2024-09-21T05:32:49.830 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T05:32:49.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T05:32:49.970 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913503 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/fsync-tester}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913503' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMBJXJm9Aach+iUQPwPj3z35N4vPwuMjYZ2AB5SjuaX1LT0x98ZFfbDqG9RNSTtTXPakZecxXHUy8rRu2smEJiU= smithi027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI8hZpzGvr69AfWLfzfj7g5g+dY1mAnbqoeFI+W4KS72RqobdtvhSw2qA7RvL5ZgNCDQWIR/Hyk0TVWlN2eGuUo= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIOFAm8SQuKWCKvBk0JFail3DZDjv4UCQ2HzDIohdsokOxImEtTjswy7en3tFSx0d/FIHfvqnnM5sc3YJE4ZliM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T05:32:49.970 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T05:32:49.971 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T05:32:49.971 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T05:32:49.972 INFO:teuthology.task.internal:Checking packages... 2024-09-21T05:32:49.994 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T05:32:49.994 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T05:32:49.994 INFO:teuthology.packaging:ref: None 2024-09-21T05:32:49.994 INFO:teuthology.packaging:tag: None 2024-09-21T05:32:49.994 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:32:49.995 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:32:49.995 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:32:50.141 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T05:32:50.142 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T05:32:50.149 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T05:32:50.150 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T05:32:50.157 INFO:teuthology.task.internal:Saving configuration 2024-09-21T05:32:50.183 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T05:32:50.193 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T05:32:50.218 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913503', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:26:48.425686', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMBJXJm9Aach+iUQPwPj3z35N4vPwuMjYZ2AB5SjuaX1LT0x98ZFfbDqG9RNSTtTXPakZecxXHUy8rRu2smEJiU='} 2024-09-21T05:32:50.239 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913503', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:26:48.423532', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI8hZpzGvr69AfWLfzfj7g5g+dY1mAnbqoeFI+W4KS72RqobdtvhSw2qA7RvL5ZgNCDQWIR/Hyk0TVWlN2eGuUo='} 2024-09-21T05:32:50.258 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913503', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:26:48.424732', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIOFAm8SQuKWCKvBk0JFail3DZDjv4UCQ2HzDIohdsokOxImEtTjswy7en3tFSx0d/FIHfvqnnM5sc3YJE4ZliM='} 2024-09-21T05:32:50.258 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T05:32:50.264 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T05:32:50.264 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T05:32:50.264 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T05:32:50.264 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T05:32:50.344 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0f073375b0>, signals=[15]) 2024-09-21T05:32:50.344 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T05:32:50.351 INFO:teuthology.task.internal:Opening connections... 2024-09-21T05:32:50.351 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T05:32:50.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:32:50.430 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2024-09-21T05:32:50.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:32:50.513 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-09-21T05:32:50.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:32:50.587 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T05:32:50.594 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-09-21T05:32:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-09-21T05:32:50.613 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-09-21T05:32:50.671 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-09-21T05:32:50.671 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-09-21T05:32:50.671 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-09-21T05:32:50.671 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:32:50.671 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-09-21T05:32:50.671 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:32:50.671 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:32:50.671 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-09-21T05:32:50.671 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:32:50.671 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:32:50.672 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:32:50.672 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:32:50.672 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:32:50.672 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:32:50.672 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-09-21T05:32:50.697 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2024-09-21T05:32:50.716 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2024-09-21T05:32:50.716 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-09-21T05:32:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2024-09-21T05:32:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9" 2024-09-21T05:32:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2024-09-21T05:32:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:32:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9" 2024-09-21T05:32:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:32:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:32:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2024-09-21T05:32:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:32:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:32:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:32:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:32:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:32:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:32:50.776 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-09-21T05:32:50.797 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-09-21T05:32:50.815 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-09-21T05:32:50.815 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-09-21T05:32:50.873 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-09-21T05:32:50.873 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-09-21T05:32:50.873 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-09-21T05:32:50.873 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:32:50.873 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-09-21T05:32:50.873 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:32:50.873 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:32:50.873 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-09-21T05:32:50.873 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:32:50.873 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:32:50.873 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:32:50.873 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:32:50.874 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:32:50.874 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:32:50.874 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-09-21T05:32:50.897 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T05:32:50.907 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T05:32:50.912 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T05:32:50.913 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:32:50.915 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:32:50.917 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:32:50.933 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T05:32:50.940 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T05:32:50.940 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:32:50.973 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:32:50.975 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:32:50.999 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T05:32:51.078 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T05:32:51.092 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T05:32:51.092 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T05:32:51.092 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T05:32:51.092 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:32:51.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:32:51.110 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-21T05:32:51.167 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-503.el9.x86_64 2024-09-21T05:32:51.167 INFO:teuthology.task.kernel:Running kernel on smithi007: 5.14.0-503.el9.x86_64 2024-09-21T05:32:51.168 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum install -y kernel 2024-09-21T05:32:54.995 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.3 MB 00:02 2024-09-21T05:32:58.229 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 20 MB 00:02 2024-09-21T05:33:04.821 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-21T05:33:06.455 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 19 kB 00:00 2024-09-21T05:33:07.592 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-21T05:33:13.215 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-21T05:33:15.172 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T05:33:15.173 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T05:33:15.260 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-09-21T05:33:15.266 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-21T05:33:15.267 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2024-09-21T05:33:15.267 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-21T05:33:15.267 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-09-21T05:33:15.267 INFO:teuthology.orchestra.run.smithi007.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T05:33:15.267 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-09-21T05:33:15.267 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T05:33:15.267 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T05:33:15.267 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T05:33:15.267 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:33:15.267 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-09-21T05:33:15.267 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-21T05:33:15.267 INFO:teuthology.orchestra.run.smithi007.stdout:Install 4 Packages 2024-09-21T05:33:15.268 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:33:15.268 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 79 M 2024-09-21T05:33:15.268 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 126 M 2024-09-21T05:33:15.268 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-09-21T05:33:15.485 INFO:teuthology.orchestra.run.smithi007.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 457 kB/s | 36 kB 00:00 2024-09-21T05:33:16.019 INFO:teuthology.orchestra.run.smithi007.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-21T05:33:16.602 INFO:teuthology.orchestra.run.smithi007.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-21T05:33:16.944 INFO:teuthology.orchestra.run.smithi007.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-21T05:33:16.944 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:33:16.945 INFO:teuthology.orchestra.run.smithi007.stdout:Total 47 MB/s | 79 MB 00:01 2024-09-21T05:33:17.662 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-09-21T05:33:18.023 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-09-21T05:33:18.024 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-09-21T05:33:19.000 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-09-21T05:33:19.000 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-09-21T05:33:21.556 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-09-21T05:33:22.205 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:33:22.286 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:33:25.033 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:33:25.187 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:33:30.319 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:33:30.363 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:33:35.505 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:34:14.908 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:34:14.949 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:34:15.362 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:34:15.362 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:34:15.362 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:34:15.362 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:34:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:34:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:34:16.238 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-09-21T05:34:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T05:34:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T05:34:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T05:34:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T05:34:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:34:16.238 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-09-21T05:34:16.591 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:34:16.677 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:34:16.677 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:34:16.678 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T05:34:16.678 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T05:34:16.678 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T05:34:16.678 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T05:34:16.678 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T05:34:16.678 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:34:16.737 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:34:16.737 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:34:16.737 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -qi grub2-tools 2024-09-21T05:34:16.768 INFO:teuthology.orchestra.run.smithi007.stdout:Name : grub2-tools 2024-09-21T05:34:16.768 INFO:teuthology.orchestra.run.smithi007.stdout:Epoch : 1 2024-09-21T05:34:16.768 INFO:teuthology.orchestra.run.smithi007.stdout:Version : 2.06 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:Release : 82.el9 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: x86_64 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:Group : Unspecified 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:Size : 8274670 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:License : GPLv3+ 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:Packager : builder@centos.org 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:Vendor : CentOS 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:Summary : Support tools for GRUB. 2024-09-21T05:34:16.769 INFO:teuthology.orchestra.run.smithi007.stdout:Description : 2024-09-21T05:34:16.770 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:34:16.770 INFO:teuthology.orchestra.run.smithi007.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T05:34:16.770 INFO:teuthology.orchestra.run.smithi007.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T05:34:16.770 INFO:teuthology.orchestra.run.smithi007.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T05:34:16.770 INFO:teuthology.orchestra.run.smithi007.stdout:hardware devices. 2024-09-21T05:34:16.770 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:34:16.770 INFO:teuthology.orchestra.run.smithi007.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T05:34:16.771 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T05:34:16.771 INFO:teuthology.task.kernel:Updating grub on smithi007 to boot 5.14.0-508.el9.x86_64 2024-09-21T05:34:16.771 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T05:34:17.457 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-09-21T05:34:18.762 INFO:teuthology.orchestra.run.smithi007.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T05:34:18.802 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-09-21T05:34:18.804 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-09-21T05:34:18.819 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.TZKWpkWP1A 2024-09-21T05:34:18.819 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TZKWpkWP1A 2024-09-21T05:34:18.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.TZKWpkWP1A 2024-09-21T05:34:19.039 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.TZKWpkWP1A is 6KB 2024-09-21T05:34:19.058 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.TZKWpkWP1A 2024-09-21T05:34:19.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T05:34:19.139 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T05:34:19.140 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T05:34:19.140 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T05:34:19.140 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T05:34:19.141 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T05:34:19.294 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2024-09-21T05:34:49.297 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T05:34:49.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T05:34:49.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:35:07.759 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-09-21T05:35:16.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T05:35:16.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:35:19.822 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-09-21T05:35:31.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T05:35:31.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:36:03.713 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-21T05:36:04.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T05:36:04.336 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T05:36:04.336 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-21T05:36:04.352 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-508.el9.x86_64 2024-09-21T05:36:04.352 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T05:36:04.352 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T05:36:04.353 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T05:36:05.353 DEBUG:teuthology.parallel:result is None 2024-09-21T05:36:05.353 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T05:36:05.361 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T05:36:05.361 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:36:05.363 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:36:05.366 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:36:05.385 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T05:36:05.391 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T05:36:05.398 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T05:36:05.398 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:36:05.421 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:36:05.426 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:36:05.467 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T05:36:05.475 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T05:36:05.475 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:36:05.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:36:05.506 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:36:05.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:36:05.524 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:36:05.526 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:36:05.548 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:36:05.590 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:36:05.596 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:36:05.601 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:36:05.612 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:36:05.618 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:36:05.618 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:36:05.620 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T05:36:05.628 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T05:36:05.628 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:36:05.630 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:36:05.633 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:36:05.689 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T05:36:05.698 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T05:36:05.698 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:36:05.701 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:36:05.703 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:36:05.746 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:36:05.795 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:36:05.852 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:36:05.937 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:36:05.981 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:36:05.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:36:06.048 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:36:06.095 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:36:06.147 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:36:06.229 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:36:06.275 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-21T05:36:06.276 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:36:06.342 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:36:06.383 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:36:06.442 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:36:06.527 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:36:06.572 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T05:36:06.572 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:36:06.640 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-09-21T05:36:06.643 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2024-09-21T05:36:06.645 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-09-21T05:36:06.683 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:36:06.687 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:36:06.720 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:36:07.132 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T05:36:07.140 INFO:teuthology.task.internal:Starting timer... 2024-09-21T05:36:07.140 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T05:36:07.163 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T05:36:07.187 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T05:36:07.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2024-09-21T05:36:07.234 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2024-09-21T05:36:07.236 DEBUG:teuthology.orchestra.run.smithi027:> sudo service auditd rotate 2024-09-21T05:36:07.296 INFO:teuthology.orchestra.run.smithi027.stdout:Rotating logs: 2024-09-21T05:36:07.298 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2024-09-21T05:36:07.359 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2024-09-21T05:36:07.361 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T05:36:07.361 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2024-09-21T05:36:07.385 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2024-09-21T05:36:07.386 DEBUG:teuthology.orchestra.run.smithi027:> /usr/sbin/getenforce 2024-09-21T05:36:07.416 INFO:teuthology.orchestra.run.smithi027.stdout:Permissive 2024-09-21T05:36:07.417 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2024-09-21T05:36:07.441 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2024-09-21T05:36:07.441 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi027.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi119.front.sepia.ceph.com': 'permissive'} 2024-09-21T05:36:07.442 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:36:07.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:36:07.471 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:36:07.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:36:07.502 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:36:07.530 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:36:07.531 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T05:36:07.531 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:36:07.565 DEBUG:teuthology.orchestra.run.smithi027:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:36:07.596 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:36:07.630 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T05:36:07.639 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T05:36:07.650 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T05:36:07.651 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi027.front.sepia.ceph.com,smithi119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T05:40:12.226 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi027.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com')] 2024-09-21T05:40:12.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T05:40:12.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:40:12.302 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-21T05:40:12.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T05:40:12.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-21T05:40:12.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:40:12.459 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-09-21T05:40:12.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-21T05:40:12.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T05:40:12.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:40:12.620 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-21T05:40:12.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T05:40:12.699 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T05:40:12.712 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T05:40:12.712 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T05:40:12.713 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:40:12.715 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T05:40:12.715 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:40:12.717 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T05:40:12.717 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:40:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T05:40:12.745 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T05:40:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T05:40:12.760 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T05:40:12.769 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T05:40:12.784 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T05:40:12.786 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: ntpd: command not found 2024-09-21T05:40:12.786 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2024-09-21T05:40:12.797 INFO:teuthology.orchestra.run.smithi027.stdout:506 Cannot talk to daemon 2024-09-21T05:40:12.797 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2024-09-21T05:40:12.809 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2024-09-21T05:40:12.812 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T05:40:12.812 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T05:40:12.820 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2024-09-21T05:40:12.826 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T05:40:12.827 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T05:40:12.834 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T05:40:12.848 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T05:40:12.883 INFO:teuthology.orchestra.run.smithi027.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:40:12.886 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:40:12.886 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2024-09-21T05:40:12.886 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:40:12.886 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:40:12.887 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:40:12.887 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:40:12.889 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:40:12.893 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:40:12.893 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-09-21T05:40:12.893 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:40:12.893 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:40:12.893 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:40:12.893 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:40:12.910 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:40:12.914 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:40:12.914 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-21T05:40:12.914 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:40:12.914 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:40:12.914 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:40:12.914 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:40:12.915 INFO:teuthology.run_tasks:Running task install... 2024-09-21T05:40:12.922 DEBUG:teuthology.task.install:project ceph 2024-09-21T05:40:12.922 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T05:40:12.923 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T05:40:12.923 INFO:teuthology.task.install:Using flavor: default 2024-09-21T05:40:12.927 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T05:40:12.927 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T05:40:12.928 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T05:40:12.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:40:12.929 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T05:40:12.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:40:12.930 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T05:40:12.931 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:40:13.084 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T05:40:13.085 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T05:40:13.088 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T05:40:13.088 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T05:40:13.091 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T05:40:13.092 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T05:40:13.194 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T05:40:13.194 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T05:40:13.194 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T05:40:13.199 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T05:40:13.199 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:40:13.199 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T05:40:13.207 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T05:40:13.207 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-21T05:40:13.207 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T05:40:13.220 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T05:40:13.221 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T05:40:13.225 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T05:40:13.226 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T05:40:13.235 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T05:40:13.235 DEBUG:teuthology.orchestra.run.smithi027:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T05:40:13.285 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T05:40:13.292 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T05:40:13.303 DEBUG:teuthology.orchestra.run.smithi027:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T05:40:13.360 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T05:40:13.369 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T05:40:13.383 DEBUG:teuthology.orchestra.run.smithi027:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T05:40:13.424 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2024-09-21T05:40:13.426 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2024-09-21T05:40:13.435 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2024-09-21T05:40:13.436 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2024-09-21T05:40:13.449 INFO:teuthology.orchestra.run.smithi027.stdout:check_obsoletes = 1 2024-09-21T05:40:13.451 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum clean all 2024-09-21T05:40:13.652 INFO:teuthology.orchestra.run.smithi119.stdout:45 files removed 2024-09-21T05:40:13.678 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T05:40:13.687 INFO:teuthology.orchestra.run.smithi027.stdout:45 files removed 2024-09-21T05:40:13.688 INFO:teuthology.orchestra.run.smithi007.stdout:45 files removed 2024-09-21T05:40:13.715 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T05:40:13.716 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T05:40:14.236 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-21T05:40:14.281 INFO:teuthology.orchestra.run.smithi027.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-09-21T05:40:14.290 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-21T05:40:14.536 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T05:40:14.565 INFO:teuthology.orchestra.run.smithi027.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-21T05:40:14.590 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-21T05:40:14.804 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-21T05:40:14.832 INFO:teuthology.orchestra.run.smithi027.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-21T05:40:14.875 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-21T05:40:15.682 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.3 MB 00:00 2024-09-21T05:40:16.453 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.3 MB 00:01 2024-09-21T05:40:17.466 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.3 MB 00:02 2024-09-21T05:40:18.296 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-21T05:40:20.684 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 20 MB 00:02 2024-09-21T05:40:22.956 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 6.5 MB 00:00 2024-09-21T05:40:24.323 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 131 kB/s | 19 kB 00:00 2024-09-21T05:40:25.252 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-21T05:40:27.384 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-21T05:40:29.177 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-21T05:40:29.325 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - AppStream 1.6 MB/s | 20 MB 00:12 2024-09-21T05:40:29.998 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-21T05:40:30.675 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-21T05:40:32.793 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:40:32.793 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:40:32.804 INFO:teuthology.orchestra.run.smithi119.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T05:40:32.805 INFO:teuthology.orchestra.run.smithi119.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T05:40:32.806 INFO:teuthology.orchestra.run.smithi119.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T05:40:32.807 INFO:teuthology.orchestra.run.smithi119.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T05:40:32.809 INFO:teuthology.orchestra.run.smithi119.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T05:40:32.811 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T05:40:32.812 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T05:40:32.875 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-21T05:40:32.892 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-09-21T05:40:32.892 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-21T05:40:32.892 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-09-21T05:40:32.892 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-21T05:40:32.892 INFO:teuthology.orchestra.run.smithi119.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T05:40:32.893 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T05:40:32.894 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T05:40:32.895 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T05:40:32.895 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T05:40:32.895 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T05:40:32.895 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T05:40:32.895 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T05:40:32.895 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T05:40:32.895 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T05:40:32.895 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T05:40:32.895 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2024-09-21T05:40:32.895 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T05:40:32.895 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T05:40:32.895 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T05:40:32.895 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T05:40:32.896 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T05:40:32.897 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T05:40:32.897 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T05:40:32.897 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T05:40:32.897 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T05:40:32.897 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T05:40:32.897 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T05:40:32.897 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T05:40:32.897 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T05:40:32.897 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T05:40:32.897 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T05:40:32.898 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T05:40:32.899 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:40:32.900 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T05:40:32.900 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T05:40:32.900 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T05:40:32.900 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T05:40:32.900 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T05:40:32.900 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T05:40:32.900 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T05:40:32.900 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T05:40:32.900 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T05:40:32.900 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T05:40:32.900 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T05:40:32.900 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T05:40:32.900 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T05:40:32.901 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T05:40:32.902 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T05:40:32.903 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout:Installing weak dependencies: 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout:Install 149 Packages 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 8 Packages 2024-09-21T05:40:32.904 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:40:32.905 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 228 M 2024-09-21T05:40:32.905 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-21T05:40:33.209 INFO:teuthology.orchestra.run.smithi119.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-09-21T05:40:33.401 INFO:teuthology.orchestra.run.smithi119.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.4 MB/s | 873 kB 00:00 2024-09-21T05:40:33.485 INFO:teuthology.orchestra.run.smithi119.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.7 MB/s | 148 kB 00:00 2024-09-21T05:40:33.576 INFO:teuthology.orchestra.run.smithi119.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T05:40:33.685 INFO:teuthology.orchestra.run.smithi119.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-21T05:40:33.727 INFO:teuthology.orchestra.run.smithi119.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 10 MB/s | 1.5 MB 00:00 2024-09-21T05:40:33.741 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-21T05:40:34.052 INFO:teuthology.orchestra.run.smithi119.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.0 MB 00:00 2024-09-21T05:40:34.253 INFO:teuthology.orchestra.run.smithi119.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T05:40:34.303 INFO:teuthology.orchestra.run.smithi119.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 506 kB/s | 25 kB 00:00 2024-09-21T05:40:34.762 INFO:teuthology.orchestra.run.smithi119.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 17 MB/s | 18 MB 00:01 2024-09-21T05:40:34.887 INFO:teuthology.orchestra.run.smithi119.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 12 MB/s | 10 MB 00:00 2024-09-21T05:40:34.912 INFO:teuthology.orchestra.run.smithi119.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.5 MB/s | 226 kB 00:00 2024-09-21T05:40:34.937 INFO:teuthology.orchestra.run.smithi119.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 539 kB/s | 27 kB 00:00 2024-09-21T05:40:34.963 INFO:teuthology.orchestra.run.smithi119.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 631 kB/s | 32 kB 00:00 2024-09-21T05:40:35.013 INFO:teuthology.orchestra.run.smithi119.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T05:40:35.038 INFO:teuthology.orchestra.run.smithi119.stdout:(16/157): libcephfs2-19.3.0-5120.g18432218.el9. 7.5 MB/s | 766 kB 00:00 2024-09-21T05:40:35.063 INFO:teuthology.orchestra.run.smithi119.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T05:40:35.097 INFO:teuthology.orchestra.run.smithi119.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.4 MB/s | 507 kB 00:00 2024-09-21T05:40:35.164 INFO:teuthology.orchestra.run.smithi119.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 679 kB/s | 45 kB 00:00 2024-09-21T05:40:35.231 INFO:teuthology.orchestra.run.smithi119.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T05:40:35.298 INFO:teuthology.orchestra.run.smithi119.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.4 MB/s | 161 kB 00:00 2024-09-21T05:40:35.365 INFO:teuthology.orchestra.run.smithi119.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 4.7 MB/s | 321 kB 00:00 2024-09-21T05:40:35.440 INFO:teuthology.orchestra.run.smithi119.stdout:(23/157): librgw2-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.3 MB 00:00 2024-09-21T05:40:35.465 INFO:teuthology.orchestra.run.smithi119.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 3.0 MB/s | 307 kB 00:00 2024-09-21T05:40:35.490 INFO:teuthology.orchestra.run.smithi119.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T05:40:35.516 INFO:teuthology.orchestra.run.smithi119.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T05:40:35.566 INFO:teuthology.orchestra.run.smithi119.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T05:40:35.628 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T05:40:35.633 INFO:teuthology.orchestra.run.smithi119.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 516 kB/s | 34 kB 00:00 2024-09-21T05:40:35.683 INFO:teuthology.orchestra.run.smithi119.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 16 MB/s | 3.1 MB 00:00 2024-09-21T05:40:35.700 INFO:teuthology.orchestra.run.smithi119.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.3 MB/s | 154 kB 00:00 2024-09-21T05:40:36.084 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-21T05:40:36.292 INFO:teuthology.orchestra.run.smithi119.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 20 MB/s | 40 MB 00:01 2024-09-21T05:40:36.409 INFO:teuthology.orchestra.run.smithi119.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 10 MB/s | 7.4 MB 00:00 2024-09-21T05:40:36.434 INFO:teuthology.orchestra.run.smithi119.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.0 MB/s | 292 kB 00:00 2024-09-21T05:40:36.451 INFO:teuthology.orchestra.run.smithi119.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 1.2 MB/s | 49 kB 00:00 2024-09-21T05:40:36.476 INFO:teuthology.orchestra.run.smithi119.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 394 kB/s | 16 kB 00:00 2024-09-21T05:40:36.510 INFO:teuthology.orchestra.run.smithi119.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T05:40:36.560 INFO:teuthology.orchestra.run.smithi119.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 9.2 MB/s | 784 kB 00:00 2024-09-21T05:40:36.611 INFO:teuthology.orchestra.run.smithi119.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 184 kB/s | 18 kB 00:00 2024-09-21T05:40:36.761 INFO:teuthology.orchestra.run.smithi119.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 13 MB/s | 14 MB 00:01 2024-09-21T05:40:36.830 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-21T05:40:36.886 INFO:teuthology.orchestra.run.smithi119.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 245 kB/s | 80 kB 00:00 2024-09-21T05:40:36.920 INFO:teuthology.orchestra.run.smithi119.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-21T05:40:36.987 INFO:teuthology.orchestra.run.smithi119.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-21T05:40:37.012 INFO:teuthology.orchestra.run.smithi119.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-09-21T05:40:37.038 INFO:teuthology.orchestra.run.smithi119.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T05:40:37.063 INFO:teuthology.orchestra.run.smithi119.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T05:40:37.088 INFO:teuthology.orchestra.run.smithi119.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T05:40:37.113 INFO:teuthology.orchestra.run.smithi119.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T05:40:37.164 INFO:teuthology.orchestra.run.smithi119.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 5.0 MB/s | 1.2 MB 00:00 2024-09-21T05:40:37.406 INFO:teuthology.orchestra.run.smithi119.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 442 kB/s | 107 kB 00:00 2024-09-21T05:40:37.473 INFO:teuthology.orchestra.run.smithi119.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-21T05:40:37.498 INFO:teuthology.orchestra.run.smithi119.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 1.6 MB/s | 689 kB 00:00 2024-09-21T05:40:37.532 INFO:teuthology.orchestra.run.smithi119.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-09-21T05:40:37.565 INFO:teuthology.orchestra.run.smithi119.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-21T05:40:37.632 INFO:teuthology.orchestra.run.smithi119.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 274 kB/s | 18 kB 00:00 2024-09-21T05:40:37.691 INFO:teuthology.orchestra.run.smithi119.stdout:(55/157): flex-2.6.4-9.el9.x86_64.rpm 1.4 MB/s | 313 kB 00:00 2024-09-21T05:40:37.716 INFO:teuthology.orchestra.run.smithi119.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-21T05:40:37.758 INFO:teuthology.orchestra.run.smithi119.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-21T05:40:37.892 INFO:teuthology.orchestra.run.smithi119.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-21T05:40:37.892 INFO:teuthology.orchestra.run.smithi119.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-09-21T05:40:37.915 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:40:37.916 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:40:37.925 INFO:teuthology.orchestra.run.smithi119.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-21T05:40:37.928 INFO:teuthology.orchestra.run.smithi007.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T05:40:37.929 INFO:teuthology.orchestra.run.smithi007.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T05:40:37.930 INFO:teuthology.orchestra.run.smithi007.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T05:40:37.931 INFO:teuthology.orchestra.run.smithi007.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T05:40:37.932 INFO:teuthology.orchestra.run.smithi007.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T05:40:37.935 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T05:40:37.936 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T05:40:37.951 INFO:teuthology.orchestra.run.smithi119.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-21T05:40:37.992 INFO:teuthology.orchestra.run.smithi119.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 367 kB/s | 24 kB 00:00 2024-09-21T05:40:38.004 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-09-21T05:40:38.018 INFO:teuthology.orchestra.run.smithi119.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-09-21T05:40:38.020 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-09-21T05:40:38.020 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2024-09-21T05:40:38.020 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T05:40:38.021 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T05:40:38.022 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T05:40:38.022 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T05:40:38.022 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T05:40:38.022 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T05:40:38.022 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T05:40:38.022 INFO:teuthology.orchestra.run.smithi007.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T05:40:38.022 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T05:40:38.022 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T05:40:38.022 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T05:40:38.022 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T05:40:38.022 INFO:teuthology.orchestra.run.smithi007.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T05:40:38.022 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T05:40:38.022 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T05:40:38.023 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T05:40:38.023 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T05:40:38.023 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T05:40:38.023 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T05:40:38.023 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T05:40:38.023 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T05:40:38.023 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T05:40:38.023 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T05:40:38.023 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T05:40:38.023 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T05:40:38.023 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T05:40:38.023 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2024-09-21T05:40:38.023 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T05:40:38.024 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T05:40:38.025 INFO:teuthology.orchestra.run.smithi007.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T05:40:38.026 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T05:40:38.026 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T05:40:38.026 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T05:40:38.026 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T05:40:38.026 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T05:40:38.026 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T05:40:38.026 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T05:40:38.026 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T05:40:38.026 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T05:40:38.026 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T05:40:38.026 INFO:teuthology.orchestra.run.smithi007.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T05:40:38.026 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T05:40:38.026 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:40:38.027 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T05:40:38.028 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T05:40:38.028 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T05:40:38.028 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T05:40:38.028 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T05:40:38.028 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T05:40:38.028 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T05:40:38.028 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T05:40:38.028 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T05:40:38.028 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T05:40:38.028 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T05:40:38.028 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T05:40:38.028 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T05:40:38.028 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T05:40:38.029 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T05:40:38.030 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T05:40:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T05:40:38.032 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T05:40:38.032 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T05:40:38.032 INFO:teuthology.orchestra.run.smithi007.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T05:40:38.032 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T05:40:38.032 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T05:40:38.032 INFO:teuthology.orchestra.run.smithi007.stdout:Installing weak dependencies: 2024-09-21T05:40:38.032 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T05:40:38.032 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:40:38.032 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-09-21T05:40:38.032 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-09-21T05:40:38.032 INFO:teuthology.orchestra.run.smithi007.stdout:Install 149 Packages 2024-09-21T05:40:38.032 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 8 Packages 2024-09-21T05:40:38.032 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:40:38.033 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 228 M 2024-09-21T05:40:38.033 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-09-21T05:40:38.093 INFO:teuthology.orchestra.run.smithi119.stdout:(64/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.3 MB/s | 3.0 MB 00:00 2024-09-21T05:40:38.118 INFO:teuthology.orchestra.run.smithi119.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-21T05:40:38.143 INFO:teuthology.orchestra.run.smithi119.stdout:(66/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-09-21T05:40:38.160 INFO:teuthology.orchestra.run.smithi119.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 575 kB/s | 38 kB 00:00 2024-09-21T05:40:38.269 INFO:teuthology.orchestra.run.smithi119.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T05:40:38.344 INFO:teuthology.orchestra.run.smithi119.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-21T05:40:38.411 INFO:teuthology.orchestra.run.smithi119.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T05:40:38.478 INFO:teuthology.orchestra.run.smithi119.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-09-21T05:40:38.620 INFO:teuthology.orchestra.run.smithi119.stdout:(72/157): postgresql-server-13.16-1.el9.x86_64. 28 MB/s | 5.8 MB 00:00 2024-09-21T05:40:38.653 INFO:teuthology.orchestra.run.smithi119.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-09-21T05:40:38.687 INFO:teuthology.orchestra.run.smithi119.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T05:40:38.754 INFO:teuthology.orchestra.run.smithi119.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 921 kB/s | 61 kB 00:00 2024-09-21T05:40:38.821 INFO:teuthology.orchestra.run.smithi119.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-21T05:40:38.880 INFO:teuthology.orchestra.run.smithi119.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-21T05:40:38.896 INFO:teuthology.orchestra.run.smithi007.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-09-21T05:40:38.938 INFO:teuthology.orchestra.run.smithi119.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2024-09-21T05:40:39.014 INFO:teuthology.orchestra.run.smithi119.stdout:(79/157): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-21T05:40:39.040 INFO:teuthology.orchestra.run.smithi119.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-09-21T05:40:39.072 INFO:teuthology.orchestra.run.smithi119.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T05:40:39.098 INFO:teuthology.orchestra.run.smithi119.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-09-21T05:40:39.130 INFO:teuthology.orchestra.run.smithi007.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.7 MB/s | 873 kB 00:00 2024-09-21T05:40:39.156 INFO:teuthology.orchestra.run.smithi119.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-21T05:40:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.9 MB/s | 148 kB 00:00 2024-09-21T05:40:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T05:40:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T05:40:39.281 INFO:teuthology.orchestra.run.smithi007.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T05:40:39.332 INFO:teuthology.orchestra.run.smithi119.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 724 kB/s | 42 kB 00:00 2024-09-21T05:40:39.399 INFO:teuthology.orchestra.run.smithi119.stdout:(87/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-21T05:40:39.406 INFO:teuthology.orchestra.run.smithi007.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-21T05:40:39.424 INFO:teuthology.orchestra.run.smithi119.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-09-21T05:40:39.458 INFO:teuthology.orchestra.run.smithi119.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-21T05:40:39.492 INFO:teuthology.orchestra.run.smithi119.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-09-21T05:40:39.498 INFO:teuthology.orchestra.run.smithi007.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 7.8 MB/s | 2.3 MB 00:00 2024-09-21T05:40:39.517 INFO:teuthology.orchestra.run.smithi119.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-09-21T05:40:39.542 INFO:teuthology.orchestra.run.smithi119.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T05:40:39.592 INFO:teuthology.orchestra.run.smithi119.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2024-09-21T05:40:39.653 INFO:teuthology.orchestra.run.smithi119.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 759 kB/s | 44 kB 00:00 2024-09-21T05:40:39.707 INFO:teuthology.orchestra.run.smithi007.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.0 MB 00:00 2024-09-21T05:40:39.710 INFO:teuthology.orchestra.run.smithi119.stdout:(95/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.8 MB/s | 4.4 MB 00:01 2024-09-21T05:40:39.768 INFO:teuthology.orchestra.run.smithi119.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 618 kB/s | 36 kB 00:00 2024-09-21T05:40:39.827 INFO:teuthology.orchestra.run.smithi119.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.2 MB/s | 221 kB 00:00 2024-09-21T05:40:39.852 INFO:teuthology.orchestra.run.smithi119.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 568 kB/s | 47 kB 00:00 2024-09-21T05:40:39.915 INFO:teuthology.orchestra.run.smithi007.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T05:40:39.919 INFO:teuthology.orchestra.run.smithi119.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 869 kB/s | 58 kB 00:00 2024-09-21T05:40:39.957 INFO:teuthology.orchestra.run.smithi007.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 608 kB/s | 25 kB 00:00 2024-09-21T05:40:39.986 INFO:teuthology.orchestra.run.smithi119.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-21T05:40:40.045 INFO:teuthology.orchestra.run.smithi119.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T05:40:40.078 INFO:teuthology.orchestra.run.smithi119.stdout:(102/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-21T05:40:40.112 INFO:teuthology.orchestra.run.smithi119.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 671 kB/s | 45 kB 00:00 2024-09-21T05:40:40.249 INFO:teuthology.orchestra.run.smithi007.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 19 MB/s | 10 MB 00:00 2024-09-21T05:40:40.299 INFO:teuthology.orchestra.run.smithi007.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T05:40:40.374 INFO:teuthology.orchestra.run.smithi007.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 361 kB/s | 27 kB 00:00 2024-09-21T05:40:40.450 INFO:teuthology.orchestra.run.smithi007.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 423 kB/s | 32 kB 00:00 2024-09-21T05:40:40.504 INFO:teuthology.orchestra.run.smithi119.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:00 2024-09-21T05:40:40.558 INFO:teuthology.orchestra.run.smithi007.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 6.9 MB/s | 766 kB 00:00 2024-09-21T05:40:40.563 INFO:teuthology.orchestra.run.smithi119.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.4 MB/s | 548 kB 00:00 2024-09-21T05:40:40.596 INFO:teuthology.orchestra.run.smithi119.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-21T05:40:40.621 INFO:teuthology.orchestra.run.smithi119.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 790 kB/s | 19 kB 00:00 2024-09-21T05:40:40.642 INFO:teuthology.orchestra.run.smithi007.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 1.9 MB/s | 158 kB 00:00 2024-09-21T05:40:40.738 INFO:teuthology.orchestra.run.smithi119.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T05:40:40.763 INFO:teuthology.orchestra.run.smithi119.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T05:40:40.789 INFO:teuthology.orchestra.run.smithi119.stdout:(110/157): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-09-21T05:40:40.814 INFO:teuthology.orchestra.run.smithi119.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 987 kB/s | 49 kB 00:00 2024-09-21T05:40:40.817 INFO:teuthology.orchestra.run.smithi007.stdout:(16/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 14 MB/s | 18 MB 00:01 2024-09-21T05:40:40.843 INFO:teuthology.orchestra.run.smithi007.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 633 kB/s | 127 kB 00:00 2024-09-21T05:40:40.848 INFO:teuthology.orchestra.run.smithi119.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.7 MB/s | 151 kB 00:00 2024-09-21T05:40:40.876 INFO:teuthology.orchestra.run.smithi007.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.5 MB/s | 507 kB 00:00 2024-09-21T05:40:40.881 INFO:teuthology.orchestra.run.smithi119.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2024-09-21T05:40:40.923 INFO:teuthology.orchestra.run.smithi119.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-21T05:40:40.935 INFO:teuthology.orchestra.run.smithi007.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 772 kB/s | 45 kB 00:00 2024-09-21T05:40:40.949 INFO:teuthology.orchestra.run.smithi119.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T05:40:40.974 INFO:teuthology.orchestra.run.smithi119.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T05:40:40.999 INFO:teuthology.orchestra.run.smithi119.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-21T05:40:41.024 INFO:teuthology.orchestra.run.smithi119.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-21T05:40:41.026 INFO:teuthology.orchestra.run.smithi007.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.6 MB/s | 148 kB 00:00 2024-09-21T05:40:41.041 INFO:teuthology.orchestra.run.smithi119.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-21T05:40:41.075 INFO:teuthology.orchestra.run.smithi119.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T05:40:41.100 INFO:teuthology.orchestra.run.smithi119.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T05:40:41.119 INFO:teuthology.orchestra.run.smithi007.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 19 MB/s | 5.3 MB 00:00 2024-09-21T05:40:41.126 INFO:teuthology.orchestra.run.smithi119.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T05:40:41.144 INFO:teuthology.orchestra.run.smithi007.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.3 MB/s | 161 kB 00:00 2024-09-21T05:40:41.159 INFO:teuthology.orchestra.run.smithi119.stdout:(123/157): protobuf-compiler-3.14.0-13.el9.x86_ 825 kB/s | 863 kB 00:01 2024-09-21T05:40:41.193 INFO:teuthology.orchestra.run.smithi119.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-09-21T05:40:41.194 INFO:teuthology.orchestra.run.smithi007.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T05:40:41.218 INFO:teuthology.orchestra.run.smithi119.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-09-21T05:40:41.219 INFO:teuthology.orchestra.run.smithi007.stdout:(24/157): python3-rados-19.3.0-5120.g18432218.e 3.1 MB/s | 321 kB 00:00 2024-09-21T05:40:41.243 INFO:teuthology.orchestra.run.smithi119.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 366 kB/s | 18 kB 00:00 2024-09-21T05:40:41.253 INFO:teuthology.orchestra.run.smithi007.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T05:40:41.279 INFO:teuthology.orchestra.run.smithi007.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T05:40:41.288 INFO:teuthology.orchestra.run.smithi119.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 332 kB/s | 23 kB 00:00 2024-09-21T05:40:41.310 INFO:teuthology.orchestra.run.smithi119.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 291 kB/s | 19 kB 00:00 2024-09-21T05:40:41.327 INFO:teuthology.orchestra.run.smithi119.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 506 kB/s | 20 kB 00:00 2024-09-21T05:40:41.344 INFO:teuthology.orchestra.run.smithi119.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-09-21T05:40:41.370 INFO:teuthology.orchestra.run.smithi119.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T05:40:41.386 INFO:teuthology.orchestra.run.smithi119.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-21T05:40:41.395 INFO:teuthology.orchestra.run.smithi007.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.4 MB/s | 170 kB 00:00 2024-09-21T05:40:41.420 INFO:teuthology.orchestra.run.smithi119.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T05:40:41.437 INFO:teuthology.orchestra.run.smithi119.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 990 kB/s | 16 kB 00:00 2024-09-21T05:40:41.462 INFO:teuthology.orchestra.run.smithi119.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T05:40:41.479 INFO:teuthology.orchestra.run.smithi007.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 14 MB/s | 3.1 MB 00:00 2024-09-21T05:40:41.488 INFO:teuthology.orchestra.run.smithi119.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T05:40:41.505 INFO:teuthology.orchestra.run.smithi007.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 315 kB/s | 34 kB 00:00 2024-09-21T05:40:41.513 INFO:teuthology.orchestra.run.smithi119.stdout:(137/157): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-21T05:40:41.530 INFO:teuthology.orchestra.run.smithi007.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T05:40:41.547 INFO:teuthology.orchestra.run.smithi119.stdout:(138/157): python3-kubernetes-26.1.0-2.el9.noar 4.3 MB/s | 1.0 MB 00:00 2024-09-21T05:40:41.572 INFO:teuthology.orchestra.run.smithi119.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T05:40:41.606 INFO:teuthology.orchestra.run.smithi119.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-09-21T05:40:41.631 INFO:teuthology.orchestra.run.smithi119.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 611 kB/s | 36 kB 00:00 2024-09-21T05:40:41.656 INFO:teuthology.orchestra.run.smithi119.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-21T05:40:41.690 INFO:teuthology.orchestra.run.smithi119.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-21T05:40:41.715 INFO:teuthology.orchestra.run.smithi119.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T05:40:41.757 INFO:teuthology.orchestra.run.smithi119.stdout:(145/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-21T05:40:41.782 INFO:teuthology.orchestra.run.smithi119.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-09-21T05:40:41.807 INFO:teuthology.orchestra.run.smithi119.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T05:40:41.833 INFO:teuthology.orchestra.run.smithi119.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-21T05:40:41.883 INFO:teuthology.orchestra.run.smithi119.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T05:40:41.897 INFO:teuthology.orchestra.run.smithi007.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 21 MB/s | 40 MB 00:01 2024-09-21T05:40:41.947 INFO:teuthology.orchestra.run.smithi007.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.7 MB/s | 292 kB 00:00 2024-09-21T05:40:42.014 INFO:teuthology.orchestra.run.smithi007.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 743 kB/s | 49 kB 00:00 2024-09-21T05:40:42.025 INFO:teuthology.orchestra.run.smithi119.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 16 MB/s | 2.3 MB 00:00 2024-09-21T05:40:42.100 INFO:teuthology.orchestra.run.smithi119.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-09-21T05:40:42.106 INFO:teuthology.orchestra.run.smithi007.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 13 MB/s | 7.4 MB 00:00 2024-09-21T05:40:42.131 INFO:teuthology.orchestra.run.smithi007.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 141 kB/s | 16 kB 00:00 2024-09-21T05:40:42.157 INFO:teuthology.orchestra.run.smithi007.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T05:40:42.159 INFO:teuthology.orchestra.run.smithi119.stdout:(152/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.7 MB/s | 3.2 MB 00:00 2024-09-21T05:40:42.184 INFO:teuthology.orchestra.run.smithi119.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 491 kB/s | 41 kB 00:00 2024-09-21T05:40:42.198 INFO:teuthology.orchestra.run.smithi007.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 444 kB/s | 18 kB 00:00 2024-09-21T05:40:42.224 INFO:teuthology.orchestra.run.smithi007.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 8.3 MB/s | 784 kB 00:00 2024-09-21T05:40:42.234 INFO:teuthology.orchestra.run.smithi119.stdout:(154/157): librados2-19.3.0-5120.g18432218.el9. 7.9 MB/s | 3.4 MB 00:00 2024-09-21T05:40:42.268 INFO:teuthology.orchestra.run.smithi119.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-21T05:40:42.299 INFO:teuthology.orchestra.run.smithi007.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 797 kB/s | 80 kB 00:00 2024-09-21T05:40:42.351 INFO:teuthology.orchestra.run.smithi119.stdout:(156/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.3 MB/s | 249 kB 00:00 2024-09-21T05:40:42.358 INFO:teuthology.orchestra.run.smithi007.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-21T05:40:42.408 INFO:teuthology.orchestra.run.smithi007.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-21T05:40:42.442 INFO:teuthology.orchestra.run.smithi007.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-21T05:40:42.483 INFO:teuthology.orchestra.run.smithi007.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-21T05:40:42.525 INFO:teuthology.orchestra.run.smithi007.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-21T05:40:42.526 INFO:teuthology.orchestra.run.smithi119.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 8.2 MB/s | 2.4 MB 00:00 2024-09-21T05:40:42.534 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:40:42.534 INFO:teuthology.orchestra.run.smithi119.stdout:Total 24 MB/s | 228 MB 00:09 2024-09-21T05:40:42.551 INFO:teuthology.orchestra.run.smithi007.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-21T05:40:42.568 INFO:teuthology.orchestra.run.smithi007.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-21T05:40:42.593 INFO:teuthology.orchestra.run.smithi007.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-09-21T05:40:42.635 INFO:teuthology.orchestra.run.smithi007.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 10 MB/s | 689 kB 00:00 2024-09-21T05:40:42.677 INFO:teuthology.orchestra.run.smithi007.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-09-21T05:40:42.702 INFO:teuthology.orchestra.run.smithi007.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-21T05:40:42.727 INFO:teuthology.orchestra.run.smithi007.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-21T05:40:42.753 INFO:teuthology.orchestra.run.smithi007.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-21T05:40:42.778 INFO:teuthology.orchestra.run.smithi007.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-21T05:40:42.820 INFO:teuthology.orchestra.run.smithi007.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-09-21T05:40:42.870 INFO:teuthology.orchestra.run.smithi007.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-21T05:40:42.920 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 3.1 kB/s | 1.7 kB 00:00 2024-09-21T05:40:42.921 INFO:teuthology.orchestra.run.smithi007.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T05:40:42.996 INFO:teuthology.orchestra.run.smithi007.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-21T05:40:43.022 INFO:teuthology.orchestra.run.smithi007.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-21T05:40:43.047 INFO:teuthology.orchestra.run.smithi007.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-21T05:40:43.080 INFO:teuthology.orchestra.run.smithi007.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-21T05:40:43.122 INFO:teuthology.orchestra.run.smithi007.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-21T05:40:43.148 INFO:teuthology.orchestra.run.smithi007.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 367 kB/s | 24 kB 00:00 2024-09-21T05:40:43.173 INFO:teuthology.orchestra.run.smithi007.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-21T05:40:43.198 INFO:teuthology.orchestra.run.smithi007.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-21T05:40:43.223 INFO:teuthology.orchestra.run.smithi007.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T05:40:43.249 INFO:teuthology.orchestra.run.smithi007.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-21T05:40:43.399 INFO:teuthology.orchestra.run.smithi007.stdout:(67/157): ceph-mgr-dashboard-19.3.0-5120.g18432 7.5 MB/s | 14 MB 00:01 2024-09-21T05:40:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-21T05:40:43.608 INFO:teuthology.orchestra.run.smithi007.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 13 MB/s | 4.9 MB 00:00 2024-09-21T05:40:43.650 INFO:teuthology.orchestra.run.smithi007.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-21T05:40:43.675 INFO:teuthology.orchestra.run.smithi007.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T05:40:43.725 INFO:teuthology.orchestra.run.smithi007.stdout:(72/157): postgresql-13.16-1.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2024-09-21T05:40:43.782 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-21T05:40:43.801 INFO:teuthology.orchestra.run.smithi007.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-21T05:40:43.826 INFO:teuthology.orchestra.run.smithi007.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 873 kB/s | 87 kB 00:00 2024-09-21T05:40:43.876 INFO:teuthology.orchestra.run.smithi007.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T05:40:43.936 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-21T05:40:43.936 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-21T05:40:43.968 INFO:teuthology.orchestra.run.smithi007.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 18 MB/s | 5.8 MB 00:00 2024-09-21T05:40:43.993 INFO:teuthology.orchestra.run.smithi007.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-21T05:40:44.019 INFO:teuthology.orchestra.run.smithi007.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-21T05:40:44.044 INFO:teuthology.orchestra.run.smithi007.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 508 kB/s | 26 kB 00:00 2024-09-21T05:40:44.069 INFO:teuthology.orchestra.run.smithi007.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-21T05:40:44.103 INFO:teuthology.orchestra.run.smithi007.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T05:40:44.128 INFO:teuthology.orchestra.run.smithi007.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-21T05:40:44.221 INFO:teuthology.orchestra.run.smithi007.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-21T05:40:44.246 INFO:teuthology.orchestra.run.smithi007.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T05:40:44.280 INFO:teuthology.orchestra.run.smithi007.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T05:40:44.305 INFO:teuthology.orchestra.run.smithi007.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T05:40:44.322 INFO:teuthology.orchestra.run.smithi007.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-21T05:40:44.355 INFO:teuthology.orchestra.run.smithi007.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T05:40:44.381 INFO:teuthology.orchestra.run.smithi007.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-21T05:40:44.406 INFO:teuthology.orchestra.run.smithi007.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T05:40:44.431 INFO:teuthology.orchestra.run.smithi007.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T05:40:44.457 INFO:teuthology.orchestra.run.smithi007.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T05:40:44.532 INFO:teuthology.orchestra.run.smithi007.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-21T05:40:44.557 INFO:teuthology.orchestra.run.smithi007.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-21T05:40:44.582 INFO:teuthology.orchestra.run.smithi007.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-09-21T05:40:44.608 INFO:teuthology.orchestra.run.smithi007.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T05:40:44.633 INFO:teuthology.orchestra.run.smithi007.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-09-21T05:40:44.658 INFO:teuthology.orchestra.run.smithi007.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 950 kB/s | 47 kB 00:00 2024-09-21T05:40:44.683 INFO:teuthology.orchestra.run.smithi007.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T05:40:44.709 INFO:teuthology.orchestra.run.smithi007.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T05:40:44.734 INFO:teuthology.orchestra.run.smithi007.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T05:40:44.759 INFO:teuthology.orchestra.run.smithi007.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T05:40:44.785 INFO:teuthology.orchestra.run.smithi007.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-21T05:40:44.893 INFO:teuthology.orchestra.run.smithi007.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-21T05:40:44.943 INFO:teuthology.orchestra.run.smithi007.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T05:40:44.977 INFO:teuthology.orchestra.run.smithi007.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T05:40:45.002 INFO:teuthology.orchestra.run.smithi007.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-21T05:40:45.138 INFO:teuthology.orchestra.run.smithi027.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:40:45.139 INFO:teuthology.orchestra.run.smithi027.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:40:45.151 INFO:teuthology.orchestra.run.smithi027.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T05:40:45.152 INFO:teuthology.orchestra.run.smithi027.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T05:40:45.153 INFO:teuthology.orchestra.run.smithi027.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T05:40:45.153 INFO:teuthology.orchestra.run.smithi027.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T05:40:45.155 INFO:teuthology.orchestra.run.smithi027.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T05:40:45.158 INFO:teuthology.orchestra.run.smithi027.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T05:40:45.158 INFO:teuthology.orchestra.run.smithi027.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T05:40:45.203 INFO:teuthology.orchestra.run.smithi007.stdout:(108/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-21T05:40:45.225 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-21T05:40:45.244 INFO:teuthology.orchestra.run.smithi007.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-21T05:40:45.250 INFO:teuthology.orchestra.run.smithi027.stdout:======================================================================================= 2024-09-21T05:40:45.250 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2024-09-21T05:40:45.250 INFO:teuthology.orchestra.run.smithi027.stdout:======================================================================================= 2024-09-21T05:40:45.250 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-21T05:40:45.250 INFO:teuthology.orchestra.run.smithi027.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T05:40:45.251 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T05:40:45.252 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T05:40:45.252 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T05:40:45.252 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T05:40:45.252 INFO:teuthology.orchestra.run.smithi027.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T05:40:45.252 INFO:teuthology.orchestra.run.smithi027.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T05:40:45.252 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T05:40:45.252 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T05:40:45.252 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T05:40:45.252 INFO:teuthology.orchestra.run.smithi027.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T05:40:45.252 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T05:40:45.252 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T05:40:45.252 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T05:40:45.252 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrading: 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T05:40:45.253 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T05:40:45.254 INFO:teuthology.orchestra.run.smithi027.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T05:40:45.254 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T05:40:45.254 INFO:teuthology.orchestra.run.smithi027.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T05:40:45.254 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T05:40:45.254 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2024-09-21T05:40:45.254 INFO:teuthology.orchestra.run.smithi027.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T05:40:45.254 INFO:teuthology.orchestra.run.smithi027.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T05:40:45.254 INFO:teuthology.orchestra.run.smithi027.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T05:40:45.254 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T05:40:45.254 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T05:40:45.254 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T05:40:45.254 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T05:40:45.255 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T05:40:45.256 INFO:teuthology.orchestra.run.smithi027.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T05:40:45.257 INFO:teuthology.orchestra.run.smithi027.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T05:40:45.257 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T05:40:45.257 INFO:teuthology.orchestra.run.smithi027.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T05:40:45.257 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T05:40:45.257 INFO:teuthology.orchestra.run.smithi027.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T05:40:45.257 INFO:teuthology.orchestra.run.smithi027.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T05:40:45.257 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T05:40:45.257 INFO:teuthology.orchestra.run.smithi027.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T05:40:45.257 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T05:40:45.257 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T05:40:45.257 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T05:40:45.258 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T05:40:45.258 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:40:45.258 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T05:40:45.258 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T05:40:45.258 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T05:40:45.258 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T05:40:45.258 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T05:40:45.258 INFO:teuthology.orchestra.run.smithi027.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T05:40:45.258 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T05:40:45.258 INFO:teuthology.orchestra.run.smithi027.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T05:40:45.258 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T05:40:45.258 INFO:teuthology.orchestra.run.smithi027.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T05:40:45.258 INFO:teuthology.orchestra.run.smithi027.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T05:40:45.259 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T05:40:45.260 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T05:40:45.261 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout:Installing weak dependencies: 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout:======================================================================================= 2024-09-21T05:40:45.262 INFO:teuthology.orchestra.run.smithi027.stdout:Install 149 Packages 2024-09-21T05:40:45.263 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrade 8 Packages 2024-09-21T05:40:45.263 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:40:45.263 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 228 M 2024-09-21T05:40:45.263 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-21T05:40:45.278 INFO:teuthology.orchestra.run.smithi007.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-09-21T05:40:45.303 INFO:teuthology.orchestra.run.smithi007.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-21T05:40:45.329 INFO:teuthology.orchestra.run.smithi007.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 593 kB/s | 49 kB 00:00 2024-09-21T05:40:45.354 INFO:teuthology.orchestra.run.smithi007.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-21T05:40:45.396 INFO:teuthology.orchestra.run.smithi007.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-21T05:40:45.421 INFO:teuthology.orchestra.run.smithi007.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T05:40:45.455 INFO:teuthology.orchestra.run.smithi007.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-21T05:40:45.480 INFO:teuthology.orchestra.run.smithi007.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 549 kB/s | 32 kB 00:00 2024-09-21T05:40:45.505 INFO:teuthology.orchestra.run.smithi007.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-21T05:40:45.564 INFO:teuthology.orchestra.run.smithi007.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-21T05:40:45.673 INFO:teuthology.orchestra.run.smithi007.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2024-09-21T05:40:45.698 INFO:teuthology.orchestra.run.smithi007.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-09-21T05:40:45.723 INFO:teuthology.orchestra.run.smithi007.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T05:40:45.746 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-21T05:40:45.746 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-21T05:40:45.748 INFO:teuthology.orchestra.run.smithi007.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T05:40:45.774 INFO:teuthology.orchestra.run.smithi007.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-21T05:40:45.799 INFO:teuthology.orchestra.run.smithi007.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-21T05:40:45.804 INFO:teuthology.orchestra.run.smithi027.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-09-21T05:40:45.825 INFO:teuthology.orchestra.run.smithi007.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 923 kB/s | 23 kB 00:00 2024-09-21T05:40:45.850 INFO:teuthology.orchestra.run.smithi007.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-21T05:40:45.875 INFO:teuthology.orchestra.run.smithi007.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-09-21T05:40:45.942 INFO:teuthology.orchestra.run.smithi007.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 4.7 MB/s | 4.4 MB 00:00 2024-09-21T05:40:45.959 INFO:teuthology.orchestra.run.smithi007.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-21T05:40:45.984 INFO:teuthology.orchestra.run.smithi007.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T05:40:46.001 INFO:teuthology.orchestra.run.smithi007.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-21T05:40:46.012 INFO:teuthology.orchestra.run.smithi027.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.1 MB/s | 873 kB 00:00 2024-09-21T05:40:46.050 INFO:teuthology.orchestra.run.smithi007.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 5.6 MB/s | 272 kB 00:00 2024-09-21T05:40:46.068 INFO:teuthology.orchestra.run.smithi007.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 889 kB/s | 16 kB 00:00 2024-09-21T05:40:46.094 INFO:teuthology.orchestra.run.smithi007.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T05:40:46.096 INFO:teuthology.orchestra.run.smithi027.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.7 MB/s | 148 kB 00:00 2024-09-21T05:40:46.119 INFO:teuthology.orchestra.run.smithi007.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T05:40:46.152 INFO:teuthology.orchestra.run.smithi007.stdout:(137/157): python3-kubernetes-26.1.0-2.el9.noar 3.7 MB/s | 1.0 MB 00:00 2024-09-21T05:40:46.171 INFO:teuthology.orchestra.run.smithi027.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T05:40:46.178 INFO:teuthology.orchestra.run.smithi007.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2024-09-21T05:40:46.203 INFO:teuthology.orchestra.run.smithi007.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T05:40:46.229 INFO:teuthology.orchestra.run.smithi007.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T05:40:46.254 INFO:teuthology.orchestra.run.smithi007.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-21T05:40:46.279 INFO:teuthology.orchestra.run.smithi007.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T05:40:46.288 INFO:teuthology.orchestra.run.smithi027.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 13 MB/s | 1.5 MB 00:00 2024-09-21T05:40:46.330 INFO:teuthology.orchestra.run.smithi007.stdout:(143/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-21T05:40:46.347 INFO:teuthology.orchestra.run.smithi027.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 9.1 MB/s | 2.3 MB 00:00 2024-09-21T05:40:46.355 INFO:teuthology.orchestra.run.smithi007.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-21T05:40:46.380 INFO:teuthology.orchestra.run.smithi007.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-21T05:40:46.406 INFO:teuthology.orchestra.run.smithi007.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-21T05:40:46.439 INFO:teuthology.orchestra.run.smithi007.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-21T05:40:46.464 INFO:teuthology.orchestra.run.smithi007.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-21T05:40:46.523 INFO:teuthology.orchestra.run.smithi007.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-21T05:40:46.572 INFO:teuthology.orchestra.run.smithi027.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 18 MB/s | 5.0 MB 00:00 2024-09-21T05:40:46.723 INFO:teuthology.orchestra.run.smithi007.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-21T05:40:46.773 INFO:teuthology.orchestra.run.smithi027.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T05:40:46.814 INFO:teuthology.orchestra.run.smithi027.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 606 kB/s | 25 kB 00:00 2024-09-21T05:40:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 20 MB/s | 1.8 MB 00:00 2024-09-21T05:40:46.874 INFO:teuthology.orchestra.run.smithi007.stdout:(152/157): librados2-19.3.0-5120.g18432218.el9. 7.8 MB/s | 3.4 MB 00:00 2024-09-21T05:40:46.899 INFO:teuthology.orchestra.run.smithi007.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 491 kB/s | 41 kB 00:00 2024-09-21T05:40:46.966 INFO:teuthology.orchestra.run.smithi007.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-21T05:40:47.016 INFO:teuthology.orchestra.run.smithi007.stdout:(155/157): librbd1-19.3.0-5120.g18432218.el9.x8 5.7 MB/s | 3.2 MB 00:00 2024-09-21T05:40:47.067 INFO:teuthology.orchestra.run.smithi007.stdout:(156/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.3 MB/s | 249 kB 00:00 2024-09-21T05:40:47.108 INFO:teuthology.orchestra.run.smithi007.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-09-21T05:40:47.115 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:40:47.115 INFO:teuthology.orchestra.run.smithi007.stdout:Total 25 MB/s | 228 MB 00:09 2024-09-21T05:40:47.198 INFO:teuthology.orchestra.run.smithi027.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 17 MB/s | 10 MB 00:00 2024-09-21T05:40:47.248 INFO:teuthology.orchestra.run.smithi027.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T05:40:47.315 INFO:teuthology.orchestra.run.smithi027.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 406 kB/s | 27 kB 00:00 2024-09-21T05:40:47.374 INFO:teuthology.orchestra.run.smithi027.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 546 kB/s | 32 kB 00:00 2024-09-21T05:40:47.466 INFO:teuthology.orchestra.run.smithi027.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.2 MB/s | 766 kB 00:00 2024-09-21T05:40:47.533 INFO:teuthology.orchestra.run.smithi027.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T05:40:47.600 INFO:teuthology.orchestra.run.smithi027.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.9 MB/s | 127 kB 00:00 2024-09-21T05:40:47.800 INFO:teuthology.orchestra.run.smithi027.stdout:(17/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 12 MB/s | 18 MB 00:01 2024-09-21T05:40:47.842 INFO:teuthology.orchestra.run.smithi027.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 2.0 MB/s | 507 kB 00:00 2024-09-21T05:40:47.901 INFO:teuthology.orchestra.run.smithi027.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 770 kB/s | 45 kB 00:00 2024-09-21T05:40:47.976 INFO:teuthology.orchestra.run.smithi027.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.9 MB/s | 148 kB 00:00 2024-09-21T05:40:48.043 INFO:teuthology.orchestra.run.smithi027.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.4 MB/s | 161 kB 00:00 2024-09-21T05:40:48.118 INFO:teuthology.orchestra.run.smithi027.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 4.2 MB/s | 321 kB 00:00 2024-09-21T05:40:48.210 INFO:teuthology.orchestra.run.smithi027.stdout:(23/157): librgw2-19.3.0-5120.g18432218.el9.x86 13 MB/s | 5.3 MB 00:00 2024-09-21T05:40:48.235 INFO:teuthology.orchestra.run.smithi027.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 2.6 MB/s | 307 kB 00:00 2024-09-21T05:40:48.261 INFO:teuthology.orchestra.run.smithi027.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T05:40:48.286 INFO:teuthology.orchestra.run.smithi027.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T05:40:48.385 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-09-21T05:40:48.557 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-09-21T05:40:48.558 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-09-21T05:40:48.662 INFO:teuthology.orchestra.run.smithi027.stdout:(27/157): ceph-test-19.3.0-5120.g18432218.el9.x 22 MB/s | 40 MB 00:01 2024-09-21T05:40:48.687 INFO:teuthology.orchestra.run.smithi027.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 425 kB/s | 170 kB 00:00 2024-09-21T05:40:48.712 INFO:teuthology.orchestra.run.smithi027.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 688 kB/s | 34 kB 00:00 2024-09-21T05:40:48.737 INFO:teuthology.orchestra.run.smithi027.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T05:40:48.804 INFO:teuthology.orchestra.run.smithi027.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 5.7 MB/s | 3.1 MB 00:00 2024-09-21T05:40:48.879 INFO:teuthology.orchestra.run.smithi027.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.8 MB/s | 292 kB 00:00 2024-09-21T05:40:48.955 INFO:teuthology.orchestra.run.smithi027.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 658 kB/s | 49 kB 00:00 2024-09-21T05:40:49.030 INFO:teuthology.orchestra.run.smithi027.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 220 kB/s | 16 kB 00:00 2024-09-21T05:40:49.113 INFO:teuthology.orchestra.run.smithi027.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 3.4 MB/s | 285 kB 00:00 2024-09-21T05:40:49.256 INFO:teuthology.orchestra.run.smithi027.stdout:(36/157): ceph-mgr-diskprediction-local-19.3.0- 14 MB/s | 7.4 MB 00:00 2024-09-21T05:40:49.406 INFO:teuthology.orchestra.run.smithi027.stdout:(37/157): ceph-mgr-dashboard-19.3.0-5120.g18432 20 MB/s | 14 MB 00:00 2024-09-21T05:40:49.473 INFO:teuthology.orchestra.run.smithi027.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 85 kB/s | 18 kB 00:00 2024-09-21T05:40:49.506 INFO:teuthology.orchestra.run.smithi027.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 2.0 MB/s | 784 kB 00:00 2024-09-21T05:40:49.615 INFO:teuthology.orchestra.run.smithi027.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 382 kB/s | 80 kB 00:00 2024-09-21T05:40:49.699 INFO:teuthology.orchestra.run.smithi027.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-21T05:40:49.723 INFO:teuthology.orchestra.run.smithi027.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 881 kB/s | 191 kB 00:00 2024-09-21T05:40:49.757 INFO:teuthology.orchestra.run.smithi027.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-21T05:40:49.782 INFO:teuthology.orchestra.run.smithi027.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T05:40:49.817 INFO:teuthology.orchestra.run.smithi027.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-21T05:40:49.858 INFO:teuthology.orchestra.run.smithi027.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-09-21T05:40:49.875 INFO:teuthology.orchestra.run.smithi027.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-21T05:40:49.901 INFO:teuthology.orchestra.run.smithi027.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-21T05:40:50.076 INFO:teuthology.orchestra.run.smithi027.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 611 kB/s | 107 kB 00:00 2024-09-21T05:40:50.126 INFO:teuthology.orchestra.run.smithi027.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 436 kB/s | 22 kB 00:00 2024-09-21T05:40:50.160 INFO:teuthology.orchestra.run.smithi027.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-21T05:40:50.202 INFO:teuthology.orchestra.run.smithi027.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-21T05:40:50.227 INFO:teuthology.orchestra.run.smithi027.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-09-21T05:40:50.252 INFO:teuthology.orchestra.run.smithi027.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-21T05:40:50.277 INFO:teuthology.orchestra.run.smithi027.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-21T05:40:50.294 INFO:teuthology.orchestra.run.smithi027.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-21T05:40:50.336 INFO:teuthology.orchestra.run.smithi027.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-21T05:40:50.362 INFO:teuthology.orchestra.run.smithi027.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-21T05:40:50.388 INFO:teuthology.orchestra.run.smithi027.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 884 kB/s | 45 kB 00:00 2024-09-21T05:40:50.505 INFO:teuthology.orchestra.run.smithi027.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-21T05:40:50.539 INFO:teuthology.orchestra.run.smithi027.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-21T05:40:50.564 INFO:teuthology.orchestra.run.smithi027.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T05:40:50.589 INFO:teuthology.orchestra.run.smithi027.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-21T05:40:50.648 INFO:teuthology.orchestra.run.smithi027.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-21T05:40:50.673 INFO:teuthology.orchestra.run.smithi027.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-21T05:40:50.698 INFO:teuthology.orchestra.run.smithi027.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-21T05:40:50.823 INFO:teuthology.orchestra.run.smithi027.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.8 MB/s | 3.0 MB 00:00 2024-09-21T05:40:50.935 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-09-21T05:40:50.936 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-09-21T05:40:51.099 INFO:teuthology.orchestra.run.smithi027.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 5.8 MB/s | 1.6 MB 00:00 2024-09-21T05:40:51.274 INFO:teuthology.orchestra.run.smithi027.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-21T05:40:51.332 INFO:teuthology.orchestra.run.smithi027.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T05:40:51.458 INFO:teuthology.orchestra.run.smithi027.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-09-21T05:40:51.583 INFO:teuthology.orchestra.run.smithi027.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 5.4 MB/s | 4.9 MB 00:00 2024-09-21T05:40:51.633 INFO:teuthology.orchestra.run.smithi027.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-21T05:40:51.675 INFO:teuthology.orchestra.run.smithi027.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-21T05:40:51.726 INFO:teuthology.orchestra.run.smithi027.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T05:40:51.809 INFO:teuthology.orchestra.run.smithi027.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-21T05:40:51.893 INFO:teuthology.orchestra.run.smithi027.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-21T05:40:51.943 INFO:teuthology.orchestra.run.smithi027.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-21T05:40:51.993 INFO:teuthology.orchestra.run.smithi027.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-21T05:40:52.060 INFO:teuthology.orchestra.run.smithi027.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-21T05:40:52.111 INFO:teuthology.orchestra.run.smithi027.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 697 kB/s | 35 kB 00:00 2024-09-21T05:40:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-21T05:40:52.295 INFO:teuthology.orchestra.run.smithi027.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 6.0 MB/s | 5.8 MB 00:00 2024-09-21T05:40:52.313 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T05:40:52.353 INFO:teuthology.orchestra.run.smithi027.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-21T05:40:52.411 INFO:teuthology.orchestra.run.smithi027.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T05:40:52.436 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T05:40:52.520 INFO:teuthology.orchestra.run.smithi027.stdout:(85/157): python3-babel-2.9.1-2.el9.noarch.rpm 6.7 MB/s | 6.0 MB 00:00 2024-09-21T05:40:52.545 INFO:teuthology.orchestra.run.smithi027.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 577 kB/s | 77 kB 00:00 2024-09-21T05:40:52.571 INFO:teuthology.orchestra.run.smithi027.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-21T05:40:52.582 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T05:40:52.621 INFO:teuthology.orchestra.run.smithi027.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T05:40:52.623 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T05:40:52.648 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T05:40:52.654 INFO:teuthology.orchestra.run.smithi027.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-09-21T05:40:52.700 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T05:40:52.713 INFO:teuthology.orchestra.run.smithi027.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-09-21T05:40:52.738 INFO:teuthology.orchestra.run.smithi027.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-21T05:40:52.763 INFO:teuthology.orchestra.run.smithi027.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T05:40:52.839 INFO:teuthology.orchestra.run.smithi027.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 556 kB/s | 42 kB 00:00 2024-09-21T05:40:52.922 INFO:teuthology.orchestra.run.smithi027.stdout:(94/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.3 MB/s | 5.1 MB 00:00 2024-09-21T05:40:52.948 INFO:teuthology.orchestra.run.smithi027.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 406 kB/s | 44 kB 00:00 2024-09-21T05:40:52.973 INFO:teuthology.orchestra.run.smithi027.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T05:40:52.998 INFO:teuthology.orchestra.run.smithi027.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-21T05:40:53.023 INFO:teuthology.orchestra.run.smithi027.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-21T05:40:53.082 INFO:teuthology.orchestra.run.smithi027.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 994 kB/s | 58 kB 00:00 2024-09-21T05:40:53.093 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T05:40:53.107 INFO:teuthology.orchestra.run.smithi027.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-21T05:40:53.141 INFO:teuthology.orchestra.run.smithi027.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T05:40:53.158 INFO:teuthology.orchestra.run.smithi027.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T05:40:53.165 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:40:53.191 INFO:teuthology.orchestra.run.smithi027.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-21T05:40:53.233 INFO:teuthology.orchestra.run.smithi027.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-09-21T05:40:53.292 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:40:53.301 INFO:teuthology.orchestra.run.smithi027.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-21T05:40:53.325 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:40:53.342 INFO:teuthology.orchestra.run.smithi027.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 7.3 MB/s | 308 kB 00:00 2024-09-21T05:40:53.368 INFO:teuthology.orchestra.run.smithi027.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-21T05:40:53.393 INFO:teuthology.orchestra.run.smithi027.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-09-21T05:40:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:40:53.429 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:40:53.435 INFO:teuthology.orchestra.run.smithi027.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 625 kB/s | 26 kB 00:00 2024-09-21T05:40:53.459 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T05:40:53.469 INFO:teuthology.orchestra.run.smithi027.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-21T05:40:53.494 INFO:teuthology.orchestra.run.smithi027.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T05:40:53.519 INFO:teuthology.orchestra.run.smithi027.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-21T05:40:53.570 INFO:teuthology.orchestra.run.smithi027.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-21T05:40:53.612 INFO:teuthology.orchestra.run.smithi027.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T05:40:53.613 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T05:40:53.637 INFO:teuthology.orchestra.run.smithi027.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T05:40:53.660 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T05:40:53.662 INFO:teuthology.orchestra.run.smithi027.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T05:40:53.688 INFO:teuthology.orchestra.run.smithi027.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-21T05:40:53.689 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:40:53.721 INFO:teuthology.orchestra.run.smithi027.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-21T05:40:53.755 INFO:teuthology.orchestra.run.smithi027.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-21T05:40:53.788 INFO:teuthology.orchestra.run.smithi027.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-21T05:40:53.795 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:40:53.822 INFO:teuthology.orchestra.run.smithi027.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-21T05:40:53.823 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:40:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:40:53.889 INFO:teuthology.orchestra.run.smithi027.stdout:(122/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.5 MB/s | 4.4 MB 00:00 2024-09-21T05:40:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:40:53.914 INFO:teuthology.orchestra.run.smithi027.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T05:40:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:40:53.939 INFO:teuthology.orchestra.run.smithi027.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-21T05:40:53.965 INFO:teuthology.orchestra.run.smithi027.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-21T05:40:53.990 INFO:teuthology.orchestra.run.smithi027.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-21T05:40:54.007 INFO:teuthology.orchestra.run.smithi027.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-21T05:40:54.024 INFO:teuthology.orchestra.run.smithi027.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-21T05:40:54.083 INFO:teuthology.orchestra.run.smithi027.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-21T05:40:54.100 INFO:teuthology.orchestra.run.smithi027.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-21T05:40:54.124 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:40:54.125 INFO:teuthology.orchestra.run.smithi027.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T05:40:54.167 INFO:teuthology.orchestra.run.smithi027.stdout:(132/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-09-21T05:40:54.192 INFO:teuthology.orchestra.run.smithi027.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-09-21T05:40:54.217 INFO:teuthology.orchestra.run.smithi027.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-21T05:40:54.243 INFO:teuthology.orchestra.run.smithi027.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T05:40:54.266 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:40:54.268 INFO:teuthology.orchestra.run.smithi027.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-21T05:40:54.293 INFO:teuthology.orchestra.run.smithi027.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-21T05:40:54.319 INFO:teuthology.orchestra.run.smithi027.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-21T05:40:54.344 INFO:teuthology.orchestra.run.smithi027.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T05:40:54.369 INFO:teuthology.orchestra.run.smithi027.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T05:40:54.380 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T05:40:54.395 INFO:teuthology.orchestra.run.smithi027.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-21T05:40:54.420 INFO:teuthology.orchestra.run.smithi027.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T05:40:54.445 INFO:teuthology.orchestra.run.smithi027.stdout:(143/157): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-21T05:40:54.471 INFO:teuthology.orchestra.run.smithi027.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T05:40:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:40:54.496 INFO:teuthology.orchestra.run.smithi027.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-21T05:40:54.529 INFO:teuthology.orchestra.run.smithi027.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-21T05:40:54.555 INFO:teuthology.orchestra.run.smithi027.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-21T05:40:54.557 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:40:54.730 INFO:teuthology.orchestra.run.smithi027.stdout:(148/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.2 MB/s | 16 MB 00:01 2024-09-21T05:40:54.782 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:40:54.788 INFO:teuthology.orchestra.run.smithi027.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-09-21T05:40:54.900 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T05:40:54.905 INFO:teuthology.orchestra.run.smithi027.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 9.7 MB/s | 3.4 MB 00:00 2024-09-21T05:40:54.928 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T05:40:54.963 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T05:40:54.972 INFO:teuthology.orchestra.run.smithi027.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-21T05:40:55.015 INFO:teuthology.orchestra.run.smithi027.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 984 kB/s | 41 kB 00:00 2024-09-21T05:40:55.036 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T05:40:55.073 INFO:teuthology.orchestra.run.smithi027.stdout:(153/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.2 MB/s | 3.2 MB 00:00 2024-09-21T05:40:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T05:40:55.098 INFO:teuthology.orchestra.run.smithi027.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.9 MB/s | 249 kB 00:00 2024-09-21T05:40:55.137 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T05:40:55.140 INFO:teuthology.orchestra.run.smithi027.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 7.7 MB/s | 1.8 MB 00:00 2024-09-21T05:40:55.181 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T05:40:55.213 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T05:40:55.223 INFO:teuthology.orchestra.run.smithi027.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-09-21T05:40:55.241 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T05:40:55.257 INFO:teuthology.orchestra.run.smithi027.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 7.4 MB/s | 1.4 MB 00:00 2024-09-21T05:40:55.262 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:40:55.262 INFO:teuthology.orchestra.run.smithi027.stdout:Total 23 MB/s | 228 MB 00:10 2024-09-21T05:40:55.310 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T05:40:55.363 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T05:40:55.397 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T05:40:55.432 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T05:40:55.513 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T05:40:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T05:40:55.594 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T05:40:55.632 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T05:40:55.701 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T05:40:55.746 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T05:40:55.828 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T05:40:55.961 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T05:40:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T05:40:56.526 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T05:40:56.537 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-21T05:40:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T05:40:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T05:40:56.682 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T05:40:56.708 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-21T05:40:56.708 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-21T05:40:56.720 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T05:40:56.762 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T05:40:56.933 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T05:40:56.981 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T05:40:57.073 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T05:40:57.138 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T05:40:57.210 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T05:40:57.242 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T05:40:57.278 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T05:40:57.324 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T05:40:57.354 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T05:40:57.393 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-09-21T05:40:57.397 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T05:40:57.439 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T05:40:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T05:40:57.574 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T05:40:57.575 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T05:40:57.616 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T05:40:57.630 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T05:40:57.657 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T05:40:57.663 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T05:40:57.689 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T05:40:57.743 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T05:40:57.760 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T05:40:57.791 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T05:40:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T05:40:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T05:40:57.881 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T05:40:57.955 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T05:40:58.209 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T05:40:58.247 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T05:40:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T05:40:58.297 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T05:40:58.309 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T05:40:58.348 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T05:40:58.380 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T05:40:58.393 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:40:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T05:40:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T05:40:58.469 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T05:40:58.510 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T05:40:58.522 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:40:58.545 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T05:40:58.552 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:40:58.638 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-21T05:40:58.639 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-21T05:40:58.645 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:40:58.656 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T05:40:58.673 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:40:58.700 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T05:40:58.704 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T05:40:58.731 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T05:40:58.833 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T05:40:58.897 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T05:40:58.898 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T05:40:58.955 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T05:40:58.982 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:40:59.089 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:40:59.109 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:40:59.165 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:40:59.185 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:40:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:40:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:40:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:40:59.613 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T05:40:59.655 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T05:40:59.688 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T05:40:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T05:40:59.794 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T05:40:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:40:59.860 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T05:40:59.905 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T05:40:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:40:59.991 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T05:41:00.024 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T05:41:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:41:00.207 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T05:41:00.238 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T05:41:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T05:41:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T05:41:00.315 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T05:41:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T05:41:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T05:41:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T05:41:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T05:41:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T05:41:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T05:41:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T05:41:00.674 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T05:41:00.735 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T05:41:00.764 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T05:41:00.808 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T05:41:00.892 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T05:41:00.927 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T05:41:00.945 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T05:41:00.971 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T05:41:00.999 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T05:41:01.053 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T05:41:01.074 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T05:41:01.123 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T05:41:01.201 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T05:41:01.349 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T05:41:01.402 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T05:41:01.973 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T05:41:02.066 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T05:41:02.099 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T05:41:02.143 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T05:41:02.182 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T05:41:02.224 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T05:41:02.265 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T05:41:02.342 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T05:41:02.370 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T05:41:02.395 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T05:41:02.403 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T05:41:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T05:41:02.555 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T05:41:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T05:41:02.700 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T05:41:02.730 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T05:41:02.736 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T05:41:02.772 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T05:41:02.783 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:41:02.821 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T05:41:02.858 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:41:02.863 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T05:41:02.887 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T05:41:02.907 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T05:41:02.923 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T05:41:03.017 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T05:41:03.186 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T05:41:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T05:41:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T05:41:03.384 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T05:41:03.418 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T05:41:03.426 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T05:41:03.452 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:41:03.458 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T05:41:03.491 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T05:41:03.506 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:41:03.516 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T05:41:03.554 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T05:41:03.626 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T05:41:03.758 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T05:41:03.790 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T05:41:03.819 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T05:41:03.853 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T05:41:03.892 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T05:41:03.932 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T05:41:03.962 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T05:41:03.996 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T05:41:04.030 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T05:41:04.075 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T05:41:04.109 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T05:41:04.200 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T05:41:04.249 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T05:41:04.280 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T05:41:04.389 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T05:41:04.440 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T05:41:05.248 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T05:41:05.294 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T05:41:05.299 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-21T05:41:05.328 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T05:41:05.369 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T05:41:05.408 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T05:41:05.435 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T05:41:05.471 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T05:41:05.492 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T05:41:05.504 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T05:41:05.529 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T05:41:05.537 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T05:41:05.581 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T05:41:05.628 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T05:41:05.664 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T05:41:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:41:05.856 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T05:41:05.886 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T05:41:05.938 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T05:41:05.966 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T05:41:06.047 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:41:06.058 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:41:06.159 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:41:06.181 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:41:06.257 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:41:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:41:06.315 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T05:41:06.476 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T05:41:06.525 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T05:41:06.553 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:41:06.632 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:41:06.661 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:41:06.665 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T05:41:06.670 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:41:06.704 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:41:06.758 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:41:06.764 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:41:06.764 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T05:41:06.764 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T05:41:06.764 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:41:06.780 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:41:06.795 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T05:41:06.796 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:41:06.805 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:41:07.000 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:41:07.135 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:41:07.320 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T05:41:07.418 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:41:07.513 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:41:07.736 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:41:07.846 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T05:41:07.875 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T05:41:07.911 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T05:41:07.987 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T05:41:08.037 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T05:41:08.077 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T05:41:08.120 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T05:41:08.153 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T05:41:08.158 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T05:41:08.181 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T05:41:08.252 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T05:41:08.304 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T05:41:08.321 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T05:41:08.333 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T05:41:08.350 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T05:41:08.369 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T05:41:08.382 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T05:41:08.453 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T05:41:08.488 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T05:41:08.524 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T05:41:08.551 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T05:41:08.628 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T05:41:08.670 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T05:41:08.726 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T05:41:08.748 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T05:41:08.770 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:41:08.863 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:41:08.892 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T05:41:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T05:41:08.928 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T05:41:08.949 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T05:41:09.464 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T05:41:09.490 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:41:09.506 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T05:41:09.553 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:41:09.583 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T05:41:09.604 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T05:41:09.638 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T05:41:09.681 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T05:41:09.720 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T05:41:09.762 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T05:41:09.934 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T05:41:09.997 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T05:41:10.093 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T05:41:10.155 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T05:41:10.228 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T05:41:10.266 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T05:41:10.302 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T05:41:10.350 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T05:41:10.385 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T05:41:10.428 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T05:41:10.471 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T05:41:10.614 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T05:41:10.665 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T05:41:10.706 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T05:41:10.815 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T05:41:10.847 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T05:41:10.887 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T05:41:10.913 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T05:41:10.937 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T05:41:11.015 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T05:41:11.168 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T05:41:11.203 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T05:41:11.231 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T05:41:11.265 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T05:41:11.305 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T05:41:11.345 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T05:41:11.374 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T05:41:11.409 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T05:41:11.492 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T05:41:11.758 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T05:41:11.828 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T05:41:11.923 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T05:41:11.945 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:41:11.970 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T05:41:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:41:12.005 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T05:41:12.114 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T05:41:12.174 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T05:41:12.584 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:41:12.625 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:41:12.719 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:41:12.719 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T05:41:12.719 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T05:41:12.719 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:41:12.760 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:41:12.940 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T05:41:12.987 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T05:41:13.020 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T05:41:13.124 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T05:41:13.168 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T05:41:13.213 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T05:41:13.303 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T05:41:13.348 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T05:41:13.539 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T05:41:13.570 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T05:41:13.649 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T05:41:14.334 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T05:41:14.441 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T05:41:15.741 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T05:41:15.826 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T05:41:15.854 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T05:41:15.887 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T05:41:16.221 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T05:41:16.266 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:41:16.350 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:41:16.379 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T05:41:16.416 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T05:41:16.941 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T05:41:16.994 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:41:17.066 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:41:17.171 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T05:41:18.675 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:41:18.675 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2024-09-21T05:41:18.675 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2024-09-21T05:41:18.675 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2024-09-21T05:41:18.675 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2024-09-21T05:41:18.675 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2024-09-21T05:41:18.675 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /root 2024-09-21T05:41:18.675 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2024-09-21T05:41:18.675 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:41:18.857 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:41:18.874 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:41:18.875 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:18.875 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T05:41:18.875 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:41:19.555 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:41:19.584 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:41:20.185 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:41:20.228 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:41:20.323 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:41:20.323 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T05:41:20.323 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T05:41:20.323 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:41:20.355 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:41:20.460 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:41:20.488 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:41:20.488 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:20.488 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T05:41:20.488 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:41:20.488 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:41:20.489 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:41:20.711 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:41:20.735 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:41:20.735 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:20.735 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T05:41:20.735 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:41:20.735 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:41:20.735 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:41:21.212 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:41:21.235 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:41:21.235 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:21.235 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T05:41:21.235 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:41:21.235 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:41:21.235 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:41:21.342 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T05:41:21.398 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T05:41:21.453 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T05:41:21.639 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T05:41:21.687 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T05:41:21.764 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T05:41:21.852 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T05:41:21.991 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T05:41:22.036 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T05:41:22.069 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T05:41:22.096 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T05:41:22.558 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:41:22.587 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:41:22.619 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T05:41:22.686 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T05:41:22.710 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:41:24.830 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:41:24.830 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2024-09-21T05:41:24.830 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2024-09-21T05:41:24.830 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2024-09-21T05:41:24.830 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2024-09-21T05:41:24.830 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2024-09-21T05:41:24.830 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /root 2024-09-21T05:41:24.831 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2024-09-21T05:41:24.831 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:41:25.006 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:41:25.023 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:41:25.023 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:25.023 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T05:41:25.023 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:41:25.895 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:41:25.958 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:41:26.676 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:41:26.705 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:41:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T05:41:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:41:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:41:26.705 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:41:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:41:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:41:26.949 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:41:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:41:26.968 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:26.968 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T05:41:26.969 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:41:26.969 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:41:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:41:27.064 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:41:27.233 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T05:41:27.268 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:41:27.293 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:41:27.293 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:27.293 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T05:41:27.293 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:41:27.293 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:41:27.294 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:41:27.336 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:41:27.347 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:41:27.438 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T05:41:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:41:27.483 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T05:41:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:41:27.486 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:27.486 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T05:41:27.486 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:41:27.486 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:41:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:41:27.600 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T05:41:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T05:41:27.731 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T05:41:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T05:41:27.980 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T05:41:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T05:41:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T05:41:28.328 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T05:41:28.371 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T05:41:28.403 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T05:41:28.430 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T05:41:28.447 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T05:41:28.480 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:41:28.504 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:41:28.504 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:28.504 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T05:41:28.504 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:41:28.504 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:41:28.504 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:41:28.547 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:41:28.570 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:41:28.570 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:28.570 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T05:41:28.570 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:41:28.623 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:41:28.647 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:41:28.647 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:28.647 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T05:41:28.647 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:41:28.647 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:41:28.647 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:41:28.885 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:41:28.913 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:41:28.946 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T05:41:28.994 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:41:28.994 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:41:28.994 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:28.994 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T05:41:28.994 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:41:28.994 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:41:28.994 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:41:29.014 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T05:41:29.044 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:41:32.485 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:41:32.542 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:41:32.621 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:41:32.621 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /sys 2024-09-21T05:41:32.621 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /proc 2024-09-21T05:41:32.621 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /mnt 2024-09-21T05:41:32.621 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /var/tmp 2024-09-21T05:41:32.621 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /home 2024-09-21T05:41:32.621 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /root 2024-09-21T05:41:32.621 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /tmp 2024-09-21T05:41:32.622 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:41:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:41:32.826 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:41:32.826 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:32.826 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T05:41:32.826 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:41:33.069 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T05:41:33.110 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T05:41:33.150 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T05:41:33.205 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T05:41:33.235 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T05:41:33.416 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T05:41:33.457 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T05:41:33.487 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T05:41:33.517 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T05:41:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:41:33.563 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T05:41:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:41:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:41:33.892 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T05:41:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:41:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:41:33.945 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:33.945 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T05:41:33.945 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:41:33.945 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:41:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:41:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:41:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:41:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T05:41:34.126 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:41:34.160 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:41:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T05:41:34.181 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:41:34.462 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:41:34.491 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:41:34.491 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:34.491 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T05:41:34.491 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:41:34.491 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:41:34.491 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:41:34.729 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:41:34.753 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:41:34.753 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:34.753 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T05:41:34.754 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:41:34.754 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:41:34.754 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:41:35.015 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T05:41:35.107 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T05:41:35.148 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T05:41:35.190 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T05:41:35.222 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:41:35.229 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T05:41:35.246 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:41:35.247 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:41:35.247 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:35.247 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T05:41:35.247 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:41:35.248 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:41:35.248 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:41:35.260 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T05:41:35.271 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:41:35.271 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:35.271 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T05:41:35.271 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:41:35.271 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:41:35.272 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:41:35.285 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T05:41:35.298 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:41:35.319 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T05:41:35.319 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:41:35.322 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:41:35.322 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:35.322 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T05:41:35.322 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:41:35.374 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:41:35.386 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T05:41:35.398 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:41:35.398 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:35.398 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T05:41:35.398 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:41:35.398 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:41:35.398 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:41:35.403 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:41:35.403 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:41:35.444 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T05:41:35.487 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:41:35.507 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T05:41:35.512 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T05:41:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:41:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:41:35.697 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:41:35.698 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:41:35.704 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T05:41:35.742 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:41:35.765 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T05:41:35.766 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:41:35.766 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:35.766 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T05:41:35.766 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:41:35.766 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:41:35.766 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:41:35.781 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:41:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T05:41:35.861 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:41:35.935 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T05:41:36.085 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T05:41:36.122 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T05:41:36.163 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T05:41:36.190 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T05:41:36.610 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:41:36.647 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:41:36.680 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T05:41:36.749 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T05:41:36.808 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:41:40.022 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T05:41:40.063 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T05:41:40.104 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T05:41:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T05:41:40.162 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T05:41:40.199 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:41:40.251 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:41:40.393 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T05:41:40.443 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T05:41:40.464 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T05:41:40.494 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T05:41:40.540 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T05:41:41.142 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:41:41.188 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:41:41.209 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:41:41.263 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:41:41.293 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:41:41.415 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:41:41.584 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T05:41:41.611 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:41:41.638 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:41:41.638 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:41.638 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T05:41:41.638 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:41:41.638 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:41:41.638 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:41:41.687 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:41:41.700 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:41:41.802 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T05:41:41.854 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T05:41:42.132 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T05:41:42.219 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T05:41:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T05:41:42.312 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:41:42.312 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T05:41:42.312 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T05:41:42.312 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T05:41:42.312 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T05:41:42.312 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T05:41:42.312 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T05:41:42.312 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T05:41:42.312 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:41:42.312 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:41:42.325 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:41:42.325 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T05:41:42.326 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T05:41:42.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T05:41:42.328 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T05:41:42.329 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T05:41:42.330 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T05:41:42.331 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T05:41:42.332 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T05:41:42.333 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T05:41:42.334 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T05:41:42.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T05:41:42.336 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T05:41:42.336 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T05:41:42.375 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T05:41:42.405 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T05:41:42.430 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T05:41:42.456 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T05:41:42.456 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:41:42.540 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:41:42.541 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:41:42.625 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:41:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T05:41:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:41:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:41:42.843 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:41:42.843 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:41:42.879 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T05:41:42.923 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:41:42.927 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:41:42.949 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:41:42.949 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:42.949 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T05:41:42.949 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:41:42.949 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:41:42.950 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:41:42.991 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:41:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:41:43.015 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:41:43.015 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:43.016 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T05:41:43.016 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:41:43.066 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:41:43.091 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:41:43.092 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:43.092 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T05:41:43.092 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:41:43.092 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:41:43.092 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:41:43.425 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:41:43.450 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:41:43.450 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:41:43.450 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T05:41:43.450 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:41:43.450 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:41:43.450 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:41:45.018 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:41:45.018 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:41:45.018 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2024-09-21T05:41:45.019 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T05:41:45.019 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T05:41:45.019 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T05:41:45.019 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T05:41:45.019 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.019 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.019 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T05:41:45.019 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T05:41:45.019 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-21T05:41:45.019 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T05:41:45.019 INFO:teuthology.orchestra.run.smithi119.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T05:41:45.019 INFO:teuthology.orchestra.run.smithi119.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:45.020 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:45.021 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.021 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.021 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:45.021 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.021 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.021 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.021 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:45.021 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:45.021 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.021 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.021 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:45.021 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T05:41:45.021 INFO:teuthology.orchestra.run.smithi119.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T05:41:45.022 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T05:41:45.023 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T05:41:45.024 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T05:41:45.025 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T05:41:45.026 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.027 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T05:41:45.028 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T05:41:45.029 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T05:41:45.030 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T05:41:45.030 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:41:45.030 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-21T05:41:45.451 DEBUG:teuthology.parallel:result is None 2024-09-21T05:41:47.664 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T05:41:47.705 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T05:41:47.763 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T05:41:47.803 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T05:41:47.829 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T05:41:48.025 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T05:41:48.068 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T05:41:48.089 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T05:41:48.120 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T05:41:48.157 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T05:41:48.793 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:41:48.829 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:41:48.851 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:41:49.224 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:41:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T05:41:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T05:41:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T05:41:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T05:41:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T05:41:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T05:41:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T05:41:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:41:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:41:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:41:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T05:41:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T05:41:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T05:41:49.237 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T05:41:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T05:41:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T05:41:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T05:41:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T05:41:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T05:41:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T05:41:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T05:41:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T05:41:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T05:41:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T05:41:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T05:41:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T05:41:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T05:41:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T05:41:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T05:41:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T05:41:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T05:41:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T05:41:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T05:41:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T05:41:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T05:41:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T05:41:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T05:41:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T05:41:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T05:41:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T05:41:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T05:41:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T05:41:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T05:41:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T05:41:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T05:41:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T05:41:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T05:41:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T05:41:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T05:41:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T05:41:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T05:41:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T05:41:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T05:41:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T05:41:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T05:41:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T05:41:49.248 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T05:41:49.248 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T05:41:49.762 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T05:41:49.859 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T05:41:49.902 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T05:41:49.985 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T05:41:50.021 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T05:41:50.046 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T05:41:50.072 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T05:41:50.072 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:41:50.164 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:41:50.165 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:41:50.249 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:41:50.274 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T05:41:50.280 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:41:50.280 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:41:50.467 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:41:50.468 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:41:50.535 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:41:50.601 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:41:52.095 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:41:52.095 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:41:52.095 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2024-09-21T05:41:52.095 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T05:41:52.095 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T05:41:52.095 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T05:41:52.095 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T05:41:52.095 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T05:41:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T05:41:52.096 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-09-21T05:41:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T05:41:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T05:41:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T05:41:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T05:41:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T05:41:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T05:41:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T05:41:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T05:41:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T05:41:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T05:41:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T05:41:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T05:41:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T05:41:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T05:41:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T05:41:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T05:41:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T05:41:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T05:41:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:41:52.107 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-09-21T05:41:52.619 DEBUG:teuthology.parallel:result is None 2024-09-21T05:41:56.692 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:41:56.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T05:41:56.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T05:41:56.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T05:41:56.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T05:41:56.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T05:41:56.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T05:41:56.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T05:41:56.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:41:56.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:41:56.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:41:56.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T05:41:56.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T05:41:56.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T05:41:56.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:41:56.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T05:41:56.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T05:41:56.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T05:41:56.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T05:41:56.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T05:41:56.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T05:41:56.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T05:41:56.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T05:41:56.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T05:41:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T05:41:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T05:41:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T05:41:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T05:41:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T05:41:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T05:41:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T05:41:56.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T05:41:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T05:41:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T05:41:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T05:41:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T05:41:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T05:41:56.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T05:41:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T05:41:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T05:41:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T05:41:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T05:41:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T05:41:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T05:41:56.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T05:41:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T05:41:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T05:41:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T05:41:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T05:41:56.699 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T05:41:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T05:41:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T05:41:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T05:41:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T05:41:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T05:41:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T05:41:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T05:41:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T05:41:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T05:41:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T05:41:56.700 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T05:41:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T05:41:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T05:41:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T05:41:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T05:41:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T05:41:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T05:41:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T05:41:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T05:41:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T05:41:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T05:41:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T05:41:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T05:41:56.701 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T05:41:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T05:41:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T05:41:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T05:41:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T05:41:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T05:41:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T05:41:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T05:41:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T05:41:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T05:41:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T05:41:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T05:41:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T05:41:56.702 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T05:41:56.703 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T05:41:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T05:41:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T05:41:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T05:41:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T05:41:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T05:41:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T05:41:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T05:41:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T05:41:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T05:41:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T05:41:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T05:41:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T05:41:56.704 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T05:41:56.705 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T05:41:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T05:41:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T05:41:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T05:41:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T05:41:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T05:41:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T05:41:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T05:41:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T05:41:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T05:41:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T05:41:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T05:41:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T05:41:56.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T05:41:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T05:41:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T05:41:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T05:41:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T05:41:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T05:41:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T05:41:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T05:41:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T05:41:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T05:41:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T05:41:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T05:41:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T05:41:56.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T05:41:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T05:41:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T05:41:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T05:41:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T05:41:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T05:41:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T05:41:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T05:41:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T05:41:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T05:41:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T05:41:56.708 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T05:41:59.225 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:41:59.226 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:41:59.226 INFO:teuthology.orchestra.run.smithi027.stdout:Upgraded: 2024-09-21T05:41:59.226 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T05:41:59.226 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T05:41:59.226 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T05:41:59.226 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T05:41:59.226 INFO:teuthology.orchestra.run.smithi027.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.226 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.226 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T05:41:59.226 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T05:41:59.226 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:59.227 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:59.228 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:59.228 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:59.228 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:59.228 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.228 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.228 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:59.228 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.228 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.228 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.228 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:59.228 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:59.228 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.228 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.229 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:41:59.229 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T05:41:59.229 INFO:teuthology.orchestra.run.smithi027.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T05:41:59.229 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T05:41:59.229 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T05:41:59.229 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T05:41:59.229 INFO:teuthology.orchestra.run.smithi027.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T05:41:59.229 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T05:41:59.229 INFO:teuthology.orchestra.run.smithi027.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T05:41:59.229 INFO:teuthology.orchestra.run.smithi027.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T05:41:59.229 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T05:41:59.229 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T05:41:59.229 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.230 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.230 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.230 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T05:41:59.230 INFO:teuthology.orchestra.run.smithi027.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T05:41:59.230 INFO:teuthology.orchestra.run.smithi027.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T05:41:59.230 INFO:teuthology.orchestra.run.smithi027.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T05:41:59.230 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T05:41:59.230 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T05:41:59.230 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.230 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.230 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T05:41:59.230 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.230 INFO:teuthology.orchestra.run.smithi027.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T05:41:59.231 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T05:41:59.232 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T05:41:59.232 INFO:teuthology.orchestra.run.smithi027.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T05:41:59.232 INFO:teuthology.orchestra.run.smithi027.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T05:41:59.232 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T05:41:59.232 INFO:teuthology.orchestra.run.smithi027.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T05:41:59.232 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T05:41:59.232 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T05:41:59.232 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T05:41:59.232 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.232 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.232 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.232 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T05:41:59.232 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T05:41:59.233 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T05:41:59.233 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T05:41:59.233 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T05:41:59.233 INFO:teuthology.orchestra.run.smithi027.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T05:41:59.233 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T05:41:59.233 INFO:teuthology.orchestra.run.smithi027.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T05:41:59.233 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T05:41:59.233 INFO:teuthology.orchestra.run.smithi027.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T05:41:59.233 INFO:teuthology.orchestra.run.smithi027.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T05:41:59.233 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T05:41:59.233 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T05:41:59.234 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T05:41:59.234 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T05:41:59.234 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T05:41:59.234 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T05:41:59.234 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T05:41:59.234 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T05:41:59.234 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T05:41:59.235 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T05:41:59.235 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T05:41:59.235 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T05:41:59.235 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T05:41:59.235 INFO:teuthology.orchestra.run.smithi027.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T05:41:59.235 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T05:41:59.235 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T05:41:59.235 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T05:41:59.235 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T05:41:59.236 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T05:41:59.236 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T05:41:59.236 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T05:41:59.236 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T05:41:59.236 INFO:teuthology.orchestra.run.smithi027.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T05:41:59.236 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T05:41:59.236 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T05:41:59.236 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T05:41:59.237 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T05:41:59.237 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T05:41:59.237 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T05:41:59.237 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.237 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.237 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T05:41:59.237 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T05:41:59.237 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T05:41:59.237 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.238 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T05:41:59.238 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T05:41:59.238 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T05:41:59.238 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T05:41:59.238 INFO:teuthology.orchestra.run.smithi027.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T05:41:59.238 INFO:teuthology.orchestra.run.smithi027.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T05:41:59.238 INFO:teuthology.orchestra.run.smithi027.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T05:41:59.238 INFO:teuthology.orchestra.run.smithi027.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T05:41:59.239 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T05:41:59.239 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T05:41:59.239 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T05:41:59.239 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T05:41:59.239 INFO:teuthology.orchestra.run.smithi027.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T05:41:59.239 INFO:teuthology.orchestra.run.smithi027.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T05:41:59.239 INFO:teuthology.orchestra.run.smithi027.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T05:41:59.239 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.239 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.240 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:41:59.240 INFO:teuthology.orchestra.run.smithi027.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T05:41:59.240 INFO:teuthology.orchestra.run.smithi027.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T05:41:59.240 INFO:teuthology.orchestra.run.smithi027.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T05:41:59.240 INFO:teuthology.orchestra.run.smithi027.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T05:41:59.240 INFO:teuthology.orchestra.run.smithi027.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T05:41:59.240 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T05:41:59.241 INFO:teuthology.orchestra.run.smithi027.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T05:41:59.241 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:41:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-21T05:41:59.632 DEBUG:teuthology.parallel:result is None 2024-09-21T05:41:59.632 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:41:59.778 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T05:41:59.804 INFO:teuthology.orchestra.run.smithi007.stdout:19.3.0-5120.g18432218.el9 2024-09-21T05:41:59.805 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T05:41:59.805 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T05:41:59.807 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:41:59.956 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T05:41:59.980 INFO:teuthology.orchestra.run.smithi027.stdout:19.3.0-5120.g18432218.el9 2024-09-21T05:41:59.980 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T05:41:59.980 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T05:41:59.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:42:00.129 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T05:42:00.155 INFO:teuthology.orchestra.run.smithi119.stdout:19.3.0-5120.g18432218.el9 2024-09-21T05:42:00.155 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T05:42:00.155 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T05:42:00.157 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T05:42:00.157 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:42:00.157 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T05:42:00.192 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-21T05:42:00.192 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T05:42:00.224 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T05:42:00.224 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T05:42:00.256 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T05:42:00.256 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:42:00.257 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T05:42:00.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T05:42:00.356 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-21T05:42:00.357 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T05:42:00.387 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T05:42:00.456 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T05:42:00.457 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T05:42:00.482 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T05:42:00.547 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T05:42:00.548 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:42:00.548 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T05:42:00.578 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T05:42:00.647 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-21T05:42:00.647 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T05:42:00.678 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T05:42:00.748 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T05:42:00.748 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T05:42:00.773 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T05:42:00.838 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T05:42:00.839 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:42:00.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T05:42:00.869 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T05:42:00.940 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-21T05:42:00.940 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T05:42:00.971 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T05:42:01.041 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T05:42:01.041 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T05:42:01.066 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T05:42:01.130 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T05:42:01.244 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T05:42:01.245 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:42:01.245 INFO:tasks.cephadm:Cluster fsid is 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:42:01.245 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T05:42:01.246 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.7', 'mon.b': '172.21.15.27', 'mon.c': '172.21.15.119'} 2024-09-21T05:42:01.246 INFO:tasks.cephadm:First mon is mon.a on smithi007 2024-09-21T05:42:01.246 INFO:tasks.cephadm:First mgr is x 2024-09-21T05:42:01.246 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T05:42:01.246 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname $(hostname -s) 2024-09-21T05:42:01.278 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname $(hostname -s) 2024-09-21T05:42:01.309 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname $(hostname -s) 2024-09-21T05:42:01.334 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T05:42:01.335 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:42:01.484 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T05:42:01.623 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:42:01.625 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T05:42:01.625 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T05:42:01.625 DEBUG:teuthology.orchestra.run.smithi007:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T05:42:02.226 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 05:42 /home/ubuntu/cephtest/cephadm 2024-09-21T05:42:02.227 DEBUG:teuthology.orchestra.run.smithi027:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T05:42:02.737 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 05:42 /home/ubuntu/cephtest/cephadm 2024-09-21T05:42:02.738 DEBUG:teuthology.orchestra.run.smithi119:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T05:42:03.324 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 05:42 /home/ubuntu/cephtest/cephadm 2024-09-21T05:42:03.324 DEBUG:teuthology.orchestra.run.smithi007:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T05:42:03.345 DEBUG:teuthology.orchestra.run.smithi027:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T05:42:03.365 DEBUG:teuthology.orchestra.run.smithi119:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T05:42:03.400 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T05:42:03.400 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T05:42:03.402 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T05:42:03.408 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T05:42:05.006 INFO:teuthology.orchestra.run.smithi027.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:42:05.038 INFO:teuthology.orchestra.run.smithi119.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:42:05.127 INFO:teuthology.orchestra.run.smithi007.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:42:51.071 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:42:51.072 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T05:42:51.072 INFO:teuthology.orchestra.run.smithi007.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T05:42:51.072 INFO:teuthology.orchestra.run.smithi007.stdout: "repo_digests": [ 2024-09-21T05:42:51.072 INFO:teuthology.orchestra.run.smithi007.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T05:42:51.072 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T05:42:51.072 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:43:20.030 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-21T05:43:20.031 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T05:43:20.031 INFO:teuthology.orchestra.run.smithi027.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T05:43:20.031 INFO:teuthology.orchestra.run.smithi027.stdout: "repo_digests": [ 2024-09-21T05:43:20.031 INFO:teuthology.orchestra.run.smithi027.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T05:43:20.031 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-21T05:43:20.031 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-21T05:43:22.343 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T05:43:22.344 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T05:43:22.344 INFO:teuthology.orchestra.run.smithi119.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T05:43:22.344 INFO:teuthology.orchestra.run.smithi119.stdout: "repo_digests": [ 2024-09-21T05:43:22.344 INFO:teuthology.orchestra.run.smithi119.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T05:43:22.344 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-21T05:43:22.344 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T05:43:22.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph 2024-09-21T05:43:22.404 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph 2024-09-21T05:43:22.438 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph 2024-09-21T05:43:22.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /etc/ceph 2024-09-21T05:43:22.496 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /etc/ceph 2024-09-21T05:43:22.525 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /etc/ceph 2024-09-21T05:43:22.550 INFO:tasks.cephadm:Writing seed config... 2024-09-21T05:43:22.551 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T05:43:22.551 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-21T05:43:22.552 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-21T05:43:22.553 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T05:43:22.553 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T05:43:22.553 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-21T05:43:22.553 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T05:43:22.553 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T05:43:22.553 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T05:43:22.553 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T05:43:22.553 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T05:43:22.553 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T05:43:22.553 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T05:43:22.554 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:43:22.554 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T05:43:22.571 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 397810bc-77dc-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-09-21T05:43:22.571 DEBUG:teuthology.orchestra.run.smithi007:mon.a> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T05:43:22.614 DEBUG:teuthology.orchestra.run.smithi007:mgr.x> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T05:43:22.659 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T05:43:22.659 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 397810bc-77dc-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.7 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:22.872 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:43:22.872 INFO:teuthology.orchestra.run.smithi007.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.7', '--skip-admin-label'] 2024-09-21T05:43:22.873 INFO:teuthology.orchestra.run.smithi007.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T05:43:22.873 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying podman|docker is present... 2024-09-21T05:43:22.897 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 5.2.2 2024-09-21T05:43:22.897 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying lvm2 is present... 2024-09-21T05:43:22.897 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying time synchronization is in place... 2024-09-21T05:43:22.905 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T05:43:22.905 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T05:43:22.912 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T05:43:22.912 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-21T05:43:22.920 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-09-21T05:43:22.925 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-09-21T05:43:22.925 INFO:teuthology.orchestra.run.smithi007.stdout:Unit chronyd.service is enabled and running 2024-09-21T05:43:22.925 INFO:teuthology.orchestra.run.smithi007.stdout:Repeating the final host check... 2024-09-21T05:43:23.398 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 5.2.2 2024-09-21T05:43:23.398 INFO:teuthology.orchestra.run.smithi007.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T05:43:23.398 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl is present 2024-09-21T05:43:23.398 INFO:teuthology.orchestra.run.smithi007.stdout:lvcreate is present 2024-09-21T05:43:23.406 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T05:43:23.406 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T05:43:23.413 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T05:43:23.413 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-21T05:43:23.421 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-09-21T05:43:23.428 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-09-21T05:43:23.428 INFO:teuthology.orchestra.run.smithi007.stdout:Unit chronyd.service is enabled and running 2024-09-21T05:43:23.428 INFO:teuthology.orchestra.run.smithi007.stdout:Host looks OK 2024-09-21T05:43:23.429 INFO:teuthology.orchestra.run.smithi007.stdout:Cluster fsid: 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:23.429 INFO:teuthology.orchestra.run.smithi007.stdout:Acquiring lock 139835481868656 on /run/cephadm/397810bc-77dc-11ef-baf5-efdc52797490.lock 2024-09-21T05:43:23.429 INFO:teuthology.orchestra.run.smithi007.stdout:Lock 139835481868656 acquired on /run/cephadm/397810bc-77dc-11ef-baf5-efdc52797490.lock 2024-09-21T05:43:23.429 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 3300 ... 2024-09-21T05:43:23.429 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 6789 ... 2024-09-21T05:43:23.430 INFO:teuthology.orchestra.run.smithi007.stdout:Base mon IP(s) is [172.21.15.7:3300, 172.21.15.7:6789], mon addrv is [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-21T05:43:23.433 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.7 metric 100 2024-09-21T05:43:23.433 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.7 metric 100 2024-09-21T05:43:23.436 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T05:43:23.436 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T05:43:23.436 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1794sec hoplimit 64 pref medium 2024-09-21T05:43:23.439 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T05:43:23.439 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T05:43:23.439 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T05:43:23.439 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T05:43:23.439 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-21T05:43:23.439 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T05:43:23.440 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-09-21T05:43:23.440 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-09-21T05:43:23.440 INFO:teuthology.orchestra.run.smithi007.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T05:43:23.441 INFO:teuthology.orchestra.run.smithi007.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T05:43:23.442 INFO:teuthology.orchestra.run.smithi007.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:43:25.030 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T05:43:25.030 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:43:25.030 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T05:43:25.030 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T05:43:25.030 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T05:43:25.030 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T05:43:25.031 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T05:43:25.999 INFO:teuthology.orchestra.run.smithi007.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T05:43:25.999 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T05:43:25.999 INFO:teuthology.orchestra.run.smithi007.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T05:43:26.897 INFO:teuthology.orchestra.run.smithi007.stdout:stat: stdout 167 167 2024-09-21T05:43:26.897 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial keys... 2024-09-21T05:43:27.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQD/XO5mS86MDhAA8qLUpeH4IT6tmcaVOZAfNg== 2024-09-21T05:43:28.642 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQAAXe5mthLFCBAAOXkYbyMJiRy/cTs74CQAlQ== 2024-09-21T05:43:29.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQAAXe5mFcnaORAAoVX3mqv6RxWWevuhb7V64g== 2024-09-21T05:43:29.531 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial monmap... 2024-09-21T05:43:30.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T05:43:30.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T05:43:30.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:30.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T05:43:30.448 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool for a [v2:172.21.15.7:3300,v1:172.21.15.7:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T05:43:30.448 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = quincy 2024-09-21T05:43:30.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: set fsid to 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:30.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T05:43:30.448 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:43:30.448 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mon... 2024-09-21T05:43:31.344 INFO:teuthology.orchestra.run.smithi007.stdout:create mon.a on 2024-09-21T05:43:31.557 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T05:43:31.713 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T05:43:31.904 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-397810bc-77dc-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-397810bc-77dc-11ef-baf5-efdc52797490.target. 2024-09-21T05:43:31.905 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-397810bc-77dc-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-397810bc-77dc-11ef-baf5-efdc52797490.target. 2024-09-21T05:43:32.187 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.a 2024-09-21T05:43:32.187 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T05:43:32.370 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-397810bc-77dc-11ef-baf5-efdc52797490.target.wants/ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-397810bc-77dc-11ef-baf5-efdc52797490@.service. 2024-09-21T05:43:32.895 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T05:43:32.896 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-21T05:43:32.903 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T05:43:32.903 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-21T05:43:32.903 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-21T05:43:32.903 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T05:43:32.904 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon to start... 2024-09-21T05:43:32.904 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon... 2024-09-21T05:43:32.994 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:32 smithi007 systemd[1]: Started Ceph mon.a for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:43:33.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T05:43:33.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout id: 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:33.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T05:43:33.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T05:43:33.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout services: 2024-09-21T05:43:33.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.530047s) 2024-09-21T05:43:33.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T05:43:33.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T05:43:33.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T05:43:33.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout data: 2024-09-21T05:43:33.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T05:43:33.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T05:43:33.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T05:43:33.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T05:43:33.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T05:43:33.891 INFO:teuthology.orchestra.run.smithi007.stdout:mon is available 2024-09-21T05:43:33.891 INFO:teuthology.orchestra.run.smithi007.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T05:43:34.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:33 smithi007 ceph-mon[30614]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T05:43:34.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:33 smithi007 ceph-mon[30614]: monmap epoch 1 2024-09-21T05:43:34.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:33 smithi007 ceph-mon[30614]: fsid 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:34.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:33 smithi007 ceph-mon[30614]: last_changed 2024-09-21T05:43:29.867973+0000 2024-09-21T05:43:34.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:33 smithi007 ceph-mon[30614]: created 2024-09-21T05:43:29.867973+0000 2024-09-21T05:43:34.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:33 smithi007 ceph-mon[30614]: min_mon_release 19 (squid) 2024-09-21T05:43:34.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:33 smithi007 ceph-mon[30614]: election_strategy: 1 2024-09-21T05:43:34.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:33 smithi007 ceph-mon[30614]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T05:43:34.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:33 smithi007 ceph-mon[30614]: fsmap 2024-09-21T05:43:34.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:33 smithi007 ceph-mon[30614]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T05:43:34.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:33 smithi007 ceph-mon[30614]: mgrmap e1: no daemons active 2024-09-21T05:43:34.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:33 smithi007 ceph-mon[30614]: from='client.? 172.21.15.7:0/3184127501' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T05:43:34.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T05:43:34.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T05:43:34.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:34.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T05:43:34.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-21T05:43:34.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T05:43:34.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T05:43:34.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T05:43:34.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T05:43:34.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T05:43:34.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T05:43:34.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T05:43:34.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T05:43:34.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T05:43:34.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T05:43:34.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T05:43:34.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T05:43:34.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T05:43:34.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T05:43:34.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T05:43:34.872 INFO:teuthology.orchestra.run.smithi007.stdout:Generating new minimal ceph.conf... 2024-09-21T05:43:34.976 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:34 smithi007 ceph-mon[30614]: from='client.? 172.21.15.7:0/426004398' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T05:43:34.976 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:34 smithi007 ceph-mon[30614]: from='client.? 172.21.15.7:0/426004398' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T05:43:35.801 INFO:teuthology.orchestra.run.smithi007.stdout:Restarting the monitor... 2024-09-21T05:43:35.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:35 smithi007 systemd[1]: Stopping Ceph mon.a for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:43:36.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:35 smithi007 ceph-mon[30614]: from='client.? 172.21.15.7:0/620968567' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:36.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:36 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a[30610]: 2024-09-21T05:43:36.083+0000 7fbfc10ba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:43:36.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:36 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a[30610]: 2024-09-21T05:43:36.083+0000 7fbfc10ba640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T05:43:36.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:36 smithi007 podman[30860]: 2024-09-21 05:43:36.299012734 +0000 UTC m=+0.321311476 container died 6721919b1cef3306a346b117057203fe4ff89e409cd153f713402050181815cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:43:36.919 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:36 smithi007 podman[30860]: 2024-09-21 05:43:36.674178497 +0000 UTC m=+0.696477233 container cleanup 6721919b1cef3306a346b117057203fe4ff89e409cd153f713402050181815cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:43:36.919 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:36 smithi007 bash[30860]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a 2024-09-21T05:43:37.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:36 smithi007 podman[30874]: 2024-09-21 05:43:36.917043831 +0000 UTC m=+0.614873331 container remove 6721919b1cef3306a346b117057203fe4ff89e409cd153f713402050181815cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T05:43:37.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 systemd[1]: ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T05:43:37.253 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 systemd[1]: Stopped Ceph mon.a for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:43:37.253 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 systemd[1]: Starting Ceph mon.a for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:43:37.513 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 podman[30964]: 2024-09-21 05:43:37.251185192 +0000 UTC m=+0.105472844 container create 2b401bd9ca816d595047690b49e6a65eb872986e414b15585342151f13b4d7d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T05:43:37.513 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 podman[30964]: 2024-09-21 05:43:37.161955194 +0000 UTC m=+0.016242855 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:43:37.513 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 podman[30964]: 2024-09-21 05:43:37.445125473 +0000 UTC m=+0.299413136 container init 2b401bd9ca816d595047690b49e6a65eb872986e414b15585342151f13b4d7d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 podman[30964]: 2024-09-21 05:43:37.448396506 +0000 UTC m=+0.302684158 container start 2b401bd9ca816d595047690b49e6a65eb872986e414b15585342151f13b4d7d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: pidfile_write: ignore empty --pid-file 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: load: jerasure load: lrc 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: RocksDB version: 7.9.2 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Git sha 0 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: DB SUMMARY 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: DB Session ID: VG27WAK3HGU5WS5FE91D 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: CURRENT file: CURRENT 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T05:43:37.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T05:43:37.515 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95120 ; 2024-09-21T05:43:37.515 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.error_if_exists: 0 2024-09-21T05:43:37.515 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.create_if_missing: 0 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.paranoid_checks: 1 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.env: 0x5619c3bf3d60 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.info_log: 0x5619c860f360 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.statistics: (nil) 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.use_fsync: 0 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_log_file_size: 0 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T05:43:37.516 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.allow_fallocate: 1 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.use_direct_reads: 0 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.db_log_dir: 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.wal_dir: 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T05:43:37.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.write_buffer_manager: 0x5619c8613d60 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.unordered_write: 0 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T05:43:37.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.row_cache: None 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.wal_filter: None 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.two_write_queues: 0 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.wal_compression: 0 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.atomic_flush: 0 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T05:43:37.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.log_readahead_size: 0 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_background_jobs: 2 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_background_compactions: -1 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_subcompactions: 1 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T05:43:37.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_open_files: -1 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_background_flushes: -1 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Compression algorithms supported: 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: kZSTD supported: 0 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: kXpressCompression supported: 0 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: kBZip2Compression supported: 0 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T05:43:37.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: kLZ4Compression supported: 1 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: kZlibCompression supported: 1 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: kSnappyCompression supported: 1 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.merge_operator: 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_filter: None 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T05:43:37.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5619c860efa0) 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_type: 0 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_index_type: 0 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_shortening: 1 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: checksum: 4 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: no_block_cache: 0 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache: 0x5619c45d3610 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_options: 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: capacity : 536870912 2024-09-21T05:43:37.523 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_shard_bits : 4 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: strict_capacity_limit : 0 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_compressed: (nil) 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: persistent_cache: (nil) 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size: 4096 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size_deviation: 10 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_restart_interval: 16 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_block_restart_interval: 1 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: metadata_block_size: 4096 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: partition_filters: 0 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: use_delta_encoding: 1 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: filter_policy: bloomfilter 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: whole_key_filtering: 1 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: verify_compression: 0 2024-09-21T05:43:37.524 INFO:journalctl@ceph.mon.a.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-09-21T05:43:37.525 INFO:journalctl@ceph.mon.a.smithi007.stdout: format_version: 5 2024-09-21T05:43:37.525 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_index_compression: 1 2024-09-21T05:43:37.525 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_align: 0 2024-09-21T05:43:37.525 INFO:journalctl@ceph.mon.a.smithi007.stdout: max_auto_readahead_size: 262144 2024-09-21T05:43:37.525 INFO:journalctl@ceph.mon.a.smithi007.stdout: prepopulate_block_cache: 0 2024-09-21T05:43:37.525 INFO:journalctl@ceph.mon.a.smithi007.stdout: initial_auto_readahead_size: 8192 2024-09-21T05:43:37.525 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T05:43:37.525 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T05:43:37.525 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T05:43:37.525 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compression: NoCompression 2024-09-21T05:43:37.525 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T05:43:37.525 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T05:43:37.525 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.num_levels: 7 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T05:43:37.526 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T05:43:37.527 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T05:43:37.527 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T05:43:37.527 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:43:37.527 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:43:37.527 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T05:43:37.527 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T05:43:37.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:43:37.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T05:43:37.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T05:43:37.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T05:43:37.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T05:43:37.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T05:43:37.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T05:43:37.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T05:43:37.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T05:43:37.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T05:43:37.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T05:43:37.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T05:43:37.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.inplace_update_support: 0 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.bloom_locality: 0 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.max_successive_merges: 0 2024-09-21T05:43:37.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T05:43:37.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T05:43:37.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T05:43:37.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T05:43:37.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.ttl: 2592000 2024-09-21T05:43:37.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T05:43:37.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T05:43:37.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T05:43:37.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.enable_blob_files: false 2024-09-21T05:43:37.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.min_blob_size: 0 2024-09-21T05:43:37.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T05:43:37.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T05:43:37.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T05:43:37.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 84fb5af6-340f-4796-9781-24f13e894136 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897417484726, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897417486030, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91263, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 285, "table_properties": {"data_size": 89311, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11700, "raw_average_key_size": 47, "raw_value_size": 82727, "raw_average_value_size": 339, "num_data_blocks": 12, "num_entries": 244, "num_filter_entries": 244, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726897417, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "84fb5af6-340f-4796-9781-24f13e894136", "db_session_id": "VG27WAK3HGU5WS5FE91D", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897417486177, "job": 1, "event": "recovery_finished"} 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5619c8632a80 2024-09-21T05:43:37.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: DB pointer 0x5619c93d8000 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** DB Stats ** 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T05:43:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout: L0 2/0 90.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: Sum 2/0 90.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 103.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T05:43:37.534 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative compaction: 0.00 GB write, 23.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval compaction: 0.00 GB write, 23.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache BinnedLRUCache@0x5619c45d3610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: starting mon.a rank 0 at public addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] at bind addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: mon.a@-1(???) e1 preinit fsid 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: mon.a@-1(???).mds e1 new map 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: mon.a@-1(???).mds e1 print_map 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout: e1 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout: btime 2024-09-21T05:43:32:863692+0000 2024-09-21T05:43:37.535 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T05:43:37.536 INFO:journalctl@ceph.mon.a.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:43:37.536 INFO:journalctl@ceph.mon.a.smithi007.stdout: legacy client fscid: -1 2024-09-21T05:43:37.536 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-21T05:43:37.536 INFO:journalctl@ceph.mon.a.smithi007.stdout: No filesystems configured 2024-09-21T05:43:37.536 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T05:43:37.536 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:43:37.536 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:43:37.536 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:43:37.536 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T05:43:37.536 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 bash[30964]: 2b401bd9ca816d595047690b49e6a65eb872986e414b15585342151f13b4d7d0 2024-09-21T05:43:37.536 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 systemd[1]: Started Ceph mon.a for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:43:37.536 INFO:teuthology.orchestra.run.smithi007.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T05:43:37.807 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T05:43:37.808 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: monmap epoch 1 2024-09-21T05:43:37.808 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: fsid 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:37.808 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: last_changed 2024-09-21T05:43:29.867973+0000 2024-09-21T05:43:37.808 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: created 2024-09-21T05:43:29.867973+0000 2024-09-21T05:43:37.808 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: min_mon_release 19 (squid) 2024-09-21T05:43:37.808 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: election_strategy: 1 2024-09-21T05:43:37.808 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T05:43:37.808 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: fsmap 2024-09-21T05:43:37.808 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T05:43:37.808 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:37 smithi007 ceph-mon[30983]: mgrmap e1: no daemons active 2024-09-21T05:43:38.497 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T05:43:38.511 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:38.511 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mgr... 2024-09-21T05:43:38.512 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T05:43:38.512 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T05:43:38.751 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-397810bc-77dc-11ef-baf5-efdc52797490@mgr.x 2024-09-21T05:43:38.751 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-397810bc-77dc-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-397810bc-77dc-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T05:43:38.914 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-397810bc-77dc-11ef-baf5-efdc52797490.target.wants/ceph-397810bc-77dc-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-397810bc-77dc-11ef-baf5-efdc52797490@.service. 2024-09-21T05:43:39.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:38 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/161684173' entity='client.admin' 2024-09-21T05:43:39.457 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:39 smithi007 podman[31192]: 2024-09-21 05:43:39.375572712 +0000 UTC m=+0.341477274 container start ef771cd10fa869c913a8cdd85a606f53e335ad70cce5a06a0a2c902ef803ea66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T05:43:39.472 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T05:43:39.472 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-21T05:43:39.479 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T05:43:39.479 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-21T05:43:39.479 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-21T05:43:39.479 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T05:43:39.489 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T05:43:39.489 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-21T05:43:39.497 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T05:43:39.497 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-21T05:43:39.497 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-21T05:43:39.497 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T05:43:39.497 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr to start... 2024-09-21T05:43:39.497 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr... 2024-09-21T05:43:39.720 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:39 smithi007 bash[31192]: ef771cd10fa869c913a8cdd85a606f53e335ad70cce5a06a0a2c902ef803ea66 2024-09-21T05:43:39.720 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:39 smithi007 systemd[1]: Started Ceph mgr.x for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:43:40.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:40 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1159493264' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T05:43:40.536 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T05:43:40.536 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:43:40.536 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "397810bc-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:43:40.536 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T05:43:40.536 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T05:43:40.536 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T05:43:40.536 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T05:43:40.536 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:40.536 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T05:43:40.536 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T05:43:40.536 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T05:43:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T05:43:40.538 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T05:43:40.538 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T05:43:40.538 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T05:43:40.538 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T05:43:40.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:40.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T05:43:40.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T05:43:40.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T05:43:40.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T05:43:40.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T05:43:40.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T05:43:40.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T05:43:40.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T05:43:40.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T05:43:40.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:40.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T05:43:40.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T05:43:32:863692+0000", 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:43:40.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:40.543 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T05:43:40.543 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:43:40.543 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T05:43:32.864654+0000", 2024-09-21T05:43:40.543 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:43:40.543 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:40.543 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T05:43:40.543 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:43:40.543 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (1/15)... 2024-09-21T05:43:43.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:43 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1758518305' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T05:43:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T05:43:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:43:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "397810bc-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:43:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T05:43:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T05:43:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T05:43:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T05:43:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T05:43:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T05:43:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T05:43:43.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T05:43:43.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T05:43:43.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T05:43:43.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:43.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T05:43:43.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T05:43:43.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T05:43:43.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T05:43:43.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T05:43:43.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T05:43:43.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T05:43:43.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T05:43:43.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T05:43:43.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:43.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T05:43:32:863692+0000", 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:43:43.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:43.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T05:43:43.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:43:43.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T05:43:32.864654+0000", 2024-09-21T05:43:43.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:43:43.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:43.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T05:43:43.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:43:43.816 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (2/15)... 2024-09-21T05:43:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:44 smithi007 ceph-mon[30983]: Activating manager daemon x 2024-09-21T05:43:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:44 smithi007 ceph-mon[30983]: mgrmap e2: x(active, starting, since 0.00381366s) 2024-09-21T05:43:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:44 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/4159493222' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T05:43:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:44 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/4159493222' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T05:43:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:44 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/4159493222' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T05:43:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:44 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/4159493222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:43:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:44 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/4159493222' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T05:43:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:44 smithi007 ceph-mon[30983]: Manager daemon x is now available 2024-09-21T05:43:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:44 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/4159493222' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T05:43:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:44 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/4159493222' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T05:43:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:44 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/4159493222' entity='mgr.x' 2024-09-21T05:43:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:44 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/4159493222' entity='mgr.x' 2024-09-21T05:43:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:44 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/4159493222' entity='mgr.x' 2024-09-21T05:43:46.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:46 smithi007 ceph-mon[30983]: mgrmap e3: x(active, since 1.00821s) 2024-09-21T05:43:46.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:46 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/640621082' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T05:43:47.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T05:43:47.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:43:47.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "397810bc-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:43:47.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T05:43:47.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T05:43:47.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T05:43:47.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T05:43:47.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:47.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T05:43:47.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T05:43:47.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-21T05:43:47.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:43:47.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T05:43:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T05:43:47.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T05:43:32:863692+0000", 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T05:43:47.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:43:47.106 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T05:43:32.864654+0000", 2024-09-21T05:43:47.106 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:43:47.106 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:43:47.106 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T05:43:47.106 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:43:47.106 INFO:teuthology.orchestra.run.smithi007.stdout:mgr is available 2024-09-21T05:43:47.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:47 smithi007 ceph-mon[30983]: mgrmap e4: x(active, since 2s) 2024-09-21T05:43:48.179 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T05:43:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T05:43:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T05:43:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-21T05:43:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T05:43:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T05:43:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T05:43:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T05:43:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T05:43:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T05:43:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T05:43:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T05:43:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T05:43:48.181 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T05:43:48.181 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T05:43:48.181 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T05:43:48.181 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T05:43:48.181 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T05:43:48.181 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T05:43:48.181 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling cephadm module... 2024-09-21T05:43:49.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:48 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1019201590' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T05:43:49.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:49 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1444588661' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T05:43:49.997 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:49 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: ignoring --setuser ceph since I am not root 2024-09-21T05:43:49.997 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:49 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: ignoring --setgroup ceph since I am not root 2024-09-21T05:43:50.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:50 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1444588661' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T05:43:50.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:50 smithi007 ceph-mon[30983]: mgrmap e5: x(active, since 5s) 2024-09-21T05:43:51.466 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:43:51.466 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T05:43:51.466 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T05:43:51.466 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T05:43:51.466 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T05:43:51.466 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:43:51.466 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-09-21T05:43:51.467 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 5... 2024-09-21T05:43:51.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:51 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4163259947' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T05:43:55.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:54 smithi007 ceph-mon[30983]: Active manager daemon x restarted 2024-09-21T05:43:55.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:54 smithi007 ceph-mon[30983]: Activating manager daemon x 2024-09-21T05:43:55.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:54 smithi007 ceph-mon[30983]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T05:43:55.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:54 smithi007 ceph-mon[30983]: mgrmap e6: x(active, starting, since 0.00387797s) 2024-09-21T05:43:55.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:54 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:43:55.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:54 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T05:43:55.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:54 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T05:43:55.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:54 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T05:43:55.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:54 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T05:43:55.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:54 smithi007 ceph-mon[30983]: Manager daemon x is now available 2024-09-21T05:43:56.440 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:43:56.440 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T05:43:56.441 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T05:43:56.441 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:43:56.441 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 5 is available 2024-09-21T05:43:56.441 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying orchestrator module is enabled... 2024-09-21T05:43:57.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:56 smithi007 ceph-mon[30983]: mgrmap e7: x(active, since 1.00567s) 2024-09-21T05:43:57.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:56 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:43:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:56 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:43:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:56 smithi007 ceph-mon[30983]: Found migration_current of "None". Setting to last migration. 2024-09-21T05:43:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:56 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:43:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:56 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:43:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:56 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:56 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:56 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T05:43:57.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:56 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T05:43:58.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2099853142' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T05:43:58.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2099853142' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T05:43:58.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-mon[30983]: mgrmap e8: x(active, since 2s) 2024-09-21T05:43:58.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-mon[30983]: [21/Sep/2024:05:43:57] ENGINE Bus STARTING 2024-09-21T05:43:58.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:58.195 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:43:57.830+0000 7fd350879640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:05:43:57] ENGINE Error in HTTPServer.serve 2024-09-21T05:43:58.195 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: Traceback (most recent call last): 2024-09-21T05:43:58.195 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:43:58.195 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: self._connections.run(self.expiration_interval) 2024-09-21T05:43:58.195 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:43:58.195 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: self._run(expiration_interval) 2024-09-21T05:43:58.195 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:43:58.195 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:43:58.195 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:43:58.195 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:43:58.196 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:43:58.196 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: s = self.context.wrap_socket( 2024-09-21T05:43:58.196 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:43:58.196 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: return self.sslsocket_class._create( 2024-09-21T05:43:58.196 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:43:58.196 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: self.do_handshake() 2024-09-21T05:43:58.196 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:43:58.196 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: self._sslobj.do_handshake() 2024-09-21T05:43:58.196 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:43:58.196 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:43:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:43:58.197 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T05:43:58.197 INFO:teuthology.orchestra.run.smithi007.stdout:Setting orchestrator backend to cephadm... 2024-09-21T05:43:59.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:58 smithi007 ceph-mon[30983]: [21/Sep/2024:05:43:57] ENGINE Serving on https://172.21.15.7:7150 2024-09-21T05:43:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:58 smithi007 ceph-mon[30983]: [21/Sep/2024:05:43:57] ENGINE Error in HTTPServer.serve 2024-09-21T05:43:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-09-21T05:43:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:43:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-09-21T05:43:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:43:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-09-21T05:43:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:43:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:43:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:43:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:43:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:43:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-09-21T05:43:59.320 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:43:59.320 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-09-21T05:43:59.320 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:43:59.320 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-09-21T05:43:59.320 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:43:59.320 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-09-21T05:43:59.320 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:43:59.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:58 smithi007 ceph-mon[30983]: [21/Sep/2024:05:43:57] ENGINE Serving on http://172.21.15.7:8765 2024-09-21T05:43:59.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:58 smithi007 ceph-mon[30983]: [21/Sep/2024:05:43:57] ENGINE Bus STARTED 2024-09-21T05:43:59.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:58 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:43:59.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:58 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:00.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:43:59 smithi007 ceph-mon[30983]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T05:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout:Generating ssh key... 2024-09-21T05:44:01.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:00 smithi007 ceph-mon[30983]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:01.564 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: Generating public/private rsa key pair. 2024-09-21T05:44:01.564 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: Your identification has been saved in /tmp/tmpc5m2v1am/key 2024-09-21T05:44:01.564 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: Your public key has been saved in /tmp/tmpc5m2v1am/key.pub 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: The key fingerprint is: 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: SHA256:WKZFtveVSFNfxJ62edZjQtPM9HGBasubt4EMhMjNhSc ceph-397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: The key's randomart image is: 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: +---[RSA 3072]----+ 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: | +. o.o++| 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: | . +Eoo . + =+| 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: | o +B.. o B.*| 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: | *.. + + *o| 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: | o S.o + o +| 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: | oo.. =+| 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: | oo.o.o| 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: | o .. | 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: | ... | 2024-09-21T05:44:01.565 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: +----[SHA256]-----+ 2024-09-21T05:44:02.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:02 smithi007 ceph-mon[30983]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:02.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:02 smithi007 ceph-mon[30983]: Generating ssh key... 2024-09-21T05:44:02.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:02 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:44:02.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:02 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:44:02.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqH9ZivruCZLlTq4eNWBqfgMF22lgAZ/5rV88xIGMAtzO0gq2vmhbqhZy4B6GwuL4UK0kc59sf/UjcyDkFlmzzmtSVAZ+ngl7jsSLXhBgl8ekbM4inVbYyn/SCJbAuXTrV7zwT2yEK5FVlgm2xNnAgZb0qCLgQ2r7Ay6/dx4sFJr0xaIOWXiGLzahWzNA3UTYsqHErQIH9H5msw4yhTF+BWKIDd7O2nf3gSMCp6gvgHbifnfQYa1dbV9dCNRzHvS/rj5e6TpJ1DZkxcOAOXwDTulAyIVWc7VkPylr8jBy2Cr9JkKGwWFyBRwqfyJZSt7Kl1BoNQc+gipcLLTEZO4ZcDH7hi4eFF9UwZG1c2rshoU6O8+JwAA7LjPJNPPBItj2mdFDC0YDLlNWfWLe1/3R0aleUsK6w/zG8Kue6x1AuYO48NstUBh6k5FZ6thebAJaKVrScExtc4QQk7cZ6AnYlg0cCFpdGpR53qELWcojZYwEDV+HFPk7Y9mjeC8ZJs9k= ceph-397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:44:02.983 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T05:44:02.983 INFO:teuthology.orchestra.run.smithi007.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T05:44:02.994 INFO:teuthology.orchestra.run.smithi007.stdout:Adding host smithi007... 2024-09-21T05:44:03.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:03 smithi007 ceph-mon[30983]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:04.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:04 smithi007 ceph-mon[30983]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi007", "addr": "172.21.15.7", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:05.467 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:05 smithi007 ceph-mon[30983]: Deploying cephadm binary to smithi007 2024-09-21T05:44:07.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Added host 'smithi007' with addr '172.21.15.7' 2024-09-21T05:44:07.959 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mon service... 2024-09-21T05:44:08.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:08 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:44:08.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:08 smithi007 ceph-mon[30983]: Added host smithi007 2024-09-21T05:44:08.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:08 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:09.258 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T05:44:09.258 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mgr service... 2024-09-21T05:44:09.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:09 smithi007 ceph-mon[30983]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:09.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:09 smithi007 ceph-mon[30983]: Saving service mon spec with placement count:5 2024-09-21T05:44:09.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:09 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:44:11.177 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:10 smithi007 ceph-mon[30983]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:11.177 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:10 smithi007 ceph-mon[30983]: Saving service mgr spec with placement count:2 2024-09-21T05:44:11.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:10 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:44:11.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:10 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:44:11.179 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T05:44:12.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:12 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:44:12.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:12 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1209408090' entity='client.admin' 2024-09-21T05:44:13.946 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling the dashboard module... 2024-09-21T05:44:13.975 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:13 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3928537058' entity='client.admin' 2024-09-21T05:44:13.975 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:13 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:44:15.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:15 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3040094593' entity='mgr.x' 2024-09-21T05:44:15.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:15 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/950602483' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T05:44:15.713 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:15 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: ignoring --setuser ceph since I am not root 2024-09-21T05:44:15.713 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:15 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: ignoring --setgroup ceph since I am not root 2024-09-21T05:44:16.424 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:16 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/950602483' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T05:44:16.424 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:16 smithi007 ceph-mon[30983]: mgrmap e9: x(active, since 20s) 2024-09-21T05:44:17.626 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:44:17.626 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T05:44:17.626 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T05:44:17.626 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T05:44:17.626 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T05:44:17.627 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:44:17.627 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-09-21T05:44:17.627 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 9... 2024-09-21T05:44:17.662 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:17 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2910189127' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T05:44:21.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:20 smithi007 ceph-mon[30983]: Active manager daemon x restarted 2024-09-21T05:44:21.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:20 smithi007 ceph-mon[30983]: Activating manager daemon x 2024-09-21T05:44:21.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:20 smithi007 ceph-mon[30983]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T05:44:21.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:20 smithi007 ceph-mon[30983]: mgrmap e10: x(active, starting, since 0.00385943s) 2024-09-21T05:44:21.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:20 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:44:21.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:20 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T05:44:21.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:20 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T05:44:21.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:20 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T05:44:21.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:20 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T05:44:21.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:20 smithi007 ceph-mon[30983]: Manager daemon x is now available 2024-09-21T05:44:21.978 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:21 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:21.978 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:21 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T05:44:21.979 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:21 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T05:44:21.979 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:21 smithi007 ceph-mon[30983]: mgrmap e11: x(active, since 1.00797s) 2024-09-21T05:44:22.215 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:44:22.215 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T05:44:22.215 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T05:44:22.215 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:44:22.215 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 9 is available 2024-09-21T05:44:22.215 INFO:teuthology.orchestra.run.smithi007.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T05:44:22.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-mon[30983]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T05:44:22.881 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-mon[30983]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T05:44:23.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:44:22.878+0000 7fd4107ee640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:05:44:22] ENGINE Error in HTTPServer.serve 2024-09-21T05:44:23.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: Traceback (most recent call last): 2024-09-21T05:44:23.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:44:23.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: self._connections.run(self.expiration_interval) 2024-09-21T05:44:23.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:44:23.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: self._run(expiration_interval) 2024-09-21T05:44:23.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:44:23.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:44:23.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:44:23.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:44:23.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:44:23.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: s = self.context.wrap_socket( 2024-09-21T05:44:23.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:44:23.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: return self.sslsocket_class._create( 2024-09-21T05:44:23.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:44:23.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: self.do_handshake() 2024-09-21T05:44:23.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:44:23.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: self._sslobj.do_handshake() 2024-09-21T05:44:23.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:44:23.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:44:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:44:24.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:23 smithi007 ceph-mon[30983]: [21/Sep/2024:05:44:22] ENGINE Bus STARTING 2024-09-21T05:44:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:23 smithi007 ceph-mon[30983]: mgrmap e12: x(active, since 2s) 2024-09-21T05:44:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:23 smithi007 ceph-mon[30983]: [21/Sep/2024:05:44:22] ENGINE Serving on http://172.21.15.7:8765 2024-09-21T05:44:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:23 smithi007 ceph-mon[30983]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:23 smithi007 ceph-mon[30983]: [21/Sep/2024:05:44:22] ENGINE Serving on https://172.21.15.7:7150 2024-09-21T05:44:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:23 smithi007 ceph-mon[30983]: [21/Sep/2024:05:44:22] ENGINE Bus STARTED 2024-09-21T05:44:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:23 smithi007 ceph-mon[30983]: [21/Sep/2024:05:44:22] ENGINE Error in HTTPServer.serve 2024-09-21T05:44:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-09-21T05:44:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:44:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-09-21T05:44:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:44:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-09-21T05:44:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:44:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:44:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:44:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:44:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:44:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-09-21T05:44:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:44:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-09-21T05:44:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:44:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-09-21T05:44:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:44:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-09-21T05:44:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:44:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:23 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:25.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:25 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:25.513 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+jCCAuKgAwIBAgIUV3KcWQ39Dpz7eX2RrIPpsTxVr+IwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA1NDQyNFoXDTM0\nMDkyMjA1NDQyNFowFjEUMBIGA1UEAwwLMTcyLjIxLjE1LjcwggIiMA0GCSqGSIb3\nDQEBAQUAA4ICDwAwggIKAoICAQCslkJ4Cn68jWAm0s+l6eKB8VcODGoJpMTbUoQO\nZD54skMivTk8vKkNFir59BhBqa3Ff3fxhEIJEqGU2OfcfxXfRKPk4nPTxFchxzf1\nNVj020bPG5q9/bkULAd84CYSus8rUW+QdU1hS1ZqnDeivgKFo1BVjwwLPdbKtM2M\n2hEorJwL3ABt4OeiElpnmXjGu7t48MLZRrHtGdjVrTf6JJoXHPcpcBxD+LVrV7Sq\nxu8r90Zh7FzzwCNOYflTTempu6akHEMHQwlCILJoEFsezsVTrwz877Xm5/Ty0x2U\nkEJfFE9oJzbTtpzyg1AB1EJ0JCkS7OD/9bug7ohffSB6jh4HtUuKy+cu0UgDG4Z2\nqiOtPX2PqwzRNHvY9ABFYv5DmW+xBk2zK1kbL8ia9Nghj3az6DhZt/3ziyblE83V\nmwS/gPURDAJ/jH9iZ87aqqb7FASVwbW3T6OocGAHu+aEHAyCbaSsjkn+KwRVU1zq\nWd/pCrjfyLrTcOQTeLgu3CL7OlDu7WSjs0lNe1WALc7W5qZvhu0oXhrE/XOrL9wy\nlPUfYURWOWXfDUq45jg8NKuV3OqbeIzmcnQW8pLAzRqCK460UCyjqAy3DyRmiYyh\nFc4j8dIuNWVX8WA5uQC4De8y6ziRyiIFBg45Urpq5VN/VvdR0egc6zr1o/nKoVO4\nfwBCgwIDAQABoz8wPTAtBgNVHREEJjAkgglzbWl0aGkwMDeCEWRhc2hib2FyZF9z\nZXJ2ZXJzhwSsFQ8HMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQELBQADggIBACJP\n5zHQgXZN02o9X7vSs+Zmyd+XMnZAjcupD18tfjUaIdyAbvzbI8xdCz51cNGi4IRs\nJDiKziVPat/j4pkLrpOfyESAf/kpAuO7d94z2jnaoGzP8hmeT5p5v0zEWwtGOtjD\nbl3m/JM5fL1oqol5c6TNr9buWj+BUFg3OmUcXpMZ65hNxxBGAEEWVJ+jIuxUVf+M\nqdJSfJFlKMB+r6CEGsKY/jp25Y4gr6TRWTum3PbELBk9rHQANvf2yIttQkte+H78\nnAzuoQg7zzk3+QYeCGzDj6fQii+O/XaFKVFn01dGneJvdumdlivfyHSznPQcLXw3\nEmmYxqNLOhoTKV6HkakKq7ShmMqtmopio7l52hozV2FWFxGzZNKuT6EvqvHT+TF0\nyduuw9juB53cfcopEm32U26n28wGgsmNC2vcFdWteZL5z44DwvVb0+GJqchJha/f\neCr7JUfIMkKmEwWSgNUHeJKb0moAS/oGJNFoe49TaozTzyoHCmhGoRAxmc5RjHbD\ntmXaqgnHt3swT6Bkki9tCGkBZh9c7MMJ7aas4D5dttXbM1Z92Y/gLHgTq1pel/W4\nwMvSSaBxMDlmbS6W/21TwZh+AFIYWLckG0zKWyK2UsoIUgTg4lVyHAJH9vks6BJ9\ns239Mqj1zpoxZ2RM/m/2kx1iKjWJOxL0nG/zl2ED\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEArJZCeAp+vI1gJtLPpenigfFXDgxqCaTE21KEDmQ+eLJDIr05\nPLypDRYq+fQYQamtxX938YRCCRKhlNjn3H8V30Sj5OJz08RXIcc39TVY9NtGzxua\nvf25FCwHfOAmErrPK1FvkHVNYUtWapw3or4ChaNQVY8MCz3WyrTNjNoRKKycC9wA\nbeDnohJaZ5l4xru7ePDC2Uax7RnY1a03+iSaFxz3KXAcQ/i1a1e0qsbvK/dGYexc\n88AjTmH5U03pqbumpBxDB0MJQiCyaBBbHs7FU68M/O+15uf08tMdlJBCXxRPaCc2\n07ac8oNQAdRCdCQpEuzg//W7oO6IX30geo4eB7VLisvnLtFIAxuGdqojrT19j6sM\n0TR72PQARWL+Q5lvsQZNsytZGy/ImvTYIY92s+g4Wbf984sm5RPN1ZsEv4D1EQwC\nf4x/YmfO2qqm+xQElcG1t0+jqHBgB7vmhBwMgm2krI5J/isEVVNc6lnf6Qq438i6\n03DkE3i4Ltwi+zpQ7u1ko7NJTXtVgC3O1uamb4btKF4axP1zqy/cMpT1H2FEVjll\n3w1KuOY4PDSrldzqm3iM5nJ0FvKSwM0agiuOtFAso6gMtw8kZomMoRXOI/HSLjVl\nV/FgObkAuA3vMus4kcoiBQYOOVK6auVTf1b3UdHoHOs69aP5yqFTuH8AQoMCAwEA\nAQKCAgABhqycyh73xNpCTZ/nbCuEEaG+7o4reqkA9XhUdj91KsJcNscgSdzG0Fjd\n7/Ic9oaiVe+2E4DP+rmyCr72HKuRV1aJqhTzHOvWUSAmC2w3cg7suuZB4tH1ozQH\nvyWnCb7WN7igUuE1yIhBlhMJ3dtA2kJWF1c4bDoPfczJf44iSXBxzGa2kgQKU1Y4\nT0uZmkRcm+hlKnJdUdqwfQEfNZ6lMKzg0Wx2j2bvRY3D6tFnlp6pNAFYaG0HfudI\n/Mnhpdah4dwX3thgnNBnCin8GkD1bflT7TyzB38LfKFo1GO52oCfP6WE9rrpjA6z\njXBu/XjdgXm12bLoh+Nt0LnuS35peE7kFtRdbGj5BsnwXkqvkIEBnczMk8jg+7qf\nXdn3UIpkpt7K00LEte2BGYR7SpPq/SzATW8rgnyPSBRIiDHNF/dNIgE3sx4knJxW\ncM+Y3beIGgmmlezy1198qEdtYOaZlLRLphFy1i4CgucfbzkApwJMEwUJp+zoJ/8Q\nnhT83HuCG+R1E2vlXdsbGa6cJ8kAaypeUe5UeNN0iogJCocvjW0kz70o0hcniwEE\nUyz3u/m1j9WDOuq0U611RlvCXdREK1i7NzARiUdvWpuGLDnwfY4rj0c24PjVBgbR\nXd6bZVOKF75BV+0tNOW9zdDli1kKE0viVNxjWxagEsAZW7BQ1QKCAQEA40Szb7WG\n16YJwP3aQZGUDO2aAcpdflg1xdYIJdUhXpjeG21Y8Yy80mwrkwvuZluE8mM0/vgO\nG27w3jJPUSSgvgRbEC0doY1JPXhcpjz1on7v2C5AxuWR+0y48rwDD96izP56kLJx\naVb6BHVHVvyxDtLyGuKoRb3im1oKmAvSIsAn605D2cEfaefNbSDpDXU+Odnpf51k\nciuq4DW5hv/JnB4XiN5LhVJo0FMgexxtWR24xWyj2g/jhhOlO/nT7A9S9Fl9idsa\nusxOIVBZ2AYX8n2g2o+Wc2POB2bGYcAcDtjvsN5A6B4S/teeeeC6jRtl6RCYDrKo\nh7ylfNqodtCIpwKCAQEAwmfaWuOS3rsusOm6kTBP4lbrXYj3ijQVxPq1MDPiK/LK\naFxmklRxfp53UvZ47rOPqi9+UXFEyZYKdPiv0uUSt0exptxcP2QxIRVPWI2BN+rk\nK3X1gajD7U9frROvEQxO0ROYigdbcZDHW2+MxUo0OVM6LzsLmVcwr8TM9BXcPSw8\nj2ved7HMjHiKbN96X9wQUOyZE6fUN2EE9J0p85LJdjVha2gvXLA/OojbJI6JEIah\nFEfE8hj+dvkN9BEeow5KVljA/ZlTSReKJEIeRJRD4eHdVhNP4KBQzwxoM9DgjcTU\n/0Scf8dy8LvVq9tOgnpTkyiGhTATB3wGRjEB/UlWxQKCAQBPX8ovpL2wiXv0nHRi\n3B5SGZXlNDFNFC/LpcH4vKRH7qn7+EfNLTMxZrgdRliABUy8fyueNTJwIGIdqIKN\nO3ashsbrMmab6sV+o4/wO3AqzZyk6xqSnNFMbHJXzJRhMYe4gtR5vujfOpJdhjxh\nRCXuoHwQKcNNgFEpotv6WH6Oxn/qrc4CunFnQp87kvfyTFVsTRBBEs5nFZs7bWgb\nnzBhxxy/H6xOpwaWY8H/XWFPc5L52MStP0lepXPbK5j5ZCy7zJmM0SpXvU04U2Dd\nkttAROIuE2IfcOcfLKTytO7XvKqSIj2XFBHcUaA2vudIqx3/tVz2HS3BIoDFx3R4\n8sIXAoIBACIwraBqgbwWY4HNuXgrbQE7lC1hF1gBDQsVpKQTm+Vqz9pG1etKWqOQ\nLyAyJNamUc/2hlrAdv6VGsWzrwiCLSZ6v22/N6IWduWAn/HNATraXsKd/k2NZtfn\nq8X+vj1bUslGjv9Hh/eTJNyZ48IW6NRkJMmFsuaHBRMEo58R8Sf5DbWTnQ6kAHt7\n/6xiKV2OkHgLBGkGjTYoI/z5XxVtbW0Suk1vh1Tf0l7zDseBIe38H3w3mxWQ+7/k\n0WVpVWAL9Vr2RQrU2mbycuMplbUt9jpVxN2Mi/HPgCbJ4dGrHLMSOPukD3oRk89u\n2YdeDJK5/NTWvcHS0KXyVBAoMldffJkCggEALQ434YF65EHDOXKVQ8Y03S8y3glt\nimg/RRv9kSS+2105S4jGKO2yGfHnbNO4e4sa/pEQ2MBrhAYj25ohUlVh1rxXr3X5\nUeW0LpfpvI1H+CGfM0y685ZM39PDSpege3j3/4tbPYoOd+UXzyEZ2XJ4uSHVT40c\nMYSXI12M6HE/OXLHUNYpP/YxmPYt/rkj6iNYLmC9B1yBv9ENvsNLQYlqwwtlPxWO\nt8J7d7jDfz843Qtg/gFUXILLOT02YsWb0DVpKsilytuCj1SzJwum+Ylv8TrOWjIU\nlM0P+MoMFFnfTP7YzXSByM+XHB23507v99myOip9yrZ3WQUh4JOEN+Drfg==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T05:44:27.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T05:44:27.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:27 smithi007 ceph-mon[30983]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:27.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:27 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:28.204 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T05:44:28.205 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial admin user... 2024-09-21T05:44:29.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:28 smithi007 ceph-mon[30983]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:29.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:28 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:29.611 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$pCc1T7BFDJOtg9ZrNGAxoOrosA.iQZSUGHRB/QURI5pwLN76PeQ1G", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726897469, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T05:44:29.611 INFO:teuthology.orchestra.run.smithi007.stdout:Fetching dashboard port number... 2024-09-21T05:44:30.228 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:30 smithi007 ceph-mon[30983]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:30.228 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:30 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:30.768 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T05:44:30.779 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T05:44:30.779 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-21T05:44:30.786 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T05:44:30.786 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-21T05:44:30.786 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-21T05:44:30.786 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T05:44:30.788 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph Dashboard is now available at: 2024-09-21T05:44:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:44:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: URL: https://smithi007.front.sepia.ceph.com:8443/ 2024-09-21T05:44:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: User: admin 2024-09-21T05:44:30.789 INFO:teuthology.orchestra.run.smithi007.stdout: Password: zmf4bfjhzj 2024-09-21T05:44:30.789 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:44:30.789 INFO:teuthology.orchestra.run.smithi007.stdout:Saving cluster configuration to /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config directory 2024-09-21T05:44:31.547 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:31 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/717664975' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T05:44:32.133 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T05:44:32.133 INFO:teuthology.orchestra.run.smithi007.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T05:44:32.133 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:44:32.133 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:44:32.133 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:44:32.133 INFO:teuthology.orchestra.run.smithi007.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T05:44:32.133 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:44:32.133 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T05:44:32.133 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:44:32.133 INFO:teuthology.orchestra.run.smithi007.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T05:44:32.134 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:44:32.134 INFO:teuthology.orchestra.run.smithi007.stdout: ceph telemetry on 2024-09-21T05:44:32.134 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:44:32.134 INFO:teuthology.orchestra.run.smithi007.stdout:For more information see: 2024-09-21T05:44:32.134 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:44:32.134 INFO:teuthology.orchestra.run.smithi007.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T05:44:32.134 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:44:32.134 INFO:teuthology.orchestra.run.smithi007.stdout:Bootstrap complete. 2024-09-21T05:44:32.171 INFO:tasks.cephadm:Fetching config... 2024-09-21T05:44:32.172 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:44:32.172 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T05:44:32.188 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T05:44:32.189 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:44:32.189 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T05:44:32.245 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T05:44:32.245 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:44:32.246 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T05:44:32.312 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T05:44:32.312 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:44:32.312 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T05:44:32.367 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T05:44:32.368 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqH9ZivruCZLlTq4eNWBqfgMF22lgAZ/5rV88xIGMAtzO0gq2vmhbqhZy4B6GwuL4UK0kc59sf/UjcyDkFlmzzmtSVAZ+ngl7jsSLXhBgl8ekbM4inVbYyn/SCJbAuXTrV7zwT2yEK5FVlgm2xNnAgZb0qCLgQ2r7Ay6/dx4sFJr0xaIOWXiGLzahWzNA3UTYsqHErQIH9H5msw4yhTF+BWKIDd7O2nf3gSMCp6gvgHbifnfQYa1dbV9dCNRzHvS/rj5e6TpJ1DZkxcOAOXwDTulAyIVWc7VkPylr8jBy2Cr9JkKGwWFyBRwqfyJZSt7Kl1BoNQc+gipcLLTEZO4ZcDH7hi4eFF9UwZG1c2rshoU6O8+JwAA7LjPJNPPBItj2mdFDC0YDLlNWfWLe1/3R0aleUsK6w/zG8Kue6x1AuYO48NstUBh6k5FZ6thebAJaKVrScExtc4QQk7cZ6AnYlg0cCFpdGpR53qELWcojZYwEDV+HFPk7Y9mjeC8ZJs9k= ceph-397810bc-77dc-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T05:44:32.444 INFO:teuthology.orchestra.run.smithi007.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqH9ZivruCZLlTq4eNWBqfgMF22lgAZ/5rV88xIGMAtzO0gq2vmhbqhZy4B6GwuL4UK0kc59sf/UjcyDkFlmzzmtSVAZ+ngl7jsSLXhBgl8ekbM4inVbYyn/SCJbAuXTrV7zwT2yEK5FVlgm2xNnAgZb0qCLgQ2r7Ay6/dx4sFJr0xaIOWXiGLzahWzNA3UTYsqHErQIH9H5msw4yhTF+BWKIDd7O2nf3gSMCp6gvgHbifnfQYa1dbV9dCNRzHvS/rj5e6TpJ1DZkxcOAOXwDTulAyIVWc7VkPylr8jBy2Cr9JkKGwWFyBRwqfyJZSt7Kl1BoNQc+gipcLLTEZO4ZcDH7hi4eFF9UwZG1c2rshoU6O8+JwAA7LjPJNPPBItj2mdFDC0YDLlNWfWLe1/3R0aleUsK6w/zG8Kue6x1AuYO48NstUBh6k5FZ6thebAJaKVrScExtc4QQk7cZ6AnYlg0cCFpdGpR53qELWcojZYwEDV+HFPk7Y9mjeC8ZJs9k= ceph-397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:44:32.462 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqH9ZivruCZLlTq4eNWBqfgMF22lgAZ/5rV88xIGMAtzO0gq2vmhbqhZy4B6GwuL4UK0kc59sf/UjcyDkFlmzzmtSVAZ+ngl7jsSLXhBgl8ekbM4inVbYyn/SCJbAuXTrV7zwT2yEK5FVlgm2xNnAgZb0qCLgQ2r7Ay6/dx4sFJr0xaIOWXiGLzahWzNA3UTYsqHErQIH9H5msw4yhTF+BWKIDd7O2nf3gSMCp6gvgHbifnfQYa1dbV9dCNRzHvS/rj5e6TpJ1DZkxcOAOXwDTulAyIVWc7VkPylr8jBy2Cr9JkKGwWFyBRwqfyJZSt7Kl1BoNQc+gipcLLTEZO4ZcDH7hi4eFF9UwZG1c2rshoU6O8+JwAA7LjPJNPPBItj2mdFDC0YDLlNWfWLe1/3R0aleUsK6w/zG8Kue6x1AuYO48NstUBh6k5FZ6thebAJaKVrScExtc4QQk7cZ6AnYlg0cCFpdGpR53qELWcojZYwEDV+HFPk7Y9mjeC8ZJs9k= ceph-397810bc-77dc-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T05:44:32.506 INFO:teuthology.orchestra.run.smithi027.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqH9ZivruCZLlTq4eNWBqfgMF22lgAZ/5rV88xIGMAtzO0gq2vmhbqhZy4B6GwuL4UK0kc59sf/UjcyDkFlmzzmtSVAZ+ngl7jsSLXhBgl8ekbM4inVbYyn/SCJbAuXTrV7zwT2yEK5FVlgm2xNnAgZb0qCLgQ2r7Ay6/dx4sFJr0xaIOWXiGLzahWzNA3UTYsqHErQIH9H5msw4yhTF+BWKIDd7O2nf3gSMCp6gvgHbifnfQYa1dbV9dCNRzHvS/rj5e6TpJ1DZkxcOAOXwDTulAyIVWc7VkPylr8jBy2Cr9JkKGwWFyBRwqfyJZSt7Kl1BoNQc+gipcLLTEZO4ZcDH7hi4eFF9UwZG1c2rshoU6O8+JwAA7LjPJNPPBItj2mdFDC0YDLlNWfWLe1/3R0aleUsK6w/zG8Kue6x1AuYO48NstUBh6k5FZ6thebAJaKVrScExtc4QQk7cZ6AnYlg0cCFpdGpR53qELWcojZYwEDV+HFPk7Y9mjeC8ZJs9k= ceph-397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:44:32.519 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqH9ZivruCZLlTq4eNWBqfgMF22lgAZ/5rV88xIGMAtzO0gq2vmhbqhZy4B6GwuL4UK0kc59sf/UjcyDkFlmzzmtSVAZ+ngl7jsSLXhBgl8ekbM4inVbYyn/SCJbAuXTrV7zwT2yEK5FVlgm2xNnAgZb0qCLgQ2r7Ay6/dx4sFJr0xaIOWXiGLzahWzNA3UTYsqHErQIH9H5msw4yhTF+BWKIDd7O2nf3gSMCp6gvgHbifnfQYa1dbV9dCNRzHvS/rj5e6TpJ1DZkxcOAOXwDTulAyIVWc7VkPylr8jBy2Cr9JkKGwWFyBRwqfyJZSt7Kl1BoNQc+gipcLLTEZO4ZcDH7hi4eFF9UwZG1c2rshoU6O8+JwAA7LjPJNPPBItj2mdFDC0YDLlNWfWLe1/3R0aleUsK6w/zG8Kue6x1AuYO48NstUBh6k5FZ6thebAJaKVrScExtc4QQk7cZ6AnYlg0cCFpdGpR53qELWcojZYwEDV+HFPk7Y9mjeC8ZJs9k= ceph-397810bc-77dc-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T05:44:32.560 INFO:teuthology.orchestra.run.smithi119.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqH9ZivruCZLlTq4eNWBqfgMF22lgAZ/5rV88xIGMAtzO0gq2vmhbqhZy4B6GwuL4UK0kc59sf/UjcyDkFlmzzmtSVAZ+ngl7jsSLXhBgl8ekbM4inVbYyn/SCJbAuXTrV7zwT2yEK5FVlgm2xNnAgZb0qCLgQ2r7Ay6/dx4sFJr0xaIOWXiGLzahWzNA3UTYsqHErQIH9H5msw4yhTF+BWKIDd7O2nf3gSMCp6gvgHbifnfQYa1dbV9dCNRzHvS/rj5e6TpJ1DZkxcOAOXwDTulAyIVWc7VkPylr8jBy2Cr9JkKGwWFyBRwqfyJZSt7Kl1BoNQc+gipcLLTEZO4ZcDH7hi4eFF9UwZG1c2rshoU6O8+JwAA7LjPJNPPBItj2mdFDC0YDLlNWfWLe1/3R0aleUsK6w/zG8Kue6x1AuYO48NstUBh6k5FZ6thebAJaKVrScExtc4QQk7cZ6AnYlg0cCFpdGpR53qELWcojZYwEDV+HFPk7Y9mjeC8ZJs9k= ceph-397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:44:32.572 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T05:44:32.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:32 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3210047916' entity='client.admin' 2024-09-21T05:44:32.829 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:34.581 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T05:44:34.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T05:44:34.806 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:34 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1879594688' entity='client.admin' 2024-09-21T05:44:34.806 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:34 smithi007 ceph-mon[30983]: mgrmap e13: x(active, since 12s) 2024-09-21T05:44:34.806 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:34 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:34.806 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:34 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:34.806 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:34 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:34.807 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:34 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:34.807 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:34 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:34.807 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:34 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:35.039 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:37.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:36 smithi007 ceph-mon[30983]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:37.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:36 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:37.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:36 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:37.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:36 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:37.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:36 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:37.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:36 smithi007 ceph-mon[30983]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-21T05:44:37.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:36 smithi007 ceph-mon[30983]: Updating smithi007:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:44:37.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:36 smithi007 ceph-mon[30983]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:44:37.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:36 smithi007 ceph-mon[30983]: Updating smithi007:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:44:37.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:36 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:37.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:36 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:37.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:36 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:37.055 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi027 2024-09-21T05:44:37.055 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-21T05:44:37.056 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/etc/ceph/ceph.conf 2024-09-21T05:44:37.076 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-21T05:44:37.076 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:44:37.135 INFO:tasks.cephadm:Adding host smithi027 to orchestrator... 2024-09-21T05:44:37.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch host add smithi027 2024-09-21T05:44:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:38.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:38 smithi007 ceph-mon[30983]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi027", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:39.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:39 smithi007 ceph-mon[30983]: Deploying cephadm binary to smithi027 2024-09-21T05:44:41.804 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi027' with addr '172.21.15.27' 2024-09-21T05:44:42.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:41 smithi007 ceph-mon[30983]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:42.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T05:44:42.638 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:43.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:42 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:43.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:42 smithi007 ceph-mon[30983]: Added host smithi027 2024-09-21T05:44:43.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:42 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:43.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:42 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:43.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:42 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:43.354 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:44:43.354 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.27", "hostname": "smithi027", "labels": [], "status": ""}] 2024-09-21T05:44:43.864 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi119 2024-09-21T05:44:43.865 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T05:44:43.865 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.conf 2024-09-21T05:44:43.881 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T05:44:43.881 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:44:43.936 INFO:tasks.cephadm:Adding host smithi119 to orchestrator... 2024-09-21T05:44:43.936 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch host add smithi119 2024-09-21T05:44:44.188 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:44.415 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:44 smithi007 ceph-mon[30983]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:44.415 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:44 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:44.415 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:44 smithi007 ceph-mon[30983]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:44:46.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:46 smithi007 ceph-mon[30983]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:46.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:46 smithi007 ceph-mon[30983]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi119", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:46.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:46 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:46.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:46 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:46.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:46 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:46.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:46 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:46.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:46 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi027", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:46.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:46 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:46.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:46 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:47.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:47 smithi007 ceph-mon[30983]: Deploying cephadm binary to smithi119 2024-09-21T05:44:47.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:47 smithi007 ceph-mon[30983]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-21T05:44:47.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:47 smithi007 ceph-mon[30983]: Updating smithi027:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:44:47.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:47 smithi007 ceph-mon[30983]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:44:47.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:47 smithi007 ceph-mon[30983]: Updating smithi027:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:44:47.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:47 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:47.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:47 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:47.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:47 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:48.640 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi119' with addr '172.21.15.119' 2024-09-21T05:44:48.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:48 smithi007 ceph-mon[30983]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:49.174 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T05:44:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:49.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:49 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:49.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:49 smithi007 ceph-mon[30983]: Added host smithi119 2024-09-21T05:44:49.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:49 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:49.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:49 smithi007 ceph-mon[30983]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:49.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:49 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:49.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:49 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:44:50.067 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.27", "hostname": "smithi027", "labels": [], "status": ""}, {"addr": "172.21.15.119", "hostname": "smithi119", "labels": [], "status": ""}] 2024-09-21T05:44:50.666 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T05:44:50.666 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T05:44:50.919 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:51.253 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:50 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:51.254 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:50 smithi007 ceph-mon[30983]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:44:51.965 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-09-21T05:44:52.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:51 smithi007 ceph-mon[30983]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:52.264 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:51 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1192303976' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T05:44:52.585 INFO:tasks.cephadm:Adding mon.a on smithi007 2024-09-21T05:44:52.585 INFO:tasks.cephadm:Adding mon.b on smithi027 2024-09-21T05:44:52.585 INFO:tasks.cephadm:Adding mon.c on smithi119 2024-09-21T05:44:52.585 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi007:172.21.15.7=a;smithi027:172.21.15.27=b;smithi119:172.21.15.119=c' 2024-09-21T05:44:52.841 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T05:44:52.886 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T05:44:53.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:52 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1192303976' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T05:44:53.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:52 smithi007 ceph-mon[30983]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:44:53.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:52 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:53.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:52 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:53.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:52 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:53.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:52 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:53.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:52 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:53.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:52 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:53.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:52 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:53.616 INFO:teuthology.orchestra.run.smithi119.stdout:Scheduled mon update... 2024-09-21T05:44:54.248 DEBUG:teuthology.orchestra.run.smithi027:mon.b> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T05:44:54.251 DEBUG:teuthology.orchestra.run.smithi119:mon.c> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T05:44:54.253 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T05:44:54.254 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T05:44:54.645 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:54.645 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T05:44:54.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: Updating smithi119:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:44:54.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:44:54.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: Updating smithi119:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:44:54.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:54.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:54.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:54.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:54.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:54.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:54.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:54.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:44:54.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:44:54.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:55.185 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:44:55.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:55 smithi007 ceph-mon[30983]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi027:172.21.15.27=b;smithi119:172.21.15.119=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:55.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:55 smithi007 ceph-mon[30983]: Saving service mon spec with placement smithi007:172.21.15.7=a;smithi027:172.21.15.27=b;smithi119:172.21.15.119=c;count:3 2024-09-21T05:44:55.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:55 smithi007 ceph-mon[30983]: Deploying daemon mon.c on smithi119 2024-09-21T05:44:56.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:56 smithi007 ceph-mon[30983]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:56.862 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:44:56.862 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","modified":"2024-09-21T05:43:29.867973Z","created":"2024-09-21T05:43:29.867973Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T05:44:56.862 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2024-09-21T05:44:57.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:44:57 smithi007 ceph-mon[30983]: from='client.? 172.21.15.119:0/3720439621' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:44:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:44:58 smithi119 systemd[1]: Started Ceph mon.c for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:44:58.593 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T05:44:58.593 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T05:44:58.845 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:45:03.317 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:03.317 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: mon.a calling monitor election 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: mon.c calling monitor election 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: monmap epoch 2 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: fsid 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: last_changed 2024-09-21T05:44:57.995071+0000 2024-09-21T05:45:03.318 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: created 2024-09-21T05:43:29.867973+0000 2024-09-21T05:45:03.319 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: min_mon_release 19 (squid) 2024-09-21T05:45:03.319 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: election_strategy: 1 2024-09-21T05:45:03.319 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T05:45:03.319 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-21T05:45:03.319 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: fsmap 2024-09-21T05:45:03.319 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:45:03.319 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: mgrmap e13: x(active, since 42s) 2024-09-21T05:45:03.319 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: overall HEALTH_OK 2024-09-21T05:45:03.319 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:03.319 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:03.319 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:03.319 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:03.319 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:03 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: mon.a calling monitor election 2024-09-21T05:45:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: mon.c calling monitor election 2024-09-21T05:45:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: monmap epoch 2 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: fsid 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: last_changed 2024-09-21T05:44:57.995071+0000 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: created 2024-09-21T05:43:29.867973+0000 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: min_mon_release 19 (squid) 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: election_strategy: 1 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: fsmap 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: mgrmap e13: x(active, since 42s) 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:03 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:03.956 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:45:03.956 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":2,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","modified":"2024-09-21T05:44:57.995071Z","created":"2024-09-21T05:43:29.867973Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T05:45:03.957 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 2 2024-09-21T05:45:04.233 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:04 smithi119 ceph-mon[34833]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:04.233 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:04 smithi119 ceph-mon[34833]: Deploying daemon mon.b on smithi027 2024-09-21T05:45:04.233 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:04 smithi119 ceph-mon[34833]: from='client.? 172.21.15.119:0/4116014796' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:45:04.233 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:04 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:04.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:04 smithi007 ceph-mon[30983]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:04.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:04 smithi007 ceph-mon[30983]: Deploying daemon mon.b on smithi027 2024-09-21T05:45:04.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:04 smithi007 ceph-mon[30983]: from='client.? 172.21.15.119:0/4116014796' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:45:04.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:04 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:05.537 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T05:45:05.537 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T05:45:05.792 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:45:06.187 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:06 smithi119 ceph-mon[34833]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:06.450 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:45:06.450 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":2,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","modified":"2024-09-21T05:44:57.995071Z","created":"2024-09-21T05:43:29.867973Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T05:45:06.450 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 2 2024-09-21T05:45:06.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:06 smithi007 ceph-mon[30983]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:06.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:06 smithi027 ceph-mon[34364]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T05:45:08.051 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T05:45:08.051 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T05:45:08.302 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:45:11.999 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:45:12.000 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":3,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","modified":"2024-09-21T05:45:06.708986Z","created":"2024-09-21T05:43:29.867973Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T05:45:12.000 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 3 2024-09-21T05:45:12.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:12.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:12.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: mon.a calling monitor election 2024-09-21T05:45:12.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: mon.c calling monitor election 2024-09-21T05:45:12.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:12.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:12.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: monmap epoch 3 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: fsid 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: last_changed 2024-09-21T05:45:06.708986+0000 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: created 2024-09-21T05:43:29.867973+0000 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: min_mon_release 19 (squid) 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: election_strategy: 1 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: 2: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.b 2024-09-21T05:45:12.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: fsmap 2024-09-21T05:45:12.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:45:12.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: mgrmap e13: x(active, since 51s) 2024-09-21T05:45:12.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T05:45:12.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:12.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:12.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:12.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:11 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:12.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:12.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:12.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: mon.a calling monitor election 2024-09-21T05:45:12.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: mon.c calling monitor election 2024-09-21T05:45:12.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: monmap epoch 3 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: fsid 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: last_changed 2024-09-21T05:45:06.708986+0000 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: created 2024-09-21T05:43:29.867973+0000 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: min_mon_release 19 (squid) 2024-09-21T05:45:12.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: election_strategy: 1 2024-09-21T05:45:12.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T05:45:12.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-21T05:45:12.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: 2: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.b 2024-09-21T05:45:12.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: fsmap 2024-09-21T05:45:12.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:45:12.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: mgrmap e13: x(active, since 51s) 2024-09-21T05:45:12.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: overall HEALTH_OK 2024-09-21T05:45:12.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:12.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:12.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:12.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:11 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:12.567 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T05:45:12.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T05:45:12.837 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:12.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:12 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:12 smithi119 ceph-mon[34833]: from='client.? 172.21.15.119:0/3656589193' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:45:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:12 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:12 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:12 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:12.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:12 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:12.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:12 smithi007 ceph-mon[30983]: from='client.? 172.21.15.119:0/3656589193' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:45:12.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:12 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:12.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:12 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:12.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:12 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:13.512 INFO:teuthology.orchestra.run.smithi007.stdout:# minimal ceph.conf for 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:45:13.513 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-09-21T05:45:13.513 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:45:13.513 INFO:teuthology.orchestra.run.smithi007.stdout: mon_host = [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-21T05:45:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: mon.a calling monitor election 2024-09-21T05:45:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: mon.c calling monitor election 2024-09-21T05:45:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: monmap epoch 3 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: fsid 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: last_changed 2024-09-21T05:45:06.708986+0000 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: created 2024-09-21T05:43:29.867973+0000 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: min_mon_release 19 (squid) 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: election_strategy: 1 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: 2: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.b 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: fsmap 2024-09-21T05:45:13.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:45:13.979 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: mgrmap e13: x(active, since 51s) 2024-09-21T05:45:13.979 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: overall HEALTH_OK 2024-09-21T05:45:13.979 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:13.979 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:13.979 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:13.979 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:13.979 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:13.979 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='client.? 172.21.15.119:0/3656589193' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:45:13.979 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:13.979 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:13.979 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:13 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:14.315 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T05:45:14.316 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:45:14.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T05:45:14.343 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:45:14.343 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:14.410 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-21T05:45:14.410 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T05:45:14.440 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-21T05:45:14.440 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:14.507 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T05:45:14.507 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T05:45:14.536 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T05:45:14.536 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:14.602 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-21T05:45:14.602 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-21T05:45:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: mon.b calling monitor election 2024-09-21T05:45:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: mon.b calling monitor election 2024-09-21T05:45:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: mon.c calling monitor election 2024-09-21T05:45:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: mon.a calling monitor election 2024-09-21T05:45:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T05:45:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: monmap epoch 3 2024-09-21T05:45:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: fsid 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:45:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: last_changed 2024-09-21T05:45:06.708986+0000 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: created 2024-09-21T05:43:29.867973+0000 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: min_mon_release 19 (squid) 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: election_strategy: 1 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: 2: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.b 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: fsmap 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: mgrmap e13: x(active, since 53s) 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: overall HEALTH_OK 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:45:14.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:14.844 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: Reconfiguring daemon mon.a on smithi007 2024-09-21T05:45:14.844 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:14 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:14.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: mon.b calling monitor election 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: mon.b calling monitor election 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: mon.c calling monitor election 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: mon.a calling monitor election 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: monmap epoch 3 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: fsid 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: last_changed 2024-09-21T05:45:06.708986+0000 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: created 2024-09-21T05:43:29.867973+0000 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: min_mon_release 19 (squid) 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: election_strategy: 1 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: 2: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.b 2024-09-21T05:45:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: fsmap 2024-09-21T05:45:14.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:45:14.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: mgrmap e13: x(active, since 53s) 2024-09-21T05:45:14.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: overall HEALTH_OK 2024-09-21T05:45:14.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:14.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T05:45:14.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:14.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:45:14.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:14.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: Reconfiguring daemon mon.a on smithi007 2024-09-21T05:45:14.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:14 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:15.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: mon.b calling monitor election 2024-09-21T05:45:15.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: mon.b calling monitor election 2024-09-21T05:45:15.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: mon.c calling monitor election 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: mon.a calling monitor election 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: monmap epoch 3 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: fsid 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: last_changed 2024-09-21T05:45:06.708986+0000 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: created 2024-09-21T05:43:29.867973+0000 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: min_mon_release 19 (squid) 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: election_strategy: 1 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: 1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.c 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: 2: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.b 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: fsmap 2024-09-21T05:45:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:45:15.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: mgrmap e13: x(active, since 53s) 2024-09-21T05:45:15.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T05:45:15.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:15.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T05:45:15.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:15.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:45:15.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:15.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: Reconfiguring daemon mon.a on smithi007 2024-09-21T05:45:15.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:14 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:15.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:15 smithi007 ceph-mon[30983]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:15.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:15 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:15.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:15 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:15.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:15 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:15.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:15 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:45:15.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:15 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:16.071 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:15 smithi027 ceph-mon[34364]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:16.072 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:15 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:16.072 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:15 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:16.072 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:15 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:16.072 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:15 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:45:16.072 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:15 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:16.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:15 smithi119 ceph-mon[34833]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:16.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:15 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:16.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:15 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:16.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:15 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:16.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:15 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:45:16.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:15 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:17.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:17 smithi027 ceph-mon[34364]: Reconfiguring mon.b (monmap changed)... 2024-09-21T05:45:17.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:17 smithi027 ceph-mon[34364]: Reconfiguring daemon mon.b on smithi027 2024-09-21T05:45:17.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:17 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:17.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:17 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1076670223' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T05:45:17.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:17 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:17.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:17 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:17.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:17 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:17.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:17 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:45:17.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:17 smithi027 ceph-mon[34364]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:17.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:17 smithi119 ceph-mon[34833]: Reconfiguring mon.b (monmap changed)... 2024-09-21T05:45:17.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:17 smithi119 ceph-mon[34833]: Reconfiguring daemon mon.b on smithi027 2024-09-21T05:45:17.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:17 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:17.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:17 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1076670223' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T05:45:17.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:17 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:17.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:17 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:17.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:17 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:17.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:17 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:45:17.376 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:17 smithi119 ceph-mon[34833]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:17.444 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:17 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: ignoring --setuser ceph since I am not root 2024-09-21T05:45:17.444 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:17 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: ignoring --setgroup ceph since I am not root 2024-09-21T05:45:17.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:17 smithi007 ceph-mon[30983]: Reconfiguring mon.b (monmap changed)... 2024-09-21T05:45:17.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:17 smithi007 ceph-mon[30983]: Reconfiguring daemon mon.b on smithi027 2024-09-21T05:45:17.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:17 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:17.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:17 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1076670223' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T05:45:17.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:17 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:17.445 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:17 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' 2024-09-21T05:45:17.445 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:17 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:17.445 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:17 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:45:17.445 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:17 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/2264307353' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:17.716 INFO:tasks.cephadm:Adding mgr.x on smithi007 2024-09-21T05:45:17.716 INFO:tasks.cephadm:Adding mgr.y on smithi027 2024-09-21T05:45:17.716 INFO:tasks.cephadm:Adding mgr.z on smithi119 2024-09-21T05:45:17.716 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi007=x;smithi027=y;smithi119=z' 2024-09-21T05:45:18.291 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:45:18.378 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:18 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1076670223' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T05:45:18.378 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:18 smithi119 ceph-mon[34833]: mgrmap e14: x(active, since 56s) 2024-09-21T05:45:18.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:18 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1076670223' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T05:45:18.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:18 smithi027 ceph-mon[34364]: mgrmap e14: x(active, since 56s) 2024-09-21T05:45:18.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:18 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1076670223' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T05:45:18.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:18 smithi007 ceph-mon[30983]: mgrmap e14: x(active, since 56s) 2024-09-21T05:45:22.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:22 smithi027 ceph-mon[34364]: Active manager daemon x restarted 2024-09-21T05:45:22.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:22 smithi027 ceph-mon[34364]: Activating manager daemon x 2024-09-21T05:45:22.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:22 smithi027 ceph-mon[34364]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T05:45:22.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:22 smithi027 ceph-mon[34364]: mgrmap e15: x(active, starting, since 0.00538524s) 2024-09-21T05:45:22.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:22.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:22.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:22.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T05:45:22.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T05:45:22.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T05:45:22.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T05:45:22.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:22 smithi027 ceph-mon[34364]: Manager daemon x is now available 2024-09-21T05:45:22.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:22 smithi007 ceph-mon[30983]: Active manager daemon x restarted 2024-09-21T05:45:22.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:22 smithi007 ceph-mon[30983]: Activating manager daemon x 2024-09-21T05:45:22.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:22 smithi007 ceph-mon[30983]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T05:45:22.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:22 smithi007 ceph-mon[30983]: mgrmap e15: x(active, starting, since 0.00538524s) 2024-09-21T05:45:22.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:22.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:22.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:22.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T05:45:22.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T05:45:22.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T05:45:22.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T05:45:22.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:22 smithi007 ceph-mon[30983]: Manager daemon x is now available 2024-09-21T05:45:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:22 smithi119 ceph-mon[34833]: Active manager daemon x restarted 2024-09-21T05:45:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:22 smithi119 ceph-mon[34833]: Activating manager daemon x 2024-09-21T05:45:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:22 smithi119 ceph-mon[34833]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T05:45:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:22 smithi119 ceph-mon[34833]: mgrmap e15: x(active, starting, since 0.00538524s) 2024-09-21T05:45:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T05:45:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T05:45:22.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T05:45:22.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T05:45:22.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:22 smithi119 ceph-mon[34833]: Manager daemon x is now available 2024-09-21T05:45:23.392 INFO:teuthology.orchestra.run.smithi119.stdout:Scheduled mgr update... 2024-09-21T05:45:23.694 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:23.695 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T05:45:23.695 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T05:45:23.695 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:23 smithi119 ceph-mon[34833]: mgrmap e16: x(active, since 1.01035s) 2024-09-21T05:45:23.695 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:23.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:23.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T05:45:23.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T05:45:23.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:23 smithi027 ceph-mon[34364]: mgrmap e16: x(active, since 1.01035s) 2024-09-21T05:45:23.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:23.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:23.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T05:45:23.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T05:45:23.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:23 smithi007 ceph-mon[30983]: mgrmap e16: x(active, since 1.01035s) 2024-09-21T05:45:23.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:23.998 DEBUG:teuthology.orchestra.run.smithi027:mgr.y> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T05:45:24.000 DEBUG:teuthology.orchestra.run.smithi119:mgr.z> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T05:45:24.003 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T05:45:24.003 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T05:45:24.005 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T05:45:24.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T05:45:24.048 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T05:45:24.048 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T05:45:24.090 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T05:45:24.091 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T05:45:24.134 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T05:45:24.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T05:45:24.177 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T05:45:24.177 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T05:45:24.220 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T05:45:24.220 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T05:45:24.275 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T05:45:24.275 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T05:45:24.327 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T05:45:24.327 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T05:45:24.380 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T05:45:24.380 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T05:45:24.436 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T05:45:24.436 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T05:45:24.437 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:24.492 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T05:45:24.492 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T05:45:24.544 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T05:45:24.544 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T05:45:24.597 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T05:45:24.597 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T05:45:24.641 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T05:45:24.642 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T05:45:24.693 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T05:45:24.693 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T05:45:24.747 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T05:45:24.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T05:45:24.799 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T05:45:24.799 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T05:45:24.863 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T05:45:24.863 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T05:45:24.938 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T05:45:24.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T05:45:24.993 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-21T05:45:24.994 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr debug_cephsqlite 20 2024-09-21T05:45:25.047 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T05:45:25.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T05:45:25.103 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T05:45:25.103 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T05:45:25.150 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:25.165 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T05:45:25.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T05:45:25.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:24 smithi007 ceph-mon[30983]: Saving service mgr spec with placement smithi007=x;smithi027=y;smithi119=z;count:3 2024-09-21T05:45:25.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi027", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.167 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:25.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:24 smithi027 ceph-mon[34364]: Saving service mgr spec with placement smithi007=x;smithi027=y;smithi119=z;count:3 2024-09-21T05:45:25.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi027", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.239 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-21T05:45:25.240 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-21T05:45:25.321 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-21T05:45:25.321 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-21T05:45:25.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:24 smithi119 ceph-mon[34833]: Saving service mgr spec with placement smithi007=x;smithi027=y;smithi119=z;count:3 2024-09-21T05:45:25.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi027", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:25.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:25.343 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:25.343 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:25.361 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-21T05:45:25.361 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-21T05:45:25.418 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T05:45:25.418 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T05:45:25.499 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T05:45:25.499 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T05:45:25.547 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T05:45:25.547 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T05:45:25.613 DEBUG:tasks.cephadm:set 30 configs 2024-09-21T05:45:25.613 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi007') 2024-09-21T05:45:26.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:25 smithi007 ceph-mon[30983]: mgrmap e17: x(active, since 2s) 2024-09-21T05:45:26.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:25 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:26.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:25 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:26.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:25 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:26.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:25 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3785723441' entity='client.admin' 2024-09-21T05:45:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:25 smithi119 ceph-mon[34833]: mgrmap e17: x(active, since 2s) 2024-09-21T05:45:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:25 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:25 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:25 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:25 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3785723441' entity='client.admin' 2024-09-21T05:45:26.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:25 smithi027 ceph-mon[34364]: mgrmap e17: x(active, since 2s) 2024-09-21T05:45:26.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:25 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:26.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:25 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:26.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:25 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:26.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:25 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3785723441' entity='client.admin' 2024-09-21T05:45:26.643 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:45:26.356+0000 7f36e115d640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:05:45:26] ENGINE Error in HTTPServer.serve 2024-09-21T05:45:26.643 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: Traceback (most recent call last): 2024-09-21T05:45:26.643 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:45:26.643 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: self._connections.run(self.expiration_interval) 2024-09-21T05:45:26.643 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:45:26.643 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: self._run(expiration_interval) 2024-09-21T05:45:26.643 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:45:26.643 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:45:26.644 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:45:26.644 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:45:26.644 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:45:26.644 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: s = self.context.wrap_socket( 2024-09-21T05:45:26.644 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:45:26.644 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: return self.sslsocket_class._create( 2024-09-21T05:45:26.644 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:45:26.644 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: self.do_handshake() 2024-09-21T05:45:26.644 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:45:26.644 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: self._sslobj.do_handshake() 2024-09-21T05:45:26.644 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:45:26.644 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:45:26.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.847+0000 7fd59b7ec640 1 -- 172.21.15.7:0/2155051376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd594109500 msgr2=0x7fd59410b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:26.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.847+0000 7fd59b7ec640 1 --2- 172.21.15.7:0/2155051376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd594109500 0x7fd59410b980 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009ca0 tx=0x7fd58c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.847+0000 7fd59b7ec640 1 -- 172.21.15.7:0/2155051376 shutdown_connections 2024-09-21T05:45:26.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.847+0000 7fd59b7ec640 1 --2- 172.21.15.7:0/2155051376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd594109500 0x7fd59410b980 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.847+0000 7fd59b7ec640 1 --2- 172.21.15.7:0/2155051376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd594106ba0 0x7fd594108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.847+0000 7fd59b7ec640 1 --2- 172.21.15.7:0/2155051376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd594101b00 0x7fd594101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.847+0000 7fd59b7ec640 1 -- 172.21.15.7:0/2155051376 >> 172.21.15.7:0/2155051376 conn(0x7fd5940fd770 msgr2=0x7fd5940ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.848+0000 7fd59b7ec640 1 -- 172.21.15.7:0/2155051376 shutdown_connections 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.848+0000 7fd59b7ec640 1 -- 172.21.15.7:0/2155051376 wait complete. 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.848+0000 7fd59b7ec640 1 Processor -- start 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.848+0000 7fd59b7ec640 1 -- start start 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.848+0000 7fd59b7ec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd594101b00 0x7fd594199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.848+0000 7fd59b7ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd594106ba0 0x7fd59419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd59b7ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd594109500 0x7fd59419aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd59b7ec640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd59410f010 con 0x7fd594109500 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd59b7ec640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd59410ee90 con 0x7fd594101b00 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd59b7ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd59410f190 con 0x7fd594106ba0 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd599588640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd594101b00 0x7fd594199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd599588640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd594101b00 0x7fd594199cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:40908/0 (socket says 172.21.15.7:40908) 2024-09-21T05:45:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd598d87640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd594106ba0 0x7fd59419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd599588640 1 -- 172.21.15.7:0/1881647799 learned_addr learned my addr 172.21.15.7:0/1881647799 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd599d89640 1 --2- 172.21.15.7:0/1881647799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd594109500 0x7fd59419aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd599588640 1 -- 172.21.15.7:0/1881647799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd594106ba0 msgr2=0x7fd59419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd599588640 1 --2- 172.21.15.7:0/1881647799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd594106ba0 0x7fd59419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd599588640 1 -- 172.21.15.7:0/1881647799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd594109500 msgr2=0x7fd59419aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd599588640 1 --2- 172.21.15.7:0/1881647799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd594109500 0x7fd59419aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd599588640 1 -- 172.21.15.7:0/1881647799 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59419b6f0 con 0x7fd594101b00 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.849+0000 7fd599588640 1 --2- 172.21.15.7:0/1881647799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd594101b00 0x7fd594199cc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd59000e9f0 tx=0x7fd59000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.850+0000 7fd58a7fc640 1 -- 172.21.15.7:0/1881647799 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59000cd80 con 0x7fd594101b00 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.850+0000 7fd58a7fc640 1 -- 172.21.15.7:0/1881647799 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(23 keys) ==== 1014+0+0 (secure 0 0 0) 0x7fd590010890 con 0x7fd594101b00 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.850+0000 7fd59b7ec640 1 -- 172.21.15.7:0/1881647799 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59419b9e0 con 0x7fd594101b00 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.850+0000 7fd58a7fc640 1 -- 172.21.15.7:0/1881647799 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd590018740 con 0x7fd594101b00 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.850+0000 7fd59b7ec640 1 -- 172.21.15.7:0/1881647799 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5941a20e0 con 0x7fd594101b00 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.851+0000 7fd58a7fc640 1 -- 172.21.15.7:0/1881647799 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7fd5900188e0 con 0x7fd594101b00 2024-09-21T05:45:26.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.851+0000 7fd59b7ec640 1 -- 172.21.15.7:0/1881647799 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd594101f10 con 0x7fd594101b00 2024-09-21T05:45:26.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.851+0000 7fd58a7fc640 1 --2- 172.21.15.7:0/1881647799 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd58003fb70 0x7fd580042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:26.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.852+0000 7fd58a7fc640 1 -- 172.21.15.7:0/1881647799 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd590054bb0 con 0x7fd594101b00 2024-09-21T05:45:26.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.852+0000 7fd598d87640 1 --2- 172.21.15.7:0/1881647799 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd58003fb70 0x7fd580042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:26.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.852+0000 7fd598d87640 1 --2- 172.21.15.7:0/1881647799 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd58003fb70 0x7fd580042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd584009bd0 tx=0x7fd584005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:26.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.857+0000 7fd58a7fc640 1 -- 172.21.15.7:0/1881647799 <== mon.2 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd590020360 con 0x7fd594101b00 2024-09-21T05:45:26.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.738+0000 7fefb20db640 1 -- 172.21.15.7:0/4083071605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefac1068d0 msgr2=0x7fefac108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:26.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.738+0000 7fefb20db640 1 --2- 172.21.15.7:0/4083071605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefac1068d0 0x7fefac108d30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009900 tx=0x7fefa002a410 comp rx=0 tx=0).stop 2024-09-21T05:45:26.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.738+0000 7fefb20db640 1 -- 172.21.15.7:0/4083071605 shutdown_connections 2024-09-21T05:45:26.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.738+0000 7fefb20db640 1 --2- 172.21.15.7:0/4083071605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefac1068d0 0x7fefac108d30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.738+0000 7fefb20db640 1 --2- 172.21.15.7:0/4083071605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefac109470 0x7fefac10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.738+0000 7fefb20db640 1 --2- 172.21.15.7:0/4083071605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefac06b980 0x7fefac106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.738+0000 7fefb20db640 1 -- 172.21.15.7:0/4083071605 >> 172.21.15.7:0/4083071605 conn(0x7fefac0fdfb0 msgr2=0x7fefac100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:26.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.738+0000 7fefb20db640 1 -- 172.21.15.7:0/4083071605 shutdown_connections 2024-09-21T05:45:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.738+0000 7fefb20db640 1 -- 172.21.15.7:0/4083071605 wait complete. 2024-09-21T05:45:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.739+0000 7fefb20db640 1 Processor -- start 2024-09-21T05:45:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.739+0000 7fefb20db640 1 -- start start 2024-09-21T05:45:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.739+0000 7fefb20db640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefac06b980 0x7fefac199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.739+0000 7fefb20db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefac1068d0 0x7fefac19a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.739+0000 7fefb20db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefac109470 0x7fefac19af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.739+0000 7fefb20db640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fefac10f060 con 0x7fefac1068d0 2024-09-21T05:45:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.739+0000 7fefb20db640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fefac10eee0 con 0x7fefac06b980 2024-09-21T05:45:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.739+0000 7fefb20db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fefac10f1e0 con 0x7fefac109470 2024-09-21T05:45:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.739+0000 7fefaaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefac1068d0 0x7fefac19a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.739+0000 7fefaaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefac1068d0 0x7fefac19a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33950/0 (socket says 172.21.15.7:33950) 2024-09-21T05:45:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.739+0000 7fefaaffd640 1 -- 172.21.15.7:0/804448405 learned_addr learned my addr 172.21.15.7:0/804448405 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.739+0000 7fefab7fe640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefac06b980 0x7fefac199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.739+0000 7fefabfff640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefac109470 0x7fefac19af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.740+0000 7fefaaffd640 1 -- 172.21.15.7:0/804448405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefac109470 msgr2=0x7fefac19af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.740+0000 7fefaaffd640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefac109470 0x7fefac19af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.740+0000 7fefaaffd640 1 -- 172.21.15.7:0/804448405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefac06b980 msgr2=0x7fefac199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.740+0000 7fefaaffd640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefac06b980 0x7fefac199d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.740+0000 7fefaaffd640 1 -- 172.21.15.7:0/804448405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefac19b750 con 0x7fefac1068d0 2024-09-21T05:45:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.740+0000 7fefab7fe640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefac06b980 0x7fefac199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:45:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.740+0000 7fefaaffd640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefac1068d0 0x7fefac19a390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fefa0005ab0 tx=0x7fefa0004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.740+0000 7fefa8ff9640 1 -- 172.21.15.7:0/804448405 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa003f070 con 0x7fefac1068d0 2024-09-21T05:45:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.740+0000 7fefa8ff9640 1 -- 172.21.15.7:0/804448405 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(23 keys) ==== 1014+0+0 (secure 0 0 0) 0x7fefa0003a50 con 0x7fefac1068d0 2024-09-21T05:45:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.740+0000 7fefb20db640 1 -- 172.21.15.7:0/804448405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefac19b9e0 con 0x7fefac1068d0 2024-09-21T05:45:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.740+0000 7fefa8ff9640 1 -- 172.21.15.7:0/804448405 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa0035030 con 0x7fefac1068d0 2024-09-21T05:45:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.740+0000 7fefb20db640 1 -- 172.21.15.7:0/804448405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefac1a2140 con 0x7fefac1068d0 2024-09-21T05:45:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.742+0000 7fefa8ff9640 1 -- 172.21.15.7:0/804448405 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7fefa0042070 con 0x7fefac1068d0 2024-09-21T05:45:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.742+0000 7fefb20db640 1 -- 172.21.15.7:0/804448405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefac10f820 con 0x7fefac1068d0 2024-09-21T05:45:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.742+0000 7fefa8ff9640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fef9403fb70 0x7fef94042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.742+0000 7fefa8ff9640 1 -- 172.21.15.7:0/804448405 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fefa0075c00 con 0x7fefac1068d0 2024-09-21T05:45:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.742+0000 7fefab7fe640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fef9403fb70 0x7fef94042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.743+0000 7fefab7fe640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fef9403fb70 0x7fef94042080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00bfd0 tx=0x7fef9c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.747+0000 7fefa8ff9640 1 -- 172.21.15.7:0/804448405 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fefa002f300 con 0x7fefac1068d0 2024-09-21T05:45:26.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.985+0000 7fefb20db640 1 -- 172.21.15.7:0/804448405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fefac02e810 con 0x7fefac1068d0 2024-09-21T05:45:26.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.990+0000 7fefa8ff9640 1 -- 172.21.15.7:0/804448405 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fefa003b900 con 0x7fefac1068d0 2024-09-21T05:45:26.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.993+0000 7fd58a7fc640 1 -- 172.21.15.7:0/1881647799 <== mon.2 v2:172.21.15.27:3300/0 7 ==== config(24 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fd590022d10 con 0x7fd594101b00 2024-09-21T05:45:26.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.993+0000 7fefa8ff9640 1 -- 172.21.15.7:0/804448405 <== mon.0 v2:172.21.15.7:3300/0 8 ==== config(24 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fefa003bdd0 con 0x7fefac1068d0 2024-09-21T05:45:26.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.995+0000 7fefb20db640 1 -- 172.21.15.7:0/804448405 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fef9403fb70 msgr2=0x7fef94042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:26.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.995+0000 7fefb20db640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fef9403fb70 0x7fef94042080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00bfd0 tx=0x7fef9c00b390 comp rx=0 tx=0).stop 2024-09-21T05:45:26.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.995+0000 7fefb20db640 1 -- 172.21.15.7:0/804448405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefac1068d0 msgr2=0x7fefac19a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:26.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.995+0000 7fefb20db640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefac1068d0 0x7fefac19a390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fefa0005ab0 tx=0x7fefa0004fa0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.996+0000 7fefb20db640 1 -- 172.21.15.7:0/804448405 shutdown_connections 2024-09-21T05:45:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.996+0000 7fefb20db640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fef9403fb70 0x7fef94042080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.996+0000 7fefb20db640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefac1068d0 0x7fefac19a390 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fefa0005ab0 tx=0x7fefa0004fa0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.996+0000 7fefb20db640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefac109470 0x7fefac19af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.996+0000 7fefb20db640 1 --2- 172.21.15.7:0/804448405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefac06b980 0x7fefac199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.996+0000 7fefb20db640 1 -- 172.21.15.7:0/804448405 >> 172.21.15.7:0/804448405 conn(0x7fefac0fdfb0 msgr2=0x7fefac104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.996+0000 7fefb20db640 1 -- 172.21.15.7:0/804448405 shutdown_connections 2024-09-21T05:45:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.996+0000 7fefb20db640 1 -- 172.21.15.7:0/804448405 wait complete. 2024-09-21T05:45:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.137+0000 7fd59b7ec640 1 -- 172.21.15.7:0/1881647799 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fd59402e990 con 0x7fd594101b00 2024-09-21T05:45:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.145+0000 7fd58a7fc640 1 -- 172.21.15.7:0/1881647799 <== mon.2 v2:172.21.15.27:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd590010d30 con 0x7fd594101b00 2024-09-21T05:45:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.145+0000 7fd58a7fc640 1 -- 172.21.15.7:0/1881647799 <== mon.2 v2:172.21.15.27:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v13)=0 v13) ==== 114+0+0 (secure 0 0 0) 0x7fd590022980 con 0x7fd594101b00 2024-09-21T05:45:27.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.147+0000 7fd59b7ec640 1 -- 172.21.15.7:0/1881647799 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd58003fb70 msgr2=0x7fd580042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:27.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.147+0000 7fd59b7ec640 1 --2- 172.21.15.7:0/1881647799 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd58003fb70 0x7fd580042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd584009bd0 tx=0x7fd584005f90 comp rx=0 tx=0).stop 2024-09-21T05:45:27.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.147+0000 7fd59b7ec640 1 -- 172.21.15.7:0/1881647799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd594101b00 msgr2=0x7fd594199cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:27.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.147+0000 7fd59b7ec640 1 --2- 172.21.15.7:0/1881647799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd594101b00 0x7fd594199cc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd59000e9f0 tx=0x7fd59000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:45:27.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.147+0000 7fd59b7ec640 1 -- 172.21.15.7:0/1881647799 shutdown_connections 2024-09-21T05:45:27.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.147+0000 7fd59b7ec640 1 --2- 172.21.15.7:0/1881647799 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd58003fb70 0x7fd580042080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:27.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.147+0000 7fd59b7ec640 1 --2- 172.21.15.7:0/1881647799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd594109500 0x7fd59419aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:27.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.147+0000 7fd59b7ec640 1 --2- 172.21.15.7:0/1881647799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd594106ba0 0x7fd59419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:27.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.147+0000 7fd59b7ec640 1 --2- 172.21.15.7:0/1881647799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd594101b00 0x7fd594199cc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:27.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.147+0000 7fd59b7ec640 1 -- 172.21.15.7:0/1881647799 >> 172.21.15.7:0/1881647799 conn(0x7fd5940fd770 msgr2=0x7fd5941079b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:27.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.147+0000 7fd59b7ec640 1 -- 172.21.15.7:0/1881647799 shutdown_connections 2024-09-21T05:45:27.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:27.147+0000 7fd59b7ec640 1 -- 172.21.15.7:0/1881647799 wait complete. 2024-09-21T05:45:27.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-mon[30983]: [21/Sep/2024:05:45:26] ENGINE Bus STARTING 2024-09-21T05:45:27.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/940513001' entity='client.admin' 2024-09-21T05:45:27.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:27.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:27.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:27.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:27.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:27.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:26 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/804448405' entity='client.admin' 2024-09-21T05:45:27.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:26 smithi119 ceph-mon[34833]: [21/Sep/2024:05:45:26] ENGINE Bus STARTING 2024-09-21T05:45:27.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:26 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/940513001' entity='client.admin' 2024-09-21T05:45:27.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:27.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:27.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:27.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:27.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:27.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:26 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/804448405' entity='client.admin' 2024-09-21T05:45:27.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:26 smithi027 ceph-mon[34364]: [21/Sep/2024:05:45:26] ENGINE Bus STARTING 2024-09-21T05:45:27.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:26 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/940513001' entity='client.admin' 2024-09-21T05:45:27.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:27.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:27.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:27.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:27.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:27.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:26 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/804448405' entity='client.admin' 2024-09-21T05:45:28.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.500+0000 7fa2f71bb640 1 -- 172.21.15.7:0/940513001 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa2e003fb70 msgr2=0x7fa2e0042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:28.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.500+0000 7fa2f71bb640 1 --2- 172.21.15.7:0/940513001 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa2e003fb70 0x7fa2e0042080 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40096c0 tx=0x7fa2e4009630 comp rx=0 tx=0).stop 2024-09-21T05:45:28.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.500+0000 7fa2f71bb640 1 -- 172.21.15.7:0/940513001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f0108370 msgr2=0x7fa2f0199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:28.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.500+0000 7fa2f71bb640 1 --2- 172.21.15.7:0/940513001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f0108370 0x7fa2f0199d50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800eaa0 tx=0x7fa2e800ef60 comp rx=0 tx=0).stop 2024-09-21T05:45:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.500+0000 7fa2f71bb640 1 -- 172.21.15.7:0/940513001 shutdown_connections 2024-09-21T05:45:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.500+0000 7fa2f71bb640 1 --2- 172.21.15.7:0/940513001 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa2e003fb70 0x7fa2e0042080 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.500+0000 7fa2f71bb640 1 --2- 172.21.15.7:0/940513001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f0108370 0x7fa2f0199d50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.500+0000 7fa2f71bb640 1 --2- 172.21.15.7:0/940513001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f0105750 0x7fa2f01991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.500+0000 7fa2f71bb640 1 --2- 172.21.15.7:0/940513001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2f0102c90 0x7fa2f0198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.500+0000 7fa2f71bb640 1 -- 172.21.15.7:0/940513001 >> 172.21.15.7:0/940513001 conn(0x7fa2f00fd770 msgr2=0x7fa2f0103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.500+0000 7fa2f71bb640 1 -- 172.21.15.7:0/940513001 shutdown_connections 2024-09-21T05:45:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:26.500+0000 7fa2f71bb640 1 -- 172.21.15.7:0/940513001 wait complete. 2024-09-21T05:45:28.265 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: [21/Sep/2024:05:45:26] ENGINE Serving on http://172.21.15.7:8765 2024-09-21T05:45:28.266 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: [21/Sep/2024:05:45:26] ENGINE Serving on https://172.21.15.7:7150 2024-09-21T05:45:28.266 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: [21/Sep/2024:05:45:26] ENGINE Bus STARTED 2024-09-21T05:45:28.266 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: [21/Sep/2024:05:45:26] ENGINE Error in HTTPServer.serve 2024-09-21T05:45:28.266 INFO:journalctl@ceph.mon.c.smithi119.stdout: Traceback (most recent call last): 2024-09-21T05:45:28.266 INFO:journalctl@ceph.mon.c.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:45:28.266 INFO:journalctl@ceph.mon.c.smithi119.stdout: self._connections.run(self.expiration_interval) 2024-09-21T05:45:28.266 INFO:journalctl@ceph.mon.c.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:45:28.266 INFO:journalctl@ceph.mon.c.smithi119.stdout: self._run(expiration_interval) 2024-09-21T05:45:28.266 INFO:journalctl@ceph.mon.c.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:45:28.266 INFO:journalctl@ceph.mon.c.smithi119.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:45:28.266 INFO:journalctl@ceph.mon.c.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:45:28.266 INFO:journalctl@ceph.mon.c.smithi119.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout: s = self.context.wrap_socket( 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout: return self.sslsocket_class._create( 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout: self.do_handshake() 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout: self._sslobj.do_handshake() 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: Updating smithi007:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: Updating smithi027:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:45:28.267 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: Updating smithi119:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: Updating smithi007:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: Updating smithi027:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: Updating smithi119:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.268 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:45:28.269 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:45:28.269 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:45:28.269 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:28.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: [21/Sep/2024:05:45:26] ENGINE Serving on http://172.21.15.7:8765 2024-09-21T05:45:28.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: [21/Sep/2024:05:45:26] ENGINE Serving on https://172.21.15.7:7150 2024-09-21T05:45:28.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: [21/Sep/2024:05:45:26] ENGINE Bus STARTED 2024-09-21T05:45:28.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: [21/Sep/2024:05:45:26] ENGINE Error in HTTPServer.serve 2024-09-21T05:45:28.477 INFO:journalctl@ceph.mon.b.smithi027.stdout: Traceback (most recent call last): 2024-09-21T05:45:28.477 INFO:journalctl@ceph.mon.b.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:45:28.477 INFO:journalctl@ceph.mon.b.smithi027.stdout: self._connections.run(self.expiration_interval) 2024-09-21T05:45:28.477 INFO:journalctl@ceph.mon.b.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:45:28.478 INFO:journalctl@ceph.mon.b.smithi027.stdout: self._run(expiration_interval) 2024-09-21T05:45:28.478 INFO:journalctl@ceph.mon.b.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:45:28.478 INFO:journalctl@ceph.mon.b.smithi027.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:45:28.478 INFO:journalctl@ceph.mon.b.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:45:28.478 INFO:journalctl@ceph.mon.b.smithi027.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:45:28.478 INFO:journalctl@ceph.mon.b.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:45:28.478 INFO:journalctl@ceph.mon.b.smithi027.stdout: s = self.context.wrap_socket( 2024-09-21T05:45:28.478 INFO:journalctl@ceph.mon.b.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:45:28.478 INFO:journalctl@ceph.mon.b.smithi027.stdout: return self.sslsocket_class._create( 2024-09-21T05:45:28.478 INFO:journalctl@ceph.mon.b.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:45:28.478 INFO:journalctl@ceph.mon.b.smithi027.stdout: self.do_handshake() 2024-09-21T05:45:28.478 INFO:journalctl@ceph.mon.b.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:45:28.478 INFO:journalctl@ceph.mon.b.smithi027.stdout: self._sslobj.do_handshake() 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: Updating smithi007:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: Updating smithi027:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: Updating smithi119:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: Updating smithi007:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: Updating smithi027:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: Updating smithi119:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: from='client.? ' entity='client.admin' 2024-09-21T05:45:28.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.480 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.480 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.480 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.480 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.480 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.480 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.480 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:45:28.480 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:45:28.480 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:45:28.480 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:28.481 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: [21/Sep/2024:05:45:26] ENGINE Serving on http://172.21.15.7:8765 2024-09-21T05:45:28.481 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: [21/Sep/2024:05:45:26] ENGINE Serving on https://172.21.15.7:7150 2024-09-21T05:45:28.481 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: [21/Sep/2024:05:45:26] ENGINE Bus STARTED 2024-09-21T05:45:28.482 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: [21/Sep/2024:05:45:26] ENGINE Error in HTTPServer.serve 2024-09-21T05:45:28.482 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-09-21T05:45:28.482 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:45:28.482 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-09-21T05:45:28.482 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:45:28.482 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-09-21T05:45:28.482 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:45:28.482 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:45:28.482 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:45:28.482 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:45:28.482 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:45:28.482 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: Updating smithi007:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: Updating smithi027:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: Updating smithi119:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:28.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:28.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:28.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: Updating smithi007:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:45:28.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: Updating smithi027:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:45:28.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: Updating smithi119:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:45:28.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: from='client.? ' entity='client.admin' 2024-09-21T05:45:28.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:28.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:45:28.485 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:45:28.485 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:45:28.485 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:28.493 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:28.493 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:28.512 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:28.518 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:28.521 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:28.942 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi007') 2024-09-21T05:45:28.942 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi007') 2024-09-21T05:45:28.942 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi007') 2024-09-21T05:45:29.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:29 smithi007 ceph-mon[30983]: Deploying daemon mgr.z on smithi119 2024-09-21T05:45:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.339+0000 7faa158c6640 1 -- 172.21.15.7:0/1719029003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa1010deb0 msgr2=0x7faa10110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.339+0000 7faa158c6640 1 --2- 172.21.15.7:0/1719029003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa1010deb0 0x7faa10110330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faa08009900 tx=0x7faa0802a410 comp rx=0 tx=0).stop 2024-09-21T05:45:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.339+0000 7faa158c6640 1 -- 172.21.15.7:0/1719029003 shutdown_connections 2024-09-21T05:45:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.339+0000 7faa158c6640 1 --2- 172.21.15.7:0/1719029003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa1010deb0 0x7faa10110330 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.339+0000 7faa158c6640 1 --2- 172.21.15.7:0/1719029003 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa10105250 0x7faa1010d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.339+0000 7faa158c6640 1 --2- 172.21.15.7:0/1719029003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa10104900 0x7faa10104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.339+0000 7faa158c6640 1 -- 172.21.15.7:0/1719029003 >> 172.21.15.7:0/1719029003 conn(0x7faa10079760 msgr2=0x7faa10079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.339+0000 7faa158c6640 1 -- 172.21.15.7:0/1719029003 shutdown_connections 2024-09-21T05:45:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.339+0000 7faa158c6640 1 -- 172.21.15.7:0/1719029003 wait complete. 2024-09-21T05:45:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.340+0000 7faa158c6640 1 Processor -- start 2024-09-21T05:45:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.340+0000 7faa158c6640 1 -- start start 2024-09-21T05:45:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.340+0000 7faa158c6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa10104900 0x7faa1019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.340+0000 7faa158c6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa10105250 0x7faa1019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.340+0000 7faa158c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa1010deb0 0x7faa101a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.340+0000 7faa158c6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faa101139e0 con 0x7faa1010deb0 2024-09-21T05:45:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.340+0000 7faa158c6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faa10113860 con 0x7faa10105250 2024-09-21T05:45:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.340+0000 7faa158c6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faa10113b60 con 0x7faa10104900 2024-09-21T05:45:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.340+0000 7faa0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa1010deb0 0x7faa101a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.340+0000 7faa0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa1010deb0 0x7faa101a1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57742/0 (socket says 172.21.15.7:57742) 2024-09-21T05:45:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.340+0000 7faa0f7fe640 1 -- 172.21.15.7:0/827177385 learned_addr learned my addr 172.21.15.7:0/827177385 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.340+0000 7faa0effd640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa10104900 0x7faa1019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.341+0000 7faa0e7fc640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa10105250 0x7faa1019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.341+0000 7faa0f7fe640 1 -- 172.21.15.7:0/827177385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa10104900 msgr2=0x7faa1019c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.341+0000 7faa0f7fe640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa10104900 0x7faa1019c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.341+0000 7faa0f7fe640 1 -- 172.21.15.7:0/827177385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa10105250 msgr2=0x7faa1019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.341+0000 7faa0f7fe640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa10105250 0x7faa1019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.341+0000 7faa0f7fe640 1 -- 172.21.15.7:0/827177385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa101a25c0 con 0x7faa1010deb0 2024-09-21T05:45:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.341+0000 7faa0f7fe640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa1010deb0 0x7faa101a1e90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faa08005ab0 tx=0x7faa080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.341+0000 7faa148c4640 1 -- 172.21.15.7:0/827177385 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0803f030 con 0x7faa1010deb0 2024-09-21T05:45:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.341+0000 7faa148c4640 1 -- 172.21.15.7:0/827177385 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7faa08003c90 con 0x7faa1010deb0 2024-09-21T05:45:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.341+0000 7faa158c6640 1 -- 172.21.15.7:0/827177385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa101a2850 con 0x7faa1010deb0 2024-09-21T05:45:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.341+0000 7faa148c4640 1 -- 172.21.15.7:0/827177385 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08035070 con 0x7faa1010deb0 2024-09-21T05:45:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.341+0000 7faa158c6640 1 -- 172.21.15.7:0/827177385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa101a9010 con 0x7faa1010deb0 2024-09-21T05:45:29.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.342+0000 7faa148c4640 1 -- 172.21.15.7:0/827177385 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7faa08042030 con 0x7faa1010deb0 2024-09-21T05:45:29.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.342+0000 7faa158c6640 1 -- 172.21.15.7:0/827177385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa1006c150 con 0x7faa1010deb0 2024-09-21T05:45:29.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.342+0000 7faa148c4640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa9f803fb70 0x7fa9f8042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:29.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.343+0000 7faa148c4640 1 -- 172.21.15.7:0/827177385 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7faa08074ee0 con 0x7faa1010deb0 2024-09-21T05:45:29.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.343+0000 7faa0effd640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa9f803fb70 0x7fa9f8042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:29.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.343+0000 7faa0effd640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa9f803fb70 0x7fa9f8042080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faa1006c850 tx=0x7faa0000d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:29.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.348+0000 7faa148c4640 1 -- 172.21.15.7:0/827177385 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faa0804d3a0 con 0x7faa1010deb0 2024-09-21T05:45:29.473 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:29 smithi119 ceph-mon[34833]: Deploying daemon mgr.z on smithi119 2024-09-21T05:45:29.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:29 smithi027 ceph-mon[34364]: Deploying daemon mgr.z on smithi119 2024-09-21T05:45:29.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.539+0000 7faa158c6640 1 -- 172.21.15.7:0/827177385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7faa101016e0 con 0x7faa1010deb0 2024-09-21T05:45:29.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.543+0000 7faa148c4640 1 -- 172.21.15.7:0/827177385 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v14)=0 v14) ==== 117+0+0 (secure 0 0 0) 0x7faa08036260 con 0x7faa1010deb0 2024-09-21T05:45:29.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.545+0000 7faa158c6640 1 -- 172.21.15.7:0/827177385 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa9f803fb70 msgr2=0x7fa9f8042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:29.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.545+0000 7faa158c6640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa9f803fb70 0x7fa9f8042080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faa1006c850 tx=0x7faa0000d040 comp rx=0 tx=0).stop 2024-09-21T05:45:29.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.545+0000 7faa158c6640 1 -- 172.21.15.7:0/827177385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa1010deb0 msgr2=0x7faa101a1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:29.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.545+0000 7faa158c6640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa1010deb0 0x7faa101a1e90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faa08005ab0 tx=0x7faa080042f0 comp rx=0 tx=0).stop 2024-09-21T05:45:29.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.545+0000 7faa158c6640 1 -- 172.21.15.7:0/827177385 shutdown_connections 2024-09-21T05:45:29.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.545+0000 7faa158c6640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa9f803fb70 0x7fa9f8042080 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:29.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.545+0000 7faa158c6640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa1010deb0 0x7faa101a1e90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:29.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.545+0000 7faa158c6640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa10105250 0x7faa1019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:29.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.545+0000 7faa158c6640 1 --2- 172.21.15.7:0/827177385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa10104900 0x7faa1019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:29.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.545+0000 7faa158c6640 1 -- 172.21.15.7:0/827177385 >> 172.21.15.7:0/827177385 conn(0x7faa10079760 msgr2=0x7faa10109f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:29.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.545+0000 7faa158c6640 1 -- 172.21.15.7:0/827177385 shutdown_connections 2024-09-21T05:45:29.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:29.546+0000 7faa158c6640 1 -- 172.21.15.7:0/827177385 wait complete. 2024-09-21T05:45:29.842 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 21 05:45:29 smithi119 systemd[1]: Started Ceph mgr.z for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:45:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:30.124 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:30.126 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:30.126 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:30.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:30 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/827177385' entity='client.admin' 2024-09-21T05:45:30.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:30.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:30.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:30.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:45:30.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:45:30.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:45:30.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:30.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:30 smithi119 ceph-mon[34833]: Deploying daemon mgr.y on smithi027 2024-09-21T05:45:30.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:30 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/827177385' entity='client.admin' 2024-09-21T05:45:30.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:30.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:30.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:30.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:45:30.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:45:30.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:45:30.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:30.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:30 smithi007 ceph-mon[30983]: Deploying daemon mgr.y on smithi027 2024-09-21T05:45:30.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:30 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/827177385' entity='client.admin' 2024-09-21T05:45:30.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:30.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:30.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:30.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:45:30.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:45:30.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:45:30.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:30.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:30 smithi027 ceph-mon[34364]: Deploying daemon mgr.y on smithi027 2024-09-21T05:45:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.894+0000 7f8145a09640 1 -- 172.21.15.7:0/3910376089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81401083a0 msgr2=0x7f81401087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.894+0000 7f8145a09640 1 --2- 172.21.15.7:0/3910376089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81401083a0 0x7f81401087b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8134009900 tx=0x7f813402a410 comp rx=0 tx=0).stop 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.894+0000 7f8145a09640 1 -- 172.21.15.7:0/3910376089 shutdown_connections 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.894+0000 7f8145a09640 1 --2- 172.21.15.7:0/3910376089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81401083a0 0x7f81401087b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.894+0000 7f8145a09640 1 --2- 172.21.15.7:0/3910376089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8140108cf0 0x7f814010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.894+0000 7f8145a09640 1 --2- 172.21.15.7:0/3910376089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8140102a60 0x7f8140102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.894+0000 7f8145a09640 1 -- 172.21.15.7:0/3910376089 >> 172.21.15.7:0/3910376089 conn(0x7f8140079730 msgr2=0x7f8140079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.894+0000 7f8145a09640 1 -- 172.21.15.7:0/3910376089 shutdown_connections 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.894+0000 7f8145a09640 1 -- 172.21.15.7:0/3910376089 wait complete. 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.895+0000 7f8145a09640 1 Processor -- start 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.895+0000 7f8145a09640 1 -- start start 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f8145a09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8140102a60 0x7f814019b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f8145a09640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81401083a0 0x7f814019b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f8145a09640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8140108cf0 0x7f814019bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f8145a09640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8140112840 con 0x7f8140102a60 2024-09-21T05:45:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f8145a09640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f81401126c0 con 0x7f8140108cf0 2024-09-21T05:45:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f8145a09640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f81401129c0 con 0x7f81401083a0 2024-09-21T05:45:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f813effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8140102a60 0x7f814019b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f813effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8140102a60 0x7f814019b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57790/0 (socket says 172.21.15.7:57790) 2024-09-21T05:45:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f813effd640 1 -- 172.21.15.7:0/684388326 learned_addr learned my addr 172.21.15.7:0/684388326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f813e7fc640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81401083a0 0x7f814019b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f813f7fe640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8140108cf0 0x7f814019bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f813effd640 1 -- 172.21.15.7:0/684388326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81401083a0 msgr2=0x7f814019b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f813effd640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81401083a0 0x7f814019b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f813effd640 1 -- 172.21.15.7:0/684388326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8140108cf0 msgr2=0x7f814019bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f813effd640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8140108cf0 0x7f814019bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f813effd640 1 -- 172.21.15.7:0/684388326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81401a6400 con 0x7f8140102a60 2024-09-21T05:45:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f813effd640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8140102a60 0x7f814019b170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f813000e9f0 tx=0x7f813000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:30.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.896+0000 7f8144a07640 1 -- 172.21.15.7:0/684388326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813000cd80 con 0x7f8140102a60 2024-09-21T05:45:30.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.897+0000 7f8144a07640 1 -- 172.21.15.7:0/684388326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f81300108c0 con 0x7f8140102a60 2024-09-21T05:45:30.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.897+0000 7f8145a09640 1 -- 172.21.15.7:0/684388326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81401a66f0 con 0x7f8140102a60 2024-09-21T05:45:30.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.897+0000 7f8144a07640 1 -- 172.21.15.7:0/684388326 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81300187d0 con 0x7f8140102a60 2024-09-21T05:45:30.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.897+0000 7f8145a09640 1 -- 172.21.15.7:0/684388326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81401a6c50 con 0x7f8140102a60 2024-09-21T05:45:30.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.898+0000 7f8145a09640 1 -- 172.21.15.7:0/684388326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8140102e70 con 0x7f8140102a60 2024-09-21T05:45:30.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.898+0000 7f8144a07640 1 -- 172.21.15.7:0/684388326 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7f8130018970 con 0x7f8140102a60 2024-09-21T05:45:30.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.898+0000 7f8144a07640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f812803fba0 0x7f81280420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:30.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.898+0000 7f8144a07640 1 -- 172.21.15.7:0/684388326 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8130054a60 con 0x7f8140102a60 2024-09-21T05:45:30.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.898+0000 7f813e7fc640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f812803fba0 0x7f81280420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:30.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.899+0000 7f813e7fc640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f812803fba0 0x7f81280420b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8134004770 tx=0x7f81340058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:30.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.903+0000 7f8144a07640 1 -- 172.21.15.7:0/684388326 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8130020360 con 0x7f8140102a60 2024-09-21T05:45:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.818+0000 7fb37850b640 1 -- 172.21.15.7:0/1633778371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3701048a0 msgr2=0x7fb370104cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.818+0000 7fb37850b640 1 --2- 172.21.15.7:0/1633778371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3701048a0 0x7fb370104cb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb364009900 tx=0x7fb36402a410 comp rx=0 tx=0).stop 2024-09-21T05:45:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.818+0000 7fb37850b640 1 -- 172.21.15.7:0/1633778371 shutdown_connections 2024-09-21T05:45:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.818+0000 7fb37850b640 1 --2- 172.21.15.7:0/1633778371 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb37010de50 0x7fb370110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.818+0000 7fb37850b640 1 --2- 172.21.15.7:0/1633778371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3701052d0 0x7fb37010d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.818+0000 7fb37850b640 1 --2- 172.21.15.7:0/1633778371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3701048a0 0x7fb370104cb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.818+0000 7fb37850b640 1 -- 172.21.15.7:0/1633778371 >> 172.21.15.7:0/1633778371 conn(0x7fb370079750 msgr2=0x7fb370079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.818+0000 7fb37850b640 1 -- 172.21.15.7:0/1633778371 shutdown_connections 2024-09-21T05:45:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.818+0000 7fb37850b640 1 -- 172.21.15.7:0/1633778371 wait complete. 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb37850b640 1 Processor -- start 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb37850b640 1 -- start start 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb37850b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3701048a0 0x7fb37019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb37850b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3701052d0 0x7fb37019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb37850b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb37010de50 0x7fb37019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb37850b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb370113990 con 0x7fb3701052d0 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb37850b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb370113810 con 0x7fb3701048a0 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb37850b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb370113b10 con 0x7fb37010de50 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb375aa6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3701052d0 0x7fb37019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb375aa6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3701052d0 0x7fb37019a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57762/0 (socket says 172.21.15.7:57762) 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb375aa6640 1 -- 172.21.15.7:0/2368831202 learned_addr learned my addr 172.21.15.7:0/2368831202 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb376aa8640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb37010de50 0x7fb37019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb3762a7640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3701048a0 0x7fb37019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb375aa6640 1 -- 172.21.15.7:0/2368831202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb37010de50 msgr2=0x7fb37019fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb375aa6640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb37010de50 0x7fb37019fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb375aa6640 1 -- 172.21.15.7:0/2368831202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3701048a0 msgr2=0x7fb37019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb375aa6640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3701048a0 0x7fb37019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.819+0000 7fb375aa6640 1 -- 172.21.15.7:0/2368831202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3701a0270 con 0x7fb3701052d0 2024-09-21T05:45:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.820+0000 7fb375aa6640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3701052d0 0x7fb37019a960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00e9c0 tx=0x7fb36c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.820+0000 7fb3637fe640 1 -- 172.21.15.7:0/2368831202 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c00cd80 con 0x7fb3701052d0 2024-09-21T05:45:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.820+0000 7fb3637fe640 1 -- 172.21.15.7:0/2368831202 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb36c0054b0 con 0x7fb3701052d0 2024-09-21T05:45:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.820+0000 7fb3637fe640 1 -- 172.21.15.7:0/2368831202 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c010430 con 0x7fb3701052d0 2024-09-21T05:45:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.820+0000 7fb37850b640 1 -- 172.21.15.7:0/2368831202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3701a0560 con 0x7fb3701052d0 2024-09-21T05:45:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.820+0000 7fb37850b640 1 -- 172.21.15.7:0/2368831202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3701a6d80 con 0x7fb3701052d0 2024-09-21T05:45:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.821+0000 7fb3637fe640 1 -- 172.21.15.7:0/2368831202 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7fb36c0105d0 con 0x7fb3701052d0 2024-09-21T05:45:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.821+0000 7fb3637fe640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb35c03fba0 0x7fb35c0420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.821+0000 7fb3637fe640 1 -- 172.21.15.7:0/2368831202 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb36c055760 con 0x7fb3701052d0 2024-09-21T05:45:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.821+0000 7fb37850b640 1 -- 172.21.15.7:0/2368831202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb370104cb0 con 0x7fb3701052d0 2024-09-21T05:45:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.821+0000 7fb3762a7640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb35c03fba0 0x7fb35c0420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.822+0000 7fb3762a7640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb35c03fba0 0x7fb35c0420b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb364000c00 tx=0x7fb364009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:30.826+0000 7fb3637fe640 1 -- 172.21.15.7:0/2368831202 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb36c016330 con 0x7fb3701052d0 2024-09-21T05:45:31.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.034+0000 7fb37850b640 1 -- 172.21.15.7:0/2368831202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fb370108fd0 con 0x7fb3701052d0 2024-09-21T05:45:31.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.039+0000 7fb3637fe640 1 -- 172.21.15.7:0/2368831202 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v15)=0 v15) ==== 116+0+0 (secure 0 0 0) 0x7fb36c0046c0 con 0x7fb3701052d0 2024-09-21T05:45:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.042+0000 7fb37850b640 1 -- 172.21.15.7:0/2368831202 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb35c03fba0 msgr2=0x7fb35c0420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.042+0000 7fb37850b640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb35c03fba0 0x7fb35c0420b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb364000c00 tx=0x7fb364009680 comp rx=0 tx=0).stop 2024-09-21T05:45:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.042+0000 7fb37850b640 1 -- 172.21.15.7:0/2368831202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3701052d0 msgr2=0x7fb37019a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.042+0000 7fb37850b640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3701052d0 0x7fb37019a960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00e9c0 tx=0x7fb36c00ee80 comp rx=0 tx=0).stop 2024-09-21T05:45:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.042+0000 7fb37850b640 1 -- 172.21.15.7:0/2368831202 shutdown_connections 2024-09-21T05:45:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.042+0000 7fb37850b640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb35c03fba0 0x7fb35c0420b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.042+0000 7fb37850b640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3701052d0 0x7fb37019a960 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.042+0000 7fb37850b640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb37010de50 0x7fb37019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:31.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.042+0000 7fb37850b640 1 --2- 172.21.15.7:0/2368831202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3701048a0 0x7fb37019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:31.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.042+0000 7fb37850b640 1 -- 172.21.15.7:0/2368831202 >> 172.21.15.7:0/2368831202 conn(0x7fb370079750 msgr2=0x7fb370100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:31.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.042+0000 7fb37850b640 1 -- 172.21.15.7:0/2368831202 shutdown_connections 2024-09-21T05:45:31.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.042+0000 7fb37850b640 1 -- 172.21.15.7:0/2368831202 wait complete. 2024-09-21T05:45:31.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.115+0000 7f8145a09640 1 -- 172.21.15.7:0/684388326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f814010a550 con 0x7f8140102a60 2024-09-21T05:45:31.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.118+0000 7f8144a07640 1 -- 172.21.15.7:0/684388326 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v16)=0 v16) ==== 127+0+0 (secure 0 0 0) 0x7f813001fe30 con 0x7f8140102a60 2024-09-21T05:45:31.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.121+0000 7f8145a09640 1 -- 172.21.15.7:0/684388326 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f812803fba0 msgr2=0x7f81280420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:31.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.121+0000 7f8145a09640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f812803fba0 0x7f81280420b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8134004770 tx=0x7f81340058d0 comp rx=0 tx=0).stop 2024-09-21T05:45:31.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.121+0000 7f8145a09640 1 -- 172.21.15.7:0/684388326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8140102a60 msgr2=0x7f814019b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:31.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.121+0000 7f8145a09640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8140102a60 0x7f814019b170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f813000e9f0 tx=0x7f813000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:45:31.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.121+0000 7f8145a09640 1 -- 172.21.15.7:0/684388326 shutdown_connections 2024-09-21T05:45:31.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.121+0000 7f8145a09640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f812803fba0 0x7f81280420b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:31.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.121+0000 7f8145a09640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8140108cf0 0x7f814019bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.121+0000 7f8145a09640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81401083a0 0x7f814019b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.121+0000 7f8145a09640 1 --2- 172.21.15.7:0/684388326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8140102a60 0x7f814019b170 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.121+0000 7f8145a09640 1 -- 172.21.15.7:0/684388326 >> 172.21.15.7:0/684388326 conn(0x7f8140079730 msgr2=0x7f8140105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.121+0000 7f8145a09640 1 -- 172.21.15.7:0/684388326 shutdown_connections 2024-09-21T05:45:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:31.121+0000 7f8145a09640 1 -- 172.21.15.7:0/684388326 wait complete. 2024-09-21T05:45:31.477 INFO:journalctl@ceph.mgr.y.smithi027.stdout:Sep 21 05:45:31 smithi027 systemd[1]: Starting Ceph mgr.y for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:45:31.810 INFO:journalctl@ceph.mgr.y.smithi027.stdout:Sep 21 05:45:31 smithi027 podman[35870]: 2024-09-21 05:45:31.444329049 +0000 UTC m=+0.016135069 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:45:31.810 INFO:journalctl@ceph.mgr.y.smithi027.stdout:Sep 21 05:45:31 smithi027 podman[35870]: 2024-09-21 05:45:31.560401209 +0000 UTC m=+0.132207268 container create 03fe0b91433b02aaa163f450b1df1bb834fa852b218ea1521518cf6fddab1927 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T05:45:31.810 INFO:journalctl@ceph.mgr.y.smithi027.stdout:Sep 21 05:45:31 smithi027 podman[35870]: 2024-09-21 05:45:31.770926496 +0000 UTC m=+0.342732514 container init 03fe0b91433b02aaa163f450b1df1bb834fa852b218ea1521518cf6fddab1927 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T05:45:31.811 INFO:journalctl@ceph.mgr.y.smithi027.stdout:Sep 21 05:45:31 smithi027 podman[35870]: 2024-09-21 05:45:31.773811838 +0000 UTC m=+0.345617863 container start 03fe0b91433b02aaa163f450b1df1bb834fa852b218ea1521518cf6fddab1927 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-y, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:45:32.227 INFO:journalctl@ceph.mgr.y.smithi027.stdout:Sep 21 05:45:31 smithi027 ceph-mgr[35889]: -- 172.21.15.27:0/304330535 <== mon.2 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ff65ebb0e0 con 0x55ff65ed9a80 2024-09-21T05:45:32.227 INFO:journalctl@ceph.mgr.y.smithi027.stdout:Sep 21 05:45:31 smithi027 bash[35870]: 03fe0b91433b02aaa163f450b1df1bb834fa852b218ea1521518cf6fddab1927 2024-09-21T05:45:32.227 INFO:journalctl@ceph.mgr.y.smithi027.stdout:Sep 21 05:45:31 smithi027 systemd[1]: Started Ceph mgr.y for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:45:32.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:32 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2368831202' entity='client.admin' 2024-09-21T05:45:32.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:32 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/684388326' entity='client.admin' 2024-09-21T05:45:32.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:32.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:32.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:32.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:32.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:32.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:32 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2368831202' entity='client.admin' 2024-09-21T05:45:32.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:32 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/684388326' entity='client.admin' 2024-09-21T05:45:32.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:32.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:32.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:32.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:32.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:32.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:32 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2368831202' entity='client.admin' 2024-09-21T05:45:32.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:32 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/684388326' entity='client.admin' 2024-09-21T05:45:32.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:32.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:32.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:32.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:32.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:32.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.166+0000 7fb139ac7640 1 -- 172.21.15.7:0/2210968822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb134108d00 msgr2=0x7fb13410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:32.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.166+0000 7fb139ac7640 1 --2- 172.21.15.7:0/2210968822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb134108d00 0x7fb13410f530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009ca0 tx=0x7fb12c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:45:32.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.166+0000 7fb139ac7640 1 -- 172.21.15.7:0/2210968822 shutdown_connections 2024-09-21T05:45:32.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.166+0000 7fb139ac7640 1 --2- 172.21.15.7:0/2210968822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb134108d00 0x7fb13410f530 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:32.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.166+0000 7fb139ac7640 1 --2- 172.21.15.7:0/2210968822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1341083b0 0x7fb1341087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:32.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.166+0000 7fb139ac7640 1 --2- 172.21.15.7:0/2210968822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb134102a70 0x7fb134102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:32.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.166+0000 7fb139ac7640 1 -- 172.21.15.7:0/2210968822 >> 172.21.15.7:0/2210968822 conn(0x7fb134079730 msgr2=0x7fb134079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:32.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.166+0000 7fb139ac7640 1 -- 172.21.15.7:0/2210968822 shutdown_connections 2024-09-21T05:45:32.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.166+0000 7fb139ac7640 1 -- 172.21.15.7:0/2210968822 wait complete. 2024-09-21T05:45:32.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.167+0000 7fb139ac7640 1 Processor -- start 2024-09-21T05:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.167+0000 7fb139ac7640 1 -- start start 2024-09-21T05:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.167+0000 7fb139ac7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb134102a70 0x7fb13419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.167+0000 7fb139ac7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1341083b0 0x7fb13419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.167+0000 7fb139ac7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb134108d00 0x7fb13419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.167+0000 7fb139ac7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb134112850 con 0x7fb1341083b0 2024-09-21T05:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.167+0000 7fb139ac7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb1341126d0 con 0x7fb134108d00 2024-09-21T05:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.167+0000 7fb139ac7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb1341129d0 con 0x7fb134102a70 2024-09-21T05:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.167+0000 7fb12affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1341083b0 0x7fb13419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.167+0000 7fb12affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1341083b0 0x7fb13419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57808/0 (socket says 172.21.15.7:57808) 2024-09-21T05:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.167+0000 7fb12affd640 1 -- 172.21.15.7:0/3911095615 learned_addr learned my addr 172.21.15.7:0/3911095615 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.167+0000 7fb1337fe640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb134102a70 0x7fb13419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.167+0000 7fb133fff640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb134108d00 0x7fb13419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.168+0000 7fb12affd640 1 -- 172.21.15.7:0/3911095615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb134102a70 msgr2=0x7fb13419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.168+0000 7fb12affd640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb134102a70 0x7fb13419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.168+0000 7fb12affd640 1 -- 172.21.15.7:0/3911095615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb134108d00 msgr2=0x7fb13419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.168+0000 7fb12affd640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb134108d00 0x7fb13419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.168+0000 7fb12affd640 1 -- 172.21.15.7:0/3911095615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1341a0380 con 0x7fb1341083b0 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.168+0000 7fb12affd640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1341083b0 0x7fb13419a9b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00e9f0 tx=0x7fb11c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.168+0000 7fb1317fa640 1 -- 172.21.15.7:0/3911095615 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c00ccc0 con 0x7fb1341083b0 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.168+0000 7fb1317fa640 1 -- 172.21.15.7:0/3911095615 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb11c0054b0 con 0x7fb1341083b0 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.168+0000 7fb1317fa640 1 -- 172.21.15.7:0/3911095615 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c010430 con 0x7fb1341083b0 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.168+0000 7fb139ac7640 1 -- 172.21.15.7:0/3911095615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1341a0670 con 0x7fb1341083b0 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.168+0000 7fb139ac7640 1 -- 172.21.15.7:0/3911095615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1341a6dd0 con 0x7fb1341083b0 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.169+0000 7fb139ac7640 1 -- 172.21.15.7:0/3911095615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb134103cf0 con 0x7fb1341083b0 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.169+0000 7fb1317fa640 1 -- 172.21.15.7:0/3911095615 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7fb11c0105d0 con 0x7fb1341083b0 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.170+0000 7fb1317fa640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb12003fb70 0x7fb120042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.170+0000 7fb1317fa640 1 -- 172.21.15.7:0/3911095615 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb11c054a60 con 0x7fb1341083b0 2024-09-21T05:45:32.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.170+0000 7fb1337fe640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb12003fb70 0x7fb120042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:32.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.170+0000 7fb1337fe640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb12003fb70 0x7fb120042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb124009bd0 tx=0x7fb124005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:32.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.174+0000 7fb1317fa640 1 -- 172.21.15.7:0/3911095615 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb11c016330 con 0x7fb1341083b0 2024-09-21T05:45:32.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.365+0000 7fb139ac7640 1 -- 172.21.15.7:0/3911095615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fb1341a7080 con 0x7fb1341083b0 2024-09-21T05:45:32.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.369+0000 7fb1317fa640 1 -- 172.21.15.7:0/3911095615 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v17)=0 v17) ==== 119+0+0 (secure 0 0 0) 0x7fb11c0047a0 con 0x7fb1341083b0 2024-09-21T05:45:32.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.372+0000 7fb139ac7640 1 -- 172.21.15.7:0/3911095615 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb12003fb70 msgr2=0x7fb120042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:32.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.372+0000 7fb139ac7640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb12003fb70 0x7fb120042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb124009bd0 tx=0x7fb124005f90 comp rx=0 tx=0).stop 2024-09-21T05:45:32.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.372+0000 7fb139ac7640 1 -- 172.21.15.7:0/3911095615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1341083b0 msgr2=0x7fb13419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:32.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.372+0000 7fb139ac7640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1341083b0 0x7fb13419a9b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00e9f0 tx=0x7fb11c00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:45:32.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.372+0000 7fb139ac7640 1 -- 172.21.15.7:0/3911095615 shutdown_connections 2024-09-21T05:45:32.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.372+0000 7fb139ac7640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb12003fb70 0x7fb120042080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:32.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.372+0000 7fb139ac7640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1341083b0 0x7fb13419a9b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:32.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.372+0000 7fb139ac7640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb134108d00 0x7fb13419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:32.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.372+0000 7fb139ac7640 1 --2- 172.21.15.7:0/3911095615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb134102a70 0x7fb13419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:32.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.372+0000 7fb139ac7640 1 -- 172.21.15.7:0/3911095615 >> 172.21.15.7:0/3911095615 conn(0x7fb134079730 msgr2=0x7fb134100d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:32.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.373+0000 7fb139ac7640 1 -- 172.21.15.7:0/3911095615 shutdown_connections 2024-09-21T05:45:32.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.373+0000 7fb139ac7640 1 -- 172.21.15.7:0/3911095615 wait complete. 2024-09-21T05:45:32.969 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi007') 2024-09-21T05:45:33.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.138+0000 7fd7182a8640 1 -- 172.21.15.7:0/4215191810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7101094c0 msgr2=0x7fd7101098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:33.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.138+0000 7fd7182a8640 1 --2- 172.21.15.7:0/4215191810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7101094c0 0x7fd7101098d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd700009900 tx=0x7fd70002a410 comp rx=0 tx=0).stop 2024-09-21T05:45:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.138+0000 7fd7182a8640 1 -- 172.21.15.7:0/4215191810 shutdown_connections 2024-09-21T05:45:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.138+0000 7fd7182a8640 1 --2- 172.21.15.7:0/4215191810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7101094c0 0x7fd7101098d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.138+0000 7fd7182a8640 1 --2- 172.21.15.7:0/4215191810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd710109e10 0x7fd710110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.138+0000 7fd7182a8640 1 --2- 172.21.15.7:0/4215191810 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd710103b80 0x7fd710103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.138+0000 7fd7182a8640 1 -- 172.21.15.7:0/4215191810 >> 172.21.15.7:0/4215191810 conn(0x7fd7100ff5b0 msgr2=0x7fd710101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.138+0000 7fd7182a8640 1 -- 172.21.15.7:0/4215191810 shutdown_connections 2024-09-21T05:45:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.138+0000 7fd7182a8640 1 -- 172.21.15.7:0/4215191810 wait complete. 2024-09-21T05:45:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.139+0000 7fd7182a8640 1 Processor -- start 2024-09-21T05:45:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.139+0000 7fd7182a8640 1 -- start start 2024-09-21T05:45:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd7182a8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd710103b80 0x7fd710075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd7182a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7101094c0 0x7fd710075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:33.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd7182a8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd710109e10 0x7fd710076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd7182a8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101139b0 con 0x7fd7101094c0 2024-09-21T05:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd7182a8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd710113830 con 0x7fd710103b80 2024-09-21T05:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd7182a8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd710113b30 con 0x7fd710109e10 2024-09-21T05:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd716044640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd710103b80 0x7fd710075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd716845640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd710109e10 0x7fd710076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd716044640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd710103b80 0x7fd710075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:43090/0 (socket says 172.21.15.7:43090) 2024-09-21T05:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd716044640 1 -- 172.21.15.7:0/1684900072 learned_addr learned my addr 172.21.15.7:0/1684900072 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd715843640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7101094c0 0x7fd710075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd716044640 1 -- 172.21.15.7:0/1684900072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd710109e10 msgr2=0x7fd710076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd716044640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd710109e10 0x7fd710076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd716044640 1 -- 172.21.15.7:0/1684900072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7101094c0 msgr2=0x7fd710075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd716044640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7101094c0 0x7fd710075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd716044640 1 -- 172.21.15.7:0/1684900072 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7101a86a0 con 0x7fd710103b80 2024-09-21T05:45:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd716845640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd710109e10 0x7fd710076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:45:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd715843640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7101094c0 0x7fd710075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:45:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.140+0000 7fd716044640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd710103b80 0x7fd710075710 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00e9f0 tx=0x7fd70c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.141+0000 7fd7077fe640 1 -- 172.21.15.7:0/1684900072 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00cd80 con 0x7fd710103b80 2024-09-21T05:45:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.141+0000 7fd7182a8640 1 -- 172.21.15.7:0/1684900072 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7101a8990 con 0x7fd710103b80 2024-09-21T05:45:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.141+0000 7fd7077fe640 1 -- 172.21.15.7:0/1684900072 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd70c0108c0 con 0x7fd710103b80 2024-09-21T05:45:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.141+0000 7fd7077fe640 1 -- 172.21.15.7:0/1684900072 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0187d0 con 0x7fd710103b80 2024-09-21T05:45:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.141+0000 7fd7182a8640 1 -- 172.21.15.7:0/1684900072 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7101a8ef0 con 0x7fd710103b80 2024-09-21T05:45:33.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.142+0000 7fd7182a8640 1 -- 172.21.15.7:0/1684900072 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd710104e00 con 0x7fd710103b80 2024-09-21T05:45:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.143+0000 7fd7077fe640 1 -- 172.21.15.7:0/1684900072 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7fd70c010430 con 0x7fd710103b80 2024-09-21T05:45:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.143+0000 7fd7077fe640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd6fc03fb70 0x7fd6fc042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.143+0000 7fd7077fe640 1 -- 172.21.15.7:0/1684900072 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd70c054bc0 con 0x7fd710103b80 2024-09-21T05:45:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.143+0000 7fd715843640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd6fc03fb70 0x7fd6fc042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:33.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.144+0000 7fd715843640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd6fc03fb70 0x7fd6fc042080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd700005940 tx=0x7fd7000058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.153+0000 7fd7077fe640 1 -- 172.21.15.7:0/1684900072 <== mon.2 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd70c00b2c0 con 0x7fd710103b80 2024-09-21T05:45:33.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.343+0000 7fd7182a8640 1 -- 172.21.15.7:0/1684900072 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fd710076a10 con 0x7fd710103b80 2024-09-21T05:45:33.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.349+0000 7fd7077fe640 1 -- 172.21.15.7:0/1684900072 <== mon.2 v2:172.21.15.27:3300/0 7 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd70c016ad0 con 0x7fd710103b80 2024-09-21T05:45:33.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.350+0000 7fd7077fe640 1 -- 172.21.15.7:0/1684900072 <== mon.2 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v19)=0 v19) ==== 123+0+0 (secure 0 0 0) 0x7fd710076a10 con 0x7fd710103b80 2024-09-21T05:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.352+0000 7fd7182a8640 1 -- 172.21.15.7:0/1684900072 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd6fc03fb70 msgr2=0x7fd6fc042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.352+0000 7fd7182a8640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd6fc03fb70 0x7fd6fc042080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd700005940 tx=0x7fd7000058d0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.352+0000 7fd7182a8640 1 -- 172.21.15.7:0/1684900072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd710103b80 msgr2=0x7fd710075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.352+0000 7fd7182a8640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd710103b80 0x7fd710075710 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00e9f0 tx=0x7fd70c00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.352+0000 7fd7182a8640 1 -- 172.21.15.7:0/1684900072 shutdown_connections 2024-09-21T05:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.352+0000 7fd7182a8640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd6fc03fb70 0x7fd6fc042080 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.352+0000 7fd7182a8640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7101094c0 0x7fd710075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.352+0000 7fd7182a8640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd710109e10 0x7fd710076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.352+0000 7fd7182a8640 1 --2- 172.21.15.7:0/1684900072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd710103b80 0x7fd710075710 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.352+0000 7fd7182a8640 1 -- 172.21.15.7:0/1684900072 >> 172.21.15.7:0/1684900072 conn(0x7fd7100ff5b0 msgr2=0x7fd710108b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.352+0000 7fd7182a8640 1 -- 172.21.15.7:0/1684900072 shutdown_connections 2024-09-21T05:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.352+0000 7fd7182a8640 1 -- 172.21.15.7:0/1684900072 wait complete. 2024-09-21T05:45:33.396 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3911095615' entity='client.admin' 2024-09-21T05:45:33.396 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3014540721' entity='client.admin' 2024-09-21T05:45:33.396 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.396 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.396 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.396 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.396 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.396 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:33.396 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:33.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T05:45:33.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:45:33.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:45:33.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:33.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: Reconfiguring daemon mgr.x on smithi007 2024-09-21T05:45:33.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:33 smithi007 ceph-mon[30983]: from='client.? ' entity='client.admin' 2024-09-21T05:45:33.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3911095615' entity='client.admin' 2024-09-21T05:45:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3014540721' entity='client.admin' 2024-09-21T05:45:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T05:45:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:45:33.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:45:33.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:33.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: Reconfiguring daemon mgr.x on smithi007 2024-09-21T05:45:33.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:33 smithi027 ceph-mon[34364]: from='client.? ' entity='client.admin' 2024-09-21T05:45:33.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.347+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3224169293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fc8105300 msgr2=0x7f8fc810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:33.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.347+0000 7f8fcf87a640 1 --2- 172.21.15.7:0/3224169293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fc8105300 0x7f8fc810d850 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009900 tx=0x7f8fb802a410 comp rx=0 tx=0).stop 2024-09-21T05:45:33.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.347+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3224169293 shutdown_connections 2024-09-21T05:45:33.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.347+0000 7f8fcf87a640 1 --2- 172.21.15.7:0/3224169293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fc8105300 0x7f8fc810d850 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.347+0000 7f8fcf87a640 1 --2- 172.21.15.7:0/3224169293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fc810de10 0x7f8fc8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.347+0000 7f8fcf87a640 1 --2- 172.21.15.7:0/3224169293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc81049b0 0x7f8fc8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.347+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3224169293 >> 172.21.15.7:0/3224169293 conn(0x7f8fc8079730 msgr2=0x7f8fc8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.347+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3224169293 shutdown_connections 2024-09-21T05:45:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.347+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3224169293 wait complete. 2024-09-21T05:45:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcf87a640 1 Processor -- start 2024-09-21T05:45:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcf87a640 1 -- start start 2024-09-21T05:45:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcf87a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fc81049b0 0x7f8fc819c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcf87a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc8105300 0x7f8fc819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcf87a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fc810de10 0x7f8fc81a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcf87a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc8113950 con 0x7f8fc81049b0 2024-09-21T05:45:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcf87a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc81137d0 con 0x7f8fc810de10 2024-09-21T05:45:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcf87a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc8113ad0 con 0x7f8fc8105300 2024-09-21T05:45:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcd616640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fc81049b0 0x7f8fc819c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcd616640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fc81049b0 0x7f8fc819c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57820/0 (socket says 172.21.15.7:57820) 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcd616640 1 -- 172.21.15.7:0/3014540721 learned_addr learned my addr 172.21.15.7:0/3014540721 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcce15640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc8105300 0x7f8fc819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcde17640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fc810de10 0x7f8fc81a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcd616640 1 -- 172.21.15.7:0/3014540721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc8105300 msgr2=0x7f8fc819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcd616640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc8105300 0x7f8fc819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcd616640 1 -- 172.21.15.7:0/3014540721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fc810de10 msgr2=0x7f8fc81a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcd616640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fc810de10 0x7f8fc81a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.348+0000 7f8fcd616640 1 -- 172.21.15.7:0/3014540721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc81a25c0 con 0x7f8fc81049b0 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.349+0000 7f8fcd616640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fc81049b0 0x7f8fc819c650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400e9c0 tx=0x7f8fc400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.349+0000 7f8fbe7fc640 1 -- 172.21.15.7:0/3014540721 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc400cd80 con 0x7f8fc81049b0 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.349+0000 7f8fbe7fc640 1 -- 172.21.15.7:0/3014540721 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8fc40044b0 con 0x7f8fc81049b0 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.349+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3014540721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc81a28b0 con 0x7f8fc81049b0 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.349+0000 7f8fbe7fc640 1 -- 172.21.15.7:0/3014540721 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4010430 con 0x7f8fc81049b0 2024-09-21T05:45:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.349+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3014540721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc81a9010 con 0x7f8fc81049b0 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.350+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3014540721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc8104dc0 con 0x7f8fc81049b0 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.350+0000 7f8fbe7fc640 1 -- 172.21.15.7:0/3014540721 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7f8fc40105d0 con 0x7f8fc81049b0 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.350+0000 7f8fbe7fc640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8fb403fb70 0x7f8fb4042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.350+0000 7f8fbe7fc640 1 -- 172.21.15.7:0/3014540721 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8fc4054960 con 0x7f8fc81049b0 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.351+0000 7f8fcce15640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8fb403fb70 0x7f8fb4042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.351+0000 7f8fcce15640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8fb403fb70 0x7f8fb4042080 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8005940 tx=0x7f8fb80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.355+0000 7f8fbe7fc640 1 -- 172.21.15.7:0/3014540721 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8fc4016330 con 0x7f8fc81049b0 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.554+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3014540721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f8fc81a9400 con 0x7f8fc81049b0 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.558+0000 7f8fbe7fc640 1 -- 172.21.15.7:0/3014540721 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v18)=0 v18) ==== 111+0+0 (secure 0 0 0) 0x7f8fc40035f0 con 0x7f8fc81049b0 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.560+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3014540721 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8fb403fb70 msgr2=0x7f8fb4042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.560+0000 7f8fcf87a640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8fb403fb70 0x7f8fb4042080 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8005940 tx=0x7f8fb80058d0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.560+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3014540721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fc81049b0 msgr2=0x7f8fc819c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.560+0000 7f8fcf87a640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fc81049b0 0x7f8fc819c650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400e9c0 tx=0x7f8fc400ee80 comp rx=0 tx=0).stop 2024-09-21T05:45:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.560+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3014540721 shutdown_connections 2024-09-21T05:45:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.560+0000 7f8fcf87a640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8fb403fb70 0x7f8fb4042080 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.560+0000 7f8fcf87a640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fc810de10 0x7f8fc81a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.560+0000 7f8fcf87a640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc8105300 0x7f8fc819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.560+0000 7f8fcf87a640 1 --2- 172.21.15.7:0/3014540721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fc81049b0 0x7f8fc819c650 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.560+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3014540721 >> 172.21.15.7:0/3014540721 conn(0x7f8fc8079730 msgr2=0x7f8fc81037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.560+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3014540721 shutdown_connections 2024-09-21T05:45:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:32.560+0000 7f8fcf87a640 1 -- 172.21.15.7:0/3014540721 wait complete. 2024-09-21T05:45:33.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3911095615' entity='client.admin' 2024-09-21T05:45:33.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3014540721' entity='client.admin' 2024-09-21T05:45:33.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:33.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:33.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:33.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T05:45:33.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:45:33.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:45:33.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:33.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: Reconfiguring daemon mgr.x on smithi007 2024-09-21T05:45:33.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:33 smithi119 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T05:45:34.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.984+0000 7f72b49d6640 1 -- 172.21.15.7:0/746234224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b01049b0 msgr2=0x7f72b0104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:34.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.984+0000 7f72b49d6640 1 --2- 172.21.15.7:0/746234224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b01049b0 0x7f72b0104dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009900 tx=0x7f72a002a410 comp rx=0 tx=0).stop 2024-09-21T05:45:34.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.984+0000 7f72b49d6640 1 -- 172.21.15.7:0/746234224 shutdown_connections 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.984+0000 7f72b49d6640 1 --2- 172.21.15.7:0/746234224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72b010de10 0x7f72b0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.984+0000 7f72b49d6640 1 --2- 172.21.15.7:0/746234224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b0105300 0x7f72b010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.984+0000 7f72b49d6640 1 --2- 172.21.15.7:0/746234224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b01049b0 0x7f72b0104dc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.984+0000 7f72b49d6640 1 -- 172.21.15.7:0/746234224 >> 172.21.15.7:0/746234224 conn(0x7f72b0079730 msgr2=0x7f72b0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.984+0000 7f72b49d6640 1 -- 172.21.15.7:0/746234224 shutdown_connections 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.984+0000 7f72b49d6640 1 -- 172.21.15.7:0/746234224 wait complete. 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.985+0000 7f72b49d6640 1 Processor -- start 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.985+0000 7f72b49d6640 1 -- start start 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72b49d6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72b01049b0 0x7f72b01026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72b49d6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b0105300 0x7f72b0102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72b49d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b010de10 0x7f72b0103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72b49d6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f72b0113a70 con 0x7f72b0105300 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72b49d6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f72b01138f0 con 0x7f72b01049b0 2024-09-21T05:45:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72b49d6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f72b0113bf0 con 0x7f72b010de10 2024-09-21T05:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72add9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b0105300 0x7f72b0102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72add9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b0105300 0x7f72b0102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57862/0 (socket says 172.21.15.7:57862) 2024-09-21T05:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72ae59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72b01049b0 0x7f72b01026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72add9b640 1 -- 172.21.15.7:0/1985135539 learned_addr learned my addr 172.21.15.7:0/1985135539 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72aed9d640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b010de10 0x7f72b0103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72add9b640 1 -- 172.21.15.7:0/1985135539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b010de10 msgr2=0x7f72b0103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72add9b640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b010de10 0x7f72b0103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72add9b640 1 -- 172.21.15.7:0/1985135539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72b01049b0 msgr2=0x7f72b01026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72add9b640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72b01049b0 0x7f72b01026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72add9b640 1 -- 172.21.15.7:0/1985135539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b01a8800 con 0x7f72b0105300 2024-09-21T05:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72ae59c640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72b01049b0 0x7f72b01026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:45:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f72add9b640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b0105300 0x7f72b0102c30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f72a400d950 tx=0x7f72a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f729f7fe640 1 -- 172.21.15.7:0/1985135539 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a4017070 con 0x7f72b0105300 2024-09-21T05:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.986+0000 7f729f7fe640 1 -- 172.21.15.7:0/1985135539 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72a4009c30 con 0x7f72b0105300 2024-09-21T05:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.987+0000 7f729f7fe640 1 -- 172.21.15.7:0/1985135539 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a40047a0 con 0x7f72b0105300 2024-09-21T05:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.987+0000 7f72b49d6640 1 -- 172.21.15.7:0/1985135539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b01a8af0 con 0x7f72b0105300 2024-09-21T05:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.987+0000 7f72b49d6640 1 -- 172.21.15.7:0/1985135539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b01a8fe0 con 0x7f72b0105300 2024-09-21T05:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.988+0000 7f72b49d6640 1 -- 172.21.15.7:0/1985135539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b0104dc0 con 0x7f72b0105300 2024-09-21T05:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.988+0000 7f729f7fe640 1 -- 172.21.15.7:0/1985135539 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7f72a4004020 con 0x7f72b0105300 2024-09-21T05:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.988+0000 7f729f7fe640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f729803fb70 0x7f7298042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.988+0000 7f729f7fe640 1 -- 172.21.15.7:0/1985135539 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f72a40541a0 con 0x7f72b0105300 2024-09-21T05:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.988+0000 7f72ae59c640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f729803fb70 0x7f7298042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.989+0000 7f72ae59c640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f729803fb70 0x7f7298042080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009230 tx=0x7f72a0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:34.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:33.993+0000 7f729f7fe640 1 -- 172.21.15.7:0/1985135539 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72a4020020 con 0x7f72b0105300 2024-09-21T05:45:34.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.184+0000 7f72b49d6640 1 -- 172.21.15.7:0/1985135539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f72b002e640 con 0x7f72b0105300 2024-09-21T05:45:34.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.188+0000 7f729f7fe640 1 -- 172.21.15.7:0/1985135539 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v20)=0 v20) ==== 108+0+0 (secure 0 0 0) 0x7f72a4004310 con 0x7f72b0105300 2024-09-21T05:45:34.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.191+0000 7f72b49d6640 1 -- 172.21.15.7:0/1985135539 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f729803fb70 msgr2=0x7f7298042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:34.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.191+0000 7f72b49d6640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f729803fb70 0x7f7298042080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009230 tx=0x7f72a0031400 comp rx=0 tx=0).stop 2024-09-21T05:45:34.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.191+0000 7f72b49d6640 1 -- 172.21.15.7:0/1985135539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b0105300 msgr2=0x7f72b0102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:34.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.191+0000 7f72b49d6640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b0105300 0x7f72b0102c30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f72a400d950 tx=0x7f72a400de10 comp rx=0 tx=0).stop 2024-09-21T05:45:34.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.191+0000 7f72b49d6640 1 -- 172.21.15.7:0/1985135539 shutdown_connections 2024-09-21T05:45:34.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.191+0000 7f72b49d6640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f729803fb70 0x7f7298042080 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.191+0000 7f72b49d6640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b0105300 0x7f72b0102c30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.191+0000 7f72b49d6640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b010de10 0x7f72b0103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.191+0000 7f72b49d6640 1 --2- 172.21.15.7:0/1985135539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72b01049b0 0x7f72b01026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.191+0000 7f72b49d6640 1 -- 172.21.15.7:0/1985135539 >> 172.21.15.7:0/1985135539 conn(0x7f72b0079730 msgr2=0x7f72b00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:34.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.192+0000 7f72b49d6640 1 -- 172.21.15.7:0/1985135539 shutdown_connections 2024-09-21T05:45:34.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.192+0000 7f72b49d6640 1 -- 172.21.15.7:0/1985135539 wait complete. 2024-09-21T05:45:34.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.639+0000 7fec56023640 1 -- 172.21.15.7:0/3213997176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec50108cf0 msgr2=0x7fec5010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:34.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.639+0000 7fec56023640 1 --2- 172.21.15.7:0/3213997176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec50108cf0 0x7fec5010f520 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fec48009ca0 tx=0x7fec4802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.639+0000 7fec56023640 1 -- 172.21.15.7:0/3213997176 shutdown_connections 2024-09-21T05:45:34.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.639+0000 7fec56023640 1 --2- 172.21.15.7:0/3213997176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec50108cf0 0x7fec5010f520 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.639+0000 7fec56023640 1 --2- 172.21.15.7:0/3213997176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec501083a0 0x7fec501087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.639+0000 7fec56023640 1 --2- 172.21.15.7:0/3213997176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec50102a60 0x7fec50102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.639+0000 7fec56023640 1 -- 172.21.15.7:0/3213997176 >> 172.21.15.7:0/3213997176 conn(0x7fec50079730 msgr2=0x7fec50079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:34.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.639+0000 7fec56023640 1 -- 172.21.15.7:0/3213997176 shutdown_connections 2024-09-21T05:45:34.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.639+0000 7fec56023640 1 -- 172.21.15.7:0/3213997176 wait complete. 2024-09-21T05:45:34.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.640+0000 7fec56023640 1 Processor -- start 2024-09-21T05:45:34.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.640+0000 7fec56023640 1 -- start start 2024-09-21T05:45:34.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.640+0000 7fec56023640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec50102a60 0x7fec5019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:34.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.640+0000 7fec56023640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec501083a0 0x7fec5019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:34.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.640+0000 7fec56023640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec50108cf0 0x7fec5019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:34.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.640+0000 7fec56023640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fec50113ab0 con 0x7fec501083a0 2024-09-21T05:45:34.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.640+0000 7fec56023640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fec50113930 con 0x7fec50102a60 2024-09-21T05:45:34.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.640+0000 7fec56023640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fec50113c30 con 0x7fec50108cf0 2024-09-21T05:45:34.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.640+0000 7fec4f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec50102a60 0x7fec5019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.640+0000 7fec4effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec501083a0 0x7fec5019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.640+0000 7fec4f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec50102a60 0x7fec5019a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:43126/0 (socket says 172.21.15.7:43126) 2024-09-21T05:45:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.640+0000 7fec4f7fe640 1 -- 172.21.15.7:0/797418838 learned_addr learned my addr 172.21.15.7:0/797418838 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.640+0000 7fec4ffff640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec50108cf0 0x7fec5019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.641+0000 7fec4effd640 1 -- 172.21.15.7:0/797418838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec50108cf0 msgr2=0x7fec5019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.641+0000 7fec4effd640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec50108cf0 0x7fec5019fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.641+0000 7fec4effd640 1 -- 172.21.15.7:0/797418838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec50102a60 msgr2=0x7fec5019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.641+0000 7fec4effd640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec50102a60 0x7fec5019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.641+0000 7fec4effd640 1 -- 172.21.15.7:0/797418838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec501a0350 con 0x7fec501083a0 2024-09-21T05:45:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.641+0000 7fec4ffff640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec50108cf0 0x7fec5019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:45:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.641+0000 7fec4f7fe640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec50102a60 0x7fec5019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:45:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.641+0000 7fec4effd640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec501083a0 0x7fec5019a980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fec3800d6a0 tx=0x7fec3800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.641+0000 7fec4cff9640 1 -- 172.21.15.7:0/797418838 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38017070 con 0x7fec501083a0 2024-09-21T05:45:34.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.641+0000 7fec4cff9640 1 -- 172.21.15.7:0/797418838 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec38009820 con 0x7fec501083a0 2024-09-21T05:45:34.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.641+0000 7fec56023640 1 -- 172.21.15.7:0/797418838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec501a0640 con 0x7fec501083a0 2024-09-21T05:45:34.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.641+0000 7fec4cff9640 1 -- 172.21.15.7:0/797418838 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38004c40 con 0x7fec501083a0 2024-09-21T05:45:34.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.641+0000 7fec56023640 1 -- 172.21.15.7:0/797418838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec501a6da0 con 0x7fec501083a0 2024-09-21T05:45:34.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.642+0000 7fec56023640 1 -- 172.21.15.7:0/797418838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec50102e70 con 0x7fec501083a0 2024-09-21T05:45:34.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.642+0000 7fec4cff9640 1 -- 172.21.15.7:0/797418838 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 51914+0+0 (secure 0 0 0) 0x7fec38010460 con 0x7fec501083a0 2024-09-21T05:45:34.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.643+0000 7fec4cff9640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fec3c03fb70 0x7fec3c042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:34.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.643+0000 7fec4cff9640 1 -- 172.21.15.7:0/797418838 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fec38053ef0 con 0x7fec501083a0 2024-09-21T05:45:34.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.643+0000 7fec4f7fe640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fec3c03fb70 0x7fec3c042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:34.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.643+0000 7fec4f7fe640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fec3c03fb70 0x7fec3c042080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fec40011500 tx=0x7fec40005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:34.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.648+0000 7fec4cff9640 1 -- 172.21.15.7:0/797418838 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec38004de0 con 0x7fec501083a0 2024-09-21T05:45:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.838+0000 7fec56023640 1 -- 172.21.15.7:0/797418838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fec5010aac0 con 0x7fec501083a0 2024-09-21T05:45:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.842+0000 7fec4cff9640 1 -- 172.21.15.7:0/797418838 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fec38009cd0 con 0x7fec501083a0 2024-09-21T05:45:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.844+0000 7fec56023640 1 -- 172.21.15.7:0/797418838 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fec3c03fb70 msgr2=0x7fec3c042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.844+0000 7fec56023640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fec3c03fb70 0x7fec3c042080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fec40011500 tx=0x7fec40005f90 comp rx=0 tx=0).stop 2024-09-21T05:45:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.844+0000 7fec56023640 1 -- 172.21.15.7:0/797418838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec501083a0 msgr2=0x7fec5019a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.844+0000 7fec56023640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec501083a0 0x7fec5019a980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fec3800d6a0 tx=0x7fec3800db60 comp rx=0 tx=0).stop 2024-09-21T05:45:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.844+0000 7fec56023640 1 -- 172.21.15.7:0/797418838 shutdown_connections 2024-09-21T05:45:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.844+0000 7fec56023640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fec3c03fb70 0x7fec3c042080 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.844+0000 7fec56023640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec501083a0 0x7fec5019a980 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.844+0000 7fec56023640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec50108cf0 0x7fec5019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.844+0000 7fec56023640 1 --2- 172.21.15.7:0/797418838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec50102a60 0x7fec5019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:34.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.844+0000 7fec56023640 1 -- 172.21.15.7:0/797418838 >> 172.21.15.7:0/797418838 conn(0x7fec50079730 msgr2=0x7fec50104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:34.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.844+0000 7fec56023640 1 -- 172.21.15.7:0/797418838 shutdown_connections 2024-09-21T05:45:34.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:34.844+0000 7fec56023640 1 -- 172.21.15.7:0/797418838 wait complete. 2024-09-21T05:45:35.125 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:35.127 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:35.132 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:35.133 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:35.133 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:35.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1985135539' entity='client.admin' 2024-09-21T05:45:35.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:35 smithi007 ceph-mon[30983]: Standby manager daemon z started 2024-09-21T05:45:35.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:35 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.119:0/2249245561' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T05:45:35.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:35 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.119:0/2249245561' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:45:35.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:35 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.119:0/2249245561' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T05:45:35.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:35 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.119:0/2249245561' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:45:35.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/797418838' entity='client.admin' 2024-09-21T05:45:35.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:35 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1985135539' entity='client.admin' 2024-09-21T05:45:35.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:35 smithi027 ceph-mon[34364]: Standby manager daemon z started 2024-09-21T05:45:35.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:35 smithi027 ceph-mon[34364]: from='mgr.? 172.21.15.119:0/2249245561' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T05:45:35.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:35 smithi027 ceph-mon[34364]: from='mgr.? 172.21.15.119:0/2249245561' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:45:35.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:35 smithi027 ceph-mon[34364]: from='mgr.? 172.21.15.119:0/2249245561' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T05:45:35.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:35 smithi027 ceph-mon[34364]: from='mgr.? 172.21.15.119:0/2249245561' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:45:35.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:35 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/797418838' entity='client.admin' 2024-09-21T05:45:35.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:35 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1985135539' entity='client.admin' 2024-09-21T05:45:35.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:35 smithi119 ceph-mon[34833]: Standby manager daemon z started 2024-09-21T05:45:35.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:35 smithi119 ceph-mon[34833]: from='mgr.? 172.21.15.119:0/2249245561' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T05:45:35.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:35 smithi119 ceph-mon[34833]: from='mgr.? 172.21.15.119:0/2249245561' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:45:35.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:35 smithi119 ceph-mon[34833]: from='mgr.? 172.21.15.119:0/2249245561' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T05:45:35.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:35 smithi119 ceph-mon[34833]: from='mgr.? 172.21.15.119:0/2249245561' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:45:35.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:35 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/797418838' entity='client.admin' 2024-09-21T05:45:35.647 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:35.647 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:35.648 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:35.648 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:35.648 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:35.652 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:36.004 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:36.032 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi007') 2024-09-21T05:45:36.032 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi007') 2024-09-21T05:45:36.032 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi007') 2024-09-21T05:45:36.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:36 smithi007 ceph-mon[30983]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-21T05:45:36.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T05:45:36.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:36 smithi027 ceph-mon[34364]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-21T05:45:36.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:36 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T05:45:36.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:36 smithi119 ceph-mon[34833]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-21T05:45:36.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:36 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T05:45:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.030+0000 7fe68d65a640 1 -- 172.21.15.7:0/2792998854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe688108d00 msgr2=0x7fe68810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.030+0000 7fe68d65a640 1 --2- 172.21.15.7:0/2792998854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe688108d00 0x7fe68810f530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe680009ca0 tx=0x7fe68002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.030+0000 7fe68d65a640 1 -- 172.21.15.7:0/2792998854 shutdown_connections 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.030+0000 7fe68d65a640 1 --2- 172.21.15.7:0/2792998854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe688108d00 0x7fe68810f530 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.030+0000 7fe68d65a640 1 --2- 172.21.15.7:0/2792998854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6881083b0 0x7fe6881087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.030+0000 7fe68d65a640 1 --2- 172.21.15.7:0/2792998854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe688103140 0x7fe688103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.030+0000 7fe68d65a640 1 -- 172.21.15.7:0/2792998854 >> 172.21.15.7:0/2792998854 conn(0x7fe688077c60 msgr2=0x7fe6880780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.030+0000 7fe68d65a640 1 -- 172.21.15.7:0/2792998854 shutdown_connections 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.030+0000 7fe68d65a640 1 -- 172.21.15.7:0/2792998854 wait complete. 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.031+0000 7fe68d65a640 1 Processor -- start 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.031+0000 7fe68d65a640 1 -- start start 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.031+0000 7fe68d65a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe688103140 0x7fe68819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.031+0000 7fe68d65a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6881083b0 0x7fe68819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.031+0000 7fe68d65a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe688108d00 0x7fe68819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.031+0000 7fe68d65a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe6881129c0 con 0x7fe688108d00 2024-09-21T05:45:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.031+0000 7fe68d65a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe688112840 con 0x7fe6881083b0 2024-09-21T05:45:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.031+0000 7fe68d65a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe688112b40 con 0x7fe688103140 2024-09-21T05:45:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.031+0000 7fe6877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe688108d00 0x7fe68819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.031+0000 7fe6867fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6881083b0 0x7fe68819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.031+0000 7fe6877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe688108d00 0x7fe68819bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57892/0 (socket says 172.21.15.7:57892) 2024-09-21T05:45:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.031+0000 7fe6877fe640 1 -- 172.21.15.7:0/3554880063 learned_addr learned my addr 172.21.15.7:0/3554880063 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.032+0000 7fe686ffd640 1 --2- 172.21.15.7:0/3554880063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe688103140 0x7fe68819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.032+0000 7fe6877fe640 1 -- 172.21.15.7:0/3554880063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe688103140 msgr2=0x7fe68819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.032+0000 7fe6877fe640 1 --2- 172.21.15.7:0/3554880063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe688103140 0x7fe68819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.032+0000 7fe6877fe640 1 -- 172.21.15.7:0/3554880063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6881083b0 msgr2=0x7fe68819b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.032+0000 7fe6877fe640 1 --2- 172.21.15.7:0/3554880063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6881083b0 0x7fe68819b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.032+0000 7fe6877fe640 1 -- 172.21.15.7:0/3554880063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6881a6540 con 0x7fe688108d00 2024-09-21T05:45:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.032+0000 7fe6877fe640 1 --2- 172.21.15.7:0/3554880063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe688108d00 0x7fe68819bcb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe680005cc0 tx=0x7fe68002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.032+0000 7fe67ffff640 1 -- 172.21.15.7:0/3554880063 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680003bf0 con 0x7fe688108d00 2024-09-21T05:45:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.032+0000 7fe67ffff640 1 -- 172.21.15.7:0/3554880063 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe680003d90 con 0x7fe688108d00 2024-09-21T05:45:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.032+0000 7fe68d65a640 1 -- 172.21.15.7:0/3554880063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6881a67d0 con 0x7fe688108d00 2024-09-21T05:45:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.032+0000 7fe67ffff640 1 -- 172.21.15.7:0/3554880063 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68002fbc0 con 0x7fe688108d00 2024-09-21T05:45:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.032+0000 7fe68d65a640 1 -- 172.21.15.7:0/3554880063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6881a6d60 con 0x7fe688108d00 2024-09-21T05:45:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.034+0000 7fe68d65a640 1 -- 172.21.15.7:0/3554880063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe688103550 con 0x7fe688108d00 2024-09-21T05:45:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.034+0000 7fe67ffff640 1 -- 172.21.15.7:0/3554880063 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 103193+0+0 (secure 0 0 0) 0x7fe68002fd60 con 0x7fe688108d00 2024-09-21T05:45:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.035+0000 7fe67ffff640 1 --2- 172.21.15.7:0/3554880063 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe67407b020 0x7fe67407d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.035+0000 7fe686ffd640 1 --2- 172.21.15.7:0/3554880063 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe67407b020 0x7fe67407d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.035+0000 7fe67ffff640 1 -- 172.21.15.7:0/3554880063 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe6800be2b0 con 0x7fe688108d00 2024-09-21T05:45:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.035+0000 7fe686ffd640 1 --2- 172.21.15.7:0/3554880063 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe67407b020 0x7fe67407d530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe688102960 tx=0x7fe67800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.040+0000 7fe67ffff640 1 -- 172.21.15.7:0/3554880063 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6800098b0 con 0x7fe688108d00 2024-09-21T05:45:37.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.206+0000 7fe67ffff640 1 -- 172.21.15.7:0/3554880063 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fe680082570 con 0x7fe688108d00 2024-09-21T05:45:37.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.232+0000 7fe68d65a640 1 -- 172.21.15.7:0/3554880063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fe68810ab50 con 0x7fe688108d00 2024-09-21T05:45:37.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.236+0000 7fe67ffff640 1 -- 172.21.15.7:0/3554880063 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v22)=0 v22) ==== 106+0+0 (secure 0 0 0) 0x7fe68008d490 con 0x7fe688108d00 2024-09-21T05:45:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.238+0000 7fe68d65a640 1 -- 172.21.15.7:0/3554880063 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe67407b020 msgr2=0x7fe67407d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.238+0000 7fe68d65a640 1 --2- 172.21.15.7:0/3554880063 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe67407b020 0x7fe67407d530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe688102960 tx=0x7fe67800b410 comp rx=0 tx=0).stop 2024-09-21T05:45:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.238+0000 7fe68d65a640 1 -- 172.21.15.7:0/3554880063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe688108d00 msgr2=0x7fe68819bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.238+0000 7fe68d65a640 1 --2- 172.21.15.7:0/3554880063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe688108d00 0x7fe68819bcb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe680005cc0 tx=0x7fe68002f380 comp rx=0 tx=0).stop 2024-09-21T05:45:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.238+0000 7fe68d65a640 1 -- 172.21.15.7:0/3554880063 shutdown_connections 2024-09-21T05:45:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.238+0000 7fe68d65a640 1 --2- 172.21.15.7:0/3554880063 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe67407b020 0x7fe67407d530 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.238+0000 7fe68d65a640 1 --2- 172.21.15.7:0/3554880063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe688108d00 0x7fe68819bcb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.238+0000 7fe68d65a640 1 --2- 172.21.15.7:0/3554880063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6881083b0 0x7fe68819b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.238+0000 7fe68d65a640 1 --2- 172.21.15.7:0/3554880063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe688103140 0x7fe68819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.238+0000 7fe68d65a640 1 -- 172.21.15.7:0/3554880063 >> 172.21.15.7:0/3554880063 conn(0x7fe688077c60 msgr2=0x7fe688106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:37.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.238+0000 7fe68d65a640 1 -- 172.21.15.7:0/3554880063 shutdown_connections 2024-09-21T05:45:37.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.238+0000 7fe68d65a640 1 -- 172.21.15.7:0/3554880063 wait complete. 2024-09-21T05:45:37.367 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:37 smithi007 ceph-mon[30983]: Standby manager daemon y started 2024-09-21T05:45:37.368 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:37 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.27:0/947579721' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T05:45:37.368 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:37 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.27:0/947579721' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:45:37.368 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:37 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.27:0/947579721' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T05:45:37.368 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:37 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.27:0/947579721' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:45:37.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:37 smithi027 ceph-mon[34364]: Standby manager daemon y started 2024-09-21T05:45:37.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:37 smithi027 ceph-mon[34364]: from='mgr.? 172.21.15.27:0/947579721' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T05:45:37.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:37 smithi027 ceph-mon[34364]: from='mgr.? 172.21.15.27:0/947579721' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:45:37.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:37 smithi027 ceph-mon[34364]: from='mgr.? 172.21.15.27:0/947579721' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T05:45:37.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:37 smithi027 ceph-mon[34364]: from='mgr.? 172.21.15.27:0/947579721' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:45:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.579+0000 7efd79fb5640 1 -- 172.21.15.7:0/1733120718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd741094c0 msgr2=0x7efd741098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.579+0000 7efd79fb5640 1 --2- 172.21.15.7:0/1733120718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd741094c0 0x7efd741098d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efd68009900 tx=0x7efd6802a410 comp rx=0 tx=0).stop 2024-09-21T05:45:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.579+0000 7efd79fb5640 1 -- 172.21.15.7:0/1733120718 shutdown_connections 2024-09-21T05:45:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.579+0000 7efd79fb5640 1 --2- 172.21.15.7:0/1733120718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd741094c0 0x7efd741098d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.579+0000 7efd79fb5640 1 --2- 172.21.15.7:0/1733120718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd74109e10 0x7efd74110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.579+0000 7efd79fb5640 1 --2- 172.21.15.7:0/1733120718 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd74103b80 0x7efd74103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.579+0000 7efd79fb5640 1 -- 172.21.15.7:0/1733120718 >> 172.21.15.7:0/1733120718 conn(0x7efd740ff5d0 msgr2=0x7efd74101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.579+0000 7efd79fb5640 1 -- 172.21.15.7:0/1733120718 shutdown_connections 2024-09-21T05:45:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.579+0000 7efd79fb5640 1 -- 172.21.15.7:0/1733120718 wait complete. 2024-09-21T05:45:37.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.580+0000 7efd79fb5640 1 Processor -- start 2024-09-21T05:45:37.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.580+0000 7efd79fb5640 1 -- start start 2024-09-21T05:45:37.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.580+0000 7efd79fb5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd74103b80 0x7efd74075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:37.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.580+0000 7efd79fb5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd741094c0 0x7efd74075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:37.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.580+0000 7efd79fb5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd74109e10 0x7efd74076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:37.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.580+0000 7efd79fb5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efd74113ad0 con 0x7efd74109e10 2024-09-21T05:45:37.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.580+0000 7efd79fb5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7efd74113950 con 0x7efd741094c0 2024-09-21T05:45:37.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.580+0000 7efd79fb5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd74113c50 con 0x7efd74103b80 2024-09-21T05:45:37.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.580+0000 7efd73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd74109e10 0x7efd74076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:37.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.580+0000 7efd72ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd741094c0 0x7efd74075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:37.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.580+0000 7efd73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd74109e10 0x7efd74076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57922/0 (socket says 172.21.15.7:57922) 2024-09-21T05:45:37.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.580+0000 7efd72ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd741094c0 0x7efd74075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:43162/0 (socket says 172.21.15.7:43162) 2024-09-21T05:45:37.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.580+0000 7efd73fff640 1 -- 172.21.15.7:0/414888461 learned_addr learned my addr 172.21.15.7:0/414888461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:37.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd737fe640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd74103b80 0x7efd74075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:37.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd73fff640 1 -- 172.21.15.7:0/414888461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd74103b80 msgr2=0x7efd74075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:37.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd73fff640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd74103b80 0x7efd74075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd73fff640 1 -- 172.21.15.7:0/414888461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd741094c0 msgr2=0x7efd74075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:37.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd73fff640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd741094c0 0x7efd74075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd73fff640 1 -- 172.21.15.7:0/414888461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd741a87a0 con 0x7efd74109e10 2024-09-21T05:45:37.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd737fe640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd74103b80 0x7efd74075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:45:37.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd72ffd640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd741094c0 0x7efd74075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:45:37.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd73fff640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd74109e10 0x7efd74076190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00cad0 tx=0x7efd6c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:37.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd70ff9640 1 -- 172.21.15.7:0/414888461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c00ae20 con 0x7efd74109e10 2024-09-21T05:45:37.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd70ff9640 1 -- 172.21.15.7:0/414888461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd6c005020 con 0x7efd74109e10 2024-09-21T05:45:37.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd79fb5640 1 -- 172.21.15.7:0/414888461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd741a8a90 con 0x7efd74109e10 2024-09-21T05:45:37.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd70ff9640 1 -- 172.21.15.7:0/414888461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c00f6b0 con 0x7efd74109e10 2024-09-21T05:45:37.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.581+0000 7efd79fb5640 1 -- 172.21.15.7:0/414888461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd741a8ff0 con 0x7efd74109e10 2024-09-21T05:45:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.583+0000 7efd79fb5640 1 -- 172.21.15.7:0/414888461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd74103f90 con 0x7efd74109e10 2024-09-21T05:45:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.584+0000 7efd70ff9640 1 -- 172.21.15.7:0/414888461 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7efd6c0051d0 con 0x7efd74109e10 2024-09-21T05:45:37.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.585+0000 7efd70ff9640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efd5c0b6550 0x7efd5c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:37.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.585+0000 7efd737fe640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efd5c0b6550 0x7efd5c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:37.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.585+0000 7efd70ff9640 1 -- 172.21.15.7:0/414888461 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7efd6c0e5ab0 con 0x7efd74109e10 2024-09-21T05:45:37.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.585+0000 7efd737fe640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efd5c0b6550 0x7efd5c0b8a60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efd64005fd0 tx=0x7efd64005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:37.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.588+0000 7efd70ff9640 1 -- 172.21.15.7:0/414888461 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd6c014030 con 0x7efd74109e10 2024-09-21T05:45:37.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:37 smithi119 ceph-mon[34833]: Standby manager daemon y started 2024-09-21T05:45:37.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:37 smithi119 ceph-mon[34833]: from='mgr.? 172.21.15.27:0/947579721' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T05:45:37.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:37 smithi119 ceph-mon[34833]: from='mgr.? 172.21.15.27:0/947579721' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:45:37.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:37 smithi119 ceph-mon[34833]: from='mgr.? 172.21.15.27:0/947579721' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T05:45:37.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:37 smithi119 ceph-mon[34833]: from='mgr.? 172.21.15.27:0/947579721' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:45:37.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.781+0000 7efd79fb5640 1 -- 172.21.15.7:0/414888461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7efd7402e640 con 0x7efd74109e10 2024-09-21T05:45:37.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.787+0000 7efd70ff9640 1 -- 172.21.15.7:0/414888461 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7efd6c0adfc0 con 0x7efd74109e10 2024-09-21T05:45:37.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.789+0000 7efd79fb5640 1 -- 172.21.15.7:0/414888461 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efd5c0b6550 msgr2=0x7efd5c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:37.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.789+0000 7efd79fb5640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efd5c0b6550 0x7efd5c0b8a60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efd64005fd0 tx=0x7efd64005850 comp rx=0 tx=0).stop 2024-09-21T05:45:37.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.789+0000 7efd79fb5640 1 -- 172.21.15.7:0/414888461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd74109e10 msgr2=0x7efd74076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:37.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.789+0000 7efd79fb5640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd74109e10 0x7efd74076190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00cad0 tx=0x7efd6c00cf90 comp rx=0 tx=0).stop 2024-09-21T05:45:37.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.790+0000 7efd79fb5640 1 -- 172.21.15.7:0/414888461 shutdown_connections 2024-09-21T05:45:37.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.790+0000 7efd79fb5640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efd5c0b6550 0x7efd5c0b8a60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.790+0000 7efd79fb5640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd74109e10 0x7efd74076190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.790+0000 7efd79fb5640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd741094c0 0x7efd74075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.790+0000 7efd79fb5640 1 --2- 172.21.15.7:0/414888461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd74103b80 0x7efd74075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:37.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.790+0000 7efd79fb5640 1 -- 172.21.15.7:0/414888461 >> 172.21.15.7:0/414888461 conn(0x7efd740ff5d0 msgr2=0x7efd741019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:37.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.790+0000 7efd79fb5640 1 -- 172.21.15.7:0/414888461 shutdown_connections 2024-09-21T05:45:37.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:37.790+0000 7efd79fb5640 1 -- 172.21.15.7:0/414888461 wait complete. 2024-09-21T05:45:38.221 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:38 smithi007 ceph-mon[30983]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-21T05:45:38.221 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T05:45:38.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:38 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3554880063' entity='client.admin' 2024-09-21T05:45:38.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:38 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/414888461' entity='client.admin' 2024-09-21T05:45:38.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:38 smithi027 ceph-mon[34364]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-21T05:45:38.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:38 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T05:45:38.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:38 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3554880063' entity='client.admin' 2024-09-21T05:45:38.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:38 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/414888461' entity='client.admin' 2024-09-21T05:45:38.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:38 smithi119 ceph-mon[34833]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-21T05:45:38.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:38 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T05:45:38.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:38 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3554880063' entity='client.admin' 2024-09-21T05:45:38.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:38 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/414888461' entity='client.admin' 2024-09-21T05:45:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.050+0000 7f6db9546640 1 -- 172.21.15.7:0/803923277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db41062c0 msgr2=0x7f6db41066d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.050+0000 7f6db9546640 1 --2- 172.21.15.7:0/803923277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db41062c0 0x7f6db41066d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009900 tx=0x7f6da802a410 comp rx=0 tx=0).stop 2024-09-21T05:45:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.050+0000 7f6db9546640 1 -- 172.21.15.7:0/803923277 shutdown_connections 2024-09-21T05:45:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.050+0000 7f6db9546640 1 --2- 172.21.15.7:0/803923277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db41062c0 0x7f6db41066d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.050+0000 7f6db9546640 1 --2- 172.21.15.7:0/803923277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db4106c10 0x7f6db4110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.050+0000 7f6db9546640 1 --2- 172.21.15.7:0/803923277 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db41020d0 0x7f6db41024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.050+0000 7f6db9546640 1 -- 172.21.15.7:0/803923277 >> 172.21.15.7:0/803923277 conn(0x7f6db4079e30 msgr2=0x7f6db407a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.050+0000 7f6db9546640 1 -- 172.21.15.7:0/803923277 shutdown_connections 2024-09-21T05:45:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.050+0000 7f6db9546640 1 -- 172.21.15.7:0/803923277 wait complete. 2024-09-21T05:45:38.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.051+0000 7f6db9546640 1 Processor -- start 2024-09-21T05:45:38.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.051+0000 7f6db9546640 1 -- start start 2024-09-21T05:45:38.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.051+0000 7f6db9546640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db41020d0 0x7f6db4103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:38.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.051+0000 7f6db9546640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db41062c0 0x7f6db41035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:38.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.051+0000 7f6db9546640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db4106c10 0x7f6db4103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:38.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.051+0000 7f6db9546640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4113a70 con 0x7f6db41020d0 2024-09-21T05:45:38.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.051+0000 7f6db9546640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6db41138f0 con 0x7f6db41062c0 2024-09-21T05:45:38.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.051+0000 7f6db9546640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4113bf0 con 0x7f6db4106c10 2024-09-21T05:45:38.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.051+0000 7f6db2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db41020d0 0x7f6db4103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:38.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.051+0000 7f6db2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db41020d0 0x7f6db4103070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57944/0 (socket says 172.21.15.7:57944) 2024-09-21T05:45:38.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.051+0000 7f6db2ffd640 1 -- 172.21.15.7:0/2256910206 learned_addr learned my addr 172.21.15.7:0/2256910206 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.051+0000 7f6db27fc640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db41062c0 0x7f6db41035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.052+0000 7f6db37fe640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db4106c10 0x7f6db4103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.052+0000 7f6db2ffd640 1 -- 172.21.15.7:0/2256910206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db4106c10 msgr2=0x7f6db4103af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.052+0000 7f6db2ffd640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db4106c10 0x7f6db4103af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.052+0000 7f6db2ffd640 1 -- 172.21.15.7:0/2256910206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db41062c0 msgr2=0x7f6db41035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.052+0000 7f6db2ffd640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db41062c0 0x7f6db41035b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.052+0000 7f6db2ffd640 1 -- 172.21.15.7:0/2256910206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db41a8780 con 0x7f6db41020d0 2024-09-21T05:45:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.052+0000 7f6db2ffd640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db41020d0 0x7f6db4103070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6da400ebc0 tx=0x7f6da400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.052+0000 7f6d9bfff640 1 -- 172.21.15.7:0/2256910206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da4010630 con 0x7f6db41020d0 2024-09-21T05:45:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.052+0000 7f6db9546640 1 -- 172.21.15.7:0/2256910206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db41a8a70 con 0x7f6db41020d0 2024-09-21T05:45:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.052+0000 7f6d9bfff640 1 -- 172.21.15.7:0/2256910206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6da4010c80 con 0x7f6db41020d0 2024-09-21T05:45:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.052+0000 7f6d9bfff640 1 -- 172.21.15.7:0/2256910206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da4018b60 con 0x7f6db41020d0 2024-09-21T05:45:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.052+0000 7f6db9546640 1 -- 172.21.15.7:0/2256910206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db41a8fd0 con 0x7f6db41020d0 2024-09-21T05:45:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.053+0000 7f6db9546640 1 -- 172.21.15.7:0/2256910206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db41024e0 con 0x7f6db41020d0 2024-09-21T05:45:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.056+0000 7f6d9bfff640 1 -- 172.21.15.7:0/2256910206 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f6da4018d00 con 0x7f6db41020d0 2024-09-21T05:45:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.056+0000 7f6d9bfff640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6d9c0b64d0 0x7f6d9c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.056+0000 7f6db27fc640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6d9c0b64d0 0x7f6d9c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.056+0000 7f6d9bfff640 1 -- 172.21.15.7:0/2256910206 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6da40e6280 con 0x7f6db41020d0 2024-09-21T05:45:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.057+0000 7f6db27fc640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6d9c0b64d0 0x7f6d9c0b89e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6da8000c00 tx=0x7f6da8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.059+0000 7f6d9bfff640 1 -- 172.21.15.7:0/2256910206 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6da40ae710 con 0x7f6db41020d0 2024-09-21T05:45:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.258+0000 7f6db9546640 1 -- 172.21.15.7:0/2256910206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f6db402e640 con 0x7f6db41020d0 2024-09-21T05:45:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.262+0000 7f6d9bfff640 1 -- 172.21.15.7:0/2256910206 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7f6da40b2af0 con 0x7f6db41020d0 2024-09-21T05:45:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.264+0000 7f6db9546640 1 -- 172.21.15.7:0/2256910206 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6d9c0b64d0 msgr2=0x7f6d9c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.264+0000 7f6db9546640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6d9c0b64d0 0x7f6d9c0b89e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6da8000c00 tx=0x7f6da8031400 comp rx=0 tx=0).stop 2024-09-21T05:45:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.264+0000 7f6db9546640 1 -- 172.21.15.7:0/2256910206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db41020d0 msgr2=0x7f6db4103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.264+0000 7f6db9546640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db41020d0 0x7f6db4103070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6da400ebc0 tx=0x7f6da400c6a0 comp rx=0 tx=0).stop 2024-09-21T05:45:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.264+0000 7f6db9546640 1 -- 172.21.15.7:0/2256910206 shutdown_connections 2024-09-21T05:45:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.264+0000 7f6db9546640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6d9c0b64d0 0x7f6d9c0b89e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.264+0000 7f6db9546640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6db4106c10 0x7f6db4103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.264+0000 7f6db9546640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db41062c0 0x7f6db41035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.264+0000 7f6db9546640 1 --2- 172.21.15.7:0/2256910206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db41020d0 0x7f6db4103070 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.265+0000 7f6db9546640 1 -- 172.21.15.7:0/2256910206 >> 172.21.15.7:0/2256910206 conn(0x7f6db4079e30 msgr2=0x7f6db4107630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.265+0000 7f6db9546640 1 -- 172.21.15.7:0/2256910206 shutdown_connections 2024-09-21T05:45:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:38.265+0000 7f6db9546640 1 -- 172.21.15.7:0/2256910206 wait complete. 2024-09-21T05:45:39.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:39 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2256910206' entity='client.admin' 2024-09-21T05:45:39.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:39 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2256910206' entity='client.admin' 2024-09-21T05:45:39.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:39 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2256910206' entity='client.admin' 2024-09-21T05:45:40.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.471+0000 7f9eaedf7640 1 -- 172.21.15.7:0/300316177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea81083a0 msgr2=0x7f9ea81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:40.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.471+0000 7f9eaedf7640 1 --2- 172.21.15.7:0/300316177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea81083a0 0x7f9ea81087b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009900 tx=0x7f9e9402a3f0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.471+0000 7f9eaedf7640 1 -- 172.21.15.7:0/300316177 shutdown_connections 2024-09-21T05:45:40.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.471+0000 7f9eaedf7640 1 --2- 172.21.15.7:0/300316177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea81083a0 0x7f9ea81087b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.471+0000 7f9eaedf7640 1 --2- 172.21.15.7:0/300316177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ea8108cf0 0x7f9ea810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.471+0000 7f9eaedf7640 1 --2- 172.21.15.7:0/300316177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea8102a60 0x7f9ea8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.471+0000 7f9eaedf7640 1 -- 172.21.15.7:0/300316177 >> 172.21.15.7:0/300316177 conn(0x7f9ea8079730 msgr2=0x7f9ea8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:40.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.471+0000 7f9eaedf7640 1 -- 172.21.15.7:0/300316177 shutdown_connections 2024-09-21T05:45:40.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.471+0000 7f9eaedf7640 1 -- 172.21.15.7:0/300316177 wait complete. 2024-09-21T05:45:40.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.472+0000 7f9eaedf7640 1 Processor -- start 2024-09-21T05:45:40.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.472+0000 7f9eaedf7640 1 -- start start 2024-09-21T05:45:40.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.472+0000 7f9eaedf7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ea8102a60 0x7f9ea819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:40.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.472+0000 7f9eaedf7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea81083a0 0x7f9ea819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.472+0000 7f9eaedf7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8108cf0 0x7f9ea819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.472+0000 7f9eaedf7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea8113a80 con 0x7f9ea8108cf0 2024-09-21T05:45:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.472+0000 7f9eaedf7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea8113900 con 0x7f9ea81083a0 2024-09-21T05:45:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.472+0000 7f9eaedf7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea8113c00 con 0x7f9ea8102a60 2024-09-21T05:45:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.472+0000 7f9ead394640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8108cf0 0x7f9ea819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.472+0000 7f9ead394640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8108cf0 0x7f9ea819fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47226/0 (socket says 172.21.15.7:47226) 2024-09-21T05:45:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.472+0000 7f9ead394640 1 -- 172.21.15.7:0/367767284 learned_addr learned my addr 172.21.15.7:0/367767284 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.472+0000 7f9eacb93640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ea8102a60 0x7f9ea819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.472+0000 7f9ea7fff640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea81083a0 0x7f9ea819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.473+0000 7f9ead394640 1 -- 172.21.15.7:0/367767284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ea8102a60 msgr2=0x7f9ea819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.473+0000 7f9ead394640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ea8102a60 0x7f9ea819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.473+0000 7f9ead394640 1 -- 172.21.15.7:0/367767284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea81083a0 msgr2=0x7f9ea819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.473+0000 7f9ead394640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea81083a0 0x7f9ea819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.473+0000 7f9ead394640 1 -- 172.21.15.7:0/367767284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea81a0320 con 0x7f9ea8108cf0 2024-09-21T05:45:40.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.473+0000 7f9ead394640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8108cf0 0x7f9ea819fcb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000cce0 tx=0x7f9ea000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:40.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.473+0000 7f9ea5ffb640 1 -- 172.21.15.7:0/367767284 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000f450 con 0x7f9ea8108cf0 2024-09-21T05:45:40.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.473+0000 7f9ea5ffb640 1 -- 172.21.15.7:0/367767284 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ea000faa0 con 0x7f9ea8108cf0 2024-09-21T05:45:40.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.473+0000 7f9eaedf7640 1 -- 172.21.15.7:0/367767284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea81a0610 con 0x7f9ea8108cf0 2024-09-21T05:45:40.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.473+0000 7f9ea5ffb640 1 -- 172.21.15.7:0/367767284 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0018b70 con 0x7f9ea8108cf0 2024-09-21T05:45:40.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.473+0000 7f9eaedf7640 1 -- 172.21.15.7:0/367767284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea81a0ad0 con 0x7f9ea8108cf0 2024-09-21T05:45:40.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.474+0000 7f9eaedf7640 1 -- 172.21.15.7:0/367767284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea8102e70 con 0x7f9ea8108cf0 2024-09-21T05:45:40.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.475+0000 7f9ea5ffb640 1 -- 172.21.15.7:0/367767284 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f9ea0018d10 con 0x7f9ea8108cf0 2024-09-21T05:45:40.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.476+0000 7f9ea5ffb640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e980b6500 0x7f9e980b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:40.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.476+0000 7f9eacb93640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e980b6500 0x7f9e980b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:40.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.476+0000 7f9ea5ffb640 1 -- 172.21.15.7:0/367767284 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9ea00e5c30 con 0x7f9ea8108cf0 2024-09-21T05:45:40.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.477+0000 7f9eacb93640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e980b6500 0x7f9e980b8a10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0058c0 tx=0x7f9e9c00a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:40.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.481+0000 7f9ea5ffb640 1 -- 172.21.15.7:0/367767284 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ea0014030 con 0x7f9ea8108cf0 2024-09-21T05:45:40.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.658+0000 7f0d6a960640 1 -- 172.21.15.7:0/4004345555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d64109500 msgr2=0x7f0d64109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:40.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.658+0000 7f0d6a960640 1 --2- 172.21.15.7:0/4004345555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d64109500 0x7f0d64109910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009900 tx=0x7f0d5802a410 comp rx=0 tx=0).stop 2024-09-21T05:45:40.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.658+0000 7f0d6a960640 1 -- 172.21.15.7:0/4004345555 shutdown_connections 2024-09-21T05:45:40.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.658+0000 7f0d6a960640 1 --2- 172.21.15.7:0/4004345555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d64109500 0x7f0d64109910 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.658+0000 7f0d6a960640 1 --2- 172.21.15.7:0/4004345555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d64109e50 0x7f0d64110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.658+0000 7f0d6a960640 1 --2- 172.21.15.7:0/4004345555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d64101fc0 0x7f0d641023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.658+0000 7f0d6a960640 1 -- 172.21.15.7:0/4004345555 >> 172.21.15.7:0/4004345555 conn(0x7f0d64079f90 msgr2=0x7f0d6407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:40.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.658+0000 7f0d6a960640 1 -- 172.21.15.7:0/4004345555 shutdown_connections 2024-09-21T05:45:40.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.658+0000 7f0d6a960640 1 -- 172.21.15.7:0/4004345555 wait complete. 2024-09-21T05:45:40.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.659+0000 7f0d6a960640 1 Processor -- start 2024-09-21T05:45:40.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.659+0000 7f0d6a960640 1 -- start start 2024-09-21T05:45:40.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d6a960640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d64101fc0 0x7f0d6419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:40.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d6a960640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d64109500 0x7f0d6419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:40.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d6a960640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d64109e50 0x7f0d6419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:40.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d6a960640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64113b60 con 0x7f0d64101fc0 2024-09-21T05:45:40.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d6a960640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641139e0 con 0x7f0d64109500 2024-09-21T05:45:40.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d6a960640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64113ce0 con 0x7f0d64109e50 2024-09-21T05:45:40.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d63fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d64101fc0 0x7f0d6419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d63fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d64101fc0 0x7f0d6419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47246/0 (socket says 172.21.15.7:47246) 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d63fff640 1 -- 172.21.15.7:0/4293266876 learned_addr learned my addr 172.21.15.7:0/4293266876 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d68efd640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d64109e50 0x7f0d6419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d63fff640 1 -- 172.21.15.7:0/4293266876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d64109e50 msgr2=0x7f0d6419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d637fe640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d64109500 0x7f0d6419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d63fff640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d64109e50 0x7f0d6419fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d63fff640 1 -- 172.21.15.7:0/4293266876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d64109500 msgr2=0x7f0d6419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d63fff640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d64109500 0x7f0d6419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d63fff640 1 -- 172.21.15.7:0/4293266876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d641a0500 con 0x7f0d64101fc0 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.660+0000 7f0d68efd640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d64109e50 0x7f0d6419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.661+0000 7f0d63fff640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d64101fc0 0x7f0d6419a590 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400e9f0 tx=0x7f0d5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.661+0000 7f0d617fa640 1 -- 172.21.15.7:0/4293266876 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5400cd80 con 0x7f0d64101fc0 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.661+0000 7f0d617fa640 1 -- 172.21.15.7:0/4293266876 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d540108e0 con 0x7f0d64101fc0 2024-09-21T05:45:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.661+0000 7f0d617fa640 1 -- 172.21.15.7:0/4293266876 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54018980 con 0x7f0d64101fc0 2024-09-21T05:45:40.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.661+0000 7f0d6a960640 1 -- 172.21.15.7:0/4293266876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d641a07f0 con 0x7f0d64101fc0 2024-09-21T05:45:40.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.661+0000 7f0d6a960640 1 -- 172.21.15.7:0/4293266876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d641a6f50 con 0x7f0d64101fc0 2024-09-21T05:45:40.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.662+0000 7f0d6a960640 1 -- 172.21.15.7:0/4293266876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d641023d0 con 0x7f0d64101fc0 2024-09-21T05:45:40.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.664+0000 7f0d617fa640 1 -- 172.21.15.7:0/4293266876 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f0d54010430 con 0x7f0d64101fc0 2024-09-21T05:45:40.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.664+0000 7f0d617fa640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d4c0b6550 0x7f0d4c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:40.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.665+0000 7f0d637fe640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d4c0b6550 0x7f0d4c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:40.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.665+0000 7f0d617fa640 1 -- 172.21.15.7:0/4293266876 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0d540e5fc0 con 0x7f0d64101fc0 2024-09-21T05:45:40.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.665+0000 7f0d637fe640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d4c0b6550 0x7f0d4c0b8a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0d6407a8c0 tx=0x7f0d58005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:40.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.668+0000 7f0d617fa640 1 -- 172.21.15.7:0/4293266876 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d540ae450 con 0x7f0d64101fc0 2024-09-21T05:45:40.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.690+0000 7f9eaedf7640 1 -- 172.21.15.7:0/367767284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f9ea810aac0 con 0x7f9ea8108cf0 2024-09-21T05:45:40.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.694+0000 7f9ea5ffb640 1 -- 172.21.15.7:0/367767284 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v26)=0 v26) ==== 129+0+0 (secure 0 0 0) 0x7f9ea00ae0c0 con 0x7f9ea8108cf0 2024-09-21T05:45:40.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.698+0000 7f9eaedf7640 1 -- 172.21.15.7:0/367767284 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e980b6500 msgr2=0x7f9e980b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:40.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.698+0000 7f9eaedf7640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e980b6500 0x7f9e980b8a10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0058c0 tx=0x7f9e9c00a4c0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.698+0000 7f9eaedf7640 1 -- 172.21.15.7:0/367767284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8108cf0 msgr2=0x7f9ea819fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:40.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.698+0000 7f9eaedf7640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8108cf0 0x7f9ea819fcb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000cce0 tx=0x7f9ea000a620 comp rx=0 tx=0).stop 2024-09-21T05:45:40.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.698+0000 7f9eaedf7640 1 -- 172.21.15.7:0/367767284 shutdown_connections 2024-09-21T05:45:40.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.698+0000 7f9eaedf7640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e980b6500 0x7f9e980b8a10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.698+0000 7f9eaedf7640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8108cf0 0x7f9ea819fcb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.698+0000 7f9eaedf7640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea81083a0 0x7f9ea819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.698+0000 7f9eaedf7640 1 --2- 172.21.15.7:0/367767284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ea8102a60 0x7f9ea819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.698+0000 7f9eaedf7640 1 -- 172.21.15.7:0/367767284 >> 172.21.15.7:0/367767284 conn(0x7f9ea8079730 msgr2=0x7f9ea8104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:40.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.698+0000 7f9eaedf7640 1 -- 172.21.15.7:0/367767284 shutdown_connections 2024-09-21T05:45:40.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.698+0000 7f9eaedf7640 1 -- 172.21.15.7:0/367767284 wait complete. 2024-09-21T05:45:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.867+0000 7f36ed01a640 1 -- 172.21.15.7:0/3452666430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36e81049f0 msgr2=0x7f36e8104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.867+0000 7f36ed01a640 1 --2- 172.21.15.7:0/3452666430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36e81049f0 0x7f36e8104e00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009900 tx=0x7f36d802a410 comp rx=0 tx=0).stop 2024-09-21T05:45:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.867+0000 7f36ed01a640 1 -- 172.21.15.7:0/3452666430 shutdown_connections 2024-09-21T05:45:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.867+0000 7f36ed01a640 1 --2- 172.21.15.7:0/3452666430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36e810de50 0x7f36e8110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.867+0000 7f36ed01a640 1 --2- 172.21.15.7:0/3452666430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36e8105340 0x7f36e810d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.867+0000 7f36ed01a640 1 --2- 172.21.15.7:0/3452666430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36e81049f0 0x7f36e8104e00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.867+0000 7f36ed01a640 1 -- 172.21.15.7:0/3452666430 >> 172.21.15.7:0/3452666430 conn(0x7f36e80797e0 msgr2=0x7f36e8079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.867+0000 7f36ed01a640 1 -- 172.21.15.7:0/3452666430 shutdown_connections 2024-09-21T05:45:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.867+0000 7f36ed01a640 1 -- 172.21.15.7:0/3452666430 wait complete. 2024-09-21T05:45:40.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.868+0000 7f36ed01a640 1 Processor -- start 2024-09-21T05:45:40.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.868+0000 7f36ed01a640 1 -- start start 2024-09-21T05:45:40.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36ed01a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36e81049f0 0x7f36e819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:40.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36ed01a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36e8105340 0x7f36e819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:40.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36ed01a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36e810de50 0x7f36e819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:40.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36ed01a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36e8113b20 con 0x7f36e81049f0 2024-09-21T05:45:40.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36ed01a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f36e81139a0 con 0x7f36e810de50 2024-09-21T05:45:40.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36ed01a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f36e8113ca0 con 0x7f36e8105340 2024-09-21T05:45:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36e6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36e81049f0 0x7f36e819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36e6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36e81049f0 0x7f36e819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47260/0 (socket says 172.21.15.7:47260) 2024-09-21T05:45:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36e6d9d640 1 -- 172.21.15.7:0/39803677 learned_addr learned my addr 172.21.15.7:0/39803677 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36e759e640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36e810de50 0x7f36e819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36e659c640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36e8105340 0x7f36e819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36e6d9d640 1 -- 172.21.15.7:0/39803677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36e8105340 msgr2=0x7f36e819aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36e6d9d640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36e8105340 0x7f36e819aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36e6d9d640 1 -- 172.21.15.7:0/39803677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36e810de50 msgr2=0x7f36e819fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36e6d9d640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36e810de50 0x7f36e819fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.869+0000 7f36e6d9d640 1 -- 172.21.15.7:0/39803677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e81a0460 con 0x7f36e81049f0 2024-09-21T05:45:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.870+0000 7f36e6d9d640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36e81049f0 0x7f36e819a4f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f36d8005ab0 tx=0x7f36d8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.870+0000 7f36cffff640 1 -- 172.21.15.7:0/39803677 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d803f070 con 0x7f36e81049f0 2024-09-21T05:45:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.870+0000 7f36cffff640 1 -- 172.21.15.7:0/39803677 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36d8031d60 con 0x7f36e81049f0 2024-09-21T05:45:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.870+0000 7f36cffff640 1 -- 172.21.15.7:0/39803677 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d8035030 con 0x7f36e81049f0 2024-09-21T05:45:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.870+0000 7f36ed01a640 1 -- 172.21.15.7:0/39803677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e81a06f0 con 0x7f36e81049f0 2024-09-21T05:45:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.870+0000 7f36ed01a640 1 -- 172.21.15.7:0/39803677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e81a6eb0 con 0x7f36e81049f0 2024-09-21T05:45:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.871+0000 7f36ed01a640 1 -- 172.21.15.7:0/39803677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e806bf20 con 0x7f36e81049f0 2024-09-21T05:45:40.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.873+0000 7f36cffff640 1 -- 172.21.15.7:0/39803677 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f36d8042070 con 0x7f36e81049f0 2024-09-21T05:45:40.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.874+0000 7f36cffff640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f36d00b64d0 0x7f36d00b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:40.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.874+0000 7f36e659c640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f36d00b64d0 0x7f36d00b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:40.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.874+0000 7f36cffff640 1 -- 172.21.15.7:0/39803677 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f36d8106610 con 0x7f36e81049f0 2024-09-21T05:45:40.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.874+0000 7f36e659c640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f36d00b64d0 0x7f36d00b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f36dc005fd0 tx=0x7f36dc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:40.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.877+0000 7f36cffff640 1 -- 172.21.15.7:0/39803677 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36d80ceaa0 con 0x7f36e81049f0 2024-09-21T05:45:40.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.887+0000 7f0d6a960640 1 -- 172.21.15.7:0/4293266876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f0d6419b6c0 con 0x7f0d64101fc0 2024-09-21T05:45:40.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.893+0000 7f0d617fa640 1 -- 172.21.15.7:0/4293266876 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v27)=0 v27) ==== 116+0+0 (secure 0 0 0) 0x7f0d540b2830 con 0x7f0d64101fc0 2024-09-21T05:45:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.895+0000 7f0d6a960640 1 -- 172.21.15.7:0/4293266876 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d4c0b6550 msgr2=0x7f0d4c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.895+0000 7f0d6a960640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d4c0b6550 0x7f0d4c0b8a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0d6407a8c0 tx=0x7f0d58005fd0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.895+0000 7f0d6a960640 1 -- 172.21.15.7:0/4293266876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d64101fc0 msgr2=0x7f0d6419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.895+0000 7f0d6a960640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d64101fc0 0x7f0d6419a590 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400e9f0 tx=0x7f0d5400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.895+0000 7f0d6a960640 1 -- 172.21.15.7:0/4293266876 shutdown_connections 2024-09-21T05:45:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.895+0000 7f0d6a960640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d4c0b6550 0x7f0d4c0b8a60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.895+0000 7f0d6a960640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d64109e50 0x7f0d6419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.895+0000 7f0d6a960640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d64109500 0x7f0d6419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.895+0000 7f0d6a960640 1 --2- 172.21.15.7:0/4293266876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d64101fc0 0x7f0d6419a590 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.895+0000 7f0d6a960640 1 -- 172.21.15.7:0/4293266876 >> 172.21.15.7:0/4293266876 conn(0x7f0d64079f90 msgr2=0x7f0d641075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.895+0000 7f0d6a960640 1 -- 172.21.15.7:0/4293266876 shutdown_connections 2024-09-21T05:45:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:40.895+0000 7f0d6a960640 1 -- 172.21.15.7:0/4293266876 wait complete. 2024-09-21T05:45:40.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:40 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3981512621' entity='client.admin' 2024-09-21T05:45:40.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:40 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/367767284' entity='client.admin' 2024-09-21T05:45:41.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.076+0000 7f36ed01a640 1 -- 172.21.15.7:0/39803677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f36e8104e00 con 0x7f36e81049f0 2024-09-21T05:45:41.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.081+0000 7f36cffff640 1 -- 172.21.15.7:0/39803677 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v28)=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f36e8104e00 con 0x7f36e81049f0 2024-09-21T05:45:41.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.083+0000 7f36ed01a640 1 -- 172.21.15.7:0/39803677 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f36d00b64d0 msgr2=0x7f36d00b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.083+0000 7f36ed01a640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f36d00b64d0 0x7f36d00b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f36dc005fd0 tx=0x7f36dc005850 comp rx=0 tx=0).stop 2024-09-21T05:45:41.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.083+0000 7f36ed01a640 1 -- 172.21.15.7:0/39803677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36e81049f0 msgr2=0x7f36e819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.083+0000 7f36ed01a640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36e81049f0 0x7f36e819a4f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f36d8005ab0 tx=0x7f36d8003cd0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.084+0000 7f36ed01a640 1 -- 172.21.15.7:0/39803677 shutdown_connections 2024-09-21T05:45:41.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.084+0000 7f36ed01a640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f36d00b64d0 0x7f36d00b89e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.084+0000 7f36ed01a640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36e810de50 0x7f36e819fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.084+0000 7f36ed01a640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36e8105340 0x7f36e819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.084+0000 7f36ed01a640 1 --2- 172.21.15.7:0/39803677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36e81049f0 0x7f36e819a4f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.084+0000 7f36ed01a640 1 -- 172.21.15.7:0/39803677 >> 172.21.15.7:0/39803677 conn(0x7f36e80797e0 msgr2=0x7f36e80ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:41.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.084+0000 7f36ed01a640 1 -- 172.21.15.7:0/39803677 shutdown_connections 2024-09-21T05:45:41.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.084+0000 7f36ed01a640 1 -- 172.21.15.7:0/39803677 wait complete. 2024-09-21T05:45:41.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:40 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3981512621' entity='client.admin' 2024-09-21T05:45:41.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:40 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/367767284' entity='client.admin' 2024-09-21T05:45:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.090+0000 7f8d4148e640 1 -- 172.21.15.7:0/1196525933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c1083e0 msgr2=0x7f8d3c1087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.090+0000 7f8d4148e640 1 --2- 172.21.15.7:0/1196525933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c1083e0 0x7f8d3c1087f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009900 tx=0x7f8d2402a410 comp rx=0 tx=0).stop 2024-09-21T05:45:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.090+0000 7f8d4148e640 1 -- 172.21.15.7:0/1196525933 shutdown_connections 2024-09-21T05:45:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.090+0000 7f8d4148e640 1 --2- 172.21.15.7:0/1196525933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c1083e0 0x7f8d3c1087f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.090+0000 7f8d4148e640 1 --2- 172.21.15.7:0/1196525933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3c108d30 0x7f8d3c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.090+0000 7f8d4148e640 1 --2- 172.21.15.7:0/1196525933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d3c102aa0 0x7f8d3c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.090+0000 7f8d4148e640 1 -- 172.21.15.7:0/1196525933 >> 172.21.15.7:0/1196525933 conn(0x7f8d3c0797e0 msgr2=0x7f8d3c079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.090+0000 7f8d4148e640 1 -- 172.21.15.7:0/1196525933 shutdown_connections 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.090+0000 7f8d4148e640 1 -- 172.21.15.7:0/1196525933 wait complete. 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.090+0000 7f8d4148e640 1 Processor -- start 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d4148e640 1 -- start start 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d4148e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3c102aa0 0x7f8d3c19b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d4148e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c1083e0 0x7f8d3c19b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d4148e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d3c108d30 0x7f8d3c19be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d4148e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c1129f0 con 0x7f8d3c1083e0 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d4148e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c112870 con 0x7f8d3c102aa0 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d4148e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c112b70 con 0x7f8d3c108d30 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d3a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c1083e0 0x7f8d3c19b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d3a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c1083e0 0x7f8d3c19b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47282/0 (socket says 172.21.15.7:47282) 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d3a7fc640 1 -- 172.21.15.7:0/684467130 learned_addr learned my addr 172.21.15.7:0/684467130 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d3affd640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3c102aa0 0x7f8d3c19b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d3b7fe640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d3c108d30 0x7f8d3c19be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d3a7fc640 1 -- 172.21.15.7:0/684467130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d3c108d30 msgr2=0x7f8d3c19be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d3a7fc640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d3c108d30 0x7f8d3c19be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d3a7fc640 1 -- 172.21.15.7:0/684467130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3c102aa0 msgr2=0x7f8d3c19b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d3a7fc640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3c102aa0 0x7f8d3c19b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.091+0000 7f8d3a7fc640 1 -- 172.21.15.7:0/684467130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3c1a6660 con 0x7f8d3c1083e0 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.092+0000 7f8d3b7fe640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d3c108d30 0x7f8d3c19be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.092+0000 7f8d3a7fc640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c1083e0 0x7f8d3c19b8e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8d24005ab0 tx=0x7f8d24003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.092+0000 7f8d33fff640 1 -- 172.21.15.7:0/684467130 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2403f070 con 0x7f8d3c1083e0 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.092+0000 7f8d4148e640 1 -- 172.21.15.7:0/684467130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3c1a68f0 con 0x7f8d3c1083e0 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.092+0000 7f8d33fff640 1 -- 172.21.15.7:0/684467130 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d24031d60 con 0x7f8d3c1083e0 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.092+0000 7f8d33fff640 1 -- 172.21.15.7:0/684467130 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d24035030 con 0x7f8d3c1083e0 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.092+0000 7f8d4148e640 1 -- 172.21.15.7:0/684467130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3c1a6dd0 con 0x7f8d3c1083e0 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.093+0000 7f8d4148e640 1 -- 172.21.15.7:0/684467130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d3c102eb0 con 0x7f8d3c1083e0 2024-09-21T05:45:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.095+0000 7f8d33fff640 1 -- 172.21.15.7:0/684467130 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f8d24042070 con 0x7f8d3c1083e0 2024-09-21T05:45:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.096+0000 7f8d33fff640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d280b64d0 0x7f8d280b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.096+0000 7f8d3affd640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d280b64d0 0x7f8d280b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.096+0000 7f8d33fff640 1 -- 172.21.15.7:0/684467130 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8d24106670 con 0x7f8d3c1083e0 2024-09-21T05:45:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.097+0000 7f8d3affd640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d280b64d0 0x7f8d280b89e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c06c3a0 tx=0x7f8d2c009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:41.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.100+0000 7f8d33fff640 1 -- 172.21.15.7:0/684467130 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8d240ceb00 con 0x7f8d3c1083e0 2024-09-21T05:45:41.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:40 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3981512621' entity='client.admin' 2024-09-21T05:45:41.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:40 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/367767284' entity='client.admin' 2024-09-21T05:45:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.296+0000 7f8d4148e640 1 -- 172.21.15.7:0/684467130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f8d3c06bc50 con 0x7f8d3c1083e0 2024-09-21T05:45:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.300+0000 7f8d33fff640 1 -- 172.21.15.7:0/684467130 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7f8d3c06bc50 con 0x7f8d3c1083e0 2024-09-21T05:45:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.302+0000 7f8d4148e640 1 -- 172.21.15.7:0/684467130 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d280b64d0 msgr2=0x7f8d280b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.303+0000 7f8d4148e640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d280b64d0 0x7f8d280b89e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c06c3a0 tx=0x7f8d2c009680 comp rx=0 tx=0).stop 2024-09-21T05:45:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.303+0000 7f8d4148e640 1 -- 172.21.15.7:0/684467130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c1083e0 msgr2=0x7f8d3c19b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.303+0000 7f8d4148e640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c1083e0 0x7f8d3c19b8e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8d24005ab0 tx=0x7f8d24003cd0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.303+0000 7f8d4148e640 1 -- 172.21.15.7:0/684467130 shutdown_connections 2024-09-21T05:45:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.303+0000 7f8d4148e640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d280b64d0 0x7f8d280b89e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.303+0000 7f8d4148e640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c1083e0 0x7f8d3c19b8e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.303+0000 7f8d4148e640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d3c108d30 0x7f8d3c19be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.303+0000 7f8d4148e640 1 --2- 172.21.15.7:0/684467130 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3c102aa0 0x7f8d3c19b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.303+0000 7f8d4148e640 1 -- 172.21.15.7:0/684467130 >> 172.21.15.7:0/684467130 conn(0x7f8d3c0797e0 msgr2=0x7f8d3c104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.303+0000 7f8d4148e640 1 -- 172.21.15.7:0/684467130 shutdown_connections 2024-09-21T05:45:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.303+0000 7f8d4148e640 1 -- 172.21.15.7:0/684467130 wait complete. 2024-09-21T05:45:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.662+0000 7f22bfdb4640 1 -- 172.21.15.7:0/1860208672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b8103b80 msgr2=0x7f22b8103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.662+0000 7f22bfdb4640 1 --2- 172.21.15.7:0/1860208672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b8103b80 0x7f22b8103f90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009900 tx=0x7f22b002a410 comp rx=0 tx=0).stop 2024-09-21T05:45:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.662+0000 7f22bfdb4640 1 -- 172.21.15.7:0/1860208672 shutdown_connections 2024-09-21T05:45:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.662+0000 7f22bfdb4640 1 --2- 172.21.15.7:0/1860208672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b8109e10 0x7f22b8110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.662+0000 7f22bfdb4640 1 --2- 172.21.15.7:0/1860208672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22b81094c0 0x7f22b81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.662+0000 7f22bfdb4640 1 --2- 172.21.15.7:0/1860208672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b8103b80 0x7f22b8103f90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.662+0000 7f22bfdb4640 1 -- 172.21.15.7:0/1860208672 >> 172.21.15.7:0/1860208672 conn(0x7f22b80ff610 msgr2=0x7f22b8101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.662+0000 7f22bfdb4640 1 -- 172.21.15.7:0/1860208672 shutdown_connections 2024-09-21T05:45:41.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.662+0000 7f22bfdb4640 1 -- 172.21.15.7:0/1860208672 wait complete. 2024-09-21T05:45:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.663+0000 7f22bfdb4640 1 Processor -- start 2024-09-21T05:45:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.663+0000 7f22bfdb4640 1 -- start start 2024-09-21T05:45:41.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.663+0000 7f22bfdb4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b8103b80 0x7f22b819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:41.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.663+0000 7f22bfdb4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22b81094c0 0x7f22b819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:41.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.663+0000 7f22bfdb4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b8109e10 0x7f22b819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:41.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.663+0000 7f22bfdb4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f22b8113b20 con 0x7f22b8109e10 2024-09-21T05:45:41.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.663+0000 7f22bfdb4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f22b81139a0 con 0x7f22b8103b80 2024-09-21T05:45:41.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.663+0000 7f22bfdb4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f22b8113ca0 con 0x7f22b81094c0 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.663+0000 7f22be351640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b8109e10 0x7f22b819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.663+0000 7f22be351640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b8109e10 0x7f22b819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47308/0 (socket says 172.21.15.7:47308) 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.663+0000 7f22be351640 1 -- 172.21.15.7:0/270723708 learned_addr learned my addr 172.21.15.7:0/270723708 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.664+0000 7f22bdb50640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b8103b80 0x7f22b819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.664+0000 7f22bd34f640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22b81094c0 0x7f22b819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.664+0000 7f22be351640 1 -- 172.21.15.7:0/270723708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22b81094c0 msgr2=0x7f22b819aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.664+0000 7f22be351640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22b81094c0 0x7f22b819aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.664+0000 7f22be351640 1 -- 172.21.15.7:0/270723708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b8103b80 msgr2=0x7f22b819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.664+0000 7f22be351640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b8103b80 0x7f22b819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.664+0000 7f22be351640 1 -- 172.21.15.7:0/270723708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b81a0460 con 0x7f22b8109e10 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.664+0000 7f22be351640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b8109e10 0x7f22b819fd30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009fd0 tx=0x7f22a800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.664+0000 7f22b6ffd640 1 -- 172.21.15.7:0/270723708 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a8017070 con 0x7f22b8109e10 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.664+0000 7f22b6ffd640 1 -- 172.21.15.7:0/270723708 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22a8003e20 con 0x7f22b8109e10 2024-09-21T05:45:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.664+0000 7f22b6ffd640 1 -- 172.21.15.7:0/270723708 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a8010460 con 0x7f22b8109e10 2024-09-21T05:45:41.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.664+0000 7f22bfdb4640 1 -- 172.21.15.7:0/270723708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b81a0750 con 0x7f22b8109e10 2024-09-21T05:45:41.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.664+0000 7f22bfdb4640 1 -- 172.21.15.7:0/270723708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b81a6eb0 con 0x7f22b8109e10 2024-09-21T05:45:41.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.666+0000 7f22bfdb4640 1 -- 172.21.15.7:0/270723708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b8104e00 con 0x7f22b8109e10 2024-09-21T05:45:41.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.667+0000 7f22b6ffd640 1 -- 172.21.15.7:0/270723708 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f22a8003970 con 0x7f22b8109e10 2024-09-21T05:45:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.668+0000 7f22b6ffd640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22a00b6550 0x7f22a00b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.668+0000 7f22bdb50640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22a00b6550 0x7f22a00b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.668+0000 7f22b6ffd640 1 -- 172.21.15.7:0/270723708 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f22a80e53b0 con 0x7f22b8109e10 2024-09-21T05:45:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.669+0000 7f22bdb50640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22a00b6550 0x7f22a00b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22b0005ab0 tx=0x7f22b0005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.671+0000 7f22b6ffd640 1 -- 172.21.15.7:0/270723708 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22a80b1ca0 con 0x7f22b8109e10 2024-09-21T05:45:41.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.603+0000 7fc55c076640 1 -- 172.21.15.7:0/2570474931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554104920 msgr2=0x7fc554104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.603+0000 7fc55c076640 1 --2- 172.21.15.7:0/2570474931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554104920 0x7fc554104d30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009900 tx=0x7fc54c02a410 comp rx=0 tx=0).stop 2024-09-21T05:45:41.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.603+0000 7fc55c076640 1 -- 172.21.15.7:0/2570474931 shutdown_connections 2024-09-21T05:45:41.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.603+0000 7fc55c076640 1 --2- 172.21.15.7:0/2570474931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc55410ded0 0x7fc554110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.603+0000 7fc55c076640 1 --2- 172.21.15.7:0/2570474931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc554105270 0x7fc55410d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.603+0000 7fc55c076640 1 --2- 172.21.15.7:0/2570474931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554104920 0x7fc554104d30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.603+0000 7fc55c076640 1 -- 172.21.15.7:0/2570474931 >> 172.21.15.7:0/2570474931 conn(0x7fc5540797b0 msgr2=0x7fc554079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:41.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.603+0000 7fc55c076640 1 -- 172.21.15.7:0/2570474931 shutdown_connections 2024-09-21T05:45:41.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.603+0000 7fc55c076640 1 -- 172.21.15.7:0/2570474931 wait complete. 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc55c076640 1 Processor -- start 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc55c076640 1 -- start start 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc55c076640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554104920 0x7fc55419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc55c076640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc554105270 0x7fc55419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc55c076640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc55410ded0 0x7fc55419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc55c076640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc554113b70 con 0x7fc554104920 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc55c076640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc5541139f0 con 0x7fc554105270 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc55c076640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc554113cf0 con 0x7fc55410ded0 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc559e12640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554104920 0x7fc55419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc559e12640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554104920 0x7fc55419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47200/0 (socket says 172.21.15.7:47200) 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc559e12640 1 -- 172.21.15.7:0/3981512621 learned_addr learned my addr 172.21.15.7:0/3981512621 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc559611640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc554105270 0x7fc55419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc55a613640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc55410ded0 0x7fc55419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc559e12640 1 -- 172.21.15.7:0/3981512621 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc55410ded0 msgr2=0x7fc55419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc559e12640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc55410ded0 0x7fc55419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc559e12640 1 -- 172.21.15.7:0/3981512621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc554105270 msgr2=0x7fc55419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc559e12640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc554105270 0x7fc55419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc559e12640 1 -- 172.21.15.7:0/3981512621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5541a0470 con 0x7fc554104920 2024-09-21T05:45:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.604+0000 7fc55a613640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc55410ded0 0x7fc55419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:45:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.605+0000 7fc559e12640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554104920 0x7fc55419a500 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc54c005ab0 tx=0x7fc54c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.605+0000 7fc552ffd640 1 -- 172.21.15.7:0/3981512621 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c03f070 con 0x7fc554104920 2024-09-21T05:45:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.605+0000 7fc55c076640 1 -- 172.21.15.7:0/3981512621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5541a0700 con 0x7fc554104920 2024-09-21T05:45:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.605+0000 7fc552ffd640 1 -- 172.21.15.7:0/3981512621 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc54c031d60 con 0x7fc554104920 2024-09-21T05:45:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.605+0000 7fc552ffd640 1 -- 172.21.15.7:0/3981512621 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c035030 con 0x7fc554104920 2024-09-21T05:45:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.605+0000 7fc55c076640 1 -- 172.21.15.7:0/3981512621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5541a6ec0 con 0x7fc554104920 2024-09-21T05:45:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.606+0000 7fc55c076640 1 -- 172.21.15.7:0/3981512621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc554104d30 con 0x7fc554104920 2024-09-21T05:45:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.608+0000 7fc552ffd640 1 -- 172.21.15.7:0/3981512621 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fc54c042070 con 0x7fc554104920 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.608+0000 7fc552ffd640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc53c0b64d0 0x7fc53c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.608+0000 7fc559611640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc53c0b64d0 0x7fc53c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.609+0000 7fc552ffd640 1 -- 172.21.15.7:0/3981512621 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc54c1065c0 con 0x7fc554104920 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.609+0000 7fc559611640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc53c0b64d0 0x7fc53c0b89e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc5541000a0 tx=0x7fc548009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.611+0000 7fc552ffd640 1 -- 172.21.15.7:0/3981512621 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc54c0cea50 con 0x7fc554104920 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.808+0000 7fc55c076640 1 -- 172.21.15.7:0/3981512621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fc5541a7160 con 0x7fc554104920 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.812+0000 7fc552ffd640 1 -- 172.21.15.7:0/3981512621 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v25)=0 v25) ==== 119+0+0 (secure 0 0 0) 0x7fc54c0d7030 con 0x7fc554104920 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.815+0000 7fc55c076640 1 -- 172.21.15.7:0/3981512621 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc53c0b64d0 msgr2=0x7fc53c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.815+0000 7fc55c076640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc53c0b64d0 0x7fc53c0b89e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc5541000a0 tx=0x7fc548009680 comp rx=0 tx=0).stop 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.815+0000 7fc55c076640 1 -- 172.21.15.7:0/3981512621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554104920 msgr2=0x7fc55419a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.815+0000 7fc55c076640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554104920 0x7fc55419a500 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc54c005ab0 tx=0x7fc54c003cd0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.815+0000 7fc55c076640 1 -- 172.21.15.7:0/3981512621 shutdown_connections 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.815+0000 7fc55c076640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc53c0b64d0 0x7fc53c0b89e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.815+0000 7fc55c076640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc55410ded0 0x7fc55419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.815+0000 7fc55c076640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc554105270 0x7fc55419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.815+0000 7fc55c076640 1 --2- 172.21.15.7:0/3981512621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc554104920 0x7fc55419a500 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.815+0000 7fc55c076640 1 -- 172.21.15.7:0/3981512621 >> 172.21.15.7:0/3981512621 conn(0x7fc5540797b0 msgr2=0x7fc5541079c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:41.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.815+0000 7fc55c076640 1 -- 172.21.15.7:0/3981512621 shutdown_connections 2024-09-21T05:45:41.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:39.815+0000 7fc55c076640 1 -- 172.21.15.7:0/3981512621 wait complete. 2024-09-21T05:45:41.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.862+0000 7f22bfdb4640 1 -- 172.21.15.7:0/270723708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f22b810bc10 con 0x7f22b8109e10 2024-09-21T05:45:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.866+0000 7f22b6ffd640 1 -- 172.21.15.7:0/270723708 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v30)=0 v30) ==== 115+0+0 (secure 0 0 0) 0x7f22a80b6be0 con 0x7f22b8109e10 2024-09-21T05:45:41.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.868+0000 7f22bfdb4640 1 -- 172.21.15.7:0/270723708 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22a00b6550 msgr2=0x7f22a00b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.868+0000 7f22bfdb4640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22a00b6550 0x7f22a00b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22b0005ab0 tx=0x7f22b0005a20 comp rx=0 tx=0).stop 2024-09-21T05:45:41.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.868+0000 7f22bfdb4640 1 -- 172.21.15.7:0/270723708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b8109e10 msgr2=0x7f22b819fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:41.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.868+0000 7f22bfdb4640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b8109e10 0x7f22b819fd30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009fd0 tx=0x7f22a800b260 comp rx=0 tx=0).stop 2024-09-21T05:45:41.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.868+0000 7f22bfdb4640 1 -- 172.21.15.7:0/270723708 shutdown_connections 2024-09-21T05:45:41.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.868+0000 7f22bfdb4640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22a00b6550 0x7f22a00b8a60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.868+0000 7f22bfdb4640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22b8109e10 0x7f22b819fd30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.868+0000 7f22bfdb4640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22b81094c0 0x7f22b819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.868+0000 7f22bfdb4640 1 --2- 172.21.15.7:0/270723708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22b8103b80 0x7f22b819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:41.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.868+0000 7f22bfdb4640 1 -- 172.21.15.7:0/270723708 >> 172.21.15.7:0/270723708 conn(0x7f22b80ff610 msgr2=0x7f22b8108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:41.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.868+0000 7f22bfdb4640 1 -- 172.21.15.7:0/270723708 shutdown_connections 2024-09-21T05:45:41.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:41.868+0000 7f22bfdb4640 1 -- 172.21.15.7:0/270723708 wait complete. 2024-09-21T05:45:42.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:41 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/4293266876' entity='client.admin' 2024-09-21T05:45:42.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:41 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/39803677' entity='client.admin' 2024-09-21T05:45:42.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:41 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/684467130' entity='client.admin' 2024-09-21T05:45:42.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:41 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/270723708' entity='client.admin' 2024-09-21T05:45:42.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:41 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4293266876' entity='client.admin' 2024-09-21T05:45:42.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:41 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/39803677' entity='client.admin' 2024-09-21T05:45:42.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:41 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/684467130' entity='client.admin' 2024-09-21T05:45:42.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:41 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/270723708' entity='client.admin' 2024-09-21T05:45:42.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:41 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/4293266876' entity='client.admin' 2024-09-21T05:45:42.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:41 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/39803677' entity='client.admin' 2024-09-21T05:45:42.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:41 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/684467130' entity='client.admin' 2024-09-21T05:45:42.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:41 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/270723708' entity='client.admin' 2024-09-21T05:45:44.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:43 smithi007 ceph-mon[30983]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:44.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:43 smithi027 ceph-mon[34364]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:44.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:43 smithi119 ceph-mon[34833]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:45.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.641+0000 7fab92835640 1 -- 172.21.15.7:0/3781321932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab8c109e20 msgr2=0x7fab8c110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:45.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.641+0000 7fab92835640 1 --2- 172.21.15.7:0/3781321932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab8c109e20 0x7fab8c110650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fab84009ca0 tx=0x7fab8402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.641+0000 7fab92835640 1 -- 172.21.15.7:0/3781321932 shutdown_connections 2024-09-21T05:45:45.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.641+0000 7fab92835640 1 --2- 172.21.15.7:0/3781321932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab8c109e20 0x7fab8c110650 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.641+0000 7fab92835640 1 --2- 172.21.15.7:0/3781321932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c1094d0 0x7fab8c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.641+0000 7fab92835640 1 --2- 172.21.15.7:0/3781321932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab8c103b90 0x7fab8c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.641+0000 7fab92835640 1 -- 172.21.15.7:0/3781321932 >> 172.21.15.7:0/3781321932 conn(0x7fab8c0ff600 msgr2=0x7fab8c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.641+0000 7fab92835640 1 -- 172.21.15.7:0/3781321932 shutdown_connections 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.641+0000 7fab92835640 1 -- 172.21.15.7:0/3781321932 wait complete. 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.642+0000 7fab92835640 1 Processor -- start 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.642+0000 7fab92835640 1 -- start start 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.642+0000 7fab92835640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c103b90 0x7fab8c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.642+0000 7fab92835640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab8c1094d0 0x7fab8c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.642+0000 7fab92835640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab8c109e20 0x7fab8c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.642+0000 7fab92835640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c113b30 con 0x7fab8c1094d0 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.642+0000 7fab92835640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c1139b0 con 0x7fab8c109e20 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.642+0000 7fab92835640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c113cb0 con 0x7fab8c103b90 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.642+0000 7fab83fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab8c1094d0 0x7fab8c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.642+0000 7fab83fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab8c1094d0 0x7fab8c19a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47350/0 (socket says 172.21.15.7:47350) 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.642+0000 7fab83fff640 1 -- 172.21.15.7:0/1325527388 learned_addr learned my addr 172.21.15.7:0/1325527388 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.642+0000 7fab90dd2640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab8c109e20 0x7fab8c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.643+0000 7fab8bfff640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c103b90 0x7fab8c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.643+0000 7fab83fff640 1 -- 172.21.15.7:0/1325527388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c103b90 msgr2=0x7fab8c19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.643+0000 7fab83fff640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c103b90 0x7fab8c19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.643+0000 7fab83fff640 1 -- 172.21.15.7:0/1325527388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab8c109e20 msgr2=0x7fab8c19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.643+0000 7fab83fff640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab8c109e20 0x7fab8c19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.643+0000 7fab83fff640 1 -- 172.21.15.7:0/1325527388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c1a0390 con 0x7fab8c1094d0 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.643+0000 7fab83fff640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab8c1094d0 0x7fab8c19a9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab7400d750 tx=0x7fab7400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.643+0000 7fab89ffb640 1 -- 172.21.15.7:0/1325527388 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74017070 con 0x7fab8c1094d0 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.643+0000 7fab89ffb640 1 -- 172.21.15.7:0/1325527388 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab740054d0 con 0x7fab8c1094d0 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.643+0000 7fab89ffb640 1 -- 172.21.15.7:0/1325527388 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74004c30 con 0x7fab8c1094d0 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.643+0000 7fab92835640 1 -- 172.21.15.7:0/1325527388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c1a0680 con 0x7fab8c1094d0 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.643+0000 7fab92835640 1 -- 172.21.15.7:0/1325527388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c1a6de0 con 0x7fab8c1094d0 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.644+0000 7fab92835640 1 -- 172.21.15.7:0/1325527388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8c103fa0 con 0x7fab8c1094d0 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.647+0000 7fab89ffb640 1 -- 172.21.15.7:0/1325527388 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fab74004dd0 con 0x7fab8c1094d0 2024-09-21T05:45:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.647+0000 7fab89ffb640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab780b6550 0x7fab780b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.648+0000 7fab8bfff640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab780b6550 0x7fab780b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.648+0000 7fab89ffb640 1 -- 172.21.15.7:0/1325527388 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fab740e5400 con 0x7fab8c1094d0 2024-09-21T05:45:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.648+0000 7fab8bfff640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab780b6550 0x7fab780b8a60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab7c005d00 tx=0x7fab7c005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.651+0000 7fab89ffb640 1 -- 172.21.15.7:0/1325527388 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab740ad910 con 0x7fab8c1094d0 2024-09-21T05:45:45.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.835+0000 7f61bec98640 1 -- 172.21.15.7:0/1822866298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b81083a0 msgr2=0x7f61b81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:45.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.835+0000 7f61bec98640 1 --2- 172.21.15.7:0/1822866298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b81083a0 0x7f61b81087b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009900 tx=0x7f61ac02a410 comp rx=0 tx=0).stop 2024-09-21T05:45:45.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.835+0000 7f61bec98640 1 -- 172.21.15.7:0/1822866298 shutdown_connections 2024-09-21T05:45:45.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.835+0000 7f61bec98640 1 --2- 172.21.15.7:0/1822866298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b81083a0 0x7f61b81087b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.835+0000 7f61bec98640 1 --2- 172.21.15.7:0/1822866298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61b8108cf0 0x7f61b810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.835+0000 7f61bec98640 1 --2- 172.21.15.7:0/1822866298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b8102a60 0x7f61b8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.835+0000 7f61bec98640 1 -- 172.21.15.7:0/1822866298 >> 172.21.15.7:0/1822866298 conn(0x7f61b8079730 msgr2=0x7f61b8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:45.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.835+0000 7f61bec98640 1 -- 172.21.15.7:0/1822866298 shutdown_connections 2024-09-21T05:45:45.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.835+0000 7f61bec98640 1 -- 172.21.15.7:0/1822866298 wait complete. 2024-09-21T05:45:45.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.836+0000 7f61bec98640 1 Processor -- start 2024-09-21T05:45:45.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.836+0000 7f61bec98640 1 -- start start 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bec98640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b8102a60 0x7f61b819b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bec98640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61b81083a0 0x7f61b819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bec98640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b8108cf0 0x7f61b819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bec98640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f61b8112960 con 0x7f61b8102a60 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bec98640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f61b81127e0 con 0x7f61b81083a0 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bec98640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f61b8112ae0 con 0x7f61b8108cf0 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bca34640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b8102a60 0x7f61b819b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bca34640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b8102a60 0x7f61b819b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47370/0 (socket says 172.21.15.7:47370) 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bca34640 1 -- 172.21.15.7:0/1995624207 learned_addr learned my addr 172.21.15.7:0/1995624207 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61b7fff640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61b81083a0 0x7f61b819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bd235640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b8108cf0 0x7f61b819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bca34640 1 -- 172.21.15.7:0/1995624207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b8108cf0 msgr2=0x7f61b819bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bca34640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b8108cf0 0x7f61b819bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bca34640 1 -- 172.21.15.7:0/1995624207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61b81083a0 msgr2=0x7f61b819b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bca34640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61b81083a0 0x7f61b819b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.837+0000 7f61bca34640 1 -- 172.21.15.7:0/1995624207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b81a64b0 con 0x7f61b8102a60 2024-09-21T05:45:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.838+0000 7f61bca34640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b8102a60 0x7f61b819b2b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f61a800d950 tx=0x7f61a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.838+0000 7f61b5ffb640 1 -- 172.21.15.7:0/1995624207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8017070 con 0x7f61b8102a60 2024-09-21T05:45:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.838+0000 7f61bec98640 1 -- 172.21.15.7:0/1995624207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b81a67a0 con 0x7f61b8102a60 2024-09-21T05:45:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.838+0000 7f61bec98640 1 -- 172.21.15.7:0/1995624207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b81a6d00 con 0x7f61b8102a60 2024-09-21T05:45:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.838+0000 7f61b5ffb640 1 -- 172.21.15.7:0/1995624207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61a8009c30 con 0x7f61b8102a60 2024-09-21T05:45:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.838+0000 7f61b5ffb640 1 -- 172.21.15.7:0/1995624207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a800f620 con 0x7f61b8102a60 2024-09-21T05:45:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.839+0000 7f61bec98640 1 -- 172.21.15.7:0/1995624207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a4005290 con 0x7f61b8102a60 2024-09-21T05:45:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.841+0000 7f61b5ffb640 1 -- 172.21.15.7:0/1995624207 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f61a800f7c0 con 0x7f61b8102a60 2024-09-21T05:45:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.841+0000 7f61b5ffb640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f61a00b6580 0x7f61a00b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.842+0000 7f61b7fff640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f61a00b6580 0x7f61a00b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.842+0000 7f61b5ffb640 1 -- 172.21.15.7:0/1995624207 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f61a80e4f40 con 0x7f61b8102a60 2024-09-21T05:45:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.842+0000 7f61b7fff640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f61a00b6580 0x7f61a00b8a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f61ac000c00 tx=0x7f61ac031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:45.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.849+0000 7f61b5ffb640 1 -- 172.21.15.7:0/1995624207 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61a80b1830 con 0x7f61b8102a60 2024-09-21T05:45:45.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.851+0000 7fab92835640 1 -- 172.21.15.7:0/1325527388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fab8c19b550 con 0x7fab8c1094d0 2024-09-21T05:45:45.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.855+0000 7fab89ffb640 1 -- 172.21.15.7:0/1325527388 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7fab8c19b550 con 0x7fab8c1094d0 2024-09-21T05:45:45.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.857+0000 7fab92835640 1 -- 172.21.15.7:0/1325527388 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab780b6550 msgr2=0x7fab780b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:45.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.857+0000 7fab92835640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab780b6550 0x7fab780b8a60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab7c005d00 tx=0x7fab7c005c50 comp rx=0 tx=0).stop 2024-09-21T05:45:45.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.857+0000 7fab92835640 1 -- 172.21.15.7:0/1325527388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab8c1094d0 msgr2=0x7fab8c19a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:45.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.857+0000 7fab92835640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab8c1094d0 0x7fab8c19a9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab7400d750 tx=0x7fab7400dc10 comp rx=0 tx=0).stop 2024-09-21T05:45:45.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.857+0000 7fab92835640 1 -- 172.21.15.7:0/1325527388 shutdown_connections 2024-09-21T05:45:45.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.857+0000 7fab92835640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab780b6550 0x7fab780b8a60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.857+0000 7fab92835640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab8c1094d0 0x7fab8c19a9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.857+0000 7fab92835640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab8c109e20 0x7fab8c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.857+0000 7fab92835640 1 --2- 172.21.15.7:0/1325527388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8c103b90 0x7fab8c19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.857+0000 7fab92835640 1 -- 172.21.15.7:0/1325527388 >> 172.21.15.7:0/1325527388 conn(0x7fab8c0ff600 msgr2=0x7fab8c108ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.857+0000 7fab92835640 1 -- 172.21.15.7:0/1325527388 shutdown_connections 2024-09-21T05:45:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:45.857+0000 7fab92835640 1 -- 172.21.15.7:0/1325527388 wait complete. 2024-09-21T05:45:46.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:45 smithi007 ceph-mon[30983]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:46.045 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:45 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1325527388' entity='client.admin' 2024-09-21T05:45:46.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.042+0000 7f61bec98640 1 -- 172.21.15.7:0/1995624207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f61a4005580 con 0x7f61b8102a60 2024-09-21T05:45:46.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.046+0000 7f61b5ffb640 1 -- 172.21.15.7:0/1995624207 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v32)=0 v32) ==== 125+0+0 (secure 0 0 0) 0x7f61a80b6770 con 0x7f61b8102a60 2024-09-21T05:45:46.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.049+0000 7f61bec98640 1 -- 172.21.15.7:0/1995624207 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f61a00b6580 msgr2=0x7f61a00b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:46.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.049+0000 7f61bec98640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f61a00b6580 0x7f61a00b8a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f61ac000c00 tx=0x7f61ac031400 comp rx=0 tx=0).stop 2024-09-21T05:45:46.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.049+0000 7f61bec98640 1 -- 172.21.15.7:0/1995624207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b8102a60 msgr2=0x7f61b819b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:46.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.049+0000 7f61bec98640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b8102a60 0x7f61b819b2b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f61a800d950 tx=0x7f61a800de10 comp rx=0 tx=0).stop 2024-09-21T05:45:46.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.049+0000 7f61bec98640 1 -- 172.21.15.7:0/1995624207 shutdown_connections 2024-09-21T05:45:46.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.049+0000 7f61bec98640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f61a00b6580 0x7f61a00b8a90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.049+0000 7f61bec98640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b8108cf0 0x7f61b819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.049+0000 7f61bec98640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61b81083a0 0x7f61b819b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.049+0000 7f61bec98640 1 --2- 172.21.15.7:0/1995624207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61b8102a60 0x7f61b819b2b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.049+0000 7f61bec98640 1 -- 172.21.15.7:0/1995624207 >> 172.21.15.7:0/1995624207 conn(0x7f61b8079730 msgr2=0x7f61b8104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:46.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.049+0000 7f61bec98640 1 -- 172.21.15.7:0/1995624207 shutdown_connections 2024-09-21T05:45:46.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.049+0000 7f61bec98640 1 -- 172.21.15.7:0/1995624207 wait complete. 2024-09-21T05:45:46.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:45 smithi027 ceph-mon[34364]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:46.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:45 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1325527388' entity='client.admin' 2024-09-21T05:45:46.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:45 smithi119 ceph-mon[34833]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:46.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:45 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1325527388' entity='client.admin' 2024-09-21T05:45:46.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.596+0000 7f9e43cab640 1 -- 172.21.15.7:0/474340958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e3c108d20 msgr2=0x7f9e3c10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:46.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.596+0000 7f9e43cab640 1 --2- 172.21.15.7:0/474340958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e3c108d20 0x7f9e3c10f550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009ca0 tx=0x7f9e3402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.596+0000 7f9e43cab640 1 -- 172.21.15.7:0/474340958 shutdown_connections 2024-09-21T05:45:46.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.596+0000 7f9e43cab640 1 --2- 172.21.15.7:0/474340958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e3c108d20 0x7f9e3c10f550 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.596+0000 7f9e43cab640 1 --2- 172.21.15.7:0/474340958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e3c1083d0 0x7f9e3c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.596+0000 7f9e43cab640 1 --2- 172.21.15.7:0/474340958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e3c102ae0 0x7f9e3c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.596+0000 7f9e43cab640 1 -- 172.21.15.7:0/474340958 >> 172.21.15.7:0/474340958 conn(0x7f9e3c0797b0 msgr2=0x7f9e3c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:46.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.596+0000 7f9e43cab640 1 -- 172.21.15.7:0/474340958 shutdown_connections 2024-09-21T05:45:46.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.596+0000 7f9e43cab640 1 -- 172.21.15.7:0/474340958 wait complete. 2024-09-21T05:45:46.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.597+0000 7f9e43cab640 1 Processor -- start 2024-09-21T05:45:46.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.597+0000 7f9e43cab640 1 -- start start 2024-09-21T05:45:46.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.597+0000 7f9e43cab640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e3c102ae0 0x7f9e3c19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:46.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.597+0000 7f9e43cab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e3c1083d0 0x7f9e3c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:46.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.597+0000 7f9e43cab640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e3c108d20 0x7f9e3c1a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:46.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.597+0000 7f9e43cab640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3c1129e0 con 0x7f9e3c1083d0 2024-09-21T05:45:46.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.597+0000 7f9e43cab640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3c112860 con 0x7f9e3c102ae0 2024-09-21T05:45:46.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.597+0000 7f9e43cab640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3c112b60 con 0x7f9e3c108d20 2024-09-21T05:45:46.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e41246640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e3c1083d0 0x7f9e3c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e41246640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e3c1083d0 0x7f9e3c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47386/0 (socket says 172.21.15.7:47386) 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e41246640 1 -- 172.21.15.7:0/1763977899 learned_addr learned my addr 172.21.15.7:0/1763977899 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e42248640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e3c108d20 0x7f9e3c1a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e41a47640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e3c102ae0 0x7f9e3c19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e41246640 1 -- 172.21.15.7:0/1763977899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e3c108d20 msgr2=0x7f9e3c1a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e41246640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e3c108d20 0x7f9e3c1a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e41246640 1 -- 172.21.15.7:0/1763977899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e3c102ae0 msgr2=0x7f9e3c19c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e41246640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e3c102ae0 0x7f9e3c19c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e41246640 1 -- 172.21.15.7:0/1763977899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3c1a2670 con 0x7f9e3c1083d0 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e41246640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e3c1083d0 0x7f9e3c19cca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00e9c0 tx=0x7f9e2c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e32ffd640 1 -- 172.21.15.7:0/1763977899 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00ccc0 con 0x7f9e3c1083d0 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e32ffd640 1 -- 172.21.15.7:0/1763977899 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e2c0054d0 con 0x7f9e3c1083d0 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e43cab640 1 -- 172.21.15.7:0/1763977899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3c1a2960 con 0x7f9e3c1083d0 2024-09-21T05:45:46.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e32ffd640 1 -- 172.21.15.7:0/1763977899 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c010430 con 0x7f9e3c1083d0 2024-09-21T05:45:46.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.598+0000 7f9e43cab640 1 -- 172.21.15.7:0/1763977899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e3c1a90c0 con 0x7f9e3c1083d0 2024-09-21T05:45:46.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.600+0000 7f9e43cab640 1 -- 172.21.15.7:0/1763977899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e3c102ef0 con 0x7f9e3c1083d0 2024-09-21T05:45:46.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.601+0000 7f9e32ffd640 1 -- 172.21.15.7:0/1763977899 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f9e2c005020 con 0x7f9e3c1083d0 2024-09-21T05:45:46.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.602+0000 7f9e32ffd640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e280b65d0 0x7f9e280b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:46.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.602+0000 7f9e41a47640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e280b65d0 0x7f9e280b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:46.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.602+0000 7f9e32ffd640 1 -- 172.21.15.7:0/1763977899 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9e2c0e5c20 con 0x7f9e3c1083d0 2024-09-21T05:45:46.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.603+0000 7f9e41a47640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e280b65d0 0x7f9e280b8ae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9e380058c0 tx=0x7f9e3800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:46.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.605+0000 7f9e32ffd640 1 -- 172.21.15.7:0/1763977899 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e2c056710 con 0x7f9e3c1083d0 2024-09-21T05:45:46.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.796+0000 7f9e43cab640 1 -- 172.21.15.7:0/1763977899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f9e3c19d830 con 0x7f9e3c1083d0 2024-09-21T05:45:46.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.800+0000 7f9e32ffd640 1 -- 172.21.15.7:0/1763977899 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f9e2c0ae010 con 0x7f9e3c1083d0 2024-09-21T05:45:46.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.802+0000 7f9e43cab640 1 -- 172.21.15.7:0/1763977899 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e280b65d0 msgr2=0x7f9e280b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.802+0000 7f9e43cab640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e280b65d0 0x7f9e280b8ae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9e380058c0 tx=0x7f9e3800a2d0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.802+0000 7f9e43cab640 1 -- 172.21.15.7:0/1763977899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e3c1083d0 msgr2=0x7f9e3c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.802+0000 7f9e43cab640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e3c1083d0 0x7f9e3c19cca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00e9c0 tx=0x7f9e2c00ee80 comp rx=0 tx=0).stop 2024-09-21T05:45:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.802+0000 7f9e43cab640 1 -- 172.21.15.7:0/1763977899 shutdown_connections 2024-09-21T05:45:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.802+0000 7f9e43cab640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e280b65d0 0x7f9e280b8ae0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.802+0000 7f9e43cab640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e3c1083d0 0x7f9e3c19cca0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.802+0000 7f9e43cab640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e3c108d20 0x7f9e3c1a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.802+0000 7f9e43cab640 1 --2- 172.21.15.7:0/1763977899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e3c102ae0 0x7f9e3c19c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.802+0000 7f9e43cab640 1 -- 172.21.15.7:0/1763977899 >> 172.21.15.7:0/1763977899 conn(0x7f9e3c0797b0 msgr2=0x7f9e3c06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.802+0000 7f9e43cab640 1 -- 172.21.15.7:0/1763977899 shutdown_connections 2024-09-21T05:45:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:46.802+0000 7f9e43cab640 1 -- 172.21.15.7:0/1763977899 wait complete. 2024-09-21T05:45:47.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:47 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1995624207' entity='client.admin' 2024-09-21T05:45:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:47 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1763977899' entity='client.admin' 2024-09-21T05:45:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:47 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1995624207' entity='client.admin' 2024-09-21T05:45:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:47 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1763977899' entity='client.admin' 2024-09-21T05:45:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.382+0000 7f043e19d640 1 -- 172.21.15.7:0/3193191138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04381094d0 msgr2=0x7f04381098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.382+0000 7f043e19d640 1 --2- 172.21.15.7:0/3193191138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04381094d0 0x7f04381098e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f042c009900 tx=0x7f042c02a410 comp rx=0 tx=0).stop 2024-09-21T05:45:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.382+0000 7f043e19d640 1 -- 172.21.15.7:0/3193191138 shutdown_connections 2024-09-21T05:45:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.382+0000 7f043e19d640 1 --2- 172.21.15.7:0/3193191138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04381094d0 0x7f04381098e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.382+0000 7f043e19d640 1 --2- 172.21.15.7:0/3193191138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0438109e20 0x7f0438110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.382+0000 7f043e19d640 1 --2- 172.21.15.7:0/3193191138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0438103b90 0x7f0438103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.382+0000 7f043e19d640 1 -- 172.21.15.7:0/3193191138 >> 172.21.15.7:0/3193191138 conn(0x7f04380ff600 msgr2=0x7f0438101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.382+0000 7f043e19d640 1 -- 172.21.15.7:0/3193191138 shutdown_connections 2024-09-21T05:45:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.382+0000 7f043e19d640 1 -- 172.21.15.7:0/3193191138 wait complete. 2024-09-21T05:45:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.383+0000 7f043e19d640 1 Processor -- start 2024-09-21T05:45:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.383+0000 7f043e19d640 1 -- start start 2024-09-21T05:45:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.383+0000 7f043e19d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0438103b90 0x7f043819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.383+0000 7f043e19d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04381094d0 0x7f043819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.383+0000 7f043e19d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0438109e20 0x7f04381a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.383+0000 7f043e19d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0438113ae0 con 0x7f04381094d0 2024-09-21T05:45:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.383+0000 7f043e19d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0438113960 con 0x7f0438109e20 2024-09-21T05:45:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.383+0000 7f043e19d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0438113c60 con 0x7f0438103b90 2024-09-21T05:45:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.383+0000 7f0436ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04381094d0 0x7f043819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.383+0000 7f0436ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04381094d0 0x7f043819cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47392/0 (socket says 172.21.15.7:47392) 2024-09-21T05:45:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.383+0000 7f0436ffd640 1 -- 172.21.15.7:0/3369680274 learned_addr learned my addr 172.21.15.7:0/3369680274 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.383+0000 7f0437fff640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0438109e20 0x7f04381a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.383+0000 7f04377fe640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0438103b90 0x7f043819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.384+0000 7f0436ffd640 1 -- 172.21.15.7:0/3369680274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0438103b90 msgr2=0x7f043819c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.384+0000 7f0436ffd640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0438103b90 0x7f043819c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.384+0000 7f0436ffd640 1 -- 172.21.15.7:0/3369680274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0438109e20 msgr2=0x7f04381a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.384+0000 7f0436ffd640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0438109e20 0x7f04381a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.384+0000 7f0436ffd640 1 -- 172.21.15.7:0/3369680274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04381a2640 con 0x7f04381094d0 2024-09-21T05:45:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.384+0000 7f0436ffd640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04381094d0 0x7f043819cc70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f042c02a930 tx=0x7f042c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.384+0000 7f0434ff9640 1 -- 172.21.15.7:0/3369680274 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c03f030 con 0x7f04381094d0 2024-09-21T05:45:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.384+0000 7f043e19d640 1 -- 172.21.15.7:0/3369680274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04381a28d0 con 0x7f04381094d0 2024-09-21T05:45:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.384+0000 7f0434ff9640 1 -- 172.21.15.7:0/3369680274 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f042c003aa0 con 0x7f04381094d0 2024-09-21T05:45:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.384+0000 7f0434ff9640 1 -- 172.21.15.7:0/3369680274 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c035070 con 0x7f04381094d0 2024-09-21T05:45:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.384+0000 7f043e19d640 1 -- 172.21.15.7:0/3369680274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04381a9090 con 0x7f04381094d0 2024-09-21T05:45:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.385+0000 7f043e19d640 1 -- 172.21.15.7:0/3369680274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0438103fa0 con 0x7f04381094d0 2024-09-21T05:45:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.387+0000 7f0434ff9640 1 -- 172.21.15.7:0/3369680274 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f042c042030 con 0x7f04381094d0 2024-09-21T05:45:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.388+0000 7f0434ff9640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f04200b64d0 0x7f04200b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.388+0000 7f04377fe640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f04200b64d0 0x7f04200b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.388+0000 7f0434ff9640 1 -- 172.21.15.7:0/3369680274 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f042c106130 con 0x7f04381094d0 2024-09-21T05:45:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.388+0000 7f04377fe640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f04200b64d0 0x7f04200b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0428005fd0 tx=0x7f042800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:47.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.391+0000 7f0434ff9640 1 -- 172.21.15.7:0/3369680274 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f042c0d2980 con 0x7f04381094d0 2024-09-21T05:45:47.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:47 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1995624207' entity='client.admin' 2024-09-21T05:45:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:47 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1763977899' entity='client.admin' 2024-09-21T05:45:47.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.565+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2293420324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3a0102a60 msgr2=0x7fb3a0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.565+0000 7fb3a7d56640 1 --2- 172.21.15.7:0/2293420324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3a0102a60 0x7fb3a0102e70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009900 tx=0x7fb39c02a410 comp rx=0 tx=0).stop 2024-09-21T05:45:47.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.565+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2293420324 shutdown_connections 2024-09-21T05:45:47.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.565+0000 7fb3a7d56640 1 --2- 172.21.15.7:0/2293420324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3a0108cf0 0x7fb3a010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.565+0000 7fb3a7d56640 1 --2- 172.21.15.7:0/2293420324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3a01083a0 0x7fb3a01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.565+0000 7fb3a7d56640 1 --2- 172.21.15.7:0/2293420324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3a0102a60 0x7fb3a0102e70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.565+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2293420324 >> 172.21.15.7:0/2293420324 conn(0x7fb3a0079730 msgr2=0x7fb3a0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:47.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.565+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2293420324 shutdown_connections 2024-09-21T05:45:47.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.565+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2293420324 wait complete. 2024-09-21T05:45:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.566+0000 7fb3a7d56640 1 Processor -- start 2024-09-21T05:45:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.566+0000 7fb3a7d56640 1 -- start start 2024-09-21T05:45:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.566+0000 7fb3a7d56640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3a0102a60 0x7fb3a010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.566+0000 7fb3a7d56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3a01083a0 0x7fb3a01104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.566+0000 7fb3a7d56640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3a0108cf0 0x7fb3a0110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.566+0000 7fb3a7d56640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a0113ad0 con 0x7fb3a0102a60 2024-09-21T05:45:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.566+0000 7fb3a7d56640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a0113950 con 0x7fb3a0108cf0 2024-09-21T05:45:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.566+0000 7fb3a7d56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a0113c50 con 0x7fb3a01083a0 2024-09-21T05:45:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb3a5af2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3a0102a60 0x7fb3a010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb3a5af2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3a0102a60 0x7fb3a010ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47424/0 (socket says 172.21.15.7:47424) 2024-09-21T05:45:47.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb3a5af2640 1 -- 172.21.15.7:0/2719107264 learned_addr learned my addr 172.21.15.7:0/2719107264 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:47.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb3a52f1640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3a01083a0 0x7fb3a01104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb3a62f3640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3a0108cf0 0x7fb3a0110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb3a5af2640 1 -- 172.21.15.7:0/2719107264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3a01083a0 msgr2=0x7fb3a01104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb3a5af2640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3a01083a0 0x7fb3a01104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb3a5af2640 1 -- 172.21.15.7:0/2719107264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3a0108cf0 msgr2=0x7fb3a0110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb3a5af2640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3a0108cf0 0x7fb3a0110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb3a5af2640 1 -- 172.21.15.7:0/2719107264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a01a8780 con 0x7fb3a0102a60 2024-09-21T05:45:47.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb3a52f1640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3a01083a0 0x7fb3a01104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:45:47.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb3a5af2640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3a0102a60 0x7fb3a010ffb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb39c005ab0 tx=0x7fb39c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:47.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb396ffd640 1 -- 172.21.15.7:0/2719107264 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c03f070 con 0x7fb3a0102a60 2024-09-21T05:45:47.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb396ffd640 1 -- 172.21.15.7:0/2719107264 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb39c031d60 con 0x7fb3a0102a60 2024-09-21T05:45:47.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb396ffd640 1 -- 172.21.15.7:0/2719107264 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c035030 con 0x7fb3a0102a60 2024-09-21T05:45:47.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.567+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2719107264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a01a8a10 con 0x7fb3a0102a60 2024-09-21T05:45:47.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.568+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2719107264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a01a8ea0 con 0x7fb3a0102a60 2024-09-21T05:45:47.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.568+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2719107264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a0102e70 con 0x7fb3a0102a60 2024-09-21T05:45:47.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.570+0000 7fb396ffd640 1 -- 172.21.15.7:0/2719107264 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fb39c042070 con 0x7fb3a0102a60 2024-09-21T05:45:47.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.571+0000 7fb396ffd640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb38c0b6550 0x7fb38c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.571+0000 7fb3a52f1640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb38c0b6550 0x7fb38c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.571+0000 7fb396ffd640 1 -- 172.21.15.7:0/2719107264 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb39c1065b0 con 0x7fb3a0102a60 2024-09-21T05:45:47.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.572+0000 7fb3a52f1640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb38c0b6550 0x7fb38c0b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb3900058c0 tx=0x7fb390005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:47.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.579+0000 7fb396ffd640 1 -- 172.21.15.7:0/2719107264 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb39c0cea40 con 0x7fb3a0102a60 2024-09-21T05:45:47.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.587+0000 7f043e19d640 1 -- 172.21.15.7:0/3369680274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f04381a9290 con 0x7f04381094d0 2024-09-21T05:45:47.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.591+0000 7f0434ff9640 1 -- 172.21.15.7:0/3369680274 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v34)=0 v34) ==== 118+0+0 (secure 0 0 0) 0x7f042c0d78c0 con 0x7f04381094d0 2024-09-21T05:45:47.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.593+0000 7f043e19d640 1 -- 172.21.15.7:0/3369680274 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f04200b64d0 msgr2=0x7f04200b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.593+0000 7f043e19d640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f04200b64d0 0x7f04200b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0428005fd0 tx=0x7f042800b390 comp rx=0 tx=0).stop 2024-09-21T05:45:47.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.593+0000 7f043e19d640 1 -- 172.21.15.7:0/3369680274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04381094d0 msgr2=0x7f043819cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.593+0000 7f043e19d640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04381094d0 0x7f043819cc70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f042c02a930 tx=0x7f042c004270 comp rx=0 tx=0).stop 2024-09-21T05:45:47.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.593+0000 7f043e19d640 1 -- 172.21.15.7:0/3369680274 shutdown_connections 2024-09-21T05:45:47.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.593+0000 7f043e19d640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f04200b64d0 0x7f04200b89e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.593+0000 7f043e19d640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04381094d0 0x7f043819cc70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.593+0000 7f043e19d640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0438109e20 0x7f04381a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.593+0000 7f043e19d640 1 --2- 172.21.15.7:0/3369680274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0438103b90 0x7f043819c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.593+0000 7f043e19d640 1 -- 172.21.15.7:0/3369680274 >> 172.21.15.7:0/3369680274 conn(0x7f04380ff600 msgr2=0x7f0438108b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:47.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.593+0000 7f043e19d640 1 -- 172.21.15.7:0/3369680274 shutdown_connections 2024-09-21T05:45:47.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.593+0000 7f043e19d640 1 -- 172.21.15.7:0/3369680274 wait complete. 2024-09-21T05:45:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.436+0000 7f2d534bb640 1 -- 172.21.15.7:0/1851984984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4c102a60 msgr2=0x7f2d4c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.436+0000 7f2d534bb640 1 --2- 172.21.15.7:0/1851984984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4c102a60 0x7f2d4c102e70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009900 tx=0x7f2d4802a410 comp rx=0 tx=0).stop 2024-09-21T05:45:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.436+0000 7f2d534bb640 1 -- 172.21.15.7:0/1851984984 shutdown_connections 2024-09-21T05:45:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.436+0000 7f2d534bb640 1 --2- 172.21.15.7:0/1851984984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d4c108cf0 0x7f2d4c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.436+0000 7f2d534bb640 1 --2- 172.21.15.7:0/1851984984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4c1083a0 0x7f2d4c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.436+0000 7f2d534bb640 1 --2- 172.21.15.7:0/1851984984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4c102a60 0x7f2d4c102e70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.436+0000 7f2d534bb640 1 -- 172.21.15.7:0/1851984984 >> 172.21.15.7:0/1851984984 conn(0x7f2d4c079730 msgr2=0x7f2d4c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.436+0000 7f2d534bb640 1 -- 172.21.15.7:0/1851984984 shutdown_connections 2024-09-21T05:45:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.436+0000 7f2d534bb640 1 -- 172.21.15.7:0/1851984984 wait complete. 2024-09-21T05:45:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.437+0000 7f2d534bb640 1 Processor -- start 2024-09-21T05:45:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.437+0000 7f2d534bb640 1 -- start start 2024-09-21T05:45:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.437+0000 7f2d534bb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4c102a60 0x7f2d4c19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.437+0000 7f2d534bb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d4c1083a0 0x7f2d4c19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.437+0000 7f2d534bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4c108cf0 0x7f2d4c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.437+0000 7f2d534bb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c112960 con 0x7f2d4c108cf0 2024-09-21T05:45:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.437+0000 7f2d534bb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c1127e0 con 0x7f2d4c1083a0 2024-09-21T05:45:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.437+0000 7f2d534bb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c112ae0 con 0x7f2d4c102a60 2024-09-21T05:45:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d51a58640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4c108cf0 0x7f2d4c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d51a58640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4c108cf0 0x7f2d4c19bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47318/0 (socket says 172.21.15.7:47318) 2024-09-21T05:45:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d51a58640 1 -- 172.21.15.7:0/1530756989 learned_addr learned my addr 172.21.15.7:0/1530756989 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d50a56640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d4c1083a0 0x7f2d4c19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d51257640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4c102a60 0x7f2d4c19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d51a58640 1 -- 172.21.15.7:0/1530756989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4c102a60 msgr2=0x7f2d4c19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d51a58640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4c102a60 0x7f2d4c19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d51a58640 1 -- 172.21.15.7:0/1530756989 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d4c1083a0 msgr2=0x7f2d4c19b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d51a58640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d4c1083a0 0x7f2d4c19b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d51a58640 1 -- 172.21.15.7:0/1530756989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d4c1a64d0 con 0x7f2d4c108cf0 2024-09-21T05:45:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d51a58640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4c108cf0 0x7f2d4c19bd50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400cce0 tx=0x7f2d4400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d427fc640 1 -- 172.21.15.7:0/1530756989 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400f450 con 0x7f2d4c108cf0 2024-09-21T05:45:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d534bb640 1 -- 172.21.15.7:0/1530756989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d4c1a67c0 con 0x7f2d4c108cf0 2024-09-21T05:45:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d427fc640 1 -- 172.21.15.7:0/1530756989 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d4400faa0 con 0x7f2d4c108cf0 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d427fc640 1 -- 172.21.15.7:0/1530756989 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44018b70 con 0x7f2d4c108cf0 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.438+0000 7f2d534bb640 1 -- 172.21.15.7:0/1530756989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d4c1a6d00 con 0x7f2d4c108cf0 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.439+0000 7f2d534bb640 1 -- 172.21.15.7:0/1530756989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d4c102e70 con 0x7f2d4c108cf0 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.441+0000 7f2d427fc640 1 -- 172.21.15.7:0/1530756989 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f2d44018d10 con 0x7f2d4c108cf0 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.442+0000 7f2d427fc640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2d380b6500 0x7f2d380b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.442+0000 7f2d51257640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2d380b6500 0x7f2d380b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.442+0000 7f2d427fc640 1 -- 172.21.15.7:0/1530756989 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2d440e5b50 con 0x7f2d4c108cf0 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.443+0000 7f2d51257640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2d380b6500 0x7f2d380b8a10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2d48000c00 tx=0x7f2d48031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.445+0000 7f2d427fc640 1 -- 172.21.15.7:0/1530756989 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2d44014030 con 0x7f2d4c108cf0 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.639+0000 7f2d534bb640 1 -- 172.21.15.7:0/1530756989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f2d4c02e640 con 0x7f2d4c108cf0 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.640+0000 7f2d427fc640 1 -- 172.21.15.7:0/1530756989 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v30)=0 v30) ==== 108+0+0 (secure 0 0 0) 0x7f2d440ae070 con 0x7f2d4c108cf0 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.642+0000 7f2d534bb640 1 -- 172.21.15.7:0/1530756989 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2d380b6500 msgr2=0x7f2d380b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.642+0000 7f2d534bb640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2d380b6500 0x7f2d380b8a10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2d48000c00 tx=0x7f2d48031400 comp rx=0 tx=0).stop 2024-09-21T05:45:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.642+0000 7f2d534bb640 1 -- 172.21.15.7:0/1530756989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4c108cf0 msgr2=0x7f2d4c19bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.642+0000 7f2d534bb640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4c108cf0 0x7f2d4c19bd50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400cce0 tx=0x7f2d4400a620 comp rx=0 tx=0).stop 2024-09-21T05:45:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.642+0000 7f2d534bb640 1 -- 172.21.15.7:0/1530756989 shutdown_connections 2024-09-21T05:45:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.642+0000 7f2d534bb640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2d380b6500 0x7f2d380b8a10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.642+0000 7f2d534bb640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4c108cf0 0x7f2d4c19bd50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.642+0000 7f2d534bb640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d4c1083a0 0x7f2d4c19b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.642+0000 7f2d534bb640 1 --2- 172.21.15.7:0/1530756989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4c102a60 0x7f2d4c19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.642+0000 7f2d534bb640 1 -- 172.21.15.7:0/1530756989 >> 172.21.15.7:0/1530756989 conn(0x7f2d4c079730 msgr2=0x7f2d4c101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.642+0000 7f2d534bb640 1 -- 172.21.15.7:0/1530756989 shutdown_connections 2024-09-21T05:45:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:44.643+0000 7f2d534bb640 1 -- 172.21.15.7:0/1530756989 wait complete. 2024-09-21T05:45:47.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.770+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2719107264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fb3a002e640 con 0x7fb3a0102a60 2024-09-21T05:45:47.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.775+0000 7fb396ffd640 1 -- 172.21.15.7:0/2719107264 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v35)=0 v35) ==== 133+0+0 (secure 0 0 0) 0x7fb39c0d2e20 con 0x7fb3a0102a60 2024-09-21T05:45:47.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.777+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2719107264 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb38c0b6550 msgr2=0x7fb38c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.777+0000 7fb3a7d56640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb38c0b6550 0x7fb38c0b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb3900058c0 tx=0x7fb390005850 comp rx=0 tx=0).stop 2024-09-21T05:45:47.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.777+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2719107264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3a0102a60 msgr2=0x7fb3a010ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.777+0000 7fb3a7d56640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3a0102a60 0x7fb3a010ffb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb39c005ab0 tx=0x7fb39c003cd0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.777+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2719107264 shutdown_connections 2024-09-21T05:45:47.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.777+0000 7fb3a7d56640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb38c0b6550 0x7fb38c0b8a60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.777+0000 7fb3a7d56640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3a0108cf0 0x7fb3a0110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.777+0000 7fb3a7d56640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3a01083a0 0x7fb3a01104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.777+0000 7fb3a7d56640 1 --2- 172.21.15.7:0/2719107264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3a0102a60 0x7fb3a010ffb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.777+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2719107264 >> 172.21.15.7:0/2719107264 conn(0x7fb3a0079730 msgr2=0x7fb3a01013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:47.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.777+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2719107264 shutdown_connections 2024-09-21T05:45:47.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:47.777+0000 7fb3a7d56640 1 -- 172.21.15.7:0/2719107264 wait complete. 2024-09-21T05:45:48.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:48 smithi007 ceph-mon[30983]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:48.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:48 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3369680274' entity='client.admin' 2024-09-21T05:45:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:48 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2719107264' entity='client.admin' 2024-09-21T05:45:48.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:48 smithi119 ceph-mon[34833]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:48.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:48 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3369680274' entity='client.admin' 2024-09-21T05:45:48.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:48 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2719107264' entity='client.admin' 2024-09-21T05:45:48.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:48 smithi027 ceph-mon[34364]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:48.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:48 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3369680274' entity='client.admin' 2024-09-21T05:45:48.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:48 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2719107264' entity='client.admin' 2024-09-21T05:45:50.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:50 smithi007 ceph-mon[30983]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:50.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:50 smithi119 ceph-mon[34833]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:50.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:50 smithi027 ceph-mon[34364]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:50.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.804+0000 7fa5493cd640 1 -- 172.21.15.7:0/2166049369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5441062e0 msgr2=0x7fa5441066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:50.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.804+0000 7fa5493cd640 1 --2- 172.21.15.7:0/2166049369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5441062e0 0x7fa5441066f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009900 tx=0x7fa52c02a410 comp rx=0 tx=0).stop 2024-09-21T05:45:50.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.804+0000 7fa5493cd640 1 -- 172.21.15.7:0/2166049369 shutdown_connections 2024-09-21T05:45:50.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.804+0000 7fa5493cd640 1 --2- 172.21.15.7:0/2166049369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5441062e0 0x7fa5441066f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:50.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.804+0000 7fa5493cd640 1 --2- 172.21.15.7:0/2166049369 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa544106c30 0x7fa544110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:50.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.804+0000 7fa5493cd640 1 --2- 172.21.15.7:0/2166049369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa544102000 0x7fa544102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:50.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.804+0000 7fa5493cd640 1 -- 172.21.15.7:0/2166049369 >> 172.21.15.7:0/2166049369 conn(0x7fa544079e40 msgr2=0x7fa54407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:50.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.804+0000 7fa5493cd640 1 -- 172.21.15.7:0/2166049369 shutdown_connections 2024-09-21T05:45:50.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.804+0000 7fa5493cd640 1 -- 172.21.15.7:0/2166049369 wait complete. 2024-09-21T05:45:50.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5493cd640 1 Processor -- start 2024-09-21T05:45:50.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5493cd640 1 -- start start 2024-09-21T05:45:50.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5493cd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa544102000 0x7fa544102fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:50.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5493cd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441062e0 0x7fa5441034e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:50.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5493cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa544106c30 0x7fa544103a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:50.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5493cd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa544113ae0 con 0x7fa544106c30 2024-09-21T05:45:50.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5493cd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa544113960 con 0x7fa5441062e0 2024-09-21T05:45:50.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5493cd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa544113c60 con 0x7fa544102000 2024-09-21T05:45:50.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa544106c30 0x7fa544103a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:50.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa544106c30 0x7fa544103a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53312/0 (socket says 172.21.15.7:53312) 2024-09-21T05:45:50.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5437fe640 1 -- 172.21.15.7:0/1760853887 learned_addr learned my addr 172.21.15.7:0/1760853887 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:50.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa53bfff640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441062e0 0x7fa5441034e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:50.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa542ffd640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa544102000 0x7fa544102fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:50.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5437fe640 1 -- 172.21.15.7:0/1760853887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa544102000 msgr2=0x7fa544102fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:50.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5437fe640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa544102000 0x7fa544102fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:50.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5437fe640 1 -- 172.21.15.7:0/1760853887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441062e0 msgr2=0x7fa5441034e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:50.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5437fe640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441062e0 0x7fa5441034e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:50.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.805+0000 7fa5437fe640 1 -- 172.21.15.7:0/1760853887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5441a8730 con 0x7fa544106c30 2024-09-21T05:45:50.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.806+0000 7fa5437fe640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa544106c30 0x7fa544103a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00eb10 tx=0x7fa53c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:50.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.806+0000 7fa540ff9640 1 -- 172.21.15.7:0/1760853887 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c004b20 con 0x7fa544106c30 2024-09-21T05:45:50.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.806+0000 7fa540ff9640 1 -- 172.21.15.7:0/1760853887 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa53c004cc0 con 0x7fa544106c30 2024-09-21T05:45:50.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.806+0000 7fa540ff9640 1 -- 172.21.15.7:0/1760853887 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c010670 con 0x7fa544106c30 2024-09-21T05:45:50.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.806+0000 7fa5493cd640 1 -- 172.21.15.7:0/1760853887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5441a8a20 con 0x7fa544106c30 2024-09-21T05:45:50.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.806+0000 7fa5493cd640 1 -- 172.21.15.7:0/1760853887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5441a8ee0 con 0x7fa544106c30 2024-09-21T05:45:50.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.807+0000 7fa5493cd640 1 -- 172.21.15.7:0/1760853887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa544102410 con 0x7fa544106c30 2024-09-21T05:45:50.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.810+0000 7fa540ff9640 1 -- 172.21.15.7:0/1760853887 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fa53c005000 con 0x7fa544106c30 2024-09-21T05:45:50.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.810+0000 7fa540ff9640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5300b64d0 0x7fa5300b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:50.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.810+0000 7fa542ffd640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5300b64d0 0x7fa5300b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:50.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.811+0000 7fa540ff9640 1 -- 172.21.15.7:0/1760853887 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa53c0e5e80 con 0x7fa544106c30 2024-09-21T05:45:50.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.811+0000 7fa542ffd640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5300b64d0 0x7fa5300b89e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5441049f0 tx=0x7fa53400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:50.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:50.814+0000 7fa540ff9640 1 -- 172.21.15.7:0/1760853887 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa53c056710 con 0x7fa544106c30 2024-09-21T05:45:51.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.005+0000 7fa5493cd640 1 -- 172.21.15.7:0/1760853887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fa54402e640 con 0x7fa544106c30 2024-09-21T05:45:51.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.005+0000 7fa540ff9640 1 -- 172.21.15.7:0/1760853887 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v35)=0 v35) ==== 106+0+0 (secure 0 0 0) 0x7fa53c0ae310 con 0x7fa544106c30 2024-09-21T05:45:51.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.008+0000 7fa5493cd640 1 -- 172.21.15.7:0/1760853887 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5300b64d0 msgr2=0x7fa5300b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:51.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.008+0000 7fa5493cd640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5300b64d0 0x7fa5300b89e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5441049f0 tx=0x7fa53400b390 comp rx=0 tx=0).stop 2024-09-21T05:45:51.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.008+0000 7fa5493cd640 1 -- 172.21.15.7:0/1760853887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa544106c30 msgr2=0x7fa544103a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:51.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.008+0000 7fa5493cd640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa544106c30 0x7fa544103a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00eb10 tx=0x7fa53c00c2d0 comp rx=0 tx=0).stop 2024-09-21T05:45:51.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.008+0000 7fa5493cd640 1 -- 172.21.15.7:0/1760853887 shutdown_connections 2024-09-21T05:45:51.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.008+0000 7fa5493cd640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5300b64d0 0x7fa5300b89e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.008+0000 7fa5493cd640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa544106c30 0x7fa544103a20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.008+0000 7fa5493cd640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5441062e0 0x7fa5441034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.008+0000 7fa5493cd640 1 --2- 172.21.15.7:0/1760853887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa544102000 0x7fa544102fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.008+0000 7fa5493cd640 1 -- 172.21.15.7:0/1760853887 >> 172.21.15.7:0/1760853887 conn(0x7fa544079e40 msgr2=0x7fa5441075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.008+0000 7fa5493cd640 1 -- 172.21.15.7:0/1760853887 shutdown_connections 2024-09-21T05:45:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:51.008+0000 7fa5493cd640 1 -- 172.21.15.7:0/1760853887 wait complete. 2024-09-21T05:45:52.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:52 smithi007 ceph-mon[30983]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:52.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:52 smithi119 ceph-mon[34833]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:52.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:52 smithi027 ceph-mon[34364]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:52.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.605+0000 7f6897820640 1 -- 172.21.15.7:0/1533132807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6890102650 msgr2=0x7f6890102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:52.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.605+0000 7f6897820640 1 --2- 172.21.15.7:0/1533132807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6890102650 0x7f6890102a60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f688c009900 tx=0x7f688c02a480 comp rx=0 tx=0).stop 2024-09-21T05:45:52.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.605+0000 7f6897820640 1 -- 172.21.15.7:0/1533132807 shutdown_connections 2024-09-21T05:45:52.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.605+0000 7f6897820640 1 --2- 172.21.15.7:0/1533132807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6890110200 0x7f6890112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:52.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.605+0000 7f6897820640 1 --2- 172.21.15.7:0/1533132807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6890102fa0 0x7f689010fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:52.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.605+0000 7f6897820640 1 --2- 172.21.15.7:0/1533132807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6890102650 0x7f6890102a60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:52.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.605+0000 7f6897820640 1 -- 172.21.15.7:0/1533132807 >> 172.21.15.7:0/1533132807 conn(0x7f6890079760 msgr2=0x7f6890079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:52.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.605+0000 7f6897820640 1 -- 172.21.15.7:0/1533132807 shutdown_connections 2024-09-21T05:45:52.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.605+0000 7f6897820640 1 -- 172.21.15.7:0/1533132807 wait complete. 2024-09-21T05:45:52.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.606+0000 7f6897820640 1 Processor -- start 2024-09-21T05:45:52.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.606+0000 7f6897820640 1 -- start start 2024-09-21T05:45:52.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6897820640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6890102650 0x7f689019c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:52.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6897820640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6890102fa0 0x7f689019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:52.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6897820640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6890110200 0x7f68901a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:52.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6897820640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6890115c70 con 0x7f6890110200 2024-09-21T05:45:52.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6897820640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6890115af0 con 0x7f6890102650 2024-09-21T05:45:52.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6897820640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6890115df0 con 0x7f6890102fa0 2024-09-21T05:45:52.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f68955bc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6890102650 0x7f689019c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:52.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6895dbd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6890110200 0x7f68901a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:52.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f68955bc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6890102650 0x7f689019c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:49434/0 (socket says 172.21.15.7:49434) 2024-09-21T05:45:52.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f68955bc640 1 -- 172.21.15.7:0/621379009 learned_addr learned my addr 172.21.15.7:0/621379009 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:52.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6894dbb640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6890102fa0 0x7f689019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:52.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6895dbd640 1 -- 172.21.15.7:0/621379009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6890102fa0 msgr2=0x7f689019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:52.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6895dbd640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6890102fa0 0x7f689019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:52.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6895dbd640 1 -- 172.21.15.7:0/621379009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6890102650 msgr2=0x7f689019c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:52.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6895dbd640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6890102650 0x7f689019c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:52.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6895dbd640 1 -- 172.21.15.7:0/621379009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68901a25b0 con 0x7f6890110200 2024-09-21T05:45:52.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6894dbb640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6890102fa0 0x7f689019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:45:52.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f68955bc640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6890102650 0x7f689019c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:45:52.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.607+0000 7f6895dbd640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6890110200 0x7f68901a1e80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6888009fd0 tx=0x7f688800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:52.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.608+0000 7f68867fc640 1 -- 172.21.15.7:0/621379009 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688800ce20 con 0x7f6890110200 2024-09-21T05:45:52.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.608+0000 7f68867fc640 1 -- 172.21.15.7:0/621379009 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6888005020 con 0x7f6890110200 2024-09-21T05:45:52.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.608+0000 7f6897820640 1 -- 172.21.15.7:0/621379009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68901a28a0 con 0x7f6890110200 2024-09-21T05:45:52.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.608+0000 7f68867fc640 1 -- 172.21.15.7:0/621379009 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888010690 con 0x7f6890110200 2024-09-21T05:45:52.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.608+0000 7f6897820640 1 -- 172.21.15.7:0/621379009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68901a9000 con 0x7f6890110200 2024-09-21T05:45:52.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.609+0000 7f6897820640 1 -- 172.21.15.7:0/621379009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f689006c1f0 con 0x7f6890110200 2024-09-21T05:45:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.610+0000 7f68867fc640 1 -- 172.21.15.7:0/621379009 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f68880054d0 con 0x7f6890110200 2024-09-21T05:45:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.611+0000 7f68867fc640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f687c0b6550 0x7f687c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.611+0000 7f68955bc640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f687c0b6550 0x7f687c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.611+0000 7f68867fc640 1 -- 172.21.15.7:0/621379009 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f68880e5f20 con 0x7f6890110200 2024-09-21T05:45:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.612+0000 7f68955bc640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f687c0b6550 0x7f687c0b8a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f688c031440 tx=0x7f688c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:52.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.614+0000 7f68867fc640 1 -- 172.21.15.7:0/621379009 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f68880ae310 con 0x7f6890110200 2024-09-21T05:45:52.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.805+0000 7f6897820640 1 -- 172.21.15.7:0/621379009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f6890102a60 con 0x7f6890110200 2024-09-21T05:45:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.809+0000 7f68867fc640 1 -- 172.21.15.7:0/621379009 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f6890102a60 con 0x7f6890110200 2024-09-21T05:45:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.811+0000 7f6897820640 1 -- 172.21.15.7:0/621379009 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f687c0b6550 msgr2=0x7f687c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.811+0000 7f6897820640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f687c0b6550 0x7f687c0b8a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f688c031440 tx=0x7f688c0058d0 comp rx=0 tx=0).stop 2024-09-21T05:45:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.811+0000 7f6897820640 1 -- 172.21.15.7:0/621379009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6890110200 msgr2=0x7f68901a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.811+0000 7f6897820640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6890110200 0x7f68901a1e80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6888009fd0 tx=0x7f688800ef10 comp rx=0 tx=0).stop 2024-09-21T05:45:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.811+0000 7f6897820640 1 -- 172.21.15.7:0/621379009 shutdown_connections 2024-09-21T05:45:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.812+0000 7f6897820640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f687c0b6550 0x7f687c0b8a60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.812+0000 7f6897820640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6890110200 0x7f68901a1e80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.812+0000 7f6897820640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6890102fa0 0x7f689019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.812+0000 7f6897820640 1 --2- 172.21.15.7:0/621379009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6890102650 0x7f689019c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.812+0000 7f6897820640 1 -- 172.21.15.7:0/621379009 >> 172.21.15.7:0/621379009 conn(0x7f6890079760 msgr2=0x7f6890109d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.812+0000 7f6897820640 1 -- 172.21.15.7:0/621379009 shutdown_connections 2024-09-21T05:45:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:52.812+0000 7f6897820640 1 -- 172.21.15.7:0/621379009 wait complete. 2024-09-21T05:45:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:53 smithi007 ceph-mon[30983]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:54.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:53 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/621379009' entity='client.admin' 2024-09-21T05:45:54.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:53 smithi119 ceph-mon[34833]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:54.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:53 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/621379009' entity='client.admin' 2024-09-21T05:45:54.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:53 smithi027 ceph-mon[34364]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:53 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/621379009' entity='client.admin' 2024-09-21T05:45:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:55.222 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi007') 2024-09-21T05:45:55.222 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi007') 2024-09-21T05:45:55.222 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi007') 2024-09-21T05:45:55.223 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi007') 2024-09-21T05:45:55.223 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi007') 2024-09-21T05:45:55.223 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi007') 2024-09-21T05:45:55.223 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi007') 2024-09-21T05:45:55.223 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi007') 2024-09-21T05:45:55.223 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi007') 2024-09-21T05:45:55.223 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi007') 2024-09-21T05:45:55.223 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi007') 2024-09-21T05:45:55.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:55 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:55.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:55 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:55.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:55 smithi027 ceph-mon[34364]: Reconfiguring mon.c (monmap changed)... 2024-09-21T05:45:55.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:55 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:55.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:55 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:45:55.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:55 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:55.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:55 smithi027 ceph-mon[34364]: Reconfiguring daemon mon.c on smithi119 2024-09-21T05:45:55.477 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:55 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:55.478 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:55 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:55.478 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:55 smithi119 ceph-mon[34833]: Reconfiguring mon.c (monmap changed)... 2024-09-21T05:45:55.478 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:55 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:55.478 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:55 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:45:55.478 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:55 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:55.478 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:55 smithi119 ceph-mon[34833]: Reconfiguring daemon mon.c on smithi119 2024-09-21T05:45:55.478 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:55 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:55.478 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:55 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:55.478 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:55 smithi007 ceph-mon[30983]: Reconfiguring mon.c (monmap changed)... 2024-09-21T05:45:55.478 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:55 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:45:55.479 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:55 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:45:55.479 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:55 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:55.479 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:55 smithi007 ceph-mon[30983]: Reconfiguring daemon mon.c on smithi119 2024-09-21T05:45:55.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.701+0000 7f0f8d524640 1 -- 172.21.15.7:0/3135995903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f881083d0 msgr2=0x7f0f881087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:55.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.701+0000 7f0f8d524640 1 --2- 172.21.15.7:0/3135995903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f881083d0 0x7f0f881087e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009900 tx=0x7f0f7c02a410 comp rx=0 tx=0).stop 2024-09-21T05:45:55.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.701+0000 7f0f8d524640 1 -- 172.21.15.7:0/3135995903 shutdown_connections 2024-09-21T05:45:55.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.701+0000 7f0f8d524640 1 --2- 172.21.15.7:0/3135995903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f881083d0 0x7f0f881087e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:55.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.701+0000 7f0f8d524640 1 --2- 172.21.15.7:0/3135995903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f88108d20 0x7f0f8810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:55.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.701+0000 7f0f8d524640 1 --2- 172.21.15.7:0/3135995903 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f88102ae0 0x7f0f88102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:55.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.701+0000 7f0f8d524640 1 -- 172.21.15.7:0/3135995903 >> 172.21.15.7:0/3135995903 conn(0x7f0f88079760 msgr2=0x7f0f88079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:55.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.701+0000 7f0f8d524640 1 -- 172.21.15.7:0/3135995903 shutdown_connections 2024-09-21T05:45:55.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.701+0000 7f0f8d524640 1 -- 172.21.15.7:0/3135995903 wait complete. 2024-09-21T05:45:55.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.701+0000 7f0f8d524640 1 Processor -- start 2024-09-21T05:45:55.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f8d524640 1 -- start start 2024-09-21T05:45:55.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f8d524640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f88102ae0 0x7f0f8819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:55.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f8d524640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f881083d0 0x7f0f8819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:55.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f8d524640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f88108d20 0x7f0f8819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:55.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f8d524640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f88112990 con 0x7f0f881083d0 2024-09-21T05:45:55.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f8d524640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0f88112810 con 0x7f0f88102ae0 2024-09-21T05:45:55.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f8d524640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0f88112b10 con 0x7f0f88108d20 2024-09-21T05:45:55.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f867fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f881083d0 0x7f0f8819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:55.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f867fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f881083d0 0x7f0f8819aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53334/0 (socket says 172.21.15.7:53334) 2024-09-21T05:45:55.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f867fc640 1 -- 172.21.15.7:0/2908851084 learned_addr learned my addr 172.21.15.7:0/2908851084 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:55.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f86ffd640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f88102ae0 0x7f0f8819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:55.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f877fe640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f88108d20 0x7f0f8819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:55.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f867fc640 1 -- 172.21.15.7:0/2908851084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f88108d20 msgr2=0x7f0f8819fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:55.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f867fc640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f88108d20 0x7f0f8819fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:55.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f867fc640 1 -- 172.21.15.7:0/2908851084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f88102ae0 msgr2=0x7f0f8819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:55.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f867fc640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f88102ae0 0x7f0f8819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:55.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f867fc640 1 -- 172.21.15.7:0/2908851084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f881a0460 con 0x7f0f881083d0 2024-09-21T05:45:55.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.702+0000 7f0f86ffd640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f88102ae0 0x7f0f8819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:45:55.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.703+0000 7f0f867fc640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f881083d0 0x7f0f8819aa90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c006010 tx=0x7f0f7c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:55.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.703+0000 7f0f6ffff640 1 -- 172.21.15.7:0/2908851084 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c03f030 con 0x7f0f881083d0 2024-09-21T05:45:55.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.703+0000 7f0f8d524640 1 -- 172.21.15.7:0/2908851084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f881a06f0 con 0x7f0f881083d0 2024-09-21T05:45:55.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.703+0000 7f0f6ffff640 1 -- 172.21.15.7:0/2908851084 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f7c003aa0 con 0x7f0f881083d0 2024-09-21T05:45:55.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.703+0000 7f0f6ffff640 1 -- 172.21.15.7:0/2908851084 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c035070 con 0x7f0f881083d0 2024-09-21T05:45:55.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.703+0000 7f0f8d524640 1 -- 172.21.15.7:0/2908851084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f881a6eb0 con 0x7f0f881083d0 2024-09-21T05:45:55.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.704+0000 7f0f8d524640 1 -- 172.21.15.7:0/2908851084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f88103d10 con 0x7f0f881083d0 2024-09-21T05:45:55.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.706+0000 7f0f6ffff640 1 -- 172.21.15.7:0/2908851084 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f0f7c042030 con 0x7f0f881083d0 2024-09-21T05:45:55.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.706+0000 7f0f6ffff640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0f700b64d0 0x7f0f700b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:55.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.707+0000 7f0f86ffd640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0f700b64d0 0x7f0f700b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:55.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.707+0000 7f0f6ffff640 1 -- 172.21.15.7:0/2908851084 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0f7c106070 con 0x7f0f881083d0 2024-09-21T05:45:55.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.707+0000 7f0f86ffd640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0f700b64d0 0x7f0f700b89e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009c20 tx=0x7f0f78005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:55.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.710+0000 7f0f6ffff640 1 -- 172.21.15.7:0/2908851084 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f7c0ce500 con 0x7f0f881083d0 2024-09-21T05:45:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.899+0000 7f0f8d524640 1 -- 172.21.15.7:0/2908851084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f0f8810bb60 con 0x7f0f881083d0 2024-09-21T05:45:55.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.903+0000 7f0f6ffff640 1 -- 172.21.15.7:0/2908851084 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v37)=0 v37) ==== 120+0+0 (secure 0 0 0) 0x7f0f7c0d28e0 con 0x7f0f881083d0 2024-09-21T05:45:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.905+0000 7f0f8d524640 1 -- 172.21.15.7:0/2908851084 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0f700b64d0 msgr2=0x7f0f700b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.905+0000 7f0f8d524640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0f700b64d0 0x7f0f700b89e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009c20 tx=0x7f0f78005f90 comp rx=0 tx=0).stop 2024-09-21T05:45:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.905+0000 7f0f8d524640 1 -- 172.21.15.7:0/2908851084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f881083d0 msgr2=0x7f0f8819aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.905+0000 7f0f8d524640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f881083d0 0x7f0f8819aa90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c006010 tx=0x7f0f7c004060 comp rx=0 tx=0).stop 2024-09-21T05:45:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.905+0000 7f0f8d524640 1 -- 172.21.15.7:0/2908851084 shutdown_connections 2024-09-21T05:45:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.905+0000 7f0f8d524640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0f700b64d0 0x7f0f700b89e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.905+0000 7f0f8d524640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f881083d0 0x7f0f8819aa90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.905+0000 7f0f8d524640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f88108d20 0x7f0f8819fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.905+0000 7f0f8d524640 1 --2- 172.21.15.7:0/2908851084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f88102ae0 0x7f0f8819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.905+0000 7f0f8d524640 1 -- 172.21.15.7:0/2908851084 >> 172.21.15.7:0/2908851084 conn(0x7f0f88079760 msgr2=0x7f0f8806bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.905+0000 7f0f8d524640 1 -- 172.21.15.7:0/2908851084 shutdown_connections 2024-09-21T05:45:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:55.905+0000 7f0f8d524640 1 -- 172.21.15.7:0/2908851084 wait complete. 2024-09-21T05:45:56.447 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:56 smithi007 ceph-mon[30983]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:56.447 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:56.447 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:56.447 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:56.447 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:56.447 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:56.447 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:56.448 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:56 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2908851084' entity='client.admin' 2024-09-21T05:45:56.476 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi007') 2024-09-21T05:45:56.476 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi007') 2024-09-21T05:45:56.476 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi007') 2024-09-21T05:45:56.477 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi007') 2024-09-21T05:45:56.477 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi007') 2024-09-21T05:45:56.477 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi007') 2024-09-21T05:45:56.477 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi007') 2024-09-21T05:45:56.477 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi007') 2024-09-21T05:45:56.477 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi007') 2024-09-21T05:45:56.477 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi007') 2024-09-21T05:45:56.477 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '397810bc-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi007') 2024-09-21T05:45:56.477 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T05:45:56.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:56 smithi027 ceph-mon[34364]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:56.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:56 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:56.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:56 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:56.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:56 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:56.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:56 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:56.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:56 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:56.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:56 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:56.479 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:56 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2908851084' entity='client.admin' 2024-09-21T05:45:56.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:56 smithi119 ceph-mon[34833]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:56.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:56 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:56.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:56 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:56.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:56 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:56.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:56 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:56.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:56 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:56.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:56 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:45:56.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:56 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2908851084' entity='client.admin' 2024-09-21T05:45:56.730 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.181+0000 7f5972fbd640 1 -- 172.21.15.7:0/2050486214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c1094c0 msgr2=0x7f596c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.181+0000 7f5972fbd640 1 --2- 172.21.15.7:0/2050486214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c1094c0 0x7f596c1098d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5958009900 tx=0x7f595802a410 comp rx=0 tx=0).stop 2024-09-21T05:45:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.181+0000 7f5972fbd640 1 -- 172.21.15.7:0/2050486214 shutdown_connections 2024-09-21T05:45:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.181+0000 7f5972fbd640 1 --2- 172.21.15.7:0/2050486214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c1094c0 0x7f596c1098d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.181+0000 7f5972fbd640 1 --2- 172.21.15.7:0/2050486214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f596c109e10 0x7f596c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.181+0000 7f5972fbd640 1 --2- 172.21.15.7:0/2050486214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f596c103b80 0x7f596c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.181+0000 7f5972fbd640 1 -- 172.21.15.7:0/2050486214 >> 172.21.15.7:0/2050486214 conn(0x7f596c0ff610 msgr2=0x7f596c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.181+0000 7f5972fbd640 1 -- 172.21.15.7:0/2050486214 shutdown_connections 2024-09-21T05:45:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.181+0000 7f5972fbd640 1 -- 172.21.15.7:0/2050486214 wait complete. 2024-09-21T05:45:57.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.182+0000 7f5972fbd640 1 Processor -- start 2024-09-21T05:45:57.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.182+0000 7f5972fbd640 1 -- start start 2024-09-21T05:45:57.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.182+0000 7f5972fbd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f596c103b80 0x7f596c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:57.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.182+0000 7f5972fbd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c1094c0 0x7f596c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.182+0000 7f5972fbd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f596c109e10 0x7f596c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.182+0000 7f5972fbd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f596c113ad0 con 0x7f596c1094c0 2024-09-21T05:45:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.182+0000 7f5972fbd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f596c113950 con 0x7f596c109e10 2024-09-21T05:45:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.182+0000 7f5972fbd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f596c113c50 con 0x7f596c103b80 2024-09-21T05:45:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.182+0000 7f596bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c1094c0 0x7f596c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f596bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c1094c0 0x7f596c19aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53360/0 (socket says 172.21.15.7:53360) 2024-09-21T05:45:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f596bfff640 1 -- 172.21.15.7:0/2307010141 learned_addr learned my addr 172.21.15.7:0/2307010141 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:45:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f5970d59640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f596c103b80 0x7f596c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f597155a640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f596c109e10 0x7f596c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f596bfff640 1 -- 172.21.15.7:0/2307010141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f596c103b80 msgr2=0x7f596c19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f596bfff640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f596c103b80 0x7f596c19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f596bfff640 1 -- 172.21.15.7:0/2307010141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f596c109e10 msgr2=0x7f596c19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:57.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f596bfff640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f596c109e10 0x7f596c19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f596bfff640 1 -- 172.21.15.7:0/2307010141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c1a0430 con 0x7f596c1094c0 2024-09-21T05:45:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f596bfff640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c1094c0 0x7f596c19aa60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f595802a930 tx=0x7f5958031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f5969ffb640 1 -- 172.21.15.7:0/2307010141 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595803f030 con 0x7f596c1094c0 2024-09-21T05:45:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f5969ffb640 1 -- 172.21.15.7:0/2307010141 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5958004490 con 0x7f596c1094c0 2024-09-21T05:45:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f5972fbd640 1 -- 172.21.15.7:0/2307010141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c1a06c0 con 0x7f596c1094c0 2024-09-21T05:45:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.183+0000 7f5969ffb640 1 -- 172.21.15.7:0/2307010141 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5958035070 con 0x7f596c1094c0 2024-09-21T05:45:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.184+0000 7f5972fbd640 1 -- 172.21.15.7:0/2307010141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c1a6e80 con 0x7f596c1094c0 2024-09-21T05:45:57.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.184+0000 7f5972fbd640 1 -- 172.21.15.7:0/2307010141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f596c103f90 con 0x7f596c1094c0 2024-09-21T05:45:57.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.187+0000 7f5969ffb640 1 -- 172.21.15.7:0/2307010141 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f5958042030 con 0x7f596c1094c0 2024-09-21T05:45:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.188+0000 7f5969ffb640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f595c0b6550 0x7f595c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.188+0000 7f5970d59640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f595c0b6550 0x7f595c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.188+0000 7f5969ffb640 1 -- 172.21.15.7:0/2307010141 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5958105e20 con 0x7f596c1094c0 2024-09-21T05:45:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.188+0000 7f5970d59640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f595c0b6550 0x7f595c0b8a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5960009bd0 tx=0x7f5960005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.191+0000 7f5969ffb640 1 -- 172.21.15.7:0/2307010141 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f59580d25f0 con 0x7f596c1094c0 2024-09-21T05:45:57.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.380+0000 7f5972fbd640 1 -- 172.21.15.7:0/2307010141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f596c19b5f0 con 0x7f596c1094c0 2024-09-21T05:45:57.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.381+0000 7f5969ffb640 1 -- 172.21.15.7:0/2307010141 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+22330 (secure 0 0 0) 0x7f59580d7530 con 0x7f596c1094c0 2024-09-21T05:45:57.383 INFO:teuthology.orchestra.run.smithi007.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T05:45:57.383 INFO:teuthology.orchestra.run.smithi007.stdout:global dev auth_debug true 2024-09-21T05:45:57.384 INFO:teuthology.orchestra.run.smithi007.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T05:45:57.384 INFO:teuthology.orchestra.run.smithi007.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T05:45:57.384 INFO:teuthology.orchestra.run.smithi007.stdout:global basic log_to_file true 2024-09-21T05:45:57.384 INFO:teuthology.orchestra.run.smithi007.stdout:global basic log_to_journald false 2024-09-21T05:45:57.384 INFO:teuthology.orchestra.run.smithi007.stdout:global basic log_to_stderr false 2024-09-21T05:45:57.384 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_allow_pool_delete true 2024-09-21T05:45:57.384 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T05:45:57.384 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T05:45:57.384 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T05:45:57.384 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T05:45:57.384 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T05:45:57.384 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:global dev ms_die_on_bug true 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:global dev ms_die_on_old_message true 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:global dev ms_die_on_skipped_message false 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced debug_mon 20/20 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced debug_ms 1/1 2024-09-21T05:45:57.385 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced debug_paxos 20/20 2024-09-21T05:45:57.386 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T05:45:57.386 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T05:45:57.386 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T05:45:57.386 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T05:45:57.386 INFO:teuthology.orchestra.run.smithi007.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T05:45:57.386 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T05:45:57.386 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T05:45:57.386 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T05:45:57.386 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T05:45:57.386 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T05:45:57.386 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T05:45:57.386 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T05:45:57.386 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced client_mount_timeout 30 2024-09-21T05:45:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced debug_cephsqlite 20/20 2024-09-21T05:45:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced debug_client 20/20 2024-09-21T05:45:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced debug_mgr 20/20 2024-09-21T05:45:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced debug_ms 1/1 2024-09-21T05:45:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T05:45:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T05:45:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T05:45:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T05:45:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T05:45:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2024-09-21T05:45:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2024-09-21T05:45:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/snap_schedule/log_level debug 2024-09-21T05:45:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev bdev_debug_aio true 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced bdev_enable_discard true 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced bluestore_allocator bitmap * 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced debug_bluefs 1/20 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced debug_bluestore 1/20 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced debug_ms 1/1 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced debug_osd 20/20 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced debug_rocksdb 4/10 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T05:45:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_op_order true 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_shutdown true 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T05:45:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced debug_mds 20/20 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced debug_ms 2/2 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced mds_bal_split_size 100 2024-09-21T05:45:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:mds dev mds_debug_frag true 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:mds dev mds_debug_scatterstat true 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:mds dev mds_verify_scatter true 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:client advanced client_mount_timeout 600 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:client advanced debug_client 20/20 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:client advanced debug_ms 1/1 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T05:45:57.391 INFO:teuthology.orchestra.run.smithi007.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T05:45:57.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.383+0000 7f5972fbd640 1 -- 172.21.15.7:0/2307010141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f595c0b6550 msgr2=0x7f595c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:57.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.383+0000 7f5972fbd640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f595c0b6550 0x7f595c0b8a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5960009bd0 tx=0x7f5960005f90 comp rx=0 tx=0).stop 2024-09-21T05:45:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.383+0000 7f5972fbd640 1 -- 172.21.15.7:0/2307010141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c1094c0 msgr2=0x7f596c19aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.383+0000 7f5972fbd640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c1094c0 0x7f596c19aa60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f595802a930 tx=0x7f5958031a20 comp rx=0 tx=0).stop 2024-09-21T05:45:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.383+0000 7f5972fbd640 1 -- 172.21.15.7:0/2307010141 shutdown_connections 2024-09-21T05:45:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.383+0000 7f5972fbd640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f595c0b6550 0x7f595c0b8a60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.383+0000 7f5972fbd640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c1094c0 0x7f596c19aa60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.383+0000 7f5972fbd640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f596c109e10 0x7f596c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.383+0000 7f5972fbd640 1 --2- 172.21.15.7:0/2307010141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f596c103b80 0x7f596c19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.383+0000 7f5972fbd640 1 -- 172.21.15.7:0/2307010141 >> 172.21.15.7:0/2307010141 conn(0x7f596c0ff610 msgr2=0x7f596c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.384+0000 7f5972fbd640 1 -- 172.21.15.7:0/2307010141 shutdown_connections 2024-09-21T05:45:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:45:57.384+0000 7f5972fbd640 1 -- 172.21.15.7:0/2307010141 wait complete. 2024-09-21T05:45:57.917 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T05:45:57.918 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:45:57.918 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T05:45:57.936 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T05:45:57.936 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-09-21T05:45:57.992 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T05:45:57.992 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:45:57.992 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T05:45:57.992 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:45:57.992 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:45:57.993 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 05:44:35.403414141 +0000 2024-09-21T05:45:57.993 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 05:39:35.808111670 +0000 2024-09-21T05:45:57.993 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 05:39:35.808111670 +0000 2024-09-21T05:45:57.993 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-21 05:39:35.808111670 +0000 2024-09-21T05:45:57.993 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T05:45:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-21T05:45:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-21T05:45:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000111903 s, 4.6 MB/s 2024-09-21T05:45:58.060 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T05:45:58.117 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-09-21T05:45:58.172 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T05:45:58.172 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:45:58.172 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T05:45:58.172 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:45:58.172 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:45:58.173 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 05:44:35.438413621 +0000 2024-09-21T05:45:58.173 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 05:39:36.130106761 +0000 2024-09-21T05:45:58.173 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 05:39:36.130106761 +0000 2024-09-21T05:45:58.173 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-21 05:39:36.130106761 +0000 2024-09-21T05:45:58.173 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T05:45:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-21T05:45:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-21T05:45:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000107328 s, 4.8 MB/s 2024-09-21T05:45:58.238 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T05:45:58.295 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-09-21T05:45:58.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:58 smithi007 ceph-mon[30983]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:58.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:45:58 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2307010141' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T05:45:58.333 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T05:45:58.333 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:45:58.333 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T05:45:58.333 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:45:58.334 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:45:58.334 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 05:44:35.473413101 +0000 2024-09-21T05:45:58.334 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 05:39:36.447101929 +0000 2024-09-21T05:45:58.334 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 05:39:36.447101929 +0000 2024-09-21T05:45:58.334 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-21 05:39:36.447101929 +0000 2024-09-21T05:45:58.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T05:45:58.397 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-21T05:45:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-21T05:45:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 9.4736e-05 s, 5.4 MB/s 2024-09-21T05:45:58.399 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T05:45:58.455 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-09-21T05:45:58.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:58 smithi027 ceph-mon[34364]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:58.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:45:58 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2307010141' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T05:45:58.511 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T05:45:58.512 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:45:58.512 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T05:45:58.512 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:45:58.512 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:45:58.512 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 05:44:35.510412551 +0000 2024-09-21T05:45:58.512 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 05:39:36.771096990 +0000 2024-09-21T05:45:58.512 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 05:39:36.771096990 +0000 2024-09-21T05:45:58.512 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-21 05:39:36.771096990 +0000 2024-09-21T05:45:58.512 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T05:45:58.576 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-21T05:45:58.576 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-21T05:45:58.576 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 9.4202e-05 s, 5.4 MB/s 2024-09-21T05:45:58.577 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T05:45:58.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:58 smithi119 ceph-mon[34833]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:45:58.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:45:58 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2307010141' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T05:45:58.635 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-21T05:45:58.635 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T05:45:58.655 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T05:45:58.655 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_1 2024-09-21T05:45:58.715 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T05:45:58.715 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:45:58.715 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 670 Links: 1 2024-09-21T05:45:58.715 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:45:58.715 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:45:58.715 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-21 05:45:31.263881410 +0000 2024-09-21T05:45:58.715 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-21 05:39:52.703193153 +0000 2024-09-21T05:45:58.715 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-21 05:39:52.703193153 +0000 2024-09-21T05:45:58.715 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-21 05:39:52.703193153 +0000 2024-09-21T05:45:58.716 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T05:45:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-21T05:45:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-21T05:45:58.787 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.00028607 s, 1.8 MB/s 2024-09-21T05:45:58.788 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T05:45:58.848 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_2 2024-09-21T05:45:58.906 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T05:45:58.906 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:45:58.906 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-09-21T05:45:58.906 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:45:58.907 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:45:58.907 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-21 05:45:31.264881384 +0000 2024-09-21T05:45:58.907 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-21 05:39:53.033184371 +0000 2024-09-21T05:45:58.907 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-21 05:39:53.033184371 +0000 2024-09-21T05:45:58.907 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-21 05:39:53.033184371 +0000 2024-09-21T05:45:58.907 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T05:45:58.973 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-21T05:45:58.973 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-21T05:45:58.973 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.00026736 s, 1.9 MB/s 2024-09-21T05:45:58.975 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T05:45:59.032 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_3 2024-09-21T05:45:59.090 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T05:45:59.090 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:45:59.090 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 710 Links: 1 2024-09-21T05:45:59.090 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:45:59.090 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:45:59.090 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-21 05:45:31.264881384 +0000 2024-09-21T05:45:59.090 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-21 05:39:53.360175668 +0000 2024-09-21T05:45:59.090 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-21 05:39:53.360175668 +0000 2024-09-21T05:45:59.090 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-21 05:39:53.360175668 +0000 2024-09-21T05:45:59.091 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T05:45:59.156 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-21T05:45:59.156 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-21T05:45:59.156 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000202768 s, 2.5 MB/s 2024-09-21T05:45:59.157 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T05:45:59.215 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_4 2024-09-21T05:45:59.270 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T05:45:59.271 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:45:59.271 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 729 Links: 1 2024-09-21T05:45:59.271 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:45:59.271 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:45:59.271 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-21 05:45:31.264881384 +0000 2024-09-21T05:45:59.271 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-21 05:39:53.688166939 +0000 2024-09-21T05:45:59.271 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-21 05:39:53.688166939 +0000 2024-09-21T05:45:59.271 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-21 05:39:53.688166939 +0000 2024-09-21T05:45:59.271 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T05:45:59.335 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-21T05:45:59.335 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-21T05:45:59.335 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000209398 s, 2.4 MB/s 2024-09-21T05:45:59.336 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T05:45:59.393 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T05:45:59.393 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T05:45:59.413 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T05:45:59.413 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-09-21T05:45:59.473 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T05:45:59.473 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:45:59.473 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T05:45:59.473 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:45:59.473 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:45:59.473 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-21 05:45:29.092281640 +0000 2024-09-21T05:45:59.473 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-21 05:39:47.241842971 +0000 2024-09-21T05:45:59.473 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-21 05:39:47.241842971 +0000 2024-09-21T05:45:59.473 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-21 05:39:47.241842971 +0000 2024-09-21T05:45:59.473 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T05:45:59.543 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-21T05:45:59.543 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-21T05:45:59.543 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000279349 s, 1.8 MB/s 2024-09-21T05:45:59.545 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T05:45:59.605 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-09-21T05:45:59.664 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T05:45:59.664 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:45:59.664 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T05:45:59.665 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:45:59.665 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:45:59.665 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-21 05:45:29.093281616 +0000 2024-09-21T05:45:59.665 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-21 05:39:47.572834752 +0000 2024-09-21T05:45:59.665 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-21 05:39:47.572834752 +0000 2024-09-21T05:45:59.665 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-21 05:39:47.572834752 +0000 2024-09-21T05:45:59.665 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T05:45:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-21T05:45:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-21T05:45:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000258656 s, 2.0 MB/s 2024-09-21T05:45:59.733 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T05:45:59.793 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-09-21T05:45:59.851 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T05:45:59.851 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:45:59.851 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-21T05:45:59.851 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:45:59.851 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:45:59.851 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-21 05:45:29.093281616 +0000 2024-09-21T05:45:59.852 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-21 05:39:47.896826707 +0000 2024-09-21T05:45:59.852 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-21 05:39:47.896826707 +0000 2024-09-21T05:45:59.852 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-21 05:39:47.896826707 +0000 2024-09-21T05:45:59.852 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T05:45:59.919 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-21T05:45:59.919 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-21T05:45:59.919 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000206503 s, 2.5 MB/s 2024-09-21T05:45:59.920 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T05:45:59.979 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-09-21T05:46:00.036 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T05:46:00.036 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:46:00.036 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T05:46:00.036 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:46:00.036 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:46:00.036 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-21 05:45:29.093281616 +0000 2024-09-21T05:46:00.036 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-21 05:39:48.210818910 +0000 2024-09-21T05:46:00.036 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-21 05:39:48.210818910 +0000 2024-09-21T05:46:00.036 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-21 05:39:48.210818910 +0000 2024-09-21T05:46:00.037 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T05:46:00.101 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-21T05:46:00.101 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-21T05:46:00.101 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000200144 s, 2.6 MB/s 2024-09-21T05:46:00.103 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T05:46:00.160 INFO:tasks.cephadm:Deploying osd.0 on smithi007 with /dev/vg_nvme/lv_4... 2024-09-21T05:46:00.160 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T05:46:00.424 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:00.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:00 smithi027 ceph-mon[34364]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:00.545 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:00 smithi007 ceph-mon[30983]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:00.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:00 smithi119 ceph-mon[34833]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:02.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:02 smithi027 ceph-mon[34364]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:02.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:02 smithi007 ceph-mon[30983]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:02.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:02 smithi119 ceph-mon[34833]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:02.791 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:46:02.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi007:vg_nvme/lv_4 2024-09-21T05:46:03.079 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:46:03.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.530+0000 7f6951d9e640 1 -- 172.21.15.7:0/3668079587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c1083d0 msgr2=0x7f694c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:03.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.530+0000 7f6951d9e640 1 --2- 172.21.15.7:0/3668079587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c1083d0 0x7f694c1087e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6940009900 tx=0x7f694002a410 comp rx=0 tx=0).stop 2024-09-21T05:46:03.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.531+0000 7f6951d9e640 1 -- 172.21.15.7:0/3668079587 shutdown_connections 2024-09-21T05:46:03.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.531+0000 7f6951d9e640 1 --2- 172.21.15.7:0/3668079587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c1083d0 0x7f694c1087e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:03.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.531+0000 7f6951d9e640 1 --2- 172.21.15.7:0/3668079587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f694c108d20 0x7f694c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:03.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.531+0000 7f6951d9e640 1 --2- 172.21.15.7:0/3668079587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f694c102ae0 0x7f694c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:03.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.531+0000 7f6951d9e640 1 -- 172.21.15.7:0/3668079587 >> 172.21.15.7:0/3668079587 conn(0x7f694c0797b0 msgr2=0x7f694c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:03.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.531+0000 7f6951d9e640 1 -- 172.21.15.7:0/3668079587 shutdown_connections 2024-09-21T05:46:03.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.531+0000 7f6951d9e640 1 -- 172.21.15.7:0/3668079587 wait complete. 2024-09-21T05:46:03.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.531+0000 7f6951d9e640 1 Processor -- start 2024-09-21T05:46:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f6951d9e640 1 -- start start 2024-09-21T05:46:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f6951d9e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f694c102ae0 0x7f694c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f6951d9e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c1083d0 0x7f694c199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f6951d9e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f694c108d20 0x7f694c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f6951d9e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f694c1129e0 con 0x7f694c1083d0 2024-09-21T05:46:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f6951d9e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f694c112860 con 0x7f694c108d20 2024-09-21T05:46:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f6951d9e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f694c112b60 con 0x7f694c102ae0 2024-09-21T05:46:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f694affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c1083d0 0x7f694c199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f694affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c1083d0 0x7f694c199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33396/0 (socket says 172.21.15.7:33396) 2024-09-21T05:46:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f694affd640 1 -- 172.21.15.7:0/1896060910 learned_addr learned my addr 172.21.15.7:0/1896060910 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:46:03.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f694b7fe640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f694c102ae0 0x7f694c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f694bfff640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f694c108d20 0x7f694c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f694affd640 1 -- 172.21.15.7:0/1896060910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f694c102ae0 msgr2=0x7f694c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f694affd640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f694c102ae0 0x7f694c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f694affd640 1 -- 172.21.15.7:0/1896060910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f694c108d20 msgr2=0x7f694c19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f694affd640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f694c108d20 0x7f694c19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.532+0000 7f694affd640 1 -- 172.21.15.7:0/1896060910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694c19f300 con 0x7f694c1083d0 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.533+0000 7f694bfff640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f694c108d20 0x7f694c19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.533+0000 7f694affd640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c1083d0 0x7f694c199930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f694002a930 tx=0x7f6940004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.533+0000 7f6948ff9640 1 -- 172.21.15.7:0/1896060910 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694003f030 con 0x7f694c1083d0 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.533+0000 7f6951d9e640 1 -- 172.21.15.7:0/1896060910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f694c19f590 con 0x7f694c1083d0 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.533+0000 7f6948ff9640 1 -- 172.21.15.7:0/1896060910 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6940003aa0 con 0x7f694c1083d0 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.533+0000 7f6948ff9640 1 -- 172.21.15.7:0/1896060910 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940035070 con 0x7f694c1083d0 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.533+0000 7f6951d9e640 1 -- 172.21.15.7:0/1896060910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f694c1a5d50 con 0x7f694c1083d0 2024-09-21T05:46:03.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.534+0000 7f6951d9e640 1 -- 172.21.15.7:0/1896060910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f694c102ef0 con 0x7f694c1083d0 2024-09-21T05:46:03.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.536+0000 7f6948ff9640 1 -- 172.21.15.7:0/1896060910 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f6940042030 con 0x7f694c1083d0 2024-09-21T05:46:03.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.537+0000 7f6948ff9640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69340b64d0 0x7f69340b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:03.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.537+0000 7f694b7fe640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69340b64d0 0x7f69340b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:03.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.537+0000 7f6948ff9640 1 -- 172.21.15.7:0/1896060910 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6940106260 con 0x7f694c1083d0 2024-09-21T05:46:03.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.538+0000 7f694b7fe640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69340b64d0 0x7f69340b89e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f693c005d00 tx=0x7f693c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:03.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.540+0000 7f6948ff9640 1 -- 172.21.15.7:0/1896060910 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69400ce650 con 0x7f694c1083d0 2024-09-21T05:46:03.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:03.737+0000 7f6951d9e640 1 -- 172.21.15.7:0/1896060910 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f694c10ab40 con 0x7f69340b64d0 2024-09-21T05:46:04.402 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:04 smithi007 ceph-mon[30983]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:04.402 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:04.402 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:04.402 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:04 smithi027 ceph-mon[34364]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:04.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:04.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:04 smithi119 ceph-mon[34833]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:05.259 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:05 smithi007 ceph-mon[30983]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:05.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:05 smithi027 ceph-mon[34364]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:05.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:05 smithi119 ceph-mon[34833]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:06.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:06 smithi027 ceph-mon[34364]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:06.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:06 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/741746100' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d7a68ba-a599-44a9-a0de-a1d6df51f437"} : dispatch 2024-09-21T05:46:06.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:06 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/741746100' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d7a68ba-a599-44a9-a0de-a1d6df51f437"}]': finished 2024-09-21T05:46:06.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:06 smithi027 ceph-mon[34364]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T05:46:06.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:06 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:06.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:06 smithi007 ceph-mon[30983]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:06.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:06 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/741746100' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d7a68ba-a599-44a9-a0de-a1d6df51f437"} : dispatch 2024-09-21T05:46:06.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:06 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/741746100' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d7a68ba-a599-44a9-a0de-a1d6df51f437"}]': finished 2024-09-21T05:46:06.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:06 smithi007 ceph-mon[30983]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T05:46:06.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:06.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:06 smithi119 ceph-mon[34833]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:06.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:06 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/741746100' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d7a68ba-a599-44a9-a0de-a1d6df51f437"} : dispatch 2024-09-21T05:46:06.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:06 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/741746100' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d7a68ba-a599-44a9-a0de-a1d6df51f437"}]': finished 2024-09-21T05:46:06.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:06 smithi119 ceph-mon[34833]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T05:46:06.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:06 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:07.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:07 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2106760599' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:07.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:07 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2106760599' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:07.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:07 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2106760599' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:08.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:08 smithi027 ceph-mon[34364]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:08.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:08 smithi007 ceph-mon[30983]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:08.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:08 smithi119 ceph-mon[34833]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:10.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:10 smithi027 ceph-mon[34364]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:10.506 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:10 smithi007 ceph-mon[30983]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:10.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:10 smithi119 ceph-mon[34833]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:12.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:12 smithi007 ceph-mon[30983]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:12.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:12 smithi027 ceph-mon[34364]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:12.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:12 smithi119 ceph-mon[34833]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:14.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:14 smithi027 ceph-mon[34364]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:14.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:14 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:46:14.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:14 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:14.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:14 smithi007 ceph-mon[30983]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:14.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:46:14.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:14.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:14 smithi119 ceph-mon[34833]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:14.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:14 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:46:14.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:14 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:15.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:15 smithi027 ceph-mon[34364]: Deploying daemon osd.0 on smithi007 2024-09-21T05:46:15.503 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:15 smithi007 ceph-mon[30983]: Deploying daemon osd.0 on smithi007 2024-09-21T05:46:15.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:15 smithi119 ceph-mon[34833]: Deploying daemon osd.0 on smithi007 2024-09-21T05:46:16.472 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:16 smithi007 ceph-mon[30983]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:16.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:16 smithi027 ceph-mon[34364]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:16.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:16 smithi119 ceph-mon[34833]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:17.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:17 smithi027 ceph-mon[34364]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:17.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:17 smithi007 ceph-mon[30983]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:17.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:17 smithi119 ceph-mon[34833]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:19.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:19 smithi027 ceph-mon[34364]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:19.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:19 smithi007 ceph-mon[30983]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:19.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:19 smithi119 ceph-mon[34833]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:20.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:20 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:20.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:20 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:20.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:20 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:20.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:20 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:20.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:20 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:20.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:20 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:20.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:20 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:20.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:20 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:20.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:20 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:21.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:21 smithi007 ceph-mon[30983]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:21.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:21.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:21.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:21.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:21.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:21.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:21 smithi027 ceph-mon[34364]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:21.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:21.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:21.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:21.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:21.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:22.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:21 smithi119 ceph-mon[34833]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:22.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:22.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:22.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:22.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:22.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:23.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:23 smithi007 ceph-mon[30983]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:23.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:23.731+0000 7f6948ff9640 1 -- 172.21.15.7:0/1896060910 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f694c10ab40 con 0x7f69340b64d0 2024-09-21T05:46:23.733 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 0 on host 'smithi007' 2024-09-21T05:46:23.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:23.734+0000 7f6951d9e640 1 -- 172.21.15.7:0/1896060910 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69340b64d0 msgr2=0x7f69340b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:23.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:23.734+0000 7f6951d9e640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69340b64d0 0x7f69340b89e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f693c005d00 tx=0x7f693c00b410 comp rx=0 tx=0).stop 2024-09-21T05:46:23.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:23.734+0000 7f6951d9e640 1 -- 172.21.15.7:0/1896060910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c1083d0 msgr2=0x7f694c199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:23.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:23.734+0000 7f6951d9e640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c1083d0 0x7f694c199930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f694002a930 tx=0x7f6940004270 comp rx=0 tx=0).stop 2024-09-21T05:46:23.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:23.734+0000 7f6951d9e640 1 -- 172.21.15.7:0/1896060910 shutdown_connections 2024-09-21T05:46:23.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:23.734+0000 7f6951d9e640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69340b64d0 0x7f69340b89e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:23.734+0000 7f6951d9e640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c1083d0 0x7f694c199930 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:23.734+0000 7f6951d9e640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f694c108d20 0x7f694c19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:23.734+0000 7f6951d9e640 1 --2- 172.21.15.7:0/1896060910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f694c102ae0 0x7f694c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:23.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:23.734+0000 7f6951d9e640 1 -- 172.21.15.7:0/1896060910 >> 172.21.15.7:0/1896060910 conn(0x7f694c0797b0 msgr2=0x7f694c106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:23.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:23.735+0000 7f6951d9e640 1 -- 172.21.15.7:0/1896060910 shutdown_connections 2024-09-21T05:46:23.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:46:23.735+0000 7f6951d9e640 1 -- 172.21.15.7:0/1896060910 wait complete. 2024-09-21T05:46:23.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:23 smithi027 ceph-mon[34364]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:23 smithi119 ceph-mon[34833]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:24.379 DEBUG:teuthology.orchestra.run.smithi007:osd.0> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T05:46:24.382 INFO:tasks.cephadm:Deploying osd.1 on smithi027 with /dev/vg_nvme/lv_4... 2024-09-21T05:46:24.382 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T05:46:24.648 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:46:24.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:24.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:24.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:25.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:25.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:25.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:25.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:25.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:25.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:25.547 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 05:46:25 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0[47922]: 2024-09-21T05:46:25.231+0000 7f34fc8e4640 -1 osd.0 0 log_to_monitors true 2024-09-21T05:46:25.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:25 smithi007 ceph-mon[30983]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:25.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:25 smithi007 ceph-mon[30983]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:46:25.875 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:25 smithi027 ceph-mon[34364]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:25.875 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:25 smithi027 ceph-mon[34364]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:46:26.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:25 smithi119 ceph-mon[34833]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:26.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:25 smithi119 ceph-mon[34833]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:46:26.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:26 smithi007 ceph-mon[30983]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:46:26.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:26 smithi007 ceph-mon[30983]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T05:46:26.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:26 smithi007 ceph-mon[30983]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T05:46:26.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:26.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:26 smithi007 ceph-mon[30983]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T05:46:26.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:26 smithi007 ceph-mon[30983]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T05:46:26.947 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:46:26.974 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi027:vg_nvme/lv_4 2024-09-21T05:46:26.998 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:26 smithi027 ceph-mon[34364]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:46:26.998 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:26 smithi027 ceph-mon[34364]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T05:46:26.998 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:26 smithi027 ceph-mon[34364]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T05:46:26.999 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:26.999 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:26 smithi027 ceph-mon[34364]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T05:46:26.999 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:26 smithi027 ceph-mon[34364]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T05:46:27.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:26 smithi119 ceph-mon[34833]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:46:27.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:26 smithi119 ceph-mon[34833]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T05:46:27.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:26 smithi119 ceph-mon[34833]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T05:46:27.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:27.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:26 smithi119 ceph-mon[34833]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T05:46:27.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:26 smithi119 ceph-mon[34833]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T05:46:27.232 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:46:27.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.712+0000 7f315c41e640 1 -- 172.21.15.27:0/3913962147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3154101ff0 msgr2=0x7f3154102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.712+0000 7f315c41e640 1 --2- 172.21.15.27:0/3913962147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3154101ff0 0x7f3154102400 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3144009900 tx=0x7f314402a410 comp rx=0 tx=0).stop 2024-09-21T05:46:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.712+0000 7f315c41e640 1 -- 172.21.15.27:0/3913962147 shutdown_connections 2024-09-21T05:46:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.712+0000 7f315c41e640 1 --2- 172.21.15.27:0/3913962147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31541062d0 0x7f31541066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.712+0000 7f315c41e640 1 --2- 172.21.15.27:0/3913962147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3154106c20 0x7f3154110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.712+0000 7f315c41e640 1 --2- 172.21.15.27:0/3913962147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3154101ff0 0x7f3154102400 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.712+0000 7f315c41e640 1 -- 172.21.15.27:0/3913962147 >> 172.21.15.27:0/3913962147 conn(0x7f3154077cc0 msgr2=0x7f3154078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.712+0000 7f315c41e640 1 -- 172.21.15.27:0/3913962147 shutdown_connections 2024-09-21T05:46:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.712+0000 7f315c41e640 1 -- 172.21.15.27:0/3913962147 wait complete. 2024-09-21T05:46:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.713+0000 7f315c41e640 1 Processor -- start 2024-09-21T05:46:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.713+0000 7f315c41e640 1 -- start start 2024-09-21T05:46:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.713+0000 7f315c41e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3154101ff0 0x7f3154102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.713+0000 7f315c41e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31541062d0 0x7f31541034d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:27.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.713+0000 7f315c41e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154106c20 0x7f3154103a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.713+0000 7f315c41e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3154113ae0 con 0x7f3154106c20 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.713+0000 7f315c41e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3154113960 con 0x7f3154101ff0 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.713+0000 7f315c41e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3154113c60 con 0x7f31541062d0 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.713+0000 7f315a1ba640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3154101ff0 0x7f3154102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.713+0000 7f315a1ba640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3154101ff0 0x7f3154102f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52644/0 (socket says 172.21.15.27:52644) 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.713+0000 7f315a1ba640 1 -- 172.21.15.27:0/259153426 learned_addr learned my addr 172.21.15.27:0/259153426 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f31599b9640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31541062d0 0x7f31541034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f315a9bb640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154106c20 0x7f3154103a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f315a1ba640 1 -- 172.21.15.27:0/259153426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31541062d0 msgr2=0x7f31541034d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f315a1ba640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31541062d0 0x7f31541034d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f315a1ba640 1 -- 172.21.15.27:0/259153426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154106c20 msgr2=0x7f3154103a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f315a1ba640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154106c20 0x7f3154103a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f315a1ba640 1 -- 172.21.15.27:0/259153426 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31541a87f0 con 0x7f3154101ff0 2024-09-21T05:46:27.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f31599b9640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31541062d0 0x7f31541034d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:46:27.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f315a1ba640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3154101ff0 0x7f3154102f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3144005940 tx=0x7f31440040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:27.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f314b7fe640 1 -- 172.21.15.27:0/259153426 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314403f030 con 0x7f3154101ff0 2024-09-21T05:46:27.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f314b7fe640 1 -- 172.21.15.27:0/259153426 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31440044c0 con 0x7f3154101ff0 2024-09-21T05:46:27.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f315c41e640 1 -- 172.21.15.27:0/259153426 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31541a8a80 con 0x7f3154101ff0 2024-09-21T05:46:27.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f314b7fe640 1 -- 172.21.15.27:0/259153426 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3144035070 con 0x7f3154101ff0 2024-09-21T05:46:27.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.714+0000 7f315c41e640 1 -- 172.21.15.27:0/259153426 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31541a8f60 con 0x7f3154101ff0 2024-09-21T05:46:27.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.715+0000 7f315c41e640 1 -- 172.21.15.27:0/259153426 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3154102400 con 0x7f3154101ff0 2024-09-21T05:46:27.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.717+0000 7f314b7fe640 1 -- 172.21.15.27:0/259153426 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7f3144042030 con 0x7f3154101ff0 2024-09-21T05:46:27.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.718+0000 7f314b7fe640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f31400b64d0 0x7f31400b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:27.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.719+0000 7f314b7fe640 1 -- 172.21.15.27:0/259153426 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7f3144105fe0 con 0x7f3154101ff0 2024-09-21T05:46:27.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.719+0000 7f31599b9640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f31400b64d0 0x7f31400b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:27.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.719+0000 7f31599b9640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f31400b64d0 0x7f31400b89e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f315406b340 tx=0x7f3150005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:27.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.721+0000 7f314b7fe640 1 -- 172.21.15.27:0/259153426 <== mon.2 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31440ce280 con 0x7f3154101ff0 2024-09-21T05:46:27.818 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0[47922]: 2024-09-21T05:46:27.520+0000 7f34f8866640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T05:46:27.819 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0[47922]: 2024-09-21T05:46:27.523+0000 7f34f065c640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:46:27.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:27.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:27.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:27.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi007 2024-09-21T05:46:27.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:27.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:27.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:27.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi007 to 17092M 2024-09-21T05:46:27.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:27.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:27.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:27.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:27.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' 2024-09-21T05:46:27.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:27.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:27.921+0000 7f315c41e640 1 -- 172.21.15.27:0/259153426 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3154063800 con 0x7f31400b64d0 2024-09-21T05:46:27.923 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:27.923 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:27.923 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:27.924 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: Detected new or changed devices on smithi007 2024-09-21T05:46:27.924 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:27.924 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:27.924 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:27.924 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi007 to 17092M 2024-09-21T05:46:27.924 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:27.924 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:27.924 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:27.924 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:27.924 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' 2024-09-21T05:46:27.924 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:27 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:28.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:28.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:28.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:28.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: Detected new or changed devices on smithi007 2024-09-21T05:46:28.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:28.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:28.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:28.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi007 to 17092M 2024-09-21T05:46:28.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:28.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:28.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:28.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:28.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: from='osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283]' entity='osd.0' 2024-09-21T05:46:28.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:27 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:28.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:28 smithi027 ceph-mon[34364]: purged_snaps scrub starts 2024-09-21T05:46:28.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:28 smithi027 ceph-mon[34364]: purged_snaps scrub ok 2024-09-21T05:46:28.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:28 smithi027 ceph-mon[34364]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:28.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:28.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:28.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:28.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:28 smithi027 ceph-mon[34364]: osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283] boot 2024-09-21T05:46:28.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:28 smithi027 ceph-mon[34364]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T05:46:28.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:29.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:28 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T05:46:29.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:28 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T05:46:29.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:28 smithi007 ceph-mon[30983]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:29.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:29.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:29.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:29.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:28 smithi007 ceph-mon[30983]: osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283] boot 2024-09-21T05:46:29.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:28 smithi007 ceph-mon[30983]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T05:46:29.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:29.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:28 smithi119 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T05:46:29.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:28 smithi119 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T05:46:29.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:28 smithi119 ceph-mon[34833]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:29.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:29.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:29.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:29.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:28 smithi119 ceph-mon[34833]: osd.0 [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283] boot 2024-09-21T05:46:29.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:28 smithi119 ceph-mon[34833]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T05:46:29.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:46:29.924 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:29 smithi027 ceph-mon[34364]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:30.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:29 smithi007 ceph-mon[30983]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:30.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:29 smithi119 ceph-mon[34833]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:46:30.900 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:30 smithi027 ceph-mon[34364]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T05:46:30.901 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:30 smithi027 ceph-mon[34364]: from='client.? 172.21.15.27:0/3281990886' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d4600805-1cb5-432a-8ae0-a40107a6c6b0"} : dispatch 2024-09-21T05:46:30.901 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:30 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d4600805-1cb5-432a-8ae0-a40107a6c6b0"} : dispatch 2024-09-21T05:46:30.901 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:30 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4600805-1cb5-432a-8ae0-a40107a6c6b0"}]': finished 2024-09-21T05:46:30.901 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:30 smithi027 ceph-mon[34364]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T05:46:30.901 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:31.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:30 smithi007 ceph-mon[30983]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T05:46:31.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:30 smithi007 ceph-mon[30983]: from='client.? 172.21.15.27:0/3281990886' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d4600805-1cb5-432a-8ae0-a40107a6c6b0"} : dispatch 2024-09-21T05:46:31.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:30 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d4600805-1cb5-432a-8ae0-a40107a6c6b0"} : dispatch 2024-09-21T05:46:31.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:30 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4600805-1cb5-432a-8ae0-a40107a6c6b0"}]': finished 2024-09-21T05:46:31.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:30 smithi007 ceph-mon[30983]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T05:46:31.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:31.107 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:30 smithi119 ceph-mon[34833]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T05:46:31.107 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:30 smithi119 ceph-mon[34833]: from='client.? 172.21.15.27:0/3281990886' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d4600805-1cb5-432a-8ae0-a40107a6c6b0"} : dispatch 2024-09-21T05:46:31.107 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:30 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d4600805-1cb5-432a-8ae0-a40107a6c6b0"} : dispatch 2024-09-21T05:46:31.107 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:30 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4600805-1cb5-432a-8ae0-a40107a6c6b0"}]': finished 2024-09-21T05:46:31.107 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:30 smithi119 ceph-mon[34833]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T05:46:31.107 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:32.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:31 smithi007 ceph-mon[30983]: pgmap v33: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:32.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:31 smithi007 ceph-mon[30983]: from='client.? 172.21.15.27:0/40704199' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:32.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:31 smithi119 ceph-mon[34833]: pgmap v33: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:32.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:31 smithi119 ceph-mon[34833]: from='client.? 172.21.15.27:0/40704199' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:32.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:31 smithi027 ceph-mon[34364]: pgmap v33: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:32.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:31 smithi027 ceph-mon[34364]: from='client.? 172.21.15.27:0/40704199' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:34.029 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:33 smithi027 ceph-mon[34364]: pgmap v34: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:34.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:33 smithi007 ceph-mon[30983]: pgmap v34: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:34.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:33 smithi119 ceph-mon[34833]: pgmap v34: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:36.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:35 smithi007 ceph-mon[30983]: pgmap v35: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:36.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:35 smithi119 ceph-mon[34833]: pgmap v35: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:36.120 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:35 smithi027 ceph-mon[34364]: pgmap v35: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:37.995 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:37 smithi027 ceph-mon[34364]: pgmap v36: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:38.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:37 smithi007 ceph-mon[30983]: pgmap v36: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:38.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:37 smithi119 ceph-mon[34833]: pgmap v36: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:39.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:39 smithi027 ceph-mon[34364]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:39.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:39 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:46:39.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:39 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:39.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:39 smithi027 ceph-mon[34364]: Deploying daemon osd.1 on smithi027 2024-09-21T05:46:40.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:39 smithi007 ceph-mon[30983]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:40.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:46:40.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:40.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:39 smithi007 ceph-mon[30983]: Deploying daemon osd.1 on smithi027 2024-09-21T05:46:40.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:39 smithi119 ceph-mon[34833]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:40.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:39 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:46:40.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:39 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:40.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:39 smithi119 ceph-mon[34833]: Deploying daemon osd.1 on smithi027 2024-09-21T05:46:42.048 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:41 smithi027 ceph-mon[34364]: pgmap v38: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:42.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:41 smithi007 ceph-mon[30983]: pgmap v38: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:42.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:41 smithi119 ceph-mon[34833]: pgmap v38: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:44.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:43 smithi007 ceph-mon[30983]: pgmap v39: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:44.073 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:43 smithi027 ceph-mon[34364]: pgmap v39: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:44.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:43 smithi119 ceph-mon[34833]: pgmap v39: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:45.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:45 smithi027 ceph-mon[34364]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:45.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:45 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:45.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:45 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:45.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:45 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:46.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:45 smithi007 ceph-mon[30983]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:46.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:46.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:46.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:45 smithi119 ceph-mon[34833]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:45 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:45 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:45 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:48.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:47 smithi007 ceph-mon[30983]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:48.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:48.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:48.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:48.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:48.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:48.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:47 smithi119 ceph-mon[34833]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:48.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:48.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:48.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:48.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:48.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:48.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:47 smithi027 ceph-mon[34364]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:48.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:48.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:48.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:48.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:48.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:49.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:49.413+0000 7f314b7fe640 1 -- 172.21.15.27:0/259153426 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3154063800 con 0x7f31400b64d0 2024-09-21T05:46:49.416 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 1 on host 'smithi027' 2024-09-21T05:46:49.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:49.416+0000 7f315c41e640 1 -- 172.21.15.27:0/259153426 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f31400b64d0 msgr2=0x7f31400b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:49.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:49.416+0000 7f315c41e640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f31400b64d0 0x7f31400b89e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f315406b340 tx=0x7f3150005f90 comp rx=0 tx=0).stop 2024-09-21T05:46:49.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:49.416+0000 7f315c41e640 1 -- 172.21.15.27:0/259153426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3154101ff0 msgr2=0x7f3154102f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:49.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:49.416+0000 7f315c41e640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3154101ff0 0x7f3154102f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3144005940 tx=0x7f31440040c0 comp rx=0 tx=0).stop 2024-09-21T05:46:49.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:49.416+0000 7f315c41e640 1 -- 172.21.15.27:0/259153426 shutdown_connections 2024-09-21T05:46:49.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:49.416+0000 7f315c41e640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f31400b64d0 0x7f31400b89e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:49.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:49.416+0000 7f315c41e640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154106c20 0x7f3154103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:49.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:49.416+0000 7f315c41e640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31541062d0 0x7f31541034d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:49.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:49.416+0000 7f315c41e640 1 --2- 172.21.15.27:0/259153426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3154101ff0 0x7f3154102f90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:49.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:49.416+0000 7f315c41e640 1 -- 172.21.15.27:0/259153426 >> 172.21.15.27:0/259153426 conn(0x7f3154077cc0 msgr2=0x7f3154107690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:49.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:49.416+0000 7f315c41e640 1 -- 172.21.15.27:0/259153426 shutdown_connections 2024-09-21T05:46:49.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:46:49.416+0000 7f315c41e640 1 -- 172.21.15.27:0/259153426 wait complete. 2024-09-21T05:46:49.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:49 smithi027 ceph-mon[34364]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:49.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:49 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:49.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:49 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:49.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:49 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:49.999 DEBUG:teuthology.orchestra.run.smithi027:osd.1> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T05:46:50.042 INFO:tasks.cephadm:Deploying osd.2 on smithi119 with /dev/vg_nvme/lv_4... 2024-09-21T05:46:50.042 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T05:46:50.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:49 smithi007 ceph-mon[30983]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:50.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:50.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:50.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:50.069 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:49 smithi119 ceph-mon[34833]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:50.069 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:49 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:50.069 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:49 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:50.069 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:49 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:50.292 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:46:51.115 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 05:46:50 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1[38887]: 2024-09-21T05:46:50.795+0000 7fdd30b70640 -1 osd.1 0 log_to_monitors true 2024-09-21T05:46:51.943 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:51 smithi119 ceph-mon[34833]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:51.943 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:51 smithi119 ceph-mon[34833]: from='osd.1 [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:46:51.943 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:51 smithi119 ceph-mon[34833]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:46:52.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:51 smithi007 ceph-mon[30983]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:51 smithi007 ceph-mon[30983]: from='osd.1 [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:46:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:51 smithi007 ceph-mon[30983]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:46:52.099 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:51 smithi027 ceph-mon[34364]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:52.100 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:51 smithi027 ceph-mon[34364]: from='osd.1 [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:46:52.100 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:51 smithi027 ceph-mon[34364]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:46:52.664 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:46:52.690 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi119:vg_nvme/lv_4 2024-09-21T05:46:52.976 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1[38887]: 2024-09-21T05:46:52.801+0000 7fdd2caf2640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T05:46:52.977 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1[38887]: 2024-09-21T05:46:52.807+0000 7fdd288f0640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:46:52.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:46:52.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: from='osd.1 [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:46:52.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T05:46:52.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:52.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:46:52.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:52.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:52.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:52.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:52.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:52.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:52.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:52.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-21T05:46:52.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:52 smithi027 ceph-mon[34364]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T05:46:52.987 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:46:53.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:46:53.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: from='osd.1 [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:46:53.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T05:46:53.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:53.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:46:53.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:53.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:53.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:53.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:53.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:53.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:53.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:53.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-21T05:46:53.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:52 smithi007 ceph-mon[30983]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T05:46:53.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:46:53.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: from='osd.1 [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:46:53.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T05:46:53.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:53.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:46:53.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:53.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:53.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:53.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:53.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:53.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:53.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:46:53.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-21T05:46:53.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:52 smithi119 ceph-mon[34833]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T05:46:53.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.455+0000 7fe8c676e640 1 -- 172.21.15.119:0/2160720308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c0109df0 msgr2=0x7fe8c0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:53.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.455+0000 7fe8c676e640 1 --2- 172.21.15.119:0/2160720308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c0109df0 0x7fe8c0110620 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009ca0 tx=0x7fe8b802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:46:53.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.456+0000 7fe8c676e640 1 -- 172.21.15.119:0/2160720308 shutdown_connections 2024-09-21T05:46:53.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.456+0000 7fe8c676e640 1 --2- 172.21.15.119:0/2160720308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c0109df0 0x7fe8c0110620 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:53.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.456+0000 7fe8c676e640 1 --2- 172.21.15.119:0/2160720308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c01094a0 0x7fe8c01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:53.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.456+0000 7fe8c676e640 1 --2- 172.21.15.119:0/2160720308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c0103b60 0x7fe8c0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:53.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.456+0000 7fe8c676e640 1 -- 172.21.15.119:0/2160720308 >> 172.21.15.119:0/2160720308 conn(0x7fe8c007b850 msgr2=0x7fe8c007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:53.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.456+0000 7fe8c676e640 1 -- 172.21.15.119:0/2160720308 shutdown_connections 2024-09-21T05:46:53.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.456+0000 7fe8c676e640 1 -- 172.21.15.119:0/2160720308 wait complete. 2024-09-21T05:46:53.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.456+0000 7fe8c676e640 1 Processor -- start 2024-09-21T05:46:53.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.456+0000 7fe8c676e640 1 -- start start 2024-09-21T05:46:53.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8c676e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c0103b60 0x7fe8c019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:53.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8c676e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c01094a0 0x7fe8c019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:53.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8c676e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c0109df0 0x7fe8c019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:53.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8c676e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c0113b00 con 0x7fe8c0109df0 2024-09-21T05:46:53.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8c676e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c0113980 con 0x7fe8c01094a0 2024-09-21T05:46:53.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8c676e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c0113c80 con 0x7fe8c0103b60 2024-09-21T05:46:53.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8bffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c0103b60 0x7fe8c019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:53.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8bffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c0103b60 0x7fe8c019a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38306/0 (socket says 172.21.15.119:38306) 2024-09-21T05:46:53.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8bffff640 1 -- 172.21.15.119:0/4125781926 learned_addr learned my addr 172.21.15.119:0/4125781926 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-21T05:46:53.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8c4d0b640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c0109df0 0x7fe8c019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:53.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8bf7fe640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c01094a0 0x7fe8c019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:53.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8bffff640 1 -- 172.21.15.119:0/4125781926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c01094a0 msgr2=0x7fe8c019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:53.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8bffff640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c01094a0 0x7fe8c019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:53.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8bffff640 1 -- 172.21.15.119:0/4125781926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c0109df0 msgr2=0x7fe8c019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:53.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8bffff640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c0109df0 0x7fe8c019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:53.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8bffff640 1 -- 172.21.15.119:0/4125781926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c01a0360 con 0x7fe8c0103b60 2024-09-21T05:46:53.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.457+0000 7fe8bffff640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c0103b60 0x7fe8c019a3f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000e9f0 tx=0x7fe8b000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:53.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.458+0000 7fe8bd7fa640 1 -- 172.21.15.119:0/4125781926 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b000cd80 con 0x7fe8c0103b60 2024-09-21T05:46:53.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.458+0000 7fe8bd7fa640 1 -- 172.21.15.119:0/4125781926 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8b00108e0 con 0x7fe8c0103b60 2024-09-21T05:46:53.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.458+0000 7fe8c676e640 1 -- 172.21.15.119:0/4125781926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c01a0650 con 0x7fe8c0103b60 2024-09-21T05:46:53.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.458+0000 7fe8bd7fa640 1 -- 172.21.15.119:0/4125781926 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0018980 con 0x7fe8c0103b60 2024-09-21T05:46:53.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.458+0000 7fe8c676e640 1 -- 172.21.15.119:0/4125781926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c01a6db0 con 0x7fe8c0103b60 2024-09-21T05:46:53.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.459+0000 7fe8c676e640 1 -- 172.21.15.119:0/4125781926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c0103f70 con 0x7fe8c0103b60 2024-09-21T05:46:53.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.460+0000 7fe8bd7fa640 1 -- 172.21.15.119:0/4125781926 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7fe8b0010430 con 0x7fe8c0103b60 2024-09-21T05:46:53.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.461+0000 7fe8bd7fa640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8a80b6550 0x7fe8a80b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:53.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.461+0000 7fe8bd7fa640 1 -- 172.21.15.119:0/4125781926 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2244+0+0 (secure 0 0 0) 0x7fe8b00e5d40 con 0x7fe8c0103b60 2024-09-21T05:46:53.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.462+0000 7fe8bf7fe640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8a80b6550 0x7fe8a80b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:53.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.462+0000 7fe8bf7fe640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8a80b6550 0x7fe8a80b8a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0109180 tx=0x7fe8b400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:53.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.466+0000 7fe8bd7fa640 1 -- 172.21.15.119:0/4125781926 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe8b00b2240 con 0x7fe8c0103b60 2024-09-21T05:46:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:46:53.651+0000 7fe8c676e640 1 -- 172.21.15.119:0/4125781926 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe8c0063800 con 0x7fe8a80b6550 2024-09-21T05:46:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:53 smithi119 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T05:46:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:53 smithi119 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T05:46:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:53 smithi119 ceph-mon[34833]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:53 smithi119 ceph-mon[34833]: Detected new or changed devices on smithi027 2024-09-21T05:46:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:53 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi027 to 17088M 2024-09-21T05:46:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:54.024 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:53 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T05:46:54.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:53 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T05:46:54.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:53 smithi007 ceph-mon[30983]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:54.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:53 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi027 2024-09-21T05:46:54.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:53 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi027 to 17088M 2024-09-21T05:46:54.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:54.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:54.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:54.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:54.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:54.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:53 smithi027 ceph-mon[34364]: purged_snaps scrub starts 2024-09-21T05:46:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:53 smithi027 ceph-mon[34364]: purged_snaps scrub ok 2024-09-21T05:46:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:53 smithi027 ceph-mon[34364]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:53 smithi027 ceph-mon[34364]: Detected new or changed devices on smithi027 2024-09-21T05:46:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:53 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi027 to 17088M 2024-09-21T05:46:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:55.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:54 smithi007 ceph-mon[30983]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:55.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:54 smithi007 ceph-mon[30983]: osd.1 [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871] boot 2024-09-21T05:46:55.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:54 smithi007 ceph-mon[30983]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T05:46:55.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:54 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:55.069 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:54 smithi119 ceph-mon[34833]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:55.069 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:54 smithi119 ceph-mon[34833]: osd.1 [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871] boot 2024-09-21T05:46:55.070 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:54 smithi119 ceph-mon[34833]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T05:46:55.070 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:54 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:55.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:54 smithi027 ceph-mon[34364]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:55.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:54 smithi027 ceph-mon[34364]: osd.1 [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871] boot 2024-09-21T05:46:55.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:54 smithi027 ceph-mon[34364]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T05:46:55.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:54 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:46:55.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:55 smithi119 ceph-mon[34833]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:55.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:55 smithi119 ceph-mon[34833]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T05:46:56.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:55 smithi027 ceph-mon[34364]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:56.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:55 smithi027 ceph-mon[34364]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T05:46:56.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:55 smithi007 ceph-mon[30983]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:46:56.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:55 smithi007 ceph-mon[30983]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T05:46:57.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:56 smithi027 ceph-mon[34364]: from='client.? 172.21.15.119:0/3825486758' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa435f82-5819-4497-9053-1d891e712b0c"} : dispatch 2024-09-21T05:46:57.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:56 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa435f82-5819-4497-9053-1d891e712b0c"} : dispatch 2024-09-21T05:46:57.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:56 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa435f82-5819-4497-9053-1d891e712b0c"}]': finished 2024-09-21T05:46:57.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:56 smithi027 ceph-mon[34364]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T05:46:57.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:56 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:46:57.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:56 smithi027 ceph-mon[34364]: from='client.? 172.21.15.119:0/3912588010' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:57.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:56 smithi007 ceph-mon[30983]: from='client.? 172.21.15.119:0/3825486758' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa435f82-5819-4497-9053-1d891e712b0c"} : dispatch 2024-09-21T05:46:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:56 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa435f82-5819-4497-9053-1d891e712b0c"} : dispatch 2024-09-21T05:46:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:56 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa435f82-5819-4497-9053-1d891e712b0c"}]': finished 2024-09-21T05:46:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:56 smithi007 ceph-mon[30983]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T05:46:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:46:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:56 smithi007 ceph-mon[30983]: from='client.? 172.21.15.119:0/3912588010' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:56 smithi119 ceph-mon[34833]: from='client.? 172.21.15.119:0/3825486758' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa435f82-5819-4497-9053-1d891e712b0c"} : dispatch 2024-09-21T05:46:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:56 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa435f82-5819-4497-9053-1d891e712b0c"} : dispatch 2024-09-21T05:46:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:56 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa435f82-5819-4497-9053-1d891e712b0c"}]': finished 2024-09-21T05:46:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:56 smithi119 ceph-mon[34833]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T05:46:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:56 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:46:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:56 smithi119 ceph-mon[34833]: from='client.? 172.21.15.119:0/3912588010' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:58.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:57 smithi027 ceph-mon[34364]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:46:58.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:57 smithi007 ceph-mon[30983]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:46:58.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:57 smithi119 ceph-mon[34833]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:00.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:46:59 smithi027 ceph-mon[34364]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:00.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:46:59 smithi007 ceph-mon[30983]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:00.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:46:59 smithi119 ceph-mon[34833]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:02.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:01 smithi119 ceph-mon[34833]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:02.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:01 smithi027 ceph-mon[34364]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:02.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:01 smithi007 ceph-mon[30983]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:04.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:03 smithi007 ceph-mon[30983]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:04.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:03 smithi027 ceph-mon[34364]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:04.325 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:03 smithi119 ceph-mon[34833]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:05.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:47:05.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:05.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:04 smithi027 ceph-mon[34364]: Deploying daemon osd.2 on smithi119 2024-09-21T05:47:05.288 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:47:05.288 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:05.289 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:04 smithi119 ceph-mon[34833]: Deploying daemon osd.2 on smithi119 2024-09-21T05:47:05.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:47:05.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:05.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:04 smithi007 ceph-mon[30983]: Deploying daemon osd.2 on smithi119 2024-09-21T05:47:06.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:05 smithi119 ceph-mon[34833]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:06.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:05 smithi027 ceph-mon[34364]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:06.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:05 smithi007 ceph-mon[30983]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:08.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:07 smithi027 ceph-mon[34364]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:08.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:07 smithi007 ceph-mon[30983]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:08.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:07 smithi119 ceph-mon[34833]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:10.028 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:09 smithi119 ceph-mon[34833]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:10.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:09 smithi027 ceph-mon[34364]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:10.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:09 smithi007 ceph-mon[30983]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:11.042 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:11.042 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:11.042 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:11.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:11.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:11.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:11.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:11.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:11.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:11.948 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:11 smithi119 ceph-mon[34833]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:12.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:11 smithi027 ceph-mon[34364]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:12.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:11 smithi007 ceph-mon[30983]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:14.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:13 smithi007 ceph-mon[30983]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:14.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:13 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:14.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:13 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:14.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:13 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:14.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:13 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:14.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:13 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:14.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:13 smithi119 ceph-mon[34833]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:14.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:13 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:14.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:13 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:14.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:13 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:14.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:13 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:14.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:13 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:14.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:47:14.093+0000 7fe8bd7fa640 1 -- 172.21.15.119:0/4125781926 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe8c0063800 con 0x7fe8a80b6550 2024-09-21T05:47:14.096 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 2 on host 'smithi119' 2024-09-21T05:47:14.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:47:14.095+0000 7fe8c676e640 1 -- 172.21.15.119:0/4125781926 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8a80b6550 msgr2=0x7fe8a80b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:14.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:47:14.095+0000 7fe8c676e640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8a80b6550 0x7fe8a80b8a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0109180 tx=0x7fe8b400b390 comp rx=0 tx=0).stop 2024-09-21T05:47:14.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:47:14.095+0000 7fe8c676e640 1 -- 172.21.15.119:0/4125781926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c0103b60 msgr2=0x7fe8c019a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:14.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:47:14.095+0000 7fe8c676e640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c0103b60 0x7fe8c019a3f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000e9f0 tx=0x7fe8b000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:47:14.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:47:14.095+0000 7fe8c676e640 1 -- 172.21.15.119:0/4125781926 shutdown_connections 2024-09-21T05:47:14.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:47:14.095+0000 7fe8c676e640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8a80b6550 0x7fe8a80b8a60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:14.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:47:14.095+0000 7fe8c676e640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c0109df0 0x7fe8c019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:14.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:47:14.095+0000 7fe8c676e640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c01094a0 0x7fe8c019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:14.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:47:14.095+0000 7fe8c676e640 1 --2- 172.21.15.119:0/4125781926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c0103b60 0x7fe8c019a3f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:14.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:47:14.095+0000 7fe8c676e640 1 -- 172.21.15.119:0/4125781926 >> 172.21.15.119:0/4125781926 conn(0x7fe8c007b850 msgr2=0x7fe8c0107450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:14.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:47:14.096+0000 7fe8c676e640 1 -- 172.21.15.119:0/4125781926 shutdown_connections 2024-09-21T05:47:14.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:47:14.096+0000 7fe8c676e640 1 -- 172.21.15.119:0/4125781926 wait complete. 2024-09-21T05:47:14.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:13 smithi027 ceph-mon[34364]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:14.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:13 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:14.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:13 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:14.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:13 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:14.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:13 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:14.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:13 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:14.701 DEBUG:teuthology.orchestra.run.smithi119:osd.2> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T05:47:14.703 INFO:tasks.cephadm:Deploying osd.3 on smithi007 with /dev/vg_nvme/lv_3... 2024-09-21T05:47:14.703 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T05:47:14.933 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:14 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:14.934 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:14 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:14.934 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:14 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:14.971 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:15.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:15.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:15.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:15.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:14 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:15.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:14 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:15.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:14 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:16.194 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:16 smithi119 ceph-mon[34833]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:16.267 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:16 smithi007 ceph-mon[30983]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:16.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:16 smithi027 ceph-mon[34364]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:16.592 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 05:47:16 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2[40036]: 2024-09-21T05:47:16.189+0000 7fb884439640 -1 osd.2 0 log_to_monitors true 2024-09-21T05:47:17.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:17 smithi119 ceph-mon[34833]: from='osd.2 [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:47:17.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:17 smithi119 ceph-mon[34833]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:47:17.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:17 smithi007 ceph-mon[30983]: from='osd.2 [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:47:17.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:17 smithi007 ceph-mon[30983]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:47:17.385 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:47:17.412 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi007:vg_nvme/lv_3 2024-09-21T05:47:17.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:17 smithi027 ceph-mon[34364]: from='osd.2 [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:47:17.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:17 smithi027 ceph-mon[34364]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:47:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:18.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.140+0000 7ff937ed8640 1 -- 172.21.15.7:0/2666295471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff930102a60 msgr2=0x7ff930102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:18.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.140+0000 7ff937ed8640 1 --2- 172.21.15.7:0/2666295471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff930102a60 0x7ff930102e70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff92c009900 tx=0x7ff92c02a410 comp rx=0 tx=0).stop 2024-09-21T05:47:18.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.140+0000 7ff937ed8640 1 -- 172.21.15.7:0/2666295471 shutdown_connections 2024-09-21T05:47:18.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.140+0000 7ff937ed8640 1 --2- 172.21.15.7:0/2666295471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff930108cf0 0x7ff93010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.140+0000 7ff937ed8640 1 --2- 172.21.15.7:0/2666295471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9301083a0 0x7ff9301087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.140+0000 7ff937ed8640 1 --2- 172.21.15.7:0/2666295471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff930102a60 0x7ff930102e70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.140+0000 7ff937ed8640 1 -- 172.21.15.7:0/2666295471 >> 172.21.15.7:0/2666295471 conn(0x7ff930079730 msgr2=0x7ff930079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:18.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.140+0000 7ff937ed8640 1 -- 172.21.15.7:0/2666295471 shutdown_connections 2024-09-21T05:47:18.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.140+0000 7ff937ed8640 1 -- 172.21.15.7:0/2666295471 wait complete. 2024-09-21T05:47:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.141+0000 7ff937ed8640 1 Processor -- start 2024-09-21T05:47:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.141+0000 7ff937ed8640 1 -- start start 2024-09-21T05:47:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.141+0000 7ff937ed8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff930102a60 0x7ff93019b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.141+0000 7ff937ed8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9301083a0 0x7ff93019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.141+0000 7ff937ed8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff930108cf0 0x7ff93019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.141+0000 7ff937ed8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff930112960 con 0x7ff930108cf0 2024-09-21T05:47:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.141+0000 7ff937ed8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff9301127e0 con 0x7ff9301083a0 2024-09-21T05:47:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.141+0000 7ff937ed8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff930112ae0 con 0x7ff930102a60 2024-09-21T05:47:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.141+0000 7ff936475640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff930108cf0 0x7ff93019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.141+0000 7ff936475640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff930108cf0 0x7ff93019bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44552/0 (socket says 172.21.15.7:44552) 2024-09-21T05:47:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.141+0000 7ff935c74640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff930102a60 0x7ff93019b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.141+0000 7ff936475640 1 -- 172.21.15.7:0/1030529929 learned_addr learned my addr 172.21.15.7:0/1030529929 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:47:18.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.142+0000 7ff935473640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9301083a0 0x7ff93019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.142+0000 7ff936475640 1 -- 172.21.15.7:0/1030529929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff930102a60 msgr2=0x7ff93019b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.142+0000 7ff936475640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff930102a60 0x7ff93019b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.142+0000 7ff936475640 1 -- 172.21.15.7:0/1030529929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9301083a0 msgr2=0x7ff93019b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.142+0000 7ff936475640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9301083a0 0x7ff93019b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.142+0000 7ff936475640 1 -- 172.21.15.7:0/1030529929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9301a6550 con 0x7ff930108cf0 2024-09-21T05:47:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.142+0000 7ff935473640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9301083a0 0x7ff93019b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:47:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.142+0000 7ff936475640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff930108cf0 0x7ff93019bd10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff92800eaa0 tx=0x7ff92800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.142+0000 7ff926ffd640 1 -- 172.21.15.7:0/1030529929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92800cdb0 con 0x7ff930108cf0 2024-09-21T05:47:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.142+0000 7ff937ed8640 1 -- 172.21.15.7:0/1030529929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9301a6840 con 0x7ff930108cf0 2024-09-21T05:47:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.142+0000 7ff926ffd640 1 -- 172.21.15.7:0/1030529929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff928005020 con 0x7ff930108cf0 2024-09-21T05:47:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.142+0000 7ff926ffd640 1 -- 172.21.15.7:0/1030529929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9280116d0 con 0x7ff930108cf0 2024-09-21T05:47:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.142+0000 7ff937ed8640 1 -- 172.21.15.7:0/1030529929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff930199080 con 0x7ff930108cf0 2024-09-21T05:47:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.143+0000 7ff937ed8640 1 -- 172.21.15.7:0/1030529929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff930102e70 con 0x7ff930108cf0 2024-09-21T05:47:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.145+0000 7ff926ffd640 1 -- 172.21.15.7:0/1030529929 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 154472+0+0 (secure 0 0 0) 0x7ff9280051d0 con 0x7ff930108cf0 2024-09-21T05:47:18.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.146+0000 7ff926ffd640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff91c0ba8e0 0x7ff91c0bcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:18.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.146+0000 7ff935c74640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff91c0ba8e0 0x7ff91c0bcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:18.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.146+0000 7ff926ffd640 1 -- 172.21.15.7:0/1030529929 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2786+0+0 (secure 0 0 0) 0x7ff9280e6370 con 0x7ff930108cf0 2024-09-21T05:47:18.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.146+0000 7ff935c74640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff91c0ba8e0 0x7ff91c0bcdf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff92c000c00 tx=0x7ff92c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:18.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.149+0000 7ff926ffd640 1 -- 172.21.15.7:0/1030529929 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff928016030 con 0x7ff930108cf0 2024-09-21T05:47:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:47:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T05:47:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: from='osd.2 [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:47:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:47:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi119 2024-09-21T05:47:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi119 to 17088M 2024-09-21T05:47:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:18.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:18.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:18.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:47:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T05:47:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: from='osd.2 [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:47:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:47:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: Detected new or changed devices on smithi119 2024-09-21T05:47:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:18.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:18.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi119 to 17088M 2024-09-21T05:47:18.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:18.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:18.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:18.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:18.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:18.348+0000 7ff937ed8640 1 -- 172.21.15.7:0/1030529929 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff930063800 con 0x7ff91c0ba8e0 2024-09-21T05:47:18.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:18.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:47:18.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T05:47:18.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:18.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: from='osd.2 [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:47:18.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:47:18.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: Detected new or changed devices on smithi119 2024-09-21T05:47:18.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:18.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:18.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:18.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi119 to 17088M 2024-09-21T05:47:18.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:18.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:18.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:18.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:19.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:19 smithi007 ceph-mon[30983]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T05:47:19.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:19 smithi007 ceph-mon[30983]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T05:47:19.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:19.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:19.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:47:19.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:47:19.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:19.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:19 smithi007 ceph-mon[30983]: from='osd.2 ' entity='osd.2' 2024-09-21T05:47:19.342 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 05:47:19 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2[40036]: 2024-09-21T05:47:19.024+0000 7fb8803bb640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T05:47:19.342 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 05:47:19 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2[40036]: 2024-09-21T05:47:19.169+0000 7fb8781b1640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:47:19.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:19 smithi119 ceph-mon[34833]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T05:47:19.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:19 smithi119 ceph-mon[34833]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T05:47:19.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:19 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:19.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:19 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:19.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:19 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:47:19.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:19 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:47:19.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:19 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:19.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:19 smithi119 ceph-mon[34833]: from='osd.2 ' entity='osd.2' 2024-09-21T05:47:19.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:19 smithi027 ceph-mon[34364]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T05:47:19.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:19 smithi027 ceph-mon[34364]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T05:47:19.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:19 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:19.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:19 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:19.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:19 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:47:19.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:19 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:47:19.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:19 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:19.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:19 smithi027 ceph-mon[34364]: from='osd.2 ' entity='osd.2' 2024-09-21T05:47:20.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:20 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T05:47:20.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:20 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T05:47:20.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:20 smithi007 ceph-mon[30983]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:20.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:20 smithi007 ceph-mon[30983]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:20.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:20 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:20.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:20 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:20.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:20 smithi027 ceph-mon[34364]: purged_snaps scrub starts 2024-09-21T05:47:20.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:20 smithi027 ceph-mon[34364]: purged_snaps scrub ok 2024-09-21T05:47:20.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:20 smithi027 ceph-mon[34364]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:20.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:20 smithi027 ceph-mon[34364]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:20.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:20 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:20.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:20 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:20.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:20 smithi119 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T05:47:20.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:20 smithi119 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T05:47:20.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:20 smithi119 ceph-mon[34833]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:20.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:20 smithi119 ceph-mon[34833]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:20.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:20 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:20.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:20 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:21.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:21 smithi027 ceph-mon[34364]: osd.2 [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043] boot 2024-09-21T05:47:21.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:21 smithi027 ceph-mon[34364]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T05:47:21.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:21.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:21 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/577696898' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55803f97-02e1-43c0-b8da-9b8af32fd1eb"} : dispatch 2024-09-21T05:47:21.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:21 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/577696898' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55803f97-02e1-43c0-b8da-9b8af32fd1eb"}]': finished 2024-09-21T05:47:21.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:21 smithi027 ceph-mon[34364]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T05:47:21.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:21.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:47:21.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:21 smithi007 ceph-mon[30983]: osd.2 [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043] boot 2024-09-21T05:47:21.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:21 smithi007 ceph-mon[30983]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T05:47:21.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:21.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:21 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/577696898' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55803f97-02e1-43c0-b8da-9b8af32fd1eb"} : dispatch 2024-09-21T05:47:21.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:21 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/577696898' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55803f97-02e1-43c0-b8da-9b8af32fd1eb"}]': finished 2024-09-21T05:47:21.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:21 smithi007 ceph-mon[30983]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T05:47:21.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:21.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:47:21.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:21 smithi119 ceph-mon[34833]: osd.2 [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043] boot 2024-09-21T05:47:21.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:21 smithi119 ceph-mon[34833]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T05:47:21.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:47:21.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:21 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/577696898' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55803f97-02e1-43c0-b8da-9b8af32fd1eb"} : dispatch 2024-09-21T05:47:21.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:21 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/577696898' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55803f97-02e1-43c0-b8da-9b8af32fd1eb"}]': finished 2024-09-21T05:47:21.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:21 smithi119 ceph-mon[34833]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T05:47:21.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:21.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:47:22.472 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 ceph-mon[30983]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:22.472 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/153379525' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:47:22.472 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T05:47:22.472 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 ceph-mon[30983]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T05:47:22.472 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:22.472 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:47:22.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:22 smithi027 ceph-mon[34364]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:22.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:22 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/153379525' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:47:22.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T05:47:22.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:22 smithi027 ceph-mon[34364]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T05:47:22.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:22.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:47:22.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 ceph-mon[34833]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:47:22.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/153379525' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:47:22.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T05:47:22.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 ceph-mon[34833]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T05:47:22.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:22.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:47:22.728 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52951]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:47:22.728 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52951]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:47:22.728 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:47:22.728 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52951]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:47:23.068 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52954]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:47:23.068 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52954]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:47:23.069 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:47:23.069 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52954]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:47:23.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52958]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:47:23.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52958]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:47:23.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:47:23.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52958]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:47:23.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52961]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:47:23.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52961]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:47:23.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:47:23.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:22 smithi007 sudo[52961]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:47:23.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 sudo[42493]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:47:23.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 sudo[42493]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:47:23.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 sudo[42493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:47:23.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 sudo[42493]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:47:23.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 sudo[42496]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:47:23.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 sudo[42496]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:47:23.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 sudo[42496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:47:23.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 sudo[42496]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:47:23.227 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 05:47:22 smithi027 sudo[42487]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:47:23.227 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 05:47:22 smithi027 sudo[42487]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:47:23.227 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 05:47:22 smithi027 sudo[42487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:47:23.228 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 05:47:22 smithi027 sudo[42487]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:47:23.228 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 05:47:22 smithi027 sudo[42490]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:47:23.228 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 05:47:22 smithi027 sudo[42490]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:47:23.228 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 05:47:22 smithi027 sudo[42490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:47:23.228 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 05:47:22 smithi027 sudo[42490]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:47:23.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43834]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:47:23.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43834]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:47:23.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:47:23.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43834]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:47:23.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43837]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:47:23.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43837]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:47:23.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:47:23.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43837]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:47:23.343 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43828]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:47:23.343 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43828]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:47:23.343 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:47:23.343 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43828]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:47:23.343 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43831]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:47:23.343 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43831]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:47:23.343 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:47:23.343 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 05:47:22 smithi119 sudo[43831]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:47:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T05:47:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T05:47:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:47:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:47:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:47:23.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:47:23.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:47:23.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:47:23.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:47:23.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:47:23.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:47:23.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:47:23.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:47:23.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:47:23.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:47:23.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:47:23.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:23 smithi027 ceph-mon[34364]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:47:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T05:47:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T05:47:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:47:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:47:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:47:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:47:24.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:47:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:47:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:47:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:47:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:47:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:47:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:47:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:47:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:47:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:47:24.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:23 smithi007 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:47:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T05:47:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T05:47:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:47:24.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:23 smithi119 ceph-mon[34833]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:47:24.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:24.659+0000 7ff926ffd640 1 -- 172.21.15.7:0/1030529929 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7ff9280a9d40 con 0x7ff930108cf0 2024-09-21T05:47:24.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:24 smithi027 ceph-mon[34364]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T05:47:24.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:25.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:24 smithi007 ceph-mon[30983]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T05:47:25.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:25.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:24 smithi119 ceph-mon[34833]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T05:47:25.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:25.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:25 smithi007 ceph-mon[30983]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:25.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:25 smithi007 ceph-mon[30983]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T05:47:25.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:25 smithi027 ceph-mon[34364]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:25.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:25 smithi027 ceph-mon[34364]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T05:47:26.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:25 smithi119 ceph-mon[34833]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:26.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:25 smithi119 ceph-mon[34833]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T05:47:27.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:27 smithi007 ceph-mon[30983]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:27.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:27 smithi027 ceph-mon[34364]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:28.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:27 smithi119 ceph-mon[34833]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:29.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:29 smithi007 ceph-mon[30983]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:29.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:29 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:47:29.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:29 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:29.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:29 smithi007 ceph-mon[30983]: Deploying daemon osd.3 on smithi007 2024-09-21T05:47:29.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:29 smithi027 ceph-mon[34364]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:29.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:29 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:47:29.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:29 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:29.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:29 smithi027 ceph-mon[34364]: Deploying daemon osd.3 on smithi007 2024-09-21T05:47:30.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:29 smithi119 ceph-mon[34833]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:30.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:29 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:47:30.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:29 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:30.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:29 smithi119 ceph-mon[34833]: Deploying daemon osd.3 on smithi007 2024-09-21T05:47:31.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:31 smithi027 ceph-mon[34364]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:32.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:31 smithi007 ceph-mon[30983]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:32.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:31 smithi119 ceph-mon[34833]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:33.816 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:33 smithi007 ceph-mon[30983]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:33.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:33 smithi027 ceph-mon[34364]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:34.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:33 smithi119 ceph-mon[34833]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:35.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:35 smithi027 ceph-mon[34364]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:35.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:35 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:35.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:35 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:35.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:35 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:36.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:35 smithi007 ceph-mon[30983]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:36.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:36.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:36.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:36.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:35 smithi119 ceph-mon[34833]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:36.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:35 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:36.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:35 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:36.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:35 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:37.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:37 smithi027 ceph-mon[34364]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:37.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:37 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:37.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:37 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:37.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:37 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:37.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:37 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:37.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:37 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:38.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:37 smithi007 ceph-mon[30983]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:38.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:38.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:38.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:38.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:38.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:38.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:37 smithi119 ceph-mon[34833]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:38.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:37 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:38.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:37 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:38.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:37 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:38.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:37 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:38.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:37 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:38.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:38.726+0000 7ff926ffd640 1 -- 172.21.15.7:0/1030529929 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff930063800 con 0x7ff91c0ba8e0 2024-09-21T05:47:38.728 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 3 on host 'smithi007' 2024-09-21T05:47:38.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:38.728+0000 7ff937ed8640 1 -- 172.21.15.7:0/1030529929 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff91c0ba8e0 msgr2=0x7ff91c0bcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:38.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:38.728+0000 7ff937ed8640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff91c0ba8e0 0x7ff91c0bcdf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff92c000c00 tx=0x7ff92c031400 comp rx=0 tx=0).stop 2024-09-21T05:47:38.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:38.728+0000 7ff937ed8640 1 -- 172.21.15.7:0/1030529929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff930108cf0 msgr2=0x7ff93019bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:38.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:38.728+0000 7ff937ed8640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff930108cf0 0x7ff93019bd10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff92800eaa0 tx=0x7ff92800ef60 comp rx=0 tx=0).stop 2024-09-21T05:47:38.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:38.728+0000 7ff937ed8640 1 -- 172.21.15.7:0/1030529929 shutdown_connections 2024-09-21T05:47:38.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:38.728+0000 7ff937ed8640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff91c0ba8e0 0x7ff91c0bcdf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:38.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:38.728+0000 7ff937ed8640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff930108cf0 0x7ff93019bd10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:38.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:38.728+0000 7ff937ed8640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9301083a0 0x7ff93019b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:38.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:38.728+0000 7ff937ed8640 1 --2- 172.21.15.7:0/1030529929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff930102a60 0x7ff93019b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:38.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:38.728+0000 7ff937ed8640 1 -- 172.21.15.7:0/1030529929 >> 172.21.15.7:0/1030529929 conn(0x7ff930079730 msgr2=0x7ff930101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:38.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:38.728+0000 7ff937ed8640 1 -- 172.21.15.7:0/1030529929 shutdown_connections 2024-09-21T05:47:38.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:47:38.728+0000 7ff937ed8640 1 -- 172.21.15.7:0/1030529929 wait complete. 2024-09-21T05:47:39.311 DEBUG:teuthology.orchestra.run.smithi007:osd.3> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T05:47:39.314 INFO:tasks.cephadm:Deploying osd.4 on smithi027 with /dev/vg_nvme/lv_3... 2024-09-21T05:47:39.314 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T05:47:39.583 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:47:39.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:39 smithi007 ceph-mon[30983]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:39.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:39.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:39.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:39.931 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:39 smithi027 ceph-mon[34364]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:39.931 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:39 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:39.931 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:39 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:39.931 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:39 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:40.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:39 smithi119 ceph-mon[34833]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:40.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:39 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:40.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:39 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:40.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:39 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:41.069 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 05:47:40 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3[54478]: 2024-09-21T05:47:40.956+0000 7f8858ee9640 -1 osd.3 0 log_to_monitors true 2024-09-21T05:47:41.761 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:41 smithi007 ceph-mon[30983]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:41.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:41 smithi007 ceph-mon[30983]: from='osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:47:41.775 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:41 smithi027 ceph-mon[34364]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:41.775 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:41 smithi027 ceph-mon[34364]: from='osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:47:42.061 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:47:42.087 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi027:vg_nvme/lv_3 2024-09-21T05:47:42.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:41 smithi119 ceph-mon[34833]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:42.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:41 smithi119 ceph-mon[34833]: from='osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:47:42.346 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:47:42.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: from='osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:47:42.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T05:47:42.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: from='osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T05:47:42.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:42.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: Detected new or changed devices on smithi007 2024-09-21T05:47:42.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:42.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:42.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:42.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:42.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi007 to 8546M 2024-09-21T05:47:42.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:42.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:42.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:42.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:42.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.822+0000 7fc7511e4640 1 -- 172.21.15.27:0/3846077409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc74c102ae0 msgr2=0x7fc74c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:42.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.822+0000 7fc7511e4640 1 --2- 172.21.15.27:0/3846077409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc74c102ae0 0x7fc74c102ef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009900 tx=0x7fc73c02a410 comp rx=0 tx=0).stop 2024-09-21T05:47:42.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.822+0000 7fc7511e4640 1 -- 172.21.15.27:0/3846077409 shutdown_connections 2024-09-21T05:47:42.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.822+0000 7fc7511e4640 1 --2- 172.21.15.27:0/3846077409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc74c108d70 0x7fc74c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.822+0000 7fc7511e4640 1 --2- 172.21.15.27:0/3846077409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c108420 0x7fc74c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.822+0000 7fc7511e4640 1 --2- 172.21.15.27:0/3846077409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc74c102ae0 0x7fc74c102ef0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.822+0000 7fc7511e4640 1 -- 172.21.15.27:0/3846077409 >> 172.21.15.27:0/3846077409 conn(0x7fc74c079770 msgr2=0x7fc74c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:42.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.822+0000 7fc7511e4640 1 -- 172.21.15.27:0/3846077409 shutdown_connections 2024-09-21T05:47:42.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.822+0000 7fc7511e4640 1 -- 172.21.15.27:0/3846077409 wait complete. 2024-09-21T05:47:42.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.822+0000 7fc7511e4640 1 Processor -- start 2024-09-21T05:47:42.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.823+0000 7fc7511e4640 1 -- start start 2024-09-21T05:47:42.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.823+0000 7fc7511e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c102ae0 0x7fc74c19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.823+0000 7fc7511e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc74c108420 0x7fc74c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.823+0000 7fc7511e4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc74c108d70 0x7fc74c1a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.823+0000 7fc7511e4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc74c112a30 con 0x7fc74c108d70 2024-09-21T05:47:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.823+0000 7fc7511e4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc74c1128b0 con 0x7fc74c108420 2024-09-21T05:47:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.823+0000 7fc7511e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc74c112bb0 con 0x7fc74c102ae0 2024-09-21T05:47:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.823+0000 7fc74a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc74c108420 0x7fc74c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.823+0000 7fc74a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc74c108420 0x7fc74c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55952/0 (socket says 172.21.15.27:55952) 2024-09-21T05:47:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.823+0000 7fc74a59c640 1 -- 172.21.15.27:0/3848424495 learned_addr learned my addr 172.21.15.27:0/3848424495 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-21T05:47:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.823+0000 7fc74b59e640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc74c108d70 0x7fc74c1a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.823+0000 7fc74ad9d640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c102ae0 0x7fc74c19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.824+0000 7fc74a59c640 1 -- 172.21.15.27:0/3848424495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c102ae0 msgr2=0x7fc74c19c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.824+0000 7fc74a59c640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c102ae0 0x7fc74c19c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.824+0000 7fc74a59c640 1 -- 172.21.15.27:0/3848424495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc74c108d70 msgr2=0x7fc74c1a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.824+0000 7fc74a59c640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc74c108d70 0x7fc74c1a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.824+0000 7fc74a59c640 1 -- 172.21.15.27:0/3848424495 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc74c1a2670 con 0x7fc74c108420 2024-09-21T05:47:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.824+0000 7fc74a59c640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc74c108420 0x7fc74c19cca0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc74000c970 tx=0x7fc74000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.824+0000 7fc733fff640 1 -- 172.21.15.27:0/3848424495 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc740007bb0 con 0x7fc74c108420 2024-09-21T05:47:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.824+0000 7fc7511e4640 1 -- 172.21.15.27:0/3848424495 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc74c1a2960 con 0x7fc74c108420 2024-09-21T05:47:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.824+0000 7fc733fff640 1 -- 172.21.15.27:0/3848424495 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc740007d50 con 0x7fc74c108420 2024-09-21T05:47:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.824+0000 7fc733fff640 1 -- 172.21.15.27:0/3848424495 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc740004e10 con 0x7fc74c108420 2024-09-21T05:47:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.824+0000 7fc7511e4640 1 -- 172.21.15.27:0/3848424495 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc74c1a90c0 con 0x7fc74c108420 2024-09-21T05:47:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.825+0000 7fc7511e4640 1 -- 172.21.15.27:0/3848424495 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc74c103d60 con 0x7fc74c108420 2024-09-21T05:47:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.828+0000 7fc733fff640 1 -- 172.21.15.27:0/3848424495 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fc740005000 con 0x7fc74c108420 2024-09-21T05:47:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.828+0000 7fc733fff640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7340b6560 0x7fc7340b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.829+0000 7fc733fff640 1 -- 172.21.15.27:0/3848424495 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3604+0+0 (secure 0 0 0) 0x7fc7400e6180 con 0x7fc74c108420 2024-09-21T05:47:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.829+0000 7fc74ad9d640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7340b6560 0x7fc7340b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:42.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.829+0000 7fc74ad9d640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7340b6560 0x7fc7340b8a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc73c031440 tx=0x7fc73c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:42.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:42.832+0000 7fc733fff640 1 -- 172.21.15.27:0/3848424495 <== mon.2 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc740014030 con 0x7fc74c108420 2024-09-21T05:47:43.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:47:43.028+0000 7fc7511e4640 1 -- 172.21.15.27:0/3848424495 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc74c06c3b0 con 0x7fc7340b6560 2024-09-21T05:47:43.070 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3[54478]: 2024-09-21T05:47:42.700+0000 7f8854e6b640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T05:47:43.070 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3[54478]: 2024-09-21T05:47:42.709+0000 7f8850c69640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:47:43.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: from='osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:47:43.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T05:47:43.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: from='osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T05:47:43.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:43.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi007 2024-09-21T05:47:43.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:43.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:43.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:43.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:43.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi007 to 8546M 2024-09-21T05:47:43.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:43.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:43.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:43.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:43.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: from='osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:47:43.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T05:47:43.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: from='osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T05:47:43.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:43.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: Detected new or changed devices on smithi007 2024-09-21T05:47:43.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:43.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:43.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:43.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:43.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi007 to 8546M 2024-09-21T05:47:43.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:43.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:43.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:43.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:47:43.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:43 smithi027 ceph-mon[34364]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:43.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:43 smithi027 ceph-mon[34364]: from='osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T05:47:43.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:43 smithi027 ceph-mon[34364]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T05:47:43.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:43 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:43.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:43 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:43.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:43 smithi027 ceph-mon[34364]: from='client.24380 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:43.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:43 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:47:43.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:43 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:47:43.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:43 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:44.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:43 smithi007 ceph-mon[30983]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:44.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:43 smithi007 ceph-mon[30983]: from='osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T05:47:44.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:43 smithi007 ceph-mon[30983]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T05:47:44.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:44.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:44.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:43 smithi007 ceph-mon[30983]: from='client.24380 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:44.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:47:44.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:47:44.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:43 smithi119 ceph-mon[34833]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:43 smithi119 ceph-mon[34833]: from='osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T05:47:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:43 smithi119 ceph-mon[34833]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T05:47:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:43 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:43 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:43 smithi119 ceph-mon[34833]: from='client.24380 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:43 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:47:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:43 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:47:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:43 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:44.713 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:44 smithi027 ceph-mon[34364]: purged_snaps scrub starts 2024-09-21T05:47:44.713 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:44 smithi027 ceph-mon[34364]: purged_snaps scrub ok 2024-09-21T05:47:44.713 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:44 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:44.713 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:44 smithi027 ceph-mon[34364]: osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771] boot 2024-09-21T05:47:44.713 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:44 smithi027 ceph-mon[34364]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T05:47:44.713 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:44 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:45.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:44 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T05:47:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:44 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T05:47:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:44 smithi007 ceph-mon[30983]: osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771] boot 2024-09-21T05:47:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:44 smithi007 ceph-mon[30983]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T05:47:45.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:45.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:44 smithi119 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T05:47:45.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:44 smithi119 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T05:47:45.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:44 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:45.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:44 smithi119 ceph-mon[34833]: osd.3 [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771] boot 2024-09-21T05:47:45.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:44 smithi119 ceph-mon[34833]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T05:47:45.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:44 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:47:45.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:45 smithi027 ceph-mon[34364]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:45.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:45 smithi027 ceph-mon[34364]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T05:47:45.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:45 smithi027 ceph-mon[34364]: from='client.? 172.21.15.27:0/2866501513' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "987ce230-5bfc-45a7-a33e-6291545afded"} : dispatch 2024-09-21T05:47:45.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:45 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "987ce230-5bfc-45a7-a33e-6291545afded"} : dispatch 2024-09-21T05:47:45.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:45 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "987ce230-5bfc-45a7-a33e-6291545afded"}]': finished 2024-09-21T05:47:45.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:45 smithi027 ceph-mon[34364]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T05:47:45.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:45 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:47:46.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:45 smithi007 ceph-mon[30983]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:46.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:45 smithi007 ceph-mon[30983]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T05:47:46.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:45 smithi007 ceph-mon[30983]: from='client.? 172.21.15.27:0/2866501513' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "987ce230-5bfc-45a7-a33e-6291545afded"} : dispatch 2024-09-21T05:47:46.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:45 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "987ce230-5bfc-45a7-a33e-6291545afded"} : dispatch 2024-09-21T05:47:46.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:45 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "987ce230-5bfc-45a7-a33e-6291545afded"}]': finished 2024-09-21T05:47:46.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:45 smithi007 ceph-mon[30983]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T05:47:46.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:47:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:45 smithi119 ceph-mon[34833]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:47:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:45 smithi119 ceph-mon[34833]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T05:47:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:45 smithi119 ceph-mon[34833]: from='client.? 172.21.15.27:0/2866501513' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "987ce230-5bfc-45a7-a33e-6291545afded"} : dispatch 2024-09-21T05:47:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:45 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "987ce230-5bfc-45a7-a33e-6291545afded"} : dispatch 2024-09-21T05:47:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:45 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "987ce230-5bfc-45a7-a33e-6291545afded"}]': finished 2024-09-21T05:47:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:45 smithi119 ceph-mon[34833]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T05:47:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:45 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:47:46.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:46 smithi027 ceph-mon[34364]: from='client.? 172.21.15.27:0/4131397695' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:47:47.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:46 smithi007 ceph-mon[30983]: from='client.? 172.21.15.27:0/4131397695' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:47:47.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:46 smithi119 ceph-mon[34833]: from='client.? 172.21.15.27:0/4131397695' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:47:47.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:47 smithi027 ceph-mon[34364]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:47:48.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:47 smithi007 ceph-mon[30983]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:47:48.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:47 smithi119 ceph-mon[34833]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:47:49.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:49 smithi027 ceph-mon[34364]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:47:50.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:49 smithi007 ceph-mon[30983]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:47:50.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:49 smithi119 ceph-mon[34833]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:47:51.996 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:51 smithi027 ceph-mon[34364]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-21T05:47:52.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:51 smithi007 ceph-mon[30983]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-21T05:47:52.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:51 smithi119 ceph-mon[34833]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-21T05:47:53.837 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:53 smithi027 ceph-mon[34364]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:47:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:53 smithi007 ceph-mon[30983]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:47:54.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:53 smithi119 ceph-mon[34833]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:47:54.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:54 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:47:54.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:54 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:54.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:54 smithi027 ceph-mon[34364]: Deploying daemon osd.4 on smithi027 2024-09-21T05:47:55.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:54 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:47:55.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:54 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:55.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:54 smithi007 ceph-mon[30983]: Deploying daemon osd.4 on smithi027 2024-09-21T05:47:55.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:54 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:47:55.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:54 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:55.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:54 smithi119 ceph-mon[34833]: Deploying daemon osd.4 on smithi027 2024-09-21T05:47:55.750 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:55 smithi027 ceph-mon[34364]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T05:47:56.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:55 smithi007 ceph-mon[30983]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T05:47:56.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:55 smithi119 ceph-mon[34833]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T05:47:58.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:57 smithi007 ceph-mon[30983]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T05:47:58.172 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:57 smithi119 ceph-mon[34833]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T05:47:58.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:57 smithi027 ceph-mon[34364]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T05:47:59.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:47:59 smithi027 ceph-mon[34364]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:48:00.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:47:59 smithi007 ceph-mon[30983]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:48:00.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:47:59 smithi119 ceph-mon[34833]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:48:00.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:00 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:00.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:00 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:00.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:00 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:01.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:00 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:01.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:00 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:01.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:00 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:01.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:00 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:01.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:00 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:01.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:00 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:02.281 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:01 smithi027 ceph-mon[34364]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:48:02.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:01 smithi007 ceph-mon[30983]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:48:02.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:01 smithi119 ceph-mon[34833]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:48:03.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:03 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:03.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:03 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:03.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:03 smithi027 ceph-mon[34364]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:48:03.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:03 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:03.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:03 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:03.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:03 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:03.785 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 4 on host 'smithi027' 2024-09-21T05:48:03.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:03.782+0000 7fc733fff640 1 -- 172.21.15.27:0/3848424495 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc74c06c3b0 con 0x7fc7340b6560 2024-09-21T05:48:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:03.785+0000 7fc7511e4640 1 -- 172.21.15.27:0/3848424495 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7340b6560 msgr2=0x7fc7340b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:03.785+0000 7fc7511e4640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7340b6560 0x7fc7340b8a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc73c031440 tx=0x7fc73c009560 comp rx=0 tx=0).stop 2024-09-21T05:48:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:03.785+0000 7fc7511e4640 1 -- 172.21.15.27:0/3848424495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc74c108420 msgr2=0x7fc74c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:03.785+0000 7fc7511e4640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc74c108420 0x7fc74c19cca0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc74000c970 tx=0x7fc74000ce30 comp rx=0 tx=0).stop 2024-09-21T05:48:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:03.785+0000 7fc7511e4640 1 -- 172.21.15.27:0/3848424495 shutdown_connections 2024-09-21T05:48:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:03.785+0000 7fc7511e4640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7340b6560 0x7fc7340b8a70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:03.785+0000 7fc7511e4640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc74c108d70 0x7fc74c1a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:03.785+0000 7fc7511e4640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc74c108420 0x7fc74c19cca0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:03.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:03.785+0000 7fc7511e4640 1 --2- 172.21.15.27:0/3848424495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c102ae0 0x7fc74c19c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:03.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:03.785+0000 7fc7511e4640 1 -- 172.21.15.27:0/3848424495 >> 172.21.15.27:0/3848424495 conn(0x7fc74c079770 msgr2=0x7fc74c06bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:03.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:03.785+0000 7fc7511e4640 1 -- 172.21.15.27:0/3848424495 shutdown_connections 2024-09-21T05:48:03.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:03.785+0000 7fc7511e4640 1 -- 172.21.15.27:0/3848424495 wait complete. 2024-09-21T05:48:03.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:03.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:03.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:03 smithi007 ceph-mon[30983]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:48:03.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:03.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:03.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:03.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:03 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:03.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:03 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:03.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:03 smithi119 ceph-mon[34833]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:48:03.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:03 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:03.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:03 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:03.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:03 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:04.388 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:04.389 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:04.389 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:04.415 DEBUG:teuthology.orchestra.run.smithi027:osd.4> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T05:48:04.418 INFO:tasks.cephadm:Deploying osd.5 on smithi119 with /dev/vg_nvme/lv_3... 2024-09-21T05:48:04.418 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T05:48:04.669 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:48:04.789 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:04.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:04.790 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:04.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:04.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:04.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:05.650 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:05 smithi027 ceph-mon[34364]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:48:05.662 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:05 smithi007 ceph-mon[30983]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:48:05.699 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:05 smithi119 ceph-mon[34833]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:48:06.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:06 smithi007 ceph-mon[30983]: from='osd.4 [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:48:06.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:06 smithi007 ceph-mon[30983]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:48:06.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:06 smithi119 ceph-mon[34833]: from='osd.4 [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:48:06.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:06 smithi119 ceph-mon[34833]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:48:06.616 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:06 smithi027 ceph-mon[34364]: from='osd.4 [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:48:06.616 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:06 smithi027 ceph-mon[34364]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:48:06.616 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 05:48:06 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4[45016]: 2024-09-21T05:48:06.350+0000 7fc43bacd640 -1 osd.4 0 log_to_monitors true 2024-09-21T05:48:06.977 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:48:07.002 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi119:vg_nvme/lv_3 2024-09-21T05:48:07.252 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:48:07.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:07 smithi119 ceph-mon[34833]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:48:07.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:07 smithi119 ceph-mon[34833]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T05:48:07.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:07 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:07.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:07 smithi119 ceph-mon[34833]: from='osd.4 [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:48:07.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:07 smithi119 ceph-mon[34833]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:48:07.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:07 smithi119 ceph-mon[34833]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:48:07.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.713+0000 7fae1c18f640 1 -- 172.21.15.119:0/3497644842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae1410ddf0 msgr2=0x7fae14110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:07.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.713+0000 7fae1c18f640 1 --2- 172.21.15.119:0/3497644842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae1410ddf0 0x7fae14110300 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009ca0 tx=0x7fae0c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.713+0000 7fae1c18f640 1 -- 172.21.15.119:0/3497644842 shutdown_connections 2024-09-21T05:48:07.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.713+0000 7fae1c18f640 1 --2- 172.21.15.119:0/3497644842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae1410ddf0 0x7fae14110300 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.713+0000 7fae1c18f640 1 --2- 172.21.15.119:0/3497644842 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae14105270 0x7fae1410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.713+0000 7fae1c18f640 1 --2- 172.21.15.119:0/3497644842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae14104840 0x7fae14104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.713+0000 7fae1c18f640 1 -- 172.21.15.119:0/3497644842 >> 172.21.15.119:0/3497644842 conn(0x7fae14079730 msgr2=0x7fae14079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:07.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.713+0000 7fae1c18f640 1 -- 172.21.15.119:0/3497644842 shutdown_connections 2024-09-21T05:48:07.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.713+0000 7fae1c18f640 1 -- 172.21.15.119:0/3497644842 wait complete. 2024-09-21T05:48:07.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.713+0000 7fae1c18f640 1 Processor -- start 2024-09-21T05:48:07.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1c18f640 1 -- start start 2024-09-21T05:48:07.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1c18f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae14104840 0x7fae1419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:07.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1c18f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae14105270 0x7fae1419a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:07.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1c18f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae1410ddf0 0x7fae1419fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:07.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1c18f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fae14113a70 con 0x7fae1410ddf0 2024-09-21T05:48:07.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1c18f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fae141138f0 con 0x7fae14104840 2024-09-21T05:48:07.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1c18f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fae14113bf0 con 0x7fae14105270 2024-09-21T05:48:07.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1972a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae14105270 0x7fae1419a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae19f2b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae14104840 0x7fae1419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1972a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae14105270 0x7fae1419a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53632/0 (socket says 172.21.15.119:53632) 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1972a640 1 -- 172.21.15.119:0/3213473316 learned_addr learned my addr 172.21.15.119:0/3213473316 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1a72c640 1 --2- 172.21.15.119:0/3213473316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae1410ddf0 0x7fae1419fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1972a640 1 -- 172.21.15.119:0/3213473316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae14104840 msgr2=0x7fae1419a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1972a640 1 --2- 172.21.15.119:0/3213473316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae14104840 0x7fae1419a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1972a640 1 -- 172.21.15.119:0/3213473316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae1410ddf0 msgr2=0x7fae1419fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1972a640 1 --2- 172.21.15.119:0/3213473316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae1410ddf0 0x7fae1419fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.714+0000 7fae1972a640 1 -- 172.21.15.119:0/3213473316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae141a0210 con 0x7fae14105270 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.715+0000 7fae1972a640 1 --2- 172.21.15.119:0/3213473316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae14105270 0x7fae1419a900 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c8c0 tx=0x7fae0400cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.715+0000 7fae0affd640 1 -- 172.21.15.119:0/3213473316 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04007bb0 con 0x7fae14105270 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.715+0000 7fae0affd640 1 -- 172.21.15.119:0/3213473316 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae04007d50 con 0x7fae14105270 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.715+0000 7fae1c18f640 1 -- 172.21.15.119:0/3213473316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae141a0500 con 0x7fae14105270 2024-09-21T05:48:07.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.715+0000 7fae0affd640 1 -- 172.21.15.119:0/3213473316 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae040187c0 con 0x7fae14105270 2024-09-21T05:48:07.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.715+0000 7fae1c18f640 1 -- 172.21.15.119:0/3213473316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae141a6d20 con 0x7fae14105270 2024-09-21T05:48:07.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.716+0000 7fae1c18f640 1 -- 172.21.15.119:0/3213473316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae14104c50 con 0x7fae14105270 2024-09-21T05:48:07.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.717+0000 7fae0affd640 1 -- 172.21.15.119:0/3213473316 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fae0400fa20 con 0x7fae14105270 2024-09-21T05:48:07.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.718+0000 7fae0affd640 1 --2- 172.21.15.119:0/3213473316 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fae000b6590 0x7fae000b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:07.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.718+0000 7fae0affd640 1 -- 172.21.15.119:0/3213473316 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4036+0+0 (secure 0 0 0) 0x7fae040e6550 con 0x7fae14105270 2024-09-21T05:48:07.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.718+0000 7fae19f2b640 1 --2- 172.21.15.119:0/3213473316 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fae000b6590 0x7fae000b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:07.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.719+0000 7fae19f2b640 1 --2- 172.21.15.119:0/3213473316 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fae000b6590 0x7fae000b8aa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae1406bc00 tx=0x7fae10005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:07.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.721+0000 7fae0affd640 1 -- 172.21.15.119:0/3213473316 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fae04014030 con 0x7fae14105270 2024-09-21T05:48:07.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:07 smithi027 ceph-mon[34364]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:48:07.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:07 smithi027 ceph-mon[34364]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T05:48:07.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:07 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:07.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:07 smithi027 ceph-mon[34364]: from='osd.4 [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:48:07.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:07 smithi027 ceph-mon[34364]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:48:07.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:07 smithi027 ceph-mon[34364]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:48:07.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:07 smithi007 ceph-mon[30983]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:48:07.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:07 smithi007 ceph-mon[30983]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T05:48:07.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:07.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:07 smithi007 ceph-mon[30983]: from='osd.4 [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:48:07.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:07 smithi007 ceph-mon[30983]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:48:07.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:07 smithi007 ceph-mon[30983]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:48:07.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:07.914+0000 7fae1c18f640 1 -- 172.21.15.119:0/3213473316 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fae14100c70 con 0x7fae000b6590 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: Detected new or changed devices on smithi027 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi027 to 8544M 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:08.589 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:08.590 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:08.590 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:08.590 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:08.590 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:08.590 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:08 smithi119 ceph-mon[34833]: from='osd.4 ' entity='osd.4' 2024-09-21T05:48:08.727 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4[45016]: 2024-09-21T05:48:08.322+0000 7fc437a4f640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T05:48:08.727 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4[45016]: 2024-09-21T05:48:08.355+0000 7fc42f845640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:48:08.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-21T05:48:08.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T05:48:08.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:08.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:08.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: Detected new or changed devices on smithi027 2024-09-21T05:48:08.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:08.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:08.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:08.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:08.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi027 to 8544M 2024-09-21T05:48:08.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:08.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:08.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:08.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:08.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:08.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:08.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:08.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:08.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:08 smithi027 ceph-mon[34364]: from='osd.4 ' entity='osd.4' 2024-09-21T05:48:08.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-21T05:48:08.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T05:48:08.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:08.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:08.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi027 2024-09-21T05:48:08.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:08.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:08.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:08.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:08.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi027 to 8544M 2024-09-21T05:48:08.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:08.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:08.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:08.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:08.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:08.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:08.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:08.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:08.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:08 smithi007 ceph-mon[30983]: from='osd.4 ' entity='osd.4' 2024-09-21T05:48:09.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:09 smithi027 ceph-mon[34364]: purged_snaps scrub starts 2024-09-21T05:48:09.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:09 smithi027 ceph-mon[34364]: purged_snaps scrub ok 2024-09-21T05:48:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:09 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:09 smithi027 ceph-mon[34364]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:48:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:09 smithi027 ceph-mon[34364]: osd.4 [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792] boot 2024-09-21T05:48:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:09 smithi027 ceph-mon[34364]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T05:48:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:09 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:09.783 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:09 smithi119 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T05:48:09.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:09 smithi119 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T05:48:09.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:09 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:09.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:09 smithi119 ceph-mon[34833]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:48:09.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:09 smithi119 ceph-mon[34833]: osd.4 [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792] boot 2024-09-21T05:48:09.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:09 smithi119 ceph-mon[34833]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T05:48:09.784 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:09 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:09.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:09 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T05:48:09.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:09 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T05:48:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:09 smithi007 ceph-mon[30983]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:48:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:09 smithi007 ceph-mon[30983]: osd.4 [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792] boot 2024-09-21T05:48:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:09 smithi007 ceph-mon[30983]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T05:48:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:48:10.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:10 smithi027 ceph-mon[34364]: from='client.? 172.21.15.119:0/3846960875' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e768fbfa-8983-4ff6-8dca-b7df2304cf91"} : dispatch 2024-09-21T05:48:10.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:10 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e768fbfa-8983-4ff6-8dca-b7df2304cf91"} : dispatch 2024-09-21T05:48:10.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:10 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e768fbfa-8983-4ff6-8dca-b7df2304cf91"}]': finished 2024-09-21T05:48:10.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:10 smithi027 ceph-mon[34364]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T05:48:10.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:10.728 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:10 smithi119 ceph-mon[34833]: from='client.? 172.21.15.119:0/3846960875' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e768fbfa-8983-4ff6-8dca-b7df2304cf91"} : dispatch 2024-09-21T05:48:10.729 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:10 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e768fbfa-8983-4ff6-8dca-b7df2304cf91"} : dispatch 2024-09-21T05:48:10.729 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:10 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e768fbfa-8983-4ff6-8dca-b7df2304cf91"}]': finished 2024-09-21T05:48:10.729 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:10 smithi119 ceph-mon[34833]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T05:48:10.729 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:10.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:10 smithi007 ceph-mon[30983]: from='client.? 172.21.15.119:0/3846960875' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e768fbfa-8983-4ff6-8dca-b7df2304cf91"} : dispatch 2024-09-21T05:48:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:10 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e768fbfa-8983-4ff6-8dca-b7df2304cf91"} : dispatch 2024-09-21T05:48:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:10 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e768fbfa-8983-4ff6-8dca-b7df2304cf91"}]': finished 2024-09-21T05:48:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:10 smithi007 ceph-mon[30983]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T05:48:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:11.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:11 smithi027 ceph-mon[34364]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:11.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:11 smithi027 ceph-mon[34364]: from='client.? 172.21.15.119:0/3754724302' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:48:11.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:11 smithi007 ceph-mon[30983]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:11 smithi007 ceph-mon[30983]: from='client.? 172.21.15.119:0/3754724302' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:48:11.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:11 smithi119 ceph-mon[34833]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:11.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:11 smithi119 ceph-mon[34833]: from='client.? 172.21.15.119:0/3754724302' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:48:13.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:13 smithi027 ceph-mon[34364]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:13.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:13 smithi007 ceph-mon[30983]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:13.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:13 smithi119 ceph-mon[34833]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:15.585 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:15 smithi119 ceph-mon[34833]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:15.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:15 smithi027 ceph-mon[34364]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:15.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:15 smithi007 ceph-mon[30983]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:17.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:17 smithi119 ceph-mon[34833]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:17.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:17 smithi027 ceph-mon[34364]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:17.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:17 smithi007 ceph-mon[30983]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:19.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:19 smithi027 ceph-mon[34364]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:19.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:19 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:48:19.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:19 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:19.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:19 smithi027 ceph-mon[34364]: Deploying daemon osd.5 on smithi119 2024-09-21T05:48:19.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:19 smithi007 ceph-mon[30983]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:19.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:48:19.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:19.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:19 smithi007 ceph-mon[30983]: Deploying daemon osd.5 on smithi119 2024-09-21T05:48:19.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:19 smithi119 ceph-mon[34833]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:19.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:19 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:48:19.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:19 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:19.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:19 smithi119 ceph-mon[34833]: Deploying daemon osd.5 on smithi119 2024-09-21T05:48:21.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:21 smithi119 ceph-mon[34833]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:21.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:21 smithi027 ceph-mon[34364]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:21.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:21 smithi007 ceph-mon[30983]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:23.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:23 smithi027 ceph-mon[34364]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:23.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:23 smithi119 ceph-mon[34833]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:23.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:23 smithi007 ceph-mon[30983]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:25.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:25 smithi027 ceph-mon[34364]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:25.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:25 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:25.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:25 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:25.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:25 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:25.732 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:25 smithi119 ceph-mon[34833]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:25.732 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:25 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:25.732 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:25 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:25.732 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:25 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:25.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:25 smithi007 ceph-mon[30983]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:25.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:25 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:25.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:25 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:25.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:25 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:27.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:27 smithi027 ceph-mon[34364]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:27.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:27 smithi007 ceph-mon[30983]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:27.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:27 smithi119 ceph-mon[34833]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:28.937 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:28.937 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:28.937 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:28.937 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:28.937 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:28.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:28.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:28.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:28.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:28.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:28.981 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 5 on host 'smithi119' 2024-09-21T05:48:28.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:28.978+0000 7fae0affd640 1 -- 172.21.15.119:0/3213473316 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fae14100c70 con 0x7fae000b6590 2024-09-21T05:48:28.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:28.981+0000 7fae1c18f640 1 -- 172.21.15.119:0/3213473316 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fae000b6590 msgr2=0x7fae000b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:28.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:28.981+0000 7fae1c18f640 1 --2- 172.21.15.119:0/3213473316 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fae000b6590 0x7fae000b8aa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae1406bc00 tx=0x7fae10005f90 comp rx=0 tx=0).stop 2024-09-21T05:48:28.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:28.981+0000 7fae1c18f640 1 -- 172.21.15.119:0/3213473316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae14105270 msgr2=0x7fae1419a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:28.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:28.981+0000 7fae1c18f640 1 --2- 172.21.15.119:0/3213473316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae14105270 0x7fae1419a900 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c8c0 tx=0x7fae0400cd80 comp rx=0 tx=0).stop 2024-09-21T05:48:28.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:28.981+0000 7fae1c18f640 1 -- 172.21.15.119:0/3213473316 shutdown_connections 2024-09-21T05:48:28.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:28.981+0000 7fae1c18f640 1 --2- 172.21.15.119:0/3213473316 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fae000b6590 0x7fae000b8aa0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:28.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:28.981+0000 7fae1c18f640 1 --2- 172.21.15.119:0/3213473316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae1410ddf0 0x7fae1419fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:28.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:28.981+0000 7fae1c18f640 1 --2- 172.21.15.119:0/3213473316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae14105270 0x7fae1419a900 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:28.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:28.981+0000 7fae1c18f640 1 --2- 172.21.15.119:0/3213473316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae14104840 0x7fae1419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:28.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:28.981+0000 7fae1c18f640 1 -- 172.21.15.119:0/3213473316 >> 172.21.15.119:0/3213473316 conn(0x7fae14079730 msgr2=0x7fae140ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:28.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:28.981+0000 7fae1c18f640 1 -- 172.21.15.119:0/3213473316 shutdown_connections 2024-09-21T05:48:28.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:48:28.981+0000 7fae1c18f640 1 -- 172.21.15.119:0/3213473316 wait complete. 2024-09-21T05:48:29.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:29.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:29.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:29.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:29.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:29.608 DEBUG:teuthology.orchestra.run.smithi119:osd.5> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T05:48:29.611 INFO:tasks.cephadm:Deploying osd.6 on smithi007 with /dev/vg_nvme/lv_2... 2024-09-21T05:48:29.611 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T05:48:29.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:29 smithi119 ceph-mon[34833]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:29.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:29 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:29.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:29 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:29.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:29 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:29.878 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:29.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:29 smithi027 ceph-mon[34364]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:29.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:29 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:29.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:29 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:29.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:29 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:30.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:29 smithi007 ceph-mon[30983]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:30.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:29 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:30.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:29 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:30.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:29 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:31.342 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 05:48:31 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T05:48:31.100+0000 7fcd05c9a640 -1 osd.5 0 log_to_monitors true 2024-09-21T05:48:31.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:31 smithi027 ceph-mon[34364]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:31.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:31 smithi027 ceph-mon[34364]: from='osd.5 [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:48:31.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:31 smithi027 ceph-mon[34364]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:48:32.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:31 smithi007 ceph-mon[30983]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:32.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:31 smithi007 ceph-mon[30983]: from='osd.5 [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:48:32.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:31 smithi007 ceph-mon[30983]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:48:32.062 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:31 smithi119 ceph-mon[34833]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:32.062 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:31 smithi119 ceph-mon[34833]: from='osd.5 [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:48:32.063 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:31 smithi119 ceph-mon[34833]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:48:32.310 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:48:32.338 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi007:vg_nvme/lv_2 2024-09-21T05:48:32.605 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:33.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:32 smithi007 ceph-mon[30983]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:48:33.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:32 smithi007 ceph-mon[30983]: from='osd.5 [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:48:33.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:32 smithi007 ceph-mon[30983]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T05:48:33.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:33.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:32 smithi007 ceph-mon[30983]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:48:33.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:33.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:33.028 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:33.028 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:33.028 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:33.028 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:33.028 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:33.028 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:33.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.062+0000 7f8ca96ff640 1 -- 172.21.15.7:0/721490136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca4102a60 msgr2=0x7f8ca4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:33.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.062+0000 7f8ca96ff640 1 --2- 172.21.15.7:0/721490136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca4102a60 0x7f8ca4102e70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009900 tx=0x7f8c9402a410 comp rx=0 tx=0).stop 2024-09-21T05:48:33.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.062+0000 7f8ca96ff640 1 -- 172.21.15.7:0/721490136 shutdown_connections 2024-09-21T05:48:33.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.062+0000 7f8ca96ff640 1 --2- 172.21.15.7:0/721490136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca4108cf0 0x7f8ca410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.062+0000 7f8ca96ff640 1 --2- 172.21.15.7:0/721490136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ca41083a0 0x7f8ca41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.062+0000 7f8ca96ff640 1 --2- 172.21.15.7:0/721490136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca4102a60 0x7f8ca4102e70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.062+0000 7f8ca96ff640 1 -- 172.21.15.7:0/721490136 >> 172.21.15.7:0/721490136 conn(0x7f8ca4079730 msgr2=0x7f8ca4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:33.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.062+0000 7f8ca96ff640 1 -- 172.21.15.7:0/721490136 shutdown_connections 2024-09-21T05:48:33.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.062+0000 7f8ca96ff640 1 -- 172.21.15.7:0/721490136 wait complete. 2024-09-21T05:48:33.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.063+0000 7f8ca96ff640 1 Processor -- start 2024-09-21T05:48:33.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.063+0000 7f8ca96ff640 1 -- start start 2024-09-21T05:48:33.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.063+0000 7f8ca96ff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca4102a60 0x7f8ca419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:33.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.063+0000 7f8ca96ff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ca41083a0 0x7f8ca419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:33.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.063+0000 7f8ca96ff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca4108cf0 0x7f8ca419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:33.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.063+0000 7f8ca96ff640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca4113a80 con 0x7f8ca4108cf0 2024-09-21T05:48:33.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca96ff640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca4113900 con 0x7f8ca41083a0 2024-09-21T05:48:33.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca96ff640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca4113c00 con 0x7f8ca4102a60 2024-09-21T05:48:33.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca4102a60 0x7f8ca419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:33.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca4108cf0 0x7f8ca419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:33.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca4102a60 0x7f8ca419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:54264/0 (socket says 172.21.15.7:54264) 2024-09-21T05:48:33.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca2ffd640 1 -- 172.21.15.7:0/4117183613 learned_addr learned my addr 172.21.15.7:0/4117183613 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:48:33.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca37fe640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca4108cf0 0x7f8ca419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45912/0 (socket says 172.21.15.7:45912) 2024-09-21T05:48:33.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca27fc640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ca41083a0 0x7f8ca419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:33.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca2ffd640 1 -- 172.21.15.7:0/4117183613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ca41083a0 msgr2=0x7f8ca419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:33.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca2ffd640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ca41083a0 0x7f8ca419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca2ffd640 1 -- 172.21.15.7:0/4117183613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca4108cf0 msgr2=0x7f8ca419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:33.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca2ffd640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca4108cf0 0x7f8ca419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:33.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca2ffd640 1 -- 172.21.15.7:0/4117183613 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca41a0400 con 0x7f8ca4102a60 2024-09-21T05:48:33.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca37fe640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca4108cf0 0x7f8ca419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:48:33.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.064+0000 7f8ca2ffd640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca4102a60 0x7f8ca419a490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8c94005940 tx=0x7f8c94004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:33.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.065+0000 7f8c8bfff640 1 -- 172.21.15.7:0/4117183613 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9403f030 con 0x7f8ca4102a60 2024-09-21T05:48:33.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.065+0000 7f8c8bfff640 1 -- 172.21.15.7:0/4117183613 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c94003aa0 con 0x7f8ca4102a60 2024-09-21T05:48:33.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.065+0000 7f8ca96ff640 1 -- 172.21.15.7:0/4117183613 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca41a0690 con 0x7f8ca4102a60 2024-09-21T05:48:33.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.065+0000 7f8c8bfff640 1 -- 172.21.15.7:0/4117183613 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94035070 con 0x7f8ca4102a60 2024-09-21T05:48:33.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.065+0000 7f8ca96ff640 1 -- 172.21.15.7:0/4117183613 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca41a6e50 con 0x7f8ca4102a60 2024-09-21T05:48:33.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.066+0000 7f8ca96ff640 1 -- 172.21.15.7:0/4117183613 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca4103ce0 con 0x7f8ca4102a60 2024-09-21T05:48:33.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.067+0000 7f8c8bfff640 1 -- 172.21.15.7:0/4117183613 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f8c94042030 con 0x7f8ca4102a60 2024-09-21T05:48:33.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.068+0000 7f8c8bfff640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8c8c0b6560 0x7f8c8c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:33.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.068+0000 7f8ca27fc640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8c8c0b6560 0x7f8c8c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:33.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.068+0000 7f8c8bfff640 1 -- 172.21.15.7:0/4117183613 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4468+0+0 (secure 0 0 0) 0x7f8c94106de0 con 0x7f8ca4102a60 2024-09-21T05:48:33.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.069+0000 7f8ca27fc640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8c8c0b6560 0x7f8c8c0b8a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4100c50 tx=0x7f8c98009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:33.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.071+0000 7f8c8bfff640 1 -- 172.21.15.7:0/4117183613 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8c940ce4d0 con 0x7f8ca4102a60 2024-09-21T05:48:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:32 smithi119 ceph-mon[34833]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:48:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:32 smithi119 ceph-mon[34833]: from='osd.5 [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:48:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:32 smithi119 ceph-mon[34833]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T05:48:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:32 smithi119 ceph-mon[34833]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:48:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:33.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:33.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:32 smithi027 ceph-mon[34364]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:48:33.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:32 smithi027 ceph-mon[34364]: from='osd.5 [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:48:33.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:32 smithi027 ceph-mon[34364]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T05:48:33.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:33.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:32 smithi027 ceph-mon[34364]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:48:33.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:33.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:33.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:33.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:33.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:33.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:33.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:33.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:33.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:33.269+0000 7f8ca96ff640 1 -- 172.21.15.7:0/4117183613 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8ca4063800 con 0x7f8c8c0b6560 2024-09-21T05:48:33.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:33 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi119 2024-09-21T05:48:33.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:33 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi119 to 8544M 2024-09-21T05:48:33.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:33 smithi007 ceph-mon[30983]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:33.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:33 smithi007 ceph-mon[30983]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T05:48:33.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:33 smithi007 ceph-mon[30983]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T05:48:33.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:33.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:33.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:33.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:33.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:33.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:33 smithi007 ceph-mon[30983]: from='osd.5 ' entity='osd.5' 2024-09-21T05:48:34.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:33 smithi119 ceph-mon[34833]: Detected new or changed devices on smithi119 2024-09-21T05:48:34.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:33 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi119 to 8544M 2024-09-21T05:48:34.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:33 smithi119 ceph-mon[34833]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:34.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:33 smithi119 ceph-mon[34833]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T05:48:34.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:33 smithi119 ceph-mon[34833]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T05:48:34.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:34.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:34.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:34.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:34.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:34.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:33 smithi119 ceph-mon[34833]: from='osd.5 ' entity='osd.5' 2024-09-21T05:48:34.093 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 05:48:33 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T05:48:33.675+0000 7fcd01c1c640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T05:48:34.093 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 05:48:33 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T05:48:33.684+0000 7fccf9a12640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:48:34.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:33 smithi027 ceph-mon[34364]: Detected new or changed devices on smithi119 2024-09-21T05:48:34.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:33 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi119 to 8544M 2024-09-21T05:48:34.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:33 smithi027 ceph-mon[34364]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:34.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:33 smithi027 ceph-mon[34364]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T05:48:34.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:33 smithi027 ceph-mon[34364]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T05:48:34.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:34.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:34.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:34.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:34.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:34.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:33 smithi027 ceph-mon[34364]: from='osd.5 ' entity='osd.5' 2024-09-21T05:48:34.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:34 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T05:48:34.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:34 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T05:48:34.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:34 smithi007 ceph-mon[30983]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:34.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:34.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:34 smithi007 ceph-mon[30983]: osd.5 [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619] boot 2024-09-21T05:48:34.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:34 smithi007 ceph-mon[30983]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T05:48:34.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:35.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:34 smithi119 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T05:48:35.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:34 smithi119 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T05:48:35.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:34 smithi119 ceph-mon[34833]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:35.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:34 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:35.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:34 smithi119 ceph-mon[34833]: osd.5 [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619] boot 2024-09-21T05:48:35.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:34 smithi119 ceph-mon[34833]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T05:48:35.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:34 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:35.128 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:34 smithi027 ceph-mon[34364]: purged_snaps scrub starts 2024-09-21T05:48:35.128 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:34 smithi027 ceph-mon[34364]: purged_snaps scrub ok 2024-09-21T05:48:35.128 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:34 smithi027 ceph-mon[34364]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:35.128 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:34 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:35.128 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:34 smithi027 ceph-mon[34364]: osd.5 [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619] boot 2024-09-21T05:48:35.128 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:34 smithi027 ceph-mon[34364]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T05:48:35.128 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:34 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:48:36.008 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:35 smithi119 ceph-mon[34833]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:36.008 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:35 smithi119 ceph-mon[34833]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T05:48:36.008 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:35 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2119139856' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "22496f13-64be-479b-89ea-bf51544199c3"} : dispatch 2024-09-21T05:48:36.008 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:35 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2119139856' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22496f13-64be-479b-89ea-bf51544199c3"}]': finished 2024-09-21T05:48:36.008 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:35 smithi119 ceph-mon[34833]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T05:48:36.008 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:35 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:35 smithi007 ceph-mon[30983]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:35 smithi007 ceph-mon[30983]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T05:48:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2119139856' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "22496f13-64be-479b-89ea-bf51544199c3"} : dispatch 2024-09-21T05:48:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2119139856' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22496f13-64be-479b-89ea-bf51544199c3"}]': finished 2024-09-21T05:48:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:35 smithi007 ceph-mon[30983]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T05:48:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:36.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:35 smithi027 ceph-mon[34364]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:48:36.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:35 smithi027 ceph-mon[34364]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T05:48:36.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:35 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2119139856' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "22496f13-64be-479b-89ea-bf51544199c3"} : dispatch 2024-09-21T05:48:36.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:35 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2119139856' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22496f13-64be-479b-89ea-bf51544199c3"}]': finished 2024-09-21T05:48:36.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:35 smithi027 ceph-mon[34364]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T05:48:36.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:35 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:37.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:36 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1129402302' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:48:37.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:36 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1129402302' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:48:37.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:36 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1129402302' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:48:38.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:37 smithi007 ceph-mon[30983]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:38.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:37 smithi119 ceph-mon[34833]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:38.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:37 smithi027 ceph-mon[34364]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:40.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:39 smithi007 ceph-mon[30983]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:40.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:39 smithi119 ceph-mon[34833]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:40.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:39 smithi027 ceph-mon[34364]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:41.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:41 smithi007 ceph-mon[30983]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-21T05:48:42.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:41 smithi119 ceph-mon[34833]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-21T05:48:42.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:41 smithi027 ceph-mon[34364]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-21T05:48:43.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:43 smithi007 ceph-mon[30983]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:48:44.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:43 smithi119 ceph-mon[34833]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:48:44.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:43 smithi027 ceph-mon[34364]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:48:44.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:48:44.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:44.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:44 smithi007 ceph-mon[30983]: Deploying daemon osd.6 on smithi007 2024-09-21T05:48:45.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:44 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:48:45.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:44 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:45.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:44 smithi119 ceph-mon[34833]: Deploying daemon osd.6 on smithi007 2024-09-21T05:48:45.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:44 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:48:45.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:44 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:45.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:44 smithi027 ceph-mon[34364]: Deploying daemon osd.6 on smithi007 2024-09-21T05:48:45.960 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:45 smithi007 ceph-mon[30983]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T05:48:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:45 smithi119 ceph-mon[34833]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T05:48:46.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:45 smithi027 ceph-mon[34364]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T05:48:48.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:47 smithi007 ceph-mon[30983]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T05:48:48.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:47 smithi119 ceph-mon[34833]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T05:48:48.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:47 smithi027 ceph-mon[34364]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T05:48:49.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:49 smithi007 ceph-mon[30983]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:48:50.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:49 smithi119 ceph-mon[34833]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:48:50.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:49 smithi027 ceph-mon[34364]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:48:50.853 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:50.853 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:50.853 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:51.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:50 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:51.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:50 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:51.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:50 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:51.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:50 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:51.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:50 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:51.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:50 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:52.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:52 smithi007 ceph-mon[30983]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:48:52.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:52 smithi027 ceph-mon[34364]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:48:52.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:52 smithi119 ceph-mon[34833]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:48:53.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:53.877+0000 7f8c8bfff640 1 -- 172.21.15.7:0/4117183613 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8ca4063800 con 0x7f8c8c0b6560 2024-09-21T05:48:53.879 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 6 on host 'smithi007' 2024-09-21T05:48:53.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:53.880+0000 7f8ca96ff640 1 -- 172.21.15.7:0/4117183613 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8c8c0b6560 msgr2=0x7f8c8c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:53.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:53.880+0000 7f8ca96ff640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8c8c0b6560 0x7f8c8c0b8a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4100c50 tx=0x7f8c98009680 comp rx=0 tx=0).stop 2024-09-21T05:48:53.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:53.880+0000 7f8ca96ff640 1 -- 172.21.15.7:0/4117183613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca4102a60 msgr2=0x7f8ca419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:53.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:53.880+0000 7f8ca96ff640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca4102a60 0x7f8ca419a490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8c94005940 tx=0x7f8c94004270 comp rx=0 tx=0).stop 2024-09-21T05:48:53.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:53.880+0000 7f8ca96ff640 1 -- 172.21.15.7:0/4117183613 shutdown_connections 2024-09-21T05:48:53.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:53.880+0000 7f8ca96ff640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8c8c0b6560 0x7f8c8c0b8a70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:53.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:53.880+0000 7f8ca96ff640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca4108cf0 0x7f8ca419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:53.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:53.880+0000 7f8ca96ff640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ca41083a0 0x7f8ca419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:53.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:53.880+0000 7f8ca96ff640 1 --2- 172.21.15.7:0/4117183613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca4102a60 0x7f8ca419a490 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:53.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:53.880+0000 7f8ca96ff640 1 -- 172.21.15.7:0/4117183613 >> 172.21.15.7:0/4117183613 conn(0x7f8ca4079730 msgr2=0x7f8ca4101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:53.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:53.881+0000 7f8ca96ff640 1 -- 172.21.15.7:0/4117183613 shutdown_connections 2024-09-21T05:48:53.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:48:53.881+0000 7f8ca96ff640 1 -- 172.21.15.7:0/4117183613 wait complete. 2024-09-21T05:48:54.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:53 smithi119 ceph-mon[34833]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:54.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:54.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:54.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:54.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:54.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:53 smithi007 ceph-mon[30983]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:54.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:53 smithi027 ceph-mon[34364]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:54.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:54.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:54.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:54.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:54.573 DEBUG:teuthology.orchestra.run.smithi007:osd.6> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T05:48:54.575 INFO:tasks.cephadm:Deploying osd.7 on smithi027 with /dev/vg_nvme/lv_2... 2024-09-21T05:48:54.575 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T05:48:54.847 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:48:54.968 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:54 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:54.968 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:54 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:54.968 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:54 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:55.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:54 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:55.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:54 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:55.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:54 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:55.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:54 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:55.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:54 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:55.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:54 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:55.882 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 05:48:55 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T05:48:55.808+0000 7f5649069640 -1 osd.6 0 log_to_monitors true 2024-09-21T05:48:56.214 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:55 smithi027 ceph-mon[34364]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:56.215 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:55 smithi027 ceph-mon[34364]: from='osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:48:56.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:55 smithi007 ceph-mon[30983]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:56.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:55 smithi007 ceph-mon[30983]: from='osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:48:56.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:55 smithi119 ceph-mon[34833]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:56.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:55 smithi119 ceph-mon[34833]: from='osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:48:57.105 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:56 smithi027 ceph-mon[34364]: from='osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:48:57.105 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:56 smithi027 ceph-mon[34364]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T05:48:57.105 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:56 smithi027 ceph-mon[34364]: from='osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T05:48:57.105 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:56 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:57.105 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:56 smithi027 ceph-mon[34364]: from='osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T05:48:57.165 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 05:48:56 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T05:48:56.885+0000 7f5644feb640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T05:48:57.165 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 05:48:56 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T05:48:56.896+0000 7f5640de9640 -1 osd.6 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:48:57.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:56 smithi007 ceph-mon[30983]: from='osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:48:57.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:56 smithi007 ceph-mon[30983]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T05:48:57.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:56 smithi007 ceph-mon[30983]: from='osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T05:48:57.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:57.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:56 smithi007 ceph-mon[30983]: from='osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T05:48:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:56 smithi119 ceph-mon[34833]: from='osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:48:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:56 smithi119 ceph-mon[34833]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T05:48:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:56 smithi119 ceph-mon[34833]: from='osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T05:48:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:56 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:56 smithi119 ceph-mon[34833]: from='osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T05:48:57.409 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:48:57.436 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi027:vg_nvme/lv_2 2024-09-21T05:48:57.699 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:48:58.051 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:58.051 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T05:48:58.051 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:58.051 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:58.051 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: Detected new or changed devices on smithi007 2024-09-21T05:48:58.051 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:58.051 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:58.051 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:58.051 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:58.051 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:58.052 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi007 to 5697M 2024-09-21T05:48:58.052 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:58.052 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:58.052 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:58.052 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:58.052 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:58.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.144+0000 7f2384106640 1 -- 172.21.15.27:0/2540407578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f237c102a60 msgr2=0x7f237c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:58.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.144+0000 7f2384106640 1 --2- 172.21.15.27:0/2540407578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f237c102a60 0x7f237c102e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2378009900 tx=0x7f237802a410 comp rx=0 tx=0).stop 2024-09-21T05:48:58.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.144+0000 7f2384106640 1 -- 172.21.15.27:0/2540407578 shutdown_connections 2024-09-21T05:48:58.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.144+0000 7f2384106640 1 --2- 172.21.15.27:0/2540407578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f237c1083a0 0x7f237c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.144+0000 7f2384106640 1 --2- 172.21.15.27:0/2540407578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f237c108cf0 0x7f237c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.144+0000 7f2384106640 1 --2- 172.21.15.27:0/2540407578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f237c102a60 0x7f237c102e70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.144+0000 7f2384106640 1 -- 172.21.15.27:0/2540407578 >> 172.21.15.27:0/2540407578 conn(0x7f237c079730 msgr2=0x7f237c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.145+0000 7f2384106640 1 -- 172.21.15.27:0/2540407578 shutdown_connections 2024-09-21T05:48:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.145+0000 7f2384106640 1 -- 172.21.15.27:0/2540407578 wait complete. 2024-09-21T05:48:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.145+0000 7f2384106640 1 Processor -- start 2024-09-21T05:48:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2384106640 1 -- start start 2024-09-21T05:48:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2384106640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f237c102a60 0x7f237c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2384106640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f237c1083a0 0x7f237c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2384106640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f237c108cf0 0x7f237c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2384106640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f237c113a80 con 0x7f237c108cf0 2024-09-21T05:48:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2384106640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f237c113900 con 0x7f237c102a60 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2384106640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f237c113c00 con 0x7f237c1083a0 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2381ea2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f237c102a60 0x7f237c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2381ea2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f237c102a60 0x7f237c19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46530/0 (socket says 172.21.15.27:46530) 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2381ea2640 1 -- 172.21.15.27:0/2560137125 learned_addr learned my addr 172.21.15.27:0/2560137125 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f23816a1640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f237c1083a0 0x7f237c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f23826a3640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f237c108cf0 0x7f237c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2381ea2640 1 -- 172.21.15.27:0/2560137125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f237c1083a0 msgr2=0x7f237c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2381ea2640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f237c1083a0 0x7f237c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2381ea2640 1 -- 172.21.15.27:0/2560137125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f237c108cf0 msgr2=0x7f237c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2381ea2640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f237c108cf0 0x7f237c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f2381ea2640 1 -- 172.21.15.27:0/2560137125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c1a03c0 con 0x7f237c102a60 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.146+0000 7f23816a1640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f237c1083a0 0x7f237c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.147+0000 7f2381ea2640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f237c102a60 0x7f237c19a450 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2378005940 tx=0x7f2378004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:58.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.147+0000 7f2372ffd640 1 -- 172.21.15.27:0/2560137125 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237803f030 con 0x7f237c102a60 2024-09-21T05:48:58.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.147+0000 7f2372ffd640 1 -- 172.21.15.27:0/2560137125 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2378003aa0 con 0x7f237c102a60 2024-09-21T05:48:58.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.147+0000 7f2384106640 1 -- 172.21.15.27:0/2560137125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237c1a0650 con 0x7f237c102a60 2024-09-21T05:48:58.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.147+0000 7f2372ffd640 1 -- 172.21.15.27:0/2560137125 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378035070 con 0x7f237c102a60 2024-09-21T05:48:58.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.147+0000 7f2384106640 1 -- 172.21.15.27:0/2560137125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237c10fe90 con 0x7f237c102a60 2024-09-21T05:48:58.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.148+0000 7f2384106640 1 -- 172.21.15.27:0/2560137125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f237c103ce0 con 0x7f237c102a60 2024-09-21T05:48:58.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.150+0000 7f2372ffd640 1 -- 172.21.15.27:0/2560137125 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f2378042030 con 0x7f237c102a60 2024-09-21T05:48:58.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.151+0000 7f2372ffd640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23680b6560 0x7f23680b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:58.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.151+0000 7f23816a1640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23680b6560 0x7f23680b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:58.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.151+0000 7f2372ffd640 1 -- 172.21.15.27:0/2560137125 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5180+0+0 (secure 0 0 0) 0x7f2378107230 con 0x7f237c102a60 2024-09-21T05:48:58.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.152+0000 7f23816a1640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23680b6560 0x7f23680b8a70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f237c100d20 tx=0x7f236c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:58.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.154+0000 7f2372ffd640 1 -- 172.21.15.27:0/2560137125 <== mon.2 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23780ce700 con 0x7f237c102a60 2024-09-21T05:48:58.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:58.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T05:48:58.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:58.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:58.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi007 2024-09-21T05:48:58.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:58.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:58.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:58.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:58.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:58.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi007 to 5697M 2024-09-21T05:48:58.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:58.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:58.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:58.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:58.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:48:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T05:48:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: Detected new or changed devices on smithi007 2024-09-21T05:48:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:58.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:58.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi007 to 5697M 2024-09-21T05:48:58.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:58.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:58.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:58.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:48:58.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:58.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:48:58.352+0000 7f2384106640 1 -- 172.21.15.27:0/2560137125 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f237c063800 con 0x7f23680b6560 2024-09-21T05:48:59.079 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:58 smithi027 ceph-mon[34364]: purged_snaps scrub starts 2024-09-21T05:48:59.079 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:58 smithi027 ceph-mon[34364]: purged_snaps scrub ok 2024-09-21T05:48:59.079 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:58 smithi027 ceph-mon[34364]: osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021] boot 2024-09-21T05:48:59.079 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:58 smithi027 ceph-mon[34364]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T05:48:59.079 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:59.079 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:59.079 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:59.079 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:59.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:58 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T05:48:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:58 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T05:48:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:58 smithi007 ceph-mon[30983]: osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021] boot 2024-09-21T05:48:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:58 smithi007 ceph-mon[30983]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T05:48:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:59.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:59.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:58 smithi119 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T05:48:59.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:58 smithi119 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T05:48:59.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:58 smithi119 ceph-mon[34833]: osd.6 [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021] boot 2024-09-21T05:48:59.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:58 smithi119 ceph-mon[34833]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T05:48:59.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:48:59.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:59.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:59.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:00.119 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:59 smithi027 ceph-mon[34364]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:00.119 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:59 smithi027 ceph-mon[34364]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:49:00.119 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:48:59 smithi027 ceph-mon[34364]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T05:49:00.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:59 smithi007 ceph-mon[30983]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:00.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:59 smithi007 ceph-mon[30983]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:49:00.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:48:59 smithi007 ceph-mon[30983]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T05:49:00.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:59 smithi119 ceph-mon[34833]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:00.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:59 smithi119 ceph-mon[34833]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:49:00.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:48:59 smithi119 ceph-mon[34833]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T05:49:01.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:00 smithi027 ceph-mon[34364]: from='client.? 172.21.15.27:0/737721296' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "53fc5616-b06a-498e-a60e-d7d7d6ba2a59"} : dispatch 2024-09-21T05:49:01.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:00 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "53fc5616-b06a-498e-a60e-d7d7d6ba2a59"} : dispatch 2024-09-21T05:49:01.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:00 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53fc5616-b06a-498e-a60e-d7d7d6ba2a59"}]': finished 2024-09-21T05:49:01.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:00 smithi027 ceph-mon[34364]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T05:49:01.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:00 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:01.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.27:0/737721296' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "53fc5616-b06a-498e-a60e-d7d7d6ba2a59"} : dispatch 2024-09-21T05:49:01.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:00 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "53fc5616-b06a-498e-a60e-d7d7d6ba2a59"} : dispatch 2024-09-21T05:49:01.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:00 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53fc5616-b06a-498e-a60e-d7d7d6ba2a59"}]': finished 2024-09-21T05:49:01.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:00 smithi007 ceph-mon[30983]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T05:49:01.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:00 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:01.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:00 smithi119 ceph-mon[34833]: from='client.? 172.21.15.27:0/737721296' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "53fc5616-b06a-498e-a60e-d7d7d6ba2a59"} : dispatch 2024-09-21T05:49:01.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:00 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "53fc5616-b06a-498e-a60e-d7d7d6ba2a59"} : dispatch 2024-09-21T05:49:01.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:00 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53fc5616-b06a-498e-a60e-d7d7d6ba2a59"}]': finished 2024-09-21T05:49:01.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:00 smithi119 ceph-mon[34833]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T05:49:01.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:00 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:02.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:01 smithi027 ceph-mon[34364]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:02.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:01 smithi027 ceph-mon[34364]: from='client.? 172.21.15.27:0/78633111' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:02.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:01 smithi007 ceph-mon[30983]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:02.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:01 smithi007 ceph-mon[30983]: from='client.? 172.21.15.27:0/78633111' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:02.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:01 smithi119 ceph-mon[34833]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:02.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:01 smithi119 ceph-mon[34833]: from='client.? 172.21.15.27:0/78633111' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:04.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:03 smithi027 ceph-mon[34364]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:04.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:03 smithi007 ceph-mon[30983]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:04.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:03 smithi119 ceph-mon[34833]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:06.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:05 smithi027 ceph-mon[34364]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:06.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:05 smithi007 ceph-mon[30983]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:06.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:05 smithi119 ceph-mon[34833]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:08.172 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:07 smithi027 ceph-mon[34364]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:08.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:07 smithi007 ceph-mon[30983]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:08.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:07 smithi119 ceph-mon[34833]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:10.090 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:09 smithi027 ceph-mon[34364]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:10.090 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:09 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:49:10.090 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:09 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:10.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:09 smithi007 ceph-mon[30983]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:10.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:49:10.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:10.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:09 smithi119 ceph-mon[34833]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:10.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:09 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:49:10.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:09 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:11.107 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:10 smithi027 ceph-mon[34364]: Deploying daemon osd.7 on smithi027 2024-09-21T05:49:11.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:10 smithi007 ceph-mon[30983]: Deploying daemon osd.7 on smithi027 2024-09-21T05:49:11.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:10 smithi119 ceph-mon[34833]: Deploying daemon osd.7 on smithi027 2024-09-21T05:49:12.132 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:11 smithi027 ceph-mon[34364]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:12.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:11 smithi007 ceph-mon[30983]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:12.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:11 smithi119 ceph-mon[34833]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:14.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:13 smithi027 ceph-mon[34364]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:14.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:13 smithi007 ceph-mon[30983]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:14.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:13 smithi119 ceph-mon[34833]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:16.148 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:15 smithi027 ceph-mon[34364]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:16.148 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:15 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:16.148 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:15 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:16.148 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:15 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:16.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:15 smithi007 ceph-mon[30983]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:16.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:16.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:16.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:16.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:15 smithi119 ceph-mon[34833]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:16.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:15 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:16.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:15 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:16.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:15 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:18.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:17 smithi027 ceph-mon[34364]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:18.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:17 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:18.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:17 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:18.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:17 smithi007 ceph-mon[30983]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:18.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:17 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:18.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:17 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:18.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:17 smithi119 ceph-mon[34833]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:17 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:17 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:18.945 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 7 on host 'smithi027' 2024-09-21T05:49:18.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:49:18.943+0000 7f2372ffd640 1 -- 172.21.15.27:0/2560137125 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f237c063800 con 0x7f23680b6560 2024-09-21T05:49:18.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:49:18.946+0000 7f2384106640 1 -- 172.21.15.27:0/2560137125 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23680b6560 msgr2=0x7f23680b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:18.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:49:18.946+0000 7f2384106640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23680b6560 0x7f23680b8a70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f237c100d20 tx=0x7f236c005f90 comp rx=0 tx=0).stop 2024-09-21T05:49:18.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:49:18.946+0000 7f2384106640 1 -- 172.21.15.27:0/2560137125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f237c102a60 msgr2=0x7f237c19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:49:18.946+0000 7f2384106640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f237c102a60 0x7f237c19a450 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2378005940 tx=0x7f2378004270 comp rx=0 tx=0).stop 2024-09-21T05:49:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:49:18.946+0000 7f2384106640 1 -- 172.21.15.27:0/2560137125 shutdown_connections 2024-09-21T05:49:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:49:18.946+0000 7f2384106640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23680b6560 0x7f23680b8a70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:49:18.946+0000 7f2384106640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f237c108cf0 0x7f237c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:49:18.946+0000 7f2384106640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f237c1083a0 0x7f237c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:49:18.946+0000 7f2384106640 1 --2- 172.21.15.27:0/2560137125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f237c102a60 0x7f237c19a450 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:49:18.946+0000 7f2384106640 1 -- 172.21.15.27:0/2560137125 >> 172.21.15.27:0/2560137125 conn(0x7f237c079730 msgr2=0x7f237c101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:49:18.946+0000 7f2384106640 1 -- 172.21.15.27:0/2560137125 shutdown_connections 2024-09-21T05:49:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:49:18.946+0000 7f2384106640 1 -- 172.21.15.27:0/2560137125 wait complete. 2024-09-21T05:49:19.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:19.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:19.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:19.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:19.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:19.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:18 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:19.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:19.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:19.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:19.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:19.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:19.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:19.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:19.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:19.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:19.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:19.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:19.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:18 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:19.591 DEBUG:teuthology.orchestra.run.smithi027:osd.7> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T05:49:19.594 INFO:tasks.cephadm:Deploying osd.8 on smithi119 with /dev/vg_nvme/lv_2... 2024-09-21T05:49:19.594 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T05:49:19.847 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:49:20.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:20 smithi007 ceph-mon[30983]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:20.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:20 smithi119 ceph-mon[34833]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:20.705 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:20 smithi027 ceph-mon[34364]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:21.977 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 05:49:21 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T05:49:21.517+0000 7f5b8195a640 -1 osd.7 0 log_to_monitors true 2024-09-21T05:49:22.167 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:49:22.192 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi119:vg_nvme/lv_2 2024-09-21T05:49:22.449 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:49:22.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:22 smithi027 ceph-mon[34364]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:22.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:22 smithi027 ceph-mon[34364]: from='osd.7 [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:49:22.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:22 smithi027 ceph-mon[34364]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:49:22.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:22 smithi007 ceph-mon[30983]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:22.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:22 smithi007 ceph-mon[30983]: from='osd.7 [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:49:22.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:22 smithi007 ceph-mon[30983]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:49:22.569 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:22 smithi119 ceph-mon[34833]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:22.570 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:22 smithi119 ceph-mon[34833]: from='osd.7 [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:49:22.570 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:22 smithi119 ceph-mon[34833]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:49:22.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.969+0000 7f7d8ff48640 1 -- 172.21.15.119:0/4059663341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d88102a80 msgr2=0x7f7d88102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:22.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.969+0000 7f7d8ff48640 1 --2- 172.21.15.119:0/4059663341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d88102a80 0x7f7d88102e90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009900 tx=0x7f7d8402a410 comp rx=0 tx=0).stop 2024-09-21T05:49:22.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.969+0000 7f7d8ff48640 1 -- 172.21.15.119:0/4059663341 shutdown_connections 2024-09-21T05:49:22.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.969+0000 7f7d8ff48640 1 --2- 172.21.15.119:0/4059663341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d88108d10 0x7f7d8810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.969+0000 7f7d8ff48640 1 --2- 172.21.15.119:0/4059663341 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d881083c0 0x7f7d881087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.969+0000 7f7d8ff48640 1 --2- 172.21.15.119:0/4059663341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d88102a80 0x7f7d88102e90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.969+0000 7f7d8ff48640 1 -- 172.21.15.119:0/4059663341 >> 172.21.15.119:0/4059663341 conn(0x7f7d88079740 msgr2=0x7f7d88079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:22.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.969+0000 7f7d8ff48640 1 -- 172.21.15.119:0/4059663341 shutdown_connections 2024-09-21T05:49:22.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.969+0000 7f7d8ff48640 1 -- 172.21.15.119:0/4059663341 wait complete. 2024-09-21T05:49:22.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.969+0000 7f7d8ff48640 1 Processor -- start 2024-09-21T05:49:22.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8ff48640 1 -- start start 2024-09-21T05:49:22.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8ff48640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d88102a80 0x7f7d8810ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:22.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8ff48640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d881083c0 0x7f7d88110510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:22.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8ff48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d88108d10 0x7f7d88110a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:22.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8ff48640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88113ad0 con 0x7f7d88102a80 2024-09-21T05:49:22.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8ff48640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88113950 con 0x7f7d881083c0 2024-09-21T05:49:22.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8ff48640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88113c50 con 0x7f7d88108d10 2024-09-21T05:49:22.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8dce4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d88102a80 0x7f7d8810ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:22.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8dce4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d88102a80 0x7f7d8810ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.119:35200/0 (socket says 172.21.15.119:35200) 2024-09-21T05:49:22.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8dce4640 1 -- 172.21.15.119:0/3629214930 learned_addr learned my addr 172.21.15.119:0/3629214930 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-21T05:49:22.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8e4e5640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d88108d10 0x7f7d88110a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:22.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8d4e3640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d881083c0 0x7f7d88110510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8dce4640 1 -- 172.21.15.119:0/3629214930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d88108d10 msgr2=0x7f7d88110a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8dce4640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d88108d10 0x7f7d88110a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8dce4640 1 -- 172.21.15.119:0/3629214930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d881083c0 msgr2=0x7f7d88110510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.970+0000 7f7d8dce4640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d881083c0 0x7f7d88110510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.971+0000 7f7d8dce4640 1 -- 172.21.15.119:0/3629214930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d881a8760 con 0x7f7d88102a80 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.971+0000 7f7d8e4e5640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d88108d10 0x7f7d88110a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.971+0000 7f7d8d4e3640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d881083c0 0x7f7d88110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.971+0000 7f7d8dce4640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d88102a80 0x7f7d8810ffd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7d84005ab0 tx=0x7f7d84003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.971+0000 7f7d7effd640 1 -- 172.21.15.119:0/3629214930 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8403f070 con 0x7f7d88102a80 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.971+0000 7f7d8ff48640 1 -- 172.21.15.119:0/3629214930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d881a89f0 con 0x7f7d88102a80 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.971+0000 7f7d7effd640 1 -- 172.21.15.119:0/3629214930 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d84031d60 con 0x7f7d88102a80 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.971+0000 7f7d8ff48640 1 -- 172.21.15.119:0/3629214930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d881a8f20 con 0x7f7d88102a80 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.971+0000 7f7d7effd640 1 -- 172.21.15.119:0/3629214930 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84035030 con 0x7f7d88102a80 2024-09-21T05:49:22.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.972+0000 7f7d8ff48640 1 -- 172.21.15.119:0/3629214930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d88102e90 con 0x7f7d88102a80 2024-09-21T05:49:22.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.974+0000 7f7d7effd640 1 -- 172.21.15.119:0/3629214930 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f7d84042070 con 0x7f7d88102a80 2024-09-21T05:49:22.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.975+0000 7f7d7effd640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7d740b6560 0x7f7d740b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:22.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.975+0000 7f7d7effd640 1 -- 172.21.15.119:0/3629214930 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5316+0+0 (secure 0 0 0) 0x7f7d841076e0 con 0x7f7d88102a80 2024-09-21T05:49:22.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.975+0000 7f7d8d4e3640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7d740b6560 0x7f7d740b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:22.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.975+0000 7f7d8d4e3640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7d740b6560 0x7f7d740b8a70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7d78005fd0 tx=0x7f7d78005ea0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:22.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:22.978+0000 7f7d7effd640 1 -- 172.21.15.119:0/3629214930 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d840cea80 con 0x7f7d88102a80 2024-09-21T05:49:23.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:23.173+0000 7f7d8ff48640 1 -- 172.21.15.119:0/3629214930 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7d88063800 con 0x7f7d740b6560 2024-09-21T05:49:23.473 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:49:23.473 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T05:49:23.473 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:23.473 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='osd.7 [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:49:23.473 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:49:23.473 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: Detected new or changed devices on smithi027 2024-09-21T05:49:23.473 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:23.473 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:23.473 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:23.473 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:23.473 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:23.474 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi027 to 5696M 2024-09-21T05:49:23.474 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:23.474 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:23.474 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:23.474 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:23.474 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:23.474 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:23.474 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:49:23.474 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:49:23.474 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:49:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T05:49:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='osd.7 [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:49:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:49:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi027 2024-09-21T05:49:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi027 to 5696M 2024-09-21T05:49:23.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:23.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:23.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:23.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:23.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:23.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:23.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:49:23.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:49:23.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:23.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T05:49:23.268+0000 7f5b7d8dc640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T05:49:23.727 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T05:49:23.282+0000 7f5b796da640 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:49:23.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:49:23.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T05:49:23.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:23.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='osd.7 [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:49:23.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:49:23.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: Detected new or changed devices on smithi027 2024-09-21T05:49:23.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:23.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:23.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:23.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:23.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:23.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi027 to 5696M 2024-09-21T05:49:23.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:23.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:23.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:23.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:23.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:23.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:23.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:49:23.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:49:23.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:24.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:24 smithi007 ceph-mon[30983]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-21T05:49:24.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:24 smithi007 ceph-mon[30983]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T05:49:24.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:24.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:24.587 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:24 smithi119 ceph-mon[34833]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-21T05:49:24.587 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:24 smithi119 ceph-mon[34833]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T05:49:24.587 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:24.588 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:24 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:24.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:24 smithi027 ceph-mon[34364]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-21T05:49:24.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:24 smithi027 ceph-mon[34364]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T05:49:24.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:24.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:24 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:25.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:25 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T05:49:25.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:25 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T05:49:25.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:25 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:25.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:25 smithi007 ceph-mon[30983]: osd.7 [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529] boot 2024-09-21T05:49:25.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:25 smithi007 ceph-mon[30983]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T05:49:25.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:25 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:25.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:25 smithi007 ceph-mon[30983]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:25.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:25 smithi119 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T05:49:25.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:25 smithi119 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T05:49:25.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:25 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:25.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:25 smithi119 ceph-mon[34833]: osd.7 [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529] boot 2024-09-21T05:49:25.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:25 smithi119 ceph-mon[34833]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T05:49:25.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:25 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:25.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:25 smithi119 ceph-mon[34833]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:25.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:25 smithi027 ceph-mon[34364]: purged_snaps scrub starts 2024-09-21T05:49:25.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:25 smithi027 ceph-mon[34364]: purged_snaps scrub ok 2024-09-21T05:49:25.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:25 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:25.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:25 smithi027 ceph-mon[34364]: osd.7 [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529] boot 2024-09-21T05:49:25.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:25 smithi027 ceph-mon[34364]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T05:49:25.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:25 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:49:25.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:25 smithi027 ceph-mon[34364]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:49:26.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:26 smithi007 ceph-mon[30983]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T05:49:26.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:26 smithi007 ceph-mon[30983]: from='client.? 172.21.15.119:0/3037226983' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9"} : dispatch 2024-09-21T05:49:26.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:26 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9"} : dispatch 2024-09-21T05:49:26.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:26 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9"}]': finished 2024-09-21T05:49:26.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:26 smithi007 ceph-mon[30983]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T05:49:26.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:26.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:26 smithi007 ceph-mon[30983]: from='client.? 172.21.15.119:0/3234846774' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:26.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:26 smithi119 ceph-mon[34833]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T05:49:26.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:26 smithi119 ceph-mon[34833]: from='client.? 172.21.15.119:0/3037226983' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9"} : dispatch 2024-09-21T05:49:26.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:26 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9"} : dispatch 2024-09-21T05:49:26.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:26 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9"}]': finished 2024-09-21T05:49:26.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:26 smithi119 ceph-mon[34833]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T05:49:26.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:26.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:26 smithi119 ceph-mon[34833]: from='client.? 172.21.15.119:0/3234846774' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:26.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:26 smithi027 ceph-mon[34364]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T05:49:26.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:26 smithi027 ceph-mon[34364]: from='client.? 172.21.15.119:0/3037226983' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9"} : dispatch 2024-09-21T05:49:26.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:26 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9"} : dispatch 2024-09-21T05:49:26.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:26 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9"}]': finished 2024-09-21T05:49:26.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:26 smithi027 ceph-mon[34364]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T05:49:26.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:26.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:26 smithi027 ceph-mon[34364]: from='client.? 172.21.15.119:0/3234846774' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:27.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:27 smithi007 ceph-mon[30983]: pgmap v157: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:27.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:27 smithi119 ceph-mon[34833]: pgmap v157: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:27.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:27 smithi027 ceph-mon[34364]: pgmap v157: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:29.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:29 smithi007 ceph-mon[30983]: pgmap v158: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:29.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:29 smithi119 ceph-mon[34833]: pgmap v158: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:29.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:29 smithi027 ceph-mon[34364]: pgmap v158: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:31.567 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:31 smithi119 ceph-mon[34833]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T05:49:31.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:31 smithi007 ceph-mon[30983]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T05:49:31.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:31 smithi027 ceph-mon[34364]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T05:49:33.545 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:33 smithi119 ceph-mon[34833]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:49:33.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:33 smithi007 ceph-mon[30983]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:49:33.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:33 smithi027 ceph-mon[34364]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:49:34.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:34 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T05:49:34.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:34 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:34.792 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:34 smithi119 ceph-mon[34833]: Deploying daemon osd.8 on smithi119 2024-09-21T05:49:34.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T05:49:34.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:34.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:34 smithi007 ceph-mon[30983]: Deploying daemon osd.8 on smithi119 2024-09-21T05:49:34.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:34 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T05:49:34.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:34 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:34.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:34 smithi027 ceph-mon[34364]: Deploying daemon osd.8 on smithi119 2024-09-21T05:49:35.725 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:35 smithi119 ceph-mon[34833]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-21T05:49:35.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:35 smithi007 ceph-mon[30983]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-21T05:49:35.978 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:35 smithi027 ceph-mon[34364]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-21T05:49:37.779 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:37 smithi027 ceph-mon[34364]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T05:49:37.788 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:37 smithi119 ceph-mon[34833]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T05:49:37.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:37 smithi007 ceph-mon[30983]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T05:49:39.780 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:39 smithi119 ceph-mon[34833]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:49:39.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:39 smithi007 ceph-mon[30983]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:49:39.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:39 smithi027 ceph-mon[34364]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:49:40.817 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:40 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:40.817 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:40 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:40.817 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:40 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:40.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:40.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:40.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:40.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:40 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:40.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:40 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:40.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:40 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:42.327 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:42 smithi119 ceph-mon[34833]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:49:42.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:42 smithi027 ceph-mon[34364]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:49:42.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:42 smithi007 ceph-mon[30983]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:49:43.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:43.385+0000 7f7d7effd640 1 -- 172.21.15.119:0/3629214930 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7d88063800 con 0x7f7d740b6560 2024-09-21T05:49:43.387 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 8 on host 'smithi119' 2024-09-21T05:49:43.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:43.387+0000 7f7d8ff48640 1 -- 172.21.15.119:0/3629214930 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7d740b6560 msgr2=0x7f7d740b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:43.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:43.387+0000 7f7d8ff48640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7d740b6560 0x7f7d740b8a70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7d78005fd0 tx=0x7f7d78005ea0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:43.387+0000 7f7d8ff48640 1 -- 172.21.15.119:0/3629214930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d88102a80 msgr2=0x7f7d8810ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:43.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:43.387+0000 7f7d8ff48640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d88102a80 0x7f7d8810ffd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7d84005ab0 tx=0x7f7d84003cd0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:43.387+0000 7f7d8ff48640 1 -- 172.21.15.119:0/3629214930 shutdown_connections 2024-09-21T05:49:43.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:43.387+0000 7f7d8ff48640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7d740b6560 0x7f7d740b8a70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:43.387+0000 7f7d8ff48640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d88108d10 0x7f7d88110a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:43.387+0000 7f7d8ff48640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d881083c0 0x7f7d88110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:43.387+0000 7f7d8ff48640 1 --2- 172.21.15.119:0/3629214930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d88102a80 0x7f7d8810ffd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:43.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:43.387+0000 7f7d8ff48640 1 -- 172.21.15.119:0/3629214930 >> 172.21.15.119:0/3629214930 conn(0x7f7d88079740 msgr2=0x7f7d881013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:43.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:43.387+0000 7f7d8ff48640 1 -- 172.21.15.119:0/3629214930 shutdown_connections 2024-09-21T05:49:43.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:49:43.387+0000 7f7d8ff48640 1 -- 172.21.15.119:0/3629214930 wait complete. 2024-09-21T05:49:44.071 DEBUG:teuthology.orchestra.run.smithi119:osd.8> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T05:49:44.073 INFO:tasks.cephadm:Deploying osd.9 on smithi007 with /dev/vg_nvme/lv_1... 2024-09-21T05:49:44.073 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T05:49:44.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:44 smithi119 ceph-mon[34833]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:44.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:44 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:44.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:44 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:44.465 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:44 smithi007 ceph-mon[30983]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:44.465 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:44.465 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:44.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:44 smithi027 ceph-mon[34364]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:44.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:44 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:44.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:44 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:45.415 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:45 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:45.416 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:45 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:45.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:45.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:45.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:45 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:45.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:45 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:46.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 05:49:45 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T05:49:45.933+0000 7f7a259d0640 -1 osd.8 0 log_to_monitors true 2024-09-21T05:49:46.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:46 smithi007 ceph-mon[30983]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:46.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:46 smithi007 ceph-mon[30983]: from='osd.8 [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:49:46.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:46 smithi007 ceph-mon[30983]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:49:46.427 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:46 smithi119 ceph-mon[34833]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:46.427 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:46 smithi119 ceph-mon[34833]: from='osd.8 [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:49:46.427 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:46 smithi119 ceph-mon[34833]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:49:46.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:46 smithi027 ceph-mon[34364]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:46.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:46 smithi027 ceph-mon[34364]: from='osd.8 [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:49:46.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:46 smithi027 ceph-mon[34364]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:49:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:49:46.973 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi007:vg_nvme/lv_1 2024-09-21T05:49:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:47.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T05:49:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T05:49:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: from='osd.8 [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:49:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:49:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:47.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T05:49:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T05:49:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: from='osd.8 [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:49:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:49:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:47.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:47.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:47.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T05:49:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T05:49:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: from='osd.8 [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:49:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:49:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:47.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.834+0000 7fd741696640 1 -- 172.21.15.7:0/3164779731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c102aa0 msgr2=0x7fd73c102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:47.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.834+0000 7fd741696640 1 --2- 172.21.15.7:0/3164779731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c102aa0 0x7fd73c102eb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009900 tx=0x7fd72c02a410 comp rx=0 tx=0).stop 2024-09-21T05:49:47.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.834+0000 7fd741696640 1 -- 172.21.15.7:0/3164779731 shutdown_connections 2024-09-21T05:49:47.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.834+0000 7fd741696640 1 --2- 172.21.15.7:0/3164779731 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd73c108d30 0x7fd73c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:47.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.834+0000 7fd741696640 1 --2- 172.21.15.7:0/3164779731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd73c1083e0 0x7fd73c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:47.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.834+0000 7fd741696640 1 --2- 172.21.15.7:0/3164779731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c102aa0 0x7fd73c102eb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.834+0000 7fd741696640 1 -- 172.21.15.7:0/3164779731 >> 172.21.15.7:0/3164779731 conn(0x7fd73c079750 msgr2=0x7fd73c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.834+0000 7fd741696640 1 -- 172.21.15.7:0/3164779731 shutdown_connections 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.834+0000 7fd741696640 1 -- 172.21.15.7:0/3164779731 wait complete. 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.835+0000 7fd741696640 1 Processor -- start 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.835+0000 7fd741696640 1 -- start start 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.835+0000 7fd741696640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd73c102aa0 0x7fd73c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.835+0000 7fd741696640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c1083e0 0x7fd73c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.835+0000 7fd741696640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd73c108d30 0x7fd73c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.835+0000 7fd741696640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd73c1129f0 con 0x7fd73c1083e0 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.835+0000 7fd741696640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd73c112870 con 0x7fd73c108d30 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.835+0000 7fd741696640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd73c112b70 con 0x7fd73c102aa0 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.835+0000 7fd733fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c1083e0 0x7fd73c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.835+0000 7fd733fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c1083e0 0x7fd73c19aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44252/0 (socket says 172.21.15.7:44252) 2024-09-21T05:49:47.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.835+0000 7fd73affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd73c102aa0 0x7fd73c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.835+0000 7fd733fff640 1 -- 172.21.15.7:0/3881265190 learned_addr learned my addr 172.21.15.7:0/3881265190 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.835+0000 7fd73b7fe640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd73c108d30 0x7fd73c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.836+0000 7fd733fff640 1 -- 172.21.15.7:0/3881265190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd73c102aa0 msgr2=0x7fd73c19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.836+0000 7fd733fff640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd73c102aa0 0x7fd73c19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.836+0000 7fd733fff640 1 -- 172.21.15.7:0/3881265190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd73c108d30 msgr2=0x7fd73c19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.836+0000 7fd733fff640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd73c108d30 0x7fd73c19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.836+0000 7fd733fff640 1 -- 172.21.15.7:0/3881265190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73c1a0460 con 0x7fd73c1083e0 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.836+0000 7fd73b7fe640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd73c108d30 0x7fd73c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.836+0000 7fd733fff640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c1083e0 0x7fd73c19aa90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd72400e9c0 tx=0x7fd72400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.836+0000 7fd738ff9640 1 -- 172.21.15.7:0/3881265190 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72400ccc0 con 0x7fd73c1083e0 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.836+0000 7fd738ff9640 1 -- 172.21.15.7:0/3881265190 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7240054d0 con 0x7fd73c1083e0 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.836+0000 7fd741696640 1 -- 172.21.15.7:0/3881265190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd73c1a0750 con 0x7fd73c1083e0 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.836+0000 7fd738ff9640 1 -- 172.21.15.7:0/3881265190 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724010430 con 0x7fd73c1083e0 2024-09-21T05:49:47.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.836+0000 7fd741696640 1 -- 172.21.15.7:0/3881265190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd73c1a6eb0 con 0x7fd73c1083e0 2024-09-21T05:49:47.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.837+0000 7fd741696640 1 -- 172.21.15.7:0/3881265190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd73c102eb0 con 0x7fd73c1083e0 2024-09-21T05:49:47.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.839+0000 7fd738ff9640 1 -- 172.21.15.7:0/3881265190 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fd724005020 con 0x7fd73c1083e0 2024-09-21T05:49:47.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.840+0000 7fd738ff9640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd7280b6560 0x7fd7280b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:47.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.840+0000 7fd73affd640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd7280b6560 0x7fd7280b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:47.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.840+0000 7fd738ff9640 1 -- 172.21.15.7:0/3881265190 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5797+0+0 (secure 0 0 0) 0x7fd7240e6fd0 con 0x7fd73c1083e0 2024-09-21T05:49:47.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.840+0000 7fd73affd640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd7280b6560 0x7fd7280b8a70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd72c031440 tx=0x7fd72c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:47.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:47.843+0000 7fd738ff9640 1 -- 172.21.15.7:0/3881265190 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd724056710 con 0x7fd73c1083e0 2024-09-21T05:49:48.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:49:48.040+0000 7fd741696640 1 -- 172.21.15.7:0/3881265190 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd73c063800 con 0x7fd7280b6560 2024-09-21T05:49:48.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi119 2024-09-21T05:49:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi119 to 5696M 2024-09-21T05:49:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T05:49:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T05:49:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T05:49:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:48.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:49:48.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:49:48.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:48.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:48 smithi007 ceph-mon[30983]: from='osd.8 ' entity='osd.8' 2024-09-21T05:49:48.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:48.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: Detected new or changed devices on smithi119 2024-09-21T05:49:48.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi119 to 5696M 2024-09-21T05:49:48.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T05:49:48.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T05:49:48.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:48.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:48.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:48.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:48.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:48.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:48.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T05:49:48.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:48.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:49:48.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:49:48.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:48.478 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:48 smithi027 ceph-mon[34364]: from='osd.8 ' entity='osd.8' 2024-09-21T05:49:48.592 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T05:49:48.100+0000 7f7a21952640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T05:49:48.592 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T05:49:48.218+0000 7f7a19748640 -1 osd.8 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:49:48.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:48.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: Detected new or changed devices on smithi119 2024-09-21T05:49:48.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi119 to 5696M 2024-09-21T05:49:48.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T05:49:48.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T05:49:48.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:48.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:48.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:48.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:48.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:48.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:49:48.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T05:49:48.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:48.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:49:48.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:49:48.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:48.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:48 smithi119 ceph-mon[34833]: from='osd.8 ' entity='osd.8' 2024-09-21T05:49:49.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:49 smithi027 ceph-mon[34364]: purged_snaps scrub starts 2024-09-21T05:49:49.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:49 smithi027 ceph-mon[34364]: purged_snaps scrub ok 2024-09-21T05:49:49.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:49 smithi027 ceph-mon[34364]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:49.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:49 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:49.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:49 smithi027 ceph-mon[34364]: osd.8 [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202] boot 2024-09-21T05:49:49.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:49 smithi027 ceph-mon[34364]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T05:49:49.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:49 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:49.496 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:49 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T05:49:49.497 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:49 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T05:49:49.497 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:49 smithi007 ceph-mon[30983]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:49.497 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:49.497 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:49 smithi007 ceph-mon[30983]: osd.8 [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202] boot 2024-09-21T05:49:49.497 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:49 smithi007 ceph-mon[30983]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T05:49:49.497 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:49.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:49 smithi119 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T05:49:49.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:49 smithi119 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T05:49:49.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:49 smithi119 ceph-mon[34833]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:49.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:49 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:49.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:49 smithi119 ceph-mon[34833]: osd.8 [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202] boot 2024-09-21T05:49:49.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:49 smithi119 ceph-mon[34833]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T05:49:49.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:49 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:49:50.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:50 smithi027 ceph-mon[34364]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:50.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:50 smithi027 ceph-mon[34364]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T05:49:50.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:50 smithi007 ceph-mon[30983]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:50.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:50 smithi007 ceph-mon[30983]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T05:49:50.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:50 smithi119 ceph-mon[34833]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:49:50.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:50 smithi119 ceph-mon[34833]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T05:49:51.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:51 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3227993921' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a69a747d-1e6c-4940-9d96-4315ab384588"} : dispatch 2024-09-21T05:49:51.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:51 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3227993921' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a69a747d-1e6c-4940-9d96-4315ab384588"}]': finished 2024-09-21T05:49:51.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:51 smithi027 ceph-mon[34364]: osdmap e53: 10 total, 9 up, 10 in 2024-09-21T05:49:51.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:51 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:51.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:51 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3227993921' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a69a747d-1e6c-4940-9d96-4315ab384588"} : dispatch 2024-09-21T05:49:51.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:51 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3227993921' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a69a747d-1e6c-4940-9d96-4315ab384588"}]': finished 2024-09-21T05:49:51.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:51 smithi007 ceph-mon[30983]: osdmap e53: 10 total, 9 up, 10 in 2024-09-21T05:49:51.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:51 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:51.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:51 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3227993921' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a69a747d-1e6c-4940-9d96-4315ab384588"} : dispatch 2024-09-21T05:49:51.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:51 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3227993921' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a69a747d-1e6c-4940-9d96-4315ab384588"}]': finished 2024-09-21T05:49:51.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:51 smithi119 ceph-mon[34833]: osdmap e53: 10 total, 9 up, 10 in 2024-09-21T05:49:51.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:51 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:52.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:52 smithi027 ceph-mon[34364]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:52.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:52 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1845645878' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:52.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:52 smithi007 ceph-mon[30983]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:52.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:52 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1845645878' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:52.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:52 smithi119 ceph-mon[34833]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:52.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:52 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1845645878' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:54.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:54 smithi027 ceph-mon[34364]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:54.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:54 smithi007 ceph-mon[30983]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:54.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:54 smithi119 ceph-mon[34833]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:56.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:56 smithi027 ceph-mon[34364]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:56.492 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:56 smithi007 ceph-mon[30983]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:56.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:56 smithi119 ceph-mon[34833]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:58.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:58 smithi027 ceph-mon[34364]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T05:49:58.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:58 smithi007 ceph-mon[30983]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T05:49:58.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:58 smithi119 ceph-mon[34833]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T05:49:59.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:59 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T05:49:59.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:49:59 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:59.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T05:49:59.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:49:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:59.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:59 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T05:49:59.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:49:59 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:00.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:00 smithi027 ceph-mon[34364]: Deploying daemon osd.9 on smithi007 2024-09-21T05:50:00.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:00 smithi027 ceph-mon[34364]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T05:50:00.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:00 smithi027 ceph-mon[34364]: overall HEALTH_OK 2024-09-21T05:50:00.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:00 smithi007 ceph-mon[30983]: Deploying daemon osd.9 on smithi007 2024-09-21T05:50:00.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:00 smithi007 ceph-mon[30983]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T05:50:00.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:00 smithi007 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T05:50:00.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:00 smithi119 ceph-mon[34833]: Deploying daemon osd.9 on smithi007 2024-09-21T05:50:00.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:00 smithi119 ceph-mon[34833]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T05:50:00.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:00 smithi119 ceph-mon[34833]: overall HEALTH_OK 2024-09-21T05:50:02.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:02 smithi027 ceph-mon[34364]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:50:02.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:02 smithi007 ceph-mon[30983]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:50:02.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:02 smithi119 ceph-mon[34833]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:50:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:04 smithi027 ceph-mon[34364]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T05:50:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:04.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:04.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:04 smithi007 ceph-mon[30983]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T05:50:04.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:04.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:04.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:04 smithi119 ceph-mon[34833]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T05:50:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:06.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:06 smithi027 ceph-mon[34364]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:06.553 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:06 smithi007 ceph-mon[30983]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:06.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:06 smithi119 ceph-mon[34833]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:07.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:07.188+0000 7fd738ff9640 1 -- 172.21.15.7:0/3881265190 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd73c063800 con 0x7fd7280b6560 2024-09-21T05:50:07.190 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 9 on host 'smithi007' 2024-09-21T05:50:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:07.190+0000 7fd741696640 1 -- 172.21.15.7:0/3881265190 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd7280b6560 msgr2=0x7fd7280b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:07.190+0000 7fd741696640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd7280b6560 0x7fd7280b8a70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd72c031440 tx=0x7fd72c009560 comp rx=0 tx=0).stop 2024-09-21T05:50:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:07.190+0000 7fd741696640 1 -- 172.21.15.7:0/3881265190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c1083e0 msgr2=0x7fd73c19aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:07.190+0000 7fd741696640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c1083e0 0x7fd73c19aa90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd72400e9c0 tx=0x7fd72400ee80 comp rx=0 tx=0).stop 2024-09-21T05:50:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:07.190+0000 7fd741696640 1 -- 172.21.15.7:0/3881265190 shutdown_connections 2024-09-21T05:50:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:07.190+0000 7fd741696640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd7280b6560 0x7fd7280b8a70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:07.190+0000 7fd741696640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c1083e0 0x7fd73c19aa90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:07.190+0000 7fd741696640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd73c108d30 0x7fd73c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:07.190+0000 7fd741696640 1 --2- 172.21.15.7:0/3881265190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd73c102aa0 0x7fd73c19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:07.190+0000 7fd741696640 1 -- 172.21.15.7:0/3881265190 >> 172.21.15.7:0/3881265190 conn(0x7fd73c079750 msgr2=0x7fd73c101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:07.190+0000 7fd741696640 1 -- 172.21.15.7:0/3881265190 shutdown_connections 2024-09-21T05:50:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:07.190+0000 7fd741696640 1 -- 172.21.15.7:0/3881265190 wait complete. 2024-09-21T05:50:07.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:07 smithi027 ceph-mon[34364]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:07.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:07 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:07 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:07 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:07.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:07 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:07.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:07 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:07 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:07.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:07 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:07 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.729 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:07 smithi007 ceph-mon[30983]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:07.729 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.729 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.729 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:07.729 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:07.729 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.730 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:07.730 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.730 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.731 DEBUG:teuthology.orchestra.run.smithi007:osd.9> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T05:50:07.733 INFO:tasks.cephadm:Deploying osd.10 on smithi027 with /dev/vg_nvme/lv_1... 2024-09-21T05:50:07.733 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T05:50:07.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:07 smithi119 ceph-mon[34833]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:07.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:07 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:07 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:07 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:07.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:07 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:07.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:07 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:07 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:07.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:07 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:07.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:07 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:08.010 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:50:09.687 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:09 smithi027 ceph-mon[34364]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:50:09.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:09 smithi007 ceph-mon[30983]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:50:09.785 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 05:50:09 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T05:50:09.558+0000 7f73ac0df640 -1 osd.9 0 log_to_monitors true 2024-09-21T05:50:09.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:09 smithi119 ceph-mon[34833]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:50:10.651 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:10 smithi027 ceph-mon[34364]: from='osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T05:50:10.652 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:10.652 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:10.652 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:10.652 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:10.652 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:10.652 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:10.652 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:10.652 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:10.652 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:10.652 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:10 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:10.655 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-21T05:50:10.682 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi027:vg_nvme/lv_1 2024-09-21T05:50:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:10 smithi007 ceph-mon[30983]: from='osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T05:50:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:10.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:10.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:10 smithi119 ceph-mon[34833]: from='osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T05:50:10.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:10.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:10.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:10.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:10.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:10.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:10.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:10.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:10.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:10.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:10 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:10.938 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:50:11.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.423+0000 7f6e18c4b640 1 -- 172.21.15.27:0/740805771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e14109df0 msgr2=0x7f6e14110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:11.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.423+0000 7f6e18c4b640 1 --2- 172.21.15.27:0/740805771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e14109df0 0x7f6e14110620 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009ca0 tx=0x7f6e0c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:50:11.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.423+0000 7f6e18c4b640 1 -- 172.21.15.27:0/740805771 shutdown_connections 2024-09-21T05:50:11.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.423+0000 7f6e18c4b640 1 --2- 172.21.15.27:0/740805771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e14109df0 0x7f6e14110620 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:11.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.423+0000 7f6e18c4b640 1 --2- 172.21.15.27:0/740805771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e141094a0 0x7f6e141098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:11.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.423+0000 7f6e18c4b640 1 --2- 172.21.15.27:0/740805771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e14103b60 0x7f6e14103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:11.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.423+0000 7f6e18c4b640 1 -- 172.21.15.27:0/740805771 >> 172.21.15.27:0/740805771 conn(0x7f6e1407b850 msgr2=0x7f6e1407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:11.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.424+0000 7f6e18c4b640 1 -- 172.21.15.27:0/740805771 shutdown_connections 2024-09-21T05:50:11.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.424+0000 7f6e18c4b640 1 -- 172.21.15.27:0/740805771 wait complete. 2024-09-21T05:50:11.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.424+0000 7f6e18c4b640 1 Processor -- start 2024-09-21T05:50:11.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.424+0000 7f6e18c4b640 1 -- start start 2024-09-21T05:50:11.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e18c4b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e14103b60 0x7f6e1419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:11.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e18c4b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e141094a0 0x7f6e1419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:11.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e18c4b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e14109df0 0x7f6e1419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:11.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e18c4b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6e14113ab0 con 0x7f6e14109df0 2024-09-21T05:50:11.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e18c4b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6e14113930 con 0x7f6e141094a0 2024-09-21T05:50:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e18c4b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6e14113c30 con 0x7f6e14103b60 2024-09-21T05:50:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e11d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e141094a0 0x7f6e1419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e11d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e141094a0 0x7f6e1419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60666/0 (socket says 172.21.15.27:60666) 2024-09-21T05:50:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e11d9b640 1 -- 172.21.15.27:0/29160763 learned_addr learned my addr 172.21.15.27:0/29160763 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-21T05:50:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e1259c640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e14103b60 0x7f6e1419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e12d9d640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e14109df0 0x7f6e1419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e11d9b640 1 -- 172.21.15.27:0/29160763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e14103b60 msgr2=0x7f6e1419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e11d9b640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e14103b60 0x7f6e1419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e11d9b640 1 -- 172.21.15.27:0/29160763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e14109df0 msgr2=0x7f6e1419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e11d9b640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e14109df0 0x7f6e1419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.425+0000 7f6e11d9b640 1 -- 172.21.15.27:0/29160763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e141a0390 con 0x7f6e141094a0 2024-09-21T05:50:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.426+0000 7f6e11d9b640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e141094a0 0x7f6e1419a9c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400d740 tx=0x7f6e0400dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:11.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.426+0000 7f6e0b7fe640 1 -- 172.21.15.27:0/29160763 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04017070 con 0x7f6e141094a0 2024-09-21T05:50:11.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.426+0000 7f6e0b7fe640 1 -- 172.21.15.27:0/29160763 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e0400de50 con 0x7f6e141094a0 2024-09-21T05:50:11.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.426+0000 7f6e0b7fe640 1 -- 172.21.15.27:0/29160763 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400f620 con 0x7f6e141094a0 2024-09-21T05:50:11.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.426+0000 7f6e18c4b640 1 -- 172.21.15.27:0/29160763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e141a0680 con 0x7f6e141094a0 2024-09-21T05:50:11.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.426+0000 7f6e18c4b640 1 -- 172.21.15.27:0/29160763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e141a6de0 con 0x7f6e141094a0 2024-09-21T05:50:11.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.427+0000 7f6e18c4b640 1 -- 172.21.15.27:0/29160763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e14103f70 con 0x7f6e141094a0 2024-09-21T05:50:11.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.428+0000 7f6e0b7fe640 1 -- 172.21.15.27:0/29160763 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f6e0401a070 con 0x7f6e141094a0 2024-09-21T05:50:11.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.429+0000 7f6e0b7fe640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e000b65e0 0x7f6e000b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:11.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.430+0000 7f6e0b7fe640 1 -- 172.21.15.27:0/29160763 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6180+0+0 (secure 0 0 0) 0x7f6e040e6340 con 0x7f6e141094a0 2024-09-21T05:50:11.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.430+0000 7f6e1259c640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e000b65e0 0x7f6e000b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:11.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.430+0000 7f6e1259c640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e000b65e0 0x7f6e000b8af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc005d00 tx=0x7f6dfc00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:11.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.432+0000 7f6e0b7fe640 1 -- 172.21.15.27:0/29160763 <== mon.2 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6e040b1880 con 0x7f6e141094a0 2024-09-21T05:50:11.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:11.635+0000 7f6e18c4b640 1 -- 172.21.15.27:0/29160763 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6e14063800 con 0x7f6e000b65e0 2024-09-21T05:50:11.638 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:11 smithi027 ceph-mon[34364]: Detected new or changed devices on smithi007 2024-09-21T05:50:11.638 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:11 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-21T05:50:11.638 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:11 smithi027 ceph-mon[34364]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:50:11.638 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:11 smithi027 ceph-mon[34364]: from='osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T05:50:11.638 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:11 smithi027 ceph-mon[34364]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T05:50:11.638 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:11 smithi027 ceph-mon[34364]: from='osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T05:50:11.638 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:11 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:50:11.818 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 05:50:11 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T05:50:11.475+0000 7f73a8061640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T05:50:11.819 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 05:50:11 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T05:50:11.493+0000 7f73a3e5f640 -1 osd.9 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:50:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:11 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi007 2024-09-21T05:50:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:11 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-21T05:50:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:11 smithi007 ceph-mon[30983]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:50:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:11 smithi007 ceph-mon[30983]: from='osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T05:50:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:11 smithi007 ceph-mon[30983]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T05:50:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:11 smithi007 ceph-mon[30983]: from='osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T05:50:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:50:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:11 smithi119 ceph-mon[34833]: Detected new or changed devices on smithi007 2024-09-21T05:50:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:11 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-21T05:50:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:11 smithi119 ceph-mon[34833]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:50:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:11 smithi119 ceph-mon[34833]: from='osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T05:50:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:11 smithi119 ceph-mon[34833]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T05:50:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:11 smithi119 ceph-mon[34833]: from='osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T05:50:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:11 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:50:12.630 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:12 smithi027 ceph-mon[34364]: from='osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T05:50:12.630 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:12 smithi027 ceph-mon[34364]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T05:50:12.630 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:12 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:50:12.631 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:12 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:50:12.631 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:12 smithi027 ceph-mon[34364]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:12.631 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:12 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:50:12.631 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:12 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:50:12.631 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:12 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:12.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:12 smithi007 ceph-mon[30983]: from='osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T05:50:12.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:12 smithi007 ceph-mon[30983]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T05:50:12.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:50:12.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:50:12.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:12 smithi007 ceph-mon[30983]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:12.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:50:12.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:50:12.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:12 smithi119 ceph-mon[34833]: from='osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T05:50:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:12 smithi119 ceph-mon[34833]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T05:50:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:12 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:50:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:12 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:50:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:12 smithi119 ceph-mon[34833]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:12 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:50:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:12 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:50:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:12 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:13.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:13 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T05:50:13.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:13 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T05:50:13.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:13 smithi007 ceph-mon[30983]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:50:13.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:13 smithi007 ceph-mon[30983]: osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959] boot 2024-09-21T05:50:13.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:13 smithi007 ceph-mon[30983]: osdmap e56: 10 total, 10 up, 10 in 2024-09-21T05:50:13.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:13 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:50:13.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:13 smithi119 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T05:50:13.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:13 smithi119 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T05:50:13.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:13 smithi119 ceph-mon[34833]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:50:13.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:13 smithi119 ceph-mon[34833]: osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959] boot 2024-09-21T05:50:13.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:13 smithi119 ceph-mon[34833]: osdmap e56: 10 total, 10 up, 10 in 2024-09-21T05:50:13.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:13 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:50:13.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:13 smithi027 ceph-mon[34364]: purged_snaps scrub starts 2024-09-21T05:50:13.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:13 smithi027 ceph-mon[34364]: purged_snaps scrub ok 2024-09-21T05:50:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:13 smithi027 ceph-mon[34364]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:50:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:13 smithi027 ceph-mon[34364]: osd.9 [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959] boot 2024-09-21T05:50:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:13 smithi027 ceph-mon[34364]: osdmap e56: 10 total, 10 up, 10 in 2024-09-21T05:50:13.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:13 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:50:14.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:14 smithi007 ceph-mon[30983]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T05:50:14.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:14 smithi007 ceph-mon[30983]: from='client.? 172.21.15.27:0/1675701631' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a8f67271-99bb-4fb7-b0f5-a24730cd96cf"} : dispatch 2024-09-21T05:50:14.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:14 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a8f67271-99bb-4fb7-b0f5-a24730cd96cf"} : dispatch 2024-09-21T05:50:14.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:14 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8f67271-99bb-4fb7-b0f5-a24730cd96cf"}]': finished 2024-09-21T05:50:14.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:14 smithi007 ceph-mon[30983]: osdmap e58: 11 total, 10 up, 11 in 2024-09-21T05:50:14.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:14.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:14 smithi119 ceph-mon[34833]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T05:50:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:14 smithi119 ceph-mon[34833]: from='client.? 172.21.15.27:0/1675701631' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a8f67271-99bb-4fb7-b0f5-a24730cd96cf"} : dispatch 2024-09-21T05:50:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:14 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a8f67271-99bb-4fb7-b0f5-a24730cd96cf"} : dispatch 2024-09-21T05:50:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:14 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8f67271-99bb-4fb7-b0f5-a24730cd96cf"}]': finished 2024-09-21T05:50:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:14 smithi119 ceph-mon[34833]: osdmap e58: 11 total, 10 up, 11 in 2024-09-21T05:50:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:14 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:14.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:14 smithi027 ceph-mon[34364]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T05:50:14.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:14 smithi027 ceph-mon[34364]: from='client.? 172.21.15.27:0/1675701631' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a8f67271-99bb-4fb7-b0f5-a24730cd96cf"} : dispatch 2024-09-21T05:50:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:14 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a8f67271-99bb-4fb7-b0f5-a24730cd96cf"} : dispatch 2024-09-21T05:50:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:14 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8f67271-99bb-4fb7-b0f5-a24730cd96cf"}]': finished 2024-09-21T05:50:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:14 smithi027 ceph-mon[34364]: osdmap e58: 11 total, 10 up, 11 in 2024-09-21T05:50:14.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:14 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:15.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:15 smithi007 ceph-mon[30983]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:15.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:15 smithi007 ceph-mon[30983]: from='client.? 172.21.15.27:0/2372117987' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:50:15.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:15 smithi119 ceph-mon[34833]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:15.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:15 smithi119 ceph-mon[34833]: from='client.? 172.21.15.27:0/2372117987' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:50:15.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:15 smithi027 ceph-mon[34364]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:15.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:15 smithi027 ceph-mon[34364]: from='client.? 172.21.15.27:0/2372117987' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:50:17.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:17 smithi007 ceph-mon[30983]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:17.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:17 smithi119 ceph-mon[34833]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:17.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:17 smithi027 ceph-mon[34364]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:19.712 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:19 smithi027 ceph-mon[34364]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:19.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:19 smithi007 ceph-mon[30983]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:19.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:19 smithi119 ceph-mon[34833]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:21.757 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:21 smithi027 ceph-mon[34364]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:21.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:21 smithi007 ceph-mon[30983]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:21.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:21 smithi119 ceph-mon[34833]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:23.570 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:23 smithi027 ceph-mon[34364]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:23.570 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T05:50:23.570 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:23.570 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:23 smithi027 ceph-mon[34364]: Deploying daemon osd.10 on smithi027 2024-09-21T05:50:23.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:23 smithi007 ceph-mon[30983]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:23.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T05:50:23.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:23.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:23 smithi007 ceph-mon[30983]: Deploying daemon osd.10 on smithi027 2024-09-21T05:50:23.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:23 smithi119 ceph-mon[34833]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:23.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T05:50:23.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:23.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:23 smithi119 ceph-mon[34833]: Deploying daemon osd.10 on smithi027 2024-09-21T05:50:25.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:25 smithi027 ceph-mon[34364]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:25.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:25 smithi007 ceph-mon[30983]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:25.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:25 smithi119 ceph-mon[34833]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:27.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:27 smithi027 ceph-mon[34364]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:27.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:27 smithi007 ceph-mon[30983]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:27.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:27 smithi119 ceph-mon[34833]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:29.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:29 smithi027 ceph-mon[34364]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:29.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:29 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:29.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:29 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:29.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:29 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:29.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:29 smithi007 ceph-mon[30983]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:29.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:29 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:29.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:29 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:29.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:29 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:29.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:29 smithi119 ceph-mon[34833]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:29.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:29 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:29.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:29 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:29.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:29 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:31.817 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:31 smithi027 ceph-mon[34364]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:31.817 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:31 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:31.817 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:31 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:31.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:31 smithi007 ceph-mon[30983]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:31.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:31.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:31.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:31 smithi119 ceph-mon[34833]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:31.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:31 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:31.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:31 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:32.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:32.243+0000 7f6e0b7fe640 1 -- 172.21.15.27:0/29160763 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f6e14063800 con 0x7f6e000b65e0 2024-09-21T05:50:32.245 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 10 on host 'smithi027' 2024-09-21T05:50:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:32.246+0000 7f6e18c4b640 1 -- 172.21.15.27:0/29160763 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e000b65e0 msgr2=0x7f6e000b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:32.246+0000 7f6e18c4b640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e000b65e0 0x7f6e000b8af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc005d00 tx=0x7f6dfc00b410 comp rx=0 tx=0).stop 2024-09-21T05:50:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:32.246+0000 7f6e18c4b640 1 -- 172.21.15.27:0/29160763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e141094a0 msgr2=0x7f6e1419a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:32.246+0000 7f6e18c4b640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e141094a0 0x7f6e1419a9c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400d740 tx=0x7f6e0400dc00 comp rx=0 tx=0).stop 2024-09-21T05:50:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:32.246+0000 7f6e18c4b640 1 -- 172.21.15.27:0/29160763 shutdown_connections 2024-09-21T05:50:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:32.246+0000 7f6e18c4b640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e000b65e0 0x7f6e000b8af0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:32.246+0000 7f6e18c4b640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e14109df0 0x7f6e1419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:32.246+0000 7f6e18c4b640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e141094a0 0x7f6e1419a9c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:32.246+0000 7f6e18c4b640 1 --2- 172.21.15.27:0/29160763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e14103b60 0x7f6e1419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:32.246+0000 7f6e18c4b640 1 -- 172.21.15.27:0/29160763 >> 172.21.15.27:0/29160763 conn(0x7f6e1407b850 msgr2=0x7f6e14107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:32.246+0000 7f6e18c4b640 1 -- 172.21.15.27:0/29160763 shutdown_connections 2024-09-21T05:50:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-21T05:50:32.246+0000 7f6e18c4b640 1 -- 172.21.15.27:0/29160763 wait complete. 2024-09-21T05:50:32.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:32.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:32.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:32.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:32.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:32.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:32.839 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:32.839 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:32.839 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:32.839 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:32.839 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:32.839 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:32 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:32.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:32.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:32.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:32.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:32.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:32.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:32 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:32.866 DEBUG:teuthology.orchestra.run.smithi027:osd.10> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T05:50:32.868 INFO:tasks.cephadm:Deploying osd.11 on smithi119 with /dev/vg_nvme/lv_1... 2024-09-21T05:50:32.868 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T05:50:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:50:34.302 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:34 smithi027 ceph-mon[34364]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:34.509 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:34 smithi119 ceph-mon[34833]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:34.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:34 smithi007 ceph-mon[30983]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:35.227 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 05:50:34 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T05:50:34.932+0000 7feaeaec3640 -1 osd.10 0 log_to_monitors true 2024-09-21T05:50:35.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:35 smithi119 ceph-mon[34833]: from='osd.10 [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:50:35.440 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:35 smithi119 ceph-mon[34833]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:50:35.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:35 smithi007 ceph-mon[30983]: from='osd.10 [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:50:35.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:35 smithi007 ceph-mon[30983]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:50:35.585 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:35 smithi027 ceph-mon[34364]: from='osd.10 [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:50:35.586 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:35 smithi027 ceph-mon[34364]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:50:35.753 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T05:50:35.780 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi119:vg_nvme/lv_1 2024-09-21T05:50:36.032 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:50:36.396 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:36.396 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T05:50:36.396 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T05:50:36.396 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:36.396 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='osd.10 [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:50:36.396 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:50:36.397 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:36.397 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:36.397 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:36.397 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:36.397 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:36.397 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:36.397 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:36.397 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:36.397 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:36.397 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:36 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:36.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.489+0000 7f2181759640 1 -- 172.21.15.119:0/2674375039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217c107c90 msgr2=0x7f217c108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:36.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.489+0000 7f2181759640 1 --2- 172.21.15.119:0/2674375039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217c107c90 0x7f217c108170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2174009ca0 tx=0x7f217402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.489+0000 7f2181759640 1 -- 172.21.15.119:0/2674375039 shutdown_connections 2024-09-21T05:50:36.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.489+0000 7f2181759640 1 --2- 172.21.15.119:0/2674375039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217c107c90 0x7f217c108170 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.489+0000 7f2181759640 1 --2- 172.21.15.119:0/2674375039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f217c1031a0 0x7f217c1076d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.489+0000 7f2181759640 1 --2- 172.21.15.119:0/2674375039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f217c102850 0x7f217c102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.489+0000 7f2181759640 1 -- 172.21.15.119:0/2674375039 >> 172.21.15.119:0/2674375039 conn(0x7f217c0796d0 msgr2=0x7f217c079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:36.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.489+0000 7f2181759640 1 -- 172.21.15.119:0/2674375039 shutdown_connections 2024-09-21T05:50:36.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.489+0000 7f2181759640 1 -- 172.21.15.119:0/2674375039 wait complete. 2024-09-21T05:50:36.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.489+0000 7f2181759640 1 Processor -- start 2024-09-21T05:50:36.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f2181759640 1 -- start start 2024-09-21T05:50:36.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f2181759640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f217c102850 0x7f217c1a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:36.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f2181759640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217c1031a0 0x7f217c1a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:36.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f2181759640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f217c107c90 0x7f217c1a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:36.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f2181759640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f217c11a170 con 0x7f217c107c90 2024-09-21T05:50:36.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f2181759640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f217c119ff0 con 0x7f217c102850 2024-09-21T05:50:36.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f2181759640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f217c11a2f0 con 0x7f217c1031a0 2024-09-21T05:50:36.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f217a7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217c1031a0 0x7f217c1a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:36.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f217a7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217c1031a0 0x7f217c1a10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58432/0 (socket says 172.21.15.119:58432) 2024-09-21T05:50:36.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f217a7fc640 1 -- 172.21.15.119:0/3082659189 learned_addr learned my addr 172.21.15.119:0/3082659189 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-21T05:50:36.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f217affd640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f217c102850 0x7f217c1a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:36.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f217b7fe640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f217c107c90 0x7f217c1a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:36.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f217a7fc640 1 -- 172.21.15.119:0/3082659189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f217c102850 msgr2=0x7f217c1a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f217a7fc640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f217c102850 0x7f217c1a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f217a7fc640 1 -- 172.21.15.119:0/3082659189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f217c107c90 msgr2=0x7f217c1a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f217a7fc640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f217c107c90 0x7f217c1a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.490+0000 7f217a7fc640 1 -- 172.21.15.119:0/3082659189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c1a6a70 con 0x7f217c1031a0 2024-09-21T05:50:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.491+0000 7f217a7fc640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217c1031a0 0x7f217c1a10a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f217000e9c0 tx=0x7f217000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.491+0000 7f2163fff640 1 -- 172.21.15.119:0/3082659189 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217000ccc0 con 0x7f217c1031a0 2024-09-21T05:50:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.491+0000 7f2181759640 1 -- 172.21.15.119:0/3082659189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217c1a6d60 con 0x7f217c1031a0 2024-09-21T05:50:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.491+0000 7f2163fff640 1 -- 172.21.15.119:0/3082659189 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21700054d0 con 0x7f217c1031a0 2024-09-21T05:50:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.491+0000 7f2163fff640 1 -- 172.21.15.119:0/3082659189 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170010430 con 0x7f217c1031a0 2024-09-21T05:50:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.491+0000 7f2181759640 1 -- 172.21.15.119:0/3082659189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217c1ad4c0 con 0x7f217c1031a0 2024-09-21T05:50:36.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.492+0000 7f2181759640 1 -- 172.21.15.119:0/3082659189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f217c1076d0 con 0x7f217c1031a0 2024-09-21T05:50:36.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.493+0000 7f2163fff640 1 -- 172.21.15.119:0/3082659189 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f2170005020 con 0x7f217c1031a0 2024-09-21T05:50:36.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.494+0000 7f2163fff640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f21640b6560 0x7f21640b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:36.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.494+0000 7f2163fff640 1 -- 172.21.15.119:0/3082659189 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6629+0+0 (secure 0 0 0) 0x7f21700e71d0 con 0x7f217c1031a0 2024-09-21T05:50:36.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.494+0000 7f217affd640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f21640b6560 0x7f21640b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:36.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.495+0000 7f217affd640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f21640b6560 0x7f21640b8a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f216c00bbe0 tx=0x7f216c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:36.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.497+0000 7f2163fff640 1 -- 172.21.15.119:0/3082659189 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2170056710 con 0x7f217c1031a0 2024-09-21T05:50:36.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:36.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T05:50:36.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T05:50:36.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:36.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='osd.10 [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:50:36.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:50:36.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:36.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:36.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:36.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:36.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:36.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:36.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:36.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:36.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:36.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:36.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:36.685+0000 7f2181759640 1 -- 172.21.15.119:0/3082659189 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f217c106dc0 con 0x7f21640b6560 2024-09-21T05:50:36.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:36.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T05:50:36.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T05:50:36.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:36.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='osd.10 [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:50:36.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-21T05:50:36.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:36.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:36.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:36.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:36.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:36.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T05:50:36.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:36.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:36.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:36.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:36 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:37.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:37 smithi119 ceph-mon[34833]: Detected new or changed devices on smithi027 2024-09-21T05:50:37.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:37 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi027 to 4272M 2024-09-21T05:50:37.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:37 smithi119 ceph-mon[34833]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-21T05:50:37.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:37 smithi119 ceph-mon[34833]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T05:50:37.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:37 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:37.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:37 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:37.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:37 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:50:37.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:37 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:50:37.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:37 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:37.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:37 smithi119 ceph-mon[34833]: from='osd.10 ' entity='osd.10' 2024-09-21T05:50:37.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:37 smithi119 ceph-mon[34833]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T05:50:37.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:37 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:37.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T05:50:37.201+0000 7feae6e45640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T05:50:37.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T05:50:37.264+0000 7feadec3b640 -1 osd.10 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:50:37.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-mon[34364]: Detected new or changed devices on smithi027 2024-09-21T05:50:37.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi027 to 4272M 2024-09-21T05:50:37.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-mon[34364]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-21T05:50:37.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-mon[34364]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T05:50:37.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:37.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:37.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:50:37.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:50:37.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:37.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-mon[34364]: from='osd.10 ' entity='osd.10' 2024-09-21T05:50:37.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-mon[34364]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T05:50:37.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:37 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:37.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:37 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi027 2024-09-21T05:50:37.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:37 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi027 to 4272M 2024-09-21T05:50:37.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:37 smithi007 ceph-mon[30983]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-21T05:50:37.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:37 smithi007 ceph-mon[30983]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T05:50:37.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:37.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:37.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:50:37.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:50:37.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:37.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:37 smithi007 ceph-mon[30983]: from='osd.10 ' entity='osd.10' 2024-09-21T05:50:37.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:37 smithi007 ceph-mon[30983]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T05:50:37.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:38.287 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:38 smithi119 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T05:50:38.287 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:38 smithi119 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T05:50:38.287 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:38 smithi119 ceph-mon[34833]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:38.287 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:38 smithi119 ceph-mon[34833]: from='client.24574 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:38.287 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:38 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:38.287 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:38 smithi119 ceph-mon[34833]: osd.10 [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090] boot 2024-09-21T05:50:38.287 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:38 smithi119 ceph-mon[34833]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T05:50:38.287 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:38 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:38.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:38 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T05:50:38.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:38 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T05:50:38.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:38 smithi007 ceph-mon[30983]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:38.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:38 smithi007 ceph-mon[30983]: from='client.24574 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:38.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:38.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:38 smithi007 ceph-mon[30983]: osd.10 [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090] boot 2024-09-21T05:50:38.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:38 smithi007 ceph-mon[30983]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T05:50:38.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:38.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:38 smithi027 ceph-mon[34364]: purged_snaps scrub starts 2024-09-21T05:50:38.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:38 smithi027 ceph-mon[34364]: purged_snaps scrub ok 2024-09-21T05:50:38.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:38 smithi027 ceph-mon[34364]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:50:38.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:38 smithi027 ceph-mon[34364]: from='client.24574 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:38.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:38 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:38.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:38 smithi027 ceph-mon[34364]: osd.10 [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090] boot 2024-09-21T05:50:38.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:38 smithi027 ceph-mon[34364]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T05:50:38.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:38 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:50:39.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:39 smithi007 ceph-mon[30983]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:50:39.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:39 smithi007 ceph-mon[30983]: from='client.? 172.21.15.119:0/1376543799' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "88456735-00b1-479c-b201-588a9ee0c881"} : dispatch 2024-09-21T05:50:39.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:39 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "88456735-00b1-479c-b201-588a9ee0c881"} : dispatch 2024-09-21T05:50:39.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:39 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88456735-00b1-479c-b201-588a9ee0c881"}]': finished 2024-09-21T05:50:39.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:39 smithi007 ceph-mon[30983]: osdmap e63: 12 total, 11 up, 12 in 2024-09-21T05:50:39.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:50:39.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:39 smithi119 ceph-mon[34833]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:50:39.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:39 smithi119 ceph-mon[34833]: from='client.? 172.21.15.119:0/1376543799' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "88456735-00b1-479c-b201-588a9ee0c881"} : dispatch 2024-09-21T05:50:39.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:39 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "88456735-00b1-479c-b201-588a9ee0c881"} : dispatch 2024-09-21T05:50:39.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:39 smithi119 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88456735-00b1-479c-b201-588a9ee0c881"}]': finished 2024-09-21T05:50:39.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:39 smithi119 ceph-mon[34833]: osdmap e63: 12 total, 11 up, 12 in 2024-09-21T05:50:39.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:39 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:50:39.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:39 smithi027 ceph-mon[34364]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:50:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:39 smithi027 ceph-mon[34364]: from='client.? 172.21.15.119:0/1376543799' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "88456735-00b1-479c-b201-588a9ee0c881"} : dispatch 2024-09-21T05:50:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:39 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "88456735-00b1-479c-b201-588a9ee0c881"} : dispatch 2024-09-21T05:50:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:39 smithi027 ceph-mon[34364]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88456735-00b1-479c-b201-588a9ee0c881"}]': finished 2024-09-21T05:50:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:39 smithi027 ceph-mon[34364]: osdmap e63: 12 total, 11 up, 12 in 2024-09-21T05:50:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:39 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:50:40.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:40 smithi007 ceph-mon[30983]: from='client.? 172.21.15.119:0/2908332280' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:50:40.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:40 smithi007 ceph-mon[30983]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T05:50:40.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:50:40.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:40 smithi119 ceph-mon[34833]: from='client.? 172.21.15.119:0/2908332280' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:50:40.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:40 smithi119 ceph-mon[34833]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T05:50:40.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:40 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:50:40.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:40 smithi027 ceph-mon[34364]: from='client.? 172.21.15.119:0/2908332280' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:50:40.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:40 smithi027 ceph-mon[34364]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T05:50:40.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:40 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:50:41.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:41 smithi007 ceph-mon[30983]: pgmap v211: 1 pgs: 1 activating; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T05:50:41.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:41 smithi119 ceph-mon[34833]: pgmap v211: 1 pgs: 1 activating; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T05:50:41.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:41 smithi027 ceph-mon[34364]: pgmap v211: 1 pgs: 1 activating; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T05:50:43.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:43 smithi007 ceph-mon[30983]: pgmap v212: 1 pgs: 1 activating; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T05:50:43.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:43 smithi119 ceph-mon[34833]: pgmap v212: 1 pgs: 1 activating; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T05:50:43.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:43 smithi027 ceph-mon[34364]: pgmap v212: 1 pgs: 1 activating; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T05:50:45.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:45 smithi007 ceph-mon[30983]: pgmap v213: 1 pgs: 1 activating; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T05:50:45.831 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:45 smithi119 ceph-mon[34833]: pgmap v213: 1 pgs: 1 activating; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T05:50:45.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:45 smithi027 ceph-mon[34364]: pgmap v213: 1 pgs: 1 activating; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T05:50:47.642 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:47 smithi119 ceph-mon[34833]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:50:47.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:47 smithi007 ceph-mon[30983]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:50:47.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:47 smithi027 ceph-mon[34364]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:50:48.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:48 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T05:50:48.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:48 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:48.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:48 smithi007 ceph-mon[30983]: Deploying daemon osd.11 on smithi119 2024-09-21T05:50:48.823 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:48 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T05:50:48.823 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:48 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:48.823 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:48 smithi027 ceph-mon[34364]: Deploying daemon osd.11 on smithi119 2024-09-21T05:50:48.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:48 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T05:50:48.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:48 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:48.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:48 smithi119 ceph-mon[34833]: Deploying daemon osd.11 on smithi119 2024-09-21T05:50:49.577 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:49 smithi119 ceph-mon[34833]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T05:50:49.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:49 smithi007 ceph-mon[30983]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T05:50:49.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:49 smithi027 ceph-mon[34364]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T05:50:51.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:51 smithi007 ceph-mon[30983]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T05:50:51.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:51 smithi119 ceph-mon[34833]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T05:50:51.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:51 smithi027 ceph-mon[34364]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T05:50:53.776 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:53 smithi119 ceph-mon[34833]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:53.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:53.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:53.777 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:53 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:53.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:53 smithi007 ceph-mon[30983]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:53.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:53.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:53.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:53.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:53 smithi027 ceph-mon[34364]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:53.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:53.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:53.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:53 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:55.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:55 smithi119 ceph-mon[34833]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:55.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:55 smithi007 ceph-mon[30983]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:55.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:55 smithi027 ceph-mon[34364]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:56.941 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 11 on host 'smithi119' 2024-09-21T05:50:56.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:56.939+0000 7f2163fff640 1 -- 172.21.15.119:0/3082659189 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f217c106dc0 con 0x7f21640b6560 2024-09-21T05:50:56.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:56.941+0000 7f2181759640 1 -- 172.21.15.119:0/3082659189 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f21640b6560 msgr2=0x7f21640b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:56.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:56.941+0000 7f2181759640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f21640b6560 0x7f21640b8a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f216c00bbe0 tx=0x7f216c00b390 comp rx=0 tx=0).stop 2024-09-21T05:50:56.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:56.941+0000 7f2181759640 1 -- 172.21.15.119:0/3082659189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217c1031a0 msgr2=0x7f217c1a10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:56.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:56.941+0000 7f2181759640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217c1031a0 0x7f217c1a10a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f217000e9c0 tx=0x7f217000ee80 comp rx=0 tx=0).stop 2024-09-21T05:50:56.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:56.941+0000 7f2181759640 1 -- 172.21.15.119:0/3082659189 shutdown_connections 2024-09-21T05:50:56.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:56.941+0000 7f2181759640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f21640b6560 0x7f21640b8a70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:56.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:56.941+0000 7f2181759640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f217c107c90 0x7f217c1a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:56.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:56.941+0000 7f2181759640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217c1031a0 0x7f217c1a10a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:56.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:56.941+0000 7f2181759640 1 --2- 172.21.15.119:0/3082659189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f217c102850 0x7f217c1a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:56.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:56.941+0000 7f2181759640 1 -- 172.21.15.119:0/3082659189 >> 172.21.15.119:0/3082659189 conn(0x7f217c0796d0 msgr2=0x7f217c1056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:56.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:56.942+0000 7f2181759640 1 -- 172.21.15.119:0/3082659189 shutdown_connections 2024-09-21T05:50:56.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:50:56.942+0000 7f2181759640 1 -- 172.21.15.119:0/3082659189 wait complete. 2024-09-21T05:50:57.238 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.238 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.238 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:57.238 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:57.238 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.239 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:57.239 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.239 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:57.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:57.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:57.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:50:57.532 DEBUG:teuthology.orchestra.run.smithi119:osd.11> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T05:50:57.535 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T05:50:57.536 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T05:50:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:58.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:58 smithi119 ceph-mon[34833]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:58.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:58 smithi007 ceph-mon[30983]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.259+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2629607298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23c8109e10 msgr2=0x7f23c8110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.259+0000 7f23cdfb4640 1 --2- 172.21.15.7:0/2629607298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23c8109e10 0x7f23c8110640 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009ca0 tx=0x7f23c002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.259+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2629607298 shutdown_connections 2024-09-21T05:50:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.259+0000 7f23cdfb4640 1 --2- 172.21.15.7:0/2629607298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23c8109e10 0x7f23c8110640 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.259+0000 7f23cdfb4640 1 --2- 172.21.15.7:0/2629607298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23c81094c0 0x7f23c81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.259+0000 7f23cdfb4640 1 --2- 172.21.15.7:0/2629607298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23c8103b80 0x7f23c8103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.259+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2629607298 >> 172.21.15.7:0/2629607298 conn(0x7f23c80ff610 msgr2=0x7f23c8101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.259+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2629607298 shutdown_connections 2024-09-21T05:50:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.259+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2629607298 wait complete. 2024-09-21T05:50:58.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.260+0000 7f23cdfb4640 1 Processor -- start 2024-09-21T05:50:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.260+0000 7f23cdfb4640 1 -- start start 2024-09-21T05:50:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.260+0000 7f23cdfb4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23c8103b80 0x7f23c819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.260+0000 7f23cdfb4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23c81094c0 0x7f23c819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23cdfb4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23c8109e10 0x7f23c819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23cdfb4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f23c8113ad0 con 0x7f23c8109e10 2024-09-21T05:50:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23cdfb4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f23c8113950 con 0x7f23c81094c0 2024-09-21T05:50:58.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23cdfb4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f23c8113c50 con 0x7f23c8103b80 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23c7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23c8109e10 0x7f23c819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23c7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23c8109e10 0x7f23c819fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52552/0 (socket says 172.21.15.7:52552) 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23c77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23c8103b80 0x7f23c819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23c7fff640 1 -- 172.21.15.7:0/2974017448 learned_addr learned my addr 172.21.15.7:0/2974017448 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23c6ffd640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23c81094c0 0x7f23c819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23c77fe640 1 -- 172.21.15.7:0/2974017448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23c81094c0 msgr2=0x7f23c819a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23c77fe640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23c81094c0 0x7f23c819a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23c77fe640 1 -- 172.21.15.7:0/2974017448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23c8109e10 msgr2=0x7f23c819fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23c77fe640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23c8109e10 0x7f23c819fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23c77fe640 1 -- 172.21.15.7:0/2974017448 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c81a0390 con 0x7f23c8103b80 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23c7fff640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23c8109e10 0x7f23c819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23c77fe640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23c8103b80 0x7f23c819a420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23b8005fd0 tx=0x7f23b800dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.261+0000 7f23c4ff9640 1 -- 172.21.15.7:0/2974017448 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8009c30 con 0x7f23c8103b80 2024-09-21T05:50:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.262+0000 7f23c4ff9640 1 -- 172.21.15.7:0/2974017448 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23b8009dd0 con 0x7f23c8103b80 2024-09-21T05:50:58.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.262+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2974017448 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c81a0680 con 0x7f23c8103b80 2024-09-21T05:50:58.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.262+0000 7f23c4ff9640 1 -- 172.21.15.7:0/2974017448 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8003e20 con 0x7f23c8103b80 2024-09-21T05:50:58.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.262+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2974017448 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c81a6de0 con 0x7f23c8103b80 2024-09-21T05:50:58.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.263+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2974017448 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c8103f90 con 0x7f23c8103b80 2024-09-21T05:50:58.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.264+0000 7f23c4ff9640 1 -- 172.21.15.7:0/2974017448 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f23b8004000 con 0x7f23c8103b80 2024-09-21T05:50:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.265+0000 7f23c4ff9640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23b00b6560 0x7f23b00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.265+0000 7f23c6ffd640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23b00b6560 0x7f23b00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.265+0000 7f23c4ff9640 1 -- 172.21.15.7:0/2974017448 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 7024+0+0 (secure 0 0 0) 0x7f23b80e69c0 con 0x7f23c8103b80 2024-09-21T05:50:58.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.266+0000 7f23c6ffd640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23b00b6560 0x7f23b00b8a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f23c8102ef0 tx=0x7f23bc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:58.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.268+0000 7f23c4ff9640 1 -- 172.21.15.7:0/2974017448 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23b8017020 con 0x7f23c8103b80 2024-09-21T05:50:58.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.456+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2974017448 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f23c802e640 con 0x7f23c8103b80 2024-09-21T05:50:58.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.457+0000 7f23c4ff9640 1 -- 172.21.15.7:0/2974017448 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v64) ==== 74+0+133 (secure 0 0 0) 0x7f23b80b1ac0 con 0x7f23c8103b80 2024-09-21T05:50:58.459 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:50:58.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.460+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2974017448 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23b00b6560 msgr2=0x7f23b00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:58.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.460+0000 7f23cdfb4640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23b00b6560 0x7f23b00b8a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f23c8102ef0 tx=0x7f23bc005f90 comp rx=0 tx=0).stop 2024-09-21T05:50:58.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.460+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2974017448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23c8103b80 msgr2=0x7f23c819a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:58.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.460+0000 7f23cdfb4640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23c8103b80 0x7f23c819a420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23b8005fd0 tx=0x7f23b800dde0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.460+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2974017448 shutdown_connections 2024-09-21T05:50:58.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.460+0000 7f23cdfb4640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23b00b6560 0x7f23b00b8a70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.460+0000 7f23cdfb4640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23c8109e10 0x7f23c819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.460+0000 7f23cdfb4640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23c81094c0 0x7f23c819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.460+0000 7f23cdfb4640 1 --2- 172.21.15.7:0/2974017448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23c8103b80 0x7f23c819a420 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.460+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2974017448 >> 172.21.15.7:0/2974017448 conn(0x7f23c80ff610 msgr2=0x7f23c8108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:58.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.460+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2974017448 shutdown_connections 2024-09-21T05:50:58.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:50:58.460+0000 7f23cdfb4640 1 -- 172.21.15.7:0/2974017448 wait complete. 2024-09-21T05:50:58.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:58 smithi027 ceph-mon[34364]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:50:59.180 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":64,"num_osds":12,"num_up_osds":11,"osd_up_since":1726897838,"num_in_osds":12,"osd_in_since":1726897839,"num_remapped_pgs":0} 2024-09-21T05:50:59.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:50:59 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2974017448' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:50:59.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:50:59 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2974017448' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:50:59.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 05:50:59 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T05:50:59.213+0000 7faa2d4d8640 -1 osd.11 0 log_to_monitors true 2024-09-21T05:50:59.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:50:59 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2974017448' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:51:00.181 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T05:51:00.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:00 smithi007 ceph-mon[30983]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:51:00.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:00 smithi007 ceph-mon[30983]: from='osd.11 [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:51:00.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:00 smithi007 ceph-mon[30983]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:51:00.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:00 smithi119 ceph-mon[34833]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:51:00.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:00 smithi119 ceph-mon[34833]: from='osd.11 [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:51:00.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:00 smithi119 ceph-mon[34833]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:51:00.451 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:00.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:00 smithi027 ceph-mon[34364]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:51:00.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:00 smithi027 ceph-mon[34364]: from='osd.11 [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:51:00.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:00 smithi027 ceph-mon[34364]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:51:01.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.007+0000 7fd6e3345640 1 -- 172.21.15.7:0/2036887134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6dc109df0 msgr2=0x7fd6dc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.007+0000 7fd6e3345640 1 --2- 172.21.15.7:0/2036887134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6dc109df0 0x7fd6dc110620 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009ca0 tx=0x7fd6d402a8e0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.007+0000 7fd6e3345640 1 -- 172.21.15.7:0/2036887134 shutdown_connections 2024-09-21T05:51:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.007+0000 7fd6e3345640 1 --2- 172.21.15.7:0/2036887134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6dc109df0 0x7fd6dc110620 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.007+0000 7fd6e3345640 1 --2- 172.21.15.7:0/2036887134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc1094a0 0x7fd6dc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.007+0000 7fd6e3345640 1 --2- 172.21.15.7:0/2036887134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6dc103b60 0x7fd6dc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.007+0000 7fd6e3345640 1 -- 172.21.15.7:0/2036887134 >> 172.21.15.7:0/2036887134 conn(0x7fd6dc07b850 msgr2=0x7fd6dc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.008+0000 7fd6e3345640 1 -- 172.21.15.7:0/2036887134 shutdown_connections 2024-09-21T05:51:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.008+0000 7fd6e3345640 1 -- 172.21.15.7:0/2036887134 wait complete. 2024-09-21T05:51:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.008+0000 7fd6e3345640 1 Processor -- start 2024-09-21T05:51:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.008+0000 7fd6e3345640 1 -- start start 2024-09-21T05:51:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.008+0000 7fd6e3345640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6dc103b60 0x7fd6dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e3345640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc1094a0 0x7fd6dc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:01.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e3345640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6dc109df0 0x7fd6dc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e3345640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc113af0 con 0x7fd6dc109df0 2024-09-21T05:51:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e3345640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc113970 con 0x7fd6dc103b60 2024-09-21T05:51:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e3345640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc113c70 con 0x7fd6dc1094a0 2024-09-21T05:51:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e18e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6dc109df0 0x7fd6dc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e18e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6dc109df0 0x7fd6dc076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36326/0 (socket says 172.21.15.7:36326) 2024-09-21T05:51:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e18e2640 1 -- 172.21.15.7:0/1228790744 learned_addr learned my addr 172.21.15.7:0/1228790744 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e10e1640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6dc103b60 0x7fd6dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e08e0640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc1094a0 0x7fd6dc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e18e2640 1 -- 172.21.15.7:0/1228790744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc1094a0 msgr2=0x7fd6dc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e18e2640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc1094a0 0x7fd6dc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e18e2640 1 -- 172.21.15.7:0/1228790744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6dc103b60 msgr2=0x7fd6dc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e18e2640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6dc103b60 0x7fd6dc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e18e2640 1 -- 172.21.15.7:0/1228790744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6dc1a8760 con 0x7fd6dc109df0 2024-09-21T05:51:01.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e18e2640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6dc109df0 0x7fd6dc076190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4005cc0 tx=0x7fd6d40039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:01.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6d27fc640 1 -- 172.21.15.7:0/1228790744 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4003de0 con 0x7fd6dc109df0 2024-09-21T05:51:01.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6d27fc640 1 -- 172.21.15.7:0/1228790744 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6d40044f0 con 0x7fd6dc109df0 2024-09-21T05:51:01.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e3345640 1 -- 172.21.15.7:0/1228790744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6dc1a89f0 con 0x7fd6dc109df0 2024-09-21T05:51:01.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6d27fc640 1 -- 172.21.15.7:0/1228790744 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4030d90 con 0x7fd6dc109df0 2024-09-21T05:51:01.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.009+0000 7fd6e3345640 1 -- 172.21.15.7:0/1228790744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6dc1a9000 con 0x7fd6dc109df0 2024-09-21T05:51:01.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.011+0000 7fd6e3345640 1 -- 172.21.15.7:0/1228790744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6dc103f70 con 0x7fd6dc109df0 2024-09-21T05:51:01.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.012+0000 7fd6d27fc640 1 -- 172.21.15.7:0/1228790744 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fd6d4004040 con 0x7fd6dc109df0 2024-09-21T05:51:01.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.013+0000 7fd6d27fc640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd6c80b65e0 0x7fd6c80b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:01.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.013+0000 7fd6e10e1640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd6c80b65e0 0x7fd6c80b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:01.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.013+0000 7fd6d27fc640 1 -- 172.21.15.7:0/1228790744 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7046+0+0 (secure 0 0 0) 0x7fd6d4108480 con 0x7fd6dc109df0 2024-09-21T05:51:01.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.014+0000 7fd6e10e1640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd6c80b65e0 0x7fd6c80b8af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc077160 tx=0x7fd6d800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:01.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.017+0000 7fd6d27fc640 1 -- 172.21.15.7:0/1228790744 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd6d40cf160 con 0x7fd6dc109df0 2024-09-21T05:51:01.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.208+0000 7fd6e3345640 1 -- 172.21.15.7:0/1228790744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd6dc02e640 con 0x7fd6dc109df0 2024-09-21T05:51:01.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.209+0000 7fd6d27fc640 1 -- 172.21.15.7:0/1228790744 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7fd6d40098b0 con 0x7fd6dc109df0 2024-09-21T05:51:01.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T05:51:01.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T05:51:01.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:51:01.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='osd.11 [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:51:01.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:51:01.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:01.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:01.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:51:01.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:51:01.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:51:01.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T05:51:01.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:01.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:01.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:01.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:01.212 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:01.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.211+0000 7fd6e3345640 1 -- 172.21.15.7:0/1228790744 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd6c80b65e0 msgr2=0x7fd6c80b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:01.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.211+0000 7fd6e3345640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd6c80b65e0 0x7fd6c80b8af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc077160 tx=0x7fd6d800b390 comp rx=0 tx=0).stop 2024-09-21T05:51:01.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.211+0000 7fd6e3345640 1 -- 172.21.15.7:0/1228790744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6dc109df0 msgr2=0x7fd6dc076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:01.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.211+0000 7fd6e3345640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6dc109df0 0x7fd6dc076190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4005cc0 tx=0x7fd6d40039f0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.211+0000 7fd6e3345640 1 -- 172.21.15.7:0/1228790744 shutdown_connections 2024-09-21T05:51:01.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.211+0000 7fd6e3345640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd6c80b65e0 0x7fd6c80b8af0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.211+0000 7fd6e3345640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6dc109df0 0x7fd6dc076190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.211+0000 7fd6e3345640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc1094a0 0x7fd6dc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.211+0000 7fd6e3345640 1 --2- 172.21.15.7:0/1228790744 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6dc103b60 0x7fd6dc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:01.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.211+0000 7fd6e3345640 1 -- 172.21.15.7:0/1228790744 >> 172.21.15.7:0/1228790744 conn(0x7fd6dc07b850 msgr2=0x7fd6dc1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:01.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.212+0000 7fd6e3345640 1 -- 172.21.15.7:0/1228790744 shutdown_connections 2024-09-21T05:51:01.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:01.212+0000 7fd6e3345640 1 -- 172.21.15.7:0/1228790744 wait complete. 2024-09-21T05:51:01.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T05:51:01.080+0000 7faa2945a640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T05:51:01.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T05:51:01.097+0000 7faa25258640 -1 osd.11 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:51:01.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T05:51:01.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T05:51:01.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:51:01.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='osd.11 [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:51:01.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:51:01.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:01.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:01.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:51:01.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:51:01.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:51:01.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T05:51:01.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:01.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:01.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:01.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:01.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='osd.11 [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:01.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:01.885 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726897838,"num_in_osds":12,"osd_in_since":1726897839,"num_remapped_pgs":0} 2024-09-21T05:51:02.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:02 smithi119 ceph-mon[34833]: Detected new or changed devices on smithi119 2024-09-21T05:51:02.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:02 smithi119 ceph-mon[34833]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:51:02.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:02 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi119 to 4272M 2024-09-21T05:51:02.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:02 smithi119 ceph-mon[34833]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T05:51:02.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:02 smithi119 ceph-mon[34833]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T05:51:02.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:02 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:51:02.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:02 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:51:02.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:02 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1228790744' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:51:02.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:02 smithi027 ceph-mon[34364]: Detected new or changed devices on smithi119 2024-09-21T05:51:02.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:02 smithi027 ceph-mon[34364]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:51:02.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:02 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi119 to 4272M 2024-09-21T05:51:02.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:02 smithi027 ceph-mon[34364]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T05:51:02.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:02 smithi027 ceph-mon[34364]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T05:51:02.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:02 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:51:02.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:02 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:51:02.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:02 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1228790744' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:51:02.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:02 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi119 2024-09-21T05:51:02.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:02 smithi007 ceph-mon[30983]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:51:02.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:02 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi119 to 4272M 2024-09-21T05:51:02.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:02 smithi007 ceph-mon[30983]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T05:51:02.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:02 smithi007 ceph-mon[30983]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T05:51:02.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:51:02.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:51:02.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:02 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1228790744' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:51:02.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T05:51:03.158 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:03.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:03 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T05:51:03.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:03 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T05:51:03.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:03 smithi007 ceph-mon[30983]: osd.11 [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826] boot 2024-09-21T05:51:03.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:03 smithi007 ceph-mon[30983]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T05:51:03.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:51:03.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:03 smithi027 ceph-mon[34364]: purged_snaps scrub starts 2024-09-21T05:51:03.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:03 smithi027 ceph-mon[34364]: purged_snaps scrub ok 2024-09-21T05:51:03.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:03 smithi027 ceph-mon[34364]: osd.11 [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826] boot 2024-09-21T05:51:03.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:03 smithi027 ceph-mon[34364]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T05:51:03.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:03 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:51:03.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:03 smithi119 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T05:51:03.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:03 smithi119 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T05:51:03.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:03 smithi119 ceph-mon[34833]: osd.11 [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826] boot 2024-09-21T05:51:03.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:03 smithi119 ceph-mon[34833]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T05:51:03.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:03 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:51:03.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.590+0000 7fc5c705f640 1 -- 172.21.15.7:0/2217415570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c0109df0 msgr2=0x7fc5c0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:03.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.590+0000 7fc5c705f640 1 --2- 172.21.15.7:0/2217415570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c0109df0 0x7fc5c0110620 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009ca0 tx=0x7fc5b802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:03.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.590+0000 7fc5c705f640 1 -- 172.21.15.7:0/2217415570 shutdown_connections 2024-09-21T05:51:03.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.590+0000 7fc5c705f640 1 --2- 172.21.15.7:0/2217415570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c0109df0 0x7fc5c0110620 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.590+0000 7fc5c705f640 1 --2- 172.21.15.7:0/2217415570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c01094a0 0x7fc5c01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.590+0000 7fc5c705f640 1 --2- 172.21.15.7:0/2217415570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c0103b60 0x7fc5c0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.590+0000 7fc5c705f640 1 -- 172.21.15.7:0/2217415570 >> 172.21.15.7:0/2217415570 conn(0x7fc5c007b850 msgr2=0x7fc5c007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.590+0000 7fc5c705f640 1 -- 172.21.15.7:0/2217415570 shutdown_connections 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.590+0000 7fc5c705f640 1 -- 172.21.15.7:0/2217415570 wait complete. 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.591+0000 7fc5c705f640 1 Processor -- start 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.591+0000 7fc5c705f640 1 -- start start 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.591+0000 7fc5c705f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c0103b60 0x7fc5c019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.591+0000 7fc5c705f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c01094a0 0x7fc5c019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.591+0000 7fc5c705f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c0109df0 0x7fc5c019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.591+0000 7fc5c705f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c0113ab0 con 0x7fc5c0103b60 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.591+0000 7fc5c705f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c0113930 con 0x7fc5c0109df0 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.591+0000 7fc5c705f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c0113c30 con 0x7fc5c01094a0 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5c4dfb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c0103b60 0x7fc5c019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5c4dfb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c0103b60 0x7fc5c019a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36338/0 (socket says 172.21.15.7:36338) 2024-09-21T05:51:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5c4dfb640 1 -- 172.21.15.7:0/4173242105 learned_addr learned my addr 172.21.15.7:0/4173242105 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5bffff640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c01094a0 0x7fc5c019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5c55fc640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c0109df0 0x7fc5c019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5c4dfb640 1 -- 172.21.15.7:0/4173242105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c01094a0 msgr2=0x7fc5c019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5c4dfb640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c01094a0 0x7fc5c019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5c4dfb640 1 -- 172.21.15.7:0/4173242105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c0109df0 msgr2=0x7fc5c019fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5c4dfb640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c0109df0 0x7fc5c019fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5c4dfb640 1 -- 172.21.15.7:0/4173242105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c01a03d0 con 0x7fc5c0103b60 2024-09-21T05:51:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5c4dfb640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c0103b60 0x7fc5c019a460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800c890 tx=0x7fc5a800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5bdffb640 1 -- 172.21.15.7:0/4173242105 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8004220 con 0x7fc5c0103b60 2024-09-21T05:51:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5c705f640 1 -- 172.21.15.7:0/4173242105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c01a06c0 con 0x7fc5c0103b60 2024-09-21T05:51:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5bdffb640 1 -- 172.21.15.7:0/4173242105 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5a80043c0 con 0x7fc5c0103b60 2024-09-21T05:51:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.592+0000 7fc5bdffb640 1 -- 172.21.15.7:0/4173242105 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8004a00 con 0x7fc5c0103b60 2024-09-21T05:51:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.593+0000 7fc5c705f640 1 -- 172.21.15.7:0/4173242105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c01a6e20 con 0x7fc5c0103b60 2024-09-21T05:51:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.593+0000 7fc5c705f640 1 -- 172.21.15.7:0/4173242105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c0103f70 con 0x7fc5c0103b60 2024-09-21T05:51:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.595+0000 7fc5bdffb640 1 -- 172.21.15.7:0/4173242105 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fc5a80079b0 con 0x7fc5c0103b60 2024-09-21T05:51:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.596+0000 7fc5bdffb640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc5ac0b6560 0x7fc5ac0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.596+0000 7fc5bffff640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc5ac0b6560 0x7fc5ac0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.596+0000 7fc5bdffb640 1 -- 172.21.15.7:0/4173242105 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7fc5a80e7050 con 0x7fc5c0103b60 2024-09-21T05:51:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.596+0000 7fc5bffff640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc5ac0b6560 0x7fc5ac0b8a70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0109040 tx=0x7fc5b000a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.599+0000 7fc5bdffb640 1 -- 172.21.15.7:0/4173242105 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc5a8014030 con 0x7fc5c0103b60 2024-09-21T05:51:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.793+0000 7fc5c705f640 1 -- 172.21.15.7:0/4173242105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc5c019b590 con 0x7fc5c0103b60 2024-09-21T05:51:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.793+0000 7fc5bdffb640 1 -- 172.21.15.7:0/4173242105 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7fc5a80b2090 con 0x7fc5c0103b60 2024-09-21T05:51:03.796 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.796+0000 7fc5c705f640 1 -- 172.21.15.7:0/4173242105 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc5ac0b6560 msgr2=0x7fc5ac0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.796+0000 7fc5c705f640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc5ac0b6560 0x7fc5ac0b8a70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0109040 tx=0x7fc5b000a250 comp rx=0 tx=0).stop 2024-09-21T05:51:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.796+0000 7fc5c705f640 1 -- 172.21.15.7:0/4173242105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c0103b60 msgr2=0x7fc5c019a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.796+0000 7fc5c705f640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c0103b60 0x7fc5c019a460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800c890 tx=0x7fc5a800cd50 comp rx=0 tx=0).stop 2024-09-21T05:51:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.796+0000 7fc5c705f640 1 -- 172.21.15.7:0/4173242105 shutdown_connections 2024-09-21T05:51:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.796+0000 7fc5c705f640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc5ac0b6560 0x7fc5ac0b8a70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.796+0000 7fc5c705f640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5c0109df0 0x7fc5c019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.796+0000 7fc5c705f640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c01094a0 0x7fc5c019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.796+0000 7fc5c705f640 1 --2- 172.21.15.7:0/4173242105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5c0103b60 0x7fc5c019a460 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.796+0000 7fc5c705f640 1 -- 172.21.15.7:0/4173242105 >> 172.21.15.7:0/4173242105 conn(0x7fc5c007b850 msgr2=0x7fc5c01074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.796+0000 7fc5c705f640 1 -- 172.21.15.7:0/4173242105 shutdown_connections 2024-09-21T05:51:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:03.796+0000 7fc5c705f640 1 -- 172.21.15.7:0/4173242105 wait complete. 2024-09-21T05:51:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:04 smithi027 ceph-mon[34364]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:51:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:04 smithi027 ceph-mon[34364]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T05:51:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:04 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/4173242105' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:51:04.497 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:04 smithi007 ceph-mon[30983]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:51:04.497 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:04 smithi007 ceph-mon[30983]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T05:51:04.497 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:04 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4173242105' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:51:04.531 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":68,"num_osds":12,"num_up_osds":12,"osd_up_since":1726897862,"num_in_osds":12,"osd_in_since":1726897839,"num_remapped_pgs":0} 2024-09-21T05:51:04.531 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:51:04.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:04 smithi119 ceph-mon[34833]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:51:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:04 smithi119 ceph-mon[34833]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T05:51:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:04 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/4173242105' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:51:04.791 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:05.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.192+0000 7f0601b4e640 1 -- 172.21.15.7:0/3694814794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05fc105320 msgr2=0x7f05fc10d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:05.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.192+0000 7f0601b4e640 1 --2- 172.21.15.7:0/3694814794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05fc105320 0x7f05fc10d870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009900 tx=0x7f05f002a410 comp rx=0 tx=0).stop 2024-09-21T05:51:05.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.192+0000 7f0601b4e640 1 -- 172.21.15.7:0/3694814794 shutdown_connections 2024-09-21T05:51:05.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.192+0000 7f0601b4e640 1 --2- 172.21.15.7:0/3694814794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05fc10de30 0x7f05fc110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.192+0000 7f0601b4e640 1 --2- 172.21.15.7:0/3694814794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05fc105320 0x7f05fc10d870 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.192+0000 7f0601b4e640 1 --2- 172.21.15.7:0/3694814794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05fc1049d0 0x7f05fc104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.192+0000 7f0601b4e640 1 -- 172.21.15.7:0/3694814794 >> 172.21.15.7:0/3694814794 conn(0x7f05fc079740 msgr2=0x7f05fc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:05.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.192+0000 7f0601b4e640 1 -- 172.21.15.7:0/3694814794 shutdown_connections 2024-09-21T05:51:05.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.192+0000 7f0601b4e640 1 -- 172.21.15.7:0/3694814794 wait complete. 2024-09-21T05:51:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.193+0000 7f0601b4e640 1 Processor -- start 2024-09-21T05:51:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.193+0000 7f0601b4e640 1 -- start start 2024-09-21T05:51:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f0601b4e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05fc1049d0 0x7f05fc19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f0601b4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05fc105320 0x7f05fc19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f0601b4e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05fc10de30 0x7f05fc19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f0601b4e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc113a90 con 0x7f05fc105320 2024-09-21T05:51:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f0601b4e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc113910 con 0x7f05fc1049d0 2024-09-21T05:51:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f0601b4e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc113c10 con 0x7f05fc10de30 2024-09-21T05:51:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f05faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05fc105320 0x7f05fc19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f05faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05fc105320 0x7f05fc19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36366/0 (socket says 172.21.15.7:36366) 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f05faffd640 1 -- 172.21.15.7:0/1153768861 learned_addr learned my addr 172.21.15.7:0/1153768861 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f05fbfff640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05fc10de30 0x7f05fc19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f05fb7fe640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05fc1049d0 0x7f05fc19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f05faffd640 1 -- 172.21.15.7:0/1153768861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05fc10de30 msgr2=0x7f05fc19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f05faffd640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05fc10de30 0x7f05fc19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f05faffd640 1 -- 172.21.15.7:0/1153768861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05fc1049d0 msgr2=0x7f05fc19a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f05faffd640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05fc1049d0 0x7f05fc19a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f05faffd640 1 -- 172.21.15.7:0/1153768861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05fc1a04b0 con 0x7f05fc105320 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.194+0000 7f05faffd640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05fc105320 0x7f05fc19aae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f05f002a930 tx=0x7f05f0031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.195+0000 7f05f8ff9640 1 -- 172.21.15.7:0/1153768861 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f003f030 con 0x7f05fc105320 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.195+0000 7f05f8ff9640 1 -- 172.21.15.7:0/1153768861 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05f0004490 con 0x7f05fc105320 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.195+0000 7f0601b4e640 1 -- 172.21.15.7:0/1153768861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05fc1a0740 con 0x7f05fc105320 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.195+0000 7f05f8ff9640 1 -- 172.21.15.7:0/1153768861 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0035070 con 0x7f05fc105320 2024-09-21T05:51:05.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.195+0000 7f0601b4e640 1 -- 172.21.15.7:0/1153768861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05fc1a6f00 con 0x7f05fc105320 2024-09-21T05:51:05.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.196+0000 7f0601b4e640 1 -- 172.21.15.7:0/1153768861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05fc06c240 con 0x7f05fc105320 2024-09-21T05:51:05.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.197+0000 7f05f8ff9640 1 -- 172.21.15.7:0/1153768861 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f05f0042030 con 0x7f05fc105320 2024-09-21T05:51:05.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.198+0000 7f05f8ff9640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f05e40b6560 0x7f05e40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:05.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.198+0000 7f05fb7fe640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f05e40b6560 0x7f05e40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:05.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.198+0000 7f05f8ff9640 1 -- 172.21.15.7:0/1153768861 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7f05f0107640 con 0x7f05fc105320 2024-09-21T05:51:05.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.199+0000 7f05fb7fe640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f05e40b6560 0x7f05e40b8a70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f05fc06c940 tx=0x7f05ec005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:05.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.201+0000 7f05f8ff9640 1 -- 172.21.15.7:0/1153768861 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05f00d2680 con 0x7f05fc105320 2024-09-21T05:51:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.390+0000 7f0601b4e640 1 -- 172.21.15.7:0/1153768861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05fc104de0 con 0x7f05fc105320 2024-09-21T05:51:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.391+0000 7f05f8ff9640 1 -- 172.21.15.7:0/1153768861 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+18685 (secure 0 0 0) 0x7f05fc104de0 con 0x7f05fc105320 2024-09-21T05:51:05.394 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:05.394 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":68,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:43:32.863896+0000","modified":"2024-09-21T05:51:03.084453+0000","last_up_change":"2024-09-21T05:51:02.074799+0000","last_in_change":"2024-09-21T05:50:39.016405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:47:20.844179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d7a68ba-a599-44a9-a0de-a1d6df51f437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6803","nonce":536257283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6805","nonce":536257283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6809","nonce":536257283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6807","nonce":536257283}]},"public_addr":"172.21.15.7:6803/536257283","cluster_addr":"172.21.15.7:6805/536257283","heartbeat_back_addr":"172.21.15.7:6809/536257283","heartbeat_front_addr":"172.21.15.7:6807/536257283","state":["exists","up"]},{"osd":1,"uuid":"d4600805-1cb5-432a-8ae0-a40107a6c6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6801","nonce":2299402871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6803","nonce":2299402871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6807","nonce":2299402871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6805","nonce":2299402871}]},"public_addr":"172.21.15.27:6801/2299402871","cluster_addr":"172.21.15.27:6803/2299402871","heartbeat_back_addr":"172.21.15.27:6807/2299402871","heartbeat_front_addr":"172.21.15.27:6805/2299402871","state":["exists","up"]},{"osd":2,"uuid":"aa435f82-5819-4497-9053-1d891e712b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6801","nonce":1043408043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6803","nonce":1043408043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6807","nonce":1043408043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6805","nonce":1043408043}]},"public_addr":"172.21.15.119:6801/1043408043","cluster_addr":"172.21.15.119:6803/1043408043","heartbeat_back_addr":"172.21.15.119:6807/1043408043","heartbeat_front_addr":"172.21.15.119:6805/1043408043","state":["exists","up"]},{"osd":3,"uuid":"55803f97-02e1-43c0-b8da-9b8af32fd1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6811","nonce":1261229771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6813","nonce":1261229771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6817","nonce":1261229771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6815","nonce":1261229771}]},"public_addr":"172.21.15.7:6811/1261229771","cluster_addr":"172.21.15.7:6813/1261229771","heartbeat_back_addr":"172.21.15.7:6817/1261229771","heartbeat_front_addr":"172.21.15.7:6815/1261229771","state":["exists","up"]},{"osd":4,"uuid":"987ce230-5bfc-45a7-a33e-6291545afded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6809","nonce":631467792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6811","nonce":631467792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6815","nonce":631467792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6813","nonce":631467792}]},"public_addr":"172.21.15.27:6809/631467792","cluster_addr":"172.21.15.27:6811/631467792","heartbeat_back_addr":"172.21.15.27:6815/631467792","heartbeat_front_addr":"172.21.15.27:6813/631467792","state":["exists","up"]},{"osd":5,"uuid":"e768fbfa-8983-4ff6-8dca-b7df2304cf91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6809","nonce":2530968619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6811","nonce":2530968619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6815","nonce":2530968619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6813","nonce":2530968619}]},"public_addr":"172.21.15.119:6809/2530968619","cluster_addr":"172.21.15.119:6811/2530968619","heartbeat_back_addr":"172.21.15.119:6815/2530968619","heartbeat_front_addr":"172.21.15.119:6813/2530968619","state":["exists","up"]},{"osd":6,"uuid":"22496f13-64be-479b-89ea-bf51544199c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6819","nonce":856032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6821","nonce":856032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6825","nonce":856032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6823","nonce":856032021}]},"public_addr":"172.21.15.7:6819/856032021","cluster_addr":"172.21.15.7:6821/856032021","heartbeat_back_addr":"172.21.15.7:6825/856032021","heartbeat_front_addr":"172.21.15.7:6823/856032021","state":["exists","up"]},{"osd":7,"uuid":"53fc5616-b06a-498e-a60e-d7d7d6ba2a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6817","nonce":2862843529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6819","nonce":2862843529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6823","nonce":2862843529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6821","nonce":2862843529}]},"public_addr":"172.21.15.27:6817/2862843529","cluster_addr":"172.21.15.27:6819/2862843529","heartbeat_back_addr":"172.21.15.27:6823/2862843529","heartbeat_front_addr":"172.21.15.27:6821/2862843529","state":["exists","up"]},{"osd":8,"uuid":"53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6817","nonce":3663835202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6819","nonce":3663835202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6823","nonce":3663835202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6821","nonce":3663835202}]},"public_addr":"172.21.15.119:6817/3663835202","cluster_addr":"172.21.15.119:6819/3663835202","heartbeat_back_addr":"172.21.15.119:6823/3663835202","heartbeat_front_addr":"172.21.15.119:6821/3663835202","state":["exists","up"]},{"osd":9,"uuid":"a69a747d-1e6c-4940-9d96-4315ab384588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6827","nonce":2348805959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6829","nonce":2348805959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6833","nonce":2348805959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6831","nonce":2348805959}]},"public_addr":"172.21.15.7:6827/2348805959","cluster_addr":"172.21.15.7:6829/2348805959","heartbeat_back_addr":"172.21.15.7:6833/2348805959","heartbeat_front_addr":"172.21.15.7:6831/2348805959","state":["exists","up"]},{"osd":10,"uuid":"a8f67271-99bb-4fb7-b0f5-a24730cd96cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6825","nonce":2363600090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6827","nonce":2363600090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6831","nonce":2363600090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6829","nonce":2363600090}]},"public_addr":"172.21.15.27:6825/2363600090","cluster_addr":"172.21.15.27:6827/2363600090","heartbeat_back_addr":"172.21.15.27:6831/2363600090","heartbeat_front_addr":"172.21.15.27:6829/2363600090","state":["exists","up"]},{"osd":11,"uuid":"88456735-00b1-479c-b201-588a9ee0c881","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6825","nonce":3937692826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6827","nonce":3937692826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6831","nonce":3937692826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6829","nonce":3937692826}]},"public_addr":"172.21.15.119:6825/3937692826","cluster_addr":"172.21.15.119:6827/3937692826","heartbeat_back_addr":"172.21.15.119:6831/3937692826","heartbeat_front_addr":"172.21.15.119:6829/3937692826","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:26.217550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:51.830871+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:17.201362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:41.990894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:07.357782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.114180+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:56.808155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:22.565234+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:46.981522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:10.600602+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:35.973766+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:51:00.216062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/4143746508":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/1505943829":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/1622456881":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/833696585":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/2055984288":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6801/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3995317885":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2229583478":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/468393974":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/1009303060":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2125734440":"2024-09-22T05:45:22.373420+0000","172.21.15.7:6800/3995317885":"2024-09-22T05:45:22.373420+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:51:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.393+0000 7f0601b4e640 1 -- 172.21.15.7:0/1153768861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f05e40b6560 msgr2=0x7f05e40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.393+0000 7f0601b4e640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f05e40b6560 0x7f05e40b8a70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f05fc06c940 tx=0x7f05ec005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.393+0000 7f0601b4e640 1 -- 172.21.15.7:0/1153768861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05fc105320 msgr2=0x7f05fc19aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.393+0000 7f0601b4e640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05fc105320 0x7f05fc19aae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f05f002a930 tx=0x7f05f0031a20 comp rx=0 tx=0).stop 2024-09-21T05:51:05.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.393+0000 7f0601b4e640 1 -- 172.21.15.7:0/1153768861 shutdown_connections 2024-09-21T05:51:05.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.393+0000 7f0601b4e640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f05e40b6560 0x7f05e40b8a70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.393+0000 7f0601b4e640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05fc105320 0x7f05fc19aae0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.393+0000 7f0601b4e640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05fc10de30 0x7f05fc19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.393+0000 7f0601b4e640 1 --2- 172.21.15.7:0/1153768861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05fc1049d0 0x7f05fc19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.393+0000 7f0601b4e640 1 -- 172.21.15.7:0/1153768861 >> 172.21.15.7:0/1153768861 conn(0x7f05fc079740 msgr2=0x7f05fc1068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:05.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.393+0000 7f0601b4e640 1 -- 172.21.15.7:0/1153768861 shutdown_connections 2024-09-21T05:51:05.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:05.393+0000 7f0601b4e640 1 -- 172.21.15.7:0/1153768861 wait complete. 2024-09-21T05:51:06.009 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T05:47:20.844179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T05:51:06.009 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T05:51:06.264 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:06.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:06 smithi007 ceph-mon[30983]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:06.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:06 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1153768861' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:06.394 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:06 smithi119 ceph-mon[34833]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:06.394 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:06 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1153768861' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:06.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:06 smithi027 ceph-mon[34364]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:06.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:06 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1153768861' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:06.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.847+0000 7f6e5d56b640 1 -- 172.21.15.7:0/1823651225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e58105380 msgr2=0x7f6e5810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:06.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.847+0000 7f6e5d56b640 1 --2- 172.21.15.7:0/1823651225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e58105380 0x7f6e5810d8d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c009900 tx=0x7f6e4c02a410 comp rx=0 tx=0).stop 2024-09-21T05:51:06.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.847+0000 7f6e5d56b640 1 -- 172.21.15.7:0/1823651225 shutdown_connections 2024-09-21T05:51:06.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.847+0000 7f6e5d56b640 1 --2- 172.21.15.7:0/1823651225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e58105380 0x7f6e5810d8d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:06.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.847+0000 7f6e5d56b640 1 --2- 172.21.15.7:0/1823651225 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e5810de60 0x7f6e58110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:06.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.847+0000 7f6e5d56b640 1 --2- 172.21.15.7:0/1823651225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e58104a30 0x7f6e58104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:06.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.847+0000 7f6e5d56b640 1 -- 172.21.15.7:0/1823651225 >> 172.21.15.7:0/1823651225 conn(0x7f6e58079760 msgr2=0x7f6e58079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:06.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.847+0000 7f6e5d56b640 1 -- 172.21.15.7:0/1823651225 shutdown_connections 2024-09-21T05:51:06.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.847+0000 7f6e5d56b640 1 -- 172.21.15.7:0/1823651225 wait complete. 2024-09-21T05:51:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.848+0000 7f6e5d56b640 1 Processor -- start 2024-09-21T05:51:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.848+0000 7f6e5d56b640 1 -- start start 2024-09-21T05:51:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.848+0000 7f6e5d56b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e58104a30 0x7f6e5819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.848+0000 7f6e5d56b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e58105380 0x7f6e5819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.848+0000 7f6e5d56b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e5810de60 0x7f6e5819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.848+0000 7f6e5d56b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6e58113aa0 con 0x7f6e5810de60 2024-09-21T05:51:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.848+0000 7f6e5d56b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6e58113920 con 0x7f6e58104a30 2024-09-21T05:51:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.848+0000 7f6e5d56b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6e58113c20 con 0x7f6e58105380 2024-09-21T05:51:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.848+0000 7f6e577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e5810de60 0x7f6e5819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.848+0000 7f6e577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e5810de60 0x7f6e5819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36374/0 (socket says 172.21.15.7:36374) 2024-09-21T05:51:06.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.848+0000 7f6e577fe640 1 -- 172.21.15.7:0/2465858362 learned_addr learned my addr 172.21.15.7:0/2465858362 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:06.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.848+0000 7f6e56ffd640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e58104a30 0x7f6e5819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:06.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.849+0000 7f6e567fc640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e58105380 0x7f6e5819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:06.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.849+0000 7f6e577fe640 1 -- 172.21.15.7:0/2465858362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e58105380 msgr2=0x7f6e5819aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:06.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.849+0000 7f6e577fe640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e58105380 0x7f6e5819aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:06.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.849+0000 7f6e577fe640 1 -- 172.21.15.7:0/2465858362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e58104a30 msgr2=0x7f6e5819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:06.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.849+0000 7f6e577fe640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e58104a30 0x7f6e5819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:06.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.849+0000 7f6e577fe640 1 -- 172.21.15.7:0/2465858362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e581a0460 con 0x7f6e5810de60 2024-09-21T05:51:06.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.849+0000 7f6e567fc640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e58105380 0x7f6e5819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:51:06.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.849+0000 7f6e577fe640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e5810de60 0x7f6e5819fd30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000eb10 tx=0x7f6e5000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:06.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.849+0000 7f6e3ffff640 1 -- 172.21.15.7:0/2465858362 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e50004b20 con 0x7f6e5810de60 2024-09-21T05:51:06.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.849+0000 7f6e3ffff640 1 -- 172.21.15.7:0/2465858362 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e50004cc0 con 0x7f6e5810de60 2024-09-21T05:51:06.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.849+0000 7f6e3ffff640 1 -- 172.21.15.7:0/2465858362 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e50010670 con 0x7f6e5810de60 2024-09-21T05:51:06.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.849+0000 7f6e5d56b640 1 -- 172.21.15.7:0/2465858362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e581a0750 con 0x7f6e5810de60 2024-09-21T05:51:06.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.849+0000 7f6e5d56b640 1 -- 172.21.15.7:0/2465858362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e581a6eb0 con 0x7f6e5810de60 2024-09-21T05:51:06.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.850+0000 7f6e5d56b640 1 -- 172.21.15.7:0/2465858362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e5806c1f0 con 0x7f6e5810de60 2024-09-21T05:51:06.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.852+0000 7f6e3ffff640 1 -- 172.21.15.7:0/2465858362 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f6e50005020 con 0x7f6e5810de60 2024-09-21T05:51:06.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.853+0000 7f6e3ffff640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e400b6560 0x7f6e400b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:06.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.853+0000 7f6e56ffd640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e400b6560 0x7f6e400b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:06.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.853+0000 7f6e3ffff640 1 -- 172.21.15.7:0/2465858362 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7f6e500e7610 con 0x7f6e5810de60 2024-09-21T05:51:06.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.853+0000 7f6e56ffd640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e400b6560 0x7f6e400b8a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6e48005fd0 tx=0x7f6e4800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:06.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:06.857+0000 7f6e3ffff640 1 -- 172.21.15.7:0/2465858362 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6e500ae1d0 con 0x7f6e5810de60 2024-09-21T05:51:07.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.045+0000 7f6e5d56b640 1 -- 172.21.15.7:0/2465858362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6e58108f40 con 0x7f6e5810de60 2024-09-21T05:51:07.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.045+0000 7f6e3ffff640 1 -- 172.21.15.7:0/2465858362 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) ==== 93+0+10 (secure 0 0 0) 0x7f6e500b25b0 con 0x7f6e5810de60 2024-09-21T05:51:07.047 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-21T05:51:07.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.048+0000 7f6e5d56b640 1 -- 172.21.15.7:0/2465858362 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e400b6560 msgr2=0x7f6e400b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:07.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.048+0000 7f6e5d56b640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e400b6560 0x7f6e400b8a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6e48005fd0 tx=0x7f6e4800b390 comp rx=0 tx=0).stop 2024-09-21T05:51:07.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.048+0000 7f6e5d56b640 1 -- 172.21.15.7:0/2465858362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e5810de60 msgr2=0x7f6e5819fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:07.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.048+0000 7f6e5d56b640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e5810de60 0x7f6e5819fd30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000eb10 tx=0x7f6e5000c2d0 comp rx=0 tx=0).stop 2024-09-21T05:51:07.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.048+0000 7f6e5d56b640 1 -- 172.21.15.7:0/2465858362 shutdown_connections 2024-09-21T05:51:07.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.048+0000 7f6e5d56b640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e400b6560 0x7f6e400b8a70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:07.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.048+0000 7f6e5d56b640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e5810de60 0x7f6e5819fd30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:07.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.048+0000 7f6e5d56b640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e58105380 0x7f6e5819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:07.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.048+0000 7f6e5d56b640 1 --2- 172.21.15.7:0/2465858362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e58104a30 0x7f6e5819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:07.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.048+0000 7f6e5d56b640 1 -- 172.21.15.7:0/2465858362 >> 172.21.15.7:0/2465858362 conn(0x7f6e58079760 msgr2=0x7f6e580ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:07.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.048+0000 7f6e5d56b640 1 -- 172.21.15.7:0/2465858362 shutdown_connections 2024-09-21T05:51:07.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:07.048+0000 7f6e5d56b640 1 -- 172.21.15.7:0/2465858362 wait complete. 2024-09-21T05:51:07.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:07 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2465858362' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:51:07.378 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:07 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2465858362' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:51:07.411 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:07 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2465858362' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:51:07.615 INFO:tasks.cephadm:Adding mds.a on smithi007 2024-09-21T05:51:07.615 INFO:tasks.cephadm:Adding mds.d on smithi007 2024-09-21T05:51:07.615 INFO:tasks.cephadm:Adding mds.g on smithi007 2024-09-21T05:51:07.615 INFO:tasks.cephadm:Adding mds.j on smithi007 2024-09-21T05:51:07.615 INFO:tasks.cephadm:Adding mds.b on smithi027 2024-09-21T05:51:07.615 INFO:tasks.cephadm:Adding mds.e on smithi027 2024-09-21T05:51:07.615 INFO:tasks.cephadm:Adding mds.h on smithi027 2024-09-21T05:51:07.615 INFO:tasks.cephadm:Adding mds.k on smithi027 2024-09-21T05:51:07.615 INFO:tasks.cephadm:Adding mds.c on smithi119 2024-09-21T05:51:07.616 INFO:tasks.cephadm:Adding mds.f on smithi119 2024-09-21T05:51:07.616 INFO:tasks.cephadm:Adding mds.i on smithi119 2024-09-21T05:51:07.616 INFO:tasks.cephadm:Adding mds.l on smithi119 2024-09-21T05:51:07.616 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi027=b;smithi027=e;smithi027=h;smithi027=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l' 2024-09-21T05:51:07.876 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:51:08.326 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:08 smithi119 ceph-mon[34833]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:08.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.324+0000 7f83f1bb1640 1 -- 172.21.15.119:0/2598171418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83ec1062c0 msgr2=0x7f83ec1066d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:08.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.324+0000 7f83f1bb1640 1 --2- 172.21.15.119:0/2598171418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83ec1062c0 0x7f83ec1066d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009930 tx=0x7f83dc02a420 comp rx=0 tx=0).stop 2024-09-21T05:51:08.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.324+0000 7f83f1bb1640 1 -- 172.21.15.119:0/2598171418 shutdown_connections 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.324+0000 7f83f1bb1640 1 --2- 172.21.15.119:0/2598171418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83ec106c10 0x7f83ec1106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.324+0000 7f83f1bb1640 1 --2- 172.21.15.119:0/2598171418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83ec1062c0 0x7f83ec1066d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.324+0000 7f83f1bb1640 1 --2- 172.21.15.119:0/2598171418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83ec102070 0x7f83ec102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.324+0000 7f83f1bb1640 1 -- 172.21.15.119:0/2598171418 >> 172.21.15.119:0/2598171418 conn(0x7f83ec079e10 msgr2=0x7f83ec07a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.324+0000 7f83f1bb1640 1 -- 172.21.15.119:0/2598171418 shutdown_connections 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.324+0000 7f83f1bb1640 1 -- 172.21.15.119:0/2598171418 wait complete. 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.324+0000 7f83f1bb1640 1 Processor -- start 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.325+0000 7f83f1bb1640 1 -- start start 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.325+0000 7f83f1bb1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83ec102070 0x7f83ec19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.325+0000 7f83f1bb1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83ec1062c0 0x7f83ec19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.325+0000 7f83f1bb1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83ec106c10 0x7f83ec19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.325+0000 7f83f1bb1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec113ae0 con 0x7f83ec1062c0 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.325+0000 7f83f1bb1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec113960 con 0x7f83ec102070 2024-09-21T05:51:08.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.325+0000 7f83f1bb1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec113c60 con 0x7f83ec106c10 2024-09-21T05:51:08.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.325+0000 7f83ebfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83ec106c10 0x7f83ec19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:08.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.325+0000 7f83ebfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83ec106c10 0x7f83ec19fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53370/0 (socket says 172.21.15.119:53370) 2024-09-21T05:51:08.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.325+0000 7f83ebfff640 1 -- 172.21.15.119:0/3649884241 learned_addr learned my addr 172.21.15.119:0/3649884241 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-21T05:51:08.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.325+0000 7f83eb7fe640 1 --2- 172.21.15.119:0/3649884241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83ec102070 0x7f83ec19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:08.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.326+0000 7f83ebfff640 1 -- 172.21.15.119:0/3649884241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83ec102070 msgr2=0x7f83ec19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:08.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.326+0000 7f83ebfff640 1 --2- 172.21.15.119:0/3649884241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83ec102070 0x7f83ec19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.326+0000 7f83ebfff640 1 -- 172.21.15.119:0/3649884241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83ec1062c0 msgr2=0x7f83ec19aad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T05:51:08.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.326+0000 7f83ebfff640 1 --2- 172.21.15.119:0/3649884241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83ec1062c0 0x7f83ec19aad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.326+0000 7f83ebfff640 1 -- 172.21.15.119:0/3649884241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ec1a04a0 con 0x7f83ec106c10 2024-09-21T05:51:08.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.326+0000 7f83ebfff640 1 --2- 172.21.15.119:0/3649884241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83ec106c10 0x7f83ec19fd70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f83e400d950 tx=0x7f83e400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:08.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.326+0000 7f83e8ff9640 1 -- 172.21.15.119:0/3649884241 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e4017030 con 0x7f83ec106c10 2024-09-21T05:51:08.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.326+0000 7f83f1bb1640 1 -- 172.21.15.119:0/3649884241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ec1a0790 con 0x7f83ec106c10 2024-09-21T05:51:08.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.326+0000 7f83e8ff9640 1 -- 172.21.15.119:0/3649884241 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83e4004020 con 0x7f83ec106c10 2024-09-21T05:51:08.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.326+0000 7f83e8ff9640 1 -- 172.21.15.119:0/3649884241 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e4003b50 con 0x7f83ec106c10 2024-09-21T05:51:08.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.326+0000 7f83f1bb1640 1 -- 172.21.15.119:0/3649884241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ec1a6ef0 con 0x7f83ec106c10 2024-09-21T05:51:08.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.327+0000 7f83f1bb1640 1 -- 172.21.15.119:0/3649884241 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ec102480 con 0x7f83ec106c10 2024-09-21T05:51:08.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.330+0000 7f83e8ff9640 1 -- 172.21.15.119:0/3649884241 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f83e401a070 con 0x7f83ec106c10 2024-09-21T05:51:08.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.331+0000 7f83e8ff9640 1 --2- 172.21.15.119:0/3649884241 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f83d40b65e0 0x7f83d40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:08.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.331+0000 7f83e8ff9640 1 -- 172.21.15.119:0/3649884241 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7f83e40e6b20 con 0x7f83ec106c10 2024-09-21T05:51:08.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.332+0000 7f83eb7fe640 1 --2- 172.21.15.119:0/3649884241 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f83d40b65e0 0x7f83d40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:08.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.332+0000 7f83eb7fe640 1 --2- 172.21.15.119:0/3649884241 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f83d40b65e0 0x7f83d40b8af0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f83ec06bab0 tx=0x7f83e0009670 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:08.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.335+0000 7f83e8ff9640 1 -- 172.21.15.119:0/3649884241 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83e4021070 con 0x7f83ec106c10 2024-09-21T05:51:08.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:08 smithi027 ceph-mon[34364]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:08.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.528+0000 7f83f1bb1640 1 -- 172.21.15.119:0/3649884241 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi027=b;smithi027=e;smithi027=h;smithi027=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}) -- 0x7f83ec063900 con 0x7f83d40b65e0 2024-09-21T05:51:08.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.537+0000 7f83e8ff9640 1 -- 172.21.15.119:0/3649884241 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f83ec063900 con 0x7f83d40b65e0 2024-09-21T05:51:08.539 INFO:teuthology.orchestra.run.smithi119.stdout:Scheduled mds.all update... 2024-09-21T05:51:08.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.540+0000 7f83f1bb1640 1 -- 172.21.15.119:0/3649884241 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f83d40b65e0 msgr2=0x7f83d40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:08.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.540+0000 7f83f1bb1640 1 --2- 172.21.15.119:0/3649884241 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f83d40b65e0 0x7f83d40b8af0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f83ec06bab0 tx=0x7f83e0009670 comp rx=0 tx=0).stop 2024-09-21T05:51:08.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.540+0000 7f83f1bb1640 1 -- 172.21.15.119:0/3649884241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83ec106c10 msgr2=0x7f83ec19fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:08.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.540+0000 7f83f1bb1640 1 --2- 172.21.15.119:0/3649884241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83ec106c10 0x7f83ec19fd70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f83e400d950 tx=0x7f83e400de10 comp rx=0 tx=0).stop 2024-09-21T05:51:08.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.540+0000 7f83f1bb1640 1 -- 172.21.15.119:0/3649884241 shutdown_connections 2024-09-21T05:51:08.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.540+0000 7f83f1bb1640 1 --2- 172.21.15.119:0/3649884241 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f83d40b65e0 0x7f83d40b8af0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.540+0000 7f83f1bb1640 1 --2- 172.21.15.119:0/3649884241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83ec1062c0 0x7f83ec19aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.540+0000 7f83f1bb1640 1 --2- 172.21.15.119:0/3649884241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83ec106c10 0x7f83ec19fd70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.540+0000 7f83f1bb1640 1 --2- 172.21.15.119:0/3649884241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83ec102070 0x7f83ec19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.540+0000 7f83f1bb1640 1 -- 172.21.15.119:0/3649884241 >> 172.21.15.119:0/3649884241 conn(0x7f83ec079e10 msgr2=0x7f83ec107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:08.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.540+0000 7f83f1bb1640 1 -- 172.21.15.119:0/3649884241 shutdown_connections 2024-09-21T05:51:08.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T05:51:08.540+0000 7f83f1bb1640 1 -- 172.21.15.119:0/3649884241 wait complete. 2024-09-21T05:51:08.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:08 smithi007 ceph-mon[30983]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:09.178 DEBUG:teuthology.orchestra.run.smithi007:mds.a> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T05:51:09.181 DEBUG:teuthology.orchestra.run.smithi007:mds.d> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T05:51:09.224 DEBUG:teuthology.orchestra.run.smithi007:mds.g> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T05:51:09.267 DEBUG:teuthology.orchestra.run.smithi007:mds.j> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T05:51:09.310 DEBUG:teuthology.orchestra.run.smithi027:mds.b> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T05:51:09.314 DEBUG:teuthology.orchestra.run.smithi027:mds.e> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T05:51:09.356 DEBUG:teuthology.orchestra.run.smithi027:mds.h> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T05:51:09.399 DEBUG:teuthology.orchestra.run.smithi027:mds.k> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T05:51:09.443 DEBUG:teuthology.orchestra.run.smithi119:mds.c> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T05:51:09.445 DEBUG:teuthology.orchestra.run.smithi119:mds.f> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T05:51:09.488 DEBUG:teuthology.orchestra.run.smithi119:mds.i> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T05:51:09.531 DEBUG:teuthology.orchestra.run.smithi119:mds.l> sudo journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T05:51:09.575 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T05:51:09.575 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:51:09.679 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:09 smithi119 ceph-mon[34833]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:09.679 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:09 smithi119 ceph-mon[34833]: from='client.24625 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi027=b;smithi027=e;smithi027=h;smithi027=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:09.680 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:09 smithi119 ceph-mon[34833]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi027=b;smithi027=e;smithi027=h;smithi027=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2024-09-21T05:51:09.680 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:09 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:09.680 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:09 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:09.680 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:09 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:09.680 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:09 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:09.680 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:09 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:09.680 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:09 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:09.680 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:09 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:09.680 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:09 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:09.680 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:09 smithi119 ceph-mon[34833]: Deploying daemon mds.l on smithi119 2024-09-21T05:51:09.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:09 smithi027 ceph-mon[34364]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:09.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:09 smithi027 ceph-mon[34364]: from='client.24625 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi027=b;smithi027=e;smithi027=h;smithi027=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:09.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:09 smithi027 ceph-mon[34364]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi027=b;smithi027=e;smithi027=h;smithi027=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2024-09-21T05:51:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:09 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:09 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:09 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:09 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:09 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:09 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:09 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:09 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:09.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:09 smithi027 ceph-mon[34364]: Deploying daemon mds.l on smithi119 2024-09-21T05:51:09.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:09 smithi007 ceph-mon[30983]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:09.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:09 smithi007 ceph-mon[30983]: from='client.24625 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi027=b;smithi027=e;smithi027=h;smithi027=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:09 smithi007 ceph-mon[30983]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi027=b;smithi027=e;smithi027=h;smithi027=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2024-09-21T05:51:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:09.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:09 smithi007 ceph-mon[30983]: Deploying daemon mds.l on smithi119 2024-09-21T05:51:09.834 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:10.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.280+0000 7f0d5f033640 1 -- 172.21.15.7:0/2813039095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d58102a70 msgr2=0x7f0d58102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:10.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.280+0000 7f0d5f033640 1 --2- 172.21.15.7:0/2813039095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d58102a70 0x7f0d58102e80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009900 tx=0x7f0d4c02a410 comp rx=0 tx=0).stop 2024-09-21T05:51:10.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.280+0000 7f0d5f033640 1 -- 172.21.15.7:0/2813039095 shutdown_connections 2024-09-21T05:51:10.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.280+0000 7f0d5f033640 1 --2- 172.21.15.7:0/2813039095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d58108d00 0x7f0d5810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.280+0000 7f0d5f033640 1 --2- 172.21.15.7:0/2813039095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d581083b0 0x7f0d581087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.280+0000 7f0d5f033640 1 --2- 172.21.15.7:0/2813039095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d58102a70 0x7f0d58102e80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.280+0000 7f0d5f033640 1 -- 172.21.15.7:0/2813039095 >> 172.21.15.7:0/2813039095 conn(0x7f0d58079710 msgr2=0x7f0d58079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:10.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.280+0000 7f0d5f033640 1 -- 172.21.15.7:0/2813039095 shutdown_connections 2024-09-21T05:51:10.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.280+0000 7f0d5f033640 1 -- 172.21.15.7:0/2813039095 wait complete. 2024-09-21T05:51:10.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.280+0000 7f0d5f033640 1 Processor -- start 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5f033640 1 -- start start 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5f033640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d58102a70 0x7f0d5819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5f033640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d581083b0 0x7f0d5819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5f033640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d58108d00 0x7f0d5819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5f033640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0d58112a20 con 0x7f0d58102a70 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5f033640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0d581128a0 con 0x7f0d581083b0 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5f033640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d58112ba0 con 0x7f0d58108d00 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5cdcf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d58102a70 0x7f0d5819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5cdcf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d58102a70 0x7f0d5819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39074/0 (socket says 172.21.15.7:39074) 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5cdcf640 1 -- 172.21.15.7:0/1387721090 learned_addr learned my addr 172.21.15.7:0/1387721090 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d57fff640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d581083b0 0x7f0d5819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5d5d0640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d58108d00 0x7f0d5819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5cdcf640 1 -- 172.21.15.7:0/1387721090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d58108d00 msgr2=0x7f0d5819fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5cdcf640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d58108d00 0x7f0d5819fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5cdcf640 1 -- 172.21.15.7:0/1387721090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d581083b0 msgr2=0x7f0d5819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5cdcf640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d581083b0 0x7f0d5819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5cdcf640 1 -- 172.21.15.7:0/1387721090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d581a0530 con 0x7f0d58102a70 2024-09-21T05:51:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.281+0000 7f0d5d5d0640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d58108d00 0x7f0d5819fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:51:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.282+0000 7f0d5cdcf640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d58102a70 0x7f0d5819a5c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c005940 tx=0x7f0d4c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.282+0000 7f0d55ffb640 1 -- 172.21.15.7:0/1387721090 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c03f030 con 0x7f0d58102a70 2024-09-21T05:51:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.282+0000 7f0d5f033640 1 -- 172.21.15.7:0/1387721090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d581a07c0 con 0x7f0d58102a70 2024-09-21T05:51:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.282+0000 7f0d55ffb640 1 -- 172.21.15.7:0/1387721090 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d4c003cb0 con 0x7f0d58102a70 2024-09-21T05:51:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.282+0000 7f0d55ffb640 1 -- 172.21.15.7:0/1387721090 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c035070 con 0x7f0d58102a70 2024-09-21T05:51:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.282+0000 7f0d5f033640 1 -- 172.21.15.7:0/1387721090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d581a6f80 con 0x7f0d58102a70 2024-09-21T05:51:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.283+0000 7f0d5f033640 1 -- 172.21.15.7:0/1387721090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d58103cf0 con 0x7f0d58102a70 2024-09-21T05:51:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.285+0000 7f0d55ffb640 1 -- 172.21.15.7:0/1387721090 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f0d4c042030 con 0x7f0d58102a70 2024-09-21T05:51:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.285+0000 7f0d55ffb640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d480b65e0 0x7f0d480b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.285+0000 7f0d57fff640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d480b65e0 0x7f0d480b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.286+0000 7f0d55ffb640 1 -- 172.21.15.7:0/1387721090 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7f0d4c1079d0 con 0x7f0d58102a70 2024-09-21T05:51:10.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.286+0000 7f0d57fff640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d480b65e0 0x7f0d480b8af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0d581048d0 tx=0x7f0d4400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:10.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.289+0000 7f0d55ffb640 1 -- 172.21.15.7:0/1387721090 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d4c0ce630 con 0x7f0d58102a70 2024-09-21T05:51:10.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.515+0000 7f0d5f033640 1 -- 172.21.15.7:0/1387721090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d5810bb40 con 0x7f0d58102a70 2024-09-21T05:51:10.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.516+0000 7f0d55ffb640 1 -- 172.21.15.7:0/1387721090 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f0d4c0d2a10 con 0x7f0d58102a70 2024-09-21T05:51:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:10.518 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":1,"btime":"2024-09-21T05:43:32:863692+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T05:51:10.518 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 1 2024-09-21T05:51:10.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.518+0000 7f0d5f033640 1 -- 172.21.15.7:0/1387721090 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d480b65e0 msgr2=0x7f0d480b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:10.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.518+0000 7f0d5f033640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d480b65e0 0x7f0d480b8af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0d581048d0 tx=0x7f0d4400b390 comp rx=0 tx=0).stop 2024-09-21T05:51:10.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.518+0000 7f0d5f033640 1 -- 172.21.15.7:0/1387721090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d58102a70 msgr2=0x7f0d5819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:10.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.518+0000 7f0d5f033640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d58102a70 0x7f0d5819a5c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c005940 tx=0x7f0d4c0042f0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.518+0000 7f0d5f033640 1 -- 172.21.15.7:0/1387721090 shutdown_connections 2024-09-21T05:51:10.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.518+0000 7f0d5f033640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d480b65e0 0x7f0d480b8af0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.518+0000 7f0d5f033640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d58108d00 0x7f0d5819fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.518+0000 7f0d5f033640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d581083b0 0x7f0d5819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.518+0000 7f0d5f033640 1 --2- 172.21.15.7:0/1387721090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d58102a70 0x7f0d5819a5c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.518+0000 7f0d5f033640 1 -- 172.21.15.7:0/1387721090 >> 172.21.15.7:0/1387721090 conn(0x7f0d58079710 msgr2=0x7f0d58101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.518+0000 7f0d5f033640 1 -- 172.21.15.7:0/1387721090 shutdown_connections 2024-09-21T05:51:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:10.518+0000 7f0d5f033640 1 -- 172.21.15.7:0/1387721090 wait complete. 2024-09-21T05:51:10.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:10 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1387721090' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:10.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:10 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1387721090' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:10.969 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 05:51:10 smithi119 systemd[1]: Starting Ceph mds.l for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:51:10.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:10 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1387721090' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:11.229 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 05:51:10 smithi119 podman[63860]: 2024-09-21 05:51:10.967352201 +0000 UTC m=+0.105123934 container create 1509638beea9980ae404427b12f25a8c94f22cbe1b8e2640e847b552f3d79d57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T05:51:11.229 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 05:51:10 smithi119 podman[63860]: 2024-09-21 05:51:10.877794962 +0000 UTC m=+0.015566709 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:51:11.229 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 05:51:11 smithi119 podman[63860]: 2024-09-21 05:51:11.228012992 +0000 UTC m=+0.365784724 container init 1509638beea9980ae404427b12f25a8c94f22cbe1b8e2640e847b552f3d79d57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-l, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-09-21T05:51:11.544 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 05:51:11 smithi119 podman[63860]: 2024-09-21 05:51:11.231047305 +0000 UTC m=+0.368819036 container start 1509638beea9980ae404427b12f25a8c94f22cbe1b8e2640e847b552f3d79d57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T05:51:11.544 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 05:51:11 smithi119 ceph-mds[63879]: -- 172.21.15.119:0/2130371643 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56062d59f860 con 0x560631747180 2024-09-21T05:51:11.544 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 05:51:11 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-l[63875]: starting mds.l at 2024-09-21T05:51:11.544 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 05:51:11 smithi119 bash[63860]: 1509638beea9980ae404427b12f25a8c94f22cbe1b8e2640e847b552f3d79d57 2024-09-21T05:51:11.544 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 05:51:11 smithi119 systemd[1]: Started Ceph mds.l for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:51:11.811 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:11 smithi027 ceph-mon[34364]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:11.811 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:11 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.119:6832/1234076482,v1:172.21.15.119:6833/1234076482] up:boot 2024-09-21T05:51:11.811 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:11 smithi027 ceph-mon[34364]: fsmap 1 up:standby 2024-09-21T05:51:11.811 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:11 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T05:51:11.811 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:11 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:11.811 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:11 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:11.811 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:11 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:11.811 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:11 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:11.811 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:11 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:11.811 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:11 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:11.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:11 smithi007 ceph-mon[30983]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:11 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.119:6832/1234076482,v1:172.21.15.119:6833/1234076482] up:boot 2024-09-21T05:51:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:11 smithi007 ceph-mon[30983]: fsmap 1 up:standby 2024-09-21T05:51:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T05:51:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:11.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:11 smithi119 ceph-mon[34833]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:11 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.119:6832/1234076482,v1:172.21.15.119:6833/1234076482] up:boot 2024-09-21T05:51:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:11 smithi119 ceph-mon[34833]: fsmap 1 up:standby 2024-09-21T05:51:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:11 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T05:51:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:11 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:11 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:11 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:11 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:11 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:11 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:12.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:12 smithi007 ceph-mon[30983]: Deploying daemon mds.k on smithi027 2024-09-21T05:51:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:12 smithi119 ceph-mon[34833]: Deploying daemon mds.k on smithi027 2024-09-21T05:51:12.884 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:12 smithi027 ceph-mon[34364]: Deploying daemon mds.k on smithi027 2024-09-21T05:51:13.226 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 05:51:13 smithi027 systemd[1]: Starting Ceph mds.k for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:51:13.289 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:51:13.560 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:13.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:13 smithi007 ceph-mon[30983]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:13.571 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:13 smithi027 ceph-mon[34364]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:13.571 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 05:51:13 smithi027 podman[61900]: 2024-09-21 05:51:13.219548404 +0000 UTC m=+0.016356256 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:51:13.571 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 05:51:13 smithi027 podman[61900]: 2024-09-21 05:51:13.342394813 +0000 UTC m=+0.139202695 container create 7821dfe3d882303147fb99f73db412d1cc4053d23a01081de6f5dafad61cb3db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-k, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T05:51:13.571 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 05:51:13 smithi027 podman[61900]: 2024-09-21 05:51:13.569931604 +0000 UTC m=+0.366739444 container init 7821dfe3d882303147fb99f73db412d1cc4053d23a01081de6f5dafad61cb3db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-k, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T05:51:13.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:13 smithi119 ceph-mon[34833]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:13.976 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 05:51:13 smithi027 podman[61900]: 2024-09-21 05:51:13.573165374 +0000 UTC m=+0.369973223 container start 7821dfe3d882303147fb99f73db412d1cc4053d23a01081de6f5dafad61cb3db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-k, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T05:51:13.977 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 05:51:13 smithi027 ceph-mds[61920]: -- 172.21.15.27:0/2218870959 <== mon.2 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55766d985860 con 0x557671b2d180 2024-09-21T05:51:13.977 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 05:51:13 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-k[61916]: starting mds.k at 2024-09-21T05:51:13.977 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 05:51:13 smithi027 bash[61900]: 7821dfe3d882303147fb99f73db412d1cc4053d23a01081de6f5dafad61cb3db 2024-09-21T05:51:13.977 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 05:51:13 smithi027 systemd[1]: Started Ceph mds.k for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:51:14.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:13.998+0000 7f7e8870d640 1 -- 172.21.15.7:0/4131145240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e80109e10 msgr2=0x7f7e80110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:14.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:13.998+0000 7f7e8870d640 1 --2- 172.21.15.7:0/4131145240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e80109e10 0x7f7e80110640 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009ca0 tx=0x7f7e7802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:14.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:13.999+0000 7f7e8870d640 1 -- 172.21.15.7:0/4131145240 shutdown_connections 2024-09-21T05:51:14.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:13.999+0000 7f7e8870d640 1 --2- 172.21.15.7:0/4131145240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e80109e10 0x7f7e80110640 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:14.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:13.999+0000 7f7e8870d640 1 --2- 172.21.15.7:0/4131145240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e801094c0 0x7f7e801098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:13.999+0000 7f7e8870d640 1 --2- 172.21.15.7:0/4131145240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e80103b80 0x7f7e80103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:13.999+0000 7f7e8870d640 1 -- 172.21.15.7:0/4131145240 >> 172.21.15.7:0/4131145240 conn(0x7f7e800ff5d0 msgr2=0x7f7e80101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:13.999+0000 7f7e8870d640 1 -- 172.21.15.7:0/4131145240 shutdown_connections 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:13.999+0000 7f7e8870d640 1 -- 172.21.15.7:0/4131145240 wait complete. 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:13.999+0000 7f7e8870d640 1 Processor -- start 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:13.999+0000 7f7e8870d640 1 -- start start 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e8870d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e80103b80 0x7f7e80075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e8870d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e801094c0 0x7f7e80075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e8870d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e80109e10 0x7f7e80076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e8870d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7e80113ad0 con 0x7f7e801094c0 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e8870d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7e80113950 con 0x7f7e80103b80 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e8870d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7e80113c50 con 0x7f7e80109e10 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e85ca8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e801094c0 0x7f7e80075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e864a9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e80103b80 0x7f7e80075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e85ca8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e801094c0 0x7f7e80075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39094/0 (socket says 172.21.15.7:39094) 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e864a9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e80103b80 0x7f7e80075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:56344/0 (socket says 172.21.15.7:56344) 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e85ca8640 1 -- 172.21.15.7:0/3850479681 learned_addr learned my addr 172.21.15.7:0/3850479681 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e86caa640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e80109e10 0x7f7e80076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e85ca8640 1 -- 172.21.15.7:0/3850479681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e80109e10 msgr2=0x7f7e80076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e85ca8640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e80109e10 0x7f7e80076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e85ca8640 1 -- 172.21.15.7:0/3850479681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e80103b80 msgr2=0x7f7e80075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e85ca8640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e80103b80 0x7f7e80075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e85ca8640 1 -- 172.21.15.7:0/3850479681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e801a8650 con 0x7f7e801094c0 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e86caa640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e80109e10 0x7f7e80076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e864a9640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e80103b80 0x7f7e80075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.000+0000 7f7e85ca8640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e801094c0 0x7f7e80075c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000c8c0 tx=0x7f7e7000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.001+0000 7f7e777fe640 1 -- 172.21.15.7:0/3850479681 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70007bb0 con 0x7f7e801094c0 2024-09-21T05:51:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.001+0000 7f7e777fe640 1 -- 172.21.15.7:0/3850479681 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e70007d50 con 0x7f7e801094c0 2024-09-21T05:51:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.001+0000 7f7e777fe640 1 -- 172.21.15.7:0/3850479681 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e700187c0 con 0x7f7e801094c0 2024-09-21T05:51:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.001+0000 7f7e8870d640 1 -- 172.21.15.7:0/3850479681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e801a8940 con 0x7f7e801094c0 2024-09-21T05:51:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.001+0000 7f7e8870d640 1 -- 172.21.15.7:0/3850479681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e801a8e30 con 0x7f7e801094c0 2024-09-21T05:51:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.002+0000 7f7e8870d640 1 -- 172.21.15.7:0/3850479681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e80103f90 con 0x7f7e801094c0 2024-09-21T05:51:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.004+0000 7f7e777fe640 1 -- 172.21.15.7:0/3850479681 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f7e7000fa20 con 0x7f7e801094c0 2024-09-21T05:51:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.005+0000 7f7e777fe640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e6c0b6560 0x7f7e6c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.005+0000 7f7e864a9640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e6c0b6560 0x7f7e6c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.005+0000 7f7e777fe640 1 -- 172.21.15.7:0/3850479681 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7f7e700e7310 con 0x7f7e801094c0 2024-09-21T05:51:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.005+0000 7f7e864a9640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e6c0b6560 0x7f7e6c0b8a70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e80077160 tx=0x7f7e7c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.008+0000 7f7e777fe640 1 -- 172.21.15.7:0/3850479681 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7e70014030 con 0x7f7e801094c0 2024-09-21T05:51:14.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.259+0000 7f7e8870d640 1 -- 172.21.15.7:0/3850479681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e80076a10 con 0x7f7e801094c0 2024-09-21T05:51:14.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.259+0000 7f7e777fe640 1 -- 172.21.15.7:0/3850479681 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f7e700ae000 con 0x7f7e801094c0 2024-09-21T05:51:14.262 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:14.262 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":2,"btime":"2024-09-21T05:51:11:269044+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24637,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T05:51:14.262 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 2 2024-09-21T05:51:14.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.262+0000 7f7e8870d640 1 -- 172.21.15.7:0/3850479681 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e6c0b6560 msgr2=0x7f7e6c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:14.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.262+0000 7f7e8870d640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e6c0b6560 0x7f7e6c0b8a70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e80077160 tx=0x7f7e7c005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:14.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.262+0000 7f7e8870d640 1 -- 172.21.15.7:0/3850479681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e801094c0 msgr2=0x7f7e80075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:14.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.262+0000 7f7e8870d640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e801094c0 0x7f7e80075c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000c8c0 tx=0x7f7e7000cd80 comp rx=0 tx=0).stop 2024-09-21T05:51:14.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.262+0000 7f7e8870d640 1 -- 172.21.15.7:0/3850479681 shutdown_connections 2024-09-21T05:51:14.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.262+0000 7f7e8870d640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e6c0b6560 0x7f7e6c0b8a70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:14.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.262+0000 7f7e8870d640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e801094c0 0x7f7e80075c50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:14.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.262+0000 7f7e8870d640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e80109e10 0x7f7e80076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:14.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.262+0000 7f7e8870d640 1 --2- 172.21.15.7:0/3850479681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e80103b80 0x7f7e80075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:14.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.262+0000 7f7e8870d640 1 -- 172.21.15.7:0/3850479681 >> 172.21.15.7:0/3850479681 conn(0x7f7e800ff5d0 msgr2=0x7f7e801019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:14.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.262+0000 7f7e8870d640 1 -- 172.21.15.7:0/3850479681 shutdown_connections 2024-09-21T05:51:14.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:14.262+0000 7f7e8870d640 1 -- 172.21.15.7:0/3850479681 wait complete. 2024-09-21T05:51:15.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:14 smithi007 ceph-mon[30983]: Deploying daemon mds.j on smithi007 2024-09-21T05:51:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:14 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3850479681' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:14 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.27:6832/3377430896,v1:172.21.15.27:6833/3377430896] up:boot 2024-09-21T05:51:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:14 smithi007 ceph-mon[30983]: fsmap 2 up:standby 2024-09-21T05:51:15.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T05:51:15.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:14 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:15.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:14 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:15.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:14 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:15.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:14 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:15.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:14 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:15.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:14 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:15.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:14 smithi119 ceph-mon[34833]: Deploying daemon mds.j on smithi007 2024-09-21T05:51:15.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:14 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3850479681' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:15.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:14 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.27:6832/3377430896,v1:172.21.15.27:6833/3377430896] up:boot 2024-09-21T05:51:15.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:14 smithi119 ceph-mon[34833]: fsmap 2 up:standby 2024-09-21T05:51:15.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:14 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T05:51:15.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:14 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:15.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:14 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:15.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:14 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:15.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:14 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:15.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:14 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:15.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:14 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:15.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:14 smithi027 ceph-mon[34364]: Deploying daemon mds.j on smithi007 2024-09-21T05:51:15.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:14 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3850479681' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:15.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:14 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.27:6832/3377430896,v1:172.21.15.27:6833/3377430896] up:boot 2024-09-21T05:51:15.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:14 smithi027 ceph-mon[34364]: fsmap 2 up:standby 2024-09-21T05:51:15.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:14 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T05:51:15.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:15 smithi007 ceph-mon[30983]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:16.021 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:15 smithi027 ceph-mon[34364]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:16.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:15 smithi119 ceph-mon[34833]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:16.297 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 05:51:16 smithi007 systemd[1]: Starting Ceph mds.j for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:51:16.551 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 05:51:16 smithi007 podman[71964]: 2024-09-21 05:51:16.295228319 +0000 UTC m=+0.099349522 container create d7598d5edaafc33afa17e6bba6504f97fdc88b1e05e9f0bad4dc533ffdc73877 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T05:51:16.551 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 05:51:16 smithi007 podman[71964]: 2024-09-21 05:51:16.212247712 +0000 UTC m=+0.016368852 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:51:16.551 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 05:51:16 smithi007 podman[71964]: 2024-09-21 05:51:16.455975299 +0000 UTC m=+0.260096436 container init d7598d5edaafc33afa17e6bba6504f97fdc88b1e05e9f0bad4dc533ffdc73877 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:51:16.552 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 05:51:16 smithi007 podman[71964]: 2024-09-21 05:51:16.458904481 +0000 UTC m=+0.263025619 container start d7598d5edaafc33afa17e6bba6504f97fdc88b1e05e9f0bad4dc533ffdc73877 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:51:16.552 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 05:51:16 smithi007 ceph-mds[71983]: -- 172.21.15.7:0/2087846162 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aae80fb860 con 0x55aaec2a3180 2024-09-21T05:51:16.552 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 05:51:16 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-j[71979]: starting mds.j at 2024-09-21T05:51:16.552 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 05:51:16 smithi007 bash[71964]: d7598d5edaafc33afa17e6bba6504f97fdc88b1e05e9f0bad4dc533ffdc73877 2024-09-21T05:51:16.818 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 05:51:16 smithi007 systemd[1]: Started Ceph mds.j for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:51:17.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:17 smithi027 ceph-mon[34364]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:17.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:17 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:17.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:17 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:17.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:17 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:17.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:17 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:17.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:17 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:17.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:17 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:17.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:17 smithi027 ceph-mon[34364]: Deploying daemon mds.d on smithi007 2024-09-21T05:51:17.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:17 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.7:6834/806638499,v1:172.21.15.7:6835/806638499] up:boot 2024-09-21T05:51:17.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:17 smithi027 ceph-mon[34364]: fsmap 3 up:standby 2024-09-21T05:51:17.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:17 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T05:51:18.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:51:18.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:17 smithi007 ceph-mon[30983]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:18.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:17 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:18.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:17 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:18.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:17 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:18.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:17 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:18.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:17 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:18.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:17 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:18.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:17 smithi007 ceph-mon[30983]: Deploying daemon mds.d on smithi007 2024-09-21T05:51:18.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:17 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.7:6834/806638499,v1:172.21.15.7:6835/806638499] up:boot 2024-09-21T05:51:18.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:17 smithi007 ceph-mon[30983]: fsmap 3 up:standby 2024-09-21T05:51:18.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:17 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T05:51:18.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:17 smithi119 ceph-mon[34833]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:18.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:17 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:18.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:17 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:18.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:17 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:18.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:17 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:18.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:17 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:18.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:17 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:18.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:17 smithi119 ceph-mon[34833]: Deploying daemon mds.d on smithi007 2024-09-21T05:51:18.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:17 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.7:6834/806638499,v1:172.21.15.7:6835/806638499] up:boot 2024-09-21T05:51:18.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:17 smithi119 ceph-mon[34833]: fsmap 3 up:standby 2024-09-21T05:51:18.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:17 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T05:51:18.288 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.808+0000 7f5bffd9b640 1 -- 172.21.15.7:0/3359480910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf8102a60 msgr2=0x7f5bf8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.808+0000 7f5bffd9b640 1 --2- 172.21.15.7:0/3359480910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf8102a60 0x7f5bf8102e70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009900 tx=0x7f5bf402a410 comp rx=0 tx=0).stop 2024-09-21T05:51:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.808+0000 7f5bffd9b640 1 -- 172.21.15.7:0/3359480910 shutdown_connections 2024-09-21T05:51:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.808+0000 7f5bffd9b640 1 --2- 172.21.15.7:0/3359480910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5bf8108cf0 0x7f5bf810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.808+0000 7f5bffd9b640 1 --2- 172.21.15.7:0/3359480910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bf81083a0 0x7f5bf81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.808+0000 7f5bffd9b640 1 --2- 172.21.15.7:0/3359480910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf8102a60 0x7f5bf8102e70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.808+0000 7f5bffd9b640 1 -- 172.21.15.7:0/3359480910 >> 172.21.15.7:0/3359480910 conn(0x7f5bf8079730 msgr2=0x7f5bf8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.808+0000 7f5bffd9b640 1 -- 172.21.15.7:0/3359480910 shutdown_connections 2024-09-21T05:51:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.808+0000 7f5bffd9b640 1 -- 172.21.15.7:0/3359480910 wait complete. 2024-09-21T05:51:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.809+0000 7f5bffd9b640 1 Processor -- start 2024-09-21T05:51:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.809+0000 7f5bffd9b640 1 -- start start 2024-09-21T05:51:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.809+0000 7f5bffd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf8102a60 0x7f5bf819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.809+0000 7f5bffd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bf81083a0 0x7f5bf819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.809+0000 7f5bffd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5bf8108cf0 0x7f5bf819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.809+0000 7f5bffd9b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8113a80 con 0x7f5bf8102a60 2024-09-21T05:51:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.809+0000 7f5bffd9b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8113900 con 0x7f5bf81083a0 2024-09-21T05:51:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.809+0000 7f5bffd9b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8113c00 con 0x7f5bf8108cf0 2024-09-21T05:51:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.809+0000 7f5bfdb37640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf8102a60 0x7f5bf819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.809+0000 7f5bfdb37640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf8102a60 0x7f5bf819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39164/0 (socket says 172.21.15.7:39164) 2024-09-21T05:51:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.809+0000 7f5bfdb37640 1 -- 172.21.15.7:0/1061041239 learned_addr learned my addr 172.21.15.7:0/1061041239 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5bfd336640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bf81083a0 0x7f5bf819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5bfe338640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5bf8108cf0 0x7f5bf819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5bfdb37640 1 -- 172.21.15.7:0/1061041239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5bf8108cf0 msgr2=0x7f5bf819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5bfdb37640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5bf8108cf0 0x7f5bf819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5bfdb37640 1 -- 172.21.15.7:0/1061041239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bf81083a0 msgr2=0x7f5bf819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5bfdb37640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bf81083a0 0x7f5bf819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5bfdb37640 1 -- 172.21.15.7:0/1061041239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf81a0320 con 0x7f5bf8102a60 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5bfe338640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5bf8108cf0 0x7f5bf819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5bfdb37640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf8102a60 0x7f5bf819a470 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4006010 tx=0x7f5bf40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5beaffd640 1 -- 172.21.15.7:0/1061041239 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf403f030 con 0x7f5bf8102a60 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5beaffd640 1 -- 172.21.15.7:0/1061041239 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bf4003800 con 0x7f5bf8102a60 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5bffd9b640 1 -- 172.21.15.7:0/1061041239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf81a05b0 con 0x7f5bf8102a60 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5beaffd640 1 -- 172.21.15.7:0/1061041239 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4035070 con 0x7f5bf8102a60 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.810+0000 7f5bffd9b640 1 -- 172.21.15.7:0/1061041239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf81a0ae0 con 0x7f5bf8102a60 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.812+0000 7f5bffd9b640 1 -- 172.21.15.7:0/1061041239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf8102e70 con 0x7f5bf8102a60 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.813+0000 7f5beaffd640 1 -- 172.21.15.7:0/1061041239 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f5bf4003cb0 con 0x7f5bf8102a60 2024-09-21T05:51:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.814+0000 7f5beaffd640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5be40b6610 0x7f5be40b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:18.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.814+0000 7f5bfd336640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5be40b6610 0x7f5be40b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:18.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.814+0000 7f5beaffd640 1 -- 172.21.15.7:0/1061041239 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7f5bf4107910 con 0x7f5bf8102a60 2024-09-21T05:51:18.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.814+0000 7f5bfd336640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5be40b6610 0x7f5be40b8b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5bec005e10 tx=0x7f5bec005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:18.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:18.818+0000 7f5beaffd640 1 -- 172.21.15.7:0/1061041239 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5bf81a0ae0 con 0x7f5bf8102a60 2024-09-21T05:51:19.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.059+0000 7f5bffd9b640 1 -- 172.21.15.7:0/1061041239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5bf819b5a0 con 0x7f5bf8102a60 2024-09-21T05:51:19.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.059+0000 7f5beaffd640 1 -- 172.21.15.7:0/1061041239 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7f5bf40ce570 con 0x7f5bf8102a60 2024-09-21T05:51:19.062 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:19.062 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":4,"btime":"2024-09-21T05:51:16:753606+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24637,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T05:51:19.062 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 4 2024-09-21T05:51:19.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.061+0000 7f5bffd9b640 1 -- 172.21.15.7:0/1061041239 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5be40b6610 msgr2=0x7f5be40b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:19.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.061+0000 7f5bffd9b640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5be40b6610 0x7f5be40b8b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5bec005e10 tx=0x7f5bec005da0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.061+0000 7f5bffd9b640 1 -- 172.21.15.7:0/1061041239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf8102a60 msgr2=0x7f5bf819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:19.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.061+0000 7f5bffd9b640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf8102a60 0x7f5bf819a470 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4006010 tx=0x7f5bf40042f0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.061+0000 7f5bffd9b640 1 -- 172.21.15.7:0/1061041239 shutdown_connections 2024-09-21T05:51:19.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.061+0000 7f5bffd9b640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5be40b6610 0x7f5be40b8b20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.061+0000 7f5bffd9b640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5bf8108cf0 0x7f5bf819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.061+0000 7f5bffd9b640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bf81083a0 0x7f5bf819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.061+0000 7f5bffd9b640 1 --2- 172.21.15.7:0/1061041239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bf8102a60 0x7f5bf819a470 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.062+0000 7f5bffd9b640 1 -- 172.21.15.7:0/1061041239 >> 172.21.15.7:0/1061041239 conn(0x7f5bf8079730 msgr2=0x7f5bf81013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:19.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.062+0000 7f5bffd9b640 1 -- 172.21.15.7:0/1061041239 shutdown_connections 2024-09-21T05:51:19.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:19.062+0000 7f5bffd9b640 1 -- 172.21.15.7:0/1061041239 wait complete. 2024-09-21T05:51:19.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:19 smithi007 ceph-mon[30983]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:19.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:19 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1061041239' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:19.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:19 smithi027 ceph-mon[34364]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:19.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:19 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1061041239' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:20.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:19 smithi119 ceph-mon[34833]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:20.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:19 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1061041239' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:20.318 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 05:51:19 smithi007 systemd[1]: Started Ceph mds.d for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:51:21.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:21.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:21.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:21.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:21.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:21.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:21.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:21 smithi007 ceph-mon[30983]: Deploying daemon mds.e on smithi027 2024-09-21T05:51:21.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:21 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.7:6836/3313125359,v1:172.21.15.7:6837/3313125359] up:boot 2024-09-21T05:51:21.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:21 smithi007 ceph-mon[30983]: fsmap 4 up:standby 2024-09-21T05:51:21.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T05:51:21.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:21.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:21.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:21.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:21.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:21.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:21.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:21 smithi119 ceph-mon[34833]: Deploying daemon mds.e on smithi027 2024-09-21T05:51:21.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:21 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.7:6836/3313125359,v1:172.21.15.7:6837/3313125359] up:boot 2024-09-21T05:51:21.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:21 smithi119 ceph-mon[34833]: fsmap 4 up:standby 2024-09-21T05:51:21.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:21 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T05:51:21.395 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:21.395 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:21.395 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:21.395 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:21.395 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:21.395 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:21.395 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:21 smithi027 ceph-mon[34364]: Deploying daemon mds.e on smithi027 2024-09-21T05:51:21.396 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:21 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.7:6836/3313125359,v1:172.21.15.7:6837/3313125359] up:boot 2024-09-21T05:51:21.396 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:21 smithi027 ceph-mon[34364]: fsmap 4 up:standby 2024-09-21T05:51:21.396 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:21 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T05:51:21.763 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:51:21.976 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 05:51:21 smithi027 systemd[1]: Starting Ceph mds.e for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:51:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:22.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:22 smithi007 ceph-mon[30983]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:22.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:22 smithi119 ceph-mon[34833]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:22.391 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:22 smithi027 ceph-mon[34364]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:22.391 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 05:51:22 smithi027 podman[62185]: 2024-09-21 05:51:22.071124345 +0000 UTC m=+0.105877922 container create 083fb9d6ae63481d03dba2f0383963f40a7a745df0af26e500fb162bf15bc567 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T05:51:22.391 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 05:51:22 smithi027 podman[62185]: 2024-09-21 05:51:21.98220713 +0000 UTC m=+0.016960710 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:51:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.647+0000 7f3bad598640 1 -- 172.21.15.7:0/3006866054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ba8109df0 msgr2=0x7f3ba8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.647+0000 7f3bad598640 1 --2- 172.21.15.7:0/3006866054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ba8109df0 0x7f3ba8110620 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0009ca0 tx=0x7f3ba002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.647+0000 7f3bad598640 1 -- 172.21.15.7:0/3006866054 shutdown_connections 2024-09-21T05:51:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.647+0000 7f3bad598640 1 --2- 172.21.15.7:0/3006866054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ba8109df0 0x7f3ba8110620 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.647+0000 7f3bad598640 1 --2- 172.21.15.7:0/3006866054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba81094a0 0x7f3ba81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.647+0000 7f3bad598640 1 --2- 172.21.15.7:0/3006866054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba8103b60 0x7f3ba8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.647+0000 7f3bad598640 1 -- 172.21.15.7:0/3006866054 >> 172.21.15.7:0/3006866054 conn(0x7f3ba807b850 msgr2=0x7f3ba807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.647+0000 7f3bad598640 1 -- 172.21.15.7:0/3006866054 shutdown_connections 2024-09-21T05:51:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.647+0000 7f3bad598640 1 -- 172.21.15.7:0/3006866054 wait complete. 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.647+0000 7f3bad598640 1 Processor -- start 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3bad598640 1 -- start start 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3bad598640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ba8103b60 0x7f3ba8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3bad598640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba81094a0 0x7f3ba8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3bad598640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba8109df0 0x7f3ba8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3bad598640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba8113ab0 con 0x7f3ba8103b60 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3bad598640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba8113930 con 0x7f3ba8109df0 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3bad598640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba8113c30 con 0x7f3ba81094a0 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3ba6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ba8103b60 0x7f3ba8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3ba6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ba8103b60 0x7f3ba8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39206/0 (socket says 172.21.15.7:39206) 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3ba6ffd640 1 -- 172.21.15.7:0/998158116 learned_addr learned my addr 172.21.15.7:0/998158116 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3ba77fe640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba8109df0 0x7f3ba8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3ba67fc640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba81094a0 0x7f3ba8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3ba6ffd640 1 -- 172.21.15.7:0/998158116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba81094a0 msgr2=0x7f3ba8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3ba6ffd640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba81094a0 0x7f3ba8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3ba6ffd640 1 -- 172.21.15.7:0/998158116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba8109df0 msgr2=0x7f3ba8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3ba6ffd640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba8109df0 0x7f3ba8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.648+0000 7f3ba6ffd640 1 -- 172.21.15.7:0/998158116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba81a8700 con 0x7f3ba8103b60 2024-09-21T05:51:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.649+0000 7f3ba6ffd640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ba8103b60 0x7f3ba8075710 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800d950 tx=0x7f3b9800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.649+0000 7f3b8ffff640 1 -- 172.21.15.7:0/998158116 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b98017030 con 0x7f3ba8103b60 2024-09-21T05:51:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.649+0000 7f3bad598640 1 -- 172.21.15.7:0/998158116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba81a89f0 con 0x7f3ba8103b60 2024-09-21T05:51:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.649+0000 7f3b8ffff640 1 -- 172.21.15.7:0/998158116 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b98004020 con 0x7f3ba8103b60 2024-09-21T05:51:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.649+0000 7f3b8ffff640 1 -- 172.21.15.7:0/998158116 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b980047a0 con 0x7f3ba8103b60 2024-09-21T05:51:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.649+0000 7f3bad598640 1 -- 172.21.15.7:0/998158116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba81a8f80 con 0x7f3ba8103b60 2024-09-21T05:51:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.650+0000 7f3bad598640 1 -- 172.21.15.7:0/998158116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba8103f70 con 0x7f3ba8103b60 2024-09-21T05:51:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.651+0000 7f3b8ffff640 1 -- 172.21.15.7:0/998158116 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f3b98009a30 con 0x7f3ba8103b60 2024-09-21T05:51:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.652+0000 7f3b8ffff640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3b900b6560 0x7f3b900b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.652+0000 7f3ba67fc640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3b900b6560 0x7f3b900b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.652+0000 7f3b8ffff640 1 -- 172.21.15.7:0/998158116 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7f3b980e7000 con 0x7f3ba8103b60 2024-09-21T05:51:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.653+0000 7f3ba67fc640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3b900b6560 0x7f3b900b8a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8109190 tx=0x7f3b9c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.656+0000 7f3b8ffff640 1 -- 172.21.15.7:0/998158116 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b980adc60 con 0x7f3ba8103b60 2024-09-21T05:51:22.726 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 05:51:22 smithi027 podman[62185]: 2024-09-21 05:51:22.390225377 +0000 UTC m=+0.424978968 container init 083fb9d6ae63481d03dba2f0383963f40a7a745df0af26e500fb162bf15bc567 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T05:51:22.726 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 05:51:22 smithi027 podman[62185]: 2024-09-21 05:51:22.393338022 +0000 UTC m=+0.428091602 container start 083fb9d6ae63481d03dba2f0383963f40a7a745df0af26e500fb162bf15bc567 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:51:22.726 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 05:51:22 smithi027 ceph-mds[62207]: -- 172.21.15.27:0/2769754481 <== mon.2 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a8c2849860 con 0x55a8c69f1600 2024-09-21T05:51:22.726 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 05:51:22 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-e[62203]: starting mds.e at 2024-09-21T05:51:22.727 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 05:51:22 smithi027 bash[62185]: 083fb9d6ae63481d03dba2f0383963f40a7a745df0af26e500fb162bf15bc567 2024-09-21T05:51:22.727 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 05:51:22 smithi027 systemd[1]: Started Ceph mds.e for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:51:22.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.881+0000 7f3bad598640 1 -- 172.21.15.7:0/998158116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ba8076a10 con 0x7f3ba8103b60 2024-09-21T05:51:22.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.881+0000 7f3b8ffff640 1 -- 172.21.15.7:0/998158116 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3904 (secure 0 0 0) 0x7f3b980b2040 con 0x7f3ba8103b60 2024-09-21T05:51:22.883 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:22.883 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"btime":"2024-09-21T05:51:20:603406+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24637,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T05:51:22.884 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-09-21T05:51:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.884+0000 7f3bad598640 1 -- 172.21.15.7:0/998158116 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3b900b6560 msgr2=0x7f3b900b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.884+0000 7f3bad598640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3b900b6560 0x7f3b900b8a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8109190 tx=0x7f3b9c00a2d0 comp rx=0 tx=0).stop 2024-09-21T05:51:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.884+0000 7f3bad598640 1 -- 172.21.15.7:0/998158116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ba8103b60 msgr2=0x7f3ba8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.884+0000 7f3bad598640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ba8103b60 0x7f3ba8075710 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800d950 tx=0x7f3b9800de10 comp rx=0 tx=0).stop 2024-09-21T05:51:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.884+0000 7f3bad598640 1 -- 172.21.15.7:0/998158116 shutdown_connections 2024-09-21T05:51:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.884+0000 7f3bad598640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3b900b6560 0x7f3b900b8a70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.884+0000 7f3bad598640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba8109df0 0x7f3ba8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.884+0000 7f3bad598640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba81094a0 0x7f3ba8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.884+0000 7f3bad598640 1 --2- 172.21.15.7:0/998158116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ba8103b60 0x7f3ba8075710 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.884+0000 7f3bad598640 1 -- 172.21.15.7:0/998158116 >> 172.21.15.7:0/998158116 conn(0x7f3ba807b850 msgr2=0x7f3ba81074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.884+0000 7f3bad598640 1 -- 172.21.15.7:0/998158116 shutdown_connections 2024-09-21T05:51:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:22.884+0000 7f3bad598640 1 -- 172.21.15.7:0/998158116 wait complete. 2024-09-21T05:51:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:23 smithi007 ceph-mon[30983]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:23 smithi007 ceph-mon[30983]: Deploying daemon mds.f on smithi119 2024-09-21T05:51:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:23 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/998158116' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:23 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.27:6834/1038330056,v1:172.21.15.27:6835/1038330056] up:boot 2024-09-21T05:51:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:23 smithi007 ceph-mon[30983]: fsmap 5 up:standby 2024-09-21T05:51:23.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T05:51:23.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:23 smithi119 ceph-mon[34833]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:23.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:23.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:23.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:23.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:23.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:23.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:23.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:23 smithi119 ceph-mon[34833]: Deploying daemon mds.f on smithi119 2024-09-21T05:51:23.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:23 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/998158116' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:23.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:23 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.27:6834/1038330056,v1:172.21.15.27:6835/1038330056] up:boot 2024-09-21T05:51:23.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:23 smithi119 ceph-mon[34833]: fsmap 5 up:standby 2024-09-21T05:51:23.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T05:51:23.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:23 smithi027 ceph-mon[34364]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:23 smithi027 ceph-mon[34364]: Deploying daemon mds.f on smithi119 2024-09-21T05:51:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:23 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/998158116' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:23 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.27:6834/1038330056,v1:172.21.15.27:6835/1038330056] up:boot 2024-09-21T05:51:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:23 smithi027 ceph-mon[34364]: fsmap 5 up:standby 2024-09-21T05:51:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T05:51:24.592 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 05:51:24 smithi119 systemd[1]: Starting Ceph mds.f for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:51:24.907 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 05:51:24 smithi119 podman[64129]: 2024-09-21 05:51:24.540401165 +0000 UTC m=+0.016879703 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:51:24.907 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 05:51:24 smithi119 podman[64129]: 2024-09-21 05:51:24.645063043 +0000 UTC m=+0.121541638 container create 7fde12298b052c2a1778aed97d2c2436f323a4b92157a2fbd331b4cdfd4e1b21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T05:51:24.907 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 05:51:24 smithi119 podman[64129]: 2024-09-21 05:51:24.90571714 +0000 UTC m=+0.382195676 container init 7fde12298b052c2a1778aed97d2c2436f323a4b92157a2fbd331b4cdfd4e1b21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-f, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T05:51:25.342 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 05:51:24 smithi119 podman[64129]: 2024-09-21 05:51:24.909281692 +0000 UTC m=+0.385760229 container start 7fde12298b052c2a1778aed97d2c2436f323a4b92157a2fbd331b4cdfd4e1b21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-f, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:51:25.342 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 05:51:24 smithi119 ceph-mds[64148]: -- 172.21.15.119:0/1176031160 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5607306af860 con 0x560734857600 2024-09-21T05:51:25.342 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 05:51:24 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-f[64144]: starting mds.f at 2024-09-21T05:51:25.342 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 05:51:25 smithi119 bash[64129]: 7fde12298b052c2a1778aed97d2c2436f323a4b92157a2fbd331b4cdfd4e1b21 2024-09-21T05:51:25.342 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 05:51:25 smithi119 systemd[1]: Started Ceph mds.f for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:51:25.608 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:51:25.883 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:26.295 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:26 smithi007 ceph-mon[30983]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:26.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:26.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:26.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:26.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:26.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:26.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:26.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:26 smithi007 ceph-mon[30983]: Deploying daemon mds.c on smithi119 2024-09-21T05:51:26.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:26 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.119:6834/4262162696,v1:172.21.15.119:6835/4262162696] up:boot 2024-09-21T05:51:26.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:26 smithi007 ceph-mon[30983]: fsmap 6 up:standby 2024-09-21T05:51:26.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T05:51:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:26 smithi119 ceph-mon[34833]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:26 smithi119 ceph-mon[34833]: Deploying daemon mds.c on smithi119 2024-09-21T05:51:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:26 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.119:6834/4262162696,v1:172.21.15.119:6835/4262162696] up:boot 2024-09-21T05:51:26.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:26 smithi119 ceph-mon[34833]: fsmap 6 up:standby 2024-09-21T05:51:26.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:26 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T05:51:26.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.403+0000 7fa4f3909640 1 -- 172.21.15.7:0/1918363110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4ec1025d0 msgr2=0x7fa4ec1029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:26.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.403+0000 7fa4f3909640 1 --2- 172.21.15.7:0/1918363110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4ec1025d0 0x7fa4ec1029e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009900 tx=0x7fa4e802a480 comp rx=0 tx=0).stop 2024-09-21T05:51:26.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.403+0000 7fa4f3909640 1 -- 172.21.15.7:0/1918363110 shutdown_connections 2024-09-21T05:51:26.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.403+0000 7fa4f3909640 1 --2- 172.21.15.7:0/1918363110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4ec110180 0x7fa4ec1125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:26.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.403+0000 7fa4f3909640 1 --2- 172.21.15.7:0/1918363110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4ec102f20 0x7fa4ec10fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:26.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.403+0000 7fa4f3909640 1 --2- 172.21.15.7:0/1918363110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4ec1025d0 0x7fa4ec1029e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:26.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.403+0000 7fa4f3909640 1 -- 172.21.15.7:0/1918363110 >> 172.21.15.7:0/1918363110 conn(0x7fa4ec079730 msgr2=0x7fa4ec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:26.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.403+0000 7fa4f3909640 1 -- 172.21.15.7:0/1918363110 shutdown_connections 2024-09-21T05:51:26.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.403+0000 7fa4f3909640 1 -- 172.21.15.7:0/1918363110 wait complete. 2024-09-21T05:51:26.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.404+0000 7fa4f3909640 1 Processor -- start 2024-09-21T05:51:26.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.404+0000 7fa4f3909640 1 -- start start 2024-09-21T05:51:26.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.404+0000 7fa4f3909640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4ec1025d0 0x7fa4ec19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:26.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.404+0000 7fa4f3909640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4ec102f20 0x7fa4ec19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:26.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.404+0000 7fa4f3909640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4ec110180 0x7fa4ec1a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:26.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.404+0000 7fa4f3909640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec115c70 con 0x7fa4ec110180 2024-09-21T05:51:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.404+0000 7fa4f3909640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec115af0 con 0x7fa4ec102f20 2024-09-21T05:51:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.404+0000 7fa4f3909640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec115df0 con 0x7fa4ec1025d0 2024-09-21T05:51:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.404+0000 7fa4f1ea6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4ec110180 0x7fa4ec1a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.404+0000 7fa4f1ea6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4ec110180 0x7fa4ec1a1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39230/0 (socket says 172.21.15.7:39230) 2024-09-21T05:51:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.404+0000 7fa4f1ea6640 1 -- 172.21.15.7:0/660147915 learned_addr learned my addr 172.21.15.7:0/660147915 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.405+0000 7fa4f16a5640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4ec1025d0 0x7fa4ec19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.405+0000 7fa4f0ea4640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4ec102f20 0x7fa4ec19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.405+0000 7fa4f1ea6640 1 -- 172.21.15.7:0/660147915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4ec1025d0 msgr2=0x7fa4ec19c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.405+0000 7fa4f1ea6640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4ec1025d0 0x7fa4ec19c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.405+0000 7fa4f1ea6640 1 -- 172.21.15.7:0/660147915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4ec102f20 msgr2=0x7fa4ec19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.405+0000 7fa4f1ea6640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4ec102f20 0x7fa4ec19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.405+0000 7fa4f1ea6640 1 -- 172.21.15.7:0/660147915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ec1a25d0 con 0x7fa4ec110180 2024-09-21T05:51:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.405+0000 7fa4f1ea6640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4ec110180 0x7fa4ec1a1ea0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400eaa0 tx=0x7fa4e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:26.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.405+0000 7fa4e27fc640 1 -- 172.21.15.7:0/660147915 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e400cdb0 con 0x7fa4ec110180 2024-09-21T05:51:26.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.405+0000 7fa4f3909640 1 -- 172.21.15.7:0/660147915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4ec1a28c0 con 0x7fa4ec110180 2024-09-21T05:51:26.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.405+0000 7fa4e27fc640 1 -- 172.21.15.7:0/660147915 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4e4005020 con 0x7fa4ec110180 2024-09-21T05:51:26.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.405+0000 7fa4e27fc640 1 -- 172.21.15.7:0/660147915 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40116d0 con 0x7fa4ec110180 2024-09-21T05:51:26.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.406+0000 7fa4f3909640 1 -- 172.21.15.7:0/660147915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4ec1a9020 con 0x7fa4ec110180 2024-09-21T05:51:26.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.407+0000 7fa4f3909640 1 -- 172.21.15.7:0/660147915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4ec1029e0 con 0x7fa4ec110180 2024-09-21T05:51:26.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.408+0000 7fa4e27fc640 1 -- 172.21.15.7:0/660147915 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fa4e40051d0 con 0x7fa4ec110180 2024-09-21T05:51:26.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.409+0000 7fa4e27fc640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa4d80b6560 0x7fa4d80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:26.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.409+0000 7fa4f16a5640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa4d80b6560 0x7fa4d80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:26.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.409+0000 7fa4e27fc640 1 -- 172.21.15.7:0/660147915 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7fa4e40e7090 con 0x7fa4ec110180 2024-09-21T05:51:26.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.410+0000 7fa4f16a5640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa4d80b6560 0x7fa4d80b8a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8031440 tx=0x7fa4e8009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:26.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.414+0000 7fa4e27fc640 1 -- 172.21.15.7:0/660147915 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4e4016030 con 0x7fa4ec110180 2024-09-21T05:51:26.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:26 smithi027 ceph-mon[34364]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:26.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:26.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:26.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:26.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:26.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:26.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:26.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:26 smithi027 ceph-mon[34364]: Deploying daemon mds.c on smithi119 2024-09-21T05:51:26.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:26 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.119:6834/4262162696,v1:172.21.15.119:6835/4262162696] up:boot 2024-09-21T05:51:26.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:26 smithi027 ceph-mon[34364]: fsmap 6 up:standby 2024-09-21T05:51:26.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:26 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T05:51:26.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.642+0000 7fa4f3909640 1 -- 172.21.15.7:0/660147915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4ec1a9380 con 0x7fa4ec110180 2024-09-21T05:51:26.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.643+0000 7fa4e27fc640 1 -- 172.21.15.7:0/660147915 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5557 (secure 0 0 0) 0x7fa4e40b20d0 con 0x7fa4ec110180 2024-09-21T05:51:26.645 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":7,"btime":"2024-09-21T05:51:25:533227+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24667,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T05:51:26.645 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 7 2024-09-21T05:51:26.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.645+0000 7fa4f3909640 1 -- 172.21.15.7:0/660147915 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa4d80b6560 msgr2=0x7fa4d80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:26.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.645+0000 7fa4f3909640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa4d80b6560 0x7fa4d80b8a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8031440 tx=0x7fa4e8009560 comp rx=0 tx=0).stop 2024-09-21T05:51:26.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.645+0000 7fa4f3909640 1 -- 172.21.15.7:0/660147915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4ec110180 msgr2=0x7fa4ec1a1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:26.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.645+0000 7fa4f3909640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4ec110180 0x7fa4ec1a1ea0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400eaa0 tx=0x7fa4e400ef60 comp rx=0 tx=0).stop 2024-09-21T05:51:26.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.645+0000 7fa4f3909640 1 -- 172.21.15.7:0/660147915 shutdown_connections 2024-09-21T05:51:26.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.645+0000 7fa4f3909640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa4d80b6560 0x7fa4d80b8a70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:26.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.645+0000 7fa4f3909640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4ec110180 0x7fa4ec1a1ea0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:26.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.645+0000 7fa4f3909640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4ec102f20 0x7fa4ec19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:26.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.645+0000 7fa4f3909640 1 --2- 172.21.15.7:0/660147915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4ec1025d0 0x7fa4ec19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:26.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.645+0000 7fa4f3909640 1 -- 172.21.15.7:0/660147915 >> 172.21.15.7:0/660147915 conn(0x7fa4ec079730 msgr2=0x7fa4ec109cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:26.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.645+0000 7fa4f3909640 1 -- 172.21.15.7:0/660147915 shutdown_connections 2024-09-21T05:51:26.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:26.645+0000 7fa4f3909640 1 -- 172.21.15.7:0/660147915 wait complete. 2024-09-21T05:51:27.050 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 05:51:26 smithi119 systemd[1]: Starting Ceph mds.c for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:51:27.310 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:27 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/660147915' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:27.310 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 05:51:27 smithi119 podman[64398]: 2024-09-21 05:51:27.047997215 +0000 UTC m=+0.113219104 container create 0c730a46804ac24c7d8bc1c54bf66eda917a6fce4d338660e67393692a1e45b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T05:51:27.310 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 05:51:27 smithi119 podman[64398]: 2024-09-21 05:51:26.950786705 +0000 UTC m=+0.016008595 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:51:27.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:27 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/660147915' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:27.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:27 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/660147915' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:27.592 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 05:51:27 smithi119 podman[64398]: 2024-09-21 05:51:27.308653855 +0000 UTC m=+0.373875747 container init 0c730a46804ac24c7d8bc1c54bf66eda917a6fce4d338660e67393692a1e45b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T05:51:27.592 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 05:51:27 smithi119 podman[64398]: 2024-09-21 05:51:27.311429916 +0000 UTC m=+0.376651813 container start 0c730a46804ac24c7d8bc1c54bf66eda917a6fce4d338660e67393692a1e45b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T05:51:27.592 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 05:51:27 smithi119 ceph-mds[64417]: -- 172.21.15.119:0/3017053439 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bb77057860 con 0x55bb7b1ffa80 2024-09-21T05:51:27.592 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 05:51:27 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-c[64413]: starting mds.c at 2024-09-21T05:51:27.592 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 05:51:27 smithi119 bash[64398]: 0c730a46804ac24c7d8bc1c54bf66eda917a6fce4d338660e67393692a1e45b0 2024-09-21T05:51:27.592 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 05:51:27 smithi119 systemd[1]: Started Ceph mds.c for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:51:28.120 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:28 smithi027 ceph-mon[34364]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:28.120 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:28.120 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:28.120 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:28.120 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:28.121 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:28.121 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:28 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:28.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:28 smithi119 ceph-mon[34833]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:28.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:28.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:28.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:28.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:28.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:28.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:28 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:28.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:28 smithi007 ceph-mon[30983]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:28.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:28.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:28.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:28.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:28.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:28.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:28 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:29.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:29 smithi119 ceph-mon[34833]: Deploying daemon mds.h on smithi027 2024-09-21T05:51:29.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:29 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] up:boot 2024-09-21T05:51:29.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:29 smithi119 ceph-mon[34833]: fsmap 7 up:standby 2024-09-21T05:51:29.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:29 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T05:51:29.395 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:51:29.425 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:29 smithi007 ceph-mon[30983]: Deploying daemon mds.h on smithi027 2024-09-21T05:51:29.425 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:29 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] up:boot 2024-09-21T05:51:29.425 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:29 smithi007 ceph-mon[30983]: fsmap 7 up:standby 2024-09-21T05:51:29.425 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:29 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T05:51:29.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:29 smithi027 ceph-mon[34364]: Deploying daemon mds.h on smithi027 2024-09-21T05:51:29.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:29 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] up:boot 2024-09-21T05:51:29.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:29 smithi027 ceph-mon[34364]: fsmap 7 up:standby 2024-09-21T05:51:29.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:29 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T05:51:29.477 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 05:51:29 smithi027 systemd[1]: Starting Ceph mds.h for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:51:29.669 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:29.783 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 05:51:29 smithi027 podman[62458]: 2024-09-21 05:51:29.425483301 +0000 UTC m=+0.016630084 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:51:29.783 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 05:51:29 smithi027 podman[62458]: 2024-09-21 05:51:29.533424427 +0000 UTC m=+0.124571200 container create c33e1a46a8c1ed5d6bfb28099cb88d1edbb1b6db6b2cc7a730054f20689a503a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T05:51:29.783 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 05:51:29 smithi027 podman[62458]: 2024-09-21 05:51:29.744485933 +0000 UTC m=+0.335632716 container init c33e1a46a8c1ed5d6bfb28099cb88d1edbb1b6db6b2cc7a730054f20689a503a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-h, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T05:51:29.783 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 05:51:29 smithi027 podman[62458]: 2024-09-21 05:51:29.747568756 +0000 UTC m=+0.338715530 container start c33e1a46a8c1ed5d6bfb28099cb88d1edbb1b6db6b2cc7a730054f20689a503a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-h, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:51:29.784 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 05:51:29 smithi027 ceph-mds[62477]: -- 172.21.15.27:0/1733009562 <== mon.2 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ead7d1d860 con 0x55eadbec5180 2024-09-21T05:51:30.085 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 05:51:29 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-h[62473]: starting mds.h at 2024-09-21T05:51:30.085 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 05:51:29 smithi027 bash[62458]: c33e1a46a8c1ed5d6bfb28099cb88d1edbb1b6db6b2cc7a730054f20689a503a 2024-09-21T05:51:30.086 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 05:51:29 smithi027 systemd[1]: Started Ceph mds.h for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:51:30.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.177+0000 7fdc1a979640 1 -- 172.21.15.7:0/371952707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc14108d00 msgr2=0x7fdc1410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:30.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.177+0000 7fdc1a979640 1 --2- 172.21.15.7:0/371952707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc14108d00 0x7fdc1410f530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009ca0 tx=0x7fdc0c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:30.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.177+0000 7fdc1a979640 1 -- 172.21.15.7:0/371952707 shutdown_connections 2024-09-21T05:51:30.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.177+0000 7fdc1a979640 1 --2- 172.21.15.7:0/371952707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc14108d00 0x7fdc1410f530 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:30.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.177+0000 7fdc1a979640 1 --2- 172.21.15.7:0/371952707 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc141083b0 0x7fdc141087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:30.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.177+0000 7fdc1a979640 1 --2- 172.21.15.7:0/371952707 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc14102a70 0x7fdc14102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:30.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.177+0000 7fdc1a979640 1 -- 172.21.15.7:0/371952707 >> 172.21.15.7:0/371952707 conn(0x7fdc14079710 msgr2=0x7fdc14079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.177+0000 7fdc1a979640 1 -- 172.21.15.7:0/371952707 shutdown_connections 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.177+0000 7fdc1a979640 1 -- 172.21.15.7:0/371952707 wait complete. 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.178+0000 7fdc1a979640 1 Processor -- start 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.178+0000 7fdc1a979640 1 -- start start 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.178+0000 7fdc1a979640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc14102a70 0x7fdc140ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.178+0000 7fdc1a979640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc141083b0 0x7fdc140ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.178+0000 7fdc1a979640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc14108d00 0x7fdc14100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.178+0000 7fdc1a979640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdc141129c0 con 0x7fdc141083b0 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.178+0000 7fdc1a979640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fdc14112840 con 0x7fdc14108d00 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.178+0000 7fdc1a979640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdc14112b40 con 0x7fdc14102a70 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.178+0000 7fdc137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc141083b0 0x7fdc140ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.178+0000 7fdc13fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc14102a70 0x7fdc140ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.178+0000 7fdc137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc141083b0 0x7fdc140ffb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35882/0 (socket says 172.21.15.7:35882) 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.178+0000 7fdc137fe640 1 -- 172.21.15.7:0/3227322501 learned_addr learned my addr 172.21.15.7:0/3227322501 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.178+0000 7fdc18f16640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc14108d00 0x7fdc14100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.179+0000 7fdc137fe640 1 -- 172.21.15.7:0/3227322501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc14102a70 msgr2=0x7fdc140ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.179+0000 7fdc137fe640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc14102a70 0x7fdc140ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.179+0000 7fdc137fe640 1 -- 172.21.15.7:0/3227322501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc14108d00 msgr2=0x7fdc14100070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.179+0000 7fdc137fe640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc14108d00 0x7fdc14100070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.179+0000 7fdc137fe640 1 -- 172.21.15.7:0/3227322501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc141a8720 con 0x7fdc141083b0 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.179+0000 7fdc13fff640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc14102a70 0x7fdc140ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.179+0000 7fdc18f16640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc14108d00 0x7fdc14100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.179+0000 7fdc137fe640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc141083b0 0x7fdc140ffb30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800d950 tx=0x7fdc0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.179+0000 7fdc117fa640 1 -- 172.21.15.7:0/3227322501 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08017070 con 0x7fdc141083b0 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.179+0000 7fdc1a979640 1 -- 172.21.15.7:0/3227322501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc141a8a10 con 0x7fdc141083b0 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.179+0000 7fdc117fa640 1 -- 172.21.15.7:0/3227322501 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc08009c30 con 0x7fdc141083b0 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.179+0000 7fdc117fa640 1 -- 172.21.15.7:0/3227322501 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc080047a0 con 0x7fdc141083b0 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.179+0000 7fdc1a979640 1 -- 172.21.15.7:0/3227322501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc141a8f50 con 0x7fdc141083b0 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.180+0000 7fdc1a979640 1 -- 172.21.15.7:0/3227322501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc14103cf0 con 0x7fdc141083b0 2024-09-21T05:51:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.182+0000 7fdc117fa640 1 -- 172.21.15.7:0/3227322501 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fdc08004020 con 0x7fdc141083b0 2024-09-21T05:51:30.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.183+0000 7fdc117fa640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdbfc0b6560 0x7fdbfc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:30.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.183+0000 7fdc13fff640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdbfc0b6560 0x7fdbfc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:30.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.183+0000 7fdc117fa640 1 -- 172.21.15.7:0/3227322501 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7fdc080e6b40 con 0x7fdc141083b0 2024-09-21T05:51:30.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.184+0000 7fdc13fff640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdbfc0b6560 0x7fdbfc0b8a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdc14101040 tx=0x7fdc04005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:30.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.188+0000 7fdc117fa640 1 -- 172.21.15.7:0/3227322501 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc08020020 con 0x7fdc141083b0 2024-09-21T05:51:30.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:30 smithi119 ceph-mon[34833]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:30.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:30.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:30.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:30.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:30.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:30.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:30 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:30.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.412+0000 7fdc1a979640 1 -- 172.21.15.7:0/3227322501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc141008f0 con 0x7fdc141083b0 2024-09-21T05:51:30.414 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:30 smithi007 ceph-mon[30983]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:30.414 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:30.414 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:30.414 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:30.414 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:30.414 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:30.415 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:30.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.412+0000 7fdc117fa640 1 -- 172.21.15.7:0/3227322501 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7210 (secure 0 0 0) 0x7fdc080ad7a0 con 0x7fdc141083b0 2024-09-21T05:51:30.415 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:30.415 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"btime":"2024-09-21T05:51:30:083248+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24667,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T05:51:30.415 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2024-09-21T05:51:30.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.414+0000 7fdc1a979640 1 -- 172.21.15.7:0/3227322501 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdbfc0b6560 msgr2=0x7fdbfc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:30.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.414+0000 7fdc1a979640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdbfc0b6560 0x7fdbfc0b8a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdc14101040 tx=0x7fdc04005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:30.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.415+0000 7fdc1a979640 1 -- 172.21.15.7:0/3227322501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc141083b0 msgr2=0x7fdc140ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:30.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.415+0000 7fdc1a979640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc141083b0 0x7fdc140ffb30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800d950 tx=0x7fdc0800de10 comp rx=0 tx=0).stop 2024-09-21T05:51:30.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.415+0000 7fdc1a979640 1 -- 172.21.15.7:0/3227322501 shutdown_connections 2024-09-21T05:51:30.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.415+0000 7fdc1a979640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdbfc0b6560 0x7fdbfc0b8a70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:30.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.415+0000 7fdc1a979640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc141083b0 0x7fdc140ffb30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:30.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.415+0000 7fdc1a979640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc14108d00 0x7fdc14100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:30.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.415+0000 7fdc1a979640 1 --2- 172.21.15.7:0/3227322501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc14102a70 0x7fdc140ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:30.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.415+0000 7fdc1a979640 1 -- 172.21.15.7:0/3227322501 >> 172.21.15.7:0/3227322501 conn(0x7fdc14079710 msgr2=0x7fdc14101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:30.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.415+0000 7fdc1a979640 1 -- 172.21.15.7:0/3227322501 shutdown_connections 2024-09-21T05:51:30.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:30.415+0000 7fdc1a979640 1 -- 172.21.15.7:0/3227322501 wait complete. 2024-09-21T05:51:30.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:30 smithi027 ceph-mon[34364]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:30.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:30.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:30.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:30.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:30.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:30.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:30 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:31.359 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:31 smithi119 ceph-mon[34833]: Deploying daemon mds.i on smithi119 2024-09-21T05:51:31.359 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:31 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.27:6836/1469000794,v1:172.21.15.27:6837/1469000794] up:boot 2024-09-21T05:51:31.359 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:31 smithi119 ceph-mon[34833]: fsmap 8 up:standby 2024-09-21T05:51:31.359 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:31 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T05:51:31.359 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:31 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3227322501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:31.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:31 smithi027 ceph-mon[34364]: Deploying daemon mds.i on smithi119 2024-09-21T05:51:31.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:31 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.27:6836/1469000794,v1:172.21.15.27:6837/1469000794] up:boot 2024-09-21T05:51:31.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:31 smithi027 ceph-mon[34364]: fsmap 8 up:standby 2024-09-21T05:51:31.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:31 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T05:51:31.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:31 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3227322501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:31.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:31 smithi007 ceph-mon[30983]: Deploying daemon mds.i on smithi119 2024-09-21T05:51:31.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:31 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.27:6836/1469000794,v1:172.21.15.27:6837/1469000794] up:boot 2024-09-21T05:51:31.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:31 smithi007 ceph-mon[30983]: fsmap 8 up:standby 2024-09-21T05:51:31.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T05:51:31.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:31 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3227322501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:32.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:32 smithi027 ceph-mon[34364]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:32.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:32 smithi007 ceph-mon[30983]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:32.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:32 smithi119 ceph-mon[34833]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:32.592 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 21 05:51:32 smithi119 systemd[1]: Started Ceph mds.i for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:51:33.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:51:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:33 smithi119 ceph-mon[34833]: Deploying daemon mds.g on smithi007 2024-09-21T05:51:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:33 smithi119 ceph-mon[34833]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:33 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] up:boot 2024-09-21T05:51:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:33 smithi119 ceph-mon[34833]: fsmap 9 up:standby 2024-09-21T05:51:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:33 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T05:51:33.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:33.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:33 smithi027 ceph-mon[34364]: Deploying daemon mds.g on smithi007 2024-09-21T05:51:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:33 smithi027 ceph-mon[34364]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:33 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] up:boot 2024-09-21T05:51:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:33 smithi027 ceph-mon[34364]: fsmap 9 up:standby 2024-09-21T05:51:33.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:33 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T05:51:33.786 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:33.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:33.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:33.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:33.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:33.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:33.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:33 smithi007 ceph-mon[30983]: Deploying daemon mds.g on smithi007 2024-09-21T05:51:33.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:33 smithi007 ceph-mon[30983]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:33.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:33 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] up:boot 2024-09-21T05:51:33.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:33 smithi007 ceph-mon[30983]: fsmap 9 up:standby 2024-09-21T05:51:33.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T05:51:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:34.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.505+0000 7f7421396640 1 -- 172.21.15.7:0/2909420282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c10de90 msgr2=0x7f741c110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:34.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.505+0000 7f7421396640 1 --2- 172.21.15.7:0/2909420282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c10de90 0x7f741c110380 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7414009ca0 tx=0x7f741402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:34.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.505+0000 7f7421396640 1 -- 172.21.15.7:0/2909420282 shutdown_connections 2024-09-21T05:51:34.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.505+0000 7f7421396640 1 --2- 172.21.15.7:0/2909420282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c10de90 0x7f741c110380 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:34.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.505+0000 7f7421396640 1 --2- 172.21.15.7:0/2909420282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f741c105380 0x7f741c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.505+0000 7f7421396640 1 --2- 172.21.15.7:0/2909420282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f741c104a30 0x7f741c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.505+0000 7f7421396640 1 -- 172.21.15.7:0/2909420282 >> 172.21.15.7:0/2909420282 conn(0x7f741c079770 msgr2=0x7f741c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.505+0000 7f7421396640 1 -- 172.21.15.7:0/2909420282 shutdown_connections 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.505+0000 7f7421396640 1 -- 172.21.15.7:0/2909420282 wait complete. 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.505+0000 7f7421396640 1 Processor -- start 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.505+0000 7f7421396640 1 -- start start 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f7421396640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c104a30 0x7f741c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f7421396640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f741c105380 0x7f741c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f7421396640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f741c10de90 0x7f741c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f7421396640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f741c113af0 con 0x7f741c104a30 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f7421396640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f741c113970 con 0x7f741c10de90 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f7421396640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f741c113c70 con 0x7f741c105380 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f741affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c104a30 0x7f741c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f741affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c104a30 0x7f741c19a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35906/0 (socket says 172.21.15.7:35906) 2024-09-21T05:51:34.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f741affd640 1 -- 172.21.15.7:0/1965958792 learned_addr learned my addr 172.21.15.7:0/1965958792 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f7413fff640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f741c105380 0x7f741c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f741b7fe640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f741c10de90 0x7f741c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f741affd640 1 -- 172.21.15.7:0/1965958792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f741c105380 msgr2=0x7f741c19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f741affd640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f741c105380 0x7f741c19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f741affd640 1 -- 172.21.15.7:0/1965958792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f741c10de90 msgr2=0x7f741c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f741affd640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f741c10de90 0x7f741c19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f741affd640 1 -- 172.21.15.7:0/1965958792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c1a0470 con 0x7f741c104a30 2024-09-21T05:51:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f741affd640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c104a30 0x7f741c19a500 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c890 tx=0x7f740c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.506+0000 7f7418ff9640 1 -- 172.21.15.7:0/1965958792 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c004220 con 0x7f741c104a30 2024-09-21T05:51:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.507+0000 7f7418ff9640 1 -- 172.21.15.7:0/1965958792 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f740c0043c0 con 0x7f741c104a30 2024-09-21T05:51:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.507+0000 7f7418ff9640 1 -- 172.21.15.7:0/1965958792 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c004a00 con 0x7f741c104a30 2024-09-21T05:51:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.507+0000 7f7421396640 1 -- 172.21.15.7:0/1965958792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741c1a0760 con 0x7f741c104a30 2024-09-21T05:51:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.507+0000 7f7421396640 1 -- 172.21.15.7:0/1965958792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f741c1a6ec0 con 0x7f741c104a30 2024-09-21T05:51:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.508+0000 7f7421396640 1 -- 172.21.15.7:0/1965958792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f741c06c260 con 0x7f741c104a30 2024-09-21T05:51:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.509+0000 7f7418ff9640 1 -- 172.21.15.7:0/1965958792 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f740c0079b0 con 0x7f741c104a30 2024-09-21T05:51:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.511+0000 7f7418ff9640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f74080b65e0 0x7f74080b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.511+0000 7f7413fff640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f74080b65e0 0x7f74080b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.511+0000 7f7418ff9640 1 -- 172.21.15.7:0/1965958792 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7f740c0e6ff0 con 0x7f741c104a30 2024-09-21T05:51:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.511+0000 7f7413fff640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f74080b65e0 0x7f74080b8af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f741c10fb80 tx=0x7f740400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.514+0000 7f7418ff9640 1 -- 172.21.15.7:0/1965958792 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f740c014030 con 0x7f741c104a30 2024-09-21T05:51:34.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.747+0000 7f7421396640 1 -- 172.21.15.7:0/1965958792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f741c104e40 con 0x7f741c104a30 2024-09-21T05:51:34.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.748+0000 7f7418ff9640 1 -- 172.21.15.7:0/1965958792 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8040 (secure 0 0 0) 0x7f740c0b2090 con 0x7f741c104a30 2024-09-21T05:51:34.750 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:34.750 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"btime":"2024-09-21T05:51:33:096918+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24667,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24691,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T05:51:34.751 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 10 2024-09-21T05:51:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.750+0000 7f7421396640 1 -- 172.21.15.7:0/1965958792 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f74080b65e0 msgr2=0x7f74080b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.750+0000 7f7421396640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f74080b65e0 0x7f74080b8af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f741c10fb80 tx=0x7f740400b390 comp rx=0 tx=0).stop 2024-09-21T05:51:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.750+0000 7f7421396640 1 -- 172.21.15.7:0/1965958792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c104a30 msgr2=0x7f741c19a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:34.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.750+0000 7f7421396640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c104a30 0x7f741c19a500 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c890 tx=0x7f740c00cd50 comp rx=0 tx=0).stop 2024-09-21T05:51:34.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.750+0000 7f7421396640 1 -- 172.21.15.7:0/1965958792 shutdown_connections 2024-09-21T05:51:34.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.750+0000 7f7421396640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f74080b65e0 0x7f74080b8af0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:34.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.750+0000 7f7421396640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f741c10de90 0x7f741c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:34.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.750+0000 7f7421396640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f741c105380 0x7f741c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:34.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.750+0000 7f7421396640 1 --2- 172.21.15.7:0/1965958792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f741c104a30 0x7f741c19a500 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:34.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.750+0000 7f7421396640 1 -- 172.21.15.7:0/1965958792 >> 172.21.15.7:0/1965958792 conn(0x7f741c079770 msgr2=0x7f741c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:34.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.751+0000 7f7421396640 1 -- 172.21.15.7:0/1965958792 shutdown_connections 2024-09-21T05:51:34.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:34.751+0000 7f7421396640 1 -- 172.21.15.7:0/1965958792 wait complete. 2024-09-21T05:51:35.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:35 smithi007 ceph-mon[30983]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:35.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1965958792' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:35.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:35.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:35.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:35.797 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:35.797 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:35.797 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:35.797 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:35 smithi007 ceph-mon[30983]: Deploying daemon mds.a on smithi007 2024-09-21T05:51:35.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:35 smithi119 ceph-mon[34833]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:35.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:35 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1965958792' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:35.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:35 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:35.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:35 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:35.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:35 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:35.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:35 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:35.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:35 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:35.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:35 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:35.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:35 smithi119 ceph-mon[34833]: Deploying daemon mds.a on smithi007 2024-09-21T05:51:35.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:35 smithi027 ceph-mon[34364]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:35.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:35 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1965958792' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:35.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:35 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:35.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:35 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:35.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:35 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:35.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:35 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:35.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:35 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:35.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:35 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:35.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:35 smithi027 ceph-mon[34364]: Deploying daemon mds.a on smithi007 2024-09-21T05:51:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:36 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.7:6838/1135458977,v1:172.21.15.7:6839/1135458977] up:boot 2024-09-21T05:51:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:36 smithi007 ceph-mon[30983]: fsmap 10 up:standby 2024-09-21T05:51:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T05:51:36.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:36 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.7:6838/1135458977,v1:172.21.15.7:6839/1135458977] up:boot 2024-09-21T05:51:36.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:36 smithi119 ceph-mon[34833]: fsmap 10 up:standby 2024-09-21T05:51:36.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:36 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T05:51:36.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:36 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.7:6838/1135458977,v1:172.21.15.7:6839/1135458977] up:boot 2024-09-21T05:51:36.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:36 smithi027 ceph-mon[34364]: fsmap 10 up:standby 2024-09-21T05:51:36.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:36 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T05:51:37.319 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 05:51:37 smithi007 systemd[1]: Starting Ceph mds.a for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:51:37.586 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:51:37.678 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:37 smithi007 ceph-mon[30983]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:37.678 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 05:51:37 smithi007 podman[73359]: 2024-09-21 05:51:37.314531281 +0000 UTC m=+0.016944923 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:51:37.678 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 05:51:37 smithi007 podman[73359]: 2024-09-21 05:51:37.419925681 +0000 UTC m=+0.122339312 container create c90d9e0c0da3929170a06614ad30fcbaf5dc66a53ed29edd501f31ee47b452fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T05:51:37.678 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 05:51:37 smithi007 podman[73359]: 2024-09-21 05:51:37.639393174 +0000 UTC m=+0.341806813 container init c90d9e0c0da3929170a06614ad30fcbaf5dc66a53ed29edd501f31ee47b452fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T05:51:37.678 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 05:51:37 smithi007 podman[73359]: 2024-09-21 05:51:37.642718688 +0000 UTC m=+0.345132322 container start c90d9e0c0da3929170a06614ad30fcbaf5dc66a53ed29edd501f31ee47b452fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:51:37.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:37 smithi119 ceph-mon[34833]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:37.858 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:37.877 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:37 smithi027 ceph-mon[34364]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:37.975 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 05:51:37 smithi007 ceph-mds[73396]: -- 172.21.15.7:0/1337272441 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e674ef7860 con 0x55e67909fa80 2024-09-21T05:51:37.975 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 05:51:37 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-a[73374]: starting mds.a at 2024-09-21T05:51:37.975 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 05:51:37 smithi007 bash[73359]: c90d9e0c0da3929170a06614ad30fcbaf5dc66a53ed29edd501f31ee47b452fd 2024-09-21T05:51:37.975 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 05:51:37 smithi007 systemd[1]: Started Ceph mds.a for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:51:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.319+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3631711039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb92410de10 msgr2=0x7fb924110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.319+0000 7fb92b1c2640 1 --2- 172.21.15.7:0/3631711039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb92410de10 0x7fb924110320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009ca0 tx=0x7fb91c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.319+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3631711039 shutdown_connections 2024-09-21T05:51:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.319+0000 7fb92b1c2640 1 --2- 172.21.15.7:0/3631711039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb92410de10 0x7fb924110320 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.319+0000 7fb92b1c2640 1 --2- 172.21.15.7:0/3631711039 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924105290 0x7fb92410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.319+0000 7fb92b1c2640 1 --2- 172.21.15.7:0/3631711039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb924104860 0x7fb924104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.319+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3631711039 >> 172.21.15.7:0/3631711039 conn(0x7fb924079740 msgr2=0x7fb924079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.319+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3631711039 shutdown_connections 2024-09-21T05:51:38.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.319+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3631711039 wait complete. 2024-09-21T05:51:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.320+0000 7fb92b1c2640 1 Processor -- start 2024-09-21T05:51:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.320+0000 7fb92b1c2640 1 -- start start 2024-09-21T05:51:38.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.320+0000 7fb92b1c2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104860 0x7fb92419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:38.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.320+0000 7fb92b1c2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb924105290 0x7fb92419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:38.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.320+0000 7fb92b1c2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb92410de10 0x7fb92419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.320+0000 7fb92b1c2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb924113ab0 con 0x7fb92410de10 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.320+0000 7fb92b1c2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb924113930 con 0x7fb924104860 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.320+0000 7fb92b1c2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb924113c30 con 0x7fb924105290 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb928f5e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104860 0x7fb92419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb928f5e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104860 0x7fb92419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:41384/0 (socket says 172.21.15.7:41384) 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb928f5e640 1 -- 172.21.15.7:0/3169767300 learned_addr learned my addr 172.21.15.7:0/3169767300 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb92975f640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb92410de10 0x7fb92419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb923fff640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb924105290 0x7fb92419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb928f5e640 1 -- 172.21.15.7:0/3169767300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb924105290 msgr2=0x7fb92419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb928f5e640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb924105290 0x7fb92419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb928f5e640 1 -- 172.21.15.7:0/3169767300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb92410de10 msgr2=0x7fb92419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb928f5e640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb92410de10 0x7fb92419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb928f5e640 1 -- 172.21.15.7:0/3169767300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9241a0410 con 0x7fb924104860 2024-09-21T05:51:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb928f5e640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104860 0x7fb92419a4a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb91400d950 tx=0x7fb91400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb921ffb640 1 -- 172.21.15.7:0/3169767300 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914017070 con 0x7fb924104860 2024-09-21T05:51:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb921ffb640 1 -- 172.21.15.7:0/3169767300 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb914009c30 con 0x7fb924104860 2024-09-21T05:51:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3169767300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9241a0700 con 0x7fb924104860 2024-09-21T05:51:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.321+0000 7fb921ffb640 1 -- 172.21.15.7:0/3169767300 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91400f620 con 0x7fb924104860 2024-09-21T05:51:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.322+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3169767300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9241a6e60 con 0x7fb924104860 2024-09-21T05:51:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.323+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3169767300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92406c1e0 con 0x7fb924104860 2024-09-21T05:51:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.324+0000 7fb921ffb640 1 -- 172.21.15.7:0/3169767300 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fb91401a070 con 0x7fb924104860 2024-09-21T05:51:38.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.325+0000 7fb921ffb640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9100b6560 0x7fb9100b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:38.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.325+0000 7fb923fff640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9100b6560 0x7fb9100b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:38.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.325+0000 7fb921ffb640 1 -- 172.21.15.7:0/3169767300 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7fb9140e68f0 con 0x7fb924104860 2024-09-21T05:51:38.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.326+0000 7fb923fff640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9100b6560 0x7fb9100b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb92410fa60 tx=0x7fb90c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:38.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.328+0000 7fb921ffb640 1 -- 172.21.15.7:0/3169767300 <== mon.2 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb914009de0 con 0x7fb924104860 2024-09-21T05:51:38.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.555+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3169767300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb924104c70 con 0x7fb924104860 2024-09-21T05:51:38.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.556+0000 7fb921ffb640 1 -- 172.21.15.7:0/3169767300 <== mon.2 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8863 (secure 0 0 0) 0x7fb9140b1910 con 0x7fb924104860 2024-09-21T05:51:38.558 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:38.558 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":11,"btime":"2024-09-21T05:51:35:515650+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24667,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24691,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T05:51:38.558 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 11 2024-09-21T05:51:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.558+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3169767300 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9100b6560 msgr2=0x7fb9100b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.558+0000 7fb92b1c2640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9100b6560 0x7fb9100b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb92410fa60 tx=0x7fb90c005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.558+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3169767300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104860 msgr2=0x7fb92419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.558+0000 7fb92b1c2640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104860 0x7fb92419a4a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb91400d950 tx=0x7fb91400de10 comp rx=0 tx=0).stop 2024-09-21T05:51:38.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.558+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3169767300 shutdown_connections 2024-09-21T05:51:38.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.558+0000 7fb92b1c2640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9100b6560 0x7fb9100b8a70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:38.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.558+0000 7fb92b1c2640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb92410de10 0x7fb92419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:38.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.558+0000 7fb92b1c2640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb924105290 0x7fb92419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:38.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.558+0000 7fb92b1c2640 1 --2- 172.21.15.7:0/3169767300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104860 0x7fb92419a4a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:38.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.558+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3169767300 >> 172.21.15.7:0/3169767300 conn(0x7fb924079740 msgr2=0x7fb9240ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:38.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.558+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3169767300 shutdown_connections 2024-09-21T05:51:38.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:38.558+0000 7fb92b1c2640 1 -- 172.21.15.7:0/3169767300 wait complete. 2024-09-21T05:51:38.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:38.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:38.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:38.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:38.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:38.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:38.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:38 smithi007 ceph-mon[30983]: Deploying daemon mds.b on smithi027 2024-09-21T05:51:38.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:38 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3169767300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:38.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:38 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.7:6840/1570509958,v1:172.21.15.7:6841/1570509958] up:boot 2024-09-21T05:51:38.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:38 smithi007 ceph-mon[30983]: fsmap 11 up:standby 2024-09-21T05:51:38.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T05:51:39.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:38 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:39.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:38 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:39.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:38 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:39.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:38 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:39.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:38 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:39.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:38 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:39.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:38 smithi119 ceph-mon[34833]: Deploying daemon mds.b on smithi027 2024-09-21T05:51:39.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:38 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3169767300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:39.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:38 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.7:6840/1570509958,v1:172.21.15.7:6841/1570509958] up:boot 2024-09-21T05:51:39.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:38 smithi119 ceph-mon[34833]: fsmap 11 up:standby 2024-09-21T05:51:39.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:38 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T05:51:39.111 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:38 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:39.111 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:38 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:39.111 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:38 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:39.111 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:38 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:51:39.111 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:38 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:51:39.111 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:38 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:39.111 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:38 smithi027 ceph-mon[34364]: Deploying daemon mds.b on smithi027 2024-09-21T05:51:39.111 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:38 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3169767300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:39.111 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:38 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.7:6840/1570509958,v1:172.21.15.7:6841/1570509958] up:boot 2024-09-21T05:51:39.111 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:38 smithi027 ceph-mon[34364]: fsmap 11 up:standby 2024-09-21T05:51:39.111 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:38 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T05:51:39.726 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 05:51:39 smithi027 systemd[1]: Starting Ceph mds.b for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:51:40.032 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:39 smithi027 ceph-mon[34364]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:40.033 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 05:51:39 smithi027 podman[62742]: 2024-09-21 05:51:39.820770092 +0000 UTC m=+0.098886954 container create efeb32a1386f42c38389a0ecd6922f006184348cd9a9fa6117db2755a5bcb697 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T05:51:40.033 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 05:51:39 smithi027 podman[62742]: 2024-09-21 05:51:39.738936242 +0000 UTC m=+0.017053069 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:51:40.033 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 05:51:40 smithi027 podman[62742]: 2024-09-21 05:51:40.031439674 +0000 UTC m=+0.309556495 container init efeb32a1386f42c38389a0ecd6922f006184348cd9a9fa6117db2755a5bcb697 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T05:51:40.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:39 smithi007 ceph-mon[30983]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:40.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:39 smithi119 ceph-mon[34833]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:40.476 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 05:51:40 smithi027 podman[62742]: 2024-09-21 05:51:40.034398394 +0000 UTC m=+0.312515212 container start efeb32a1386f42c38389a0ecd6922f006184348cd9a9fa6117db2755a5bcb697 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:51:40.476 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 05:51:40 smithi027 ceph-mds[62762]: -- 172.21.15.27:0/2534776344 <== mon.2 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560f10841860 con 0x560f149e9180 2024-09-21T05:51:40.477 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 05:51:40 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-b[62758]: starting mds.b at 2024-09-21T05:51:40.477 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 05:51:40 smithi027 bash[62742]: efeb32a1386f42c38389a0ecd6922f006184348cd9a9fa6117db2755a5bcb697 2024-09-21T05:51:40.477 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 05:51:40 smithi027 systemd[1]: Started Ceph mds.b for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:51:41.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:51:41.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:41 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:41 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:41 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:41 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:41 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:41 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:41.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:41 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] up:boot 2024-09-21T05:51:41.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:41 smithi027 ceph-mon[34364]: fsmap 12 up:standby 2024-09-21T05:51:41.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:41 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T05:51:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:41.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:41 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:41 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:41 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:41 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:41 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:41 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:41.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:41 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] up:boot 2024-09-21T05:51:41.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:41 smithi007 ceph-mon[30983]: fsmap 12 up:standby 2024-09-21T05:51:41.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:41 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T05:51:41.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:41 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:41 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:41 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:41 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:41 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:41.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:41 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:41.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:41 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] up:boot 2024-09-21T05:51:41.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:41 smithi119 ceph-mon[34833]: fsmap 12 up:standby 2024-09-21T05:51:41.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:41 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T05:51:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.043+0000 7fc6f95f4640 1 -- 172.21.15.7:0/1695859795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4107be0 msgr2=0x7fc6f4107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.043+0000 7fc6f95f4640 1 --2- 172.21.15.7:0/1695859795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4107be0 0x7fc6f4107ff0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009860 tx=0x7fc6dc02a340 comp rx=0 tx=0).stop 2024-09-21T05:51:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.044+0000 7fc6f95f4640 1 -- 172.21.15.7:0/1695859795 shutdown_connections 2024-09-21T05:51:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.044+0000 7fc6f95f4640 1 --2- 172.21.15.7:0/1695859795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4108530 0x7fc6f410ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.044+0000 7fc6f95f4640 1 --2- 172.21.15.7:0/1695859795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4107be0 0x7fc6f4107ff0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.044+0000 7fc6f95f4640 1 --2- 172.21.15.7:0/1695859795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41022a0 0x7fc6f41026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.044+0000 7fc6f95f4640 1 -- 172.21.15.7:0/1695859795 >> 172.21.15.7:0/1695859795 conn(0x7fc6f4079ec0 msgr2=0x7fc6f407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.044+0000 7fc6f95f4640 1 -- 172.21.15.7:0/1695859795 shutdown_connections 2024-09-21T05:51:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.044+0000 7fc6f95f4640 1 -- 172.21.15.7:0/1695859795 wait complete. 2024-09-21T05:51:42.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.045+0000 7fc6f95f4640 1 Processor -- start 2024-09-21T05:51:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.045+0000 7fc6f95f4640 1 -- start start 2024-09-21T05:51:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.045+0000 7fc6f95f4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41022a0 0x7fc6f419b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.045+0000 7fc6f95f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4107be0 0x7fc6f419b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.045+0000 7fc6f95f4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4108530 0x7fc6f419be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.045+0000 7fc6f95f4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f4112a60 con 0x7fc6f4107be0 2024-09-21T05:51:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.045+0000 7fc6f95f4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f41128e0 con 0x7fc6f41022a0 2024-09-21T05:51:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.045+0000 7fc6f95f4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f4112be0 con 0x7fc6f4108530 2024-09-21T05:51:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.046+0000 7fc6f2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41022a0 0x7fc6f419b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.046+0000 7fc6f27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4107be0 0x7fc6f419b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.046+0000 7fc6f2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41022a0 0x7fc6f419b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:41350/0 (socket says 172.21.15.7:41350) 2024-09-21T05:51:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.046+0000 7fc6f2ffd640 1 -- 172.21.15.7:0/2668301654 learned_addr learned my addr 172.21.15.7:0/2668301654 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.046+0000 7fc6f37fe640 1 --2- 172.21.15.7:0/2668301654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4108530 0x7fc6f419be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.046+0000 7fc6f2ffd640 1 -- 172.21.15.7:0/2668301654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4108530 msgr2=0x7fc6f419be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.046+0000 7fc6f2ffd640 1 --2- 172.21.15.7:0/2668301654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4108530 0x7fc6f419be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.046+0000 7fc6f2ffd640 1 -- 172.21.15.7:0/2668301654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4107be0 msgr2=0x7fc6f419b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.046+0000 7fc6f2ffd640 1 --2- 172.21.15.7:0/2668301654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4107be0 0x7fc6f419b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.046+0000 7fc6f2ffd640 1 -- 172.21.15.7:0/2668301654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f41a6640 con 0x7fc6f41022a0 2024-09-21T05:51:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.046+0000 7fc6f2ffd640 1 --2- 172.21.15.7:0/2668301654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41022a0 0x7fc6f419b3b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400efb0 tx=0x7fc6e400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.046+0000 7fc6ebfff640 1 -- 172.21.15.7:0/2668301654 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e401b070 con 0x7fc6f41022a0 2024-09-21T05:51:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.047+0000 7fc6f95f4640 1 -- 172.21.15.7:0/2668301654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f41a6930 con 0x7fc6f41022a0 2024-09-21T05:51:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.047+0000 7fc6ebfff640 1 -- 172.21.15.7:0/2668301654 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6e400ba20 con 0x7fc6f41022a0 2024-09-21T05:51:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.047+0000 7fc6ebfff640 1 -- 172.21.15.7:0/2668301654 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4016b30 con 0x7fc6f41022a0 2024-09-21T05:51:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.047+0000 7fc6f95f4640 1 -- 172.21.15.7:0/2668301654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f41a6e90 con 0x7fc6f41022a0 2024-09-21T05:51:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.048+0000 7fc6f95f4640 1 -- 172.21.15.7:0/2668301654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f41026b0 con 0x7fc6f41022a0 2024-09-21T05:51:42.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.050+0000 7fc6ebfff640 1 -- 172.21.15.7:0/2668301654 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fc6e401e070 con 0x7fc6f41022a0 2024-09-21T05:51:42.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.051+0000 7fc6ebfff640 1 --2- 172.21.15.7:0/2668301654 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc6e00b6590 0x7fc6e00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:42.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.051+0000 7fc6f27fc640 1 --2- 172.21.15.7:0/2668301654 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc6e00b6590 0x7fc6e00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:42.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.052+0000 7fc6ebfff640 1 -- 172.21.15.7:0/2668301654 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7fc6e40e7430 con 0x7fc6f41022a0 2024-09-21T05:51:42.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.052+0000 7fc6f27fc640 1 --2- 172.21.15.7:0/2668301654 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc6e00b6590 0x7fc6e00b8aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc005940 tx=0x7fc6dc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:42.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.053+0000 7fc6ebfff640 1 -- 172.21.15.7:0/2668301654 <== mon.2 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc6e40b2470 con 0x7fc6f41022a0 2024-09-21T05:51:42.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.287+0000 7fc6f95f4640 1 -- 172.21.15.7:0/2668301654 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6f402e640 con 0x7fc6f41022a0 2024-09-21T05:51:42.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:42 smithi007 ceph-mon[30983]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:42.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.288+0000 7fc6ebfff640 1 -- 172.21.15.7:0/2668301654 <== mon.2 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10509 (secure 0 0 0) 0x7fc6e40b73b0 con 0x7fc6f41022a0 2024-09-21T05:51:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:42.291 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":13,"btime":"2024-09-21T05:51:40:777548+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24667,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24686,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24691,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T05:51:42.291 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 13 2024-09-21T05:51:42.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.291+0000 7fc6f95f4640 1 -- 172.21.15.7:0/2668301654 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc6e00b6590 msgr2=0x7fc6e00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:42.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.291+0000 7fc6f95f4640 1 --2- 172.21.15.7:0/2668301654 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc6e00b6590 0x7fc6e00b8aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc005940 tx=0x7fc6dc0058d0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.291+0000 7fc6f95f4640 1 -- 172.21.15.7:0/2668301654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41022a0 msgr2=0x7fc6f419b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:42.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.291+0000 7fc6f95f4640 1 --2- 172.21.15.7:0/2668301654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41022a0 0x7fc6f419b3b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400efb0 tx=0x7fc6e400c800 comp rx=0 tx=0).stop 2024-09-21T05:51:42.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.291+0000 7fc6f95f4640 1 -- 172.21.15.7:0/2668301654 shutdown_connections 2024-09-21T05:51:42.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.291+0000 7fc6f95f4640 1 --2- 172.21.15.7:0/2668301654 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc6e00b6590 0x7fc6e00b8aa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.291+0000 7fc6f95f4640 1 --2- 172.21.15.7:0/2668301654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4107be0 0x7fc6f419b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.291+0000 7fc6f95f4640 1 --2- 172.21.15.7:0/2668301654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4108530 0x7fc6f419be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.291+0000 7fc6f95f4640 1 --2- 172.21.15.7:0/2668301654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41022a0 0x7fc6f419b3b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.291+0000 7fc6f95f4640 1 -- 172.21.15.7:0/2668301654 >> 172.21.15.7:0/2668301654 conn(0x7fc6f4079ec0 msgr2=0x7fc6f4103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:42.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.292+0000 7fc6f95f4640 1 -- 172.21.15.7:0/2668301654 shutdown_connections 2024-09-21T05:51:42.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:42.292+0000 7fc6f95f4640 1 -- 172.21.15.7:0/2668301654 wait complete. 2024-09-21T05:51:42.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:42 smithi027 ceph-mon[34364]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:42.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:42 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:42 smithi119 ceph-mon[34833]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:42.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:42 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:42.968 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T05:51:43.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:43 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2668301654' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:43.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:43 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:43.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:43 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:43.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:43 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:43.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:43 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:43.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:43 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:43.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:43 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2668301654' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:43.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:43 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:43.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:43 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:43.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:43 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:43.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:43 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:43.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:43 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:43.493 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:43 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2668301654' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:43.493 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:43.493 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:43.493 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:43.493 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:43.493 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:43.799 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.331+0000 7fc75e98f640 1 -- 172.21.15.7:0/3748943793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7581094c0 msgr2=0x7fc7581098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.331+0000 7fc75e98f640 1 --2- 172.21.15.7:0/3748943793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7581094c0 0x7fc7581098d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009900 tx=0x7fc74c02a410 comp rx=0 tx=0).stop 2024-09-21T05:51:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.332+0000 7fc75e98f640 1 -- 172.21.15.7:0/3748943793 shutdown_connections 2024-09-21T05:51:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.332+0000 7fc75e98f640 1 --2- 172.21.15.7:0/3748943793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7581094c0 0x7fc7581098d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.332+0000 7fc75e98f640 1 --2- 172.21.15.7:0/3748943793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc758109e10 0x7fc758110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.332+0000 7fc75e98f640 1 --2- 172.21.15.7:0/3748943793 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc758103b80 0x7fc758103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.332+0000 7fc75e98f640 1 -- 172.21.15.7:0/3748943793 >> 172.21.15.7:0/3748943793 conn(0x7fc7580ff610 msgr2=0x7fc758101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.332+0000 7fc75e98f640 1 -- 172.21.15.7:0/3748943793 shutdown_connections 2024-09-21T05:51:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.332+0000 7fc75e98f640 1 -- 172.21.15.7:0/3748943793 wait complete. 2024-09-21T05:51:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.333+0000 7fc75e98f640 1 Processor -- start 2024-09-21T05:51:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.333+0000 7fc75e98f640 1 -- start start 2024-09-21T05:51:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.333+0000 7fc75e98f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc758103b80 0x7fc75819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.333+0000 7fc75e98f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7581094c0 0x7fc75819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.333+0000 7fc75e98f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc758109e10 0x7fc75819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.333+0000 7fc75e98f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc758113ad0 con 0x7fc758109e10 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.333+0000 7fc75e98f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc758113950 con 0x7fc7581094c0 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.333+0000 7fc75e98f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc758113c50 con 0x7fc758103b80 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.333+0000 7fc75cf2c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc758109e10 0x7fc75819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.333+0000 7fc75cf2c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc758109e10 0x7fc75819fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53596/0 (socket says 172.21.15.7:53596) 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.333+0000 7fc75cf2c640 1 -- 172.21.15.7:0/830710083 learned_addr learned my addr 172.21.15.7:0/830710083 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.334+0000 7fc7577fe640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7581094c0 0x7fc75819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.334+0000 7fc757fff640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc758103b80 0x7fc75819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.334+0000 7fc75cf2c640 1 -- 172.21.15.7:0/830710083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc758103b80 msgr2=0x7fc75819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.334+0000 7fc75cf2c640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc758103b80 0x7fc75819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.334+0000 7fc75cf2c640 1 -- 172.21.15.7:0/830710083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7581094c0 msgr2=0x7fc75819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.334+0000 7fc75cf2c640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7581094c0 0x7fc75819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.334+0000 7fc75cf2c640 1 -- 172.21.15.7:0/830710083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7581a0410 con 0x7fc758109e10 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.334+0000 7fc75cf2c640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc758109e10 0x7fc75819fce0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc75000eb10 tx=0x7fc75000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.334+0000 7fc7557fa640 1 -- 172.21.15.7:0/830710083 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750004b20 con 0x7fc758109e10 2024-09-21T05:51:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.334+0000 7fc75e98f640 1 -- 172.21.15.7:0/830710083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7581a0700 con 0x7fc758109e10 2024-09-21T05:51:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.334+0000 7fc7557fa640 1 -- 172.21.15.7:0/830710083 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc750004cc0 con 0x7fc758109e10 2024-09-21T05:51:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.334+0000 7fc75e98f640 1 -- 172.21.15.7:0/830710083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7581a6e60 con 0x7fc758109e10 2024-09-21T05:51:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.335+0000 7fc7557fa640 1 -- 172.21.15.7:0/830710083 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750010690 con 0x7fc758109e10 2024-09-21T05:51:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.336+0000 7fc75e98f640 1 -- 172.21.15.7:0/830710083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc758104e00 con 0x7fc758109e10 2024-09-21T05:51:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.337+0000 7fc7557fa640 1 -- 172.21.15.7:0/830710083 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fc7500108f0 con 0x7fc758109e10 2024-09-21T05:51:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.338+0000 7fc7557fa640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7400b6560 0x7fc7400b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.338+0000 7fc757fff640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7400b6560 0x7fc7400b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.338+0000 7fc7557fa640 1 -- 172.21.15.7:0/830710083 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7fc7500e75a0 con 0x7fc758109e10 2024-09-21T05:51:44.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.339+0000 7fc757fff640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7400b6560 0x7fc7400b8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc7480058c0 tx=0x7fc74800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:44.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.344+0000 7fc7557fa640 1 -- 172.21.15.7:0/830710083 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc7500ae160 con 0x7fc758109e10 2024-09-21T05:51:44.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:44 smithi027 ceph-mon[34364]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:44.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:44 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:44.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:44 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:44.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:44 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:44.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:44 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.542+0000 7fc75e98f640 1 -- 172.21.15.7:0/830710083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc75810bc00 con 0x7fc758109e10 2024-09-21T05:51:44.546 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:44 smithi007 ceph-mon[30983]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:44.546 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:44.546 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:44.546 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:44.546 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:44.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.543+0000 7fc7557fa640 1 -- 172.21.15.7:0/830710083 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) ==== 84+0+65 (secure 0 0 0) 0x7fc7500b2540 con 0x7fc758109e10 2024-09-21T05:51:44.547 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:44.547 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-09-21T05:51:44.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T05:51:44.547 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-09-21T05:51:44.547 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-09-21T05:51:44.547 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:51:44.547 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-09-21T05:51:44.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.545+0000 7fc75e98f640 1 -- 172.21.15.7:0/830710083 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7400b6560 msgr2=0x7fc7400b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:44.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.545+0000 7fc75e98f640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7400b6560 0x7fc7400b8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc7480058c0 tx=0x7fc74800a2d0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.545+0000 7fc75e98f640 1 -- 172.21.15.7:0/830710083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc758109e10 msgr2=0x7fc75819fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:44.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.545+0000 7fc75e98f640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc758109e10 0x7fc75819fce0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc75000eb10 tx=0x7fc75000c2d0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.546+0000 7fc75e98f640 1 -- 172.21.15.7:0/830710083 shutdown_connections 2024-09-21T05:51:44.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.546+0000 7fc75e98f640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7400b6560 0x7fc7400b8a70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.546+0000 7fc75e98f640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc758109e10 0x7fc75819fce0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.546+0000 7fc75e98f640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7581094c0 0x7fc75819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.546+0000 7fc75e98f640 1 --2- 172.21.15.7:0/830710083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc758103b80 0x7fc75819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.546+0000 7fc75e98f640 1 -- 172.21.15.7:0/830710083 >> 172.21.15.7:0/830710083 conn(0x7fc7580ff610 msgr2=0x7fc758101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:44.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.546+0000 7fc75e98f640 1 -- 172.21.15.7:0/830710083 shutdown_connections 2024-09-21T05:51:44.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:44.546+0000 7fc75e98f640 1 -- 172.21.15.7:0/830710083 wait complete. 2024-09-21T05:51:44.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:44 smithi119 ceph-mon[34833]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:44.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:44 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:44.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:44 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:44.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:44 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:44.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:44 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:45.261 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T05:51:45.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T05:51:45.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:45 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/830710083' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T05:51:45.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:45 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:45.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:45 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:45.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:45 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:45.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:45 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:45.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:45 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:45.521 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:45.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:45 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/830710083' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T05:51:45.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:45.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:45.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:45.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:45.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:45.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:45 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/830710083' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T05:51:45.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:45 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:45.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:45 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:45.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:45 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:45.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:45 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:45.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:45 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:51:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.030+0000 7f6acbb75640 1 -- 172.21.15.7:0/1758441514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac4102a80 msgr2=0x7f6ac4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.030+0000 7f6acbb75640 1 --2- 172.21.15.7:0/1758441514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac4102a80 0x7f6ac4102e90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009900 tx=0x7f6ac002a410 comp rx=0 tx=0).stop 2024-09-21T05:51:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.030+0000 7f6acbb75640 1 -- 172.21.15.7:0/1758441514 shutdown_connections 2024-09-21T05:51:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.030+0000 7f6acbb75640 1 --2- 172.21.15.7:0/1758441514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ac4108d10 0x7f6ac410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.030+0000 7f6acbb75640 1 --2- 172.21.15.7:0/1758441514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac41083c0 0x7f6ac41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.030+0000 7f6acbb75640 1 --2- 172.21.15.7:0/1758441514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac4102a80 0x7f6ac4102e90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.030+0000 7f6acbb75640 1 -- 172.21.15.7:0/1758441514 >> 172.21.15.7:0/1758441514 conn(0x7f6ac4079740 msgr2=0x7f6ac4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.031+0000 7f6acbb75640 1 -- 172.21.15.7:0/1758441514 shutdown_connections 2024-09-21T05:51:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.031+0000 7f6acbb75640 1 -- 172.21.15.7:0/1758441514 wait complete. 2024-09-21T05:51:46.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.031+0000 7f6acbb75640 1 Processor -- start 2024-09-21T05:51:46.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.031+0000 7f6acbb75640 1 -- start start 2024-09-21T05:51:46.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6acbb75640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac4102a80 0x7f6ac419b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:46.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6acbb75640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac41083c0 0x7f6ac419b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:46.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6acbb75640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ac4108d10 0x7f6ac419bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6acbb75640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac41129d0 con 0x7f6ac4102a80 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6acbb75640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac4112850 con 0x7f6ac41083c0 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6acbb75640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac4112b50 con 0x7f6ac4108d10 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6ac9911640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac4102a80 0x7f6ac419b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6ac9911640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac4102a80 0x7f6ac419b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53624/0 (socket says 172.21.15.7:53624) 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6ac9911640 1 -- 172.21.15.7:0/1031385004 learned_addr learned my addr 172.21.15.7:0/1031385004 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6ac9110640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac41083c0 0x7f6ac419b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6aca112640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ac4108d10 0x7f6ac419bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6ac9911640 1 -- 172.21.15.7:0/1031385004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ac4108d10 msgr2=0x7f6ac419bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6ac9911640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ac4108d10 0x7f6ac419bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6ac9911640 1 -- 172.21.15.7:0/1031385004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac41083c0 msgr2=0x7f6ac419b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6ac9911640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac41083c0 0x7f6ac419b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6ac9911640 1 -- 172.21.15.7:0/1031385004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac41a6550 con 0x7f6ac4102a80 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6ac9110640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac41083c0 0x7f6ac419b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6ac9911640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac4102a80 0x7f6ac419b240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0005ab0 tx=0x7f6ac0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:46.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6abaffd640 1 -- 172.21.15.7:0/1031385004 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac003f070 con 0x7f6ac4102a80 2024-09-21T05:51:46.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.032+0000 7f6abaffd640 1 -- 172.21.15.7:0/1031385004 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ac0031d60 con 0x7f6ac4102a80 2024-09-21T05:51:46.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.033+0000 7f6acbb75640 1 -- 172.21.15.7:0/1031385004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac41a67e0 con 0x7f6ac4102a80 2024-09-21T05:51:46.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.033+0000 7f6abaffd640 1 -- 172.21.15.7:0/1031385004 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0035030 con 0x7f6ac4102a80 2024-09-21T05:51:46.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.033+0000 7f6acbb75640 1 -- 172.21.15.7:0/1031385004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac41a6d10 con 0x7f6ac4102a80 2024-09-21T05:51:46.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.034+0000 7f6acbb75640 1 -- 172.21.15.7:0/1031385004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac4103d00 con 0x7f6ac4102a80 2024-09-21T05:51:46.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.035+0000 7f6abaffd640 1 -- 172.21.15.7:0/1031385004 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f6ac0042070 con 0x7f6ac4102a80 2024-09-21T05:51:46.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.036+0000 7f6abaffd640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6ab00b65e0 0x7f6ab00b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:46.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.036+0000 7f6ac9110640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6ab00b65e0 0x7f6ab00b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:46.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.036+0000 7f6abaffd640 1 -- 172.21.15.7:0/1031385004 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7f6ac0107e70 con 0x7f6ac4102a80 2024-09-21T05:51:46.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.037+0000 7f6ac9110640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6ab00b65e0 0x7f6ab00b8af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4005d00 tx=0x7f6ab4005ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:46.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.039+0000 7f6abaffd640 1 -- 172.21.15.7:0/1031385004 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ac00cead0 con 0x7f6ac4102a80 2024-09-21T05:51:46.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:46.233+0000 7f6acbb75640 1 -- 172.21.15.7:0/1031385004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6ac4102e90 con 0x7f6ac4102a80 2024-09-21T05:51:46.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:46 smithi027 ceph-mon[34364]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:46.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:46 smithi007 ceph-mon[30983]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:46.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:46 smithi119 ceph-mon[34833]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:47.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:47.213+0000 7f6abaffd640 1 -- 172.21.15.7:0/1031385004 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) ==== 138+0+0 (secure 0 0 0) 0x7f6ac00d2eb0 con 0x7f6ac4102a80 2024-09-21T05:51:47.216 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-09-21T05:51:47.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:47.216+0000 7f6acbb75640 1 -- 172.21.15.7:0/1031385004 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6ab00b65e0 msgr2=0x7f6ab00b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:47.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:47.216+0000 7f6acbb75640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6ab00b65e0 0x7f6ab00b8af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4005d00 tx=0x7f6ab4005ed0 comp rx=0 tx=0).stop 2024-09-21T05:51:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:47.216+0000 7f6acbb75640 1 -- 172.21.15.7:0/1031385004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac4102a80 msgr2=0x7f6ac419b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:47.216+0000 7f6acbb75640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac4102a80 0x7f6ac419b240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0005ab0 tx=0x7f6ac0003cd0 comp rx=0 tx=0).stop 2024-09-21T05:51:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:47.216+0000 7f6acbb75640 1 -- 172.21.15.7:0/1031385004 shutdown_connections 2024-09-21T05:51:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:47.216+0000 7f6acbb75640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6ab00b65e0 0x7f6ab00b8af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:47.216+0000 7f6acbb75640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ac4108d10 0x7f6ac419bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:47.216+0000 7f6acbb75640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ac41083c0 0x7f6ac419b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:47.216+0000 7f6acbb75640 1 --2- 172.21.15.7:0/1031385004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ac4102a80 0x7f6ac419b240 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:47.216+0000 7f6acbb75640 1 -- 172.21.15.7:0/1031385004 >> 172.21.15.7:0/1031385004 conn(0x7f6ac4079740 msgr2=0x7f6ac41013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:47.217+0000 7f6acbb75640 1 -- 172.21.15.7:0/1031385004 shutdown_connections 2024-09-21T05:51:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:47.217+0000 7f6acbb75640 1 -- 172.21.15.7:0/1031385004 wait complete. 2024-09-21T05:51:47.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:47 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1031385004' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T05:51:47.480 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:47 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1031385004' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T05:51:47.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:47 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1031385004' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T05:51:47.893 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T05:51:48.158 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:48.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:48 smithi119 ceph-mon[34833]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:48.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:48 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1031385004' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T05:51:48.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:48 smithi119 ceph-mon[34833]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T05:51:48.527 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:48 smithi007 ceph-mon[30983]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:48.527 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:48 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1031385004' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T05:51:48.527 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:48 smithi007 ceph-mon[30983]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T05:51:48.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.622+0000 7f5681086640 1 -- 172.21.15.7:0/1610601529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567c105380 msgr2=0x7f567c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:48.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.622+0000 7f5681086640 1 --2- 172.21.15.7:0/1610601529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567c105380 0x7f567c10d8d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5670009900 tx=0x7f567002a410 comp rx=0 tx=0).stop 2024-09-21T05:51:48.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.622+0000 7f5681086640 1 -- 172.21.15.7:0/1610601529 shutdown_connections 2024-09-21T05:51:48.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.622+0000 7f5681086640 1 --2- 172.21.15.7:0/1610601529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567c105380 0x7f567c10d8d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:48.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.622+0000 7f5681086640 1 --2- 172.21.15.7:0/1610601529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f567c10de60 0x7f567c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:48.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.622+0000 7f5681086640 1 --2- 172.21.15.7:0/1610601529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567c104a30 0x7f567c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.622+0000 7f5681086640 1 -- 172.21.15.7:0/1610601529 >> 172.21.15.7:0/1610601529 conn(0x7f567c079760 msgr2=0x7f567c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.623+0000 7f5681086640 1 -- 172.21.15.7:0/1610601529 shutdown_connections 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.623+0000 7f5681086640 1 -- 172.21.15.7:0/1610601529 wait complete. 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.624+0000 7f5681086640 1 Processor -- start 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.624+0000 7f5681086640 1 -- start start 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.624+0000 7f5681086640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567c104a30 0x7f567c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.624+0000 7f5681086640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f567c105380 0x7f567c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.624+0000 7f5681086640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567c10de60 0x7f567c19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.624+0000 7f5681086640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f567c113aa0 con 0x7f567c104a30 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.624+0000 7f5681086640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f567c113920 con 0x7f567c105380 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.624+0000 7f5681086640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f567c113c20 con 0x7f567c10de60 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.624+0000 7f567ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567c104a30 0x7f567c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.624+0000 7f567ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567c104a30 0x7f567c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39706/0 (socket says 172.21.15.7:39706) 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.624+0000 7f567ad9d640 1 -- 172.21.15.7:0/1962324011 learned_addr learned my addr 172.21.15.7:0/1962324011 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.624+0000 7f567a59c640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f567c105380 0x7f567c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.624+0000 7f567b59e640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567c10de60 0x7f567c19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.625+0000 7f567ad9d640 1 -- 172.21.15.7:0/1962324011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567c10de60 msgr2=0x7f567c19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.625+0000 7f567ad9d640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567c10de60 0x7f567c19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.625+0000 7f567ad9d640 1 -- 172.21.15.7:0/1962324011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f567c105380 msgr2=0x7f567c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.625+0000 7f567ad9d640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f567c105380 0x7f567c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.625+0000 7f567ad9d640 1 -- 172.21.15.7:0/1962324011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567c1a0420 con 0x7f567c104a30 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.625+0000 7f567a59c640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f567c105380 0x7f567c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.625+0000 7f567ad9d640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567c104a30 0x7f567c19a4b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f566c00d950 tx=0x7f566c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.625+0000 7f5663fff640 1 -- 172.21.15.7:0/1962324011 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c017020 con 0x7f567c104a30 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.625+0000 7f5663fff640 1 -- 172.21.15.7:0/1962324011 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f566c009c30 con 0x7f567c104a30 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.625+0000 7f5681086640 1 -- 172.21.15.7:0/1962324011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567c1a0710 con 0x7f567c104a30 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.625+0000 7f5663fff640 1 -- 172.21.15.7:0/1962324011 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c00f690 con 0x7f567c104a30 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.625+0000 7f5681086640 1 -- 172.21.15.7:0/1962324011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567c1a6e70 con 0x7f567c104a30 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.626+0000 7f5681086640 1 -- 172.21.15.7:0/1962324011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f567c06c1f0 con 0x7f567c104a30 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.629+0000 7f5663fff640 1 -- 172.21.15.7:0/1962324011 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f566c01a020 con 0x7f567c104a30 2024-09-21T05:51:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.630+0000 7f5663fff640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f56640b6560 0x7f56640b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:48.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.630+0000 7f567a59c640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f56640b6560 0x7f56640b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:48.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.630+0000 7f5663fff640 1 -- 172.21.15.7:0/1962324011 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7712+0+0 (secure 0 0 0) 0x7f566c0e7550 con 0x7f567c104a30 2024-09-21T05:51:48.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.630+0000 7f567a59c640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f56640b6560 0x7f56640b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5670000c00 tx=0x7f5670031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:48.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.633+0000 7f5663fff640 1 -- 172.21.15.7:0/1962324011 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f566c021020 con 0x7f567c104a30 2024-09-21T05:51:48.664 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:48 smithi027 ceph-mon[34364]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:48.664 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:48 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1031385004' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T05:51:48.664 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:48 smithi027 ceph-mon[34364]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T05:51:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:48.826+0000 7f5681086640 1 -- 172.21.15.7:0/1962324011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f567c104e40 con 0x7f567c104a30 2024-09-21T05:51:49.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:49.228+0000 7f5663fff640 1 -- 172.21.15.7:0/1962324011 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) ==== 170+0+0 (secure 0 0 0) 0x7f566c009de0 con 0x7f567c104a30 2024-09-21T05:51:49.231 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-09-21T05:51:49.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:49.231+0000 7f5681086640 1 -- 172.21.15.7:0/1962324011 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f56640b6560 msgr2=0x7f56640b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:49.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:49.231+0000 7f5681086640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f56640b6560 0x7f56640b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5670000c00 tx=0x7f5670031400 comp rx=0 tx=0).stop 2024-09-21T05:51:49.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:49.231+0000 7f5681086640 1 -- 172.21.15.7:0/1962324011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567c104a30 msgr2=0x7f567c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:49.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:49.231+0000 7f5681086640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567c104a30 0x7f567c19a4b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f566c00d950 tx=0x7f566c00de10 comp rx=0 tx=0).stop 2024-09-21T05:51:49.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:49.231+0000 7f5681086640 1 -- 172.21.15.7:0/1962324011 shutdown_connections 2024-09-21T05:51:49.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:49.231+0000 7f5681086640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f56640b6560 0x7f56640b8a70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:49.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:49.231+0000 7f5681086640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f567c10de60 0x7f567c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:49.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:49.231+0000 7f5681086640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f567c105380 0x7f567c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:49.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:49.231+0000 7f5681086640 1 --2- 172.21.15.7:0/1962324011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f567c104a30 0x7f567c19a4b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:49.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:49.231+0000 7f5681086640 1 -- 172.21.15.7:0/1962324011 >> 172.21.15.7:0/1962324011 conn(0x7f567c079760 msgr2=0x7f567c1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:49.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:49.231+0000 7f5681086640 1 -- 172.21.15.7:0/1962324011 shutdown_connections 2024-09-21T05:51:49.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:49.231+0000 7f5681086640 1 -- 172.21.15.7:0/1962324011 wait complete. 2024-09-21T05:51:49.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:49 smithi007 ceph-mon[30983]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T05:51:49.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:49 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1962324011' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T05:51:49.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:49 smithi119 ceph-mon[34833]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T05:51:49.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:49 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1962324011' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T05:51:49.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:49 smithi027 ceph-mon[34364]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T05:51:49.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:49 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1962324011' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T05:51:49.891 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T05:51:50.154 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:50.247 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:50 smithi007 ceph-mon[30983]: pgmap v251: 33 pgs: 29 unknown, 4 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:50.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:50 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1962324011' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T05:51:50.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:50 smithi007 ceph-mon[30983]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T05:51:50.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:50 smithi119 ceph-mon[34833]: pgmap v251: 33 pgs: 29 unknown, 4 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:50.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:50 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1962324011' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T05:51:50.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:50 smithi119 ceph-mon[34833]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T05:51:50.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.644+0000 7f8bb2391640 1 -- 172.21.15.7:0/1502278688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac105380 msgr2=0x7f8bac10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:50.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.644+0000 7f8bb2391640 1 --2- 172.21.15.7:0/1502278688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac105380 0x7f8bac10d8d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009900 tx=0x7f8ba002a410 comp rx=0 tx=0).stop 2024-09-21T05:51:50.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.644+0000 7f8bb2391640 1 -- 172.21.15.7:0/1502278688 shutdown_connections 2024-09-21T05:51:50.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.644+0000 7f8bb2391640 1 --2- 172.21.15.7:0/1502278688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac105380 0x7f8bac10d8d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.644+0000 7f8bb2391640 1 --2- 172.21.15.7:0/1502278688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bac10de60 0x7f8bac110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.644+0000 7f8bb2391640 1 --2- 172.21.15.7:0/1502278688 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac104a30 0x7f8bac104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.644+0000 7f8bb2391640 1 -- 172.21.15.7:0/1502278688 >> 172.21.15.7:0/1502278688 conn(0x7f8bac079760 msgr2=0x7f8bac079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:50.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.645+0000 7f8bb2391640 1 -- 172.21.15.7:0/1502278688 shutdown_connections 2024-09-21T05:51:50.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.645+0000 7f8bb2391640 1 -- 172.21.15.7:0/1502278688 wait complete. 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.645+0000 7f8bb2391640 1 Processor -- start 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.645+0000 7f8bb2391640 1 -- start start 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb2391640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac104a30 0x7f8bac102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb2391640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bac105380 0x7f8bac102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb2391640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac10de60 0x7f8bac1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb2391640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac113aa0 con 0x7f8bac10de60 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb2391640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac113920 con 0x7f8bac104a30 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb2391640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac113c20 con 0x7f8bac105380 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb092e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac10de60 0x7f8bac1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb092e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac10de60 0x7f8bac1031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39726/0 (socket says 172.21.15.7:39726) 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb092e640 1 -- 172.21.15.7:0/585240615 learned_addr learned my addr 172.21.15.7:0/585240615 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8babfff640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac104a30 0x7f8bac102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bab7fe640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bac105380 0x7f8bac102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb092e640 1 -- 172.21.15.7:0/585240615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bac105380 msgr2=0x7f8bac102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb092e640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bac105380 0x7f8bac102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb092e640 1 -- 172.21.15.7:0/585240615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac104a30 msgr2=0x7f8bac102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb092e640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac104a30 0x7f8bac102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb092e640 1 -- 172.21.15.7:0/585240615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bac1a8770 con 0x7f8bac10de60 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.646+0000 7f8bb092e640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac10de60 0x7f8bac1031f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400eaa0 tx=0x7f8ba400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.647+0000 7f8ba97fa640 1 -- 172.21.15.7:0/585240615 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400cdb0 con 0x7f8bac10de60 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.647+0000 7f8bb2391640 1 -- 172.21.15.7:0/585240615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bac1a8a60 con 0x7f8bac10de60 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.647+0000 7f8ba97fa640 1 -- 172.21.15.7:0/585240615 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ba4005020 con 0x7f8bac10de60 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.647+0000 7f8ba97fa640 1 -- 172.21.15.7:0/585240615 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba40116d0 con 0x7f8bac10de60 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.647+0000 7f8bb2391640 1 -- 172.21.15.7:0/585240615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bac1a8f70 con 0x7f8bac10de60 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.648+0000 7f8bb2391640 1 -- 172.21.15.7:0/585240615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bac06c1f0 con 0x7f8bac10de60 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.649+0000 7f8ba97fa640 1 -- 172.21.15.7:0/585240615 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f8ba40051d0 con 0x7f8bac10de60 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.650+0000 7f8ba97fa640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b940b6560 0x7f8b940b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.650+0000 7f8babfff640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b940b6560 0x7f8b940b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.650+0000 7f8ba97fa640 1 -- 172.21.15.7:0/585240615 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8094+0+0 (secure 0 0 0) 0x7f8ba40e7800 con 0x7f8bac10de60 2024-09-21T05:51:50.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.651+0000 7f8babfff640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b940b6560 0x7f8b940b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8bac1041c0 tx=0x7f8b9c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:50.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.654+0000 7f8ba97fa640 1 -- 172.21.15.7:0/585240615 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ba4016030 con 0x7f8bac10de60 2024-09-21T05:51:50.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:50 smithi027 ceph-mon[34364]: pgmap v251: 33 pgs: 29 unknown, 4 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:50.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:50 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1962324011' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T05:51:50.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:50 smithi027 ceph-mon[34364]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T05:51:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:50.880+0000 7f8bb2391640 1 -- 172.21.15.7:0/585240615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8bac103a70 con 0x7f8bac10de60 2024-09-21T05:51:51.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:51.252+0000 7f8ba97fa640 1 -- 172.21.15.7:0/585240615 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f8ba40ae170 con 0x7f8bac10de60 2024-09-21T05:51:51.255 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T05:51:51.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:51.254+0000 7f8bb2391640 1 -- 172.21.15.7:0/585240615 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b940b6560 msgr2=0x7f8b940b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:51.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:51.254+0000 7f8bb2391640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b940b6560 0x7f8b940b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8bac1041c0 tx=0x7f8b9c00b390 comp rx=0 tx=0).stop 2024-09-21T05:51:51.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:51.254+0000 7f8bb2391640 1 -- 172.21.15.7:0/585240615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac10de60 msgr2=0x7f8bac1031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:51.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:51.254+0000 7f8bb2391640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac10de60 0x7f8bac1031f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400eaa0 tx=0x7f8ba400ef60 comp rx=0 tx=0).stop 2024-09-21T05:51:51.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:51.254+0000 7f8bb2391640 1 -- 172.21.15.7:0/585240615 shutdown_connections 2024-09-21T05:51:51.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:51.254+0000 7f8bb2391640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b940b6560 0x7f8b940b8a70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:51.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:51.254+0000 7f8bb2391640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bac10de60 0x7f8bac1031f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:51.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:51.254+0000 7f8bb2391640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bac105380 0x7f8bac102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:51.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:51.254+0000 7f8bb2391640 1 --2- 172.21.15.7:0/585240615 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8bac104a30 0x7f8bac102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:51.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:51.254+0000 7f8bb2391640 1 -- 172.21.15.7:0/585240615 >> 172.21.15.7:0/585240615 conn(0x7f8bac079760 msgr2=0x7f8bac0ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:51.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:51.254+0000 7f8bb2391640 1 -- 172.21.15.7:0/585240615 shutdown_connections 2024-09-21T05:51:51.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:51.254+0000 7f8bb2391640 1 -- 172.21.15.7:0/585240615 wait complete. 2024-09-21T05:51:51.556 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:51 smithi007 ceph-mon[30983]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T05:51:51.556 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:51 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/585240615' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T05:51:51.556 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:51 smithi007 ceph-mon[30983]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-21T05:51:51.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:51 smithi119 ceph-mon[34833]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T05:51:51.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:51 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/585240615' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T05:51:51.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:51 smithi119 ceph-mon[34833]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-21T05:51:51.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:51 smithi027 ceph-mon[34364]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T05:51:51.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:51 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/585240615' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T05:51:51.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:51 smithi027 ceph-mon[34364]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-21T05:51:51.854 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:51:52.113 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:52.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:52 smithi007 ceph-mon[30983]: pgmap v254: 97 pgs: 21 creating+peering, 38 unknown, 38 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:52.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:52 smithi007 ceph-mon[30983]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T05:51:52.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:52 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/585240615' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T05:51:52.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:52 smithi007 ceph-mon[30983]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-21T05:51:52.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:52 smithi007 ceph-mon[30983]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-21T05:51:52.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:52 smithi119 ceph-mon[34833]: pgmap v254: 97 pgs: 21 creating+peering, 38 unknown, 38 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:52.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:52 smithi119 ceph-mon[34833]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T05:51:52.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:52 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/585240615' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T05:51:52.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:52 smithi119 ceph-mon[34833]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-21T05:51:52.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:52 smithi119 ceph-mon[34833]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-21T05:51:52.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.619+0000 7f57f7d32640 1 -- 172.21.15.7:0/1593379707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57f010de60 msgr2=0x7f57f0110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.619+0000 7f57f7d32640 1 --2- 172.21.15.7:0/1593379707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57f010de60 0x7f57f0110330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009ca0 tx=0x7f57e802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.619+0000 7f57f7d32640 1 -- 172.21.15.7:0/1593379707 shutdown_connections 2024-09-21T05:51:52.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.619+0000 7f57f7d32640 1 --2- 172.21.15.7:0/1593379707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57f010de60 0x7f57f0110330 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.619+0000 7f57f7d32640 1 --2- 172.21.15.7:0/1593379707 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57f0105380 0x7f57f010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.619+0000 7f57f7d32640 1 --2- 172.21.15.7:0/1593379707 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f0104a30 0x7f57f0104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.619+0000 7f57f7d32640 1 -- 172.21.15.7:0/1593379707 >> 172.21.15.7:0/1593379707 conn(0x7f57f0079760 msgr2=0x7f57f0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:52.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.619+0000 7f57f7d32640 1 -- 172.21.15.7:0/1593379707 shutdown_connections 2024-09-21T05:51:52.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.619+0000 7f57f7d32640 1 -- 172.21.15.7:0/1593379707 wait complete. 2024-09-21T05:51:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f7d32640 1 Processor -- start 2024-09-21T05:51:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f7d32640 1 -- start start 2024-09-21T05:51:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f7d32640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57f0104a30 0x7f57f0102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f7d32640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57f0105380 0x7f57f0102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f7d32640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f010de60 0x7f57f01031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f7d32640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0113ac0 con 0x7f57f0105380 2024-09-21T05:51:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f7d32640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0113940 con 0x7f57f010de60 2024-09-21T05:51:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f7d32640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0113c40 con 0x7f57f0104a30 2024-09-21T05:51:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f52cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57f0105380 0x7f57f0102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f52cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57f0105380 0x7f57f0102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39746/0 (socket says 172.21.15.7:39746) 2024-09-21T05:51:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f52cd640 1 -- 172.21.15.7:0/1235026653 learned_addr learned my addr 172.21.15.7:0/1235026653 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f5ace640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57f0104a30 0x7f57f0102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f62cf640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f010de60 0x7f57f01031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f52cd640 1 -- 172.21.15.7:0/1235026653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57f0104a30 msgr2=0x7f57f0102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f52cd640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57f0104a30 0x7f57f0102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f52cd640 1 -- 172.21.15.7:0/1235026653 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f010de60 msgr2=0x7f57f01031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f52cd640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f010de60 0x7f57f01031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.620+0000 7f57f52cd640 1 -- 172.21.15.7:0/1235026653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f01a8730 con 0x7f57f0105380 2024-09-21T05:51:52.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.621+0000 7f57f52cd640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57f0105380 0x7f57f0102cb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f57e000e9c0 tx=0x7f57e000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:52.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.621+0000 7f57e6ffd640 1 -- 172.21.15.7:0/1235026653 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e000ccc0 con 0x7f57f0105380 2024-09-21T05:51:52.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.621+0000 7f57f7d32640 1 -- 172.21.15.7:0/1235026653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f01a8a20 con 0x7f57f0105380 2024-09-21T05:51:52.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.621+0000 7f57e6ffd640 1 -- 172.21.15.7:0/1235026653 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57e00054d0 con 0x7f57f0105380 2024-09-21T05:51:52.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.621+0000 7f57e6ffd640 1 -- 172.21.15.7:0/1235026653 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0010430 con 0x7f57f0105380 2024-09-21T05:51:52.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.621+0000 7f57f7d32640 1 -- 172.21.15.7:0/1235026653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f01a8f10 con 0x7f57f0105380 2024-09-21T05:51:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.622+0000 7f57f7d32640 1 -- 172.21.15.7:0/1235026653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f006c1f0 con 0x7f57f0105380 2024-09-21T05:51:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.624+0000 7f57e6ffd640 1 -- 172.21.15.7:0/1235026653 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f57e0005000 con 0x7f57f0105380 2024-09-21T05:51:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.624+0000 7f57e6ffd640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f57dc0b6560 0x7f57dc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.625+0000 7f57f5ace640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f57dc0b6560 0x7f57dc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.625+0000 7f57e6ffd640 1 -- 172.21.15.7:0/1235026653 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7f57e00e78d0 con 0x7f57f0105380 2024-09-21T05:51:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.625+0000 7f57f5ace640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f57dc0b6560 0x7f57dc0b8a70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f57f01041c0 tx=0x7f57ec005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:52.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.628+0000 7f57e6ffd640 1 -- 172.21.15.7:0/1235026653 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57e0056710 con 0x7f57f0105380 2024-09-21T05:51:52.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:52 smithi027 ceph-mon[34364]: pgmap v254: 97 pgs: 21 creating+peering, 38 unknown, 38 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:52.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:52 smithi027 ceph-mon[34364]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T05:51:52.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:52 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/585240615' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T05:51:52.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:52 smithi027 ceph-mon[34364]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-21T05:51:52.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:52 smithi027 ceph-mon[34364]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-21T05:51:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.816+0000 7f57f7d32640 1 -- 172.21.15.7:0/1235026653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57f0103a70 con 0x7f57f0105380 2024-09-21T05:51:52.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.818+0000 7f57e6ffd640 1 -- 172.21.15.7:0/1235026653 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22496 (secure 0 0 0) 0x7f57f0103a70 con 0x7f57f0105380 2024-09-21T05:51:52.821 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:52.821 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":73,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:43:32.863896+0000","modified":"2024-09-21T05:51:50.882965+0000","last_up_change":"2024-09-21T05:51:02.074799+0000","last_in_change":"2024-09-21T05:50:39.016405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:47:20.844179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:51:46.238763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:51:48.832249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d7a68ba-a599-44a9-a0de-a1d6df51f437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6803","nonce":536257283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6805","nonce":536257283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6809","nonce":536257283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6807","nonce":536257283}]},"public_addr":"172.21.15.7:6803/536257283","cluster_addr":"172.21.15.7:6805/536257283","heartbeat_back_addr":"172.21.15.7:6809/536257283","heartbeat_front_addr":"172.21.15.7:6807/536257283","state":["exists","up"]},{"osd":1,"uuid":"d4600805-1cb5-432a-8ae0-a40107a6c6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6801","nonce":2299402871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6803","nonce":2299402871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6807","nonce":2299402871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6805","nonce":2299402871}]},"public_addr":"172.21.15.27:6801/2299402871","cluster_addr":"172.21.15.27:6803/2299402871","heartbeat_back_addr":"172.21.15.27:6807/2299402871","heartbeat_front_addr":"172.21.15.27:6805/2299402871","state":["exists","up"]},{"osd":2,"uuid":"aa435f82-5819-4497-9053-1d891e712b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6801","nonce":1043408043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6803","nonce":1043408043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6807","nonce":1043408043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6805","nonce":1043408043}]},"public_addr":"172.21.15.119:6801/1043408043","cluster_addr":"172.21.15.119:6803/1043408043","heartbeat_back_addr":"172.21.15.119:6807/1043408043","heartbeat_front_addr":"172.21.15.119:6805/1043408043","state":["exists","up"]},{"osd":3,"uuid":"55803f97-02e1-43c0-b8da-9b8af32fd1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6811","nonce":1261229771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6813","nonce":1261229771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6817","nonce":1261229771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6815","nonce":1261229771}]},"public_addr":"172.21.15.7:6811/1261229771","cluster_addr":"172.21.15.7:6813/1261229771","heartbeat_back_addr":"172.21.15.7:6817/1261229771","heartbeat_front_addr":"172.21.15.7:6815/1261229771","state":["exists","up"]},{"osd":4,"uuid":"987ce230-5bfc-45a7-a33e-6291545afded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6809","nonce":631467792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6811","nonce":631467792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6815","nonce":631467792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6813","nonce":631467792}]},"public_addr":"172.21.15.27:6809/631467792","cluster_addr":"172.21.15.27:6811/631467792","heartbeat_back_addr":"172.21.15.27:6815/631467792","heartbeat_front_addr":"172.21.15.27:6813/631467792","state":["exists","up"]},{"osd":5,"uuid":"e768fbfa-8983-4ff6-8dca-b7df2304cf91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6809","nonce":2530968619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6811","nonce":2530968619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6815","nonce":2530968619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6813","nonce":2530968619}]},"public_addr":"172.21.15.119:6809/2530968619","cluster_addr":"172.21.15.119:6811/2530968619","heartbeat_back_addr":"172.21.15.119:6815/2530968619","heartbeat_front_addr":"172.21.15.119:6813/2530968619","state":["exists","up"]},{"osd":6,"uuid":"22496f13-64be-479b-89ea-bf51544199c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6819","nonce":856032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6821","nonce":856032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6825","nonce":856032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6823","nonce":856032021}]},"public_addr":"172.21.15.7:6819/856032021","cluster_addr":"172.21.15.7:6821/856032021","heartbeat_back_addr":"172.21.15.7:6825/856032021","heartbeat_front_addr":"172.21.15.7:6823/856032021","state":["exists","up"]},{"osd":7,"uuid":"53fc5616-b06a-498e-a60e-d7d7d6ba2a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6817","nonce":2862843529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6819","nonce":2862843529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6823","nonce":2862843529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6821","nonce":2862843529}]},"public_addr":"172.21.15.27:6817/2862843529","cluster_addr":"172.21.15.27:6819/2862843529","heartbeat_back_addr":"172.21.15.27:6823/2862843529","heartbeat_front_addr":"172.21.15.27:6821/2862843529","state":["exists","up"]},{"osd":8,"uuid":"53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6817","nonce":3663835202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6819","nonce":3663835202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6823","nonce":3663835202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6821","nonce":3663835202}]},"public_addr":"172.21.15.119:6817/3663835202","cluster_addr":"172.21.15.119:6819/3663835202","heartbeat_back_addr":"172.21.15.119:6823/3663835202","heartbeat_front_addr":"172.21.15.119:6821/3663835202","state":["exists","up"]},{"osd":9,"uuid":"a69a747d-1e6c-4940-9d96-4315ab384588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6827","nonce":2348805959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6829","nonce":2348805959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6833","nonce":2348805959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6831","nonce":2348805959}]},"public_addr":"172.21.15.7:6827/2348805959","cluster_addr":"172.21.15.7:6829/2348805959","heartbeat_back_addr":"172.21.15.7:6833/2348805959","heartbeat_front_addr":"172.21.15.7:6831/2348805959","state":["exists","up"]},{"osd":10,"uuid":"a8f67271-99bb-4fb7-b0f5-a24730cd96cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6825","nonce":2363600090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6827","nonce":2363600090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6831","nonce":2363600090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6829","nonce":2363600090}]},"public_addr":"172.21.15.27:6825/2363600090","cluster_addr":"172.21.15.27:6827/2363600090","heartbeat_back_addr":"172.21.15.27:6831/2363600090","heartbeat_front_addr":"172.21.15.27:6829/2363600090","state":["exists","up"]},{"osd":11,"uuid":"88456735-00b1-479c-b201-588a9ee0c881","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6825","nonce":3937692826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6827","nonce":3937692826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6831","nonce":3937692826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6829","nonce":3937692826}]},"public_addr":"172.21.15.119:6825/3937692826","cluster_addr":"172.21.15.119:6827/3937692826","heartbeat_back_addr":"172.21.15.119:6831/3937692826","heartbeat_front_addr":"172.21.15.119:6829/3937692826","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:26.217550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:51.830871+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:17.201362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:41.990894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:07.357782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.114180+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:56.808155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:22.565234+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:46.981522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:10.600602+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:35.973766+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:51:00.216062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/4143746508":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/1505943829":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/1622456881":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/833696585":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/2055984288":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6801/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3995317885":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2229583478":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/468393974":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/1009303060":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2125734440":"2024-09-22T05:45:22.373420+0000","172.21.15.7:6800/3995317885":"2024-09-22T05:45:22.373420+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:51:52.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.820+0000 7f57f7d32640 1 -- 172.21.15.7:0/1235026653 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f57dc0b6560 msgr2=0x7f57dc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.820+0000 7f57f7d32640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f57dc0b6560 0x7f57dc0b8a70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f57f01041c0 tx=0x7f57ec005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:52.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.820+0000 7f57f7d32640 1 -- 172.21.15.7:0/1235026653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57f0105380 msgr2=0x7f57f0102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.820+0000 7f57f7d32640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57f0105380 0x7f57f0102cb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f57e000e9c0 tx=0x7f57e000ee80 comp rx=0 tx=0).stop 2024-09-21T05:51:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.820+0000 7f57f7d32640 1 -- 172.21.15.7:0/1235026653 shutdown_connections 2024-09-21T05:51:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.820+0000 7f57f7d32640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f57dc0b6560 0x7f57dc0b8a70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.820+0000 7f57f7d32640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57f0105380 0x7f57f0102cb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.820+0000 7f57f7d32640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57f010de60 0x7f57f01031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.820+0000 7f57f7d32640 1 --2- 172.21.15.7:0/1235026653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57f0104a30 0x7f57f0102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.820+0000 7f57f7d32640 1 -- 172.21.15.7:0/1235026653 >> 172.21.15.7:0/1235026653 conn(0x7f57f0079760 msgr2=0x7f57f01007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.820+0000 7f57f7d32640 1 -- 172.21.15.7:0/1235026653 shutdown_connections 2024-09-21T05:51:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:52.820+0000 7f57f7d32640 1 -- 172.21.15.7:0/1235026653 wait complete. 2024-09-21T05:51:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:53 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] up:active 2024-09-21T05:51:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:53 smithi007 ceph-mon[30983]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T05:51:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:53 smithi007 ceph-mon[30983]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T05:51:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:53 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1235026653' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:53.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:51:53.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:53 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] up:active 2024-09-21T05:51:53.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:53 smithi119 ceph-mon[34833]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T05:51:53.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:53 smithi119 ceph-mon[34833]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T05:51:53.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:53 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1235026653' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:53.592 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 21 05:51:53 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-i[64682]: 2024-09-21T05:51:53.107+0000 7f7d730af640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T05:51:53.644 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:53.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:53 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] up:active 2024-09-21T05:51:53.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:53 smithi027 ceph-mon[34364]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T05:51:53.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:53 smithi027 ceph-mon[34364]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T05:51:53.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:53 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1235026653' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:54.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.151+0000 7f55f1e81640 1 -- 172.21.15.7:0/2660885125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ec10de10 msgr2=0x7f55ec110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:54.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.151+0000 7f55f1e81640 1 --2- 172.21.15.7:0/2660885125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ec10de10 0x7f55ec110320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f55e4009ca0 tx=0x7f55e402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.151+0000 7f55f1e81640 1 -- 172.21.15.7:0/2660885125 shutdown_connections 2024-09-21T05:51:54.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.151+0000 7f55f1e81640 1 --2- 172.21.15.7:0/2660885125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ec10de10 0x7f55ec110320 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.151+0000 7f55f1e81640 1 --2- 172.21.15.7:0/2660885125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55ec105290 0x7f55ec10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.151+0000 7f55f1e81640 1 --2- 172.21.15.7:0/2660885125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55ec104860 0x7f55ec104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.151+0000 7f55f1e81640 1 -- 172.21.15.7:0/2660885125 >> 172.21.15.7:0/2660885125 conn(0x7f55ec079740 msgr2=0x7f55ec079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.151+0000 7f55f1e81640 1 -- 172.21.15.7:0/2660885125 shutdown_connections 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.151+0000 7f55f1e81640 1 -- 172.21.15.7:0/2660885125 wait complete. 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.152+0000 7f55f1e81640 1 Processor -- start 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.152+0000 7f55f1e81640 1 -- start start 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.152+0000 7f55f1e81640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55ec104860 0x7f55ec19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.152+0000 7f55f1e81640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55ec105290 0x7f55ec19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.152+0000 7f55f1e81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ec10de10 0x7f55ec19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.152+0000 7f55f1e81640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f55ec113a90 con 0x7f55ec10de10 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.152+0000 7f55f1e81640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f55ec113910 con 0x7f55ec104860 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.152+0000 7f55f1e81640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f55ec113c10 con 0x7f55ec105290 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.152+0000 7f55ebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ec10de10 0x7f55ec19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.152+0000 7f55ebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ec10de10 0x7f55ec19fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39766/0 (socket says 172.21.15.7:39766) 2024-09-21T05:51:54.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.152+0000 7f55ebfff640 1 -- 172.21.15.7:0/1858682386 learned_addr learned my addr 172.21.15.7:0/1858682386 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.152+0000 7f55eb7fe640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55ec104860 0x7f55ec19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.152+0000 7f55eaffd640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55ec105290 0x7f55ec19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.153+0000 7f55ebfff640 1 -- 172.21.15.7:0/1858682386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55ec105290 msgr2=0x7f55ec19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.153+0000 7f55ebfff640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55ec105290 0x7f55ec19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.153+0000 7f55ebfff640 1 -- 172.21.15.7:0/1858682386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55ec104860 msgr2=0x7f55ec19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.153+0000 7f55ebfff640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55ec104860 0x7f55ec19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.153+0000 7f55ebfff640 1 -- 172.21.15.7:0/1858682386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ec1a03d0 con 0x7f55ec10de10 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.153+0000 7f55eaffd640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55ec105290 0x7f55ec19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.153+0000 7f55ebfff640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ec10de10 0x7f55ec19fca0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f55e4005cc0 tx=0x7f55e4031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.153+0000 7f55e8ff9640 1 -- 172.21.15.7:0/1858682386 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4003b70 con 0x7f55ec10de10 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.153+0000 7f55e8ff9640 1 -- 172.21.15.7:0/1858682386 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55e40318f0 con 0x7f55ec10de10 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.153+0000 7f55e8ff9640 1 -- 172.21.15.7:0/1858682386 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e402f950 con 0x7f55ec10de10 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.153+0000 7f55f1e81640 1 -- 172.21.15.7:0/1858682386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ec1a0660 con 0x7f55ec10de10 2024-09-21T05:51:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.153+0000 7f55f1e81640 1 -- 172.21.15.7:0/1858682386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ec1a6e20 con 0x7f55ec10de10 2024-09-21T05:51:54.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.154+0000 7f55f1e81640 1 -- 172.21.15.7:0/1858682386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ec06c1c0 con 0x7f55ec10de10 2024-09-21T05:51:54.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.156+0000 7f55e8ff9640 1 -- 172.21.15.7:0/1858682386 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f55e4004b40 con 0x7f55ec10de10 2024-09-21T05:51:54.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.158+0000 7f55e8ff9640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f55d40b6560 0x7f55d40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:54.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.158+0000 7f55eb7fe640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f55d40b6560 0x7f55d40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:54.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.158+0000 7f55e8ff9640 1 -- 172.21.15.7:0/1858682386 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7f55e41086c0 con 0x7f55ec10de10 2024-09-21T05:51:54.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.158+0000 7f55eb7fe640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f55d40b6560 0x7f55d40b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f55ec06c8c0 tx=0x7f55dc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:54.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.160+0000 7f55e8ff9640 1 -- 172.21.15.7:0/1858682386 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55e40cef10 con 0x7f55ec10de10 2024-09-21T05:51:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:54 smithi007 ceph-mon[30983]: pgmap v256: 97 pgs: 21 creating+peering, 31 unknown, 45 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:54.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.350+0000 7f55f1e81640 1 -- 172.21.15.7:0/1858682386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55ec108ff0 con 0x7f55ec10de10 2024-09-21T05:51:54.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.352+0000 7f55e8ff9640 1 -- 172.21.15.7:0/1858682386 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22496 (secure 0 0 0) 0x7f55e40d32f0 con 0x7f55ec10de10 2024-09-21T05:51:54.355 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:51:54.355 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":73,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:43:32.863896+0000","modified":"2024-09-21T05:51:50.882965+0000","last_up_change":"2024-09-21T05:51:02.074799+0000","last_in_change":"2024-09-21T05:50:39.016405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:47:20.844179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:51:46.238763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:51:48.832249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d7a68ba-a599-44a9-a0de-a1d6df51f437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6803","nonce":536257283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6805","nonce":536257283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6809","nonce":536257283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6807","nonce":536257283}]},"public_addr":"172.21.15.7:6803/536257283","cluster_addr":"172.21.15.7:6805/536257283","heartbeat_back_addr":"172.21.15.7:6809/536257283","heartbeat_front_addr":"172.21.15.7:6807/536257283","state":["exists","up"]},{"osd":1,"uuid":"d4600805-1cb5-432a-8ae0-a40107a6c6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6801","nonce":2299402871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6803","nonce":2299402871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6807","nonce":2299402871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6805","nonce":2299402871}]},"public_addr":"172.21.15.27:6801/2299402871","cluster_addr":"172.21.15.27:6803/2299402871","heartbeat_back_addr":"172.21.15.27:6807/2299402871","heartbeat_front_addr":"172.21.15.27:6805/2299402871","state":["exists","up"]},{"osd":2,"uuid":"aa435f82-5819-4497-9053-1d891e712b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6801","nonce":1043408043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6803","nonce":1043408043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6807","nonce":1043408043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6805","nonce":1043408043}]},"public_addr":"172.21.15.119:6801/1043408043","cluster_addr":"172.21.15.119:6803/1043408043","heartbeat_back_addr":"172.21.15.119:6807/1043408043","heartbeat_front_addr":"172.21.15.119:6805/1043408043","state":["exists","up"]},{"osd":3,"uuid":"55803f97-02e1-43c0-b8da-9b8af32fd1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6811","nonce":1261229771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6813","nonce":1261229771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6817","nonce":1261229771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6815","nonce":1261229771}]},"public_addr":"172.21.15.7:6811/1261229771","cluster_addr":"172.21.15.7:6813/1261229771","heartbeat_back_addr":"172.21.15.7:6817/1261229771","heartbeat_front_addr":"172.21.15.7:6815/1261229771","state":["exists","up"]},{"osd":4,"uuid":"987ce230-5bfc-45a7-a33e-6291545afded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6809","nonce":631467792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6811","nonce":631467792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6815","nonce":631467792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6813","nonce":631467792}]},"public_addr":"172.21.15.27:6809/631467792","cluster_addr":"172.21.15.27:6811/631467792","heartbeat_back_addr":"172.21.15.27:6815/631467792","heartbeat_front_addr":"172.21.15.27:6813/631467792","state":["exists","up"]},{"osd":5,"uuid":"e768fbfa-8983-4ff6-8dca-b7df2304cf91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6809","nonce":2530968619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6811","nonce":2530968619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6815","nonce":2530968619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6813","nonce":2530968619}]},"public_addr":"172.21.15.119:6809/2530968619","cluster_addr":"172.21.15.119:6811/2530968619","heartbeat_back_addr":"172.21.15.119:6815/2530968619","heartbeat_front_addr":"172.21.15.119:6813/2530968619","state":["exists","up"]},{"osd":6,"uuid":"22496f13-64be-479b-89ea-bf51544199c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6819","nonce":856032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6821","nonce":856032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6825","nonce":856032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6823","nonce":856032021}]},"public_addr":"172.21.15.7:6819/856032021","cluster_addr":"172.21.15.7:6821/856032021","heartbeat_back_addr":"172.21.15.7:6825/856032021","heartbeat_front_addr":"172.21.15.7:6823/856032021","state":["exists","up"]},{"osd":7,"uuid":"53fc5616-b06a-498e-a60e-d7d7d6ba2a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6817","nonce":2862843529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6819","nonce":2862843529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6823","nonce":2862843529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6821","nonce":2862843529}]},"public_addr":"172.21.15.27:6817/2862843529","cluster_addr":"172.21.15.27:6819/2862843529","heartbeat_back_addr":"172.21.15.27:6823/2862843529","heartbeat_front_addr":"172.21.15.27:6821/2862843529","state":["exists","up"]},{"osd":8,"uuid":"53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6817","nonce":3663835202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6819","nonce":3663835202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6823","nonce":3663835202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6821","nonce":3663835202}]},"public_addr":"172.21.15.119:6817/3663835202","cluster_addr":"172.21.15.119:6819/3663835202","heartbeat_back_addr":"172.21.15.119:6823/3663835202","heartbeat_front_addr":"172.21.15.119:6821/3663835202","state":["exists","up"]},{"osd":9,"uuid":"a69a747d-1e6c-4940-9d96-4315ab384588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6827","nonce":2348805959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6829","nonce":2348805959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6833","nonce":2348805959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6831","nonce":2348805959}]},"public_addr":"172.21.15.7:6827/2348805959","cluster_addr":"172.21.15.7:6829/2348805959","heartbeat_back_addr":"172.21.15.7:6833/2348805959","heartbeat_front_addr":"172.21.15.7:6831/2348805959","state":["exists","up"]},{"osd":10,"uuid":"a8f67271-99bb-4fb7-b0f5-a24730cd96cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6825","nonce":2363600090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6827","nonce":2363600090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6831","nonce":2363600090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6829","nonce":2363600090}]},"public_addr":"172.21.15.27:6825/2363600090","cluster_addr":"172.21.15.27:6827/2363600090","heartbeat_back_addr":"172.21.15.27:6831/2363600090","heartbeat_front_addr":"172.21.15.27:6829/2363600090","state":["exists","up"]},{"osd":11,"uuid":"88456735-00b1-479c-b201-588a9ee0c881","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6825","nonce":3937692826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6827","nonce":3937692826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6831","nonce":3937692826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6829","nonce":3937692826}]},"public_addr":"172.21.15.119:6825/3937692826","cluster_addr":"172.21.15.119:6827/3937692826","heartbeat_back_addr":"172.21.15.119:6831/3937692826","heartbeat_front_addr":"172.21.15.119:6829/3937692826","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:26.217550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:51.830871+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:17.201362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:41.990894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:07.357782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.114180+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:56.808155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:22.565234+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:46.981522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:10.600602+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:35.973766+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:51:00.216062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/4143746508":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/1505943829":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/1622456881":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/833696585":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/2055984288":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6801/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3995317885":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2229583478":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/468393974":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/1009303060":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2125734440":"2024-09-22T05:45:22.373420+0000","172.21.15.7:6800/3995317885":"2024-09-22T05:45:22.373420+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:51:54.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.355+0000 7f55f1e81640 1 -- 172.21.15.7:0/1858682386 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f55d40b6560 msgr2=0x7f55d40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:54.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.355+0000 7f55f1e81640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f55d40b6560 0x7f55d40b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f55ec06c8c0 tx=0x7f55dc005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:54.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.355+0000 7f55f1e81640 1 -- 172.21.15.7:0/1858682386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ec10de10 msgr2=0x7f55ec19fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:54.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.355+0000 7f55f1e81640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ec10de10 0x7f55ec19fca0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f55e4005cc0 tx=0x7f55e4031700 comp rx=0 tx=0).stop 2024-09-21T05:51:54.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.355+0000 7f55f1e81640 1 -- 172.21.15.7:0/1858682386 shutdown_connections 2024-09-21T05:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.355+0000 7f55f1e81640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f55d40b6560 0x7f55d40b8a70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.355+0000 7f55f1e81640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ec10de10 0x7f55ec19fca0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.355+0000 7f55f1e81640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55ec105290 0x7f55ec19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.355+0000 7f55f1e81640 1 --2- 172.21.15.7:0/1858682386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55ec104860 0x7f55ec19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.355+0000 7f55f1e81640 1 -- 172.21.15.7:0/1858682386 >> 172.21.15.7:0/1858682386 conn(0x7f55ec079740 msgr2=0x7f55ec1007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.355+0000 7f55f1e81640 1 -- 172.21.15.7:0/1858682386 shutdown_connections 2024-09-21T05:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:54.355+0000 7f55f1e81640 1 -- 172.21.15.7:0/1858682386 wait complete. 2024-09-21T05:51:54.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:54 smithi119 ceph-mon[34833]: pgmap v256: 97 pgs: 21 creating+peering, 31 unknown, 45 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:54.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:54 smithi027 ceph-mon[34364]: pgmap v256: 97 pgs: 21 creating+peering, 31 unknown, 45 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:54.965 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T05:51:55.227 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:55.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:55 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1858682386' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:55.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:55 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1858682386' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:55.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.715+0000 7fabf57a3640 1 -- 172.21.15.7:0/3792683217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf0104a30 msgr2=0x7fabf0104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.715+0000 7fabf57a3640 1 --2- 172.21.15.7:0/3792683217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf0104a30 0x7fabf0104e40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009900 tx=0x7fabe002a410 comp rx=0 tx=0).stop 2024-09-21T05:51:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.715+0000 7fabf57a3640 1 -- 172.21.15.7:0/3792683217 shutdown_connections 2024-09-21T05:51:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.715+0000 7fabf57a3640 1 --2- 172.21.15.7:0/3792683217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf010de60 0x7fabf0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.715+0000 7fabf57a3640 1 --2- 172.21.15.7:0/3792683217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0105380 0x7fabf010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.715+0000 7fabf57a3640 1 --2- 172.21.15.7:0/3792683217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf0104a30 0x7fabf0104e40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.715+0000 7fabf57a3640 1 -- 172.21.15.7:0/3792683217 >> 172.21.15.7:0/3792683217 conn(0x7fabf0079760 msgr2=0x7fabf0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.715+0000 7fabf57a3640 1 -- 172.21.15.7:0/3792683217 shutdown_connections 2024-09-21T05:51:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.715+0000 7fabf57a3640 1 -- 172.21.15.7:0/3792683217 wait complete. 2024-09-21T05:51:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.716+0000 7fabf57a3640 1 Processor -- start 2024-09-21T05:51:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.716+0000 7fabf57a3640 1 -- start start 2024-09-21T05:51:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabf57a3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0104a30 0x7fabf019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabf57a3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0105380 0x7fabf019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabf57a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010de60 0x7fabf019fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabf57a3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fabf0113b80 con 0x7fabf010de60 2024-09-21T05:51:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabf57a3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fabf0113a00 con 0x7fabf0105380 2024-09-21T05:51:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabf57a3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fabf0113d00 con 0x7fabf0104a30 2024-09-21T05:51:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabef7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010de60 0x7fabf019fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabef7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010de60 0x7fabf019fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39782/0 (socket says 172.21.15.7:39782) 2024-09-21T05:51:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabef7fe640 1 -- 172.21.15.7:0/161694711 learned_addr learned my addr 172.21.15.7:0/161694711 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabeeffd640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0104a30 0x7fabf019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabee7fc640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0105380 0x7fabf019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabef7fe640 1 -- 172.21.15.7:0/161694711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0104a30 msgr2=0x7fabf019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabef7fe640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0104a30 0x7fabf019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabef7fe640 1 -- 172.21.15.7:0/161694711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0105380 msgr2=0x7fabf019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabef7fe640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0105380 0x7fabf019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabef7fe640 1 -- 172.21.15.7:0/161694711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf01a05a0 con 0x7fabf010de60 2024-09-21T05:51:55.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabee7fc640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0105380 0x7fabf019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:51:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabef7fe640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010de60 0x7fabf019fe70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fabe800b970 tx=0x7fabe800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabd7fff640 1 -- 172.21.15.7:0/161694711 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8019070 con 0x7fabf010de60 2024-09-21T05:51:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.717+0000 7fabf57a3640 1 -- 172.21.15.7:0/161694711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf01a0890 con 0x7fabf010de60 2024-09-21T05:51:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.718+0000 7fabd7fff640 1 -- 172.21.15.7:0/161694711 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabe8014440 con 0x7fabf010de60 2024-09-21T05:51:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.718+0000 7fabd7fff640 1 -- 172.21.15.7:0/161694711 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe80075d0 con 0x7fabf010de60 2024-09-21T05:51:55.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.718+0000 7fabf57a3640 1 -- 172.21.15.7:0/161694711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf01a6ff0 con 0x7fabf010de60 2024-09-21T05:51:55.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.719+0000 7fabf57a3640 1 -- 172.21.15.7:0/161694711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabf006c1f0 con 0x7fabf010de60 2024-09-21T05:51:55.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.720+0000 7fabd7fff640 1 -- 172.21.15.7:0/161694711 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7fabe801c070 con 0x7fabf010de60 2024-09-21T05:51:55.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.721+0000 7fabd7fff640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fabd80b6560 0x7fabd80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:55.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.721+0000 7fabeeffd640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fabd80b6560 0x7fabd80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:55.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.721+0000 7fabd7fff640 1 -- 172.21.15.7:0/161694711 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7fabe80e6cb0 con 0x7fabf010de60 2024-09-21T05:51:55.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.722+0000 7fabeeffd640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fabd80b6560 0x7fabd80b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fabe0000c00 tx=0x7fabe0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:55.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.724+0000 7fabd7fff640 1 -- 172.21.15.7:0/161694711 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fabe80b18e0 con 0x7fabf010de60 2024-09-21T05:51:55.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:55 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1858682386' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:55.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:55.951+0000 7fabf57a3640 1 -- 172.21.15.7:0/161694711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fabf0104ec0 con 0x7fabf010de60 2024-09-21T05:51:56.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:56.280+0000 7fabd7fff640 1 -- 172.21.15.7:0/161694711 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fabf0104ec0 con 0x7fabf010de60 2024-09-21T05:51:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:56.284+0000 7fabf57a3640 1 -- 172.21.15.7:0/161694711 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fabd80b6560 msgr2=0x7fabd80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:56.284+0000 7fabf57a3640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fabd80b6560 0x7fabd80b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fabe0000c00 tx=0x7fabe0031400 comp rx=0 tx=0).stop 2024-09-21T05:51:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:56.284+0000 7fabf57a3640 1 -- 172.21.15.7:0/161694711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010de60 msgr2=0x7fabf019fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:56.284+0000 7fabf57a3640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010de60 0x7fabf019fe70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fabe800b970 tx=0x7fabe800be30 comp rx=0 tx=0).stop 2024-09-21T05:51:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:56.284+0000 7fabf57a3640 1 -- 172.21.15.7:0/161694711 shutdown_connections 2024-09-21T05:51:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:56.284+0000 7fabf57a3640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fabd80b6560 0x7fabd80b8a70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:56.284+0000 7fabf57a3640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010de60 0x7fabf019fe70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:56.284+0000 7fabf57a3640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabf0105380 0x7fabf019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:56.284+0000 7fabf57a3640 1 --2- 172.21.15.7:0/161694711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0104a30 0x7fabf019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:56.284+0000 7fabf57a3640 1 -- 172.21.15.7:0/161694711 >> 172.21.15.7:0/161694711 conn(0x7fabf0079760 msgr2=0x7fabf01009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:56.284+0000 7fabf57a3640 1 -- 172.21.15.7:0/161694711 shutdown_connections 2024-09-21T05:51:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:56.284+0000 7fabf57a3640 1 -- 172.21.15.7:0/161694711 wait complete. 2024-09-21T05:51:56.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:56 smithi007 ceph-mon[30983]: pgmap v257: 97 pgs: 19 creating+peering, 78 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 6 op/s 2024-09-21T05:51:56.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:56 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/161694711' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T05:51:56.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:56 smithi119 ceph-mon[34833]: pgmap v257: 97 pgs: 19 creating+peering, 78 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 6 op/s 2024-09-21T05:51:56.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:56 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/161694711' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T05:51:56.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:56 smithi027 ceph-mon[34364]: pgmap v257: 97 pgs: 19 creating+peering, 78 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 6 op/s 2024-09-21T05:51:56.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:56 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/161694711' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T05:51:56.895 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T05:51:56.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 3 2024-09-21T05:51:57.189 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:57.556 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:57 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/161694711' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T05:51:57.556 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:57 smithi007 ceph-mon[30983]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T05:51:57.556 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:57 smithi007 ceph-mon[30983]: pgmap v258: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T05:51:57.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:57 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/161694711' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T05:51:57.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:57 smithi119 ceph-mon[34833]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T05:51:57.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:57 smithi119 ceph-mon[34833]: pgmap v258: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T05:51:57.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.652+0000 7f2b312c5640 1 -- 172.21.15.7:0/1587217062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2c108cf0 msgr2=0x7f2b2c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:57.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.652+0000 7f2b312c5640 1 --2- 172.21.15.7:0/1587217062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2c108cf0 0x7f2b2c10f520 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009ca0 tx=0x7f2b2402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:57.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.652+0000 7f2b312c5640 1 -- 172.21.15.7:0/1587217062 shutdown_connections 2024-09-21T05:51:57.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.652+0000 7f2b312c5640 1 --2- 172.21.15.7:0/1587217062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2c108cf0 0x7f2b2c10f520 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:57.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.652+0000 7f2b312c5640 1 --2- 172.21.15.7:0/1587217062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b2c1083a0 0x7f2b2c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:57.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.652+0000 7f2b312c5640 1 --2- 172.21.15.7:0/1587217062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c102a60 0x7f2b2c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:57.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.652+0000 7f2b312c5640 1 -- 172.21.15.7:0/1587217062 >> 172.21.15.7:0/1587217062 conn(0x7f2b2c079730 msgr2=0x7f2b2c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:57.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.652+0000 7f2b312c5640 1 -- 172.21.15.7:0/1587217062 shutdown_connections 2024-09-21T05:51:57.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.652+0000 7f2b312c5640 1 -- 172.21.15.7:0/1587217062 wait complete. 2024-09-21T05:51:57.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.653+0000 7f2b312c5640 1 Processor -- start 2024-09-21T05:51:57.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.653+0000 7f2b312c5640 1 -- start start 2024-09-21T05:51:57.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b312c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2c102a60 0x7f2b2c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b312c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c1083a0 0x7f2b2c199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b312c5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b2c108cf0 0x7f2b2c19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b312c5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c112960 con 0x7f2b2c102a60 2024-09-21T05:51:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b312c5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c1127e0 con 0x7f2b2c108cf0 2024-09-21T05:51:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b312c5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c112ae0 con 0x7f2b2c1083a0 2024-09-21T05:51:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b2affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2c102a60 0x7f2b2c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b2affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2c102a60 0x7f2b2c1993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39810/0 (socket says 172.21.15.7:39810) 2024-09-21T05:51:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b2affd640 1 -- 172.21.15.7:0/2607701180 learned_addr learned my addr 172.21.15.7:0/2607701180 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b2b7fe640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b2c108cf0 0x7f2b2c19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b2a7fc640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c1083a0 0x7f2b2c199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b2affd640 1 -- 172.21.15.7:0/2607701180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c1083a0 msgr2=0x7f2b2c199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b2affd640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c1083a0 0x7f2b2c199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b2affd640 1 -- 172.21.15.7:0/2607701180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b2c108cf0 msgr2=0x7f2b2c19ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:57.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b2affd640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b2c108cf0 0x7f2b2c19ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:57.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b2affd640 1 -- 172.21.15.7:0/2607701180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c19f2a0 con 0x7f2b2c102a60 2024-09-21T05:51:57.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.654+0000 7f2b2affd640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2c102a60 0x7f2b2c1993f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00c920 tx=0x7f2b1c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:57.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.655+0000 7f2b23fff640 1 -- 172.21.15.7:0/2607701180 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c007c70 con 0x7f2b2c102a60 2024-09-21T05:51:57.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.655+0000 7f2b312c5640 1 -- 172.21.15.7:0/2607701180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2c19f590 con 0x7f2b2c102a60 2024-09-21T05:51:57.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.655+0000 7f2b23fff640 1 -- 172.21.15.7:0/2607701180 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b1c007e10 con 0x7f2b2c102a60 2024-09-21T05:51:57.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.655+0000 7f2b23fff640 1 -- 172.21.15.7:0/2607701180 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c018820 con 0x7f2b2c102a60 2024-09-21T05:51:57.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.655+0000 7f2b312c5640 1 -- 172.21.15.7:0/2607701180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2c1a5db0 con 0x7f2b2c102a60 2024-09-21T05:51:57.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.656+0000 7f2b312c5640 1 -- 172.21.15.7:0/2607701180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b2c102e70 con 0x7f2b2c102a60 2024-09-21T05:51:57.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.658+0000 7f2b23fff640 1 -- 172.21.15.7:0/2607701180 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f2b1c00f450 con 0x7f2b2c102a60 2024-09-21T05:51:57.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.658+0000 7f2b23fff640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2b180b6590 0x7f2b180b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:57.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.659+0000 7f2b2a7fc640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2b180b6590 0x7f2b180b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:57.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.659+0000 7f2b23fff640 1 -- 172.21.15.7:0/2607701180 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7f2b1c0e76a0 con 0x7f2b2c102a60 2024-09-21T05:51:57.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.659+0000 7f2b2a7fc640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2b180b6590 0x7f2b180b8aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2b14005fd0 tx=0x7f2b14005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:57.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.664+0000 7f2b23fff640 1 -- 172.21.15.7:0/2607701180 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b1c014030 con 0x7f2b2c102a60 2024-09-21T05:51:57.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:57 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/161694711' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T05:51:57.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:57 smithi027 ceph-mon[34364]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T05:51:57.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:57 smithi027 ceph-mon[34364]: pgmap v258: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T05:51:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:57.891+0000 7f2b312c5640 1 -- 172.21.15.7:0/2607701180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f2b2c10ab40 con 0x7f2b2c102a60 2024-09-21T05:51:58.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:58.296+0000 7f2b23fff640 1 -- 172.21.15.7:0/2607701180 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f2b1c0adfe0 con 0x7f2b2c102a60 2024-09-21T05:51:58.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:58.299+0000 7f2b312c5640 1 -- 172.21.15.7:0/2607701180 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2b180b6590 msgr2=0x7f2b180b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:58.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:58.299+0000 7f2b312c5640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2b180b6590 0x7f2b180b8aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2b14005fd0 tx=0x7f2b14005850 comp rx=0 tx=0).stop 2024-09-21T05:51:58.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:58.299+0000 7f2b312c5640 1 -- 172.21.15.7:0/2607701180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2c102a60 msgr2=0x7f2b2c1993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:58.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:58.299+0000 7f2b312c5640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2c102a60 0x7f2b2c1993f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00c920 tx=0x7f2b1c00cde0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:58.299+0000 7f2b312c5640 1 -- 172.21.15.7:0/2607701180 shutdown_connections 2024-09-21T05:51:58.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:58.299+0000 7f2b312c5640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2b180b6590 0x7f2b180b8aa0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:58.299+0000 7f2b312c5640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b2c108cf0 0x7f2b2c19ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:58.299+0000 7f2b312c5640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b2c1083a0 0x7f2b2c199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:58.299+0000 7f2b312c5640 1 --2- 172.21.15.7:0/2607701180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2c102a60 0x7f2b2c1993f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:58.299+0000 7f2b312c5640 1 -- 172.21.15.7:0/2607701180 >> 172.21.15.7:0/2607701180 conn(0x7f2b2c079730 msgr2=0x7f2b2c104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:58.299+0000 7f2b312c5640 1 -- 172.21.15.7:0/2607701180 shutdown_connections 2024-09-21T05:51:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:58.299+0000 7f2b312c5640 1 -- 172.21.15.7:0/2607701180 wait complete. 2024-09-21T05:51:58.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:58 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2607701180' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T05:51:58.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:58 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2607701180' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T05:51:58.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:58 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2607701180' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T05:51:58.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T05:51:59.205 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:59.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:59 smithi007 ceph-mon[30983]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T05:51:59.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:59 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2607701180' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T05:51:59.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:59 smithi007 ceph-mon[30983]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T05:51:59.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:59 smithi007 ceph-mon[30983]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T05:51:59.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:59 smithi007 ceph-mon[30983]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-21T05:51:59.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:59 smithi007 ceph-mon[30983]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-21T05:51:59.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:51:59 smithi007 ceph-mon[30983]: pgmap v259: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T05:51:59.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:59 smithi119 ceph-mon[34833]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T05:51:59.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:59 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2607701180' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T05:51:59.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:59 smithi119 ceph-mon[34833]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T05:51:59.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:59 smithi119 ceph-mon[34833]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T05:51:59.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:59 smithi119 ceph-mon[34833]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-21T05:51:59.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:59 smithi119 ceph-mon[34833]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-21T05:51:59.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:51:59 smithi119 ceph-mon[34833]: pgmap v259: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T05:51:59.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.618+0000 7f8daa060640 1 -- 172.21.15.7:0/657804592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da4109e20 msgr2=0x7f8da4110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:59.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.618+0000 7f8daa060640 1 --2- 172.21.15.7:0/657804592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da4109e20 0x7f8da4110650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009900 tx=0x7f8d9c02a3f0 comp rx=0 tx=0).stop 2024-09-21T05:51:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.618+0000 7f8daa060640 1 -- 172.21.15.7:0/657804592 shutdown_connections 2024-09-21T05:51:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.618+0000 7f8daa060640 1 --2- 172.21.15.7:0/657804592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da4109e20 0x7f8da4110650 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.618+0000 7f8daa060640 1 --2- 172.21.15.7:0/657804592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da41094d0 0x7f8da41098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.618+0000 7f8daa060640 1 --2- 172.21.15.7:0/657804592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8da4103b90 0x7f8da4103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.618+0000 7f8daa060640 1 -- 172.21.15.7:0/657804592 >> 172.21.15.7:0/657804592 conn(0x7f8da40ff600 msgr2=0x7f8da4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.618+0000 7f8daa060640 1 -- 172.21.15.7:0/657804592 shutdown_connections 2024-09-21T05:51:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.618+0000 7f8daa060640 1 -- 172.21.15.7:0/657804592 wait complete. 2024-09-21T05:51:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.619+0000 7f8daa060640 1 Processor -- start 2024-09-21T05:51:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.619+0000 7f8daa060640 1 -- start start 2024-09-21T05:51:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8daa060640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da4103b90 0x7f8da419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8daa060640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8da41094d0 0x7f8da419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8daa060640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da4109e20 0x7f8da419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8daa060640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8da4113ae0 con 0x7f8da4103b90 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8daa060640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8da4113960 con 0x7f8da41094d0 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8daa060640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8da4113c60 con 0x7f8da4109e20 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da4103b90 0x7f8da419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da4103b90 0x7f8da419a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46922/0 (socket says 172.21.15.7:46922) 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da37fe640 1 -- 172.21.15.7:0/4035303188 learned_addr learned my addr 172.21.15.7:0/4035303188 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da2ffd640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8da41094d0 0x7f8da419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da3fff640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da4109e20 0x7f8da419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da37fe640 1 -- 172.21.15.7:0/4035303188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da4109e20 msgr2=0x7f8da419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da37fe640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da4109e20 0x7f8da419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da37fe640 1 -- 172.21.15.7:0/4035303188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8da41094d0 msgr2=0x7f8da419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da37fe640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8da41094d0 0x7f8da419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da37fe640 1 -- 172.21.15.7:0/4035303188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da41a02c0 con 0x7f8da4103b90 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da37fe640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da4103b90 0x7f8da419a410 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400cce0 tx=0x7f8d9400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da0ff9640 1 -- 172.21.15.7:0/4035303188 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9400f450 con 0x7f8da4103b90 2024-09-21T05:51:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8daa060640 1 -- 172.21.15.7:0/4035303188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da41a05b0 con 0x7f8da4103b90 2024-09-21T05:51:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da0ff9640 1 -- 172.21.15.7:0/4035303188 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d9400faa0 con 0x7f8da4103b90 2024-09-21T05:51:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.620+0000 7f8da0ff9640 1 -- 172.21.15.7:0/4035303188 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d94018aa0 con 0x7f8da4103b90 2024-09-21T05:51:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.621+0000 7f8daa060640 1 -- 172.21.15.7:0/4035303188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da41a6dd0 con 0x7f8da4103b90 2024-09-21T05:51:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.622+0000 7f8daa060640 1 -- 172.21.15.7:0/4035303188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da4104e10 con 0x7f8da4103b90 2024-09-21T05:51:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.623+0000 7f8da0ff9640 1 -- 172.21.15.7:0/4035303188 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f8d94018c40 con 0x7f8da4103b90 2024-09-21T05:51:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.624+0000 7f8da0ff9640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d8c0b6590 0x7f8d8c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.625+0000 7f8da2ffd640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d8c0b6590 0x7f8d8c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.625+0000 7f8da0ff9640 1 -- 172.21.15.7:0/4035303188 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7f8d940e7af0 con 0x7f8da4103b90 2024-09-21T05:51:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.625+0000 7f8da2ffd640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d8c0b6590 0x7f8d8c0b8aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8da4102e50 tx=0x7f8d9800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:59.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.628+0000 7f8da0ff9640 1 -- 172.21.15.7:0/4035303188 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8d94014030 con 0x7f8da4103b90 2024-09-21T05:51:59.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:59 smithi027 ceph-mon[34364]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T05:51:59.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:59 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2607701180' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T05:51:59.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:59 smithi027 ceph-mon[34364]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T05:51:59.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:59 smithi027 ceph-mon[34364]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T05:51:59.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:59 smithi027 ceph-mon[34364]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-21T05:51:59.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:59 smithi027 ceph-mon[34364]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-21T05:51:59.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:51:59 smithi027 ceph-mon[34364]: pgmap v259: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T05:51:59.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:51:59.854+0000 7f8daa060640 1 -- 172.21.15.7:0/4035303188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f8da4103fa0 con 0x7f8da4103b90 2024-09-21T05:52:00.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:00.315+0000 7f8da0ff9640 1 -- 172.21.15.7:0/4035303188 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f8d940ae430 con 0x7f8da4103b90 2024-09-21T05:52:00.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:00.318+0000 7f8daa060640 1 -- 172.21.15.7:0/4035303188 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d8c0b6590 msgr2=0x7f8d8c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:00.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:00.318+0000 7f8daa060640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d8c0b6590 0x7f8d8c0b8aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8da4102e50 tx=0x7f8d9800a2d0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:00.318+0000 7f8daa060640 1 -- 172.21.15.7:0/4035303188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da4103b90 msgr2=0x7f8da419a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:00.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:00.318+0000 7f8daa060640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da4103b90 0x7f8da419a410 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400cce0 tx=0x7f8d9400a620 comp rx=0 tx=0).stop 2024-09-21T05:52:00.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:00.318+0000 7f8daa060640 1 -- 172.21.15.7:0/4035303188 shutdown_connections 2024-09-21T05:52:00.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:00.318+0000 7f8daa060640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d8c0b6590 0x7f8d8c0b8aa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:00.318+0000 7f8daa060640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8da4109e20 0x7f8da419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:00.318+0000 7f8daa060640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8da41094d0 0x7f8da419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:00.318+0000 7f8daa060640 1 --2- 172.21.15.7:0/4035303188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da4103b90 0x7f8da419a410 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:00.318+0000 7f8daa060640 1 -- 172.21.15.7:0/4035303188 >> 172.21.15.7:0/4035303188 conn(0x7f8da40ff600 msgr2=0x7f8da4108ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:00.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:00.318+0000 7f8daa060640 1 -- 172.21.15.7:0/4035303188 shutdown_connections 2024-09-21T05:52:00.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:00.318+0000 7f8daa060640 1 -- 172.21.15.7:0/4035303188 wait complete. 2024-09-21T05:52:00.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:00 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] up:active 2024-09-21T05:52:00.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:00 smithi007 ceph-mon[30983]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T05:52:00.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:00 smithi007 ceph-mon[30983]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T05:52:00.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:00 smithi007 ceph-mon[30983]: Cluster is now healthy 2024-09-21T05:52:00.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:00 smithi007 ceph-mon[30983]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-21T05:52:00.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:00 smithi007 ceph-mon[30983]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-21T05:52:00.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:00 smithi007 ceph-mon[30983]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T05:52:00.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4035303188' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T05:52:00.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:00 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] up:active 2024-09-21T05:52:00.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:00 smithi119 ceph-mon[34833]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T05:52:00.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:00 smithi119 ceph-mon[34833]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T05:52:00.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:00 smithi119 ceph-mon[34833]: Cluster is now healthy 2024-09-21T05:52:00.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:00 smithi119 ceph-mon[34833]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-21T05:52:00.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:00 smithi119 ceph-mon[34833]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-21T05:52:00.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:00 smithi119 ceph-mon[34833]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T05:52:00.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:00 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/4035303188' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T05:52:00.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:00 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] up:active 2024-09-21T05:52:00.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:00 smithi027 ceph-mon[34364]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T05:52:00.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:00 smithi027 ceph-mon[34364]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T05:52:00.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:00 smithi027 ceph-mon[34364]: Cluster is now healthy 2024-09-21T05:52:00.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:00 smithi027 ceph-mon[34364]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-21T05:52:00.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:00 smithi027 ceph-mon[34364]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-21T05:52:00.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:00 smithi027 ceph-mon[34364]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T05:52:00.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:00 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/4035303188' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T05:52:00.955 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T05:52:01.218 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:01 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/4035303188' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T05:52:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:01 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] up:active 2024-09-21T05:52:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:01 smithi119 ceph-mon[34833]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-21T05:52:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:01 smithi119 ceph-mon[34833]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T05:52:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:01 smithi119 ceph-mon[34833]: pgmap v260: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-09-21T05:52:01.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:01 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4035303188' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T05:52:01.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:01 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] up:active 2024-09-21T05:52:01.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:01 smithi007 ceph-mon[30983]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-21T05:52:01.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:01 smithi007 ceph-mon[30983]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T05:52:01.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:01 smithi007 ceph-mon[30983]: pgmap v260: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-09-21T05:52:01.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.657+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3180244121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8981048c0 msgr2=0x7ff898104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:01.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.657+0000 7ff89cdd5640 1 --2- 172.21.15.7:0/3180244121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8981048c0 0x7ff898104cd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff888009900 tx=0x7ff88802a410 comp rx=0 tx=0).stop 2024-09-21T05:52:01.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.658+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3180244121 shutdown_connections 2024-09-21T05:52:01.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.658+0000 7ff89cdd5640 1 --2- 172.21.15.7:0/3180244121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff89810de70 0x7ff898110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:01.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.658+0000 7ff89cdd5640 1 --2- 172.21.15.7:0/3180244121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8981052a0 0x7ff89810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:01.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.658+0000 7ff89cdd5640 1 --2- 172.21.15.7:0/3180244121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8981048c0 0x7ff898104cd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:01.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.658+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3180244121 >> 172.21.15.7:0/3180244121 conn(0x7ff898079760 msgr2=0x7ff898079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:01.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.658+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3180244121 shutdown_connections 2024-09-21T05:52:01.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.658+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3180244121 wait complete. 2024-09-21T05:52:01.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.658+0000 7ff89cdd5640 1 Processor -- start 2024-09-21T05:52:01.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.658+0000 7ff89cdd5640 1 -- start start 2024-09-21T05:52:01.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff89cdd5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8981048c0 0x7ff89819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:01.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff89cdd5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8981052a0 0x7ff89819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:01.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff89cdd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff89810de70 0x7ff89819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:01.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff89cdd5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff898113ad0 con 0x7ff89810de70 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff89cdd5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff898113950 con 0x7ff8981052a0 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff89cdd5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff898113c50 con 0x7ff8981048c0 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff896d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff89810de70 0x7ff89819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff896d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff89810de70 0x7ff89819fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46932/0 (socket says 172.21.15.7:46932) 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff896d9d640 1 -- 172.21.15.7:0/3569595980 learned_addr learned my addr 172.21.15.7:0/3569595980 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff89659c640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8981048c0 0x7ff89819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff895d9b640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8981052a0 0x7ff89819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff896d9d640 1 -- 172.21.15.7:0/3569595980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8981048c0 msgr2=0x7ff89819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff896d9d640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8981048c0 0x7ff89819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff896d9d640 1 -- 172.21.15.7:0/3569595980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8981052a0 msgr2=0x7ff89819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff896d9d640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8981052a0 0x7ff89819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.659+0000 7ff896d9d640 1 -- 172.21.15.7:0/3569595980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8981a0470 con 0x7ff89810de70 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.660+0000 7ff896d9d640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff89810de70 0x7ff89819fd40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff89000eb10 tx=0x7ff89000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.660+0000 7ff8877fe640 1 -- 172.21.15.7:0/3569595980 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890004b20 con 0x7ff89810de70 2024-09-21T05:52:01.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.660+0000 7ff8877fe640 1 -- 172.21.15.7:0/3569595980 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff890004cc0 con 0x7ff89810de70 2024-09-21T05:52:01.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.660+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3569595980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8981a0760 con 0x7ff89810de70 2024-09-21T05:52:01.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.660+0000 7ff8877fe640 1 -- 172.21.15.7:0/3569595980 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890010670 con 0x7ff89810de70 2024-09-21T05:52:01.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.660+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3569595980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8981a6ec0 con 0x7ff89810de70 2024-09-21T05:52:01.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.661+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3569595980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff89806c190 con 0x7ff89810de70 2024-09-21T05:52:01.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.662+0000 7ff8877fe640 1 -- 172.21.15.7:0/3569595980 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7ff890005000 con 0x7ff89810de70 2024-09-21T05:52:01.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.663+0000 7ff8877fe640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff8800b6560 0x7ff8800b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:01.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.663+0000 7ff89659c640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff8800b6560 0x7ff8800b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:01.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.663+0000 7ff8877fe640 1 -- 172.21.15.7:0/3569595980 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7ff8900e7b30 con 0x7ff89810de70 2024-09-21T05:52:01.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.664+0000 7ff89659c640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff8800b6560 0x7ff8800b8a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff888000c00 tx=0x7ff888031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:01.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.666+0000 7ff8877fe640 1 -- 172.21.15.7:0/3569595980 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff890056710 con 0x7ff89810de70 2024-09-21T05:52:01.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:01 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/4035303188' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T05:52:01.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:01 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] up:active 2024-09-21T05:52:01.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:01 smithi027 ceph-mon[34364]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-21T05:52:01.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:01 smithi027 ceph-mon[34364]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T05:52:01.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:01 smithi027 ceph-mon[34364]: pgmap v260: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-09-21T05:52:01.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:01.893+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3569595980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7ff898108ff0 con 0x7ff89810de70 2024-09-21T05:52:02.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:02.332+0000 7ff8877fe640 1 -- 172.21.15.7:0/3569595980 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7ff8900ae3e0 con 0x7ff89810de70 2024-09-21T05:52:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:02.334+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3569595980 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff8800b6560 msgr2=0x7ff8800b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:02.334+0000 7ff89cdd5640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff8800b6560 0x7ff8800b8a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff888000c00 tx=0x7ff888031400 comp rx=0 tx=0).stop 2024-09-21T05:52:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:02.334+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3569595980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff89810de70 msgr2=0x7ff89819fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:02.334+0000 7ff89cdd5640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff89810de70 0x7ff89819fd40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff89000eb10 tx=0x7ff89000c2d0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:02.334+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3569595980 shutdown_connections 2024-09-21T05:52:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:02.334+0000 7ff89cdd5640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff8800b6560 0x7ff8800b8a70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:02.334+0000 7ff89cdd5640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff89810de70 0x7ff89819fd40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:02.334+0000 7ff89cdd5640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8981052a0 0x7ff89819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:02.334+0000 7ff89cdd5640 1 --2- 172.21.15.7:0/3569595980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8981048c0 0x7ff89819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:02.334+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3569595980 >> 172.21.15.7:0/3569595980 conn(0x7ff898079760 msgr2=0x7ff898100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:02.335+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3569595980 shutdown_connections 2024-09-21T05:52:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:02.335+0000 7ff89cdd5640 1 -- 172.21.15.7:0/3569595980 wait complete. 2024-09-21T05:52:02.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:02 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3569595980' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T05:52:02.678 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:02 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3569595980' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T05:52:02.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:02 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3569595980' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T05:52:03.011 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-21T05:52:03.012 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T05:52:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:03.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:03 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3569595980' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T05:52:03.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:03 smithi119 ceph-mon[34833]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T05:52:03.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:03 smithi119 ceph-mon[34833]: pgmap v261: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 182 B/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-21T05:52:03.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:03 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3569595980' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T05:52:03.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:03 smithi027 ceph-mon[34364]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T05:52:03.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:03 smithi027 ceph-mon[34364]: pgmap v261: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 182 B/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-21T05:52:03.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:03 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3569595980' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T05:52:03.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:03 smithi007 ceph-mon[30983]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T05:52:03.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:03 smithi007 ceph-mon[30983]: pgmap v261: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 182 B/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-21T05:52:03.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.993+0000 7f6f918c1640 1 -- 172.21.15.7:0/357900657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c1083a0 msgr2=0x7f6f8c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:03.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.993+0000 7f6f918c1640 1 --2- 172.21.15.7:0/357900657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c1083a0 0x7f6f8c1087b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009900 tx=0x7f6f7402a410 comp rx=0 tx=0).stop 2024-09-21T05:52:03.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.993+0000 7f6f918c1640 1 -- 172.21.15.7:0/357900657 shutdown_connections 2024-09-21T05:52:03.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.993+0000 7f6f918c1640 1 --2- 172.21.15.7:0/357900657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c1083a0 0x7f6f8c1087b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:03.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.993+0000 7f6f918c1640 1 --2- 172.21.15.7:0/357900657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f8c108cf0 0x7f6f8c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:03.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.993+0000 7f6f918c1640 1 --2- 172.21.15.7:0/357900657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f8c102a60 0x7f6f8c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:03.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.993+0000 7f6f918c1640 1 -- 172.21.15.7:0/357900657 >> 172.21.15.7:0/357900657 conn(0x7f6f8c079730 msgr2=0x7f6f8c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:03.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.993+0000 7f6f918c1640 1 -- 172.21.15.7:0/357900657 shutdown_connections 2024-09-21T05:52:03.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.993+0000 7f6f918c1640 1 -- 172.21.15.7:0/357900657 wait complete. 2024-09-21T05:52:03.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.994+0000 7f6f918c1640 1 Processor -- start 2024-09-21T05:52:03.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.994+0000 7f6f918c1640 1 -- start start 2024-09-21T05:52:03.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.994+0000 7f6f918c1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f8c102a60 0x7f6f8c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:03.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.994+0000 7f6f918c1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c1083a0 0x7f6f8c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:03.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.994+0000 7f6f918c1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f8c108cf0 0x7f6f8c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:03.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.994+0000 7f6f918c1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c112960 con 0x7f6f8c1083a0 2024-09-21T05:52:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.994+0000 7f6f918c1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c1127e0 con 0x7f6f8c108cf0 2024-09-21T05:52:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.994+0000 7f6f918c1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c112ae0 con 0x7f6f8c102a60 2024-09-21T05:52:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.994+0000 7f6f8a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c1083a0 0x7f6f8c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.994+0000 7f6f8a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c1083a0 0x7f6f8c199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46950/0 (socket says 172.21.15.7:46950) 2024-09-21T05:52:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.994+0000 7f6f8a7fc640 1 -- 172.21.15.7:0/3201240459 learned_addr learned my addr 172.21.15.7:0/3201240459 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.994+0000 7f6f8b7fe640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f8c108cf0 0x7f6f8c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.995+0000 7f6f8affd640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f8c102a60 0x7f6f8c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.995+0000 7f6f8a7fc640 1 -- 172.21.15.7:0/3201240459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f8c102a60 msgr2=0x7f6f8c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.995+0000 7f6f8a7fc640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f8c102a60 0x7f6f8c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.995+0000 7f6f8a7fc640 1 -- 172.21.15.7:0/3201240459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f8c108cf0 msgr2=0x7f6f8c19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.995+0000 7f6f8a7fc640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f8c108cf0 0x7f6f8c19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.995+0000 7f6f8a7fc640 1 -- 172.21.15.7:0/3201240459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c19f2e0 con 0x7f6f8c1083a0 2024-09-21T05:52:04.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.995+0000 7f6f8a7fc640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c1083a0 0x7f6f8c199910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6f74032fd0 tx=0x7f6f74004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:04.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.995+0000 7f6f908bf640 1 -- 172.21.15.7:0/3201240459 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7403f030 con 0x7f6f8c1083a0 2024-09-21T05:52:04.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.995+0000 7f6f918c1640 1 -- 172.21.15.7:0/3201240459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8c19f570 con 0x7f6f8c1083a0 2024-09-21T05:52:04.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.995+0000 7f6f908bf640 1 -- 172.21.15.7:0/3201240459 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f74004490 con 0x7f6f8c1083a0 2024-09-21T05:52:04.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.995+0000 7f6f908bf640 1 -- 172.21.15.7:0/3201240459 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74035070 con 0x7f6f8c1083a0 2024-09-21T05:52:04.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.995+0000 7f6f918c1640 1 -- 172.21.15.7:0/3201240459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f8c1a5d30 con 0x7f6f8c1083a0 2024-09-21T05:52:04.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.996+0000 7f6f918c1640 1 -- 172.21.15.7:0/3201240459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f8c102e70 con 0x7f6f8c1083a0 2024-09-21T05:52:04.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.998+0000 7f6f908bf640 1 -- 172.21.15.7:0/3201240459 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154528+0+0 (secure 0 0 0) 0x7f6f74042030 con 0x7f6f8c1083a0 2024-09-21T05:52:04.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.999+0000 7f6f908bf640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6f780b6560 0x7f6f780b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:04.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.999+0000 7f6f8affd640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6f780b6560 0x7f6f780b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:04.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.999+0000 7f6f908bf640 1 -- 172.21.15.7:0/3201240459 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7f6f74107c10 con 0x7f6f8c1083a0 2024-09-21T05:52:04.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:03.999+0000 7f6f8affd640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6f780b6560 0x7f6f780b8a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c005c40 tx=0x7f6f7c00a780 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:04.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.002+0000 7f6f908bf640 1 -- 172.21.15.7:0/3201240459 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f740ce4c0 con 0x7f6f8c1083a0 2024-09-21T05:52:04.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.215+0000 7f6f918c1640 1 -- 172.21.15.7:0/3201240459 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6f8c063800 con 0x7f6f780b6560 2024-09-21T05:52:04.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.245+0000 7f6f908bf640 1 -- 172.21.15.7:0/3201240459 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6f8c063800 con 0x7f6f780b6560 2024-09-21T05:52:04.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.247+0000 7f6f918c1640 1 -- 172.21.15.7:0/3201240459 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6f780b6560 msgr2=0x7f6f780b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:04.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.247+0000 7f6f918c1640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6f780b6560 0x7f6f780b8a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c005c40 tx=0x7f6f7c00a780 comp rx=0 tx=0).stop 2024-09-21T05:52:04.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.247+0000 7f6f918c1640 1 -- 172.21.15.7:0/3201240459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c1083a0 msgr2=0x7f6f8c199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:04.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.247+0000 7f6f918c1640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c1083a0 0x7f6f8c199910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6f74032fd0 tx=0x7f6f74004270 comp rx=0 tx=0).stop 2024-09-21T05:52:04.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.247+0000 7f6f918c1640 1 -- 172.21.15.7:0/3201240459 shutdown_connections 2024-09-21T05:52:04.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.247+0000 7f6f918c1640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6f780b6560 0x7f6f780b8a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.247+0000 7f6f918c1640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c1083a0 0x7f6f8c199910 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.247+0000 7f6f918c1640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f8c108cf0 0x7f6f8c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.247+0000 7f6f918c1640 1 --2- 172.21.15.7:0/3201240459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f8c102a60 0x7f6f8c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.247+0000 7f6f918c1640 1 -- 172.21.15.7:0/3201240459 >> 172.21.15.7:0/3201240459 conn(0x7f6f8c079730 msgr2=0x7f6f8c104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:04.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.247+0000 7f6f918c1640 1 -- 172.21.15.7:0/3201240459 shutdown_connections 2024-09-21T05:52:04.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:04.247+0000 7f6f918c1640 1 -- 172.21.15.7:0/3201240459 wait complete. 2024-09-21T05:52:04.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:04 smithi007 ceph-mon[30983]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:04.569 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:52:04 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:52:04.221+0000 7f36ee3b1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:52:04.569 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:52:04 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:52:04.221+0000 7f36ee3b1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:52:04.569 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:52:04 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:52:04.221+0000 7f36ee3b1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:52:04.569 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:52:04 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:52:04.221+0000 7f36ee3b1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:52:04.569 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:52:04 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:52:04.221+0000 7f36ee3b1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:52:04.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:04 smithi119 ceph-mon[34833]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:04.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:04 smithi027 ceph-mon[34364]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:04.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T05:52:05.165 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:05.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:05 smithi007 ceph-mon[30983]: pgmap v262: 97 pgs: 97 active+clean; 582 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-09-21T05:52:05.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.611+0000 7fba1a014640 1 -- 172.21.15.7:0/117070892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba14103b60 msgr2=0x7fba14103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:05.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.611+0000 7fba1a014640 1 --2- 172.21.15.7:0/117070892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba14103b60 0x7fba14103f70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fba04009900 tx=0x7fba0402a410 comp rx=0 tx=0).stop 2024-09-21T05:52:05.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.611+0000 7fba1a014640 1 -- 172.21.15.7:0/117070892 shutdown_connections 2024-09-21T05:52:05.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.611+0000 7fba1a014640 1 --2- 172.21.15.7:0/117070892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba14109df0 0x7fba14110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:05.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.611+0000 7fba1a014640 1 --2- 172.21.15.7:0/117070892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba141094a0 0x7fba141098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.611+0000 7fba1a014640 1 --2- 172.21.15.7:0/117070892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba14103b60 0x7fba14103f70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.611+0000 7fba1a014640 1 -- 172.21.15.7:0/117070892 >> 172.21.15.7:0/117070892 conn(0x7fba1407b850 msgr2=0x7fba1407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.611+0000 7fba1a014640 1 -- 172.21.15.7:0/117070892 shutdown_connections 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.611+0000 7fba1a014640 1 -- 172.21.15.7:0/117070892 wait complete. 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.611+0000 7fba1a014640 1 Processor -- start 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.611+0000 7fba1a014640 1 -- start start 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba1a014640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba14103b60 0x7fba1419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba1a014640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba141094a0 0x7fba1419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba1a014640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba14109df0 0x7fba1419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba1a014640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba14113ab0 con 0x7fba14103b60 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba1a014640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fba14113930 con 0x7fba141094a0 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba1a014640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fba14113c30 con 0x7fba14109df0 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba14103b60 0x7fba1419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba14103b60 0x7fba1419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46986/0 (socket says 172.21.15.7:46986) 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba137fe640 1 -- 172.21.15.7:0/3346014243 learned_addr learned my addr 172.21.15.7:0/3346014243 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba13fff640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba14109df0 0x7fba1419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba0affd640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba141094a0 0x7fba1419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba137fe640 1 -- 172.21.15.7:0/3346014243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba14109df0 msgr2=0x7fba1419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba137fe640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba14109df0 0x7fba1419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba137fe640 1 -- 172.21.15.7:0/3346014243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba141094a0 msgr2=0x7fba1419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba137fe640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba141094a0 0x7fba1419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba137fe640 1 -- 172.21.15.7:0/3346014243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba141a03b0 con 0x7fba14103b60 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba13fff640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba14109df0 0x7fba1419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.612+0000 7fba0affd640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba141094a0 0x7fba1419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.613+0000 7fba137fe640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba14103b60 0x7fba1419a500 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fba04006010 tx=0x7fba040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.613+0000 7fba117fa640 1 -- 172.21.15.7:0/3346014243 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0403f030 con 0x7fba14103b60 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.613+0000 7fba1a014640 1 -- 172.21.15.7:0/3346014243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba141a0640 con 0x7fba14103b60 2024-09-21T05:52:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.613+0000 7fba117fa640 1 -- 172.21.15.7:0/3346014243 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba04003800 con 0x7fba14103b60 2024-09-21T05:52:05.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.613+0000 7fba117fa640 1 -- 172.21.15.7:0/3346014243 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04035070 con 0x7fba14103b60 2024-09-21T05:52:05.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.613+0000 7fba1a014640 1 -- 172.21.15.7:0/3346014243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba141a0b70 con 0x7fba14103b60 2024-09-21T05:52:05.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.614+0000 7fba1a014640 1 -- 172.21.15.7:0/3346014243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba14103f70 con 0x7fba14103b60 2024-09-21T05:52:05.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.616+0000 7fba117fa640 1 -- 172.21.15.7:0/3346014243 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fba04003cb0 con 0x7fba14103b60 2024-09-21T05:52:05.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.617+0000 7fba117fa640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba000b66a0 0x7fba000b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:05.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.617+0000 7fba0affd640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba000b66a0 0x7fba000b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:05.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.617+0000 7fba117fa640 1 -- 172.21.15.7:0/3346014243 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7fba041081c0 con 0x7fba14103b60 2024-09-21T05:52:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.618+0000 7fba0affd640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba000b66a0 0x7fba000b8bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fba141064c0 tx=0x7fb9fc005d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.621+0000 7fba117fa640 1 -- 172.21.15.7:0/3346014243 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fba141a0b70 con 0x7fba14103b60 2024-09-21T05:52:05.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:05 smithi027 ceph-mon[34364]: pgmap v262: 97 pgs: 97 active+clean; 582 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-09-21T05:52:05.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.838+0000 7fba1a014640 1 -- 172.21.15.7:0/3346014243 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fba14063800 con 0x7fba000b66a0 2024-09-21T05:52:05.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:05 smithi119 ceph-mon[34833]: pgmap v262: 97 pgs: 97 active+clean; 582 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-09-21T05:52:05.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.868+0000 7fba117fa640 1 -- 172.21.15.7:0/3346014243 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fba14063800 con 0x7fba000b66a0 2024-09-21T05:52:05.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.870+0000 7fba1a014640 1 -- 172.21.15.7:0/3346014243 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba000b66a0 msgr2=0x7fba000b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:05.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.870+0000 7fba1a014640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba000b66a0 0x7fba000b8bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fba141064c0 tx=0x7fb9fc005d30 comp rx=0 tx=0).stop 2024-09-21T05:52:05.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.871+0000 7fba1a014640 1 -- 172.21.15.7:0/3346014243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba14103b60 msgr2=0x7fba1419a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:05.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.871+0000 7fba1a014640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba14103b60 0x7fba1419a500 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fba04006010 tx=0x7fba040042f0 comp rx=0 tx=0).stop 2024-09-21T05:52:05.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.871+0000 7fba1a014640 1 -- 172.21.15.7:0/3346014243 shutdown_connections 2024-09-21T05:52:05.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.871+0000 7fba1a014640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba000b66a0 0x7fba000b8bb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:05.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.871+0000 7fba1a014640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba14109df0 0x7fba1419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:05.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.871+0000 7fba1a014640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba141094a0 0x7fba1419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:05.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.871+0000 7fba1a014640 1 --2- 172.21.15.7:0/3346014243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba14103b60 0x7fba1419a500 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:05.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.871+0000 7fba1a014640 1 -- 172.21.15.7:0/3346014243 >> 172.21.15.7:0/3346014243 conn(0x7fba1407b850 msgr2=0x7fba141075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:05.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.871+0000 7fba1a014640 1 -- 172.21.15.7:0/3346014243 shutdown_connections 2024-09-21T05:52:05.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:05.871+0000 7fba1a014640 1 -- 172.21.15.7:0/3346014243 wait complete. 2024-09-21T05:52:06.464 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T05:52:06.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:06 smithi007 ceph-mon[30983]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-21T05:52:06.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:06 smithi007 ceph-mon[30983]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:06.721 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:06.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:06 smithi027 ceph-mon[34364]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-21T05:52:06.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:06 smithi027 ceph-mon[34364]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:06.743 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:06 smithi119 ceph-mon[34833]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-21T05:52:06.743 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:06 smithi119 ceph-mon[34833]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:07.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.127+0000 7fe923ee6640 1 -- 172.21.15.7:0/3409439336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe91c108420 msgr2=0x7fe91c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:07.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.127+0000 7fe923ee6640 1 --2- 172.21.15.7:0/3409439336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe91c108420 0x7fe91c108830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009900 tx=0x7fe90c02a410 comp rx=0 tx=0).stop 2024-09-21T05:52:07.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.127+0000 7fe923ee6640 1 -- 172.21.15.7:0/3409439336 shutdown_connections 2024-09-21T05:52:07.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.127+0000 7fe923ee6640 1 --2- 172.21.15.7:0/3409439336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe91c108420 0x7fe91c108830 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:07.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.127+0000 7fe923ee6640 1 --2- 172.21.15.7:0/3409439336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe91c108d70 0x7fe91c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:07.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.127+0000 7fe923ee6640 1 --2- 172.21.15.7:0/3409439336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe91c102ae0 0x7fe91c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:07.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.127+0000 7fe923ee6640 1 -- 172.21.15.7:0/3409439336 >> 172.21.15.7:0/3409439336 conn(0x7fe91c0796b0 msgr2=0x7fe91c079ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:07.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.127+0000 7fe923ee6640 1 -- 172.21.15.7:0/3409439336 shutdown_connections 2024-09-21T05:52:07.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.127+0000 7fe923ee6640 1 -- 172.21.15.7:0/3409439336 wait complete. 2024-09-21T05:52:07.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.128+0000 7fe923ee6640 1 Processor -- start 2024-09-21T05:52:07.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.128+0000 7fe923ee6640 1 -- start start 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.128+0000 7fe923ee6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe91c102ae0 0x7fe91c19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.128+0000 7fe923ee6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe91c108420 0x7fe91c19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.128+0000 7fe923ee6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe91c108d70 0x7fe91c19bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.128+0000 7fe923ee6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c112a80 con 0x7fe91c108d70 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.128+0000 7fe923ee6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c112900 con 0x7fe91c108420 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.128+0000 7fe923ee6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c112c00 con 0x7fe91c102ae0 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.128+0000 7fe922483640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe91c108d70 0x7fe91c19bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.128+0000 7fe922483640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe91c108d70 0x7fe91c19bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47004/0 (socket says 172.21.15.7:47004) 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.128+0000 7fe922483640 1 -- 172.21.15.7:0/3636683880 learned_addr learned my addr 172.21.15.7:0/3636683880 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.128+0000 7fe921481640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe91c108420 0x7fe91c19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.128+0000 7fe921c82640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe91c102ae0 0x7fe91c19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.129+0000 7fe922483640 1 -- 172.21.15.7:0/3636683880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe91c102ae0 msgr2=0x7fe91c19b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.129+0000 7fe922483640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe91c102ae0 0x7fe91c19b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.129+0000 7fe922483640 1 -- 172.21.15.7:0/3636683880 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe91c108420 msgr2=0x7fe91c19b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:07.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.129+0000 7fe922483640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe91c108420 0x7fe91c19b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:07.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.129+0000 7fe922483640 1 -- 172.21.15.7:0/3636683880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c1a65e0 con 0x7fe91c108d70 2024-09-21T05:52:07.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.129+0000 7fe921c82640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe91c102ae0 0x7fe91c19b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:07.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.129+0000 7fe922483640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe91c108d70 0x7fe91c19bdd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe91400eaa0 tx=0x7fe91400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:07.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.129+0000 7fe912ffd640 1 -- 172.21.15.7:0/3636683880 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91400cdb0 con 0x7fe91c108d70 2024-09-21T05:52:07.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.129+0000 7fe912ffd640 1 -- 172.21.15.7:0/3636683880 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe914005020 con 0x7fe91c108d70 2024-09-21T05:52:07.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.129+0000 7fe923ee6640 1 -- 172.21.15.7:0/3636683880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91c1a68d0 con 0x7fe91c108d70 2024-09-21T05:52:07.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.129+0000 7fe912ffd640 1 -- 172.21.15.7:0/3636683880 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9140116d0 con 0x7fe91c108d70 2024-09-21T05:52:07.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.129+0000 7fe923ee6640 1 -- 172.21.15.7:0/3636683880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91c1a6de0 con 0x7fe91c108d70 2024-09-21T05:52:07.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.130+0000 7fe923ee6640 1 -- 172.21.15.7:0/3636683880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe91c103d60 con 0x7fe91c108d70 2024-09-21T05:52:07.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.132+0000 7fe912ffd640 1 -- 172.21.15.7:0/3636683880 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fe9140051d0 con 0x7fe91c108d70 2024-09-21T05:52:07.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.133+0000 7fe912ffd640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe9080b66a0 0x7fe9080b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:07.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.133+0000 7fe921c82640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe9080b66a0 0x7fe9080b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:07.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.133+0000 7fe912ffd640 1 -- 172.21.15.7:0/3636683880 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7fe9140e7a60 con 0x7fe91c108d70 2024-09-21T05:52:07.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.133+0000 7fe921c82640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe9080b66a0 0x7fe9080b8bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe918005fd0 tx=0x7fe918005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:07.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.136+0000 7fe912ffd640 1 -- 172.21.15.7:0/3636683880 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe914016030 con 0x7fe91c108d70 2024-09-21T05:52:07.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.355+0000 7fe923ee6640 1 -- 172.21.15.7:0/3636683880 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fe91c063800 con 0x7fe9080b66a0 2024-09-21T05:52:07.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.361+0000 7fe912ffd640 1 -- 172.21.15.7:0/3636683880 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe91c063800 con 0x7fe9080b66a0 2024-09-21T05:52:07.363 INFO:teuthology.orchestra.run.smithi007.stdout:/volumes/qa/sv_0/2bb9eb95-ba73-4fb5-86be-376cd2418ec3 2024-09-21T05:52:07.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:07 smithi007 ceph-mon[30983]: pgmap v263: 97 pgs: 97 active+clean; 582 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-21T05:52:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.363+0000 7fe923ee6640 1 -- 172.21.15.7:0/3636683880 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe9080b66a0 msgr2=0x7fe9080b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.363+0000 7fe923ee6640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe9080b66a0 0x7fe9080b8bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe918005fd0 tx=0x7fe918005850 comp rx=0 tx=0).stop 2024-09-21T05:52:07.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.363+0000 7fe923ee6640 1 -- 172.21.15.7:0/3636683880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe91c108d70 msgr2=0x7fe91c19bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:07.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.363+0000 7fe923ee6640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe91c108d70 0x7fe91c19bdd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe91400eaa0 tx=0x7fe91400ef60 comp rx=0 tx=0).stop 2024-09-21T05:52:07.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.363+0000 7fe923ee6640 1 -- 172.21.15.7:0/3636683880 shutdown_connections 2024-09-21T05:52:07.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.363+0000 7fe923ee6640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe9080b66a0 0x7fe9080b8bb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:07.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.363+0000 7fe923ee6640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe91c108d70 0x7fe91c19bdd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:07.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.363+0000 7fe923ee6640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe91c108420 0x7fe91c19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:07.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.363+0000 7fe923ee6640 1 --2- 172.21.15.7:0/3636683880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe91c102ae0 0x7fe91c19b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:07.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.363+0000 7fe923ee6640 1 -- 172.21.15.7:0/3636683880 >> 172.21.15.7:0/3636683880 conn(0x7fe91c0796b0 msgr2=0x7fe91c104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:07.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.363+0000 7fe923ee6640 1 -- 172.21.15.7:0/3636683880 shutdown_connections 2024-09-21T05:52:07.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:07.363+0000 7fe923ee6640 1 -- 172.21.15.7:0/3636683880 wait complete. 2024-09-21T05:52:07.628 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:07 smithi027 ceph-mon[34364]: pgmap v263: 97 pgs: 97 active+clean; 582 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-21T05:52:07.755 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:07 smithi119 ceph-mon[34833]: pgmap v263: 97 pgs: 97 active+clean; 582 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-21T05:52:07.950 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T05:52:08.211 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:08 smithi007 ceph-mon[30983]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:08.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.710+0000 7f09feb2a640 1 -- 172.21.15.7:0/4205121962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8103b60 msgr2=0x7f09f8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:08.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.710+0000 7f09feb2a640 1 --2- 172.21.15.7:0/4205121962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8103b60 0x7f09f8103f70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009900 tx=0x7f09e802a410 comp rx=0 tx=0).stop 2024-09-21T05:52:08.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.710+0000 7f09feb2a640 1 -- 172.21.15.7:0/4205121962 shutdown_connections 2024-09-21T05:52:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.710+0000 7f09feb2a640 1 --2- 172.21.15.7:0/4205121962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f8109df0 0x7f09f8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.710+0000 7f09feb2a640 1 --2- 172.21.15.7:0/4205121962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f81094a0 0x7f09f81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.710+0000 7f09feb2a640 1 --2- 172.21.15.7:0/4205121962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8103b60 0x7f09f8103f70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.710+0000 7f09feb2a640 1 -- 172.21.15.7:0/4205121962 >> 172.21.15.7:0/4205121962 conn(0x7f09f807b850 msgr2=0x7f09f807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.710+0000 7f09feb2a640 1 -- 172.21.15.7:0/4205121962 shutdown_connections 2024-09-21T05:52:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.710+0000 7f09feb2a640 1 -- 172.21.15.7:0/4205121962 wait complete. 2024-09-21T05:52:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.710+0000 7f09feb2a640 1 Processor -- start 2024-09-21T05:52:08.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.710+0000 7f09feb2a640 1 -- start start 2024-09-21T05:52:08.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09feb2a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8103b60 0x7f09f819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:08.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09feb2a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f81094a0 0x7f09f819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:08.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09feb2a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f8109df0 0x7f09f819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:08.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09feb2a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09f8113ab0 con 0x7f09f8103b60 2024-09-21T05:52:08.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09feb2a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f09f8113930 con 0x7f09f8109df0 2024-09-21T05:52:08.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09feb2a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f09f8113c30 con 0x7f09f81094a0 2024-09-21T05:52:08.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09fc8c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8103b60 0x7f09f819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:08.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09fc8c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8103b60 0x7f09f819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55358/0 (socket says 172.21.15.7:55358) 2024-09-21T05:52:08.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09fc8c6640 1 -- 172.21.15.7:0/2754736162 learned_addr learned my addr 172.21.15.7:0/2754736162 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09f7fff640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f81094a0 0x7f09f819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09fd0c7640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f8109df0 0x7f09f819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09fc8c6640 1 -- 172.21.15.7:0/2754736162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f81094a0 msgr2=0x7f09f819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09fc8c6640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f81094a0 0x7f09f819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09fc8c6640 1 -- 172.21.15.7:0/2754736162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f8109df0 msgr2=0x7f09f819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09fc8c6640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f8109df0 0x7f09f819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09fc8c6640 1 -- 172.21.15.7:0/2754736162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f81a0410 con 0x7f09f8103b60 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09fd0c7640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f8109df0 0x7f09f819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.711+0000 7f09fc8c6640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8103b60 0x7f09f819a4a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f09e8005940 tx=0x7f09e80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.712+0000 7f09f5ffb640 1 -- 172.21.15.7:0/2754736162 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e803f030 con 0x7f09f8103b60 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.712+0000 7f09feb2a640 1 -- 172.21.15.7:0/2754736162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f81a06a0 con 0x7f09f8103b60 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.712+0000 7f09f5ffb640 1 -- 172.21.15.7:0/2754736162 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09e80044c0 con 0x7f09f8103b60 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.712+0000 7f09f5ffb640 1 -- 172.21.15.7:0/2754736162 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8035070 con 0x7f09f8103b60 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.712+0000 7f09feb2a640 1 -- 172.21.15.7:0/2754736162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f81a6e60 con 0x7f09f8103b60 2024-09-21T05:52:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.713+0000 7f09feb2a640 1 -- 172.21.15.7:0/2754736162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f8104de0 con 0x7f09f8103b60 2024-09-21T05:52:08.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.715+0000 7f09f5ffb640 1 -- 172.21.15.7:0/2754736162 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f09e8042030 con 0x7f09f8103b60 2024-09-21T05:52:08.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.715+0000 7f09f5ffb640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f09e00b65f0 0x7f09e00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:08.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.715+0000 7f09f5ffb640 1 -- 172.21.15.7:0/2754736162 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7f09e8107b50 con 0x7f09f8103b60 2024-09-21T05:52:08.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.715+0000 7f09f7fff640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f09e00b65f0 0x7f09e00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:08.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.716+0000 7f09f7fff640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f09e00b65f0 0x7f09e00b8b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f09f81091a0 tx=0x7f09ec005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:08.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.719+0000 7f09f5ffb640 1 -- 172.21.15.7:0/2754736162 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f09e80ce2a0 con 0x7f09f8103b60 2024-09-21T05:52:08.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:08 smithi027 ceph-mon[34364]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:08.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:08 smithi119 ceph-mon[34833]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:08.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.937+0000 7f09feb2a640 1 -- 172.21.15.7:0/2754736162 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f09f8063800 con 0x7f09e00b65f0 2024-09-21T05:52:08.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.961+0000 7f09f5ffb640 1 -- 172.21.15.7:0/2754736162 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f09f8063800 con 0x7f09e00b65f0 2024-09-21T05:52:08.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.963+0000 7f09feb2a640 1 -- 172.21.15.7:0/2754736162 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f09e00b65f0 msgr2=0x7f09e00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:08.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.963+0000 7f09feb2a640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f09e00b65f0 0x7f09e00b8b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f09f81091a0 tx=0x7f09ec005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.963+0000 7f09feb2a640 1 -- 172.21.15.7:0/2754736162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8103b60 msgr2=0x7f09f819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.963+0000 7f09feb2a640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8103b60 0x7f09f819a4a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f09e8005940 tx=0x7f09e80040c0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.963+0000 7f09feb2a640 1 -- 172.21.15.7:0/2754736162 shutdown_connections 2024-09-21T05:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.963+0000 7f09feb2a640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f09e00b65f0 0x7f09e00b8b00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.963+0000 7f09feb2a640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09f8109df0 0x7f09f819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.963+0000 7f09feb2a640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f81094a0 0x7f09f819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.963+0000 7f09feb2a640 1 --2- 172.21.15.7:0/2754736162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8103b60 0x7f09f819a4a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.963+0000 7f09feb2a640 1 -- 172.21.15.7:0/2754736162 >> 172.21.15.7:0/2754736162 conn(0x7f09f807b850 msgr2=0x7f09f8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.963+0000 7f09feb2a640 1 -- 172.21.15.7:0/2754736162 shutdown_connections 2024-09-21T05:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:08.963+0000 7f09feb2a640 1 -- 172.21.15.7:0/2754736162 wait complete. 2024-09-21T05:52:09.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:09 smithi007 ceph-mon[30983]: pgmap v264: 97 pgs: 97 active+clean; 609 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-09-21T05:52:09.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:09 smithi007 ceph-mon[30983]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:09.603 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T05:52:09.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:09 smithi027 ceph-mon[34364]: pgmap v264: 97 pgs: 97 active+clean; 609 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-09-21T05:52:09.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:09 smithi027 ceph-mon[34364]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:09.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:09 smithi119 ceph-mon[34833]: pgmap v264: 97 pgs: 97 active+clean; 609 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-09-21T05:52:09.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:09 smithi119 ceph-mon[34833]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:09.863 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:10.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.284+0000 7fafc20e0640 1 -- 172.21.15.7:0/2025611340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafbc108d70 msgr2=0x7fafbc10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:10.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.284+0000 7fafc20e0640 1 --2- 172.21.15.7:0/2025611340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafbc108d70 0x7fafbc10f5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009ca0 tx=0x7fafb402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:10.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.284+0000 7fafc20e0640 1 -- 172.21.15.7:0/2025611340 shutdown_connections 2024-09-21T05:52:10.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.284+0000 7fafc20e0640 1 --2- 172.21.15.7:0/2025611340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafbc108d70 0x7fafbc10f5a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:10.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.284+0000 7fafc20e0640 1 --2- 172.21.15.7:0/2025611340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafbc108420 0x7fafbc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:10.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.284+0000 7fafc20e0640 1 --2- 172.21.15.7:0/2025611340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafbc102ae0 0x7fafbc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:10.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.284+0000 7fafc20e0640 1 -- 172.21.15.7:0/2025611340 >> 172.21.15.7:0/2025611340 conn(0x7fafbc079770 msgr2=0x7fafbc079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:10.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.284+0000 7fafc20e0640 1 -- 172.21.15.7:0/2025611340 shutdown_connections 2024-09-21T05:52:10.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.284+0000 7fafc20e0640 1 -- 172.21.15.7:0/2025611340 wait complete. 2024-09-21T05:52:10.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.285+0000 7fafc20e0640 1 Processor -- start 2024-09-21T05:52:10.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.285+0000 7fafc20e0640 1 -- start start 2024-09-21T05:52:10.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafc20e0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafbc102ae0 0x7fafbc19c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:10.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafc20e0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafbc108420 0x7fafbc19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafc20e0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafbc108d70 0x7fafbc1a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafc20e0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc112a30 con 0x7fafbc108420 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafc20e0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc1128b0 con 0x7fafbc102ae0 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafc20e0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc112bb0 con 0x7fafbc108d70 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafbaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafbc108420 0x7fafbc19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafbb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafbc102ae0 0x7fafbc19c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafbbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafbc108d70 0x7fafbc1a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafbaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafbc108420 0x7fafbc19ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55376/0 (socket says 172.21.15.7:55376) 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafbaffd640 1 -- 172.21.15.7:0/4157092481 learned_addr learned my addr 172.21.15.7:0/4157092481 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafbaffd640 1 -- 172.21.15.7:0/4157092481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafbc108d70 msgr2=0x7fafbc1a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafbaffd640 1 --2- 172.21.15.7:0/4157092481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafbc108d70 0x7fafbc1a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafbaffd640 1 -- 172.21.15.7:0/4157092481 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafbc102ae0 msgr2=0x7fafbc19c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafbaffd640 1 --2- 172.21.15.7:0/4157092481 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafbc102ae0 0x7fafbc19c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafbaffd640 1 -- 172.21.15.7:0/4157092481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafbc1a25e0 con 0x7fafbc108420 2024-09-21T05:52:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.286+0000 7fafbaffd640 1 --2- 172.21.15.7:0/4157092481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafbc108420 0x7fafbc19ccd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fafb000d740 tx=0x7fafb000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.287+0000 7fafb8ff9640 1 -- 172.21.15.7:0/4157092481 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0017070 con 0x7fafbc108420 2024-09-21T05:52:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.287+0000 7fafb8ff9640 1 -- 172.21.15.7:0/4157092481 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafb0010460 con 0x7fafbc108420 2024-09-21T05:52:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.287+0000 7fafc20e0640 1 -- 172.21.15.7:0/4157092481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafbc1a28d0 con 0x7fafbc108420 2024-09-21T05:52:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.287+0000 7fafb8ff9640 1 -- 172.21.15.7:0/4157092481 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb000f600 con 0x7fafbc108420 2024-09-21T05:52:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.287+0000 7fafc20e0640 1 -- 172.21.15.7:0/4157092481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafbc1a90f0 con 0x7fafbc108420 2024-09-21T05:52:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.288+0000 7fafc20e0640 1 -- 172.21.15.7:0/4157092481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafbc103d60 con 0x7fafbc108420 2024-09-21T05:52:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.290+0000 7fafb8ff9640 1 -- 172.21.15.7:0/4157092481 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fafb001a070 con 0x7fafbc108420 2024-09-21T05:52:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.290+0000 7fafb8ff9640 1 --2- 172.21.15.7:0/4157092481 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fafa40b66a0 0x7fafa40b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.291+0000 7fafbb7fe640 1 --2- 172.21.15.7:0/4157092481 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fafa40b66a0 0x7fafa40b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.291+0000 7fafb8ff9640 1 -- 172.21.15.7:0/4157092481 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7fafb00e6d70 con 0x7fafbc108420 2024-09-21T05:52:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.291+0000 7fafbb7fe640 1 --2- 172.21.15.7:0/4157092481 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fafa40b66a0 0x7fafa40b8bb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fafac00abe0 tx=0x7fafac00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:10.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.295+0000 7fafb8ff9640 1 -- 172.21.15.7:0/4157092481 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fafb00ad4e0 con 0x7fafbc108420 2024-09-21T05:52:10.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.511+0000 7fafc20e0640 1 -- 172.21.15.7:0/4157092481 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fafbc063800 con 0x7fafa40b66a0 2024-09-21T05:52:10.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.516+0000 7fafb8ff9640 1 -- 172.21.15.7:0/4157092481 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fafbc063800 con 0x7fafa40b66a0 2024-09-21T05:52:10.518 INFO:teuthology.orchestra.run.smithi007.stdout:/volumes/qa/sv_1/d0c2e36f-f6f1-4af4-b189-75287cc7d12e 2024-09-21T05:52:10.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.518+0000 7fafc20e0640 1 -- 172.21.15.7:0/4157092481 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fafa40b66a0 msgr2=0x7fafa40b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:10.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.518+0000 7fafc20e0640 1 --2- 172.21.15.7:0/4157092481 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fafa40b66a0 0x7fafa40b8bb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fafac00abe0 tx=0x7fafac00a2d0 comp rx=0 tx=0).stop 2024-09-21T05:52:10.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.518+0000 7fafc20e0640 1 -- 172.21.15.7:0/4157092481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafbc108420 msgr2=0x7fafbc19ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:10.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.518+0000 7fafc20e0640 1 --2- 172.21.15.7:0/4157092481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafbc108420 0x7fafbc19ccd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fafb000d740 tx=0x7fafb000db40 comp rx=0 tx=0).stop 2024-09-21T05:52:10.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.518+0000 7fafc20e0640 1 -- 172.21.15.7:0/4157092481 shutdown_connections 2024-09-21T05:52:10.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.518+0000 7fafc20e0640 1 --2- 172.21.15.7:0/4157092481 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fafa40b66a0 0x7fafa40b8bb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:10.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.518+0000 7fafc20e0640 1 --2- 172.21.15.7:0/4157092481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafbc108420 0x7fafbc19ccd0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.518+0000 7fafc20e0640 1 --2- 172.21.15.7:0/4157092481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafbc108d70 0x7fafbc1a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.518+0000 7fafc20e0640 1 --2- 172.21.15.7:0/4157092481 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafbc102ae0 0x7fafbc19c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.518+0000 7fafc20e0640 1 -- 172.21.15.7:0/4157092481 >> 172.21.15.7:0/4157092481 conn(0x7fafbc079770 msgr2=0x7fafbc06bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.518+0000 7fafc20e0640 1 -- 172.21.15.7:0/4157092481 shutdown_connections 2024-09-21T05:52:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:10.518+0000 7fafc20e0640 1 -- 172.21.15.7:0/4157092481 wait complete. 2024-09-21T05:52:11.203 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:52:11.467 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:11.805 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:11 smithi007 ceph-mon[30983]: pgmap v265: 97 pgs: 97 active+clean; 609 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.1 KiB/s wr, 14 op/s 2024-09-21T05:52:11.805 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:11 smithi007 ceph-mon[30983]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:11 smithi119 ceph-mon[34833]: pgmap v265: 97 pgs: 97 active+clean; 609 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.1 KiB/s wr, 14 op/s 2024-09-21T05:52:11.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:11 smithi119 ceph-mon[34833]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:11.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.895+0000 7f3c10a94640 1 -- 172.21.15.7:0/3560287825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c0c108d10 msgr2=0x7f3c0c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:11.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.895+0000 7f3c10a94640 1 --2- 172.21.15.7:0/3560287825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c0c108d10 0x7f3c0c10f540 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009ca0 tx=0x7f3c0402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.895+0000 7f3c10a94640 1 -- 172.21.15.7:0/3560287825 shutdown_connections 2024-09-21T05:52:11.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.895+0000 7f3c10a94640 1 --2- 172.21.15.7:0/3560287825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c0c108d10 0x7f3c0c10f540 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.895+0000 7f3c10a94640 1 --2- 172.21.15.7:0/3560287825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c0c1083c0 0x7f3c0c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.895+0000 7f3c10a94640 1 --2- 172.21.15.7:0/3560287825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c0c102a80 0x7f3c0c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.895+0000 7f3c10a94640 1 -- 172.21.15.7:0/3560287825 >> 172.21.15.7:0/3560287825 conn(0x7f3c0c079740 msgr2=0x7f3c0c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:11.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.895+0000 7f3c10a94640 1 -- 172.21.15.7:0/3560287825 shutdown_connections 2024-09-21T05:52:11.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.895+0000 7f3c10a94640 1 -- 172.21.15.7:0/3560287825 wait complete. 2024-09-21T05:52:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.896+0000 7f3c10a94640 1 Processor -- start 2024-09-21T05:52:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.896+0000 7f3c10a94640 1 -- start start 2024-09-21T05:52:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c10a94640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c0c102a80 0x7f3c0c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c10a94640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c0c1083c0 0x7f3c0c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c10a94640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c0c108d10 0x7f3c0c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c10a94640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c112980 con 0x7f3c0c1083c0 2024-09-21T05:52:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c10a94640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c112800 con 0x7f3c0c108d10 2024-09-21T05:52:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c10a94640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c112b00 con 0x7f3c0c102a80 2024-09-21T05:52:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c01d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c0c1083c0 0x7f3c0c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c01d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c0c1083c0 0x7f3c0c19a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55380/0 (socket says 172.21.15.7:55380) 2024-09-21T05:52:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c01d9b640 1 -- 172.21.15.7:0/1823993398 learned_addr learned my addr 172.21.15.7:0/1823993398 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:11.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c0a59c640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c0c102a80 0x7f3c0c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:11.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c0ad9d640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c0c108d10 0x7f3c0c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:11.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c01d9b640 1 -- 172.21.15.7:0/1823993398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c0c102a80 msgr2=0x7f3c0c19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:11.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c01d9b640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c0c102a80 0x7f3c0c19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c01d9b640 1 -- 172.21.15.7:0/1823993398 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c0c108d10 msgr2=0x7f3c0c19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:11.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c01d9b640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c0c108d10 0x7f3c0c19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c01d9b640 1 -- 172.21.15.7:0/1823993398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c1a0390 con 0x7f3c0c1083c0 2024-09-21T05:52:11.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.897+0000 7f3c01d9b640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c0c1083c0 0x7f3c0c19a9c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400d740 tx=0x7f3bf400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:11.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.898+0000 7f3c03fff640 1 -- 172.21.15.7:0/1823993398 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4017070 con 0x7f3c0c1083c0 2024-09-21T05:52:11.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.898+0000 7f3c10a94640 1 -- 172.21.15.7:0/1823993398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0c1a0680 con 0x7f3c0c1083c0 2024-09-21T05:52:11.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.898+0000 7f3c03fff640 1 -- 172.21.15.7:0/1823993398 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bf400de50 con 0x7f3c0c1083c0 2024-09-21T05:52:11.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.898+0000 7f3c03fff640 1 -- 172.21.15.7:0/1823993398 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4004ce0 con 0x7f3c0c1083c0 2024-09-21T05:52:11.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.898+0000 7f3c10a94640 1 -- 172.21.15.7:0/1823993398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c0c1a6de0 con 0x7f3c0c1083c0 2024-09-21T05:52:11.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.899+0000 7f3c10a94640 1 -- 172.21.15.7:0/1823993398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c0c103d00 con 0x7f3c0c1083c0 2024-09-21T05:52:11.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.900+0000 7f3c03fff640 1 -- 172.21.15.7:0/1823993398 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f3bf4004e80 con 0x7f3c0c1083c0 2024-09-21T05:52:11.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.901+0000 7f3c03fff640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3bf80b65f0 0x7f3bf80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:11.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.901+0000 7f3c03fff640 1 -- 172.21.15.7:0/1823993398 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7f3bf40e7240 con 0x7f3c0c1083c0 2024-09-21T05:52:11.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.901+0000 7f3c0a59c640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3bf80b65f0 0x7f3bf80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:11.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.902+0000 7f3c0a59c640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3bf80b65f0 0x7f3bf80b8b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00bbe0 tx=0x7f3bfc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:11.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:11.904+0000 7f3c03fff640 1 -- 172.21.15.7:0/1823993398 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3bf40b1d10 con 0x7f3c0c1083c0 2024-09-21T05:52:11.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:11 smithi027 ceph-mon[34364]: pgmap v265: 97 pgs: 97 active+clean; 609 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.1 KiB/s wr, 14 op/s 2024-09-21T05:52:11.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:11 smithi027 ceph-mon[34364]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:12.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.135+0000 7f3c10a94640 1 -- 172.21.15.7:0/1823993398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c0c19b550 con 0x7f3c0c1083c0 2024-09-21T05:52:12.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.136+0000 7f3c03fff640 1 -- 172.21.15.7:0/1823993398 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11896 (secure 0 0 0) 0x7f3c0c19b550 con 0x7f3c0c1083c0 2024-09-21T05:52:12.138 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:52:12.138 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-21T05:52:02:324811+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:52:01.894944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24679,24686,24691]},"id":1}]} 2024-09-21T05:52:12.139 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T05:52:12.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.138+0000 7f3c10a94640 1 -- 172.21.15.7:0/1823993398 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3bf80b65f0 msgr2=0x7f3bf80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:12.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.138+0000 7f3c10a94640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3bf80b65f0 0x7f3bf80b8b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00bbe0 tx=0x7f3bfc00b390 comp rx=0 tx=0).stop 2024-09-21T05:52:12.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.138+0000 7f3c10a94640 1 -- 172.21.15.7:0/1823993398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c0c1083c0 msgr2=0x7f3c0c19a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:12.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.138+0000 7f3c10a94640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c0c1083c0 0x7f3c0c19a9c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400d740 tx=0x7f3bf400dc00 comp rx=0 tx=0).stop 2024-09-21T05:52:12.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.138+0000 7f3c10a94640 1 -- 172.21.15.7:0/1823993398 shutdown_connections 2024-09-21T05:52:12.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.138+0000 7f3c10a94640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3bf80b65f0 0x7f3bf80b8b00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:12.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.138+0000 7f3c10a94640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c0c1083c0 0x7f3c0c19a9c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:12.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.138+0000 7f3c10a94640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c0c108d10 0x7f3c0c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:12.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.138+0000 7f3c10a94640 1 --2- 172.21.15.7:0/1823993398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c0c102a80 0x7f3c0c19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:12.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.138+0000 7f3c10a94640 1 -- 172.21.15.7:0/1823993398 >> 172.21.15.7:0/1823993398 conn(0x7f3c0c079740 msgr2=0x7f3c0c06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:12.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.138+0000 7f3c10a94640 1 -- 172.21.15.7:0/1823993398 shutdown_connections 2024-09-21T05:52:12.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:12.138+0000 7f3c10a94640 1 -- 172.21.15.7:0/1823993398 wait complete. 2024-09-21T05:52:12.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:12 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1823993398' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:12.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:12 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1823993398' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:12.912 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:52:12.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:12 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1823993398' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:13.169 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:13.564 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:13 smithi007 ceph-mon[30983]: pgmap v266: 97 pgs: 97 active+clean; 609 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 KiB/s wr, 11 op/s 2024-09-21T05:52:13.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.596+0000 7f6119d86640 1 -- 172.21.15.7:0/2364413638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6114103b60 msgr2=0x7f6114103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:13.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.596+0000 7f6119d86640 1 --2- 172.21.15.7:0/2364413638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6114103b60 0x7f6114103f70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6104009900 tx=0x7f610402a410 comp rx=0 tx=0).stop 2024-09-21T05:52:13.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.596+0000 7f6119d86640 1 -- 172.21.15.7:0/2364413638 shutdown_connections 2024-09-21T05:52:13.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.596+0000 7f6119d86640 1 --2- 172.21.15.7:0/2364413638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6114109df0 0x7f6114110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.596+0000 7f6119d86640 1 --2- 172.21.15.7:0/2364413638 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61141094a0 0x7f61141098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.596+0000 7f6119d86640 1 --2- 172.21.15.7:0/2364413638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6114103b60 0x7f6114103f70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.596+0000 7f6119d86640 1 -- 172.21.15.7:0/2364413638 >> 172.21.15.7:0/2364413638 conn(0x7f611407b850 msgr2=0x7f611407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:13.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.596+0000 7f6119d86640 1 -- 172.21.15.7:0/2364413638 shutdown_connections 2024-09-21T05:52:13.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.596+0000 7f6119d86640 1 -- 172.21.15.7:0/2364413638 wait complete. 2024-09-21T05:52:13.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.597+0000 7f6119d86640 1 Processor -- start 2024-09-21T05:52:13.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.597+0000 7f6119d86640 1 -- start start 2024-09-21T05:52:13.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.597+0000 7f6119d86640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6114103b60 0x7f611419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:13.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.597+0000 7f6119d86640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61141094a0 0x7f611419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:13.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.597+0000 7f6119d86640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6114109df0 0x7f611419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.597+0000 7f6119d86640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6114113ab0 con 0x7f6114103b60 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.597+0000 7f6119d86640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6114113930 con 0x7f6114109df0 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.597+0000 7f6119d86640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6114113c30 con 0x7f61141094a0 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.597+0000 7f61137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6114103b60 0x7f611419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.597+0000 7f61137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6114103b60 0x7f611419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55392/0 (socket says 172.21.15.7:55392) 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.597+0000 7f61137fe640 1 -- 172.21.15.7:0/1902343637 learned_addr learned my addr 172.21.15.7:0/1902343637 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.597+0000 7f6112ffd640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61141094a0 0x7f611419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.598+0000 7f6113fff640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6114109df0 0x7f611419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.598+0000 7f61137fe640 1 -- 172.21.15.7:0/1902343637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61141094a0 msgr2=0x7f611419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.598+0000 7f61137fe640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61141094a0 0x7f611419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.598+0000 7f61137fe640 1 -- 172.21.15.7:0/1902343637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6114109df0 msgr2=0x7f611419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.598+0000 7f61137fe640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6114109df0 0x7f611419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.598+0000 7f61137fe640 1 -- 172.21.15.7:0/1902343637 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61141a03d0 con 0x7f6114103b60 2024-09-21T05:52:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.598+0000 7f61137fe640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6114103b60 0x7f611419a460 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6104005940 tx=0x7f61040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:13.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.598+0000 7f6110ff9640 1 -- 172.21.15.7:0/1902343637 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610403f030 con 0x7f6114103b60 2024-09-21T05:52:13.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.598+0000 7f6119d86640 1 -- 172.21.15.7:0/1902343637 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61141a0660 con 0x7f6114103b60 2024-09-21T05:52:13.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.598+0000 7f6110ff9640 1 -- 172.21.15.7:0/1902343637 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6104003cb0 con 0x7f6114103b60 2024-09-21T05:52:13.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.598+0000 7f6110ff9640 1 -- 172.21.15.7:0/1902343637 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104035070 con 0x7f6114103b60 2024-09-21T05:52:13.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.598+0000 7f6119d86640 1 -- 172.21.15.7:0/1902343637 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61141a6e20 con 0x7f6114103b60 2024-09-21T05:52:13.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.600+0000 7f6119d86640 1 -- 172.21.15.7:0/1902343637 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6114103f70 con 0x7f6114103b60 2024-09-21T05:52:13.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.601+0000 7f6110ff9640 1 -- 172.21.15.7:0/1902343637 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f6104042030 con 0x7f6114103b60 2024-09-21T05:52:13.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.601+0000 7f6110ff9640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f60fc0b65f0 0x7f60fc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:13.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.602+0000 7f6112ffd640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f60fc0b65f0 0x7f60fc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:13.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.602+0000 7f6110ff9640 1 -- 172.21.15.7:0/1902343637 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7f6104107ce0 con 0x7f6114103b60 2024-09-21T05:52:13.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.602+0000 7f6112ffd640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f60fc0b65f0 0x7f60fc0b8b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f61141064c0 tx=0x7f610800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:13.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.607+0000 7f6110ff9640 1 -- 172.21.15.7:0/1902343637 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61040d2810 con 0x7f6114103b60 2024-09-21T05:52:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.795+0000 7f6119d86640 1 -- 172.21.15.7:0/1902343637 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f611410bbc0 con 0x7f6114103b60 2024-09-21T05:52:13.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.797+0000 7f6110ff9640 1 -- 172.21.15.7:0/1902343637 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22496 (secure 0 0 0) 0x7f61040d7750 con 0x7f6114103b60 2024-09-21T05:52:13.799 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:52:13.799 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":73,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:43:32.863896+0000","modified":"2024-09-21T05:51:50.882965+0000","last_up_change":"2024-09-21T05:51:02.074799+0000","last_in_change":"2024-09-21T05:50:39.016405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:47:20.844179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:51:46.238763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:51:48.832249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d7a68ba-a599-44a9-a0de-a1d6df51f437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6803","nonce":536257283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6805","nonce":536257283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6809","nonce":536257283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6807","nonce":536257283}]},"public_addr":"172.21.15.7:6803/536257283","cluster_addr":"172.21.15.7:6805/536257283","heartbeat_back_addr":"172.21.15.7:6809/536257283","heartbeat_front_addr":"172.21.15.7:6807/536257283","state":["exists","up"]},{"osd":1,"uuid":"d4600805-1cb5-432a-8ae0-a40107a6c6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6801","nonce":2299402871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6803","nonce":2299402871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6807","nonce":2299402871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6805","nonce":2299402871}]},"public_addr":"172.21.15.27:6801/2299402871","cluster_addr":"172.21.15.27:6803/2299402871","heartbeat_back_addr":"172.21.15.27:6807/2299402871","heartbeat_front_addr":"172.21.15.27:6805/2299402871","state":["exists","up"]},{"osd":2,"uuid":"aa435f82-5819-4497-9053-1d891e712b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6801","nonce":1043408043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6803","nonce":1043408043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6807","nonce":1043408043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6805","nonce":1043408043}]},"public_addr":"172.21.15.119:6801/1043408043","cluster_addr":"172.21.15.119:6803/1043408043","heartbeat_back_addr":"172.21.15.119:6807/1043408043","heartbeat_front_addr":"172.21.15.119:6805/1043408043","state":["exists","up"]},{"osd":3,"uuid":"55803f97-02e1-43c0-b8da-9b8af32fd1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6811","nonce":1261229771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6813","nonce":1261229771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6817","nonce":1261229771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6815","nonce":1261229771}]},"public_addr":"172.21.15.7:6811/1261229771","cluster_addr":"172.21.15.7:6813/1261229771","heartbeat_back_addr":"172.21.15.7:6817/1261229771","heartbeat_front_addr":"172.21.15.7:6815/1261229771","state":["exists","up"]},{"osd":4,"uuid":"987ce230-5bfc-45a7-a33e-6291545afded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6809","nonce":631467792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6811","nonce":631467792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6815","nonce":631467792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6813","nonce":631467792}]},"public_addr":"172.21.15.27:6809/631467792","cluster_addr":"172.21.15.27:6811/631467792","heartbeat_back_addr":"172.21.15.27:6815/631467792","heartbeat_front_addr":"172.21.15.27:6813/631467792","state":["exists","up"]},{"osd":5,"uuid":"e768fbfa-8983-4ff6-8dca-b7df2304cf91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6809","nonce":2530968619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6811","nonce":2530968619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6815","nonce":2530968619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6813","nonce":2530968619}]},"public_addr":"172.21.15.119:6809/2530968619","cluster_addr":"172.21.15.119:6811/2530968619","heartbeat_back_addr":"172.21.15.119:6815/2530968619","heartbeat_front_addr":"172.21.15.119:6813/2530968619","state":["exists","up"]},{"osd":6,"uuid":"22496f13-64be-479b-89ea-bf51544199c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6819","nonce":856032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6821","nonce":856032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6825","nonce":856032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6823","nonce":856032021}]},"public_addr":"172.21.15.7:6819/856032021","cluster_addr":"172.21.15.7:6821/856032021","heartbeat_back_addr":"172.21.15.7:6825/856032021","heartbeat_front_addr":"172.21.15.7:6823/856032021","state":["exists","up"]},{"osd":7,"uuid":"53fc5616-b06a-498e-a60e-d7d7d6ba2a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6817","nonce":2862843529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6819","nonce":2862843529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6823","nonce":2862843529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6821","nonce":2862843529}]},"public_addr":"172.21.15.27:6817/2862843529","cluster_addr":"172.21.15.27:6819/2862843529","heartbeat_back_addr":"172.21.15.27:6823/2862843529","heartbeat_front_addr":"172.21.15.27:6821/2862843529","state":["exists","up"]},{"osd":8,"uuid":"53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6817","nonce":3663835202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6819","nonce":3663835202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6823","nonce":3663835202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6821","nonce":3663835202}]},"public_addr":"172.21.15.119:6817/3663835202","cluster_addr":"172.21.15.119:6819/3663835202","heartbeat_back_addr":"172.21.15.119:6823/3663835202","heartbeat_front_addr":"172.21.15.119:6821/3663835202","state":["exists","up"]},{"osd":9,"uuid":"a69a747d-1e6c-4940-9d96-4315ab384588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6827","nonce":2348805959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6829","nonce":2348805959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6833","nonce":2348805959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6831","nonce":2348805959}]},"public_addr":"172.21.15.7:6827/2348805959","cluster_addr":"172.21.15.7:6829/2348805959","heartbeat_back_addr":"172.21.15.7:6833/2348805959","heartbeat_front_addr":"172.21.15.7:6831/2348805959","state":["exists","up"]},{"osd":10,"uuid":"a8f67271-99bb-4fb7-b0f5-a24730cd96cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6825","nonce":2363600090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6827","nonce":2363600090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6831","nonce":2363600090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6829","nonce":2363600090}]},"public_addr":"172.21.15.27:6825/2363600090","cluster_addr":"172.21.15.27:6827/2363600090","heartbeat_back_addr":"172.21.15.27:6831/2363600090","heartbeat_front_addr":"172.21.15.27:6829/2363600090","state":["exists","up"]},{"osd":11,"uuid":"88456735-00b1-479c-b201-588a9ee0c881","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6825","nonce":3937692826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6827","nonce":3937692826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6831","nonce":3937692826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6829","nonce":3937692826}]},"public_addr":"172.21.15.119:6825/3937692826","cluster_addr":"172.21.15.119:6827/3937692826","heartbeat_back_addr":"172.21.15.119:6831/3937692826","heartbeat_front_addr":"172.21.15.119:6829/3937692826","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:26.217550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:51.830871+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:17.201362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:41.990894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:07.357782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.114180+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:56.808155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:22.565234+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:46.981522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:10.600602+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:35.973766+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:51:00.216062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/4143746508":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/1505943829":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/1622456881":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/833696585":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/2055984288":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6801/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3995317885":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2229583478":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/468393974":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/1009303060":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2125734440":"2024-09-22T05:45:22.373420+0000","172.21.15.7:6800/3995317885":"2024-09-22T05:45:22.373420+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:52:13.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.799+0000 7f6119d86640 1 -- 172.21.15.7:0/1902343637 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f60fc0b65f0 msgr2=0x7f60fc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:13.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.799+0000 7f6119d86640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f60fc0b65f0 0x7f60fc0b8b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f61141064c0 tx=0x7f610800b410 comp rx=0 tx=0).stop 2024-09-21T05:52:13.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.799+0000 7f6119d86640 1 -- 172.21.15.7:0/1902343637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6114103b60 msgr2=0x7f611419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:13.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.799+0000 7f6119d86640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6114103b60 0x7f611419a460 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6104005940 tx=0x7f61040042f0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.799+0000 7f6119d86640 1 -- 172.21.15.7:0/1902343637 shutdown_connections 2024-09-21T05:52:13.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.799+0000 7f6119d86640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f60fc0b65f0 0x7f60fc0b8b00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.799+0000 7f6119d86640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6114109df0 0x7f611419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.799+0000 7f6119d86640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61141094a0 0x7f611419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.799+0000 7f6119d86640 1 --2- 172.21.15.7:0/1902343637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6114103b60 0x7f611419a460 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.799+0000 7f6119d86640 1 -- 172.21.15.7:0/1902343637 >> 172.21.15.7:0/1902343637 conn(0x7f611407b850 msgr2=0x7f6114107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:13.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.799+0000 7f6119d86640 1 -- 172.21.15.7:0/1902343637 shutdown_connections 2024-09-21T05:52:13.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:13.799+0000 7f6119d86640 1 -- 172.21.15.7:0/1902343637 wait complete. 2024-09-21T05:52:13.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:13 smithi119 ceph-mon[34833]: pgmap v266: 97 pgs: 97 active+clean; 609 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 KiB/s wr, 11 op/s 2024-09-21T05:52:13.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:13 smithi027 ceph-mon[34364]: pgmap v266: 97 pgs: 97 active+clean; 609 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 KiB/s wr, 11 op/s 2024-09-21T05:52:14.430 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T05:52:14.430 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:52:14.693 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:14.814 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:14 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1902343637' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:14.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:14 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1902343637' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:14.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:14 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1902343637' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.134+0000 7f60f239b640 1 -- 172.21.15.7:0/2302169356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec109df0 msgr2=0x7f60ec110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.134+0000 7f60f239b640 1 --2- 172.21.15.7:0/2302169356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec109df0 0x7f60ec110620 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009ca0 tx=0x7f60e402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.134+0000 7f60f239b640 1 -- 172.21.15.7:0/2302169356 shutdown_connections 2024-09-21T05:52:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.134+0000 7f60f239b640 1 --2- 172.21.15.7:0/2302169356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec109df0 0x7f60ec110620 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.134+0000 7f60f239b640 1 --2- 172.21.15.7:0/2302169356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ec1094a0 0x7f60ec1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.134+0000 7f60f239b640 1 --2- 172.21.15.7:0/2302169356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60ec103b60 0x7f60ec103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.134+0000 7f60f239b640 1 -- 172.21.15.7:0/2302169356 >> 172.21.15.7:0/2302169356 conn(0x7f60ec07b850 msgr2=0x7f60ec07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:15.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.134+0000 7f60f239b640 1 -- 172.21.15.7:0/2302169356 shutdown_connections 2024-09-21T05:52:15.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.134+0000 7f60f239b640 1 -- 172.21.15.7:0/2302169356 wait complete. 2024-09-21T05:52:15.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.135+0000 7f60f239b640 1 Processor -- start 2024-09-21T05:52:15.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.135+0000 7f60f239b640 1 -- start start 2024-09-21T05:52:15.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60f239b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec103b60 0x7f60ec19c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:15.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60f239b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60ec1094a0 0x7f60ec19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:15.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60f239b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ec109df0 0x7f60ec1a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:15.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60f239b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec113ab0 con 0x7f60ec103b60 2024-09-21T05:52:15.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60f239b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec113930 con 0x7f60ec109df0 2024-09-21T05:52:15.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60f239b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec113c30 con 0x7f60ec1094a0 2024-09-21T05:52:15.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60ebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec103b60 0x7f60ec19c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:15.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60ebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec103b60 0x7f60ec19c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55406/0 (socket says 172.21.15.7:55406) 2024-09-21T05:52:15.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60ebfff640 1 -- 172.21.15.7:0/1452243577 learned_addr learned my addr 172.21.15.7:0/1452243577 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:15.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60f0938640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ec109df0 0x7f60ec1a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:15.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60eb7fe640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60ec1094a0 0x7f60ec19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60ebfff640 1 -- 172.21.15.7:0/1452243577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60ec1094a0 msgr2=0x7f60ec19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60ebfff640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60ec1094a0 0x7f60ec19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60ebfff640 1 -- 172.21.15.7:0/1452243577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ec109df0 msgr2=0x7f60ec1a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60ebfff640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ec109df0 0x7f60ec1a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60ebfff640 1 -- 172.21.15.7:0/1452243577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec1a2630 con 0x7f60ec103b60 2024-09-21T05:52:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60eb7fe640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60ec1094a0 0x7f60ec19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:52:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.136+0000 7f60ebfff640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec103b60 0x7f60ec19c6c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00d950 tx=0x7f60dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.137+0000 7f60e97fa640 1 -- 172.21.15.7:0/1452243577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc017030 con 0x7f60ec103b60 2024-09-21T05:52:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.137+0000 7f60f239b640 1 -- 172.21.15.7:0/1452243577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ec1a2920 con 0x7f60ec103b60 2024-09-21T05:52:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.137+0000 7f60e97fa640 1 -- 172.21.15.7:0/1452243577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60dc004020 con 0x7f60ec103b60 2024-09-21T05:52:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.137+0000 7f60e97fa640 1 -- 172.21.15.7:0/1452243577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0047a0 con 0x7f60ec103b60 2024-09-21T05:52:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.137+0000 7f60f239b640 1 -- 172.21.15.7:0/1452243577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ec1a9080 con 0x7f60ec103b60 2024-09-21T05:52:15.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.138+0000 7f60f239b640 1 -- 172.21.15.7:0/1452243577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60ec103f70 con 0x7f60ec103b60 2024-09-21T05:52:15.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.139+0000 7f60e97fa640 1 -- 172.21.15.7:0/1452243577 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f60dc009a30 con 0x7f60ec103b60 2024-09-21T05:52:15.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.140+0000 7f60e97fa640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f60d40b65f0 0x7f60d40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:15.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.140+0000 7f60eb7fe640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f60d40b65f0 0x7f60d40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:15.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.140+0000 7f60e97fa640 1 -- 172.21.15.7:0/1452243577 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7f60dc0e7570 con 0x7f60ec103b60 2024-09-21T05:52:15.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.140+0000 7f60eb7fe640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f60d40b65f0 0x7f60d40b8b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f60ec108fd0 tx=0x7f60e0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:15.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.143+0000 7f60e97fa640 1 -- 172.21.15.7:0/1452243577 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60dc0adcc0 con 0x7f60ec103b60 2024-09-21T05:52:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.330+0000 7f60f239b640 1 -- 172.21.15.7:0/1452243577 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60ec107a20 con 0x7f60d40b65f0 2024-09-21T05:52:15.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.335+0000 7f60e97fa640 1 -- 172.21.15.7:0/1452243577 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258701 (secure 0 0 0) 0x7f60ec107a20 con 0x7f60d40b65f0 2024-09-21T05:52:15.339 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:52:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T05:52:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.338+0000 7f60f239b640 1 -- 172.21.15.7:0/1452243577 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f60d40b65f0 msgr2=0x7f60d40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.338+0000 7f60f239b640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f60d40b65f0 0x7f60d40b8b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f60ec108fd0 tx=0x7f60e0005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.338+0000 7f60f239b640 1 -- 172.21.15.7:0/1452243577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec103b60 msgr2=0x7f60ec19c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.338+0000 7f60f239b640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec103b60 0x7f60ec19c6c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00d950 tx=0x7f60dc00de10 comp rx=0 tx=0).stop 2024-09-21T05:52:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.338+0000 7f60f239b640 1 -- 172.21.15.7:0/1452243577 shutdown_connections 2024-09-21T05:52:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.338+0000 7f60f239b640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f60d40b65f0 0x7f60d40b8b00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.338+0000 7f60f239b640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60ec109df0 0x7f60ec1a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.338+0000 7f60f239b640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60ec1094a0 0x7f60ec19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.338+0000 7f60f239b640 1 --2- 172.21.15.7:0/1452243577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec103b60 0x7f60ec19c6c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.338+0000 7f60f239b640 1 -- 172.21.15.7:0/1452243577 >> 172.21.15.7:0/1452243577 conn(0x7f60ec07b850 msgr2=0x7f60ec107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.338+0000 7f60f239b640 1 -- 172.21.15.7:0/1452243577 shutdown_connections 2024-09-21T05:52:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:15.338+0000 7f60f239b640 1 -- 172.21.15.7:0/1452243577 wait complete. 2024-09-21T05:52:15.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:15 smithi007 ceph-mon[30983]: pgmap v267: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-09-21T05:52:15.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:15 smithi119 ceph-mon[34833]: pgmap v267: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-09-21T05:52:15.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:15 smithi027 ceph-mon[34364]: pgmap v267: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-09-21T05:52:16.006 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2024-09-21T05:52:14.468573+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648853,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":185,"num_read_kb":183,"num_write":282,"num_write_kb":2255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":389668,"kb_used_data":11300,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124552156,"statfs":{"total":1151940427776,"available":1151541407744,"internally_reserved":0,"allocated":11571200,"data_stored":6594092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53555,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":102,"num_read_kb":112,"num_write":68,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003476"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267754+0000","last_change":"2024-09-21T05:51:50.266316+0000","last_active":"2024-09-21T05:51:51.267754+0000","last_peered":"2024-09-21T05:51:51.267754+0000","last_clean":"2024-09-21T05:51:51.267754+0000","last_became_active":"2024-09-21T05:51:50.265970+0000","last_became_peered":"2024-09-21T05:51:50.265970+0000","last_unstale":"2024-09-21T05:51:51.267754+0000","last_undegraded":"2024-09-21T05:51:51.267754+0000","last_fullsized":"2024-09-21T05:51:51.267754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:31.728635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.272046+0000","last_change":"2024-09-21T05:51:50.254215+0000","last_active":"2024-09-21T05:51:51.272046+0000","last_peered":"2024-09-21T05:51:51.272046+0000","last_clean":"2024-09-21T05:51:51.272046+0000","last_became_active":"2024-09-21T05:51:50.253701+0000","last_became_peered":"2024-09-21T05:51:50.253701+0000","last_unstale":"2024-09-21T05:51:51.272046+0000","last_undegraded":"2024-09-21T05:51:51.272046+0000","last_fullsized":"2024-09-21T05:51:51.272046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:56.211706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271299+0000","last_change":"2024-09-21T05:51:50.258535+0000","last_active":"2024-09-21T05:51:51.271299+0000","last_peered":"2024-09-21T05:51:51.271299+0000","last_clean":"2024-09-21T05:51:51.271299+0000","last_became_active":"2024-09-21T05:51:50.258186+0000","last_became_peered":"2024-09-21T05:51:50.258186+0000","last_unstale":"2024-09-21T05:51:51.271299+0000","last_undegraded":"2024-09-21T05:51:51.271299+0000","last_fullsized":"2024-09-21T05:51:51.271299+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:15.134574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.251807+0000","last_change":"2024-09-21T05:51:50.254832+0000","last_active":"2024-09-21T05:51:51.251807+0000","last_peered":"2024-09-21T05:51:51.251807+0000","last_clean":"2024-09-21T05:51:51.251807+0000","last_became_active":"2024-09-21T05:51:50.254449+0000","last_became_peered":"2024-09-21T05:51:50.254449+0000","last_unstale":"2024-09-21T05:51:51.251807+0000","last_undegraded":"2024-09-21T05:51:51.251807+0000","last_fullsized":"2024-09-21T05:51:51.251807+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:31.411808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264279+0000","last_change":"2024-09-21T05:51:50.251144+0000","last_active":"2024-09-21T05:51:51.264279+0000","last_peered":"2024-09-21T05:51:51.264279+0000","last_clean":"2024-09-21T05:51:51.264279+0000","last_became_active":"2024-09-21T05:51:50.250782+0000","last_became_peered":"2024-09-21T05:51:50.250782+0000","last_unstale":"2024-09-21T05:51:51.264279+0000","last_undegraded":"2024-09-21T05:51:51.264279+0000","last_fullsized":"2024-09-21T05:51:51.264279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:15.055805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264559+0000","last_change":"2024-09-21T05:51:50.259758+0000","last_active":"2024-09-21T05:51:51.264559+0000","last_peered":"2024-09-21T05:51:51.264559+0000","last_clean":"2024-09-21T05:51:51.264559+0000","last_became_active":"2024-09-21T05:51:50.259358+0000","last_became_peered":"2024-09-21T05:51:50.259358+0000","last_unstale":"2024-09-21T05:51:51.264559+0000","last_undegraded":"2024-09-21T05:51:51.264559+0000","last_fullsized":"2024-09-21T05:51:51.264559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:08.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.268868+0000","last_change":"2024-09-21T05:51:50.260018+0000","last_active":"2024-09-21T05:51:51.268868+0000","last_peered":"2024-09-21T05:51:51.268868+0000","last_clean":"2024-09-21T05:51:51.268868+0000","last_became_active":"2024-09-21T05:51:50.257143+0000","last_became_peered":"2024-09-21T05:51:50.257143+0000","last_unstale":"2024-09-21T05:51:51.268868+0000","last_undegraded":"2024-09-21T05:51:51.268868+0000","last_fullsized":"2024-09-21T05:51:51.268868+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:05.579662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265317+0000","last_change":"2024-09-21T05:51:50.256867+0000","last_active":"2024-09-21T05:51:51.265317+0000","last_peered":"2024-09-21T05:51:51.265317+0000","last_clean":"2024-09-21T05:51:51.265317+0000","last_became_active":"2024-09-21T05:51:50.256392+0000","last_became_peered":"2024-09-21T05:51:50.256392+0000","last_unstale":"2024-09-21T05:51:51.265317+0000","last_undegraded":"2024-09-21T05:51:51.265317+0000","last_fullsized":"2024-09-21T05:51:51.265317+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:43.169607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.270715+0000","last_change":"2024-09-21T05:51:50.260430+0000","last_active":"2024-09-21T05:51:51.270715+0000","last_peered":"2024-09-21T05:51:51.270715+0000","last_clean":"2024-09-21T05:51:51.270715+0000","last_became_active":"2024-09-21T05:51:50.259993+0000","last_became_peered":"2024-09-21T05:51:50.259993+0000","last_unstale":"2024-09-21T05:51:51.270715+0000","last_undegraded":"2024-09-21T05:51:51.270715+0000","last_fullsized":"2024-09-21T05:51:51.270715+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:31.811151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265402+0000","last_change":"2024-09-21T05:51:50.263027+0000","last_active":"2024-09-21T05:51:51.265402+0000","last_peered":"2024-09-21T05:51:51.265402+0000","last_clean":"2024-09-21T05:51:51.265402+0000","last_became_active":"2024-09-21T05:51:50.261816+0000","last_became_peered":"2024-09-21T05:51:50.261816+0000","last_unstale":"2024-09-21T05:51:51.265402+0000","last_undegraded":"2024-09-21T05:51:51.265402+0000","last_fullsized":"2024-09-21T05:51:51.265402+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:39.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271157+0000","last_change":"2024-09-21T05:51:50.263976+0000","last_active":"2024-09-21T05:51:51.271157+0000","last_peered":"2024-09-21T05:51:51.271157+0000","last_clean":"2024-09-21T05:51:51.271157+0000","last_became_active":"2024-09-21T05:51:50.263179+0000","last_became_peered":"2024-09-21T05:51:50.263179+0000","last_unstale":"2024-09-21T05:51:51.271157+0000","last_undegraded":"2024-09-21T05:51:51.271157+0000","last_fullsized":"2024-09-21T05:51:51.271157+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:08.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.251802+0000","last_change":"2024-09-21T05:51:50.259967+0000","last_active":"2024-09-21T05:51:51.251802+0000","last_peered":"2024-09-21T05:51:51.251802+0000","last_clean":"2024-09-21T05:51:51.251802+0000","last_became_active":"2024-09-21T05:51:50.259460+0000","last_became_peered":"2024-09-21T05:51:50.259460+0000","last_unstale":"2024-09-21T05:51:51.251802+0000","last_undegraded":"2024-09-21T05:51:51.251802+0000","last_fullsized":"2024-09-21T05:51:51.251802+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:48.576362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.245942+0000","last_change":"2024-09-21T05:51:50.252949+0000","last_active":"2024-09-21T05:51:51.245942+0000","last_peered":"2024-09-21T05:51:51.245942+0000","last_clean":"2024-09-21T05:51:51.245942+0000","last_became_active":"2024-09-21T05:51:50.252518+0000","last_became_peered":"2024-09-21T05:51:50.252518+0000","last_unstale":"2024-09-21T05:51:51.245942+0000","last_undegraded":"2024-09-21T05:51:51.245942+0000","last_fullsized":"2024-09-21T05:51:51.245942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:38.145947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271193+0000","last_change":"2024-09-21T05:51:50.250309+0000","last_active":"2024-09-21T05:51:51.271193+0000","last_peered":"2024-09-21T05:51:51.271193+0000","last_clean":"2024-09-21T05:51:51.271193+0000","last_became_active":"2024-09-21T05:51:50.249629+0000","last_became_peered":"2024-09-21T05:51:50.249629+0000","last_unstale":"2024-09-21T05:51:51.271193+0000","last_undegraded":"2024-09-21T05:51:51.271193+0000","last_fullsized":"2024-09-21T05:51:51.271193+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:28.551654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271134+0000","last_change":"2024-09-21T05:51:50.242211+0000","last_active":"2024-09-21T05:51:51.271134+0000","last_peered":"2024-09-21T05:51:51.271134+0000","last_clean":"2024-09-21T05:51:51.271134+0000","last_became_active":"2024-09-21T05:51:50.241861+0000","last_became_peered":"2024-09-21T05:51:50.241861+0000","last_unstale":"2024-09-21T05:51:51.271134+0000","last_undegraded":"2024-09-21T05:51:51.271134+0000","last_fullsized":"2024-09-21T05:51:51.271134+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:46.045907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.268362+0000","last_change":"2024-09-21T05:51:50.268926+0000","last_active":"2024-09-21T05:51:51.268362+0000","last_peered":"2024-09-21T05:51:51.268362+0000","last_clean":"2024-09-21T05:51:51.268362+0000","last_became_active":"2024-09-21T05:51:50.268164+0000","last_became_peered":"2024-09-21T05:51:50.268164+0000","last_unstale":"2024-09-21T05:51:51.268362+0000","last_undegraded":"2024-09-21T05:51:51.268362+0000","last_fullsized":"2024-09-21T05:51:51.268362+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:43.021303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267172+0000","last_change":"2024-09-21T05:51:50.266365+0000","last_active":"2024-09-21T05:51:51.267172+0000","last_peered":"2024-09-21T05:51:51.267172+0000","last_clean":"2024-09-21T05:51:51.267172+0000","last_became_active":"2024-09-21T05:51:50.265803+0000","last_became_peered":"2024-09-21T05:51:50.265803+0000","last_unstale":"2024-09-21T05:51:51.267172+0000","last_undegraded":"2024-09-21T05:51:51.267172+0000","last_fullsized":"2024-09-21T05:51:51.267172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:45.574795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264351+0000","last_change":"2024-09-21T05:51:50.257129+0000","last_active":"2024-09-21T05:51:51.264351+0000","last_peered":"2024-09-21T05:51:51.264351+0000","last_clean":"2024-09-21T05:51:51.264351+0000","last_became_active":"2024-09-21T05:51:50.256721+0000","last_became_peered":"2024-09-21T05:51:50.256721+0000","last_unstale":"2024-09-21T05:51:51.264351+0000","last_undegraded":"2024-09-21T05:51:51.264351+0000","last_fullsized":"2024-09-21T05:51:51.264351+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:26.688743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.247221+0000","last_change":"2024-09-21T05:51:50.243460+0000","last_active":"2024-09-21T05:51:51.247221+0000","last_peered":"2024-09-21T05:51:51.247221+0000","last_clean":"2024-09-21T05:51:51.247221+0000","last_became_active":"2024-09-21T05:51:50.243094+0000","last_became_peered":"2024-09-21T05:51:50.243094+0000","last_unstale":"2024-09-21T05:51:51.247221+0000","last_undegraded":"2024-09-21T05:51:51.247221+0000","last_fullsized":"2024-09-21T05:51:51.247221+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:16.751564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264983+0000","last_change":"2024-09-21T05:51:50.257571+0000","last_active":"2024-09-21T05:51:51.264983+0000","last_peered":"2024-09-21T05:51:51.264983+0000","last_clean":"2024-09-21T05:51:51.264983+0000","last_became_active":"2024-09-21T05:51:50.257193+0000","last_became_peered":"2024-09-21T05:51:50.257193+0000","last_unstale":"2024-09-21T05:51:51.264983+0000","last_undegraded":"2024-09-21T05:51:51.264983+0000","last_fullsized":"2024-09-21T05:51:51.264983+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:52.710859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.246061+0000","last_change":"2024-09-21T05:51:50.251288+0000","last_active":"2024-09-21T05:51:51.246061+0000","last_peered":"2024-09-21T05:51:51.246061+0000","last_clean":"2024-09-21T05:51:51.246061+0000","last_became_active":"2024-09-21T05:51:50.250841+0000","last_became_peered":"2024-09-21T05:51:50.250841+0000","last_unstale":"2024-09-21T05:51:51.246061+0000","last_undegraded":"2024-09-21T05:51:51.246061+0000","last_fullsized":"2024-09-21T05:51:51.246061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:44.196822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.268603+0000","last_change":"2024-09-21T05:51:50.259418+0000","last_active":"2024-09-21T05:51:51.268603+0000","last_peered":"2024-09-21T05:51:51.268603+0000","last_clean":"2024-09-21T05:51:51.268603+0000","last_became_active":"2024-09-21T05:51:50.257641+0000","last_became_peered":"2024-09-21T05:51:50.257641+0000","last_unstale":"2024-09-21T05:51:51.268603+0000","last_undegraded":"2024-09-21T05:51:51.268603+0000","last_fullsized":"2024-09-21T05:51:51.268603+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:23.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265590+0000","last_change":"2024-09-21T05:51:50.252746+0000","last_active":"2024-09-21T05:51:51.265590+0000","last_peered":"2024-09-21T05:51:51.265590+0000","last_clean":"2024-09-21T05:51:51.265590+0000","last_became_active":"2024-09-21T05:51:50.250551+0000","last_became_peered":"2024-09-21T05:51:50.250551+0000","last_unstale":"2024-09-21T05:51:51.265590+0000","last_undegraded":"2024-09-21T05:51:51.265590+0000","last_fullsized":"2024-09-21T05:51:51.265590+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:05.821737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267031+0000","last_change":"2024-09-21T05:51:50.246170+0000","last_active":"2024-09-21T05:51:51.267031+0000","last_peered":"2024-09-21T05:51:51.267031+0000","last_clean":"2024-09-21T05:51:51.267031+0000","last_became_active":"2024-09-21T05:51:50.245747+0000","last_became_peered":"2024-09-21T05:51:50.245747+0000","last_unstale":"2024-09-21T05:51:51.267031+0000","last_undegraded":"2024-09-21T05:51:51.267031+0000","last_fullsized":"2024-09-21T05:51:51.267031+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:05.005437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267389+0000","last_change":"2024-09-21T05:51:50.258248+0000","last_active":"2024-09-21T05:51:51.267389+0000","last_peered":"2024-09-21T05:51:51.267389+0000","last_clean":"2024-09-21T05:51:51.267389+0000","last_became_active":"2024-09-21T05:51:50.257891+0000","last_became_peered":"2024-09-21T05:51:50.257891+0000","last_unstale":"2024-09-21T05:51:51.267389+0000","last_undegraded":"2024-09-21T05:51:51.267389+0000","last_fullsized":"2024-09-21T05:51:51.267389+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:44.093064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.247368+0000","last_change":"2024-09-21T05:51:50.258497+0000","last_active":"2024-09-21T05:51:51.247368+0000","last_peered":"2024-09-21T05:51:51.247368+0000","last_clean":"2024-09-21T05:51:51.247368+0000","last_became_active":"2024-09-21T05:51:50.257633+0000","last_became_peered":"2024-09-21T05:51:50.257633+0000","last_unstale":"2024-09-21T05:51:51.247368+0000","last_undegraded":"2024-09-21T05:51:51.247368+0000","last_fullsized":"2024-09-21T05:51:51.247368+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:41.793650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.266616+0000","last_change":"2024-09-21T05:51:50.255336+0000","last_active":"2024-09-21T05:51:51.266616+0000","last_peered":"2024-09-21T05:51:51.266616+0000","last_clean":"2024-09-21T05:51:51.266616+0000","last_became_active":"2024-09-21T05:51:50.254955+0000","last_became_peered":"2024-09-21T05:51:50.254955+0000","last_unstale":"2024-09-21T05:51:51.266616+0000","last_undegraded":"2024-09-21T05:51:51.266616+0000","last_fullsized":"2024-09-21T05:51:51.266616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:28.198455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.246104+0000","last_change":"2024-09-21T05:51:50.242391+0000","last_active":"2024-09-21T05:51:51.246104+0000","last_peered":"2024-09-21T05:51:51.246104+0000","last_clean":"2024-09-21T05:51:51.246104+0000","last_became_active":"2024-09-21T05:51:50.242055+0000","last_became_peered":"2024-09-21T05:51:50.242055+0000","last_unstale":"2024-09-21T05:51:51.246104+0000","last_undegraded":"2024-09-21T05:51:51.246104+0000","last_fullsized":"2024-09-21T05:51:51.246104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:48.937516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271547+0000","last_change":"2024-09-21T05:51:50.243343+0000","last_active":"2024-09-21T05:51:51.271547+0000","last_peered":"2024-09-21T05:51:51.271547+0000","last_clean":"2024-09-21T05:51:51.271547+0000","last_became_active":"2024-09-21T05:51:50.243005+0000","last_became_peered":"2024-09-21T05:51:50.243005+0000","last_unstale":"2024-09-21T05:51:51.271547+0000","last_undegraded":"2024-09-21T05:51:51.271547+0000","last_fullsized":"2024-09-21T05:51:51.271547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:51.975966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.246671+0000","last_change":"2024-09-21T05:51:50.250290+0000","last_active":"2024-09-21T05:51:51.246671+0000","last_peered":"2024-09-21T05:51:51.246671+0000","last_clean":"2024-09-21T05:51:51.246671+0000","last_became_active":"2024-09-21T05:51:50.249867+0000","last_became_peered":"2024-09-21T05:51:50.249867+0000","last_unstale":"2024-09-21T05:51:51.246671+0000","last_undegraded":"2024-09-21T05:51:51.246671+0000","last_fullsized":"2024-09-21T05:51:51.246671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:33.852383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.246857+0000","last_change":"2024-09-21T05:51:50.244908+0000","last_active":"2024-09-21T05:51:51.246857+0000","last_peered":"2024-09-21T05:51:51.246857+0000","last_clean":"2024-09-21T05:51:51.246857+0000","last_became_active":"2024-09-21T05:51:50.244473+0000","last_became_peered":"2024-09-21T05:51:50.244473+0000","last_unstale":"2024-09-21T05:51:51.246857+0000","last_undegraded":"2024-09-21T05:51:51.246857+0000","last_fullsized":"2024-09-21T05:51:51.246857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:08.040920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265802+0000","last_change":"2024-09-21T05:51:50.259926+0000","last_active":"2024-09-21T05:51:51.265802+0000","last_peered":"2024-09-21T05:51:51.265802+0000","last_clean":"2024-09-21T05:51:51.265802+0000","last_became_active":"2024-09-21T05:51:50.259511+0000","last_became_peered":"2024-09-21T05:51:50.259511+0000","last_unstale":"2024-09-21T05:51:51.265802+0000","last_undegraded":"2024-09-21T05:51:51.265802+0000","last_fullsized":"2024-09-21T05:51:51.265802+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:46.735741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.269855+0000","last_change":"2024-09-21T05:51:50.249474+0000","last_active":"2024-09-21T05:51:51.269855+0000","last_peered":"2024-09-21T05:51:51.269855+0000","last_clean":"2024-09-21T05:51:51.269855+0000","last_became_active":"2024-09-21T05:51:50.247503+0000","last_became_peered":"2024-09-21T05:51:50.247503+0000","last_unstale":"2024-09-21T05:51:51.269855+0000","last_undegraded":"2024-09-21T05:51:51.269855+0000","last_fullsized":"2024-09-21T05:51:51.269855+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:11.639218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":36,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:08.344296+0000","last_change":"2024-09-21T05:51:48.236001+0000","last_active":"2024-09-21T05:52:08.344296+0000","last_peered":"2024-09-21T05:52:08.344296+0000","last_clean":"2024-09-21T05:52:08.344296+0000","last_became_active":"2024-09-21T05:51:48.235603+0000","last_became_peered":"2024-09-21T05:51:48.235603+0000","last_unstale":"2024-09-21T05:52:08.344296+0000","last_undegraded":"2024-09-21T05:52:08.344296+0000","last_fullsized":"2024-09-21T05:52:08.344296+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:33.217248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265176+0000","last_change":"2024-09-21T05:51:50.253183+0000","last_active":"2024-09-21T05:51:51.265176+0000","last_peered":"2024-09-21T05:51:51.265176+0000","last_clean":"2024-09-21T05:51:51.265176+0000","last_became_active":"2024-09-21T05:51:50.252811+0000","last_became_peered":"2024-09-21T05:51:50.252811+0000","last_unstale":"2024-09-21T05:51:51.265176+0000","last_undegraded":"2024-09-21T05:51:51.265176+0000","last_fullsized":"2024-09-21T05:51:51.265176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:04.999897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.322141+0000","last_change":"2024-09-21T05:51:48.230191+0000","last_active":"2024-09-21T05:51:59.322141+0000","last_peered":"2024-09-21T05:51:59.322141+0000","last_clean":"2024-09-21T05:51:59.322141+0000","last_became_active":"2024-09-21T05:51:48.229780+0000","last_became_peered":"2024-09-21T05:51:48.229780+0000","last_unstale":"2024-09-21T05:51:59.322141+0000","last_undegraded":"2024-09-21T05:51:59.322141+0000","last_fullsized":"2024-09-21T05:51:59.322141+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:34.950404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.322156+0000","last_change":"2024-09-21T05:51:48.224115+0000","last_active":"2024-09-21T05:51:59.322156+0000","last_peered":"2024-09-21T05:51:59.322156+0000","last_clean":"2024-09-21T05:51:59.322156+0000","last_became_active":"2024-09-21T05:51:48.223714+0000","last_became_peered":"2024-09-21T05:51:48.223714+0000","last_unstale":"2024-09-21T05:51:59.322156+0000","last_undegraded":"2024-09-21T05:51:59.322156+0000","last_fullsized":"2024-09-21T05:51:59.322156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:29.450354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265496+0000","last_change":"2024-09-21T05:51:50.250129+0000","last_active":"2024-09-21T05:51:51.265496+0000","last_peered":"2024-09-21T05:51:51.265496+0000","last_clean":"2024-09-21T05:51:51.265496+0000","last_became_active":"2024-09-21T05:51:50.249743+0000","last_became_peered":"2024-09-21T05:51:50.249743+0000","last_unstale":"2024-09-21T05:51:51.265496+0000","last_undegraded":"2024-09-21T05:51:51.265496+0000","last_fullsized":"2024-09-21T05:51:51.265496+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:37.204476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267763+0000","last_change":"2024-09-21T05:51:48.236289+0000","last_active":"2024-09-21T05:51:51.267763+0000","last_peered":"2024-09-21T05:51:51.267763+0000","last_clean":"2024-09-21T05:51:51.267763+0000","last_became_active":"2024-09-21T05:51:48.235898+0000","last_became_peered":"2024-09-21T05:51:48.235898+0000","last_unstale":"2024-09-21T05:51:51.267763+0000","last_undegraded":"2024-09-21T05:51:51.267763+0000","last_fullsized":"2024-09-21T05:51:51.267763+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:05.457237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.263909+0000","last_change":"2024-09-21T05:51:50.251905+0000","last_active":"2024-09-21T05:51:51.263909+0000","last_peered":"2024-09-21T05:51:51.263909+0000","last_clean":"2024-09-21T05:51:51.263909+0000","last_became_active":"2024-09-21T05:51:50.251537+0000","last_became_peered":"2024-09-21T05:51:50.251537+0000","last_unstale":"2024-09-21T05:51:51.263909+0000","last_undegraded":"2024-09-21T05:51:51.263909+0000","last_fullsized":"2024-09-21T05:51:51.263909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:57.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":35,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:11.347960+0000","last_change":"2024-09-21T05:51:48.232007+0000","last_active":"2024-09-21T05:52:11.347960+0000","last_peered":"2024-09-21T05:52:11.347960+0000","last_clean":"2024-09-21T05:52:11.347960+0000","last_became_active":"2024-09-21T05:51:48.231534+0000","last_became_peered":"2024-09-21T05:51:48.231534+0000","last_unstale":"2024-09-21T05:52:11.347960+0000","last_undegraded":"2024-09-21T05:52:11.347960+0000","last_fullsized":"2024-09-21T05:52:11.347960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:05.874618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.269187+0000","last_change":"2024-09-21T05:51:50.265224+0000","last_active":"2024-09-21T05:51:51.269187+0000","last_peered":"2024-09-21T05:51:51.269187+0000","last_clean":"2024-09-21T05:51:51.269187+0000","last_became_active":"2024-09-21T05:51:50.264690+0000","last_became_peered":"2024-09-21T05:51:50.264690+0000","last_unstale":"2024-09-21T05:51:51.269187+0000","last_undegraded":"2024-09-21T05:51:51.269187+0000","last_fullsized":"2024-09-21T05:51:51.269187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:15.835492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.314586+0000","last_change":"2024-09-21T05:51:48.233092+0000","last_active":"2024-09-21T05:51:58.314586+0000","last_peered":"2024-09-21T05:51:58.314586+0000","last_clean":"2024-09-21T05:51:58.314586+0000","last_became_active":"2024-09-21T05:51:48.232684+0000","last_became_peered":"2024-09-21T05:51:48.232684+0000","last_unstale":"2024-09-21T05:51:58.314586+0000","last_undegraded":"2024-09-21T05:51:58.314586+0000","last_fullsized":"2024-09-21T05:51:58.314586+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:21.664828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.272417+0000","last_change":"2024-09-21T05:51:50.248419+0000","last_active":"2024-09-21T05:51:51.272417+0000","last_peered":"2024-09-21T05:51:51.272417+0000","last_clean":"2024-09-21T05:51:51.272417+0000","last_became_active":"2024-09-21T05:51:50.247871+0000","last_became_peered":"2024-09-21T05:51:50.247871+0000","last_unstale":"2024-09-21T05:51:51.272417+0000","last_undegraded":"2024-09-21T05:51:51.272417+0000","last_fullsized":"2024-09-21T05:51:51.272417+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:49.851685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.314918+0000","last_change":"2024-09-21T05:51:48.338367+0000","last_active":"2024-09-21T05:51:58.314918+0000","last_peered":"2024-09-21T05:51:58.314918+0000","last_clean":"2024-09-21T05:51:58.314918+0000","last_became_active":"2024-09-21T05:51:48.337992+0000","last_became_peered":"2024-09-21T05:51:48.337992+0000","last_unstale":"2024-09-21T05:51:58.314918+0000","last_undegraded":"2024-09-21T05:51:58.314918+0000","last_fullsized":"2024-09-21T05:51:58.314918+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:52.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.269735+0000","last_change":"2024-09-21T05:51:50.267046+0000","last_active":"2024-09-21T05:51:51.269735+0000","last_peered":"2024-09-21T05:51:51.269735+0000","last_clean":"2024-09-21T05:51:51.269735+0000","last_became_active":"2024-09-21T05:51:50.266672+0000","last_became_peered":"2024-09-21T05:51:50.266672+0000","last_unstale":"2024-09-21T05:51:51.269735+0000","last_undegraded":"2024-09-21T05:51:51.269735+0000","last_fullsized":"2024-09-21T05:51:51.269735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:53.628646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'25","reported_seq":77,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:12.355830+0000","last_change":"2024-09-21T05:51:48.233804+0000","last_active":"2024-09-21T05:52:12.355830+0000","last_peered":"2024-09-21T05:52:12.355830+0000","last_clean":"2024-09-21T05:52:12.355830+0000","last_became_active":"2024-09-21T05:51:48.233386+0000","last_became_peered":"2024-09-21T05:51:48.233386+0000","last_unstale":"2024-09-21T05:52:12.355830+0000","last_undegraded":"2024-09-21T05:52:12.355830+0000","last_fullsized":"2024-09-21T05:52:12.355830+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:45.644005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54250,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":68,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264621+0000","last_change":"2024-09-21T05:51:50.257673+0000","last_active":"2024-09-21T05:51:51.264621+0000","last_peered":"2024-09-21T05:51:51.264621+0000","last_clean":"2024-09-21T05:51:51.264621+0000","last_became_active":"2024-09-21T05:51:50.257319+0000","last_became_peered":"2024-09-21T05:51:50.257319+0000","last_unstale":"2024-09-21T05:51:51.264621+0000","last_undegraded":"2024-09-21T05:51:51.264621+0000","last_fullsized":"2024-09-21T05:51:51.264621+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:26.008964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.322325+0000","last_change":"2024-09-21T05:51:48.233264+0000","last_active":"2024-09-21T05:51:59.322325+0000","last_peered":"2024-09-21T05:51:59.322325+0000","last_clean":"2024-09-21T05:51:59.322325+0000","last_became_active":"2024-09-21T05:51:48.232808+0000","last_became_peered":"2024-09-21T05:51:48.232808+0000","last_unstale":"2024-09-21T05:51:59.322325+0000","last_undegraded":"2024-09-21T05:51:59.322325+0000","last_fullsized":"2024-09-21T05:51:59.322325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:05.105861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.245746+0000","last_change":"2024-09-21T05:51:50.251727+0000","last_active":"2024-09-21T05:51:51.245746+0000","last_peered":"2024-09-21T05:51:51.245746+0000","last_clean":"2024-09-21T05:51:51.245746+0000","last_became_active":"2024-09-21T05:51:50.251382+0000","last_became_peered":"2024-09-21T05:51:50.251382+0000","last_unstale":"2024-09-21T05:51:51.245746+0000","last_undegraded":"2024-09-21T05:51:51.245746+0000","last_fullsized":"2024-09-21T05:51:51.245746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:30.098548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.315623+0000","last_change":"2024-09-21T05:51:48.235226+0000","last_active":"2024-09-21T05:51:58.315623+0000","last_peered":"2024-09-21T05:51:58.315623+0000","last_clean":"2024-09-21T05:51:58.315623+0000","last_became_active":"2024-09-21T05:51:48.234432+0000","last_became_peered":"2024-09-21T05:51:48.234432+0000","last_unstale":"2024-09-21T05:51:58.315623+0000","last_undegraded":"2024-09-21T05:51:58.315623+0000","last_fullsized":"2024-09-21T05:51:58.315623+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:49.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.270399+0000","last_change":"2024-09-21T05:51:50.260276+0000","last_active":"2024-09-21T05:51:51.270399+0000","last_peered":"2024-09-21T05:51:51.270399+0000","last_clean":"2024-09-21T05:51:51.270399+0000","last_became_active":"2024-09-21T05:51:50.257448+0000","last_became_peered":"2024-09-21T05:51:50.257448+0000","last_unstale":"2024-09-21T05:51:51.270399+0000","last_undegraded":"2024-09-21T05:51:51.270399+0000","last_fullsized":"2024-09-21T05:51:51.270399+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:46.052226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:13.357208+0000","last_change":"2024-09-21T05:51:48.230764+0000","last_active":"2024-09-21T05:52:13.357208+0000","last_peered":"2024-09-21T05:52:13.357208+0000","last_clean":"2024-09-21T05:52:13.357208+0000","last_became_active":"2024-09-21T05:51:48.230332+0000","last_became_peered":"2024-09-21T05:51:48.230332+0000","last_unstale":"2024-09-21T05:52:13.357208+0000","last_undegraded":"2024-09-21T05:52:13.357208+0000","last_fullsized":"2024-09-21T05:52:13.357208+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:33.459588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.268880+0000","last_change":"2024-09-21T05:51:50.262380+0000","last_active":"2024-09-21T05:51:51.268880+0000","last_peered":"2024-09-21T05:51:51.268880+0000","last_clean":"2024-09-21T05:51:51.268880+0000","last_became_active":"2024-09-21T05:51:50.261972+0000","last_became_peered":"2024-09-21T05:51:50.261972+0000","last_unstale":"2024-09-21T05:51:51.268880+0000","last_undegraded":"2024-09-21T05:51:51.268880+0000","last_fullsized":"2024-09-21T05:51:51.268880+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:18.170437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":35,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.323302+0000","last_change":"2024-09-21T05:51:48.338309+0000","last_active":"2024-09-21T05:51:59.323302+0000","last_peered":"2024-09-21T05:51:59.323302+0000","last_clean":"2024-09-21T05:51:59.323302+0000","last_became_active":"2024-09-21T05:51:48.337903+0000","last_became_peered":"2024-09-21T05:51:48.337903+0000","last_unstale":"2024-09-21T05:51:59.323302+0000","last_undegraded":"2024-09-21T05:51:59.323302+0000","last_fullsized":"2024-09-21T05:51:59.323302+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:54.634956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.268271+0000","last_change":"2024-09-21T05:51:50.259257+0000","last_active":"2024-09-21T05:51:51.268271+0000","last_peered":"2024-09-21T05:51:51.268271+0000","last_clean":"2024-09-21T05:51:51.268271+0000","last_became_active":"2024-09-21T05:51:50.258892+0000","last_became_peered":"2024-09-21T05:51:50.258892+0000","last_unstale":"2024-09-21T05:51:51.268271+0000","last_undegraded":"2024-09-21T05:51:51.268271+0000","last_fullsized":"2024-09-21T05:51:51.268271+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:46.683115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:00.331740+0000","last_change":"2024-09-21T05:51:48.226956+0000","last_active":"2024-09-21T05:52:00.331740+0000","last_peered":"2024-09-21T05:52:00.331740+0000","last_clean":"2024-09-21T05:52:00.331740+0000","last_became_active":"2024-09-21T05:51:48.226531+0000","last_became_peered":"2024-09-21T05:51:48.226531+0000","last_unstale":"2024-09-21T05:52:00.331740+0000","last_undegraded":"2024-09-21T05:52:00.331740+0000","last_fullsized":"2024-09-21T05:52:00.331740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:14.888074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265344+0000","last_change":"2024-09-21T05:51:50.261080+0000","last_active":"2024-09-21T05:51:51.265344+0000","last_peered":"2024-09-21T05:51:51.265344+0000","last_clean":"2024-09-21T05:51:51.265344+0000","last_became_active":"2024-09-21T05:51:50.260700+0000","last_became_peered":"2024-09-21T05:51:50.260700+0000","last_unstale":"2024-09-21T05:51:51.265344+0000","last_undegraded":"2024-09-21T05:51:51.265344+0000","last_fullsized":"2024-09-21T05:51:51.265344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.033889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267967+0000","last_change":"2024-09-21T05:51:48.230236+0000","last_active":"2024-09-21T05:51:51.267967+0000","last_peered":"2024-09-21T05:51:51.267967+0000","last_clean":"2024-09-21T05:51:51.267967+0000","last_became_active":"2024-09-21T05:51:48.229775+0000","last_became_peered":"2024-09-21T05:51:48.229775+0000","last_unstale":"2024-09-21T05:51:51.267967+0000","last_undegraded":"2024-09-21T05:51:51.267967+0000","last_fullsized":"2024-09-21T05:51:51.267967+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:25.371256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271036+0000","last_change":"2024-09-21T05:51:50.260749+0000","last_active":"2024-09-21T05:51:51.271036+0000","last_peered":"2024-09-21T05:51:51.271036+0000","last_clean":"2024-09-21T05:51:51.271036+0000","last_became_active":"2024-09-21T05:51:50.257406+0000","last_became_peered":"2024-09-21T05:51:50.257406+0000","last_unstale":"2024-09-21T05:51:51.271036+0000","last_undegraded":"2024-09-21T05:51:51.271036+0000","last_fullsized":"2024-09-21T05:51:51.271036+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:18.293144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.272197+0000","last_change":"2024-09-21T05:51:48.228752+0000","last_active":"2024-09-21T05:51:51.272197+0000","last_peered":"2024-09-21T05:51:51.272197+0000","last_clean":"2024-09-21T05:51:51.272197+0000","last_became_active":"2024-09-21T05:51:48.228361+0000","last_became_peered":"2024-09-21T05:51:48.228361+0000","last_unstale":"2024-09-21T05:51:51.272197+0000","last_undegraded":"2024-09-21T05:51:51.272197+0000","last_fullsized":"2024-09-21T05:51:51.272197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:05.868153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.270549+0000","last_change":"2024-09-21T05:51:50.256183+0000","last_active":"2024-09-21T05:51:51.270549+0000","last_peered":"2024-09-21T05:51:51.270549+0000","last_clean":"2024-09-21T05:51:51.270549+0000","last_became_active":"2024-09-21T05:51:50.255746+0000","last_became_peered":"2024-09-21T05:51:50.255746+0000","last_unstale":"2024-09-21T05:51:51.270549+0000","last_undegraded":"2024-09-21T05:51:51.270549+0000","last_fullsized":"2024-09-21T05:51:51.270549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:29.044470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.322372+0000","last_change":"2024-09-21T05:51:48.852935+0000","last_active":"2024-09-21T05:51:59.322372+0000","last_peered":"2024-09-21T05:51:59.322372+0000","last_clean":"2024-09-21T05:51:59.322372+0000","last_became_active":"2024-09-21T05:51:48.852457+0000","last_became_peered":"2024-09-21T05:51:48.852457+0000","last_unstale":"2024-09-21T05:51:59.322372+0000","last_undegraded":"2024-09-21T05:51:59.322372+0000","last_fullsized":"2024-09-21T05:51:59.322372+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:12.109669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271943+0000","last_change":"2024-09-21T05:51:50.261136+0000","last_active":"2024-09-21T05:51:51.271943+0000","last_peered":"2024-09-21T05:51:51.271943+0000","last_clean":"2024-09-21T05:51:51.271943+0000","last_became_active":"2024-09-21T05:51:50.260698+0000","last_became_peered":"2024-09-21T05:51:50.260698+0000","last_unstale":"2024-09-21T05:51:51.271943+0000","last_undegraded":"2024-09-21T05:51:51.271943+0000","last_fullsized":"2024-09-21T05:51:51.271943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:34.480352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":90,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.269114+0000","last_change":"2024-09-21T05:50:40.836627+0000","last_active":"2024-09-21T05:51:51.269114+0000","last_peered":"2024-09-21T05:51:51.269114+0000","last_clean":"2024-09-21T05:51:51.269114+0000","last_became_active":"2024-09-21T05:50:40.830426+0000","last_became_peered":"2024-09-21T05:50:40.830426+0000","last_unstale":"2024-09-21T05:51:51.269114+0000","last_undegraded":"2024-09-21T05:51:51.269114+0000","last_fullsized":"2024-09-21T05:51:51.269114+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_clean_scrub_stamp":"2024-09-21T05:47:21.634945+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:33.394077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:00.327727+0000","last_change":"2024-09-21T05:51:48.228187+0000","last_active":"2024-09-21T05:52:00.327727+0000","last_peered":"2024-09-21T05:52:00.327727+0000","last_clean":"2024-09-21T05:52:00.327727+0000","last_became_active":"2024-09-21T05:51:48.227690+0000","last_became_peered":"2024-09-21T05:51:48.227690+0000","last_unstale":"2024-09-21T05:52:00.327727+0000","last_undegraded":"2024-09-21T05:52:00.327727+0000","last_fullsized":"2024-09-21T05:52:00.327727+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:37.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.266038+0000","last_change":"2024-09-21T05:51:50.256024+0000","last_active":"2024-09-21T05:51:51.266038+0000","last_peered":"2024-09-21T05:51:51.266038+0000","last_clean":"2024-09-21T05:51:51.266038+0000","last_became_active":"2024-09-21T05:51:50.255597+0000","last_became_peered":"2024-09-21T05:51:50.255597+0000","last_unstale":"2024-09-21T05:51:51.266038+0000","last_undegraded":"2024-09-21T05:51:51.266038+0000","last_fullsized":"2024-09-21T05:51:51.266038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:07.768944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.323589+0000","last_change":"2024-09-21T05:51:48.234444+0000","last_active":"2024-09-21T05:51:59.323589+0000","last_peered":"2024-09-21T05:51:59.323589+0000","last_clean":"2024-09-21T05:51:59.323589+0000","last_became_active":"2024-09-21T05:51:48.233997+0000","last_became_peered":"2024-09-21T05:51:48.233997+0000","last_unstale":"2024-09-21T05:51:59.323589+0000","last_undegraded":"2024-09-21T05:51:59.323589+0000","last_fullsized":"2024-09-21T05:51:59.323589+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:12.931628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.245659+0000","last_change":"2024-09-21T05:51:50.242267+0000","last_active":"2024-09-21T05:51:51.245659+0000","last_peered":"2024-09-21T05:51:51.245659+0000","last_clean":"2024-09-21T05:51:51.245659+0000","last_became_active":"2024-09-21T05:51:50.241927+0000","last_became_peered":"2024-09-21T05:51:50.241927+0000","last_unstale":"2024-09-21T05:51:51.245659+0000","last_undegraded":"2024-09-21T05:51:51.245659+0000","last_fullsized":"2024-09-21T05:51:51.245659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:28.954451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:12.354631+0000","last_change":"2024-09-21T05:51:48.338372+0000","last_active":"2024-09-21T05:52:12.354631+0000","last_peered":"2024-09-21T05:52:12.354631+0000","last_clean":"2024-09-21T05:52:12.354631+0000","last_became_active":"2024-09-21T05:51:48.337966+0000","last_became_peered":"2024-09-21T05:51:48.337966+0000","last_unstale":"2024-09-21T05:52:12.354631+0000","last_undegraded":"2024-09-21T05:52:12.354631+0000","last_fullsized":"2024-09-21T05:52:12.354631+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:10.301871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267295+0000","last_change":"2024-09-21T05:51:50.253151+0000","last_active":"2024-09-21T05:51:51.267295+0000","last_peered":"2024-09-21T05:51:51.267295+0000","last_clean":"2024-09-21T05:51:51.267295+0000","last_became_active":"2024-09-21T05:51:50.252770+0000","last_became_peered":"2024-09-21T05:51:50.252770+0000","last_unstale":"2024-09-21T05:51:51.267295+0000","last_undegraded":"2024-09-21T05:51:51.267295+0000","last_fullsized":"2024-09-21T05:51:51.267295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:48.784229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271286+0000","last_change":"2024-09-21T05:51:48.233273+0000","last_active":"2024-09-21T05:51:51.271286+0000","last_peered":"2024-09-21T05:51:51.271286+0000","last_clean":"2024-09-21T05:51:51.271286+0000","last_became_active":"2024-09-21T05:51:48.232724+0000","last_became_peered":"2024-09-21T05:51:48.232724+0000","last_unstale":"2024-09-21T05:51:51.271286+0000","last_undegraded":"2024-09-21T05:51:51.271286+0000","last_fullsized":"2024-09-21T05:51:51.271286+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:50.869396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264827+0000","last_change":"2024-09-21T05:51:50.262521+0000","last_active":"2024-09-21T05:51:51.264827+0000","last_peered":"2024-09-21T05:51:51.264827+0000","last_clean":"2024-09-21T05:51:51.264827+0000","last_became_active":"2024-09-21T05:51:50.262135+0000","last_became_peered":"2024-09-21T05:51:50.262135+0000","last_unstale":"2024-09-21T05:51:51.264827+0000","last_undegraded":"2024-09-21T05:51:51.264827+0000","last_fullsized":"2024-09-21T05:51:51.264827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:18.347182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264172+0000","last_change":"2024-09-21T05:51:48.338532+0000","last_active":"2024-09-21T05:51:51.264172+0000","last_peered":"2024-09-21T05:51:51.264172+0000","last_clean":"2024-09-21T05:51:51.264172+0000","last_became_active":"2024-09-21T05:51:48.338099+0000","last_became_peered":"2024-09-21T05:51:48.338099+0000","last_unstale":"2024-09-21T05:51:51.264172+0000","last_undegraded":"2024-09-21T05:51:51.264172+0000","last_fullsized":"2024-09-21T05:51:51.264172+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:48.670988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:53.271427+0000","last_change":"2024-09-21T05:51:50.251814+0000","last_active":"2024-09-21T05:51:53.271427+0000","last_peered":"2024-09-21T05:51:53.271427+0000","last_clean":"2024-09-21T05:51:53.271427+0000","last_became_active":"2024-09-21T05:51:50.251401+0000","last_became_peered":"2024-09-21T05:51:50.251401+0000","last_unstale":"2024-09-21T05:51:53.271427+0000","last_undegraded":"2024-09-21T05:51:53.271427+0000","last_fullsized":"2024-09-21T05:51:53.271427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:12.972300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.312773+0000","last_change":"2024-09-21T05:51:48.338312+0000","last_active":"2024-09-21T05:51:58.312773+0000","last_peered":"2024-09-21T05:51:58.312773+0000","last_clean":"2024-09-21T05:51:58.312773+0000","last_became_active":"2024-09-21T05:51:48.337872+0000","last_became_peered":"2024-09-21T05:51:48.337872+0000","last_unstale":"2024-09-21T05:51:58.312773+0000","last_undegraded":"2024-09-21T05:51:58.312773+0000","last_fullsized":"2024-09-21T05:51:58.312773+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:26.158650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.246157+0000","last_change":"2024-09-21T05:51:50.245129+0000","last_active":"2024-09-21T05:51:51.246157+0000","last_peered":"2024-09-21T05:51:51.246157+0000","last_clean":"2024-09-21T05:51:51.246157+0000","last_became_active":"2024-09-21T05:51:50.244439+0000","last_became_peered":"2024-09-21T05:51:50.244439+0000","last_unstale":"2024-09-21T05:51:51.246157+0000","last_undegraded":"2024-09-21T05:51:51.246157+0000","last_fullsized":"2024-09-21T05:51:51.246157+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:19.241921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'10","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:12.264443+0000","last_change":"2024-09-21T05:51:48.226303+0000","last_active":"2024-09-21T05:52:12.264443+0000","last_peered":"2024-09-21T05:52:12.264443+0000","last_clean":"2024-09-21T05:52:12.264443+0000","last_became_active":"2024-09-21T05:51:48.225869+0000","last_became_peered":"2024-09-21T05:51:48.225869+0000","last_unstale":"2024-09-21T05:52:12.264443+0000","last_undegraded":"2024-09-21T05:52:12.264443+0000","last_fullsized":"2024-09-21T05:52:12.264443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:47.210001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267386+0000","last_change":"2024-09-21T05:51:50.253411+0000","last_active":"2024-09-21T05:51:51.267386+0000","last_peered":"2024-09-21T05:51:51.267386+0000","last_clean":"2024-09-21T05:51:51.267386+0000","last_became_active":"2024-09-21T05:51:50.252816+0000","last_became_peered":"2024-09-21T05:51:50.252816+0000","last_unstale":"2024-09-21T05:51:51.267386+0000","last_undegraded":"2024-09-21T05:51:51.267386+0000","last_fullsized":"2024-09-21T05:51:51.267386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:33.444176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.311496+0000","last_change":"2024-09-21T05:51:48.852668+0000","last_active":"2024-09-21T05:51:58.311496+0000","last_peered":"2024-09-21T05:51:58.311496+0000","last_clean":"2024-09-21T05:51:58.311496+0000","last_became_active":"2024-09-21T05:51:48.852298+0000","last_became_peered":"2024-09-21T05:51:48.852298+0000","last_unstale":"2024-09-21T05:51:58.311496+0000","last_undegraded":"2024-09-21T05:51:58.311496+0000","last_fullsized":"2024-09-21T05:51:58.311496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:19.529194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.272291+0000","last_change":"2024-09-21T05:51:50.246720+0000","last_active":"2024-09-21T05:51:51.272291+0000","last_peered":"2024-09-21T05:51:51.272291+0000","last_clean":"2024-09-21T05:51:51.272291+0000","last_became_active":"2024-09-21T05:51:50.246318+0000","last_became_peered":"2024-09-21T05:51:50.246318+0000","last_unstale":"2024-09-21T05:51:51.272291+0000","last_undegraded":"2024-09-21T05:51:51.272291+0000","last_fullsized":"2024-09-21T05:51:51.272291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:45.737949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.314642+0000","last_change":"2024-09-21T05:51:48.338346+0000","last_active":"2024-09-21T05:51:58.314642+0000","last_peered":"2024-09-21T05:51:58.314642+0000","last_clean":"2024-09-21T05:51:58.314642+0000","last_became_active":"2024-09-21T05:51:48.337968+0000","last_became_peered":"2024-09-21T05:51:48.337968+0000","last_unstale":"2024-09-21T05:51:58.314642+0000","last_undegraded":"2024-09-21T05:51:58.314642+0000","last_fullsized":"2024-09-21T05:51:58.314642+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:32.450546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264350+0000","last_change":"2024-09-21T05:51:50.255993+0000","last_active":"2024-09-21T05:51:51.264350+0000","last_peered":"2024-09-21T05:51:51.264350+0000","last_clean":"2024-09-21T05:51:51.264350+0000","last_became_active":"2024-09-21T05:51:50.255645+0000","last_became_peered":"2024-09-21T05:51:50.255645+0000","last_unstale":"2024-09-21T05:51:51.264350+0000","last_undegraded":"2024-09-21T05:51:51.264350+0000","last_fullsized":"2024-09-21T05:51:51.264350+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.890940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.315685+0000","last_change":"2024-09-21T05:51:48.231659+0000","last_active":"2024-09-21T05:51:58.315685+0000","last_peered":"2024-09-21T05:51:58.315685+0000","last_clean":"2024-09-21T05:51:58.315685+0000","last_became_active":"2024-09-21T05:51:48.231137+0000","last_became_peered":"2024-09-21T05:51:48.231137+0000","last_unstale":"2024-09-21T05:51:58.315685+0000","last_undegraded":"2024-09-21T05:51:58.315685+0000","last_fullsized":"2024-09-21T05:51:58.315685+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:06.166268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.266051+0000","last_change":"2024-09-21T05:51:50.251904+0000","last_active":"2024-09-21T05:51:51.266051+0000","last_peered":"2024-09-21T05:51:51.266051+0000","last_clean":"2024-09-21T05:51:51.266051+0000","last_became_active":"2024-09-21T05:51:50.251403+0000","last_became_peered":"2024-09-21T05:51:50.251403+0000","last_unstale":"2024-09-21T05:51:51.266051+0000","last_undegraded":"2024-09-21T05:51:51.266051+0000","last_fullsized":"2024-09-21T05:51:51.266051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:47.702083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.246914+0000","last_change":"2024-09-21T05:51:48.229861+0000","last_active":"2024-09-21T05:51:51.246914+0000","last_peered":"2024-09-21T05:51:51.246914+0000","last_clean":"2024-09-21T05:51:51.246914+0000","last_became_active":"2024-09-21T05:51:48.229296+0000","last_became_peered":"2024-09-21T05:51:48.229296+0000","last_unstale":"2024-09-21T05:51:51.246914+0000","last_undegraded":"2024-09-21T05:51:51.246914+0000","last_fullsized":"2024-09-21T05:51:51.246914+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:16.586505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.266048+0000","last_change":"2024-09-21T05:51:50.256654+0000","last_active":"2024-09-21T05:51:51.266048+0000","last_peered":"2024-09-21T05:51:51.266048+0000","last_clean":"2024-09-21T05:51:51.266048+0000","last_became_active":"2024-09-21T05:51:50.255830+0000","last_became_peered":"2024-09-21T05:51:50.255830+0000","last_unstale":"2024-09-21T05:51:51.266048+0000","last_undegraded":"2024-09-21T05:51:51.266048+0000","last_fullsized":"2024-09-21T05:51:51.266048+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:49.643890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.315966+0000","last_change":"2024-09-21T05:51:48.233608+0000","last_active":"2024-09-21T05:51:58.315966+0000","last_peered":"2024-09-21T05:51:58.315966+0000","last_clean":"2024-09-21T05:51:58.315966+0000","last_became_active":"2024-09-21T05:51:48.233187+0000","last_became_peered":"2024-09-21T05:51:48.233187+0000","last_unstale":"2024-09-21T05:51:58.315966+0000","last_undegraded":"2024-09-21T05:51:58.315966+0000","last_fullsized":"2024-09-21T05:51:58.315966+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:57.815632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.269869+0000","last_change":"2024-09-21T05:51:50.266753+0000","last_active":"2024-09-21T05:51:51.269869+0000","last_peered":"2024-09-21T05:51:51.269869+0000","last_clean":"2024-09-21T05:51:51.269869+0000","last_became_active":"2024-09-21T05:51:50.266368+0000","last_became_peered":"2024-09-21T05:51:50.266368+0000","last_unstale":"2024-09-21T05:51:51.269869+0000","last_undegraded":"2024-09-21T05:51:51.269869+0000","last_fullsized":"2024-09-21T05:51:51.269869+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:02.011213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267452+0000","last_change":"2024-09-21T05:51:50.257731+0000","last_active":"2024-09-21T05:51:51.267452+0000","last_peered":"2024-09-21T05:51:51.267452+0000","last_clean":"2024-09-21T05:51:51.267452+0000","last_became_active":"2024-09-21T05:51:50.257396+0000","last_became_peered":"2024-09-21T05:51:50.257396+0000","last_unstale":"2024-09-21T05:51:51.267452+0000","last_undegraded":"2024-09-21T05:51:51.267452+0000","last_fullsized":"2024-09-21T05:51:51.267452+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:58.109069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271039+0000","last_change":"2024-09-21T05:51:48.234067+0000","last_active":"2024-09-21T05:51:51.271039+0000","last_peered":"2024-09-21T05:51:51.271039+0000","last_clean":"2024-09-21T05:51:51.271039+0000","last_became_active":"2024-09-21T05:51:48.233532+0000","last_became_peered":"2024-09-21T05:51:48.233532+0000","last_unstale":"2024-09-21T05:51:51.271039+0000","last_undegraded":"2024-09-21T05:51:51.271039+0000","last_fullsized":"2024-09-21T05:51:51.271039+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:40.997254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.269574+0000","last_change":"2024-09-21T05:51:50.265453+0000","last_active":"2024-09-21T05:51:51.269574+0000","last_peered":"2024-09-21T05:51:51.269574+0000","last_clean":"2024-09-21T05:51:51.269574+0000","last_became_active":"2024-09-21T05:51:50.265073+0000","last_became_peered":"2024-09-21T05:51:50.265073+0000","last_unstale":"2024-09-21T05:51:51.269574+0000","last_undegraded":"2024-09-21T05:51:51.269574+0000","last_fullsized":"2024-09-21T05:51:51.269574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:15.295822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.321919+0000","last_change":"2024-09-21T05:51:48.233623+0000","last_active":"2024-09-21T05:51:59.321919+0000","last_peered":"2024-09-21T05:51:59.321919+0000","last_clean":"2024-09-21T05:51:59.321919+0000","last_became_active":"2024-09-21T05:51:48.233182+0000","last_became_peered":"2024-09-21T05:51:48.233182+0000","last_unstale":"2024-09-21T05:51:59.321919+0000","last_undegraded":"2024-09-21T05:51:59.321919+0000","last_fullsized":"2024-09-21T05:51:59.321919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:07.948266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271684+0000","last_change":"2024-09-21T05:51:50.267110+0000","last_active":"2024-09-21T05:51:51.271684+0000","last_peered":"2024-09-21T05:51:51.271684+0000","last_clean":"2024-09-21T05:51:51.271684+0000","last_became_active":"2024-09-21T05:51:50.266504+0000","last_became_peered":"2024-09-21T05:51:50.266504+0000","last_unstale":"2024-09-21T05:51:51.271684+0000","last_undegraded":"2024-09-21T05:51:51.271684+0000","last_fullsized":"2024-09-21T05:51:51.271684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:10.618361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271337+0000","last_change":"2024-09-21T05:51:48.337971+0000","last_active":"2024-09-21T05:51:51.271337+0000","last_peered":"2024-09-21T05:51:51.271337+0000","last_clean":"2024-09-21T05:51:51.271337+0000","last_became_active":"2024-09-21T05:51:48.337487+0000","last_became_peered":"2024-09-21T05:51:48.337487+0000","last_unstale":"2024-09-21T05:51:51.271337+0000","last_undegraded":"2024-09-21T05:51:51.271337+0000","last_fullsized":"2024-09-21T05:51:51.271337+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.150563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.266943+0000","last_change":"2024-09-21T05:51:50.253826+0000","last_active":"2024-09-21T05:51:51.266943+0000","last_peered":"2024-09-21T05:51:51.266943+0000","last_clean":"2024-09-21T05:51:51.266943+0000","last_became_active":"2024-09-21T05:51:50.251700+0000","last_became_peered":"2024-09-21T05:51:50.251700+0000","last_unstale":"2024-09-21T05:51:51.266943+0000","last_undegraded":"2024-09-21T05:51:51.266943+0000","last_fullsized":"2024-09-21T05:51:51.266943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:02.929651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.323221+0000","last_change":"2024-09-21T05:51:48.234358+0000","last_active":"2024-09-21T05:51:59.323221+0000","last_peered":"2024-09-21T05:51:59.323221+0000","last_clean":"2024-09-21T05:51:59.323221+0000","last_became_active":"2024-09-21T05:51:48.233982+0000","last_became_peered":"2024-09-21T05:51:48.233982+0000","last_unstale":"2024-09-21T05:51:59.323221+0000","last_undegraded":"2024-09-21T05:51:59.323221+0000","last_fullsized":"2024-09-21T05:51:59.323221+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:42.510872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58251,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":104,"num_read_kb":114,"num_write":157,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":156659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808849,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717360,"statfs":{"total":95995035648,"available":95966576640,"internally_reserved":0,"allocated":786432,"data_stored":389394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972373,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36788,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708364,"statfs":{"total":95995035648,"available":95957364736,"internally_reserved":0,"allocated":1478656,"data_stored":1035516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168603,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":389630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332128,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":389550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528356,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28388,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716764,"statfs":{"total":95995035648,"available":95965966336,"internally_reserved":0,"allocated":1396736,"data_stored":981480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":389019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855406,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36716,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708436,"statfs":{"total":95995035648,"available":95957438464,"internally_reserved":0,"allocated":1404928,"data_stored":980656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986228,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36120,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709032,"statfs":{"total":95995035648,"available":95958048768,"internally_reserved":0,"allocated":794624,"data_stored":389847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149752,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":806912,"data_stored":389330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378686,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":435365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542210,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":434015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40296,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704856,"statfs":{"total":95995035648,"available":95953772544,"internally_reserved":0,"allocated":811008,"data_stored":390290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":45203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":46553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:52:16.010 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:52:16.272 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:16.694 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:16 smithi007 ceph-mon[30983]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:16.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.725+0000 7f8b77538640 1 -- 172.21.15.7:0/2945534939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b70102a80 msgr2=0x7f8b70102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:16.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.725+0000 7f8b77538640 1 --2- 172.21.15.7:0/2945534939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b70102a80 0x7f8b70102e90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009ca0 tx=0x7f8b6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:16.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.725+0000 7f8b77538640 1 -- 172.21.15.7:0/2945534939 shutdown_connections 2024-09-21T05:52:16.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.725+0000 7f8b77538640 1 --2- 172.21.15.7:0/2945534939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b70108d10 0x7f8b7010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:16.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.725+0000 7f8b77538640 1 --2- 172.21.15.7:0/2945534939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b701083c0 0x7f8b701087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:16.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.725+0000 7f8b77538640 1 --2- 172.21.15.7:0/2945534939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b70102a80 0x7f8b70102e90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:16.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.725+0000 7f8b77538640 1 -- 172.21.15.7:0/2945534939 >> 172.21.15.7:0/2945534939 conn(0x7f8b70079740 msgr2=0x7f8b70079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:16.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.726+0000 7f8b77538640 1 -- 172.21.15.7:0/2945534939 shutdown_connections 2024-09-21T05:52:16.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.726+0000 7f8b77538640 1 -- 172.21.15.7:0/2945534939 wait complete. 2024-09-21T05:52:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.726+0000 7f8b77538640 1 Processor -- start 2024-09-21T05:52:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.726+0000 7f8b77538640 1 -- start start 2024-09-21T05:52:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b77538640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b70102a80 0x7f8b7019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b77538640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b701083c0 0x7f8b7019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b77538640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b70108d10 0x7f8b7019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b77538640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8b70113a90 con 0x7f8b70108d10 2024-09-21T05:52:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b77538640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8b70113910 con 0x7f8b701083c0 2024-09-21T05:52:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b77538640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8b70113c10 con 0x7f8b70102a80 2024-09-21T05:52:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b75ad5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b70108d10 0x7f8b7019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b75ad5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b70108d10 0x7f8b7019fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55422/0 (socket says 172.21.15.7:55422) 2024-09-21T05:52:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b75ad5640 1 -- 172.21.15.7:0/98667345 learned_addr learned my addr 172.21.15.7:0/98667345 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b74ad3640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b701083c0 0x7f8b7019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b752d4640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b70102a80 0x7f8b7019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b75ad5640 1 -- 172.21.15.7:0/98667345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b70102a80 msgr2=0x7f8b7019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b75ad5640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b70102a80 0x7f8b7019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b75ad5640 1 -- 172.21.15.7:0/98667345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b701083c0 msgr2=0x7f8b7019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b75ad5640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b701083c0 0x7f8b7019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b75ad5640 1 -- 172.21.15.7:0/98667345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b701a03b0 con 0x7f8b70108d10 2024-09-21T05:52:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b752d4640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b70102a80 0x7f8b7019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b75ad5640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b70108d10 0x7f8b7019fc80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800e970 tx=0x7f8b6800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b667fc640 1 -- 172.21.15.7:0/98667345 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6800ccc0 con 0x7f8b70108d10 2024-09-21T05:52:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.727+0000 7f8b667fc640 1 -- 172.21.15.7:0/98667345 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b6800ce60 con 0x7f8b70108d10 2024-09-21T05:52:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.728+0000 7f8b77538640 1 -- 172.21.15.7:0/98667345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b701a06a0 con 0x7f8b70108d10 2024-09-21T05:52:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.728+0000 7f8b667fc640 1 -- 172.21.15.7:0/98667345 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68010430 con 0x7f8b70108d10 2024-09-21T05:52:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.728+0000 7f8b77538640 1 -- 172.21.15.7:0/98667345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b701a6e00 con 0x7f8b70108d10 2024-09-21T05:52:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.728+0000 7f8b77538640 1 -- 172.21.15.7:0/98667345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b70103d00 con 0x7f8b70108d10 2024-09-21T05:52:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.730+0000 7f8b667fc640 1 -- 172.21.15.7:0/98667345 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f8b68004f70 con 0x7f8b70108d10 2024-09-21T05:52:16.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.731+0000 7f8b667fc640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b5c0b6670 0x7f8b5c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:16.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.731+0000 7f8b752d4640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b5c0b6670 0x7f8b5c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:16.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.731+0000 7f8b667fc640 1 -- 172.21.15.7:0/98667345 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7f8b680e7a60 con 0x7f8b70108d10 2024-09-21T05:52:16.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.732+0000 7f8b752d4640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b5c0b6670 0x7f8b5c0b8b80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0094e0 tx=0x7f8b6c0093f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:16.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.734+0000 7f8b667fc640 1 -- 172.21.15.7:0/98667345 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b68056710 con 0x7f8b70108d10 2024-09-21T05:52:16.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:16 smithi119 ceph-mon[34833]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:16.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.921+0000 7f8b77538640 1 -- 172.21.15.7:0/98667345 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b70063800 con 0x7f8b5c0b6670 2024-09-21T05:52:16.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.925+0000 7f8b667fc640 1 -- 172.21.15.7:0/98667345 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258695 (secure 0 0 0) 0x7f8b70063800 con 0x7f8b5c0b6670 2024-09-21T05:52:16.929 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:52:16.930 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T05:52:16.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.929+0000 7f8b77538640 1 -- 172.21.15.7:0/98667345 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b5c0b6670 msgr2=0x7f8b5c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.929+0000 7f8b77538640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b5c0b6670 0x7f8b5c0b8b80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0094e0 tx=0x7f8b6c0093f0 comp rx=0 tx=0).stop 2024-09-21T05:52:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.929+0000 7f8b77538640 1 -- 172.21.15.7:0/98667345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b70108d10 msgr2=0x7f8b7019fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.929+0000 7f8b77538640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b70108d10 0x7f8b7019fc80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800e970 tx=0x7f8b6800ed70 comp rx=0 tx=0).stop 2024-09-21T05:52:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.929+0000 7f8b77538640 1 -- 172.21.15.7:0/98667345 shutdown_connections 2024-09-21T05:52:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.929+0000 7f8b77538640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b5c0b6670 0x7f8b5c0b8b80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.929+0000 7f8b77538640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b70108d10 0x7f8b7019fc80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.929+0000 7f8b77538640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b701083c0 0x7f8b7019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.929+0000 7f8b77538640 1 --2- 172.21.15.7:0/98667345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b70102a80 0x7f8b7019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.929+0000 7f8b77538640 1 -- 172.21.15.7:0/98667345 >> 172.21.15.7:0/98667345 conn(0x7f8b70079740 msgr2=0x7f8b70101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.929+0000 7f8b77538640 1 -- 172.21.15.7:0/98667345 shutdown_connections 2024-09-21T05:52:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:16.929+0000 7f8b77538640 1 -- 172.21.15.7:0/98667345 wait complete. 2024-09-21T05:52:16.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:16 smithi027 ceph-mon[34364]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:17.671 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2024-09-21T05:52:16.469098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648853,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":190,"num_read_kb":183,"num_write":282,"num_write_kb":2255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":389696,"kb_used_data":11328,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124552128,"statfs":{"total":1151940427776,"available":1151541379072,"internally_reserved":0,"allocated":11599872,"data_stored":6612303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":52872,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":87,"num_write":33,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003538"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267754+0000","last_change":"2024-09-21T05:51:50.266316+0000","last_active":"2024-09-21T05:51:51.267754+0000","last_peered":"2024-09-21T05:51:51.267754+0000","last_clean":"2024-09-21T05:51:51.267754+0000","last_became_active":"2024-09-21T05:51:50.265970+0000","last_became_peered":"2024-09-21T05:51:50.265970+0000","last_unstale":"2024-09-21T05:51:51.267754+0000","last_undegraded":"2024-09-21T05:51:51.267754+0000","last_fullsized":"2024-09-21T05:51:51.267754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:31.728635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.272046+0000","last_change":"2024-09-21T05:51:50.254215+0000","last_active":"2024-09-21T05:51:51.272046+0000","last_peered":"2024-09-21T05:51:51.272046+0000","last_clean":"2024-09-21T05:51:51.272046+0000","last_became_active":"2024-09-21T05:51:50.253701+0000","last_became_peered":"2024-09-21T05:51:50.253701+0000","last_unstale":"2024-09-21T05:51:51.272046+0000","last_undegraded":"2024-09-21T05:51:51.272046+0000","last_fullsized":"2024-09-21T05:51:51.272046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:56.211706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271299+0000","last_change":"2024-09-21T05:51:50.258535+0000","last_active":"2024-09-21T05:51:51.271299+0000","last_peered":"2024-09-21T05:51:51.271299+0000","last_clean":"2024-09-21T05:51:51.271299+0000","last_became_active":"2024-09-21T05:51:50.258186+0000","last_became_peered":"2024-09-21T05:51:50.258186+0000","last_unstale":"2024-09-21T05:51:51.271299+0000","last_undegraded":"2024-09-21T05:51:51.271299+0000","last_fullsized":"2024-09-21T05:51:51.271299+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:15.134574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.251807+0000","last_change":"2024-09-21T05:51:50.254832+0000","last_active":"2024-09-21T05:51:51.251807+0000","last_peered":"2024-09-21T05:51:51.251807+0000","last_clean":"2024-09-21T05:51:51.251807+0000","last_became_active":"2024-09-21T05:51:50.254449+0000","last_became_peered":"2024-09-21T05:51:50.254449+0000","last_unstale":"2024-09-21T05:51:51.251807+0000","last_undegraded":"2024-09-21T05:51:51.251807+0000","last_fullsized":"2024-09-21T05:51:51.251807+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:31.411808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264279+0000","last_change":"2024-09-21T05:51:50.251144+0000","last_active":"2024-09-21T05:51:51.264279+0000","last_peered":"2024-09-21T05:51:51.264279+0000","last_clean":"2024-09-21T05:51:51.264279+0000","last_became_active":"2024-09-21T05:51:50.250782+0000","last_became_peered":"2024-09-21T05:51:50.250782+0000","last_unstale":"2024-09-21T05:51:51.264279+0000","last_undegraded":"2024-09-21T05:51:51.264279+0000","last_fullsized":"2024-09-21T05:51:51.264279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:15.055805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264559+0000","last_change":"2024-09-21T05:51:50.259758+0000","last_active":"2024-09-21T05:51:51.264559+0000","last_peered":"2024-09-21T05:51:51.264559+0000","last_clean":"2024-09-21T05:51:51.264559+0000","last_became_active":"2024-09-21T05:51:50.259358+0000","last_became_peered":"2024-09-21T05:51:50.259358+0000","last_unstale":"2024-09-21T05:51:51.264559+0000","last_undegraded":"2024-09-21T05:51:51.264559+0000","last_fullsized":"2024-09-21T05:51:51.264559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:08.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.268868+0000","last_change":"2024-09-21T05:51:50.260018+0000","last_active":"2024-09-21T05:51:51.268868+0000","last_peered":"2024-09-21T05:51:51.268868+0000","last_clean":"2024-09-21T05:51:51.268868+0000","last_became_active":"2024-09-21T05:51:50.257143+0000","last_became_peered":"2024-09-21T05:51:50.257143+0000","last_unstale":"2024-09-21T05:51:51.268868+0000","last_undegraded":"2024-09-21T05:51:51.268868+0000","last_fullsized":"2024-09-21T05:51:51.268868+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:05.579662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265317+0000","last_change":"2024-09-21T05:51:50.256867+0000","last_active":"2024-09-21T05:51:51.265317+0000","last_peered":"2024-09-21T05:51:51.265317+0000","last_clean":"2024-09-21T05:51:51.265317+0000","last_became_active":"2024-09-21T05:51:50.256392+0000","last_became_peered":"2024-09-21T05:51:50.256392+0000","last_unstale":"2024-09-21T05:51:51.265317+0000","last_undegraded":"2024-09-21T05:51:51.265317+0000","last_fullsized":"2024-09-21T05:51:51.265317+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:43.169607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.270715+0000","last_change":"2024-09-21T05:51:50.260430+0000","last_active":"2024-09-21T05:51:51.270715+0000","last_peered":"2024-09-21T05:51:51.270715+0000","last_clean":"2024-09-21T05:51:51.270715+0000","last_became_active":"2024-09-21T05:51:50.259993+0000","last_became_peered":"2024-09-21T05:51:50.259993+0000","last_unstale":"2024-09-21T05:51:51.270715+0000","last_undegraded":"2024-09-21T05:51:51.270715+0000","last_fullsized":"2024-09-21T05:51:51.270715+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:31.811151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265402+0000","last_change":"2024-09-21T05:51:50.263027+0000","last_active":"2024-09-21T05:51:51.265402+0000","last_peered":"2024-09-21T05:51:51.265402+0000","last_clean":"2024-09-21T05:51:51.265402+0000","last_became_active":"2024-09-21T05:51:50.261816+0000","last_became_peered":"2024-09-21T05:51:50.261816+0000","last_unstale":"2024-09-21T05:51:51.265402+0000","last_undegraded":"2024-09-21T05:51:51.265402+0000","last_fullsized":"2024-09-21T05:51:51.265402+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:39.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271157+0000","last_change":"2024-09-21T05:51:50.263976+0000","last_active":"2024-09-21T05:51:51.271157+0000","last_peered":"2024-09-21T05:51:51.271157+0000","last_clean":"2024-09-21T05:51:51.271157+0000","last_became_active":"2024-09-21T05:51:50.263179+0000","last_became_peered":"2024-09-21T05:51:50.263179+0000","last_unstale":"2024-09-21T05:51:51.271157+0000","last_undegraded":"2024-09-21T05:51:51.271157+0000","last_fullsized":"2024-09-21T05:51:51.271157+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:08.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.251802+0000","last_change":"2024-09-21T05:51:50.259967+0000","last_active":"2024-09-21T05:51:51.251802+0000","last_peered":"2024-09-21T05:51:51.251802+0000","last_clean":"2024-09-21T05:51:51.251802+0000","last_became_active":"2024-09-21T05:51:50.259460+0000","last_became_peered":"2024-09-21T05:51:50.259460+0000","last_unstale":"2024-09-21T05:51:51.251802+0000","last_undegraded":"2024-09-21T05:51:51.251802+0000","last_fullsized":"2024-09-21T05:51:51.251802+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:48.576362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.245942+0000","last_change":"2024-09-21T05:51:50.252949+0000","last_active":"2024-09-21T05:51:51.245942+0000","last_peered":"2024-09-21T05:51:51.245942+0000","last_clean":"2024-09-21T05:51:51.245942+0000","last_became_active":"2024-09-21T05:51:50.252518+0000","last_became_peered":"2024-09-21T05:51:50.252518+0000","last_unstale":"2024-09-21T05:51:51.245942+0000","last_undegraded":"2024-09-21T05:51:51.245942+0000","last_fullsized":"2024-09-21T05:51:51.245942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:38.145947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271193+0000","last_change":"2024-09-21T05:51:50.250309+0000","last_active":"2024-09-21T05:51:51.271193+0000","last_peered":"2024-09-21T05:51:51.271193+0000","last_clean":"2024-09-21T05:51:51.271193+0000","last_became_active":"2024-09-21T05:51:50.249629+0000","last_became_peered":"2024-09-21T05:51:50.249629+0000","last_unstale":"2024-09-21T05:51:51.271193+0000","last_undegraded":"2024-09-21T05:51:51.271193+0000","last_fullsized":"2024-09-21T05:51:51.271193+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:28.551654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271134+0000","last_change":"2024-09-21T05:51:50.242211+0000","last_active":"2024-09-21T05:51:51.271134+0000","last_peered":"2024-09-21T05:51:51.271134+0000","last_clean":"2024-09-21T05:51:51.271134+0000","last_became_active":"2024-09-21T05:51:50.241861+0000","last_became_peered":"2024-09-21T05:51:50.241861+0000","last_unstale":"2024-09-21T05:51:51.271134+0000","last_undegraded":"2024-09-21T05:51:51.271134+0000","last_fullsized":"2024-09-21T05:51:51.271134+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:46.045907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.268362+0000","last_change":"2024-09-21T05:51:50.268926+0000","last_active":"2024-09-21T05:51:51.268362+0000","last_peered":"2024-09-21T05:51:51.268362+0000","last_clean":"2024-09-21T05:51:51.268362+0000","last_became_active":"2024-09-21T05:51:50.268164+0000","last_became_peered":"2024-09-21T05:51:50.268164+0000","last_unstale":"2024-09-21T05:51:51.268362+0000","last_undegraded":"2024-09-21T05:51:51.268362+0000","last_fullsized":"2024-09-21T05:51:51.268362+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:43.021303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267172+0000","last_change":"2024-09-21T05:51:50.266365+0000","last_active":"2024-09-21T05:51:51.267172+0000","last_peered":"2024-09-21T05:51:51.267172+0000","last_clean":"2024-09-21T05:51:51.267172+0000","last_became_active":"2024-09-21T05:51:50.265803+0000","last_became_peered":"2024-09-21T05:51:50.265803+0000","last_unstale":"2024-09-21T05:51:51.267172+0000","last_undegraded":"2024-09-21T05:51:51.267172+0000","last_fullsized":"2024-09-21T05:51:51.267172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:45.574795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264351+0000","last_change":"2024-09-21T05:51:50.257129+0000","last_active":"2024-09-21T05:51:51.264351+0000","last_peered":"2024-09-21T05:51:51.264351+0000","last_clean":"2024-09-21T05:51:51.264351+0000","last_became_active":"2024-09-21T05:51:50.256721+0000","last_became_peered":"2024-09-21T05:51:50.256721+0000","last_unstale":"2024-09-21T05:51:51.264351+0000","last_undegraded":"2024-09-21T05:51:51.264351+0000","last_fullsized":"2024-09-21T05:51:51.264351+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:26.688743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.247221+0000","last_change":"2024-09-21T05:51:50.243460+0000","last_active":"2024-09-21T05:51:51.247221+0000","last_peered":"2024-09-21T05:51:51.247221+0000","last_clean":"2024-09-21T05:51:51.247221+0000","last_became_active":"2024-09-21T05:51:50.243094+0000","last_became_peered":"2024-09-21T05:51:50.243094+0000","last_unstale":"2024-09-21T05:51:51.247221+0000","last_undegraded":"2024-09-21T05:51:51.247221+0000","last_fullsized":"2024-09-21T05:51:51.247221+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:16.751564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264983+0000","last_change":"2024-09-21T05:51:50.257571+0000","last_active":"2024-09-21T05:51:51.264983+0000","last_peered":"2024-09-21T05:51:51.264983+0000","last_clean":"2024-09-21T05:51:51.264983+0000","last_became_active":"2024-09-21T05:51:50.257193+0000","last_became_peered":"2024-09-21T05:51:50.257193+0000","last_unstale":"2024-09-21T05:51:51.264983+0000","last_undegraded":"2024-09-21T05:51:51.264983+0000","last_fullsized":"2024-09-21T05:51:51.264983+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:52.710859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.246061+0000","last_change":"2024-09-21T05:51:50.251288+0000","last_active":"2024-09-21T05:51:51.246061+0000","last_peered":"2024-09-21T05:51:51.246061+0000","last_clean":"2024-09-21T05:51:51.246061+0000","last_became_active":"2024-09-21T05:51:50.250841+0000","last_became_peered":"2024-09-21T05:51:50.250841+0000","last_unstale":"2024-09-21T05:51:51.246061+0000","last_undegraded":"2024-09-21T05:51:51.246061+0000","last_fullsized":"2024-09-21T05:51:51.246061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:44.196822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.268603+0000","last_change":"2024-09-21T05:51:50.259418+0000","last_active":"2024-09-21T05:51:51.268603+0000","last_peered":"2024-09-21T05:51:51.268603+0000","last_clean":"2024-09-21T05:51:51.268603+0000","last_became_active":"2024-09-21T05:51:50.257641+0000","last_became_peered":"2024-09-21T05:51:50.257641+0000","last_unstale":"2024-09-21T05:51:51.268603+0000","last_undegraded":"2024-09-21T05:51:51.268603+0000","last_fullsized":"2024-09-21T05:51:51.268603+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:23.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265590+0000","last_change":"2024-09-21T05:51:50.252746+0000","last_active":"2024-09-21T05:51:51.265590+0000","last_peered":"2024-09-21T05:51:51.265590+0000","last_clean":"2024-09-21T05:51:51.265590+0000","last_became_active":"2024-09-21T05:51:50.250551+0000","last_became_peered":"2024-09-21T05:51:50.250551+0000","last_unstale":"2024-09-21T05:51:51.265590+0000","last_undegraded":"2024-09-21T05:51:51.265590+0000","last_fullsized":"2024-09-21T05:51:51.265590+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:05.821737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267031+0000","last_change":"2024-09-21T05:51:50.246170+0000","last_active":"2024-09-21T05:51:51.267031+0000","last_peered":"2024-09-21T05:51:51.267031+0000","last_clean":"2024-09-21T05:51:51.267031+0000","last_became_active":"2024-09-21T05:51:50.245747+0000","last_became_peered":"2024-09-21T05:51:50.245747+0000","last_unstale":"2024-09-21T05:51:51.267031+0000","last_undegraded":"2024-09-21T05:51:51.267031+0000","last_fullsized":"2024-09-21T05:51:51.267031+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:05.005437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267389+0000","last_change":"2024-09-21T05:51:50.258248+0000","last_active":"2024-09-21T05:51:51.267389+0000","last_peered":"2024-09-21T05:51:51.267389+0000","last_clean":"2024-09-21T05:51:51.267389+0000","last_became_active":"2024-09-21T05:51:50.257891+0000","last_became_peered":"2024-09-21T05:51:50.257891+0000","last_unstale":"2024-09-21T05:51:51.267389+0000","last_undegraded":"2024-09-21T05:51:51.267389+0000","last_fullsized":"2024-09-21T05:51:51.267389+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:44.093064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.247368+0000","last_change":"2024-09-21T05:51:50.258497+0000","last_active":"2024-09-21T05:51:51.247368+0000","last_peered":"2024-09-21T05:51:51.247368+0000","last_clean":"2024-09-21T05:51:51.247368+0000","last_became_active":"2024-09-21T05:51:50.257633+0000","last_became_peered":"2024-09-21T05:51:50.257633+0000","last_unstale":"2024-09-21T05:51:51.247368+0000","last_undegraded":"2024-09-21T05:51:51.247368+0000","last_fullsized":"2024-09-21T05:51:51.247368+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:41.793650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.266616+0000","last_change":"2024-09-21T05:51:50.255336+0000","last_active":"2024-09-21T05:51:51.266616+0000","last_peered":"2024-09-21T05:51:51.266616+0000","last_clean":"2024-09-21T05:51:51.266616+0000","last_became_active":"2024-09-21T05:51:50.254955+0000","last_became_peered":"2024-09-21T05:51:50.254955+0000","last_unstale":"2024-09-21T05:51:51.266616+0000","last_undegraded":"2024-09-21T05:51:51.266616+0000","last_fullsized":"2024-09-21T05:51:51.266616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:28.198455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.246104+0000","last_change":"2024-09-21T05:51:50.242391+0000","last_active":"2024-09-21T05:51:51.246104+0000","last_peered":"2024-09-21T05:51:51.246104+0000","last_clean":"2024-09-21T05:51:51.246104+0000","last_became_active":"2024-09-21T05:51:50.242055+0000","last_became_peered":"2024-09-21T05:51:50.242055+0000","last_unstale":"2024-09-21T05:51:51.246104+0000","last_undegraded":"2024-09-21T05:51:51.246104+0000","last_fullsized":"2024-09-21T05:51:51.246104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:48.937516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271547+0000","last_change":"2024-09-21T05:51:50.243343+0000","last_active":"2024-09-21T05:51:51.271547+0000","last_peered":"2024-09-21T05:51:51.271547+0000","last_clean":"2024-09-21T05:51:51.271547+0000","last_became_active":"2024-09-21T05:51:50.243005+0000","last_became_peered":"2024-09-21T05:51:50.243005+0000","last_unstale":"2024-09-21T05:51:51.271547+0000","last_undegraded":"2024-09-21T05:51:51.271547+0000","last_fullsized":"2024-09-21T05:51:51.271547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:51.975966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.246671+0000","last_change":"2024-09-21T05:51:50.250290+0000","last_active":"2024-09-21T05:51:51.246671+0000","last_peered":"2024-09-21T05:51:51.246671+0000","last_clean":"2024-09-21T05:51:51.246671+0000","last_became_active":"2024-09-21T05:51:50.249867+0000","last_became_peered":"2024-09-21T05:51:50.249867+0000","last_unstale":"2024-09-21T05:51:51.246671+0000","last_undegraded":"2024-09-21T05:51:51.246671+0000","last_fullsized":"2024-09-21T05:51:51.246671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:33.852383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.246857+0000","last_change":"2024-09-21T05:51:50.244908+0000","last_active":"2024-09-21T05:51:51.246857+0000","last_peered":"2024-09-21T05:51:51.246857+0000","last_clean":"2024-09-21T05:51:51.246857+0000","last_became_active":"2024-09-21T05:51:50.244473+0000","last_became_peered":"2024-09-21T05:51:50.244473+0000","last_unstale":"2024-09-21T05:51:51.246857+0000","last_undegraded":"2024-09-21T05:51:51.246857+0000","last_fullsized":"2024-09-21T05:51:51.246857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:08.040920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265802+0000","last_change":"2024-09-21T05:51:50.259926+0000","last_active":"2024-09-21T05:51:51.265802+0000","last_peered":"2024-09-21T05:51:51.265802+0000","last_clean":"2024-09-21T05:51:51.265802+0000","last_became_active":"2024-09-21T05:51:50.259511+0000","last_became_peered":"2024-09-21T05:51:50.259511+0000","last_unstale":"2024-09-21T05:51:51.265802+0000","last_undegraded":"2024-09-21T05:51:51.265802+0000","last_fullsized":"2024-09-21T05:51:51.265802+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:46.735741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.269855+0000","last_change":"2024-09-21T05:51:50.249474+0000","last_active":"2024-09-21T05:51:51.269855+0000","last_peered":"2024-09-21T05:51:51.269855+0000","last_clean":"2024-09-21T05:51:51.269855+0000","last_became_active":"2024-09-21T05:51:50.247503+0000","last_became_peered":"2024-09-21T05:51:50.247503+0000","last_unstale":"2024-09-21T05:51:51.269855+0000","last_undegraded":"2024-09-21T05:51:51.269855+0000","last_fullsized":"2024-09-21T05:51:51.269855+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:11.639218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:13.351710+0000","last_change":"2024-09-21T05:51:48.236001+0000","last_active":"2024-09-21T05:52:13.351710+0000","last_peered":"2024-09-21T05:52:13.351710+0000","last_clean":"2024-09-21T05:52:13.351710+0000","last_became_active":"2024-09-21T05:51:48.235603+0000","last_became_peered":"2024-09-21T05:51:48.235603+0000","last_unstale":"2024-09-21T05:52:13.351710+0000","last_undegraded":"2024-09-21T05:52:13.351710+0000","last_fullsized":"2024-09-21T05:52:13.351710+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:33.217248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265176+0000","last_change":"2024-09-21T05:51:50.253183+0000","last_active":"2024-09-21T05:51:51.265176+0000","last_peered":"2024-09-21T05:51:51.265176+0000","last_clean":"2024-09-21T05:51:51.265176+0000","last_became_active":"2024-09-21T05:51:50.252811+0000","last_became_peered":"2024-09-21T05:51:50.252811+0000","last_unstale":"2024-09-21T05:51:51.265176+0000","last_undegraded":"2024-09-21T05:51:51.265176+0000","last_fullsized":"2024-09-21T05:51:51.265176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:04.999897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.322141+0000","last_change":"2024-09-21T05:51:48.230191+0000","last_active":"2024-09-21T05:51:59.322141+0000","last_peered":"2024-09-21T05:51:59.322141+0000","last_clean":"2024-09-21T05:51:59.322141+0000","last_became_active":"2024-09-21T05:51:48.229780+0000","last_became_peered":"2024-09-21T05:51:48.229780+0000","last_unstale":"2024-09-21T05:51:59.322141+0000","last_undegraded":"2024-09-21T05:51:59.322141+0000","last_fullsized":"2024-09-21T05:51:59.322141+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:34.950404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.322156+0000","last_change":"2024-09-21T05:51:48.224115+0000","last_active":"2024-09-21T05:51:59.322156+0000","last_peered":"2024-09-21T05:51:59.322156+0000","last_clean":"2024-09-21T05:51:59.322156+0000","last_became_active":"2024-09-21T05:51:48.223714+0000","last_became_peered":"2024-09-21T05:51:48.223714+0000","last_unstale":"2024-09-21T05:51:59.322156+0000","last_undegraded":"2024-09-21T05:51:59.322156+0000","last_fullsized":"2024-09-21T05:51:59.322156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:29.450354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265496+0000","last_change":"2024-09-21T05:51:50.250129+0000","last_active":"2024-09-21T05:51:51.265496+0000","last_peered":"2024-09-21T05:51:51.265496+0000","last_clean":"2024-09-21T05:51:51.265496+0000","last_became_active":"2024-09-21T05:51:50.249743+0000","last_became_peered":"2024-09-21T05:51:50.249743+0000","last_unstale":"2024-09-21T05:51:51.265496+0000","last_undegraded":"2024-09-21T05:51:51.265496+0000","last_fullsized":"2024-09-21T05:51:51.265496+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:37.204476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267763+0000","last_change":"2024-09-21T05:51:48.236289+0000","last_active":"2024-09-21T05:51:51.267763+0000","last_peered":"2024-09-21T05:51:51.267763+0000","last_clean":"2024-09-21T05:51:51.267763+0000","last_became_active":"2024-09-21T05:51:48.235898+0000","last_became_peered":"2024-09-21T05:51:48.235898+0000","last_unstale":"2024-09-21T05:51:51.267763+0000","last_undegraded":"2024-09-21T05:51:51.267763+0000","last_fullsized":"2024-09-21T05:51:51.267763+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:05.457237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.263909+0000","last_change":"2024-09-21T05:51:50.251905+0000","last_active":"2024-09-21T05:51:51.263909+0000","last_peered":"2024-09-21T05:51:51.263909+0000","last_clean":"2024-09-21T05:51:51.263909+0000","last_became_active":"2024-09-21T05:51:50.251537+0000","last_became_peered":"2024-09-21T05:51:50.251537+0000","last_unstale":"2024-09-21T05:51:51.263909+0000","last_undegraded":"2024-09-21T05:51:51.263909+0000","last_fullsized":"2024-09-21T05:51:51.263909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:57.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":35,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:11.347960+0000","last_change":"2024-09-21T05:51:48.232007+0000","last_active":"2024-09-21T05:52:11.347960+0000","last_peered":"2024-09-21T05:52:11.347960+0000","last_clean":"2024-09-21T05:52:11.347960+0000","last_became_active":"2024-09-21T05:51:48.231534+0000","last_became_peered":"2024-09-21T05:51:48.231534+0000","last_unstale":"2024-09-21T05:52:11.347960+0000","last_undegraded":"2024-09-21T05:52:11.347960+0000","last_fullsized":"2024-09-21T05:52:11.347960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:05.874618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.269187+0000","last_change":"2024-09-21T05:51:50.265224+0000","last_active":"2024-09-21T05:51:51.269187+0000","last_peered":"2024-09-21T05:51:51.269187+0000","last_clean":"2024-09-21T05:51:51.269187+0000","last_became_active":"2024-09-21T05:51:50.264690+0000","last_became_peered":"2024-09-21T05:51:50.264690+0000","last_unstale":"2024-09-21T05:51:51.269187+0000","last_undegraded":"2024-09-21T05:51:51.269187+0000","last_fullsized":"2024-09-21T05:51:51.269187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:15.835492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.314586+0000","last_change":"2024-09-21T05:51:48.233092+0000","last_active":"2024-09-21T05:51:58.314586+0000","last_peered":"2024-09-21T05:51:58.314586+0000","last_clean":"2024-09-21T05:51:58.314586+0000","last_became_active":"2024-09-21T05:51:48.232684+0000","last_became_peered":"2024-09-21T05:51:48.232684+0000","last_unstale":"2024-09-21T05:51:58.314586+0000","last_undegraded":"2024-09-21T05:51:58.314586+0000","last_fullsized":"2024-09-21T05:51:58.314586+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:21.664828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.272417+0000","last_change":"2024-09-21T05:51:50.248419+0000","last_active":"2024-09-21T05:51:51.272417+0000","last_peered":"2024-09-21T05:51:51.272417+0000","last_clean":"2024-09-21T05:51:51.272417+0000","last_became_active":"2024-09-21T05:51:50.247871+0000","last_became_peered":"2024-09-21T05:51:50.247871+0000","last_unstale":"2024-09-21T05:51:51.272417+0000","last_undegraded":"2024-09-21T05:51:51.272417+0000","last_fullsized":"2024-09-21T05:51:51.272417+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:49.851685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.314918+0000","last_change":"2024-09-21T05:51:48.338367+0000","last_active":"2024-09-21T05:51:58.314918+0000","last_peered":"2024-09-21T05:51:58.314918+0000","last_clean":"2024-09-21T05:51:58.314918+0000","last_became_active":"2024-09-21T05:51:48.337992+0000","last_became_peered":"2024-09-21T05:51:48.337992+0000","last_unstale":"2024-09-21T05:51:58.314918+0000","last_undegraded":"2024-09-21T05:51:58.314918+0000","last_fullsized":"2024-09-21T05:51:58.314918+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:52.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.269735+0000","last_change":"2024-09-21T05:51:50.267046+0000","last_active":"2024-09-21T05:51:51.269735+0000","last_peered":"2024-09-21T05:51:51.269735+0000","last_clean":"2024-09-21T05:51:51.269735+0000","last_became_active":"2024-09-21T05:51:50.266672+0000","last_became_peered":"2024-09-21T05:51:50.266672+0000","last_unstale":"2024-09-21T05:51:51.269735+0000","last_undegraded":"2024-09-21T05:51:51.269735+0000","last_fullsized":"2024-09-21T05:51:51.269735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:53.628646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'25","reported_seq":77,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:12.355830+0000","last_change":"2024-09-21T05:51:48.233804+0000","last_active":"2024-09-21T05:52:12.355830+0000","last_peered":"2024-09-21T05:52:12.355830+0000","last_clean":"2024-09-21T05:52:12.355830+0000","last_became_active":"2024-09-21T05:51:48.233386+0000","last_became_peered":"2024-09-21T05:51:48.233386+0000","last_unstale":"2024-09-21T05:52:12.355830+0000","last_undegraded":"2024-09-21T05:52:12.355830+0000","last_fullsized":"2024-09-21T05:52:12.355830+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:45.644005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54250,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":68,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264621+0000","last_change":"2024-09-21T05:51:50.257673+0000","last_active":"2024-09-21T05:51:51.264621+0000","last_peered":"2024-09-21T05:51:51.264621+0000","last_clean":"2024-09-21T05:51:51.264621+0000","last_became_active":"2024-09-21T05:51:50.257319+0000","last_became_peered":"2024-09-21T05:51:50.257319+0000","last_unstale":"2024-09-21T05:51:51.264621+0000","last_undegraded":"2024-09-21T05:51:51.264621+0000","last_fullsized":"2024-09-21T05:51:51.264621+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:26.008964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.322325+0000","last_change":"2024-09-21T05:51:48.233264+0000","last_active":"2024-09-21T05:51:59.322325+0000","last_peered":"2024-09-21T05:51:59.322325+0000","last_clean":"2024-09-21T05:51:59.322325+0000","last_became_active":"2024-09-21T05:51:48.232808+0000","last_became_peered":"2024-09-21T05:51:48.232808+0000","last_unstale":"2024-09-21T05:51:59.322325+0000","last_undegraded":"2024-09-21T05:51:59.322325+0000","last_fullsized":"2024-09-21T05:51:59.322325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:05.105861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.245746+0000","last_change":"2024-09-21T05:51:50.251727+0000","last_active":"2024-09-21T05:51:51.245746+0000","last_peered":"2024-09-21T05:51:51.245746+0000","last_clean":"2024-09-21T05:51:51.245746+0000","last_became_active":"2024-09-21T05:51:50.251382+0000","last_became_peered":"2024-09-21T05:51:50.251382+0000","last_unstale":"2024-09-21T05:51:51.245746+0000","last_undegraded":"2024-09-21T05:51:51.245746+0000","last_fullsized":"2024-09-21T05:51:51.245746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:30.098548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.315623+0000","last_change":"2024-09-21T05:51:48.235226+0000","last_active":"2024-09-21T05:51:58.315623+0000","last_peered":"2024-09-21T05:51:58.315623+0000","last_clean":"2024-09-21T05:51:58.315623+0000","last_became_active":"2024-09-21T05:51:48.234432+0000","last_became_peered":"2024-09-21T05:51:48.234432+0000","last_unstale":"2024-09-21T05:51:58.315623+0000","last_undegraded":"2024-09-21T05:51:58.315623+0000","last_fullsized":"2024-09-21T05:51:58.315623+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:49.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.270399+0000","last_change":"2024-09-21T05:51:50.260276+0000","last_active":"2024-09-21T05:51:51.270399+0000","last_peered":"2024-09-21T05:51:51.270399+0000","last_clean":"2024-09-21T05:51:51.270399+0000","last_became_active":"2024-09-21T05:51:50.257448+0000","last_became_peered":"2024-09-21T05:51:50.257448+0000","last_unstale":"2024-09-21T05:51:51.270399+0000","last_undegraded":"2024-09-21T05:51:51.270399+0000","last_fullsized":"2024-09-21T05:51:51.270399+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:46.052226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:13.357208+0000","last_change":"2024-09-21T05:51:48.230764+0000","last_active":"2024-09-21T05:52:13.357208+0000","last_peered":"2024-09-21T05:52:13.357208+0000","last_clean":"2024-09-21T05:52:13.357208+0000","last_became_active":"2024-09-21T05:51:48.230332+0000","last_became_peered":"2024-09-21T05:51:48.230332+0000","last_unstale":"2024-09-21T05:52:13.357208+0000","last_undegraded":"2024-09-21T05:52:13.357208+0000","last_fullsized":"2024-09-21T05:52:13.357208+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:33.459588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.268880+0000","last_change":"2024-09-21T05:51:50.262380+0000","last_active":"2024-09-21T05:51:51.268880+0000","last_peered":"2024-09-21T05:51:51.268880+0000","last_clean":"2024-09-21T05:51:51.268880+0000","last_became_active":"2024-09-21T05:51:50.261972+0000","last_became_peered":"2024-09-21T05:51:50.261972+0000","last_unstale":"2024-09-21T05:51:51.268880+0000","last_undegraded":"2024-09-21T05:51:51.268880+0000","last_fullsized":"2024-09-21T05:51:51.268880+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:18.170437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":35,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.323302+0000","last_change":"2024-09-21T05:51:48.338309+0000","last_active":"2024-09-21T05:51:59.323302+0000","last_peered":"2024-09-21T05:51:59.323302+0000","last_clean":"2024-09-21T05:51:59.323302+0000","last_became_active":"2024-09-21T05:51:48.337903+0000","last_became_peered":"2024-09-21T05:51:48.337903+0000","last_unstale":"2024-09-21T05:51:59.323302+0000","last_undegraded":"2024-09-21T05:51:59.323302+0000","last_fullsized":"2024-09-21T05:51:59.323302+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:54.634956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.268271+0000","last_change":"2024-09-21T05:51:50.259257+0000","last_active":"2024-09-21T05:51:51.268271+0000","last_peered":"2024-09-21T05:51:51.268271+0000","last_clean":"2024-09-21T05:51:51.268271+0000","last_became_active":"2024-09-21T05:51:50.258892+0000","last_became_peered":"2024-09-21T05:51:50.258892+0000","last_unstale":"2024-09-21T05:51:51.268271+0000","last_undegraded":"2024-09-21T05:51:51.268271+0000","last_fullsized":"2024-09-21T05:51:51.268271+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:46.683115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:00.331740+0000","last_change":"2024-09-21T05:51:48.226956+0000","last_active":"2024-09-21T05:52:00.331740+0000","last_peered":"2024-09-21T05:52:00.331740+0000","last_clean":"2024-09-21T05:52:00.331740+0000","last_became_active":"2024-09-21T05:51:48.226531+0000","last_became_peered":"2024-09-21T05:51:48.226531+0000","last_unstale":"2024-09-21T05:52:00.331740+0000","last_undegraded":"2024-09-21T05:52:00.331740+0000","last_fullsized":"2024-09-21T05:52:00.331740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:14.888074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.265344+0000","last_change":"2024-09-21T05:51:50.261080+0000","last_active":"2024-09-21T05:51:51.265344+0000","last_peered":"2024-09-21T05:51:51.265344+0000","last_clean":"2024-09-21T05:51:51.265344+0000","last_became_active":"2024-09-21T05:51:50.260700+0000","last_became_peered":"2024-09-21T05:51:50.260700+0000","last_unstale":"2024-09-21T05:51:51.265344+0000","last_undegraded":"2024-09-21T05:51:51.265344+0000","last_fullsized":"2024-09-21T05:51:51.265344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.033889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267967+0000","last_change":"2024-09-21T05:51:48.230236+0000","last_active":"2024-09-21T05:51:51.267967+0000","last_peered":"2024-09-21T05:51:51.267967+0000","last_clean":"2024-09-21T05:51:51.267967+0000","last_became_active":"2024-09-21T05:51:48.229775+0000","last_became_peered":"2024-09-21T05:51:48.229775+0000","last_unstale":"2024-09-21T05:51:51.267967+0000","last_undegraded":"2024-09-21T05:51:51.267967+0000","last_fullsized":"2024-09-21T05:51:51.267967+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:25.371256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271036+0000","last_change":"2024-09-21T05:51:50.260749+0000","last_active":"2024-09-21T05:51:51.271036+0000","last_peered":"2024-09-21T05:51:51.271036+0000","last_clean":"2024-09-21T05:51:51.271036+0000","last_became_active":"2024-09-21T05:51:50.257406+0000","last_became_peered":"2024-09-21T05:51:50.257406+0000","last_unstale":"2024-09-21T05:51:51.271036+0000","last_undegraded":"2024-09-21T05:51:51.271036+0000","last_fullsized":"2024-09-21T05:51:51.271036+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:18.293144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.272197+0000","last_change":"2024-09-21T05:51:48.228752+0000","last_active":"2024-09-21T05:51:51.272197+0000","last_peered":"2024-09-21T05:51:51.272197+0000","last_clean":"2024-09-21T05:51:51.272197+0000","last_became_active":"2024-09-21T05:51:48.228361+0000","last_became_peered":"2024-09-21T05:51:48.228361+0000","last_unstale":"2024-09-21T05:51:51.272197+0000","last_undegraded":"2024-09-21T05:51:51.272197+0000","last_fullsized":"2024-09-21T05:51:51.272197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:05.868153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.270549+0000","last_change":"2024-09-21T05:51:50.256183+0000","last_active":"2024-09-21T05:51:51.270549+0000","last_peered":"2024-09-21T05:51:51.270549+0000","last_clean":"2024-09-21T05:51:51.270549+0000","last_became_active":"2024-09-21T05:51:50.255746+0000","last_became_peered":"2024-09-21T05:51:50.255746+0000","last_unstale":"2024-09-21T05:51:51.270549+0000","last_undegraded":"2024-09-21T05:51:51.270549+0000","last_fullsized":"2024-09-21T05:51:51.270549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:29.044470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.322372+0000","last_change":"2024-09-21T05:51:48.852935+0000","last_active":"2024-09-21T05:51:59.322372+0000","last_peered":"2024-09-21T05:51:59.322372+0000","last_clean":"2024-09-21T05:51:59.322372+0000","last_became_active":"2024-09-21T05:51:48.852457+0000","last_became_peered":"2024-09-21T05:51:48.852457+0000","last_unstale":"2024-09-21T05:51:59.322372+0000","last_undegraded":"2024-09-21T05:51:59.322372+0000","last_fullsized":"2024-09-21T05:51:59.322372+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:12.109669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271943+0000","last_change":"2024-09-21T05:51:50.261136+0000","last_active":"2024-09-21T05:51:51.271943+0000","last_peered":"2024-09-21T05:51:51.271943+0000","last_clean":"2024-09-21T05:51:51.271943+0000","last_became_active":"2024-09-21T05:51:50.260698+0000","last_became_peered":"2024-09-21T05:51:50.260698+0000","last_unstale":"2024-09-21T05:51:51.271943+0000","last_undegraded":"2024-09-21T05:51:51.271943+0000","last_fullsized":"2024-09-21T05:51:51.271943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:34.480352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":90,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.269114+0000","last_change":"2024-09-21T05:50:40.836627+0000","last_active":"2024-09-21T05:51:51.269114+0000","last_peered":"2024-09-21T05:51:51.269114+0000","last_clean":"2024-09-21T05:51:51.269114+0000","last_became_active":"2024-09-21T05:50:40.830426+0000","last_became_peered":"2024-09-21T05:50:40.830426+0000","last_unstale":"2024-09-21T05:51:51.269114+0000","last_undegraded":"2024-09-21T05:51:51.269114+0000","last_fullsized":"2024-09-21T05:51:51.269114+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_clean_scrub_stamp":"2024-09-21T05:47:21.634945+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:33.394077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:00.327727+0000","last_change":"2024-09-21T05:51:48.228187+0000","last_active":"2024-09-21T05:52:00.327727+0000","last_peered":"2024-09-21T05:52:00.327727+0000","last_clean":"2024-09-21T05:52:00.327727+0000","last_became_active":"2024-09-21T05:51:48.227690+0000","last_became_peered":"2024-09-21T05:51:48.227690+0000","last_unstale":"2024-09-21T05:52:00.327727+0000","last_undegraded":"2024-09-21T05:52:00.327727+0000","last_fullsized":"2024-09-21T05:52:00.327727+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:37.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.266038+0000","last_change":"2024-09-21T05:51:50.256024+0000","last_active":"2024-09-21T05:51:51.266038+0000","last_peered":"2024-09-21T05:51:51.266038+0000","last_clean":"2024-09-21T05:51:51.266038+0000","last_became_active":"2024-09-21T05:51:50.255597+0000","last_became_peered":"2024-09-21T05:51:50.255597+0000","last_unstale":"2024-09-21T05:51:51.266038+0000","last_undegraded":"2024-09-21T05:51:51.266038+0000","last_fullsized":"2024-09-21T05:51:51.266038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:07.768944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.323589+0000","last_change":"2024-09-21T05:51:48.234444+0000","last_active":"2024-09-21T05:51:59.323589+0000","last_peered":"2024-09-21T05:51:59.323589+0000","last_clean":"2024-09-21T05:51:59.323589+0000","last_became_active":"2024-09-21T05:51:48.233997+0000","last_became_peered":"2024-09-21T05:51:48.233997+0000","last_unstale":"2024-09-21T05:51:59.323589+0000","last_undegraded":"2024-09-21T05:51:59.323589+0000","last_fullsized":"2024-09-21T05:51:59.323589+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:12.931628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.245659+0000","last_change":"2024-09-21T05:51:50.242267+0000","last_active":"2024-09-21T05:51:51.245659+0000","last_peered":"2024-09-21T05:51:51.245659+0000","last_clean":"2024-09-21T05:51:51.245659+0000","last_became_active":"2024-09-21T05:51:50.241927+0000","last_became_peered":"2024-09-21T05:51:50.241927+0000","last_unstale":"2024-09-21T05:51:51.245659+0000","last_undegraded":"2024-09-21T05:51:51.245659+0000","last_fullsized":"2024-09-21T05:51:51.245659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:28.954451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:12.354631+0000","last_change":"2024-09-21T05:51:48.338372+0000","last_active":"2024-09-21T05:52:12.354631+0000","last_peered":"2024-09-21T05:52:12.354631+0000","last_clean":"2024-09-21T05:52:12.354631+0000","last_became_active":"2024-09-21T05:51:48.337966+0000","last_became_peered":"2024-09-21T05:51:48.337966+0000","last_unstale":"2024-09-21T05:52:12.354631+0000","last_undegraded":"2024-09-21T05:52:12.354631+0000","last_fullsized":"2024-09-21T05:52:12.354631+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:10.301871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267295+0000","last_change":"2024-09-21T05:51:50.253151+0000","last_active":"2024-09-21T05:51:51.267295+0000","last_peered":"2024-09-21T05:51:51.267295+0000","last_clean":"2024-09-21T05:51:51.267295+0000","last_became_active":"2024-09-21T05:51:50.252770+0000","last_became_peered":"2024-09-21T05:51:50.252770+0000","last_unstale":"2024-09-21T05:51:51.267295+0000","last_undegraded":"2024-09-21T05:51:51.267295+0000","last_fullsized":"2024-09-21T05:51:51.267295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:48.784229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271286+0000","last_change":"2024-09-21T05:51:48.233273+0000","last_active":"2024-09-21T05:51:51.271286+0000","last_peered":"2024-09-21T05:51:51.271286+0000","last_clean":"2024-09-21T05:51:51.271286+0000","last_became_active":"2024-09-21T05:51:48.232724+0000","last_became_peered":"2024-09-21T05:51:48.232724+0000","last_unstale":"2024-09-21T05:51:51.271286+0000","last_undegraded":"2024-09-21T05:51:51.271286+0000","last_fullsized":"2024-09-21T05:51:51.271286+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:50.869396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264827+0000","last_change":"2024-09-21T05:51:50.262521+0000","last_active":"2024-09-21T05:51:51.264827+0000","last_peered":"2024-09-21T05:51:51.264827+0000","last_clean":"2024-09-21T05:51:51.264827+0000","last_became_active":"2024-09-21T05:51:50.262135+0000","last_became_peered":"2024-09-21T05:51:50.262135+0000","last_unstale":"2024-09-21T05:51:51.264827+0000","last_undegraded":"2024-09-21T05:51:51.264827+0000","last_fullsized":"2024-09-21T05:51:51.264827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:18.347182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264172+0000","last_change":"2024-09-21T05:51:48.338532+0000","last_active":"2024-09-21T05:51:51.264172+0000","last_peered":"2024-09-21T05:51:51.264172+0000","last_clean":"2024-09-21T05:51:51.264172+0000","last_became_active":"2024-09-21T05:51:48.338099+0000","last_became_peered":"2024-09-21T05:51:48.338099+0000","last_unstale":"2024-09-21T05:51:51.264172+0000","last_undegraded":"2024-09-21T05:51:51.264172+0000","last_fullsized":"2024-09-21T05:51:51.264172+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:48.670988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:53.271427+0000","last_change":"2024-09-21T05:51:50.251814+0000","last_active":"2024-09-21T05:51:53.271427+0000","last_peered":"2024-09-21T05:51:53.271427+0000","last_clean":"2024-09-21T05:51:53.271427+0000","last_became_active":"2024-09-21T05:51:50.251401+0000","last_became_peered":"2024-09-21T05:51:50.251401+0000","last_unstale":"2024-09-21T05:51:53.271427+0000","last_undegraded":"2024-09-21T05:51:53.271427+0000","last_fullsized":"2024-09-21T05:51:53.271427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:12.972300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.312773+0000","last_change":"2024-09-21T05:51:48.338312+0000","last_active":"2024-09-21T05:51:58.312773+0000","last_peered":"2024-09-21T05:51:58.312773+0000","last_clean":"2024-09-21T05:51:58.312773+0000","last_became_active":"2024-09-21T05:51:48.337872+0000","last_became_peered":"2024-09-21T05:51:48.337872+0000","last_unstale":"2024-09-21T05:51:58.312773+0000","last_undegraded":"2024-09-21T05:51:58.312773+0000","last_fullsized":"2024-09-21T05:51:58.312773+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:26.158650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.246157+0000","last_change":"2024-09-21T05:51:50.245129+0000","last_active":"2024-09-21T05:51:51.246157+0000","last_peered":"2024-09-21T05:51:51.246157+0000","last_clean":"2024-09-21T05:51:51.246157+0000","last_became_active":"2024-09-21T05:51:50.244439+0000","last_became_peered":"2024-09-21T05:51:50.244439+0000","last_unstale":"2024-09-21T05:51:51.246157+0000","last_undegraded":"2024-09-21T05:51:51.246157+0000","last_fullsized":"2024-09-21T05:51:51.246157+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:19.241921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'10","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:52:12.264443+0000","last_change":"2024-09-21T05:51:48.226303+0000","last_active":"2024-09-21T05:52:12.264443+0000","last_peered":"2024-09-21T05:52:12.264443+0000","last_clean":"2024-09-21T05:52:12.264443+0000","last_became_active":"2024-09-21T05:51:48.225869+0000","last_became_peered":"2024-09-21T05:51:48.225869+0000","last_unstale":"2024-09-21T05:52:12.264443+0000","last_undegraded":"2024-09-21T05:52:12.264443+0000","last_fullsized":"2024-09-21T05:52:12.264443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:47.210001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267386+0000","last_change":"2024-09-21T05:51:50.253411+0000","last_active":"2024-09-21T05:51:51.267386+0000","last_peered":"2024-09-21T05:51:51.267386+0000","last_clean":"2024-09-21T05:51:51.267386+0000","last_became_active":"2024-09-21T05:51:50.252816+0000","last_became_peered":"2024-09-21T05:51:50.252816+0000","last_unstale":"2024-09-21T05:51:51.267386+0000","last_undegraded":"2024-09-21T05:51:51.267386+0000","last_fullsized":"2024-09-21T05:51:51.267386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:33.444176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.311496+0000","last_change":"2024-09-21T05:51:48.852668+0000","last_active":"2024-09-21T05:51:58.311496+0000","last_peered":"2024-09-21T05:51:58.311496+0000","last_clean":"2024-09-21T05:51:58.311496+0000","last_became_active":"2024-09-21T05:51:48.852298+0000","last_became_peered":"2024-09-21T05:51:48.852298+0000","last_unstale":"2024-09-21T05:51:58.311496+0000","last_undegraded":"2024-09-21T05:51:58.311496+0000","last_fullsized":"2024-09-21T05:51:58.311496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:19.529194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.272291+0000","last_change":"2024-09-21T05:51:50.246720+0000","last_active":"2024-09-21T05:51:51.272291+0000","last_peered":"2024-09-21T05:51:51.272291+0000","last_clean":"2024-09-21T05:51:51.272291+0000","last_became_active":"2024-09-21T05:51:50.246318+0000","last_became_peered":"2024-09-21T05:51:50.246318+0000","last_unstale":"2024-09-21T05:51:51.272291+0000","last_undegraded":"2024-09-21T05:51:51.272291+0000","last_fullsized":"2024-09-21T05:51:51.272291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:45.737949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.314642+0000","last_change":"2024-09-21T05:51:48.338346+0000","last_active":"2024-09-21T05:51:58.314642+0000","last_peered":"2024-09-21T05:51:58.314642+0000","last_clean":"2024-09-21T05:51:58.314642+0000","last_became_active":"2024-09-21T05:51:48.337968+0000","last_became_peered":"2024-09-21T05:51:48.337968+0000","last_unstale":"2024-09-21T05:51:58.314642+0000","last_undegraded":"2024-09-21T05:51:58.314642+0000","last_fullsized":"2024-09-21T05:51:58.314642+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:32.450546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.264350+0000","last_change":"2024-09-21T05:51:50.255993+0000","last_active":"2024-09-21T05:51:51.264350+0000","last_peered":"2024-09-21T05:51:51.264350+0000","last_clean":"2024-09-21T05:51:51.264350+0000","last_became_active":"2024-09-21T05:51:50.255645+0000","last_became_peered":"2024-09-21T05:51:50.255645+0000","last_unstale":"2024-09-21T05:51:51.264350+0000","last_undegraded":"2024-09-21T05:51:51.264350+0000","last_fullsized":"2024-09-21T05:51:51.264350+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.890940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.315685+0000","last_change":"2024-09-21T05:51:48.231659+0000","last_active":"2024-09-21T05:51:58.315685+0000","last_peered":"2024-09-21T05:51:58.315685+0000","last_clean":"2024-09-21T05:51:58.315685+0000","last_became_active":"2024-09-21T05:51:48.231137+0000","last_became_peered":"2024-09-21T05:51:48.231137+0000","last_unstale":"2024-09-21T05:51:58.315685+0000","last_undegraded":"2024-09-21T05:51:58.315685+0000","last_fullsized":"2024-09-21T05:51:58.315685+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:06.166268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.266051+0000","last_change":"2024-09-21T05:51:50.251904+0000","last_active":"2024-09-21T05:51:51.266051+0000","last_peered":"2024-09-21T05:51:51.266051+0000","last_clean":"2024-09-21T05:51:51.266051+0000","last_became_active":"2024-09-21T05:51:50.251403+0000","last_became_peered":"2024-09-21T05:51:50.251403+0000","last_unstale":"2024-09-21T05:51:51.266051+0000","last_undegraded":"2024-09-21T05:51:51.266051+0000","last_fullsized":"2024-09-21T05:51:51.266051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:47.702083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.246914+0000","last_change":"2024-09-21T05:51:48.229861+0000","last_active":"2024-09-21T05:51:51.246914+0000","last_peered":"2024-09-21T05:51:51.246914+0000","last_clean":"2024-09-21T05:51:51.246914+0000","last_became_active":"2024-09-21T05:51:48.229296+0000","last_became_peered":"2024-09-21T05:51:48.229296+0000","last_unstale":"2024-09-21T05:51:51.246914+0000","last_undegraded":"2024-09-21T05:51:51.246914+0000","last_fullsized":"2024-09-21T05:51:51.246914+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:16.586505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.266048+0000","last_change":"2024-09-21T05:51:50.256654+0000","last_active":"2024-09-21T05:51:51.266048+0000","last_peered":"2024-09-21T05:51:51.266048+0000","last_clean":"2024-09-21T05:51:51.266048+0000","last_became_active":"2024-09-21T05:51:50.255830+0000","last_became_peered":"2024-09-21T05:51:50.255830+0000","last_unstale":"2024-09-21T05:51:51.266048+0000","last_undegraded":"2024-09-21T05:51:51.266048+0000","last_fullsized":"2024-09-21T05:51:51.266048+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:49.643890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:58.315966+0000","last_change":"2024-09-21T05:51:48.233608+0000","last_active":"2024-09-21T05:51:58.315966+0000","last_peered":"2024-09-21T05:51:58.315966+0000","last_clean":"2024-09-21T05:51:58.315966+0000","last_became_active":"2024-09-21T05:51:48.233187+0000","last_became_peered":"2024-09-21T05:51:48.233187+0000","last_unstale":"2024-09-21T05:51:58.315966+0000","last_undegraded":"2024-09-21T05:51:58.315966+0000","last_fullsized":"2024-09-21T05:51:58.315966+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:57.815632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.269869+0000","last_change":"2024-09-21T05:51:50.266753+0000","last_active":"2024-09-21T05:51:51.269869+0000","last_peered":"2024-09-21T05:51:51.269869+0000","last_clean":"2024-09-21T05:51:51.269869+0000","last_became_active":"2024-09-21T05:51:50.266368+0000","last_became_peered":"2024-09-21T05:51:50.266368+0000","last_unstale":"2024-09-21T05:51:51.269869+0000","last_undegraded":"2024-09-21T05:51:51.269869+0000","last_fullsized":"2024-09-21T05:51:51.269869+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:02.011213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.267452+0000","last_change":"2024-09-21T05:51:50.257731+0000","last_active":"2024-09-21T05:51:51.267452+0000","last_peered":"2024-09-21T05:51:51.267452+0000","last_clean":"2024-09-21T05:51:51.267452+0000","last_became_active":"2024-09-21T05:51:50.257396+0000","last_became_peered":"2024-09-21T05:51:50.257396+0000","last_unstale":"2024-09-21T05:51:51.267452+0000","last_undegraded":"2024-09-21T05:51:51.267452+0000","last_fullsized":"2024-09-21T05:51:51.267452+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:58.109069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271039+0000","last_change":"2024-09-21T05:51:48.234067+0000","last_active":"2024-09-21T05:51:51.271039+0000","last_peered":"2024-09-21T05:51:51.271039+0000","last_clean":"2024-09-21T05:51:51.271039+0000","last_became_active":"2024-09-21T05:51:48.233532+0000","last_became_peered":"2024-09-21T05:51:48.233532+0000","last_unstale":"2024-09-21T05:51:51.271039+0000","last_undegraded":"2024-09-21T05:51:51.271039+0000","last_fullsized":"2024-09-21T05:51:51.271039+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:40.997254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.269574+0000","last_change":"2024-09-21T05:51:50.265453+0000","last_active":"2024-09-21T05:51:51.269574+0000","last_peered":"2024-09-21T05:51:51.269574+0000","last_clean":"2024-09-21T05:51:51.269574+0000","last_became_active":"2024-09-21T05:51:50.265073+0000","last_became_peered":"2024-09-21T05:51:50.265073+0000","last_unstale":"2024-09-21T05:51:51.269574+0000","last_undegraded":"2024-09-21T05:51:51.269574+0000","last_fullsized":"2024-09-21T05:51:51.269574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:15.295822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.321919+0000","last_change":"2024-09-21T05:51:48.233623+0000","last_active":"2024-09-21T05:51:59.321919+0000","last_peered":"2024-09-21T05:51:59.321919+0000","last_clean":"2024-09-21T05:51:59.321919+0000","last_became_active":"2024-09-21T05:51:48.233182+0000","last_became_peered":"2024-09-21T05:51:48.233182+0000","last_unstale":"2024-09-21T05:51:59.321919+0000","last_undegraded":"2024-09-21T05:51:59.321919+0000","last_fullsized":"2024-09-21T05:51:59.321919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:07.948266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271684+0000","last_change":"2024-09-21T05:51:50.267110+0000","last_active":"2024-09-21T05:51:51.271684+0000","last_peered":"2024-09-21T05:51:51.271684+0000","last_clean":"2024-09-21T05:51:51.271684+0000","last_became_active":"2024-09-21T05:51:50.266504+0000","last_became_peered":"2024-09-21T05:51:50.266504+0000","last_unstale":"2024-09-21T05:51:51.271684+0000","last_undegraded":"2024-09-21T05:51:51.271684+0000","last_fullsized":"2024-09-21T05:51:51.271684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:10.618361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.271337+0000","last_change":"2024-09-21T05:51:48.337971+0000","last_active":"2024-09-21T05:51:51.271337+0000","last_peered":"2024-09-21T05:51:51.271337+0000","last_clean":"2024-09-21T05:51:51.271337+0000","last_became_active":"2024-09-21T05:51:48.337487+0000","last_became_peered":"2024-09-21T05:51:48.337487+0000","last_unstale":"2024-09-21T05:51:51.271337+0000","last_undegraded":"2024-09-21T05:51:51.271337+0000","last_fullsized":"2024-09-21T05:51:51.271337+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.150563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:51.266943+0000","last_change":"2024-09-21T05:51:50.253826+0000","last_active":"2024-09-21T05:51:51.266943+0000","last_peered":"2024-09-21T05:51:51.266943+0000","last_clean":"2024-09-21T05:51:51.266943+0000","last_became_active":"2024-09-21T05:51:50.251700+0000","last_became_peered":"2024-09-21T05:51:50.251700+0000","last_unstale":"2024-09-21T05:51:51.266943+0000","last_undegraded":"2024-09-21T05:51:51.266943+0000","last_fullsized":"2024-09-21T05:51:51.266943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:02.929651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T05:51:59.323221+0000","last_change":"2024-09-21T05:51:48.234358+0000","last_active":"2024-09-21T05:51:59.323221+0000","last_peered":"2024-09-21T05:51:59.323221+0000","last_clean":"2024-09-21T05:51:59.323221+0000","last_became_active":"2024-09-21T05:51:48.233982+0000","last_became_peered":"2024-09-21T05:51:48.233982+0000","last_unstale":"2024-09-21T05:51:59.323221+0000","last_undegraded":"2024-09-21T05:51:59.323221+0000","last_fullsized":"2024-09-21T05:51:59.323221+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:42.510872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58251,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":109,"num_read_kb":114,"num_write":157,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":174753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808849,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717360,"statfs":{"total":95995035648,"available":95966576640,"internally_reserved":0,"allocated":786432,"data_stored":389394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972373,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36788,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708364,"statfs":{"total":95995035648,"available":95957364736,"internally_reserved":0,"allocated":1478656,"data_stored":1035516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168603,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":389630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332128,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":389550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528357,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28388,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716764,"statfs":{"total":95995035648,"available":95965966336,"internally_reserved":0,"allocated":1396736,"data_stored":981480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":389019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855407,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36720,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708432,"statfs":{"total":95995035648,"available":95957434368,"internally_reserved":0,"allocated":1409024,"data_stored":980773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986228,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36120,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709032,"statfs":{"total":95995035648,"available":95958048768,"internally_reserved":0,"allocated":794624,"data_stored":389847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149753,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":806912,"data_stored":389330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378687,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":444412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":443062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40296,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704856,"statfs":{"total":95995035648,"available":95953772544,"internally_reserved":0,"allocated":811008,"data_stored":390290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":55600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:52:17.675 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T05:52:17.675 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T05:52:17.676 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T05:52:17.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:17 smithi007 ceph-mon[30983]: pgmap v268: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.5 KiB/s wr, 8 op/s 2024-09-21T05:52:17.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:17 smithi007 ceph-mon[30983]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:17.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:17 smithi119 ceph-mon[34833]: pgmap v268: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.5 KiB/s wr, 8 op/s 2024-09-21T05:52:17.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:17 smithi119 ceph-mon[34833]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:17.938 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:17.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:17 smithi027 ceph-mon[34364]: pgmap v268: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.5 KiB/s wr, 8 op/s 2024-09-21T05:52:17.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:17 smithi027 ceph-mon[34364]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:18.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.384+0000 7fc6fc305640 1 -- 172.21.15.7:0/956903953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4102a80 msgr2=0x7fc6f4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:18.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.384+0000 7fc6fc305640 1 --2- 172.21.15.7:0/956903953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4102a80 0x7fc6f4102e90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009900 tx=0x7fc6f002a410 comp rx=0 tx=0).stop 2024-09-21T05:52:18.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.384+0000 7fc6fc305640 1 -- 172.21.15.7:0/956903953 shutdown_connections 2024-09-21T05:52:18.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.384+0000 7fc6fc305640 1 --2- 172.21.15.7:0/956903953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4108d10 0x7fc6f410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.384+0000 7fc6fc305640 1 --2- 172.21.15.7:0/956903953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41083c0 0x7fc6f41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.384+0000 7fc6fc305640 1 --2- 172.21.15.7:0/956903953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4102a80 0x7fc6f4102e90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.384+0000 7fc6fc305640 1 -- 172.21.15.7:0/956903953 >> 172.21.15.7:0/956903953 conn(0x7fc6f4079760 msgr2=0x7fc6f4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:18.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.384+0000 7fc6fc305640 1 -- 172.21.15.7:0/956903953 shutdown_connections 2024-09-21T05:52:18.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.384+0000 7fc6fc305640 1 -- 172.21.15.7:0/956903953 wait complete. 2024-09-21T05:52:18.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.385+0000 7fc6fc305640 1 Processor -- start 2024-09-21T05:52:18.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.385+0000 7fc6fc305640 1 -- start start 2024-09-21T05:52:18.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.385+0000 7fc6fc305640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4102a80 0x7fc6f419b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:18.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.385+0000 7fc6fc305640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41083c0 0x7fc6f419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.385+0000 7fc6fc305640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4108d10 0x7fc6f419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.385+0000 7fc6fc305640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f4112a30 con 0x7fc6f4102a80 2024-09-21T05:52:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.385+0000 7fc6fc305640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f41128b0 con 0x7fc6f41083c0 2024-09-21T05:52:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.385+0000 7fc6fc305640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f4112bb0 con 0x7fc6f4108d10 2024-09-21T05:52:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6fa0a1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4102a80 0x7fc6f419b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6fa0a1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4102a80 0x7fc6f419b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55428/0 (socket says 172.21.15.7:55428) 2024-09-21T05:52:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6fa0a1640 1 -- 172.21.15.7:0/2539687179 learned_addr learned my addr 172.21.15.7:0/2539687179 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6f98a0640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41083c0 0x7fc6f419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6fa8a2640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4108d10 0x7fc6f419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6fa0a1640 1 -- 172.21.15.7:0/2539687179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4108d10 msgr2=0x7fc6f419bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6fa0a1640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4108d10 0x7fc6f419bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6fa0a1640 1 -- 172.21.15.7:0/2539687179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41083c0 msgr2=0x7fc6f419b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:18.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6fa0a1640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41083c0 0x7fc6f419b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6fa0a1640 1 -- 172.21.15.7:0/2539687179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f41a6510 con 0x7fc6f4102a80 2024-09-21T05:52:18.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6fa8a2640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4108d10 0x7fc6f419bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:18.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6fa0a1640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4102a80 0x7fc6f419b280 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0005ab0 tx=0x7fc6f0003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:18.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6eb7fe640 1 -- 172.21.15.7:0/2539687179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f003f070 con 0x7fc6f4102a80 2024-09-21T05:52:18.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6eb7fe640 1 -- 172.21.15.7:0/2539687179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6f0031d60 con 0x7fc6f4102a80 2024-09-21T05:52:18.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6fc305640 1 -- 172.21.15.7:0/2539687179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f4199070 con 0x7fc6f4102a80 2024-09-21T05:52:18.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.386+0000 7fc6eb7fe640 1 -- 172.21.15.7:0/2539687179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0035030 con 0x7fc6f4102a80 2024-09-21T05:52:18.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.387+0000 7fc6fc305640 1 -- 172.21.15.7:0/2539687179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f4199620 con 0x7fc6f4102a80 2024-09-21T05:52:18.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.387+0000 7fc6fc305640 1 -- 172.21.15.7:0/2539687179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f4102e90 con 0x7fc6f4102a80 2024-09-21T05:52:18.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.389+0000 7fc6eb7fe640 1 -- 172.21.15.7:0/2539687179 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fc6f0042070 con 0x7fc6f4102a80 2024-09-21T05:52:18.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.390+0000 7fc6eb7fe640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc6e00b66a0 0x7fc6e00b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:18.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.390+0000 7fc6f98a0640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc6e00b66a0 0x7fc6e00b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:18.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.391+0000 7fc6eb7fe640 1 -- 172.21.15.7:0/2539687179 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7fc6f0108090 con 0x7fc6f4102a80 2024-09-21T05:52:18.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.391+0000 7fc6f98a0640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc6e00b66a0 0x7fc6e00b8bb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4079c20 tx=0x7fc6e4010040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:18.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.394+0000 7fc6eb7fe640 1 -- 172.21.15.7:0/2539687179 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc6f00ce7e0 con 0x7fc6f4102a80 2024-09-21T05:52:18.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.654+0000 7fc6fc305640 1 -- 172.21.15.7:0/2539687179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fc6f402e640 con 0x7fc6f4102a80 2024-09-21T05:52:18.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.657+0000 7fc6eb7fe640 1 -- 172.21.15.7:0/2539687179 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fc6f00d2bc0 con 0x7fc6f4102a80 2024-09-21T05:52:18.659 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-09-21T05:52:18.659 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQASX+5mftsZJxAAPiiBtPOM3KezPqY8rPYGDg== 2024-09-21T05:52:18.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.659+0000 7fc6fc305640 1 -- 172.21.15.7:0/2539687179 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc6e00b66a0 msgr2=0x7fc6e00b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:18.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.659+0000 7fc6fc305640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc6e00b66a0 0x7fc6e00b8bb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4079c20 tx=0x7fc6e4010040 comp rx=0 tx=0).stop 2024-09-21T05:52:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.659+0000 7fc6fc305640 1 -- 172.21.15.7:0/2539687179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4102a80 msgr2=0x7fc6f419b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.659+0000 7fc6fc305640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4102a80 0x7fc6f419b280 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0005ab0 tx=0x7fc6f0003d50 comp rx=0 tx=0).stop 2024-09-21T05:52:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.659+0000 7fc6fc305640 1 -- 172.21.15.7:0/2539687179 shutdown_connections 2024-09-21T05:52:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.659+0000 7fc6fc305640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc6e00b66a0 0x7fc6e00b8bb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.659+0000 7fc6fc305640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6f4108d10 0x7fc6f419bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.659+0000 7fc6fc305640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6f41083c0 0x7fc6f419b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.659+0000 7fc6fc305640 1 --2- 172.21.15.7:0/2539687179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6f4102a80 0x7fc6f419b280 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.659+0000 7fc6fc305640 1 -- 172.21.15.7:0/2539687179 >> 172.21.15.7:0/2539687179 conn(0x7fc6f4079760 msgr2=0x7fc6f41012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.660+0000 7fc6fc305640 1 -- 172.21.15.7:0/2539687179 shutdown_connections 2024-09-21T05:52:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:18.660+0000 7fc6fc305640 1 -- 172.21.15.7:0/2539687179 wait complete. 2024-09-21T05:52:19.377 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:52:19.377 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T05:52:19.377 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T05:52:19.418 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T05:52:19.721 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:19.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:19 smithi007 ceph-mon[30983]: pgmap v269: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-21T05:52:19.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:19 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2539687179' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T05:52:19.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:19 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2539687179' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:52:19.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:19 smithi119 ceph-mon[34833]: pgmap v269: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-21T05:52:19.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:19 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2539687179' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T05:52:19.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:19 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2539687179' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:52:19.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:19 smithi027 ceph-mon[34364]: pgmap v269: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-21T05:52:19.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:19 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2539687179' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T05:52:19.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:19 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2539687179' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:52:20.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.192+0000 7fa188c60640 1 -- 172.21.15.7:0/1203320548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102a60 msgr2=0x7fa184102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:20.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.192+0000 7fa188c60640 1 --2- 172.21.15.7:0/1203320548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102a60 0x7fa184102e70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa17c009900 tx=0x7fa17c02a410 comp rx=0 tx=0).stop 2024-09-21T05:52:20.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.192+0000 7fa188c60640 1 -- 172.21.15.7:0/1203320548 shutdown_connections 2024-09-21T05:52:20.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.192+0000 7fa188c60640 1 --2- 172.21.15.7:0/1203320548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa184108cf0 0x7fa18410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.192+0000 7fa188c60640 1 --2- 172.21.15.7:0/1203320548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1841083a0 0x7fa1841087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.192+0000 7fa188c60640 1 --2- 172.21.15.7:0/1203320548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102a60 0x7fa184102e70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.192+0000 7fa188c60640 1 -- 172.21.15.7:0/1203320548 >> 172.21.15.7:0/1203320548 conn(0x7fa184079720 msgr2=0x7fa184079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:20.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.192+0000 7fa188c60640 1 -- 172.21.15.7:0/1203320548 shutdown_connections 2024-09-21T05:52:20.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.192+0000 7fa188c60640 1 -- 172.21.15.7:0/1203320548 wait complete. 2024-09-21T05:52:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.193+0000 7fa188c60640 1 Processor -- start 2024-09-21T05:52:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.193+0000 7fa188c60640 1 -- start start 2024-09-21T05:52:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.193+0000 7fa188c60640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102a60 0x7fa18419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.193+0000 7fa188c60640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1841083a0 0x7fa18419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:20.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.193+0000 7fa188c60640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184108cf0 0x7fa18419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa188c60640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa184112960 con 0x7fa184102a60 2024-09-21T05:52:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa188c60640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841127e0 con 0x7fa1841083a0 2024-09-21T05:52:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa188c60640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa184112ae0 con 0x7fa184108cf0 2024-09-21T05:52:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa18259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102a60 0x7fa18419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa18259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102a60 0x7fa18419b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52750/0 (socket says 172.21.15.7:52750) 2024-09-21T05:52:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa18259c640 1 -- 172.21.15.7:0/1711478832 learned_addr learned my addr 172.21.15.7:0/1711478832 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa181d9b640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1841083a0 0x7fa18419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa182d9d640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184108cf0 0x7fa18419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa18259c640 1 -- 172.21.15.7:0/1711478832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184108cf0 msgr2=0x7fa18419bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa18259c640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184108cf0 0x7fa18419bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa18259c640 1 -- 172.21.15.7:0/1711478832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1841083a0 msgr2=0x7fa18419b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa18259c640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1841083a0 0x7fa18419b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa18259c640 1 -- 172.21.15.7:0/1711478832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1841a6560 con 0x7fa184102a60 2024-09-21T05:52:20.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa18259c640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102a60 0x7fa18419b2d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa17c005940 tx=0x7fa17c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:20.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa17b7fe640 1 -- 172.21.15.7:0/1711478832 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c03f030 con 0x7fa184102a60 2024-09-21T05:52:20.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa17b7fe640 1 -- 172.21.15.7:0/1711478832 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa17c003cb0 con 0x7fa184102a60 2024-09-21T05:52:20.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.194+0000 7fa188c60640 1 -- 172.21.15.7:0/1711478832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1841a67f0 con 0x7fa184102a60 2024-09-21T05:52:20.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.195+0000 7fa17b7fe640 1 -- 172.21.15.7:0/1711478832 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c035070 con 0x7fa184102a60 2024-09-21T05:52:20.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.195+0000 7fa188c60640 1 -- 172.21.15.7:0/1711478832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1841a6cd0 con 0x7fa184102a60 2024-09-21T05:52:20.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.195+0000 7fa188c60640 1 -- 172.21.15.7:0/1711478832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa184103ce0 con 0x7fa184102a60 2024-09-21T05:52:20.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.197+0000 7fa17b7fe640 1 -- 172.21.15.7:0/1711478832 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fa17c042030 con 0x7fa184102a60 2024-09-21T05:52:20.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.198+0000 7fa17b7fe640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa1700b6620 0x7fa1700b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:20.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.198+0000 7fa181d9b640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa1700b6620 0x7fa1700b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:20.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.198+0000 7fa17b7fe640 1 -- 172.21.15.7:0/1711478832 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7fa17c107d40 con 0x7fa184102a60 2024-09-21T05:52:20.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.199+0000 7fa181d9b640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa1700b6620 0x7fa1700b8b30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa184100bd0 tx=0x7fa16c00a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:20.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.201+0000 7fa17b7fe640 1 -- 172.21.15.7:0/1711478832 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa17c0ce430 con 0x7fa184102a60 2024-09-21T05:52:20.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.391+0000 7fa188c60640 1 -- 172.21.15.7:0/1711478832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fa18406bff0 con 0x7fa184102a60 2024-09-21T05:52:20.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.391+0000 7fa17b7fe640 1 -- 172.21.15.7:0/1711478832 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v56) ==== 86+0+133 (secure 0 0 0) 0x7fa18406bff0 con 0x7fa184102a60 2024-09-21T05:52:20.393 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:52:20.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.394+0000 7fa188c60640 1 -- 172.21.15.7:0/1711478832 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa1700b6620 msgr2=0x7fa1700b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:20.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.394+0000 7fa188c60640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa1700b6620 0x7fa1700b8b30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa184100bd0 tx=0x7fa16c00a250 comp rx=0 tx=0).stop 2024-09-21T05:52:20.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.394+0000 7fa188c60640 1 -- 172.21.15.7:0/1711478832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102a60 msgr2=0x7fa18419b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:20.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.394+0000 7fa188c60640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102a60 0x7fa18419b2d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa17c005940 tx=0x7fa17c0042f0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.394+0000 7fa188c60640 1 -- 172.21.15.7:0/1711478832 shutdown_connections 2024-09-21T05:52:20.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.394+0000 7fa188c60640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa1700b6620 0x7fa1700b8b30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.394+0000 7fa188c60640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184108cf0 0x7fa18419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.394+0000 7fa188c60640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1841083a0 0x7fa18419b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.394+0000 7fa188c60640 1 --2- 172.21.15.7:0/1711478832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102a60 0x7fa18419b2d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:20.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.394+0000 7fa188c60640 1 -- 172.21.15.7:0/1711478832 >> 172.21.15.7:0/1711478832 conn(0x7fa184079720 msgr2=0x7fa184101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:20.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.394+0000 7fa188c60640 1 -- 172.21.15.7:0/1711478832 shutdown_connections 2024-09-21T05:52:20.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:20.394+0000 7fa188c60640 1 -- 172.21.15.7:0/1711478832 wait complete. 2024-09-21T05:52:20.754 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:20 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1711478832' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T05:52:20.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:20 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1711478832' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T05:52:20.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:20 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1711478832' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T05:52:21.065 INFO:teuthology.orchestra.run.smithi007.stdout:[{"version":56,"timestamp":"2024-09-21T05:51:40.186524+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T05:52:21.066 INFO:tasks.ceph_manager:config epoch is 56 2024-09-21T05:52:21.066 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T05:52:21.066 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T05:52:21.066 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T05:52:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:21.758 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:21 smithi007 ceph-mon[30983]: pgmap v270: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s 2024-09-21T05:52:21.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.755+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/4244661472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2c8109df0 msgr2=0x7fb2c8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:21.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.755+0000 7fb2cd4f4640 1 --2- 172.21.15.7:0/4244661472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2c8109df0 0x7fb2c8110620 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009ca0 tx=0x7fb2c002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:21.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.755+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/4244661472 shutdown_connections 2024-09-21T05:52:21.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.755+0000 7fb2cd4f4640 1 --2- 172.21.15.7:0/4244661472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2c8109df0 0x7fb2c8110620 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:21.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.755+0000 7fb2cd4f4640 1 --2- 172.21.15.7:0/4244661472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c81094a0 0x7fb2c81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:21.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.755+0000 7fb2cd4f4640 1 --2- 172.21.15.7:0/4244661472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c8103b60 0x7fb2c8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:21.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.756+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/4244661472 >> 172.21.15.7:0/4244661472 conn(0x7fb2c807b850 msgr2=0x7fb2c807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:21.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.756+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/4244661472 shutdown_connections 2024-09-21T05:52:21.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.756+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/4244661472 wait complete. 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.756+0000 7fb2cd4f4640 1 Processor -- start 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.756+0000 7fb2cd4f4640 1 -- start start 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2cd4f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2c8103b60 0x7fb2c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2cd4f4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c81094a0 0x7fb2c8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2cd4f4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c8109df0 0x7fb2c8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2cd4f4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c8113ab0 con 0x7fb2c8103b60 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2cd4f4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c8113930 con 0x7fb2c8109df0 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2cd4f4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c8113c30 con 0x7fb2c81094a0 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2c6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2c8103b60 0x7fb2c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2c6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2c8103b60 0x7fb2c8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52764/0 (socket says 172.21.15.7:52764) 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2c6ffd640 1 -- 172.21.15.7:0/3698991799 learned_addr learned my addr 172.21.15.7:0/3698991799 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2bffff640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c81094a0 0x7fb2c8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2c77fe640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c8109df0 0x7fb2c8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2c6ffd640 1 -- 172.21.15.7:0/3698991799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c81094a0 msgr2=0x7fb2c8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:21.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2c6ffd640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c81094a0 0x7fb2c8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:21.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2c6ffd640 1 -- 172.21.15.7:0/3698991799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c8109df0 msgr2=0x7fb2c8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:21.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2c6ffd640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c8109df0 0x7fb2c8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:21.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2c6ffd640 1 -- 172.21.15.7:0/3698991799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c81a8720 con 0x7fb2c8103b60 2024-09-21T05:52:21.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.757+0000 7fb2c77fe640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c8109df0 0x7fb2c8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:21.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.758+0000 7fb2c6ffd640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2c8103b60 0x7fb2c8075710 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800d950 tx=0x7fb2b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:21.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.758+0000 7fb2c4ff9640 1 -- 172.21.15.7:0/3698991799 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8017030 con 0x7fb2c8103b60 2024-09-21T05:52:21.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.758+0000 7fb2c4ff9640 1 -- 172.21.15.7:0/3698991799 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2b8004020 con 0x7fb2c8103b60 2024-09-21T05:52:21.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.758+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/3698991799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c81a8a10 con 0x7fb2c8103b60 2024-09-21T05:52:21.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.758+0000 7fb2c4ff9640 1 -- 172.21.15.7:0/3698991799 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b80047a0 con 0x7fb2c8103b60 2024-09-21T05:52:21.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.758+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/3698991799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c81a8fa0 con 0x7fb2c8103b60 2024-09-21T05:52:21.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.759+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/3698991799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c8103f70 con 0x7fb2c8103b60 2024-09-21T05:52:21.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.761+0000 7fb2c4ff9640 1 -- 172.21.15.7:0/3698991799 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fb2b8009a30 con 0x7fb2c8103b60 2024-09-21T05:52:21.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.761+0000 7fb2c4ff9640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb2b40b6670 0x7fb2b40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:21.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.761+0000 7fb2bffff640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb2b40b6670 0x7fb2b40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:21.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.762+0000 7fb2c4ff9640 1 -- 172.21.15.7:0/3698991799 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8194+0+0 (secure 0 0 0) 0x7fb2b80e6f70 con 0x7fb2c8103b60 2024-09-21T05:52:21.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.762+0000 7fb2bffff640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb2b40b6670 0x7fb2b40b8b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8109040 tx=0x7fb2b000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:21.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:21.766+0000 7fb2c4ff9640 1 -- 172.21.15.7:0/3698991799 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb2b80ad6c0 con 0x7fb2c8103b60 2024-09-21T05:52:21.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:21 smithi119 ceph-mon[34833]: pgmap v270: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s 2024-09-21T05:52:21.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:21 smithi027 ceph-mon[34364]: pgmap v270: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s 2024-09-21T05:52:22.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.008+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/3698991799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb2c802e640 con 0x7fb2c8103b60 2024-09-21T05:52:22.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.013+0000 7fb2c4ff9640 1 -- 172.21.15.7:0/3698991799 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+296445 (secure 0 0 0) 0x7fb2b80b4e20 con 0x7fb2c8103b60 2024-09-21T05:52:22.018 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:52:22.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.016+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/3698991799 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb2b40b6670 msgr2=0x7fb2b40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:22.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.016+0000 7fb2cd4f4640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb2b40b6670 0x7fb2b40b8b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8109040 tx=0x7fb2b000b390 comp rx=0 tx=0).stop 2024-09-21T05:52:22.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.016+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/3698991799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2c8103b60 msgr2=0x7fb2c8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:22.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.016+0000 7fb2cd4f4640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2c8103b60 0x7fb2c8075710 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800d950 tx=0x7fb2b800de10 comp rx=0 tx=0).stop 2024-09-21T05:52:22.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.016+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/3698991799 shutdown_connections 2024-09-21T05:52:22.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.016+0000 7fb2cd4f4640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb2b40b6670 0x7fb2b40b8b80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.016+0000 7fb2cd4f4640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2c8109df0 0x7fb2c8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.016+0000 7fb2cd4f4640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c81094a0 0x7fb2c8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.016+0000 7fb2cd4f4640 1 --2- 172.21.15.7:0/3698991799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2c8103b60 0x7fb2c8075710 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.016+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/3698991799 >> 172.21.15.7:0/3698991799 conn(0x7fb2c807b850 msgr2=0x7fb2c81074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:22.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.016+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/3698991799 shutdown_connections 2024-09-21T05:52:22.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:22.016+0000 7fb2cd4f4640 1 -- 172.21.15.7:0/3698991799 wait complete. 2024-09-21T05:52:22.676 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"flags":0,"active_gid":14223,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":2451017072},{"type":"v1","addr":"172.21.15.7:6801","nonce":2451017072}]},"active_addr":"172.21.15.7:6801/2451017072","active_change":"2024-09-21T05:45:22.373551+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24154,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24155,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.7:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":4081314363}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":1024329610}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":1286981104}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2761747325}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3395770588}]}]} 2024-09-21T05:52:22.683 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T05:52:22.683 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T05:52:22.683 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:52:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:22 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3698991799' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T05:52:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T05:52:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T05:52:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-21T05:52:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-09-21T05:52:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2024-09-21T05:52:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-09-21T05:52:22.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:22 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T05:52:22.944 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:22.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:22 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3698991799' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T05:52:22.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T05:52:22.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T05:52:22.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-21T05:52:22.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-09-21T05:52:22.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2024-09-21T05:52:22.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-09-21T05:52:22.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:22 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T05:52:23.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:22 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3698991799' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T05:52:23.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T05:52:23.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T05:52:23.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-21T05:52:23.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-09-21T05:52:23.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2024-09-21T05:52:23.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-09-21T05:52:23.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T05:52:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.398+0000 7fcbafcda640 1 -- 172.21.15.7:0/3727930384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcba8108d20 msgr2=0x7fcba810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.398+0000 7fcbafcda640 1 --2- 172.21.15.7:0/3727930384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcba8108d20 0x7fcba810f550 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009ca0 tx=0x7fcba002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.399+0000 7fcbafcda640 1 -- 172.21.15.7:0/3727930384 shutdown_connections 2024-09-21T05:52:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.399+0000 7fcbafcda640 1 --2- 172.21.15.7:0/3727930384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcba8108d20 0x7fcba810f550 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.399+0000 7fcbafcda640 1 --2- 172.21.15.7:0/3727930384 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba81083d0 0x7fcba81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.399+0000 7fcbafcda640 1 --2- 172.21.15.7:0/3727930384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba8102ae0 0x7fcba8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.399+0000 7fcbafcda640 1 -- 172.21.15.7:0/3727930384 >> 172.21.15.7:0/3727930384 conn(0x7fcba8079760 msgr2=0x7fcba8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.399+0000 7fcbafcda640 1 -- 172.21.15.7:0/3727930384 shutdown_connections 2024-09-21T05:52:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.399+0000 7fcbafcda640 1 -- 172.21.15.7:0/3727930384 wait complete. 2024-09-21T05:52:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.399+0000 7fcbafcda640 1 Processor -- start 2024-09-21T05:52:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.399+0000 7fcbafcda640 1 -- start start 2024-09-21T05:52:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbafcda640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba8102ae0 0x7fcba819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbafcda640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcba81083d0 0x7fcba819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbafcda640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba8108d20 0x7fcba819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbafcda640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcba8112990 con 0x7fcba81083d0 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbafcda640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcba8112810 con 0x7fcba8108d20 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbafcda640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcba8112b10 con 0x7fcba8102ae0 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbad275640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcba81083d0 0x7fcba819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbad275640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcba81083d0 0x7fcba819a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52778/0 (socket says 172.21.15.7:52778) 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbad275640 1 -- 172.21.15.7:0/2336736145 learned_addr learned my addr 172.21.15.7:0/2336736145 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbada76640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba8102ae0 0x7fcba819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbae277640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba8108d20 0x7fcba819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbad275640 1 -- 172.21.15.7:0/2336736145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba8102ae0 msgr2=0x7fcba819a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbad275640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba8102ae0 0x7fcba819a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbad275640 1 -- 172.21.15.7:0/2336736145 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba8108d20 msgr2=0x7fcba819fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbad275640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba8108d20 0x7fcba819fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbad275640 1 -- 172.21.15.7:0/2336736145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba81a0380 con 0x7fcba81083d0 2024-09-21T05:52:23.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbada76640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba8102ae0 0x7fcba819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcbad275640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcba81083d0 0x7fcba819a9b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800e9c0 tx=0x7fcb9800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.400+0000 7fcb9effd640 1 -- 172.21.15.7:0/2336736145 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800cd80 con 0x7fcba81083d0 2024-09-21T05:52:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.401+0000 7fcbafcda640 1 -- 172.21.15.7:0/2336736145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba81a0670 con 0x7fcba81083d0 2024-09-21T05:52:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.401+0000 7fcb9effd640 1 -- 172.21.15.7:0/2336736145 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb980054d0 con 0x7fcba81083d0 2024-09-21T05:52:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.401+0000 7fcb9effd640 1 -- 172.21.15.7:0/2336736145 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98010430 con 0x7fcba81083d0 2024-09-21T05:52:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.401+0000 7fcbafcda640 1 -- 172.21.15.7:0/2336736145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba81a6dd0 con 0x7fcba81083d0 2024-09-21T05:52:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.402+0000 7fcbafcda640 1 -- 172.21.15.7:0/2336736145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba8103d10 con 0x7fcba81083d0 2024-09-21T05:52:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.403+0000 7fcb9effd640 1 -- 172.21.15.7:0/2336736145 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fcb98004fb0 con 0x7fcba81083d0 2024-09-21T05:52:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.404+0000 7fcb9effd640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcb940b65f0 0x7fcb940b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.404+0000 7fcbada76640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcb940b65f0 0x7fcb940b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.404+0000 7fcb9effd640 1 -- 172.21.15.7:0/2336736145 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8397+0+0 (secure 0 0 0) 0x7fcb980e7db0 con 0x7fcba81083d0 2024-09-21T05:52:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.405+0000 7fcbada76640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcb940b65f0 0x7fcb940b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcba40058c0 tx=0x7fcba4005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.407+0000 7fcb9effd640 1 -- 172.21.15.7:0/2336736145 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb98056710 con 0x7fcba81083d0 2024-09-21T05:52:23.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.603+0000 7fcbafcda640 1 -- 172.21.15.7:0/2336736145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcba8102ef0 con 0x7fcba81083d0 2024-09-21T05:52:23.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.604+0000 7fcb9effd640 1 -- 172.21.15.7:0/2336736145 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22826 (secure 0 0 0) 0x7fcba8102ef0 con 0x7fcba81083d0 2024-09-21T05:52:23.606 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:52:23.607 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:43:32.863896+0000","modified":"2024-09-21T05:52:23.580753+0000","last_up_change":"2024-09-21T05:51:02.074799+0000","last_in_change":"2024-09-21T05:50:39.016405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:47:20.844179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:51:46.238763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:51:48.832249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d7a68ba-a599-44a9-a0de-a1d6df51f437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6803","nonce":536257283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6805","nonce":536257283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6809","nonce":536257283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6807","nonce":536257283}]},"public_addr":"172.21.15.7:6803/536257283","cluster_addr":"172.21.15.7:6805/536257283","heartbeat_back_addr":"172.21.15.7:6809/536257283","heartbeat_front_addr":"172.21.15.7:6807/536257283","state":["exists","up"]},{"osd":1,"uuid":"d4600805-1cb5-432a-8ae0-a40107a6c6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6801","nonce":2299402871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6803","nonce":2299402871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6807","nonce":2299402871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6805","nonce":2299402871}]},"public_addr":"172.21.15.27:6801/2299402871","cluster_addr":"172.21.15.27:6803/2299402871","heartbeat_back_addr":"172.21.15.27:6807/2299402871","heartbeat_front_addr":"172.21.15.27:6805/2299402871","state":["exists","up"]},{"osd":2,"uuid":"aa435f82-5819-4497-9053-1d891e712b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6801","nonce":1043408043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6803","nonce":1043408043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6807","nonce":1043408043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6805","nonce":1043408043}]},"public_addr":"172.21.15.119:6801/1043408043","cluster_addr":"172.21.15.119:6803/1043408043","heartbeat_back_addr":"172.21.15.119:6807/1043408043","heartbeat_front_addr":"172.21.15.119:6805/1043408043","state":["exists","up"]},{"osd":3,"uuid":"55803f97-02e1-43c0-b8da-9b8af32fd1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6811","nonce":1261229771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6813","nonce":1261229771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6817","nonce":1261229771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6815","nonce":1261229771}]},"public_addr":"172.21.15.7:6811/1261229771","cluster_addr":"172.21.15.7:6813/1261229771","heartbeat_back_addr":"172.21.15.7:6817/1261229771","heartbeat_front_addr":"172.21.15.7:6815/1261229771","state":["exists","up"]},{"osd":4,"uuid":"987ce230-5bfc-45a7-a33e-6291545afded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6809","nonce":631467792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6811","nonce":631467792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6815","nonce":631467792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6813","nonce":631467792}]},"public_addr":"172.21.15.27:6809/631467792","cluster_addr":"172.21.15.27:6811/631467792","heartbeat_back_addr":"172.21.15.27:6815/631467792","heartbeat_front_addr":"172.21.15.27:6813/631467792","state":["exists","up"]},{"osd":5,"uuid":"e768fbfa-8983-4ff6-8dca-b7df2304cf91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6809","nonce":2530968619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6811","nonce":2530968619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6815","nonce":2530968619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6813","nonce":2530968619}]},"public_addr":"172.21.15.119:6809/2530968619","cluster_addr":"172.21.15.119:6811/2530968619","heartbeat_back_addr":"172.21.15.119:6815/2530968619","heartbeat_front_addr":"172.21.15.119:6813/2530968619","state":["exists","up"]},{"osd":6,"uuid":"22496f13-64be-479b-89ea-bf51544199c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6819","nonce":856032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6821","nonce":856032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6825","nonce":856032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6823","nonce":856032021}]},"public_addr":"172.21.15.7:6819/856032021","cluster_addr":"172.21.15.7:6821/856032021","heartbeat_back_addr":"172.21.15.7:6825/856032021","heartbeat_front_addr":"172.21.15.7:6823/856032021","state":["exists","up"]},{"osd":7,"uuid":"53fc5616-b06a-498e-a60e-d7d7d6ba2a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6817","nonce":2862843529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6819","nonce":2862843529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6823","nonce":2862843529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6821","nonce":2862843529}]},"public_addr":"172.21.15.27:6817/2862843529","cluster_addr":"172.21.15.27:6819/2862843529","heartbeat_back_addr":"172.21.15.27:6823/2862843529","heartbeat_front_addr":"172.21.15.27:6821/2862843529","state":["exists","up"]},{"osd":8,"uuid":"53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6817","nonce":3663835202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6819","nonce":3663835202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6823","nonce":3663835202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6821","nonce":3663835202}]},"public_addr":"172.21.15.119:6817/3663835202","cluster_addr":"172.21.15.119:6819/3663835202","heartbeat_back_addr":"172.21.15.119:6823/3663835202","heartbeat_front_addr":"172.21.15.119:6821/3663835202","state":["exists","up"]},{"osd":9,"uuid":"a69a747d-1e6c-4940-9d96-4315ab384588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6827","nonce":2348805959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6829","nonce":2348805959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6833","nonce":2348805959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6831","nonce":2348805959}]},"public_addr":"172.21.15.7:6827/2348805959","cluster_addr":"172.21.15.7:6829/2348805959","heartbeat_back_addr":"172.21.15.7:6833/2348805959","heartbeat_front_addr":"172.21.15.7:6831/2348805959","state":["exists","up"]},{"osd":10,"uuid":"a8f67271-99bb-4fb7-b0f5-a24730cd96cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6825","nonce":2363600090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6827","nonce":2363600090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6831","nonce":2363600090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6829","nonce":2363600090}]},"public_addr":"172.21.15.27:6825/2363600090","cluster_addr":"172.21.15.27:6827/2363600090","heartbeat_back_addr":"172.21.15.27:6831/2363600090","heartbeat_front_addr":"172.21.15.27:6829/2363600090","state":["exists","up"]},{"osd":11,"uuid":"88456735-00b1-479c-b201-588a9ee0c881","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6825","nonce":3937692826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6827","nonce":3937692826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6831","nonce":3937692826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6829","nonce":3937692826}]},"public_addr":"172.21.15.119:6825/3937692826","cluster_addr":"172.21.15.119:6827/3937692826","heartbeat_back_addr":"172.21.15.119:6831/3937692826","heartbeat_front_addr":"172.21.15.119:6829/3937692826","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:26.217550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:51.830871+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:17.201362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:41.990894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:07.357782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.114180+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:56.808155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:22.565234+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:46.981522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:10.600602+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:35.973766+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:51:00.216062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/4143746508":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/1505943829":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/1622456881":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/833696585":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/2055984288":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6801/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3995317885":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2229583478":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/468393974":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/1009303060":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2125734440":"2024-09-22T05:45:22.373420+0000","172.21.15.7:6800/3995317885":"2024-09-22T05:45:22.373420+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:52:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.606+0000 7fcbafcda640 1 -- 172.21.15.7:0/2336736145 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcb940b65f0 msgr2=0x7fcb940b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.606+0000 7fcbafcda640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcb940b65f0 0x7fcb940b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcba40058c0 tx=0x7fcba4005850 comp rx=0 tx=0).stop 2024-09-21T05:52:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.606+0000 7fcbafcda640 1 -- 172.21.15.7:0/2336736145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcba81083d0 msgr2=0x7fcba819a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.606+0000 7fcbafcda640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcba81083d0 0x7fcba819a9b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800e9c0 tx=0x7fcb9800ee80 comp rx=0 tx=0).stop 2024-09-21T05:52:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.606+0000 7fcbafcda640 1 -- 172.21.15.7:0/2336736145 shutdown_connections 2024-09-21T05:52:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.606+0000 7fcbafcda640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcb940b65f0 0x7fcb940b8b00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.606+0000 7fcbafcda640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcba81083d0 0x7fcba819a9b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.606+0000 7fcbafcda640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba8108d20 0x7fcba819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.606+0000 7fcbafcda640 1 --2- 172.21.15.7:0/2336736145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcba8102ae0 0x7fcba819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.607+0000 7fcbafcda640 1 -- 172.21.15.7:0/2336736145 >> 172.21.15.7:0/2336736145 conn(0x7fcba8079760 msgr2=0x7fcba8101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.607+0000 7fcbafcda640 1 -- 172.21.15.7:0/2336736145 shutdown_connections 2024-09-21T05:52:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:23.607+0000 7fcbafcda640 1 -- 172.21.15.7:0/2336736145 wait complete. 2024-09-21T05:52:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:23 smithi027 ceph-mon[34364]: pgmap v271: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-21T05:52:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T05:52:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T05:52:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-21T05:52:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-21T05:52:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-21T05:52:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-21T05:52:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:23 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T05:52:23.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:23 smithi027 ceph-mon[34364]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T05:52:24.058 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:23 smithi007 ceph-mon[30983]: pgmap v271: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-21T05:52:24.058 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T05:52:24.058 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T05:52:24.059 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-21T05:52:24.059 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-21T05:52:24.059 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-21T05:52:24.059 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-21T05:52:24.059 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T05:52:24.059 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:23 smithi007 ceph-mon[30983]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T05:52:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:23 smithi119 ceph-mon[34833]: pgmap v271: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-21T05:52:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T05:52:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T05:52:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-21T05:52:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-21T05:52:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-21T05:52:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-21T05:52:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:23 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T05:52:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:23 smithi119 ceph-mon[34833]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T05:52:24.201 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T05:52:24.201 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:52:24.460 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:24.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:24 smithi007 ceph-mon[30983]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T05:52:24.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:24 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2336736145' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.922+0000 7fa15f51d640 1 -- 172.21.15.7:0/1624578896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1581062d0 msgr2=0x7fa1581066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.922+0000 7fa15f51d640 1 --2- 172.21.15.7:0/1624578896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1581062d0 0x7fa1581066e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa148009900 tx=0x7fa14802a410 comp rx=0 tx=0).stop 2024-09-21T05:52:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.922+0000 7fa15f51d640 1 -- 172.21.15.7:0/1624578896 shutdown_connections 2024-09-21T05:52:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.922+0000 7fa15f51d640 1 --2- 172.21.15.7:0/1624578896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1581062d0 0x7fa1581066e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.922+0000 7fa15f51d640 1 --2- 172.21.15.7:0/1624578896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa158106c20 0x7fa158110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.922+0000 7fa15f51d640 1 --2- 172.21.15.7:0/1624578896 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1581020e0 0x7fa1581024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.922+0000 7fa15f51d640 1 -- 172.21.15.7:0/1624578896 >> 172.21.15.7:0/1624578896 conn(0x7fa158079e40 msgr2=0x7fa15807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:24.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.922+0000 7fa15f51d640 1 -- 172.21.15.7:0/1624578896 shutdown_connections 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.922+0000 7fa15f51d640 1 -- 172.21.15.7:0/1624578896 wait complete. 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.923+0000 7fa15f51d640 1 Processor -- start 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.923+0000 7fa15f51d640 1 -- start start 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.923+0000 7fa15f51d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1581020e0 0x7fa158103080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.923+0000 7fa15f51d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1581062d0 0x7fa1581035c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.923+0000 7fa15f51d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa158106c20 0x7fa158103b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.923+0000 7fa15f51d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa158113ac0 con 0x7fa158106c20 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.923+0000 7fa15f51d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa158113940 con 0x7fa1581062d0 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.923+0000 7fa15f51d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa158113c40 con 0x7fa1581020e0 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa15daba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa158106c20 0x7fa158103b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa15daba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa158106c20 0x7fa158103b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52796/0 (socket says 172.21.15.7:52796) 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa15daba640 1 -- 172.21.15.7:0/3389912250 learned_addr learned my addr 172.21.15.7:0/3389912250 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa15d2b9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1581020e0 0x7fa158103080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa15cab8640 1 --2- 172.21.15.7:0/3389912250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1581062d0 0x7fa1581035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa15daba640 1 -- 172.21.15.7:0/3389912250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1581020e0 msgr2=0x7fa158103080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa15daba640 1 --2- 172.21.15.7:0/3389912250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1581020e0 0x7fa158103080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa15daba640 1 -- 172.21.15.7:0/3389912250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1581062d0 msgr2=0x7fa1581035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa15daba640 1 --2- 172.21.15.7:0/3389912250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1581062d0 0x7fa1581035c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa15daba640 1 -- 172.21.15.7:0/3389912250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1581a86a0 con 0x7fa158106c20 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa15daba640 1 --2- 172.21.15.7:0/3389912250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa158106c20 0x7fa158103b00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa15000eaa0 tx=0x7fa15000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa14e7fc640 1 -- 172.21.15.7:0/3389912250 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150004d20 con 0x7fa158106c20 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa14e7fc640 1 -- 172.21.15.7:0/3389912250 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa150005020 con 0x7fa158106c20 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa15f51d640 1 -- 172.21.15.7:0/3389912250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1581a8990 con 0x7fa158106c20 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa14e7fc640 1 -- 172.21.15.7:0/3389912250 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1500116b0 con 0x7fa158106c20 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.924+0000 7fa15f51d640 1 -- 172.21.15.7:0/3389912250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1581a8e50 con 0x7fa158106c20 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.926+0000 7fa15f51d640 1 -- 172.21.15.7:0/3389912250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1581024f0 con 0x7fa158106c20 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.927+0000 7fa14e7fc640 1 -- 172.21.15.7:0/3389912250 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fa1500051d0 con 0x7fa158106c20 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.928+0000 7fa14e7fc640 1 --2- 172.21.15.7:0/3389912250 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa1440b65f0 0x7fa1440b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.928+0000 7fa15d2b9640 1 --2- 172.21.15.7:0/3389912250 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa1440b65f0 0x7fa1440b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.928+0000 7fa14e7fc640 1 -- 172.21.15.7:0/3389912250 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa1500e7b90 con 0x7fa158106c20 2024-09-21T05:52:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.928+0000 7fa15d2b9640 1 --2- 172.21.15.7:0/3389912250 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa1440b65f0 0x7fa1440b8b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa158104ad0 tx=0x7fa15400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:24.931+0000 7fa14e7fc640 1 -- 172.21.15.7:0/3389912250 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa150016030 con 0x7fa158106c20 2024-09-21T05:52:24.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:24 smithi027 ceph-mon[34364]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T05:52:24.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:24 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2336736145' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:25.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:24 smithi119 ceph-mon[34833]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T05:52:25.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:24 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2336736145' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:25.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.122+0000 7fa15f51d640 1 -- 172.21.15.7:0/3389912250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa158104380 con 0x7fa158106c20 2024-09-21T05:52:25.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.123+0000 7fa14e7fc640 1 -- 172.21.15.7:0/3389912250 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22826 (secure 0 0 0) 0x7fa1500ae220 con 0x7fa158106c20 2024-09-21T05:52:25.125 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:52:25.126 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:43:32.863896+0000","modified":"2024-09-21T05:52:23.580753+0000","last_up_change":"2024-09-21T05:51:02.074799+0000","last_in_change":"2024-09-21T05:50:39.016405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:47:20.844179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:51:46.238763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:51:48.832249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d7a68ba-a599-44a9-a0de-a1d6df51f437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6803","nonce":536257283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6805","nonce":536257283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6809","nonce":536257283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6807","nonce":536257283}]},"public_addr":"172.21.15.7:6803/536257283","cluster_addr":"172.21.15.7:6805/536257283","heartbeat_back_addr":"172.21.15.7:6809/536257283","heartbeat_front_addr":"172.21.15.7:6807/536257283","state":["exists","up"]},{"osd":1,"uuid":"d4600805-1cb5-432a-8ae0-a40107a6c6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6801","nonce":2299402871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6803","nonce":2299402871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6807","nonce":2299402871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6805","nonce":2299402871}]},"public_addr":"172.21.15.27:6801/2299402871","cluster_addr":"172.21.15.27:6803/2299402871","heartbeat_back_addr":"172.21.15.27:6807/2299402871","heartbeat_front_addr":"172.21.15.27:6805/2299402871","state":["exists","up"]},{"osd":2,"uuid":"aa435f82-5819-4497-9053-1d891e712b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6801","nonce":1043408043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6803","nonce":1043408043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6807","nonce":1043408043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6805","nonce":1043408043}]},"public_addr":"172.21.15.119:6801/1043408043","cluster_addr":"172.21.15.119:6803/1043408043","heartbeat_back_addr":"172.21.15.119:6807/1043408043","heartbeat_front_addr":"172.21.15.119:6805/1043408043","state":["exists","up"]},{"osd":3,"uuid":"55803f97-02e1-43c0-b8da-9b8af32fd1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6811","nonce":1261229771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6813","nonce":1261229771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6817","nonce":1261229771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6815","nonce":1261229771}]},"public_addr":"172.21.15.7:6811/1261229771","cluster_addr":"172.21.15.7:6813/1261229771","heartbeat_back_addr":"172.21.15.7:6817/1261229771","heartbeat_front_addr":"172.21.15.7:6815/1261229771","state":["exists","up"]},{"osd":4,"uuid":"987ce230-5bfc-45a7-a33e-6291545afded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6809","nonce":631467792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6811","nonce":631467792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6815","nonce":631467792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6813","nonce":631467792}]},"public_addr":"172.21.15.27:6809/631467792","cluster_addr":"172.21.15.27:6811/631467792","heartbeat_back_addr":"172.21.15.27:6815/631467792","heartbeat_front_addr":"172.21.15.27:6813/631467792","state":["exists","up"]},{"osd":5,"uuid":"e768fbfa-8983-4ff6-8dca-b7df2304cf91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6809","nonce":2530968619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6811","nonce":2530968619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6815","nonce":2530968619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6813","nonce":2530968619}]},"public_addr":"172.21.15.119:6809/2530968619","cluster_addr":"172.21.15.119:6811/2530968619","heartbeat_back_addr":"172.21.15.119:6815/2530968619","heartbeat_front_addr":"172.21.15.119:6813/2530968619","state":["exists","up"]},{"osd":6,"uuid":"22496f13-64be-479b-89ea-bf51544199c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6819","nonce":856032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6821","nonce":856032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6825","nonce":856032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6823","nonce":856032021}]},"public_addr":"172.21.15.7:6819/856032021","cluster_addr":"172.21.15.7:6821/856032021","heartbeat_back_addr":"172.21.15.7:6825/856032021","heartbeat_front_addr":"172.21.15.7:6823/856032021","state":["exists","up"]},{"osd":7,"uuid":"53fc5616-b06a-498e-a60e-d7d7d6ba2a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6817","nonce":2862843529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6819","nonce":2862843529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6823","nonce":2862843529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6821","nonce":2862843529}]},"public_addr":"172.21.15.27:6817/2862843529","cluster_addr":"172.21.15.27:6819/2862843529","heartbeat_back_addr":"172.21.15.27:6823/2862843529","heartbeat_front_addr":"172.21.15.27:6821/2862843529","state":["exists","up"]},{"osd":8,"uuid":"53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6817","nonce":3663835202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6819","nonce":3663835202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6823","nonce":3663835202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6821","nonce":3663835202}]},"public_addr":"172.21.15.119:6817/3663835202","cluster_addr":"172.21.15.119:6819/3663835202","heartbeat_back_addr":"172.21.15.119:6823/3663835202","heartbeat_front_addr":"172.21.15.119:6821/3663835202","state":["exists","up"]},{"osd":9,"uuid":"a69a747d-1e6c-4940-9d96-4315ab384588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6827","nonce":2348805959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6829","nonce":2348805959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6833","nonce":2348805959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6831","nonce":2348805959}]},"public_addr":"172.21.15.7:6827/2348805959","cluster_addr":"172.21.15.7:6829/2348805959","heartbeat_back_addr":"172.21.15.7:6833/2348805959","heartbeat_front_addr":"172.21.15.7:6831/2348805959","state":["exists","up"]},{"osd":10,"uuid":"a8f67271-99bb-4fb7-b0f5-a24730cd96cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6825","nonce":2363600090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6827","nonce":2363600090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6831","nonce":2363600090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6829","nonce":2363600090}]},"public_addr":"172.21.15.27:6825/2363600090","cluster_addr":"172.21.15.27:6827/2363600090","heartbeat_back_addr":"172.21.15.27:6831/2363600090","heartbeat_front_addr":"172.21.15.27:6829/2363600090","state":["exists","up"]},{"osd":11,"uuid":"88456735-00b1-479c-b201-588a9ee0c881","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6825","nonce":3937692826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6827","nonce":3937692826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6831","nonce":3937692826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6829","nonce":3937692826}]},"public_addr":"172.21.15.119:6825/3937692826","cluster_addr":"172.21.15.119:6827/3937692826","heartbeat_back_addr":"172.21.15.119:6831/3937692826","heartbeat_front_addr":"172.21.15.119:6829/3937692826","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:26.217550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:51.830871+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:17.201362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:41.990894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:07.357782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.114180+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:56.808155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:22.565234+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:46.981522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:10.600602+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:35.973766+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:51:00.216062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/4143746508":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/1505943829":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/1622456881":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/833696585":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/2055984288":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6801/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3995317885":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2229583478":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/468393974":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/1009303060":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2125734440":"2024-09-22T05:45:22.373420+0000","172.21.15.7:6800/3995317885":"2024-09-22T05:45:22.373420+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:52:25.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.126+0000 7fa15f51d640 1 -- 172.21.15.7:0/3389912250 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa1440b65f0 msgr2=0x7fa1440b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.126+0000 7fa15f51d640 1 --2- 172.21.15.7:0/3389912250 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa1440b65f0 0x7fa1440b8b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa158104ad0 tx=0x7fa15400a2d0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.127+0000 7fa15f51d640 1 -- 172.21.15.7:0/3389912250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa158106c20 msgr2=0x7fa158103b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.127+0000 7fa15f51d640 1 --2- 172.21.15.7:0/3389912250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa158106c20 0x7fa158103b00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa15000eaa0 tx=0x7fa15000eea0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.127+0000 7fa15f51d640 1 -- 172.21.15.7:0/3389912250 shutdown_connections 2024-09-21T05:52:25.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.127+0000 7fa15f51d640 1 --2- 172.21.15.7:0/3389912250 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa1440b65f0 0x7fa1440b8b00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.127+0000 7fa15f51d640 1 --2- 172.21.15.7:0/3389912250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa158106c20 0x7fa158103b00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.127+0000 7fa15f51d640 1 --2- 172.21.15.7:0/3389912250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1581062d0 0x7fa1581035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.127+0000 7fa15f51d640 1 --2- 172.21.15.7:0/3389912250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1581020e0 0x7fa158103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.127+0000 7fa15f51d640 1 -- 172.21.15.7:0/3389912250 >> 172.21.15.7:0/3389912250 conn(0x7fa158079e40 msgr2=0x7fa1581075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:25.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.127+0000 7fa15f51d640 1 -- 172.21.15.7:0/3389912250 shutdown_connections 2024-09-21T05:52:25.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:25.127+0000 7fa15f51d640 1 -- 172.21.15.7:0/3389912250 wait complete. 2024-09-21T05:52:25.803 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:25 smithi007 ceph-mon[30983]: pgmap v274: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:25.803 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:25 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3389912250' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:25.833 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T05:52:25.833 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T05:52:25.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T05:52:25.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T05:52:25.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T05:52:25.835 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T05:52:25.835 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T05:52:25.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T05:52:25.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T05:52:25.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T05:52:25.837 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T05:52:25.837 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T05:52:25.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:25 smithi027 ceph-mon[34364]: pgmap v274: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:25.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:25 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3389912250' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:26.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:25 smithi119 ceph-mon[34833]: pgmap v274: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:26.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:25 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3389912250' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:26.605 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:26.606 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:26.608 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:26.611 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:26.614 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:26.628 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:26.889 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:27.927 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:27 smithi007 ceph-mon[30983]: pgmap v275: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 383 B/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:27.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.925+0000 7fa7e0c79640 1 -- 172.21.15.7:0/2339421094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7dc108610 msgr2=0x7fa7dc108a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:27.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.925+0000 7fa7e0c79640 1 --2- 172.21.15.7:0/2339421094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7dc108610 0x7fa7dc108a20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009900 tx=0x7fa7c402a3f0 comp rx=0 tx=0).stop 2024-09-21T05:52:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.925+0000 7fa7e0c79640 1 -- 172.21.15.7:0/2339421094 shutdown_connections 2024-09-21T05:52:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.925+0000 7fa7e0c79640 1 --2- 172.21.15.7:0/2339421094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7dc108610 0x7fa7dc108a20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.925+0000 7fa7e0c79640 1 --2- 172.21.15.7:0/2339421094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7dc108f60 0x7fa7dc10f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.925+0000 7fa7e0c79640 1 --2- 172.21.15.7:0/2339421094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc1031d0 0x7fa7dc1035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.925+0000 7fa7e0c79640 1 -- 172.21.15.7:0/2339421094 >> 172.21.15.7:0/2339421094 conn(0x7fa7dc079e40 msgr2=0x7fa7dc07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.925+0000 7fa7e0c79640 1 -- 172.21.15.7:0/2339421094 shutdown_connections 2024-09-21T05:52:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.925+0000 7fa7e0c79640 1 -- 172.21.15.7:0/2339421094 wait complete. 2024-09-21T05:52:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.926+0000 7fa7e0c79640 1 Processor -- start 2024-09-21T05:52:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.926+0000 7fa7e0c79640 1 -- start start 2024-09-21T05:52:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.926+0000 7fa7e0c79640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7dc1031d0 0x7fa7dc199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.926+0000 7fa7e0c79640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7dc108610 0x7fa7dc199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.926+0000 7fa7e0c79640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc108f60 0x7fa7dc19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.926+0000 7fa7e0c79640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc112c20 con 0x7fa7dc108610 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.926+0000 7fa7e0c79640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc112aa0 con 0x7fa7dc1031d0 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.926+0000 7fa7e0c79640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc112da0 con 0x7fa7dc108f60 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.926+0000 7fa7d3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7dc108610 0x7fa7dc199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.926+0000 7fa7d3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7dc108610 0x7fa7dc199bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52814/0 (socket says 172.21.15.7:52814) 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.926+0000 7fa7d3fff640 1 -- 172.21.15.7:0/1146101363 learned_addr learned my addr 172.21.15.7:0/1146101363 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.926+0000 7fa7da59c640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7dc1031d0 0x7fa7dc199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.926+0000 7fa7dad9d640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc108f60 0x7fa7dc19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.927+0000 7fa7d3fff640 1 -- 172.21.15.7:0/1146101363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc108f60 msgr2=0x7fa7dc19ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.927+0000 7fa7d3fff640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc108f60 0x7fa7dc19ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.927+0000 7fa7d3fff640 1 -- 172.21.15.7:0/1146101363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7dc1031d0 msgr2=0x7fa7dc199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.927+0000 7fa7d3fff640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7dc1031d0 0x7fa7dc199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.927+0000 7fa7d3fff640 1 -- 172.21.15.7:0/1146101363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc19f4c0 con 0x7fa7dc108610 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.927+0000 7fa7dad9d640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc108f60 0x7fa7dc19ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:27.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.927+0000 7fa7d3fff640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7dc108610 0x7fa7dc199bb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa7c402a910 tx=0x7fa7c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:27.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.927+0000 7fa7d37fe640 1 -- 172.21.15.7:0/1146101363 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c403f030 con 0x7fa7dc108610 2024-09-21T05:52:27.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.927+0000 7fa7e0c79640 1 -- 172.21.15.7:0/1146101363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7dc19f750 con 0x7fa7dc108610 2024-09-21T05:52:27.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.927+0000 7fa7d37fe640 1 -- 172.21.15.7:0/1146101363 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7c4003cb0 con 0x7fa7dc108610 2024-09-21T05:52:27.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.927+0000 7fa7d37fe640 1 -- 172.21.15.7:0/1146101363 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4035070 con 0x7fa7dc108610 2024-09-21T05:52:27.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.927+0000 7fa7e0c79640 1 -- 172.21.15.7:0/1146101363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7dc19fc80 con 0x7fa7dc108610 2024-09-21T05:52:27.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.928+0000 7fa7e0c79640 1 -- 172.21.15.7:0/1146101363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7dc063b50 con 0x7fa7dc108610 2024-09-21T05:52:27.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.930+0000 7fa7d37fe640 1 -- 172.21.15.7:0/1146101363 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fa7c4042030 con 0x7fa7dc108610 2024-09-21T05:52:27.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.931+0000 7fa7d37fe640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa7c80b6620 0x7fa7c80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:27.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.931+0000 7fa7da59c640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa7c80b6620 0x7fa7c80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:27.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.931+0000 7fa7d37fe640 1 -- 172.21.15.7:0/1146101363 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa7c4108000 con 0x7fa7dc108610 2024-09-21T05:52:27.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.931+0000 7fa7d37fe640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792] conn(0x7fa7c80c0310 0x7fa7c80c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:27.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.931+0000 7fa7d37fe640 1 -- 172.21.15.7:0/1146101363 --> [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7c80c2ed0 con 0x7fa7c80c0310 2024-09-21T05:52:27.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.931+0000 7fa7d37fe640 1 -- 172.21.15.7:0/1146101363 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fa7c4108450 con 0x7fa7dc108610 2024-09-21T05:52:27.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.932+0000 7fa7da59c640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa7c80b6620 0x7fa7c80b8b30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0058c0 tx=0x7fa7cc00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:27.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.932+0000 7fa7dad9d640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792] conn(0x7fa7c80c0310 0x7fa7c80c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:27.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.932+0000 7fa7dad9d640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792] conn(0x7fa7c80c0310 0x7fa7c80c2800 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:27.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.933+0000 7fa7d37fe640 1 -- 172.21.15.7:0/1146101363 <== osd.4 v2:172.21.15.27:6808/631467792 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa7c80c2ed0 con 0x7fa7c80c0310 2024-09-21T05:52:27.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.947+0000 7fa7e0c79640 1 -- 172.21.15.7:0/1146101363 --> [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa7dc063f50 con 0x7fa7c80c0310 2024-09-21T05:52:27.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.948+0000 7fa7d37fe640 1 -- 172.21.15.7:0/1146101363 <== osd.4 v2:172.21.15.27:6808/631467792 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa7dc063f50 con 0x7fa7c80c0310 2024-09-21T05:52:27.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.948+0000 7fa7e0c79640 1 -- 172.21.15.7:0/1146101363 >> [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792] conn(0x7fa7c80c0310 msgr2=0x7fa7c80c2800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:27.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.948+0000 7fa7e0c79640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792] conn(0x7fa7c80c0310 0x7fa7c80c2800 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:27.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.948+0000 7fa7e0c79640 1 -- 172.21.15.7:0/1146101363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa7c80b6620 msgr2=0x7fa7c80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:27.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.948+0000 7fa7e0c79640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa7c80b6620 0x7fa7c80b8b30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0058c0 tx=0x7fa7cc00a2d0 comp rx=0 tx=0).stop 2024-09-21T05:52:27.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.948+0000 7fa7e0c79640 1 -- 172.21.15.7:0/1146101363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7dc108610 msgr2=0x7fa7dc199bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:27.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.948+0000 7fa7e0c79640 1 --2- 172.21.15.7:0/1146101363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7dc108610 0x7fa7dc199bb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa7c402a910 tx=0x7fa7c4004270 comp rx=0 tx=0).stop 2024-09-21T05:52:27.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.948+0000 7fa7dad9d640 1 -- 172.21.15.7:0/1146101363 reap_dead start 2024-09-21T05:52:27.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.948+0000 7fa7e0c79640 1 -- 172.21.15.7:0/1146101363 shutdown_connections 2024-09-21T05:52:27.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.948+0000 7fa7e0c79640 1 -- 172.21.15.7:0/1146101363 >> 172.21.15.7:0/1146101363 conn(0x7fa7dc079e40 msgr2=0x7fa7dc104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:27.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.948+0000 7fa7e0c79640 1 -- 172.21.15.7:0/1146101363 shutdown_connections 2024-09-21T05:52:27.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:27.948+0000 7fa7e0c79640 1 -- 172.21.15.7:0/1146101363 wait complete. 2024-09-21T05:52:27.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:27 smithi027 ceph-mon[34364]: pgmap v275: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 383 B/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:28.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:27 smithi119 ceph-mon[34833]: pgmap v275: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 383 B/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:28.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.141+0000 7ff781960640 1 -- 172.21.15.7:0/1252019354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff77c103b60 msgr2=0x7ff77c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.141+0000 7ff781960640 1 --2- 172.21.15.7:0/1252019354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff77c103b60 0x7ff77c103f70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009900 tx=0x7ff76c02a3f0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.141+0000 7ff781960640 1 -- 172.21.15.7:0/1252019354 shutdown_connections 2024-09-21T05:52:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.141+0000 7ff781960640 1 --2- 172.21.15.7:0/1252019354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff77c109df0 0x7ff77c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.141+0000 7ff781960640 1 --2- 172.21.15.7:0/1252019354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff77c1094a0 0x7ff77c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.141+0000 7ff781960640 1 --2- 172.21.15.7:0/1252019354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff77c103b60 0x7ff77c103f70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.141+0000 7ff781960640 1 -- 172.21.15.7:0/1252019354 >> 172.21.15.7:0/1252019354 conn(0x7ff77c07b850 msgr2=0x7ff77c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.142+0000 7ff781960640 1 -- 172.21.15.7:0/1252019354 shutdown_connections 2024-09-21T05:52:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.142+0000 7ff781960640 1 -- 172.21.15.7:0/1252019354 wait complete. 2024-09-21T05:52:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.142+0000 7ff781960640 1 Processor -- start 2024-09-21T05:52:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.142+0000 7ff781960640 1 -- start start 2024-09-21T05:52:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff781960640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff77c103b60 0x7ff77c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff781960640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff77c1094a0 0x7ff77c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff781960640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff77c109df0 0x7ff77c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff781960640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c113ab0 con 0x7ff77c103b60 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff781960640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c113930 con 0x7ff77c109df0 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff781960640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c113c30 con 0x7ff77c1094a0 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff77affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff77c103b60 0x7ff77c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff77affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff77c103b60 0x7ff77c19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52824/0 (socket says 172.21.15.7:52824) 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff77affd640 1 -- 172.21.15.7:0/1851939903 learned_addr learned my addr 172.21.15.7:0/1851939903 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff7727fc640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff77c1094a0 0x7ff77c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff77b7fe640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff77c109df0 0x7ff77c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff77affd640 1 -- 172.21.15.7:0/1851939903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff77c1094a0 msgr2=0x7ff77c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff77affd640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff77c1094a0 0x7ff77c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff77affd640 1 -- 172.21.15.7:0/1851939903 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff77c109df0 msgr2=0x7ff77c19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff77affd640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff77c109df0 0x7ff77c19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff77affd640 1 -- 172.21.15.7:0/1851939903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77c1a0350 con 0x7ff77c103b60 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff77b7fe640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff77c109df0 0x7ff77c19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.143+0000 7ff77affd640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff77c103b60 0x7ff77c19a4a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff76c005940 tx=0x7ff76c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.144+0000 7ff78095e640 1 -- 172.21.15.7:0/1851939903 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c03f030 con 0x7ff77c103b60 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.144+0000 7ff78095e640 1 -- 172.21.15.7:0/1851939903 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff76c003cb0 con 0x7ff77c103b60 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.144+0000 7ff781960640 1 -- 172.21.15.7:0/1851939903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77c1a05e0 con 0x7ff77c103b60 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.144+0000 7ff78095e640 1 -- 172.21.15.7:0/1851939903 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c035070 con 0x7ff77c103b60 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.144+0000 7ff781960640 1 -- 172.21.15.7:0/1851939903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff77c1a0ac0 con 0x7ff77c103b60 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.145+0000 7ff781960640 1 -- 172.21.15.7:0/1851939903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff77c063b50 con 0x7ff77c103b60 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.146+0000 7ff78095e640 1 -- 172.21.15.7:0/1851939903 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7ff76c042030 con 0x7ff77c103b60 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.147+0000 7ff78095e640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff7680b6620 0x7ff7680b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.147+0000 7ff7727fc640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff7680b6620 0x7ff7680b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.147+0000 7ff78095e640 1 -- 172.21.15.7:0/1851939903 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7ff76c108220 con 0x7ff77c103b60 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.147+0000 7ff78095e640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771] conn(0x7ff7680c0310 0x7ff7680c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.147+0000 7ff78095e640 1 -- 172.21.15.7:0/1851939903 --> [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7680c2ed0 con 0x7ff7680c0310 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.147+0000 7ff78095e640 1 -- 172.21.15.7:0/1851939903 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7ff76c108670 con 0x7ff77c103b60 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.147+0000 7ff77b7fe640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771] conn(0x7ff7680c0310 0x7ff7680c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.148+0000 7ff7727fc640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff7680b6620 0x7ff7680b8b30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff764005e10 tx=0x7ff764005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.148+0000 7ff77b7fe640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771] conn(0x7ff7680c0310 0x7ff7680c2800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.149+0000 7ff78095e640 1 -- 172.21.15.7:0/1851939903 <== osd.3 v2:172.21.15.7:6810/1261229771 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7680c2ed0 con 0x7ff7680c0310 2024-09-21T05:52:28.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.162+0000 7ff781960640 1 -- 172.21.15.7:0/1851939903 --> [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff77c063fd0 con 0x7ff7680c0310 2024-09-21T05:52:28.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.163+0000 7ff78095e640 1 -- 172.21.15.7:0/1851939903 <== osd.3 v2:172.21.15.7:6810/1261229771 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff77c063fd0 con 0x7ff7680c0310 2024-09-21T05:52:28.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.163+0000 7ff781960640 1 -- 172.21.15.7:0/1851939903 >> [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771] conn(0x7ff7680c0310 msgr2=0x7ff7680c2800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.163+0000 7ff781960640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771] conn(0x7ff7680c0310 0x7ff7680c2800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.163+0000 7ff781960640 1 -- 172.21.15.7:0/1851939903 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff7680b6620 msgr2=0x7ff7680b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.163+0000 7ff781960640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff7680b6620 0x7ff7680b8b30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff764005e10 tx=0x7ff764005da0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.163+0000 7ff781960640 1 -- 172.21.15.7:0/1851939903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff77c103b60 msgr2=0x7ff77c19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.163+0000 7ff781960640 1 --2- 172.21.15.7:0/1851939903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff77c103b60 0x7ff77c19a4a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff76c005940 tx=0x7ff76c0042f0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.163+0000 7ff77b7fe640 1 -- 172.21.15.7:0/1851939903 reap_dead start 2024-09-21T05:52:28.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.163+0000 7ff781960640 1 -- 172.21.15.7:0/1851939903 shutdown_connections 2024-09-21T05:52:28.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.163+0000 7ff781960640 1 -- 172.21.15.7:0/1851939903 >> 172.21.15.7:0/1851939903 conn(0x7ff77c07b850 msgr2=0x7ff77c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:28.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.163+0000 7ff781960640 1 -- 172.21.15.7:0/1851939903 shutdown_connections 2024-09-21T05:52:28.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.163+0000 7ff781960640 1 -- 172.21.15.7:0/1851939903 wait complete. 2024-09-21T05:52:28.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.359+0000 7f5835548640 1 -- 172.21.15.7:0/406125090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5830102aa0 msgr2=0x7f5830102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.359+0000 7f5835548640 1 --2- 172.21.15.7:0/406125090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5830102aa0 0x7f5830102eb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5820009ca0 tx=0x7f582002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.360+0000 7f5835548640 1 -- 172.21.15.7:0/406125090 shutdown_connections 2024-09-21T05:52:28.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.360+0000 7f5835548640 1 --2- 172.21.15.7:0/406125090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5830108d30 0x7f583010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.360+0000 7f5835548640 1 --2- 172.21.15.7:0/406125090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58301083e0 0x7f58301087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.360+0000 7f5835548640 1 --2- 172.21.15.7:0/406125090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5830102aa0 0x7f5830102eb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.360+0000 7f5835548640 1 -- 172.21.15.7:0/406125090 >> 172.21.15.7:0/406125090 conn(0x7f58300797e0 msgr2=0x7f5830079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.360+0000 7f5835548640 1 -- 172.21.15.7:0/406125090 shutdown_connections 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.360+0000 7f5835548640 1 -- 172.21.15.7:0/406125090 wait complete. 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.360+0000 7f5835548640 1 Processor -- start 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.360+0000 7f5835548640 1 -- start start 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f5835548640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5830102aa0 0x7f583019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f5835548640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58301083e0 0x7f583019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f5835548640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5830108d30 0x7f583019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f5835548640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5830113ab0 con 0x7f5830102aa0 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f5835548640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5830113930 con 0x7f5830108d30 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f5835548640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5830113c30 con 0x7f58301083e0 2024-09-21T05:52:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f582effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5830102aa0 0x7f583019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f582effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5830102aa0 0x7f583019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52838/0 (socket says 172.21.15.7:52838) 2024-09-21T05:52:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f582effd640 1 -- 172.21.15.7:0/1986172514 learned_addr learned my addr 172.21.15.7:0/1986172514 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f582e7fc640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58301083e0 0x7f583019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f582f7fe640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5830108d30 0x7f583019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f582effd640 1 -- 172.21.15.7:0/1986172514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58301083e0 msgr2=0x7f583019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f582effd640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58301083e0 0x7f583019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f582effd640 1 -- 172.21.15.7:0/1986172514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5830108d30 msgr2=0x7f583019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f582effd640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5830108d30 0x7f583019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f582effd640 1 -- 172.21.15.7:0/1986172514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58301a0410 con 0x7f5830102aa0 2024-09-21T05:52:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f582f7fe640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5830108d30 0x7f583019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.361+0000 7f582effd640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5830102aa0 0x7f583019a4a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f582002ade0 tx=0x7f5820031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.362+0000 7f5817fff640 1 -- 172.21.15.7:0/1986172514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820003b70 con 0x7f5830102aa0 2024-09-21T05:52:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.362+0000 7f5835548640 1 -- 172.21.15.7:0/1986172514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58301a06a0 con 0x7f5830102aa0 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.362+0000 7f5817fff640 1 -- 172.21.15.7:0/1986172514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5820003d10 con 0x7f5830102aa0 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.362+0000 7f5817fff640 1 -- 172.21.15.7:0/1986172514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582002fa50 con 0x7f5830102aa0 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.362+0000 7f5835548640 1 -- 172.21.15.7:0/1986172514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58301a6e60 con 0x7f5830102aa0 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.363+0000 7f5835548640 1 -- 172.21.15.7:0/1986172514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5830063b10 con 0x7f5830102aa0 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.365+0000 7f5817fff640 1 -- 172.21.15.7:0/1986172514 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f5820004580 con 0x7f5830102aa0 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.365+0000 7f5817fff640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f58180b65f0 0x7f58180b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.366+0000 7f582e7fc640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f58180b65f0 0x7f58180b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.366+0000 7f5817fff640 1 -- 172.21.15.7:0/1986172514 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f5820108ae0 con 0x7f5830102aa0 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.366+0000 7f5817fff640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619] conn(0x7f58180c02e0 0x7f58180c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.366+0000 7f5817fff640 1 -- 172.21.15.7:0/1986172514 --> [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f58180c2ea0 con 0x7f58180c02e0 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.366+0000 7f5817fff640 1 -- 172.21.15.7:0/1986172514 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f5820108f30 con 0x7f5830102aa0 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.366+0000 7f582e7fc640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f58180b65f0 0x7f58180b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f58301081b0 tx=0x7f5824005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.366+0000 7f582f7fe640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619] conn(0x7f58180c02e0 0x7f58180c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.367+0000 7f582f7fe640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619] conn(0x7f58180c02e0 0x7f58180c27d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.368+0000 7f5817fff640 1 -- 172.21.15.7:0/1986172514 <== osd.5 v2:172.21.15.119:6808/2530968619 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f58180c2ea0 con 0x7f58180c02e0 2024-09-21T05:52:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.381+0000 7f5835548640 1 -- 172.21.15.7:0/1986172514 --> [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5830063f90 con 0x7f58180c02e0 2024-09-21T05:52:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.382+0000 7f5817fff640 1 -- 172.21.15.7:0/1986172514 <== osd.5 v2:172.21.15.119:6808/2530968619 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5830063f90 con 0x7f58180c02e0 2024-09-21T05:52:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.382+0000 7f5835548640 1 -- 172.21.15.7:0/1986172514 >> [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619] conn(0x7f58180c02e0 msgr2=0x7f58180c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.382+0000 7f5835548640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619] conn(0x7f58180c02e0 0x7f58180c27d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.382+0000 7f5835548640 1 -- 172.21.15.7:0/1986172514 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f58180b65f0 msgr2=0x7f58180b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.382+0000 7f5835548640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f58180b65f0 0x7f58180b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f58301081b0 tx=0x7f5824005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.382+0000 7f5835548640 1 -- 172.21.15.7:0/1986172514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5830102aa0 msgr2=0x7f583019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.382+0000 7f5835548640 1 --2- 172.21.15.7:0/1986172514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5830102aa0 0x7f583019a4a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f582002ade0 tx=0x7f5820031770 comp rx=0 tx=0).stop 2024-09-21T05:52:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.382+0000 7f582f7fe640 1 -- 172.21.15.7:0/1986172514 reap_dead start 2024-09-21T05:52:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.382+0000 7f5835548640 1 -- 172.21.15.7:0/1986172514 shutdown_connections 2024-09-21T05:52:28.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.382+0000 7f5835548640 1 -- 172.21.15.7:0/1986172514 >> 172.21.15.7:0/1986172514 conn(0x7f58300797e0 msgr2=0x7f5830101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:28.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.382+0000 7f5835548640 1 -- 172.21.15.7:0/1986172514 shutdown_connections 2024-09-21T05:52:28.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:28.382+0000 7f5835548640 1 -- 172.21.15.7:0/1986172514 wait complete. 2024-09-21T05:52:29.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.009+0000 7fbbb89bb640 1 -- 172.21.15.7:0/271038378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb4109e40 msgr2=0x7fbbb4110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:29.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.009+0000 7fbbb89bb640 1 --2- 172.21.15.7:0/271038378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb4109e40 0x7fbbb4110670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009ca0 tx=0x7fbbac02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:29.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.010+0000 7fbbb89bb640 1 -- 172.21.15.7:0/271038378 shutdown_connections 2024-09-21T05:52:29.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.010+0000 7fbbb89bb640 1 --2- 172.21.15.7:0/271038378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb4109e40 0x7fbbb4110670 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:29.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.010+0000 7fbbb89bb640 1 --2- 172.21.15.7:0/271038378 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbb41094f0 0x7fbbb4109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:29.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.010+0000 7fbbb89bb640 1 --2- 172.21.15.7:0/271038378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbb4103bb0 0x7fbbb4103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:29.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.010+0000 7fbbb89bb640 1 -- 172.21.15.7:0/271038378 >> 172.21.15.7:0/271038378 conn(0x7fbbb40ff600 msgr2=0x7fbbb4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:29.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.010+0000 7fbbb89bb640 1 -- 172.21.15.7:0/271038378 shutdown_connections 2024-09-21T05:52:29.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.010+0000 7fbbb89bb640 1 -- 172.21.15.7:0/271038378 wait complete. 2024-09-21T05:52:29.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.011+0000 7fbbb89bb640 1 Processor -- start 2024-09-21T05:52:29.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.011+0000 7fbbb89bb640 1 -- start start 2024-09-21T05:52:29.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.011+0000 7fbbb89bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb4103bb0 0x7fbbb419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:29.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.011+0000 7fbbb89bb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbb41094f0 0x7fbbb419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:29.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.011+0000 7fbbb89bb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbb4109e40 0x7fbbb419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:29.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.011+0000 7fbbb89bb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb4113b60 con 0x7fbbb4103bb0 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.011+0000 7fbbb89bb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41139e0 con 0x7fbbb41094f0 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.011+0000 7fbbb89bb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb4113ce0 con 0x7fbbb4109e40 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.011+0000 7fbbb259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb4103bb0 0x7fbbb419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.011+0000 7fbbb259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb4103bb0 0x7fbbb419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47814/0 (socket says 172.21.15.7:47814) 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.011+0000 7fbbb259c640 1 -- 172.21.15.7:0/767585173 learned_addr learned my addr 172.21.15.7:0/767585173 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.011+0000 7fbbb1d9b640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbb41094f0 0x7fbbb419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.012+0000 7fbbb2d9d640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbb4109e40 0x7fbbb419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.012+0000 7fbbb259c640 1 -- 172.21.15.7:0/767585173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbb4109e40 msgr2=0x7fbbb419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.012+0000 7fbbb259c640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbb4109e40 0x7fbbb419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.012+0000 7fbbb259c640 1 -- 172.21.15.7:0/767585173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbb41094f0 msgr2=0x7fbbb419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.012+0000 7fbbb259c640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbb41094f0 0x7fbbb419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.012+0000 7fbbb259c640 1 -- 172.21.15.7:0/767585173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb41a0460 con 0x7fbbb4103bb0 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.012+0000 7fbbb259c640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb4103bb0 0x7fbbb419a4f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbba400b4a0 tx=0x7fbba400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.012+0000 7fbba37fe640 1 -- 172.21.15.7:0/767585173 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba4014070 con 0x7fbbb4103bb0 2024-09-21T05:52:29.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.012+0000 7fbba37fe640 1 -- 172.21.15.7:0/767585173 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbba4010ac0 con 0x7fbbb4103bb0 2024-09-21T05:52:29.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.012+0000 7fbba37fe640 1 -- 172.21.15.7:0/767585173 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba4017c30 con 0x7fbbb4103bb0 2024-09-21T05:52:29.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.012+0000 7fbbb89bb640 1 -- 172.21.15.7:0/767585173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb41a0750 con 0x7fbbb4103bb0 2024-09-21T05:52:29.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.012+0000 7fbbb89bb640 1 -- 172.21.15.7:0/767585173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb41a6eb0 con 0x7fbbb4103bb0 2024-09-21T05:52:29.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.013+0000 7fbbb89bb640 1 -- 172.21.15.7:0/767585173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbbb4063b50 con 0x7fbbb4103bb0 2024-09-21T05:52:29.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.015+0000 7fbba37fe640 1 -- 172.21.15.7:0/767585173 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fbba4017070 con 0x7fbbb4103bb0 2024-09-21T05:52:29.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.015+0000 7fbba37fe640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbb9c0b65f0 0x7fbb9c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:29.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.016+0000 7fbbb1d9b640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbb9c0b65f0 0x7fbb9c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:29.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.016+0000 7fbba37fe640 1 -- 172.21.15.7:0/767585173 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fbba40e6c10 con 0x7fbbb4103bb0 2024-09-21T05:52:29.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.016+0000 7fbba37fe640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043] conn(0x7fbb9c0c02e0 0x7fbb9c0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:29.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.016+0000 7fbba37fe640 1 -- 172.21.15.7:0/767585173 --> [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbba4015e50 con 0x7fbb9c0c02e0 2024-09-21T05:52:29.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.016+0000 7fbba37fe640 1 -- 172.21.15.7:0/767585173 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fbba40e7060 con 0x7fbbb4103bb0 2024-09-21T05:52:29.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.016+0000 7fbbb1d9b640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbb9c0b65f0 0x7fbb9c0b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4108f90 tx=0x7fbba800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:29.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.016+0000 7fbbb2d9d640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043] conn(0x7fbb9c0c02e0 0x7fbb9c0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:29.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.017+0000 7fbbb2d9d640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043] conn(0x7fbb9c0c02e0 0x7fbb9c0c27d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:29.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.018+0000 7fbba37fe640 1 -- 172.21.15.7:0/767585173 <== osd.2 v2:172.21.15.119:6800/1043408043 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbba4015e50 con 0x7fbb9c0c02e0 2024-09-21T05:52:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.031+0000 7fbbb89bb640 1 -- 172.21.15.7:0/767585173 --> [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbbb4063fd0 con 0x7fbb9c0c02e0 2024-09-21T05:52:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.032+0000 7fbba37fe640 1 -- 172.21.15.7:0/767585173 <== osd.2 v2:172.21.15.119:6800/1043408043 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbbb4063fd0 con 0x7fbb9c0c02e0 2024-09-21T05:52:29.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.032+0000 7fbbb89bb640 1 -- 172.21.15.7:0/767585173 >> [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043] conn(0x7fbb9c0c02e0 msgr2=0x7fbb9c0c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:29.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.032+0000 7fbbb89bb640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043] conn(0x7fbb9c0c02e0 0x7fbb9c0c27d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:29.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.032+0000 7fbbb89bb640 1 -- 172.21.15.7:0/767585173 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbb9c0b65f0 msgr2=0x7fbb9c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:29.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.032+0000 7fbbb89bb640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbb9c0b65f0 0x7fbb9c0b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4108f90 tx=0x7fbba800b390 comp rx=0 tx=0).stop 2024-09-21T05:52:29.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.032+0000 7fbbb89bb640 1 -- 172.21.15.7:0/767585173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb4103bb0 msgr2=0x7fbbb419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:29.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.032+0000 7fbbb89bb640 1 --2- 172.21.15.7:0/767585173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbb4103bb0 0x7fbbb419a4f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbba400b4a0 tx=0x7fbba400b960 comp rx=0 tx=0).stop 2024-09-21T05:52:29.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.032+0000 7fbbb2d9d640 1 -- 172.21.15.7:0/767585173 reap_dead start 2024-09-21T05:52:29.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.032+0000 7fbbb89bb640 1 -- 172.21.15.7:0/767585173 shutdown_connections 2024-09-21T05:52:29.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.032+0000 7fbbb89bb640 1 -- 172.21.15.7:0/767585173 >> 172.21.15.7:0/767585173 conn(0x7fbbb40ff600 msgr2=0x7fbbb4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:29.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.032+0000 7fbbb89bb640 1 -- 172.21.15.7:0/767585173 shutdown_connections 2024-09-21T05:52:29.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:29.032+0000 7fbbb89bb640 1 -- 172.21.15.7:0/767585173 wait complete. 2024-09-21T05:52:29.746 INFO:teuthology.orchestra.run.smithi007.stdout:111669149756 2024-09-21T05:52:29.746 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T05:52:29.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:29 smithi027 ceph-mon[34364]: pgmap v276: 97 pgs: 2 peering, 95 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:30.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:29 smithi007 ceph-mon[30983]: pgmap v276: 97 pgs: 2 peering, 95 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:30.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:29 smithi119 ceph-mon[34833]: pgmap v276: 97 pgs: 2 peering, 95 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:30.131 INFO:teuthology.orchestra.run.smithi007.stdout:150323855410 2024-09-21T05:52:30.131 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T05:52:30.502 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:30.502 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:30.503 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:30.536 INFO:teuthology.orchestra.run.smithi007.stdout:133143986231 2024-09-21T05:52:30.536 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T05:52:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.708+0000 7fca5754c640 1 -- 172.21.15.7:0/1457570735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca5010de10 msgr2=0x7fca50110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.708+0000 7fca5754c640 1 --2- 172.21.15.7:0/1457570735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca5010de10 0x7fca50110300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fca48009900 tx=0x7fca4802a410 comp rx=0 tx=0).stop 2024-09-21T05:52:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.708+0000 7fca5754c640 1 -- 172.21.15.7:0/1457570735 shutdown_connections 2024-09-21T05:52:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.708+0000 7fca5754c640 1 --2- 172.21.15.7:0/1457570735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca5010de10 0x7fca50110300 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.708+0000 7fca5754c640 1 --2- 172.21.15.7:0/1457570735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca50105300 0x7fca5010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.708+0000 7fca5754c640 1 --2- 172.21.15.7:0/1457570735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca501049b0 0x7fca50104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.708+0000 7fca5754c640 1 -- 172.21.15.7:0/1457570735 >> 172.21.15.7:0/1457570735 conn(0x7fca50079730 msgr2=0x7fca50079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.708+0000 7fca5754c640 1 -- 172.21.15.7:0/1457570735 shutdown_connections 2024-09-21T05:52:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.708+0000 7fca5754c640 1 -- 172.21.15.7:0/1457570735 wait complete. 2024-09-21T05:52:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.709+0000 7fca5754c640 1 Processor -- start 2024-09-21T05:52:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.709+0000 7fca5754c640 1 -- start start 2024-09-21T05:52:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.709+0000 7fca5754c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca501049b0 0x7fca5019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.709+0000 7fca5754c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca50105300 0x7fca5019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.709+0000 7fca5754c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca5010de10 0x7fca5019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.709+0000 7fca5754c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fca50113ad0 con 0x7fca50105300 2024-09-21T05:52:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.709+0000 7fca5754c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fca50113950 con 0x7fca5010de10 2024-09-21T05:52:30.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.709+0000 7fca5754c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fca50113c50 con 0x7fca501049b0 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.709+0000 7fca54ae7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca50105300 0x7fca5019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.710+0000 7fca54ae7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca50105300 0x7fca5019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47828/0 (socket says 172.21.15.7:47828) 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.710+0000 7fca54ae7640 1 -- 172.21.15.7:0/2712812778 learned_addr learned my addr 172.21.15.7:0/2712812778 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.710+0000 7fca552e8640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca501049b0 0x7fca5019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.710+0000 7fca55ae9640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca5010de10 0x7fca5019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.710+0000 7fca54ae7640 1 -- 172.21.15.7:0/2712812778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca501049b0 msgr2=0x7fca5019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.710+0000 7fca54ae7640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca501049b0 0x7fca5019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.710+0000 7fca54ae7640 1 -- 172.21.15.7:0/2712812778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca5010de10 msgr2=0x7fca5019fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.710+0000 7fca54ae7640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca5010de10 0x7fca5019fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.710+0000 7fca54ae7640 1 -- 172.21.15.7:0/2712812778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca501a03f0 con 0x7fca50105300 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.710+0000 7fca54ae7640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca50105300 0x7fca5019aa20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fca44006fd0 tx=0x7fca4400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.710+0000 7fca4e7fc640 1 -- 172.21.15.7:0/2712812778 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44011830 con 0x7fca50105300 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.710+0000 7fca5754c640 1 -- 172.21.15.7:0/2712812778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca501a06e0 con 0x7fca50105300 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.710+0000 7fca4e7fc640 1 -- 172.21.15.7:0/2712812778 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca44016070 con 0x7fca50105300 2024-09-21T05:52:30.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.711+0000 7fca4e7fc640 1 -- 172.21.15.7:0/2712812778 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44010e00 con 0x7fca50105300 2024-09-21T05:52:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.711+0000 7fca5754c640 1 -- 172.21.15.7:0/2712812778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca501a6ec0 con 0x7fca50105300 2024-09-21T05:52:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.712+0000 7fca5754c640 1 -- 172.21.15.7:0/2712812778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca50063b50 con 0x7fca50105300 2024-09-21T05:52:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.713+0000 7fca4e7fc640 1 -- 172.21.15.7:0/2712812778 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fca4401b460 con 0x7fca50105300 2024-09-21T05:52:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.714+0000 7fca4e7fc640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fca380b6670 0x7fca380b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.714+0000 7fca552e8640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fca380b6670 0x7fca380b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.714+0000 7fca4e7fc640 1 -- 172.21.15.7:0/2712812778 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fca440e7450 con 0x7fca50105300 2024-09-21T05:52:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.715+0000 7fca4e7fc640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202] conn(0x7fca380c0360 0x7fca380c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.715+0000 7fca4e7fc640 1 -- 172.21.15.7:0/2712812778 --> [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca44022e50 con 0x7fca380c0360 2024-09-21T05:52:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.715+0000 7fca4e7fc640 1 -- 172.21.15.7:0/2712812778 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fca440e78a0 con 0x7fca50105300 2024-09-21T05:52:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.715+0000 7fca552e8640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fca380b6670 0x7fca380b8b80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fca5006bc60 tx=0x7fca4000a590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.715+0000 7fca55ae9640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202] conn(0x7fca380c0360 0x7fca380c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.716+0000 7fca55ae9640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202] conn(0x7fca380c0360 0x7fca380c2850 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:30.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.716+0000 7fca4e7fc640 1 -- 172.21.15.7:0/2712812778 <== osd.8 v2:172.21.15.119:6816/3663835202 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca44022e50 con 0x7fca380c0360 2024-09-21T05:52:30.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.731+0000 7fca5754c640 1 -- 172.21.15.7:0/2712812778 --> [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca50063f50 con 0x7fca380c0360 2024-09-21T05:52:30.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.731+0000 7fca4e7fc640 1 -- 172.21.15.7:0/2712812778 <== osd.8 v2:172.21.15.119:6816/3663835202 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fca50063f50 con 0x7fca380c0360 2024-09-21T05:52:30.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.732+0000 7fca5754c640 1 -- 172.21.15.7:0/2712812778 >> [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202] conn(0x7fca380c0360 msgr2=0x7fca380c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:30.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.732+0000 7fca5754c640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202] conn(0x7fca380c0360 0x7fca380c2850 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:30.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.732+0000 7fca5754c640 1 -- 172.21.15.7:0/2712812778 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fca380b6670 msgr2=0x7fca380b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:30.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.732+0000 7fca5754c640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fca380b6670 0x7fca380b8b80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fca5006bc60 tx=0x7fca4000a590 comp rx=0 tx=0).stop 2024-09-21T05:52:30.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.732+0000 7fca5754c640 1 -- 172.21.15.7:0/2712812778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca50105300 msgr2=0x7fca5019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:30.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.732+0000 7fca5754c640 1 --2- 172.21.15.7:0/2712812778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca50105300 0x7fca5019aa20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fca44006fd0 tx=0x7fca4400b8e0 comp rx=0 tx=0).stop 2024-09-21T05:52:30.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.732+0000 7fca55ae9640 1 -- 172.21.15.7:0/2712812778 reap_dead start 2024-09-21T05:52:30.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.732+0000 7fca5754c640 1 -- 172.21.15.7:0/2712812778 shutdown_connections 2024-09-21T05:52:30.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.732+0000 7fca5754c640 1 -- 172.21.15.7:0/2712812778 >> 172.21.15.7:0/2712812778 conn(0x7fca50079730 msgr2=0x7fca50100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:30.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.732+0000 7fca5754c640 1 -- 172.21.15.7:0/2712812778 shutdown_connections 2024-09-21T05:52:30.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:30.732+0000 7fca5754c640 1 -- 172.21.15.7:0/2712812778 wait complete. 2024-09-21T05:52:31.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:31 smithi007 ceph-mon[30983]: pgmap v277: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s; 0 B/s, 2 keys/s, 0 objects/s recovering 2024-09-21T05:52:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.741+0000 7f4b7e838640 1 -- 172.21.15.7:0/902808214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b781083c0 msgr2=0x7f4b781087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.741+0000 7f4b7e838640 1 --2- 172.21.15.7:0/902808214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b781083c0 0x7f4b781087d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009900 tx=0x7f4b6002a410 comp rx=0 tx=0).stop 2024-09-21T05:52:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.741+0000 7f4b7e838640 1 -- 172.21.15.7:0/902808214 shutdown_connections 2024-09-21T05:52:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.741+0000 7f4b7e838640 1 --2- 172.21.15.7:0/902808214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b781083c0 0x7f4b781087d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.741+0000 7f4b7e838640 1 --2- 172.21.15.7:0/902808214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b78108d10 0x7f4b7810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.741+0000 7f4b7e838640 1 --2- 172.21.15.7:0/902808214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b78102a80 0x7f4b78102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.741+0000 7f4b7e838640 1 -- 172.21.15.7:0/902808214 >> 172.21.15.7:0/902808214 conn(0x7f4b78079740 msgr2=0x7f4b78079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:31.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.741+0000 7f4b7e838640 1 -- 172.21.15.7:0/902808214 shutdown_connections 2024-09-21T05:52:31.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.741+0000 7f4b7e838640 1 -- 172.21.15.7:0/902808214 wait complete. 2024-09-21T05:52:31.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.742+0000 7f4b7e838640 1 Processor -- start 2024-09-21T05:52:31.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.742+0000 7f4b7e838640 1 -- start start 2024-09-21T05:52:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7e838640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b78102a80 0x7f4b7819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7e838640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b781083c0 0x7f4b7819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7e838640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b78108d10 0x7f4b7819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7e838640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b78112980 con 0x7f4b78108d10 2024-09-21T05:52:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7e838640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4b78112800 con 0x7f4b781083c0 2024-09-21T05:52:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7e838640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b78112b00 con 0x7f4b78102a80 2024-09-21T05:52:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7cdd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b78108d10 0x7f4b7819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7cdd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b78108d10 0x7f4b7819fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47848/0 (socket says 172.21.15.7:47848) 2024-09-21T05:52:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7cdd5640 1 -- 172.21.15.7:0/2427848922 learned_addr learned my addr 172.21.15.7:0/2427848922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b77fff640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b78102a80 0x7f4b7819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b6ffff640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b781083c0 0x7f4b7819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7cdd5640 1 -- 172.21.15.7:0/2427848922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b78102a80 msgr2=0x7f4b7819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7cdd5640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b78102a80 0x7f4b7819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7cdd5640 1 -- 172.21.15.7:0/2427848922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b781083c0 msgr2=0x7f4b7819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7cdd5640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b781083c0 0x7f4b7819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7cdd5640 1 -- 172.21.15.7:0/2427848922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b781a0470 con 0x7f4b78108d10 2024-09-21T05:52:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b77fff640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b78102a80 0x7f4b7819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b6ffff640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b781083c0 0x7f4b7819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.743+0000 7f4b7cdd5640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b78108d10 0x7f4b7819fe00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000eaa0 tx=0x7f4b7000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.744+0000 7f4b75ffb640 1 -- 172.21.15.7:0/2427848922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000cdb0 con 0x7f4b78108d10 2024-09-21T05:52:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.744+0000 7f4b7e838640 1 -- 172.21.15.7:0/2427848922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b781a0760 con 0x7f4b78108d10 2024-09-21T05:52:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.744+0000 7f4b75ffb640 1 -- 172.21.15.7:0/2427848922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b70005020 con 0x7f4b78108d10 2024-09-21T05:52:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.744+0000 7f4b75ffb640 1 -- 172.21.15.7:0/2427848922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b700116d0 con 0x7f4b78108d10 2024-09-21T05:52:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.744+0000 7f4b7e838640 1 -- 172.21.15.7:0/2427848922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b781a0c20 con 0x7f4b78108d10 2024-09-21T05:52:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.745+0000 7f4b7e838640 1 -- 172.21.15.7:0/2427848922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b78063a90 con 0x7f4b78108d10 2024-09-21T05:52:31.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.747+0000 7f4b75ffb640 1 -- 172.21.15.7:0/2427848922 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f4b700051d0 con 0x7f4b78108d10 2024-09-21T05:52:31.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.747+0000 7f4b75ffb640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b640b6620 0x7f4b640b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.747+0000 7f4b77fff640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b640b6620 0x7f4b640b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.747+0000 7f4b75ffb640 1 -- 172.21.15.7:0/2427848922 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4b700e7bb0 con 0x7f4b78108d10 2024-09-21T05:52:31.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.748+0000 7f4b75ffb640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871] conn(0x7f4b640c0310 0x7f4b640c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.748+0000 7f4b75ffb640 1 -- 172.21.15.7:0/2427848922 --> [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b7001ce50 con 0x7f4b640c0310 2024-09-21T05:52:31.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.748+0000 7f4b75ffb640 1 -- 172.21.15.7:0/2427848922 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f4b700e8000 con 0x7f4b78108d10 2024-09-21T05:52:31.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.748+0000 7f4b77fff640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b640b6620 0x7f4b640b8b30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800abe0 tx=0x7f4b6800a5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:31.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.748+0000 7f4b6ffff640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871] conn(0x7f4b640c0310 0x7f4b640c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.748+0000 7f4b6ffff640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871] conn(0x7f4b640c0310 0x7f4b640c2800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:31.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.749+0000 7f4b75ffb640 1 -- 172.21.15.7:0/2427848922 <== osd.1 v2:172.21.15.27:6800/2299402871 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4b7001ce50 con 0x7f4b640c0310 2024-09-21T05:52:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.763+0000 7f4b7e838640 1 -- 172.21.15.7:0/2427848922 --> [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4b78063f10 con 0x7f4b640c0310 2024-09-21T05:52:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.763+0000 7f4b75ffb640 1 -- 172.21.15.7:0/2427848922 <== osd.1 v2:172.21.15.27:6800/2299402871 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4b78063f10 con 0x7f4b640c0310 2024-09-21T05:52:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.764+0000 7f4b7e838640 1 -- 172.21.15.7:0/2427848922 >> [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871] conn(0x7f4b640c0310 msgr2=0x7f4b640c2800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.764+0000 7f4b7e838640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871] conn(0x7f4b640c0310 0x7f4b640c2800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.764+0000 7f4b7e838640 1 -- 172.21.15.7:0/2427848922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b640b6620 msgr2=0x7f4b640b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.764+0000 7f4b7e838640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b640b6620 0x7f4b640b8b30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800abe0 tx=0x7f4b6800a5c0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.764+0000 7f4b7e838640 1 -- 172.21.15.7:0/2427848922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b78108d10 msgr2=0x7f4b7819fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.764+0000 7f4b7e838640 1 --2- 172.21.15.7:0/2427848922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b78108d10 0x7f4b7819fe00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000eaa0 tx=0x7f4b7000ef60 comp rx=0 tx=0).stop 2024-09-21T05:52:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.764+0000 7f4b7cdd5640 1 -- 172.21.15.7:0/2427848922 reap_dead start 2024-09-21T05:52:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.764+0000 7f4b7e838640 1 -- 172.21.15.7:0/2427848922 shutdown_connections 2024-09-21T05:52:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.764+0000 7f4b7e838640 1 -- 172.21.15.7:0/2427848922 >> 172.21.15.7:0/2427848922 conn(0x7f4b78079740 msgr2=0x7f4b7806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:31.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.764+0000 7f4b7e838640 1 -- 172.21.15.7:0/2427848922 shutdown_connections 2024-09-21T05:52:31.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.764+0000 7f4b7e838640 1 -- 172.21.15.7:0/2427848922 wait complete. 2024-09-21T05:52:31.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.935+0000 7f5e2e92b640 1 -- 172.21.15.7:0/934441224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e28105300 msgr2=0x7f5e2810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.935+0000 7f5e2e92b640 1 --2- 172.21.15.7:0/934441224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e28105300 0x7f5e2810d850 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009900 tx=0x7f5e1002a410 comp rx=0 tx=0).stop 2024-09-21T05:52:31.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.935+0000 7f5e2e92b640 1 -- 172.21.15.7:0/934441224 shutdown_connections 2024-09-21T05:52:31.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.935+0000 7f5e2e92b640 1 --2- 172.21.15.7:0/934441224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e28105300 0x7f5e2810d850 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.935+0000 7f5e2e92b640 1 --2- 172.21.15.7:0/934441224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e2810de10 0x7f5e28110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.935+0000 7f5e2e92b640 1 --2- 172.21.15.7:0/934441224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e281049b0 0x7f5e28104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.935+0000 7f5e2e92b640 1 -- 172.21.15.7:0/934441224 >> 172.21.15.7:0/934441224 conn(0x7f5e28079730 msgr2=0x7f5e28079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:31.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.935+0000 7f5e2e92b640 1 -- 172.21.15.7:0/934441224 shutdown_connections 2024-09-21T05:52:31.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.935+0000 7f5e2e92b640 1 -- 172.21.15.7:0/934441224 wait complete. 2024-09-21T05:52:31.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.935+0000 7f5e2e92b640 1 Processor -- start 2024-09-21T05:52:31.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e2e92b640 1 -- start start 2024-09-21T05:52:31.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e2e92b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e281049b0 0x7f5e2819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e2e92b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e28105300 0x7f5e2819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e2e92b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e2810de10 0x7f5e2819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e2e92b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5e28113ad0 con 0x7f5e281049b0 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e2e92b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5e28113950 con 0x7f5e28105300 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e2e92b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5e28113c50 con 0x7f5e2810de10 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e281049b0 0x7f5e2819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e281049b0 0x7f5e2819a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47874/0 (socket says 172.21.15.7:47874) 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e27fff640 1 -- 172.21.15.7:0/3482425139 learned_addr learned my addr 172.21.15.7:0/3482425139 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e1ffff640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e28105300 0x7f5e2819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e2cec8640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e2810de10 0x7f5e2819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e27fff640 1 -- 172.21.15.7:0/3482425139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e2810de10 msgr2=0x7f5e2819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e27fff640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e2810de10 0x7f5e2819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e27fff640 1 -- 172.21.15.7:0/3482425139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e28105300 msgr2=0x7f5e2819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e27fff640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e28105300 0x7f5e2819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e27fff640 1 -- 172.21.15.7:0/3482425139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e281a03f0 con 0x7f5e281049b0 2024-09-21T05:52:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.936+0000 7f5e2cec8640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e2810de10 0x7f5e2819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:52:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.937+0000 7f5e27fff640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e281049b0 0x7f5e2819a540 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800b450 tx=0x7f5e1800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.937+0000 7f5e25ffb640 1 -- 172.21.15.7:0/3482425139 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18015020 con 0x7f5e281049b0 2024-09-21T05:52:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.937+0000 7f5e2e92b640 1 -- 172.21.15.7:0/3482425139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e281a06e0 con 0x7f5e281049b0 2024-09-21T05:52:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.937+0000 7f5e25ffb640 1 -- 172.21.15.7:0/3482425139 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e18011d40 con 0x7f5e281049b0 2024-09-21T05:52:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.937+0000 7f5e25ffb640 1 -- 172.21.15.7:0/3482425139 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1800f340 con 0x7f5e281049b0 2024-09-21T05:52:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.937+0000 7f5e2e92b640 1 -- 172.21.15.7:0/3482425139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e281a6f00 con 0x7f5e281049b0 2024-09-21T05:52:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.938+0000 7f5e2e92b640 1 -- 172.21.15.7:0/3482425139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e28063b50 con 0x7f5e281049b0 2024-09-21T05:52:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.939+0000 7f5e25ffb640 1 -- 172.21.15.7:0/3482425139 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f5e18018020 con 0x7f5e281049b0 2024-09-21T05:52:31.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.940+0000 7f5e25ffb640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5e140b6620 0x7f5e140b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.940+0000 7f5e1ffff640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5e140b6620 0x7f5e140b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.940+0000 7f5e25ffb640 1 -- 172.21.15.7:0/3482425139 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f5e180e75e0 con 0x7f5e281049b0 2024-09-21T05:52:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.941+0000 7f5e25ffb640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021] conn(0x7f5e140c0310 0x7f5e140c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.941+0000 7f5e25ffb640 1 -- 172.21.15.7:0/3482425139 --> [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e140c2ed0 con 0x7f5e140c0310 2024-09-21T05:52:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.941+0000 7f5e25ffb640 1 -- 172.21.15.7:0/3482425139 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f5e180e7a30 con 0x7f5e281049b0 2024-09-21T05:52:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.941+0000 7f5e2cec8640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021] conn(0x7f5e140c0310 0x7f5e140c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.941+0000 7f5e1ffff640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5e140b6620 0x7f5e140b8b30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009230 tx=0x7f5e10031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.941+0000 7f5e2cec8640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021] conn(0x7f5e140c0310 0x7f5e140c2800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.942+0000 7f5e25ffb640 1 -- 172.21.15.7:0/3482425139 <== osd.6 v2:172.21.15.7:6818/856032021 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5e140c2ed0 con 0x7f5e140c0310 2024-09-21T05:52:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.956+0000 7f5e2e92b640 1 -- 172.21.15.7:0/3482425139 --> [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e28063fd0 con 0x7f5e140c0310 2024-09-21T05:52:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.956+0000 7f5e25ffb640 1 -- 172.21.15.7:0/3482425139 <== osd.6 v2:172.21.15.7:6818/856032021 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5e28063fd0 con 0x7f5e140c0310 2024-09-21T05:52:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.956+0000 7f5e2e92b640 1 -- 172.21.15.7:0/3482425139 >> [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021] conn(0x7f5e140c0310 msgr2=0x7f5e140c2800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.956+0000 7f5e2e92b640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021] conn(0x7f5e140c0310 0x7f5e140c2800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.956+0000 7f5e2e92b640 1 -- 172.21.15.7:0/3482425139 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5e140b6620 msgr2=0x7f5e140b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.956+0000 7f5e2e92b640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5e140b6620 0x7f5e140b8b30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009230 tx=0x7f5e10031400 comp rx=0 tx=0).stop 2024-09-21T05:52:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.956+0000 7f5e2e92b640 1 -- 172.21.15.7:0/3482425139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e281049b0 msgr2=0x7f5e2819a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.956+0000 7f5e2e92b640 1 --2- 172.21.15.7:0/3482425139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e281049b0 0x7f5e2819a540 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800b450 tx=0x7f5e1800b910 comp rx=0 tx=0).stop 2024-09-21T05:52:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.956+0000 7f5e2cec8640 1 -- 172.21.15.7:0/3482425139 reap_dead start 2024-09-21T05:52:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.956+0000 7f5e2e92b640 1 -- 172.21.15.7:0/3482425139 shutdown_connections 2024-09-21T05:52:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.956+0000 7f5e2e92b640 1 -- 172.21.15.7:0/3482425139 >> 172.21.15.7:0/3482425139 conn(0x7f5e28079730 msgr2=0x7f5e28100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.956+0000 7f5e2e92b640 1 -- 172.21.15.7:0/3482425139 shutdown_connections 2024-09-21T05:52:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:31.956+0000 7f5e2e92b640 1 -- 172.21.15.7:0/3482425139 wait complete. 2024-09-21T05:52:31.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:31 smithi027 ceph-mon[34364]: pgmap v277: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s; 0 B/s, 2 keys/s, 0 objects/s recovering 2024-09-21T05:52:32.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:31 smithi119 ceph-mon[34833]: pgmap v277: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s; 0 B/s, 2 keys/s, 0 objects/s recovering 2024-09-21T05:52:32.802 INFO:teuthology.orchestra.run.smithi007.stdout:60129542215 2024-09-21T05:52:32.802 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T05:52:33.423 INFO:teuthology.orchestra.run.smithi007.stdout:81604378690 2024-09-21T05:52:33.423 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T05:52:33.595 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:33.635 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:33.653 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:33 smithi007 ceph-mon[30983]: pgmap v278: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 310 B/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:33.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:33 smithi027 ceph-mon[34364]: pgmap v278: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 310 B/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:34.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:33 smithi119 ceph-mon[34833]: pgmap v278: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 310 B/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:34.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.395+0000 7f838b291640 1 -- 172.21.15.7:0/32701253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8384109df0 msgr2=0x7f8384110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.395+0000 7f838b291640 1 --2- 172.21.15.7:0/32701253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8384109df0 0x7f8384110620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f837c009ca0 tx=0x7f837c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.395+0000 7f838b291640 1 -- 172.21.15.7:0/32701253 shutdown_connections 2024-09-21T05:52:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.395+0000 7f838b291640 1 --2- 172.21.15.7:0/32701253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8384109df0 0x7f8384110620 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.395+0000 7f838b291640 1 --2- 172.21.15.7:0/32701253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83841094a0 0x7f83841098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.395+0000 7f838b291640 1 --2- 172.21.15.7:0/32701253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8384103b60 0x7f8384103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.395+0000 7f838b291640 1 -- 172.21.15.7:0/32701253 >> 172.21.15.7:0/32701253 conn(0x7f838407b850 msgr2=0x7f838407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.395+0000 7f838b291640 1 -- 172.21.15.7:0/32701253 shutdown_connections 2024-09-21T05:52:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.395+0000 7f838b291640 1 -- 172.21.15.7:0/32701253 wait complete. 2024-09-21T05:52:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.396+0000 7f838b291640 1 Processor -- start 2024-09-21T05:52:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.396+0000 7f838b291640 1 -- start start 2024-09-21T05:52:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.396+0000 7f838b291640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8384103b60 0x7f8384075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.396+0000 7f838b291640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83841094a0 0x7f8384075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.396+0000 7f838b291640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8384109df0 0x7f8384076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.396+0000 7f838b291640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8384113ab0 con 0x7f8384103b60 2024-09-21T05:52:34.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.396+0000 7f838b291640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8384113930 con 0x7f83841094a0 2024-09-21T05:52:34.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.396+0000 7f838b291640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8384113c30 con 0x7f8384109df0 2024-09-21T05:52:34.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.396+0000 7f838902d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8384103b60 0x7f8384075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.396+0000 7f838902d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8384103b60 0x7f8384075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47902/0 (socket says 172.21.15.7:47902) 2024-09-21T05:52:34.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.396+0000 7f838902d640 1 -- 172.21.15.7:0/2262676771 learned_addr learned my addr 172.21.15.7:0/2262676771 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:34.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.397+0000 7f838882c640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83841094a0 0x7f8384075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.397+0000 7f838982e640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8384109df0 0x7f8384076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.397+0000 7f838902d640 1 -- 172.21.15.7:0/2262676771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8384109df0 msgr2=0x7f8384076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.397+0000 7f838902d640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8384109df0 0x7f8384076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.397+0000 7f838902d640 1 -- 172.21.15.7:0/2262676771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83841094a0 msgr2=0x7f8384075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.397+0000 7f838902d640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f83841094a0 0x7f8384075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.397+0000 7f838902d640 1 -- 172.21.15.7:0/2262676771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83841a86e0 con 0x7f8384103b60 2024-09-21T05:52:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.397+0000 7f838902d640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8384103b60 0x7f8384075710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f838000c970 tx=0x7f838000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.397+0000 7f837a7fc640 1 -- 172.21.15.7:0/2262676771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380007bb0 con 0x7f8384103b60 2024-09-21T05:52:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.397+0000 7f837a7fc640 1 -- 172.21.15.7:0/2262676771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8380007d50 con 0x7f8384103b60 2024-09-21T05:52:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.397+0000 7f838b291640 1 -- 172.21.15.7:0/2262676771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83841a89d0 con 0x7f8384103b60 2024-09-21T05:52:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.397+0000 7f837a7fc640 1 -- 172.21.15.7:0/2262676771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838000f450 con 0x7f8384103b60 2024-09-21T05:52:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.397+0000 7f838b291640 1 -- 172.21.15.7:0/2262676771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83841a8ec0 con 0x7f8384103b60 2024-09-21T05:52:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.398+0000 7f838b291640 1 -- 172.21.15.7:0/2262676771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8384063b50 con 0x7f8384103b60 2024-09-21T05:52:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.400+0000 7f837a7fc640 1 -- 172.21.15.7:0/2262676771 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f8380004f00 con 0x7f8384103b60 2024-09-21T05:52:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.401+0000 7f837a7fc640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f83700b65f0 0x7f83700b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.401+0000 7f838882c640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f83700b65f0 0x7f83700b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.401+0000 7f837a7fc640 1 -- 172.21.15.7:0/2262676771 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f83800e7750 con 0x7f8384103b60 2024-09-21T05:52:34.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.401+0000 7f837a7fc640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826] conn(0x7f83700c02e0 0x7f83700c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.401+0000 7f837a7fc640 1 -- 172.21.15.7:0/2262676771 --> [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83800047b0 con 0x7f83700c02e0 2024-09-21T05:52:34.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.401+0000 7f837a7fc640 1 -- 172.21.15.7:0/2262676771 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f83800e7ba0 con 0x7f8384103b60 2024-09-21T05:52:34.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.401+0000 7f838882c640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f83700b65f0 0x7f83700b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f83841070f0 tx=0x7f837400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:34.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.401+0000 7f838982e640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826] conn(0x7f83700c02e0 0x7f83700c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.402+0000 7f838982e640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826] conn(0x7f83700c02e0 0x7f83700c27d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:34.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.403+0000 7f837a7fc640 1 -- 172.21.15.7:0/2262676771 <== osd.11 v2:172.21.15.119:6824/3937692826 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83800047b0 con 0x7f83700c02e0 2024-09-21T05:52:34.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.416+0000 7f838b291640 1 -- 172.21.15.7:0/2262676771 --> [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8384063fd0 con 0x7f83700c02e0 2024-09-21T05:52:34.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.417+0000 7f837a7fc640 1 -- 172.21.15.7:0/2262676771 <== osd.11 v2:172.21.15.119:6824/3937692826 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8384063fd0 con 0x7f83700c02e0 2024-09-21T05:52:34.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.417+0000 7f838b291640 1 -- 172.21.15.7:0/2262676771 >> [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826] conn(0x7f83700c02e0 msgr2=0x7f83700c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.417+0000 7f838b291640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826] conn(0x7f83700c02e0 0x7f83700c27d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.417+0000 7f838b291640 1 -- 172.21.15.7:0/2262676771 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f83700b65f0 msgr2=0x7f83700b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.417+0000 7f838b291640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f83700b65f0 0x7f83700b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f83841070f0 tx=0x7f837400b390 comp rx=0 tx=0).stop 2024-09-21T05:52:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.417+0000 7f838b291640 1 -- 172.21.15.7:0/2262676771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8384103b60 msgr2=0x7f8384075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.417+0000 7f838b291640 1 --2- 172.21.15.7:0/2262676771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8384103b60 0x7f8384075710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f838000c970 tx=0x7f838000ce30 comp rx=0 tx=0).stop 2024-09-21T05:52:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.417+0000 7f838982e640 1 -- 172.21.15.7:0/2262676771 reap_dead start 2024-09-21T05:52:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.417+0000 7f838b291640 1 -- 172.21.15.7:0/2262676771 shutdown_connections 2024-09-21T05:52:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.417+0000 7f838b291640 1 -- 172.21.15.7:0/2262676771 >> 172.21.15.7:0/2262676771 conn(0x7f838407b850 msgr2=0x7f8384105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.417+0000 7f838b291640 1 -- 172.21.15.7:0/2262676771 shutdown_connections 2024-09-21T05:52:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:34.418+0000 7f838b291640 1 -- 172.21.15.7:0/2262676771 wait complete. 2024-09-21T05:52:35.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.082+0000 7fafdf709640 1 -- 172.21.15.7:0/1476158758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd81083a0 msgr2=0x7fafd81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:35.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.082+0000 7fafdf709640 1 --2- 172.21.15.7:0/1476158758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd81083a0 0x7fafd81087b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009900 tx=0x7fafc802a410 comp rx=0 tx=0).stop 2024-09-21T05:52:35.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.082+0000 7fafdf709640 1 -- 172.21.15.7:0/1476158758 shutdown_connections 2024-09-21T05:52:35.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.082+0000 7fafdf709640 1 --2- 172.21.15.7:0/1476158758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd81083a0 0x7fafd81087b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:35.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.082+0000 7fafdf709640 1 --2- 172.21.15.7:0/1476158758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafd8108cf0 0x7fafd810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:35.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.082+0000 7fafdf709640 1 --2- 172.21.15.7:0/1476158758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafd8102a60 0x7fafd8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:35.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.082+0000 7fafdf709640 1 -- 172.21.15.7:0/1476158758 >> 172.21.15.7:0/1476158758 conn(0x7fafd8079730 msgr2=0x7fafd8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:35.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.082+0000 7fafdf709640 1 -- 172.21.15.7:0/1476158758 shutdown_connections 2024-09-21T05:52:35.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.082+0000 7fafdf709640 1 -- 172.21.15.7:0/1476158758 wait complete. 2024-09-21T05:52:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.083+0000 7fafdf709640 1 Processor -- start 2024-09-21T05:52:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.083+0000 7fafdf709640 1 -- start start 2024-09-21T05:52:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.083+0000 7fafdf709640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafd8102a60 0x7fafd819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.083+0000 7fafdf709640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd81083a0 0x7fafd819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.083+0000 7fafdf709640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafd8108cf0 0x7fafd819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.083+0000 7fafdf709640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fafd8113a80 con 0x7fafd81083a0 2024-09-21T05:52:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.083+0000 7fafdf709640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fafd8113900 con 0x7fafd8108cf0 2024-09-21T05:52:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.083+0000 7fafdf709640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fafd8113c00 con 0x7fafd8102a60 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.083+0000 7fafdcca4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd81083a0 0x7fafd819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.083+0000 7fafdcca4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd81083a0 0x7fafd819aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47910/0 (socket says 172.21.15.7:47910) 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.083+0000 7fafdcca4640 1 -- 172.21.15.7:0/2759163078 learned_addr learned my addr 172.21.15.7:0/2759163078 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafddca6640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafd8108cf0 0x7fafd819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafdd4a5640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafd8102a60 0x7fafd819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafdcca4640 1 -- 172.21.15.7:0/2759163078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafd8102a60 msgr2=0x7fafd819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafdcca4640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafd8102a60 0x7fafd819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafdcca4640 1 -- 172.21.15.7:0/2759163078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafd8108cf0 msgr2=0x7fafd819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafdcca4640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafd8108cf0 0x7fafd819fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafdcca4640 1 -- 172.21.15.7:0/2759163078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd81a0480 con 0x7fafd81083a0 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafdd4a5640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafd8102a60 0x7fafd819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafdcca4640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd81083a0 0x7fafd819aab0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fafc8032fd0 tx=0x7fafc8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafce7fc640 1 -- 172.21.15.7:0/2759163078 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc803f030 con 0x7fafd81083a0 2024-09-21T05:52:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafce7fc640 1 -- 172.21.15.7:0/2759163078 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafc8004490 con 0x7fafd81083a0 2024-09-21T05:52:35.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafdf709640 1 -- 172.21.15.7:0/2759163078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd81a0710 con 0x7fafd81083a0 2024-09-21T05:52:35.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafce7fc640 1 -- 172.21.15.7:0/2759163078 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc8035070 con 0x7fafd81083a0 2024-09-21T05:52:35.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.084+0000 7fafdf709640 1 -- 172.21.15.7:0/2759163078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd81a6ed0 con 0x7fafd81083a0 2024-09-21T05:52:35.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.085+0000 7fafdf709640 1 -- 172.21.15.7:0/2759163078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fafd8063b50 con 0x7fafd81083a0 2024-09-21T05:52:35.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.087+0000 7fafce7fc640 1 -- 172.21.15.7:0/2759163078 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fafc8042030 con 0x7fafd81083a0 2024-09-21T05:52:35.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.088+0000 7fafce7fc640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fafc40b6670 0x7fafc40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:35.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.088+0000 7fafdd4a5640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fafc40b6670 0x7fafc40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:35.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.088+0000 7fafce7fc640 1 -- 172.21.15.7:0/2759163078 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fafc8107eb0 con 0x7fafd81083a0 2024-09-21T05:52:35.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.088+0000 7fafce7fc640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959] conn(0x7fafc40c0360 0x7fafc40c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:35.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.088+0000 7fafce7fc640 1 -- 172.21.15.7:0/2759163078 --> [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafc40c2f20 con 0x7fafc40c0360 2024-09-21T05:52:35.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.088+0000 7fafce7fc640 1 -- 172.21.15.7:0/2759163078 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fafc8108300 con 0x7fafd81083a0 2024-09-21T05:52:35.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.088+0000 7fafddca6640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959] conn(0x7fafc40c0360 0x7fafc40c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:35.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.089+0000 7fafdd4a5640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fafc40b6670 0x7fafc40b8b80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fafd40058c0 tx=0x7fafd4005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:35.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.089+0000 7fafddca6640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959] conn(0x7fafc40c0360 0x7fafc40c2850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:35.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.089+0000 7fafce7fc640 1 -- 172.21.15.7:0/2759163078 <== osd.9 v2:172.21.15.7:6826/2348805959 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fafc40c2f20 con 0x7fafc40c0360 2024-09-21T05:52:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.103+0000 7fafdf709640 1 -- 172.21.15.7:0/2759163078 --> [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fafd8063f80 con 0x7fafc40c0360 2024-09-21T05:52:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.103+0000 7fafce7fc640 1 -- 172.21.15.7:0/2759163078 <== osd.9 v2:172.21.15.7:6826/2348805959 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fafd8063f80 con 0x7fafc40c0360 2024-09-21T05:52:35.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.104+0000 7fafdf709640 1 -- 172.21.15.7:0/2759163078 >> [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959] conn(0x7fafc40c0360 msgr2=0x7fafc40c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:35.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.104+0000 7fafdf709640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959] conn(0x7fafc40c0360 0x7fafc40c2850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:35.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.104+0000 7fafdf709640 1 -- 172.21.15.7:0/2759163078 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fafc40b6670 msgr2=0x7fafc40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:35.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.104+0000 7fafdf709640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fafc40b6670 0x7fafc40b8b80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fafd40058c0 tx=0x7fafd4005850 comp rx=0 tx=0).stop 2024-09-21T05:52:35.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.104+0000 7fafdf709640 1 -- 172.21.15.7:0/2759163078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd81083a0 msgr2=0x7fafd819aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:35.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.104+0000 7fafdf709640 1 --2- 172.21.15.7:0/2759163078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd81083a0 0x7fafd819aab0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fafc8032fd0 tx=0x7fafc8004270 comp rx=0 tx=0).stop 2024-09-21T05:52:35.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.104+0000 7fafddca6640 1 -- 172.21.15.7:0/2759163078 reap_dead start 2024-09-21T05:52:35.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.104+0000 7fafdf709640 1 -- 172.21.15.7:0/2759163078 shutdown_connections 2024-09-21T05:52:35.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.104+0000 7fafdf709640 1 -- 172.21.15.7:0/2759163078 >> 172.21.15.7:0/2759163078 conn(0x7fafd8079730 msgr2=0x7fafd8104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:35.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.104+0000 7fafdf709640 1 -- 172.21.15.7:0/2759163078 shutdown_connections 2024-09-21T05:52:35.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.104+0000 7fafdf709640 1 -- 172.21.15.7:0/2759163078 wait complete. 2024-09-21T05:52:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.476+0000 7f28c4621640 1 -- 172.21.15.7:0/3901321678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28bc103b80 msgr2=0x7f28bc103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.476+0000 7f28c4621640 1 --2- 172.21.15.7:0/3901321678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28bc103b80 0x7f28bc103f90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009900 tx=0x7f28b402a410 comp rx=0 tx=0).stop 2024-09-21T05:52:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.476+0000 7f28c4621640 1 -- 172.21.15.7:0/3901321678 shutdown_connections 2024-09-21T05:52:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.476+0000 7f28c4621640 1 --2- 172.21.15.7:0/3901321678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28bc109e10 0x7f28bc110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.476+0000 7f28c4621640 1 --2- 172.21.15.7:0/3901321678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1094c0 0x7f28bc1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.476+0000 7f28c4621640 1 --2- 172.21.15.7:0/3901321678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28bc103b80 0x7f28bc103f90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.476+0000 7f28c4621640 1 -- 172.21.15.7:0/3901321678 >> 172.21.15.7:0/3901321678 conn(0x7f28bc0ff610 msgr2=0x7f28bc101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.476+0000 7f28c4621640 1 -- 172.21.15.7:0/3901321678 shutdown_connections 2024-09-21T05:52:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.476+0000 7f28c4621640 1 -- 172.21.15.7:0/3901321678 wait complete. 2024-09-21T05:52:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.477+0000 7f28c4621640 1 Processor -- start 2024-09-21T05:52:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.477+0000 7f28c4621640 1 -- start start 2024-09-21T05:52:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.477+0000 7f28c4621640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc103b80 0x7f28bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.477+0000 7f28c4621640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28bc1094c0 0x7f28bc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.477+0000 7f28c4621640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28bc109e10 0x7f28bc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.477+0000 7f28c4621640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc113ad0 con 0x7f28bc1094c0 2024-09-21T05:52:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.477+0000 7f28c4621640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc113950 con 0x7f28bc109e10 2024-09-21T05:52:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.477+0000 7f28c4621640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc113c50 con 0x7f28bc103b80 2024-09-21T05:52:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.477+0000 7f28c1bbc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28bc1094c0 0x7f28bc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.477+0000 7f28c1bbc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28bc1094c0 0x7f28bc075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47942/0 (socket says 172.21.15.7:47942) 2024-09-21T05:52:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.477+0000 7f28c1bbc640 1 -- 172.21.15.7:0/2630327549 learned_addr learned my addr 172.21.15.7:0/2630327549 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28c23bd640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc103b80 0x7f28bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28c2bbe640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28bc109e10 0x7f28bc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28c1bbc640 1 -- 172.21.15.7:0/2630327549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc103b80 msgr2=0x7f28bc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28c1bbc640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc103b80 0x7f28bc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28c1bbc640 1 -- 172.21.15.7:0/2630327549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28bc109e10 msgr2=0x7f28bc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28c1bbc640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28bc109e10 0x7f28bc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28c1bbc640 1 -- 172.21.15.7:0/2630327549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28bc1a86d0 con 0x7f28bc1094c0 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28c2bbe640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28bc109e10 0x7f28bc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28c1bbc640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28bc1094c0 0x7f28bc075c50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f28b000d750 tx=0x7f28b000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28bb7fe640 1 -- 172.21.15.7:0/2630327549 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b0017070 con 0x7f28bc1094c0 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28bb7fe640 1 -- 172.21.15.7:0/2630327549 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28b00054d0 con 0x7f28bc1094c0 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28c4621640 1 -- 172.21.15.7:0/2630327549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28bc1a89c0 con 0x7f28bc1094c0 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28bb7fe640 1 -- 172.21.15.7:0/2630327549 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b0004c30 con 0x7f28bc1094c0 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.478+0000 7f28c4621640 1 -- 172.21.15.7:0/2630327549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28bc1a8eb0 con 0x7f28bc1094c0 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.479+0000 7f28c4621640 1 -- 172.21.15.7:0/2630327549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f28bc063b50 con 0x7f28bc1094c0 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.481+0000 7f28bb7fe640 1 -- 172.21.15.7:0/2630327549 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f28b0004dd0 con 0x7f28bc1094c0 2024-09-21T05:52:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.482+0000 7f28bb7fe640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f28a40b65f0 0x7f28a40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.482+0000 7f28c23bd640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f28a40b65f0 0x7f28a40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.482+0000 7f28bb7fe640 1 -- 172.21.15.7:0/2630327549 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f28b00e73d0 con 0x7f28bc1094c0 2024-09-21T05:52:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.482+0000 7f28bb7fe640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283] conn(0x7f28a40c02e0 0x7f28a40c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.482+0000 7f28bb7fe640 1 -- 172.21.15.7:0/2630327549 --> [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28b0021e50 con 0x7f28a40c02e0 2024-09-21T05:52:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.482+0000 7f28bb7fe640 1 -- 172.21.15.7:0/2630327549 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f28b00e7820 con 0x7f28bc1094c0 2024-09-21T05:52:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.482+0000 7f28c2bbe640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283] conn(0x7f28a40c02e0 0x7f28a40c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.482+0000 7f28c23bd640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f28a40b65f0 0x7f28a40b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f28b4000c00 tx=0x7f28b4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.482+0000 7f28c2bbe640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283] conn(0x7f28a40c02e0 0x7f28a40c27d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.483+0000 7f28bb7fe640 1 -- 172.21.15.7:0/2630327549 <== osd.0 v2:172.21.15.7:6802/536257283 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f28b0021e50 con 0x7f28a40c02e0 2024-09-21T05:52:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.497+0000 7f28c4621640 1 -- 172.21.15.7:0/2630327549 --> [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f28bc063fd0 con 0x7f28a40c02e0 2024-09-21T05:52:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.497+0000 7f28bb7fe640 1 -- 172.21.15.7:0/2630327549 <== osd.0 v2:172.21.15.7:6802/536257283 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f28bc063fd0 con 0x7f28a40c02e0 2024-09-21T05:52:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.497+0000 7f28c4621640 1 -- 172.21.15.7:0/2630327549 >> [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283] conn(0x7f28a40c02e0 msgr2=0x7f28a40c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:35.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.497+0000 7f28c4621640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283] conn(0x7f28a40c02e0 0x7f28a40c27d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:35.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.497+0000 7f28c4621640 1 -- 172.21.15.7:0/2630327549 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f28a40b65f0 msgr2=0x7f28a40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:35.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.497+0000 7f28c4621640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f28a40b65f0 0x7f28a40b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f28b4000c00 tx=0x7f28b4031400 comp rx=0 tx=0).stop 2024-09-21T05:52:35.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.497+0000 7f28c4621640 1 -- 172.21.15.7:0/2630327549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28bc1094c0 msgr2=0x7f28bc075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:35.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.497+0000 7f28c4621640 1 --2- 172.21.15.7:0/2630327549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28bc1094c0 0x7f28bc075c50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f28b000d750 tx=0x7f28b000dc10 comp rx=0 tx=0).stop 2024-09-21T05:52:35.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.497+0000 7f28c2bbe640 1 -- 172.21.15.7:0/2630327549 reap_dead start 2024-09-21T05:52:35.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.498+0000 7f28c4621640 1 -- 172.21.15.7:0/2630327549 shutdown_connections 2024-09-21T05:52:35.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.498+0000 7f28c4621640 1 -- 172.21.15.7:0/2630327549 >> 172.21.15.7:0/2630327549 conn(0x7f28bc0ff610 msgr2=0x7f28bc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:35.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.498+0000 7f28c4621640 1 -- 172.21.15.7:0/2630327549 shutdown_connections 2024-09-21T05:52:35.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.498+0000 7f28c4621640 1 -- 172.21.15.7:0/2630327549 wait complete. 2024-09-21T05:52:35.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:35 smithi007 ceph-mon[30983]: pgmap v279: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:35.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:35 smithi027 ceph-mon[34364]: pgmap v279: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:36.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:35 smithi119 ceph-mon[34833]: pgmap v279: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T05:52:36.286 INFO:teuthology.orchestra.run.smithi007.stdout:38654705741 2024-09-21T05:52:36.286 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T05:52:36.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.275+0000 7fb11700e640 1 -- 172.21.15.7:0/205818616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1101094d0 msgr2=0x7fb1101098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:36.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.275+0000 7fb11700e640 1 --2- 172.21.15.7:0/205818616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1101094d0 0x7fb1101098e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009900 tx=0x7fb0fc02a410 comp rx=0 tx=0).stop 2024-09-21T05:52:36.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.275+0000 7fb11700e640 1 -- 172.21.15.7:0/205818616 shutdown_connections 2024-09-21T05:52:36.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.275+0000 7fb11700e640 1 --2- 172.21.15.7:0/205818616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1101094d0 0x7fb1101098e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:36.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.275+0000 7fb11700e640 1 --2- 172.21.15.7:0/205818616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb110109e20 0x7fb110110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.275+0000 7fb11700e640 1 --2- 172.21.15.7:0/205818616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb110103b90 0x7fb110103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.275+0000 7fb11700e640 1 -- 172.21.15.7:0/205818616 >> 172.21.15.7:0/205818616 conn(0x7fb1100ff600 msgr2=0x7fb110101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.275+0000 7fb11700e640 1 -- 172.21.15.7:0/205818616 shutdown_connections 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.275+0000 7fb11700e640 1 -- 172.21.15.7:0/205818616 wait complete. 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb11700e640 1 Processor -- start 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb11700e640 1 -- start start 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb11700e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb110103b90 0x7fb11019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb11700e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1101094d0 0x7fb11019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb11700e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb110109e20 0x7fb1101a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb11700e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb110113ae0 con 0x7fb110109e20 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb11700e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb110113960 con 0x7fb1101094d0 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb11700e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb110113c60 con 0x7fb110103b90 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb1155ab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb110109e20 0x7fb1101a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb1155ab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb110109e20 0x7fb1101a1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47918/0 (socket says 172.21.15.7:47918) 2024-09-21T05:52:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb1155ab640 1 -- 172.21.15.7:0/4081959470 learned_addr learned my addr 172.21.15.7:0/4081959470 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb10ffff640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1101094d0 0x7fb11019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb114daa640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb110103b90 0x7fb11019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb1155ab640 1 -- 172.21.15.7:0/4081959470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb110103b90 msgr2=0x7fb11019c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.276+0000 7fb1155ab640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb110103b90 0x7fb11019c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.277+0000 7fb1155ab640 1 -- 172.21.15.7:0/4081959470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1101094d0 msgr2=0x7fb11019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.277+0000 7fb1155ab640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1101094d0 0x7fb11019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.277+0000 7fb1155ab640 1 -- 172.21.15.7:0/4081959470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1101a2600 con 0x7fb110109e20 2024-09-21T05:52:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.277+0000 7fb10ffff640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1101094d0 0x7fb11019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.277+0000 7fb114daa640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb110103b90 0x7fb11019c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:52:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.277+0000 7fb1155ab640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb110109e20 0x7fb1101a1ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb10800eb10 tx=0x7fb10800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.277+0000 7fb10dffb640 1 -- 172.21.15.7:0/4081959470 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108004b20 con 0x7fb110109e20 2024-09-21T05:52:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.277+0000 7fb11700e640 1 -- 172.21.15.7:0/4081959470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1101a28f0 con 0x7fb110109e20 2024-09-21T05:52:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.277+0000 7fb10dffb640 1 -- 172.21.15.7:0/4081959470 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb108004cc0 con 0x7fb110109e20 2024-09-21T05:52:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.277+0000 7fb10dffb640 1 -- 172.21.15.7:0/4081959470 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108010690 con 0x7fb110109e20 2024-09-21T05:52:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.277+0000 7fb11700e640 1 -- 172.21.15.7:0/4081959470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1101a9050 con 0x7fb110109e20 2024-09-21T05:52:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.278+0000 7fb11700e640 1 -- 172.21.15.7:0/4081959470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb11010fc70 con 0x7fb110109e20 2024-09-21T05:52:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.280+0000 7fb10dffb640 1 -- 172.21.15.7:0/4081959470 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fb108005000 con 0x7fb110109e20 2024-09-21T05:52:36.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.280+0000 7fb10dffb640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb1000b65f0 0x7fb1000b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.281+0000 7fb114daa640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb1000b65f0 0x7fb1000b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.281+0000 7fb10dffb640 1 -- 172.21.15.7:0/4081959470 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb1080e8080 con 0x7fb110109e20 2024-09-21T05:52:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.281+0000 7fb10dffb640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090] conn(0x7fb1000c02e0 0x7fb1000c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.281+0000 7fb10dffb640 1 -- 172.21.15.7:0/4081959470 --> [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb108009030 con 0x7fb1000c02e0 2024-09-21T05:52:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.281+0000 7fb10dffb640 1 -- 172.21.15.7:0/4081959470 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fb1080e84d0 con 0x7fb110109e20 2024-09-21T05:52:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.281+0000 7fb114daa640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb1000b65f0 0x7fb1000b8b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb104009b40 tx=0x7fb104005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.281+0000 7fb10ffff640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090] conn(0x7fb1000c02e0 0x7fb1000c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.282+0000 7fb10ffff640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090] conn(0x7fb1000c02e0 0x7fb1000c27d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.283+0000 7fb10dffb640 1 -- 172.21.15.7:0/4081959470 <== osd.10 v2:172.21.15.27:6824/2363600090 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb108009030 con 0x7fb1000c02e0 2024-09-21T05:52:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.296+0000 7fb11700e640 1 -- 172.21.15.7:0/4081959470 --> [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb110104e10 con 0x7fb1000c02e0 2024-09-21T05:52:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.297+0000 7fb10dffb640 1 -- 172.21.15.7:0/4081959470 <== osd.10 v2:172.21.15.27:6824/2363600090 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb110104e10 con 0x7fb1000c02e0 2024-09-21T05:52:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.297+0000 7fb11700e640 1 -- 172.21.15.7:0/4081959470 >> [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090] conn(0x7fb1000c02e0 msgr2=0x7fb1000c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.297+0000 7fb11700e640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090] conn(0x7fb1000c02e0 0x7fb1000c27d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.298+0000 7fb11700e640 1 -- 172.21.15.7:0/4081959470 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb1000b65f0 msgr2=0x7fb1000b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.298+0000 7fb11700e640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb1000b65f0 0x7fb1000b8b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb104009b40 tx=0x7fb104005e50 comp rx=0 tx=0).stop 2024-09-21T05:52:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.298+0000 7fb11700e640 1 -- 172.21.15.7:0/4081959470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb110109e20 msgr2=0x7fb1101a1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.298+0000 7fb11700e640 1 --2- 172.21.15.7:0/4081959470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb110109e20 0x7fb1101a1ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb10800eb10 tx=0x7fb10800c2d0 comp rx=0 tx=0).stop 2024-09-21T05:52:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.298+0000 7fb1155ab640 1 -- 172.21.15.7:0/4081959470 reap_dead start 2024-09-21T05:52:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.298+0000 7fb11700e640 1 -- 172.21.15.7:0/4081959470 shutdown_connections 2024-09-21T05:52:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.298+0000 7fb11700e640 1 -- 172.21.15.7:0/4081959470 >> 172.21.15.7:0/4081959470 conn(0x7fb1100ff600 msgr2=0x7fb110106ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.298+0000 7fb11700e640 1 -- 172.21.15.7:0/4081959470 shutdown_connections 2024-09-21T05:52:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:35.298+0000 7fb11700e640 1 -- 172.21.15.7:0/4081959470 wait complete. 2024-09-21T05:52:37.328 INFO:teuthology.orchestra.run.smithi007.stdout:266287972378 2024-09-21T05:52:37.328 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T05:52:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.490+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/3378934226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e41094b0 msgr2=0x7fe8e41098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.490+0000 7fe8ec7c7640 1 --2- 172.21.15.7:0/3378934226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e41094b0 0x7fe8e41098c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009900 tx=0x7fe8d402a410 comp rx=0 tx=0).stop 2024-09-21T05:52:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.490+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/3378934226 shutdown_connections 2024-09-21T05:52:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.490+0000 7fe8ec7c7640 1 --2- 172.21.15.7:0/3378934226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e41094b0 0x7fe8e41098c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.490+0000 7fe8ec7c7640 1 --2- 172.21.15.7:0/3378934226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8e4109e00 0x7fe8e4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.490+0000 7fe8ec7c7640 1 --2- 172.21.15.7:0/3378934226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8e4101f70 0x7fe8e4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.490+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/3378934226 >> 172.21.15.7:0/3378934226 conn(0x7fe8e4077c60 msgr2=0x7fe8e40780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.490+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/3378934226 shutdown_connections 2024-09-21T05:52:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.490+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/3378934226 wait complete. 2024-09-21T05:52:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.491+0000 7fe8ec7c7640 1 Processor -- start 2024-09-21T05:52:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.491+0000 7fe8ec7c7640 1 -- start start 2024-09-21T05:52:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.491+0000 7fe8ec7c7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8e4101f70 0x7fe8e4102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8ec7c7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e41094b0 0x7fe8e4103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8ec7c7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8e4109e00 0x7fe8e4103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8ec7c7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4113ae0 con 0x7fe8e41094b0 2024-09-21T05:52:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8ec7c7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4113960 con 0x7fe8e4109e00 2024-09-21T05:52:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8ec7c7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4113c60 con 0x7fe8e4101f70 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8e9d62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e41094b0 0x7fe8e4103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8e9d62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e41094b0 0x7fe8e4103450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47960/0 (socket says 172.21.15.7:47960) 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8e9d62640 1 -- 172.21.15.7:0/1971200526 learned_addr learned my addr 172.21.15.7:0/1971200526 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8ead64640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8e4109e00 0x7fe8e4103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8ea563640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8e4101f70 0x7fe8e4102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8e9d62640 1 -- 172.21.15.7:0/1971200526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8e4101f70 msgr2=0x7fe8e4102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8e9d62640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8e4101f70 0x7fe8e4102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8e9d62640 1 -- 172.21.15.7:0/1971200526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8e4109e00 msgr2=0x7fe8e4103990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8e9d62640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8e4109e00 0x7fe8e4103990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8e9d62640 1 -- 172.21.15.7:0/1971200526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e41a8790 con 0x7fe8e41094b0 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.492+0000 7fe8e9d62640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e41094b0 0x7fe8e4103450 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe8d402a930 tx=0x7fe8d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.493+0000 7fe8db7fe640 1 -- 172.21.15.7:0/1971200526 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d403f030 con 0x7fe8e41094b0 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.493+0000 7fe8db7fe640 1 -- 172.21.15.7:0/1971200526 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8d4003aa0 con 0x7fe8e41094b0 2024-09-21T05:52:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.493+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/1971200526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e41a8a20 con 0x7fe8e41094b0 2024-09-21T05:52:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.493+0000 7fe8db7fe640 1 -- 172.21.15.7:0/1971200526 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4035070 con 0x7fe8e41094b0 2024-09-21T05:52:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.493+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/1971200526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e41a8fd0 con 0x7fe8e41094b0 2024-09-21T05:52:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.494+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/1971200526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8e4063b50 con 0x7fe8e41094b0 2024-09-21T05:52:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.496+0000 7fe8db7fe640 1 -- 172.21.15.7:0/1971200526 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fe8d4042030 con 0x7fe8e41094b0 2024-09-21T05:52:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.497+0000 7fe8db7fe640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8d00b6670 0x7fe8d00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.497+0000 7fe8ea563640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8d00b6670 0x7fe8d00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.497+0000 7fe8db7fe640 1 -- 172.21.15.7:0/1971200526 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fe8d41080d0 con 0x7fe8e41094b0 2024-09-21T05:52:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.498+0000 7fe8db7fe640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529] conn(0x7fe8d00c0360 0x7fe8d00c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.498+0000 7fe8db7fe640 1 -- 172.21.15.7:0/1971200526 --> [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8d00c2f20 con 0x7fe8d00c0360 2024-09-21T05:52:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.498+0000 7fe8db7fe640 1 -- 172.21.15.7:0/1971200526 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fe8d4108520 con 0x7fe8e41094b0 2024-09-21T05:52:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.498+0000 7fe8ea563640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8d00b6670 0x7fe8d00b8b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4104960 tx=0x7fe8e000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.498+0000 7fe8ead64640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529] conn(0x7fe8d00c0360 0x7fe8d00c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.499+0000 7fe8ead64640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529] conn(0x7fe8d00c0360 0x7fe8d00c2850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.499+0000 7fe8db7fe640 1 -- 172.21.15.7:0/1971200526 <== osd.7 v2:172.21.15.27:6816/2862843529 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8d00c2f20 con 0x7fe8d00c0360 2024-09-21T05:52:37.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.514+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/1971200526 --> [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe8e4063f50 con 0x7fe8d00c0360 2024-09-21T05:52:37.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.514+0000 7fe8db7fe640 1 -- 172.21.15.7:0/1971200526 <== osd.7 v2:172.21.15.27:6816/2862843529 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe8e4063f50 con 0x7fe8d00c0360 2024-09-21T05:52:37.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.515+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/1971200526 >> [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529] conn(0x7fe8d00c0360 msgr2=0x7fe8d00c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:37.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.515+0000 7fe8ec7c7640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529] conn(0x7fe8d00c0360 0x7fe8d00c2850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.515+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/1971200526 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8d00b6670 msgr2=0x7fe8d00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.515+0000 7fe8ec7c7640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8d00b6670 0x7fe8d00b8b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4104960 tx=0x7fe8e000b390 comp rx=0 tx=0).stop 2024-09-21T05:52:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.515+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/1971200526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e41094b0 msgr2=0x7fe8e4103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.515+0000 7fe8ec7c7640 1 --2- 172.21.15.7:0/1971200526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e41094b0 0x7fe8e4103450 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe8d402a930 tx=0x7fe8d4004270 comp rx=0 tx=0).stop 2024-09-21T05:52:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.515+0000 7fe8ead64640 1 -- 172.21.15.7:0/1971200526 reap_dead start 2024-09-21T05:52:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.515+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/1971200526 shutdown_connections 2024-09-21T05:52:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.515+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/1971200526 >> 172.21.15.7:0/1971200526 conn(0x7fe8e4077c60 msgr2=0x7fe8e41075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.516+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/1971200526 shutdown_connections 2024-09-21T05:52:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:37.516+0000 7fe8ec7c7640 1 -- 172.21.15.7:0/1971200526 wait complete. 2024-09-21T05:52:37.894 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:37 smithi119 ceph-mon[34833]: pgmap v280: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T05:52:37.959 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:37 smithi007 ceph-mon[30983]: pgmap v280: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T05:52:37.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:37 smithi027 ceph-mon[34364]: pgmap v280: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T05:52:37.986 INFO:teuthology.orchestra.run.smithi007.stdout:219043332132 2024-09-21T05:52:37.987 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T05:52:38.666 INFO:teuthology.orchestra.run.smithi007.stdout:193273528362 2024-09-21T05:52:38.667 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T05:52:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:39.290 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:39.326 INFO:teuthology.orchestra.run.smithi007.stdout:240518168608 2024-09-21T05:52:39.326 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T05:52:39.712 INFO:teuthology.orchestra.run.smithi007.stdout:287762808854 2024-09-21T05:52:39.712 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T05:52:39.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:39 smithi027 ceph-mon[34364]: pgmap v281: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T05:52:40.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:39 smithi007 ceph-mon[30983]: pgmap v281: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T05:52:40.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:39 smithi119 ceph-mon[34833]: pgmap v281: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T05:52:40.130 INFO:teuthology.orchestra.run.smithi007.stdout:171798691886 2024-09-21T05:52:40.130 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T05:52:40.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.893+0000 7f2058326640 1 -- 172.21.15.7:0/2955682705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2050102ae0 msgr2=0x7f2050102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:40.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.893+0000 7f2058326640 1 --2- 172.21.15.7:0/2955682705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2050102ae0 0x7f2050102ef0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f204c009900 tx=0x7f204c02a410 comp rx=0 tx=0).stop 2024-09-21T05:52:40.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.893+0000 7f2058326640 1 -- 172.21.15.7:0/2955682705 shutdown_connections 2024-09-21T05:52:40.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.893+0000 7f2058326640 1 --2- 172.21.15.7:0/2955682705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2050108d70 0x7f205010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:40.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.893+0000 7f2058326640 1 --2- 172.21.15.7:0/2955682705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2050108420 0x7f2050108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:40.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.893+0000 7f2058326640 1 --2- 172.21.15.7:0/2955682705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2050102ae0 0x7f2050102ef0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:40.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.893+0000 7f2058326640 1 -- 172.21.15.7:0/2955682705 >> 172.21.15.7:0/2955682705 conn(0x7f2050079770 msgr2=0x7f2050079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:40.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.893+0000 7f2058326640 1 -- 172.21.15.7:0/2955682705 shutdown_connections 2024-09-21T05:52:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.893+0000 7f2058326640 1 -- 172.21.15.7:0/2955682705 wait complete. 2024-09-21T05:52:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.894+0000 7f2058326640 1 Processor -- start 2024-09-21T05:52:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.894+0000 7f2058326640 1 -- start start 2024-09-21T05:52:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.894+0000 7f2058326640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2050102ae0 0x7f2050110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.894+0000 7f2058326640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2050108420 0x7f20501105c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.894+0000 7f2058326640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2050108d70 0x7f2050110b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.894+0000 7f2058326640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2050113b50 con 0x7f2050108420 2024-09-21T05:52:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.894+0000 7f2058326640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f20501139d0 con 0x7f2050102ae0 2024-09-21T05:52:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.894+0000 7f2058326640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2050113cd0 con 0x7f2050108d70 2024-09-21T05:52:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.894+0000 7f20558c1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2050108420 0x7f20501105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f20558c1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2050108420 0x7f20501105c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43346/0 (socket says 172.21.15.7:43346) 2024-09-21T05:52:40.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f20560c2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2050102ae0 0x7f2050110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f20558c1640 1 -- 172.21.15.7:0/3377926872 learned_addr learned my addr 172.21.15.7:0/3377926872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f20568c3640 1 --2- 172.21.15.7:0/3377926872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2050108d70 0x7f2050110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f20558c1640 1 -- 172.21.15.7:0/3377926872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2050108d70 msgr2=0x7f2050110b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f20558c1640 1 --2- 172.21.15.7:0/3377926872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2050108d70 0x7f2050110b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f20558c1640 1 -- 172.21.15.7:0/3377926872 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2050102ae0 msgr2=0x7f2050110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f20558c1640 1 --2- 172.21.15.7:0/3377926872 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2050102ae0 0x7f2050110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f20558c1640 1 -- 172.21.15.7:0/3377926872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20501a8840 con 0x7f2050108420 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f20558c1640 1 --2- 172.21.15.7:0/3377926872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2050108420 0x7f20501105c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f204000d750 tx=0x7f204000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f20477fe640 1 -- 172.21.15.7:0/3377926872 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2040017070 con 0x7f2050108420 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f2058326640 1 -- 172.21.15.7:0/3377926872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20501a8b30 con 0x7f2050108420 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f20477fe640 1 -- 172.21.15.7:0/3377926872 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20400054d0 con 0x7f2050108420 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f20477fe640 1 -- 172.21.15.7:0/3377926872 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2040004c30 con 0x7f2050108420 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.895+0000 7f2058326640 1 -- 172.21.15.7:0/3377926872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20501a9070 con 0x7f2050108420 2024-09-21T05:52:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.896+0000 7f2058326640 1 -- 172.21.15.7:0/3377926872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2050103d60 con 0x7f2050108420 2024-09-21T05:52:40.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.898+0000 7f20477fe640 1 -- 172.21.15.7:0/3377926872 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f2040004dd0 con 0x7f2050108420 2024-09-21T05:52:40.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.899+0000 7f20477fe640 1 --2- 172.21.15.7:0/3377926872 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f203c0b65f0 0x7f203c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:40.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.899+0000 7f20560c2640 1 --2- 172.21.15.7:0/3377926872 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f203c0b65f0 0x7f203c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:40.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.899+0000 7f20477fe640 1 -- 172.21.15.7:0/3377926872 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f20400e6f60 con 0x7f2050108420 2024-09-21T05:52:40.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.899+0000 7f20560c2640 1 --2- 172.21.15.7:0/3377926872 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f203c0b65f0 0x7f203c0b8b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f204c000c00 tx=0x7f204c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:40.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:40.903+0000 7f20477fe640 1 -- 172.21.15.7:0/3377926872 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20400b1970 con 0x7f2050108420 2024-09-21T05:52:40.937 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:40.940 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:40.941 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:41.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.115+0000 7f2058326640 1 -- 172.21.15.7:0/3377926872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f205010a5b0 con 0x7f2050108420 2024-09-21T05:52:41.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.115+0000 7f20477fe640 1 -- 172.21.15.7:0/3377926872 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f20400b68b0 con 0x7f2050108420 2024-09-21T05:52:41.118 INFO:teuthology.orchestra.run.smithi007.stdout:133143986234 2024-09-21T05:52:41.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.117+0000 7f2058326640 1 -- 172.21.15.7:0/3377926872 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f203c0b65f0 msgr2=0x7f203c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.118+0000 7f2058326640 1 --2- 172.21.15.7:0/3377926872 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f203c0b65f0 0x7f203c0b8b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f204c000c00 tx=0x7f204c031400 comp rx=0 tx=0).stop 2024-09-21T05:52:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.118+0000 7f2058326640 1 -- 172.21.15.7:0/3377926872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2050108420 msgr2=0x7f20501105c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.118+0000 7f2058326640 1 --2- 172.21.15.7:0/3377926872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2050108420 0x7f20501105c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f204000d750 tx=0x7f204000dc10 comp rx=0 tx=0).stop 2024-09-21T05:52:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.118+0000 7f2058326640 1 -- 172.21.15.7:0/3377926872 shutdown_connections 2024-09-21T05:52:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.118+0000 7f2058326640 1 --2- 172.21.15.7:0/3377926872 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f203c0b65f0 0x7f203c0b8b00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.118+0000 7f2058326640 1 --2- 172.21.15.7:0/3377926872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2050108420 0x7f20501105c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.118+0000 7f2058326640 1 --2- 172.21.15.7:0/3377926872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2050108d70 0x7f2050110b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.118+0000 7f2058326640 1 --2- 172.21.15.7:0/3377926872 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2050102ae0 0x7f2050110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.118+0000 7f2058326640 1 -- 172.21.15.7:0/3377926872 >> 172.21.15.7:0/3377926872 conn(0x7f2050079770 msgr2=0x7f2050106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.118+0000 7f2058326640 1 -- 172.21.15.7:0/3377926872 shutdown_connections 2024-09-21T05:52:41.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.118+0000 7f2058326640 1 -- 172.21.15.7:0/3377926872 wait complete. 2024-09-21T05:52:41.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.140+0000 7f263c3a4640 1 -- 172.21.15.7:0/4186186244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f263410de10 msgr2=0x7f2634110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:41.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.140+0000 7f263c3a4640 1 --2- 172.21.15.7:0/4186186244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f263410de10 0x7f2634110300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f262c009ca0 tx=0x7f262c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.141+0000 7f263c3a4640 1 -- 172.21.15.7:0/4186186244 shutdown_connections 2024-09-21T05:52:41.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.141+0000 7f263c3a4640 1 --2- 172.21.15.7:0/4186186244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f263410de10 0x7f2634110300 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.141+0000 7f263c3a4640 1 --2- 172.21.15.7:0/4186186244 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2634105300 0x7f263410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.141+0000 7f263c3a4640 1 --2- 172.21.15.7:0/4186186244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26341049b0 0x7f2634104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.141+0000 7f263c3a4640 1 -- 172.21.15.7:0/4186186244 >> 172.21.15.7:0/4186186244 conn(0x7f2634079730 msgr2=0x7f2634079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:41.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.141+0000 7f263c3a4640 1 -- 172.21.15.7:0/4186186244 shutdown_connections 2024-09-21T05:52:41.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.141+0000 7f263c3a4640 1 -- 172.21.15.7:0/4186186244 wait complete. 2024-09-21T05:52:41.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.141+0000 7f263c3a4640 1 Processor -- start 2024-09-21T05:52:41.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263c3a4640 1 -- start start 2024-09-21T05:52:41.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263c3a4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26341049b0 0x7f263419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:41.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263c3a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634105300 0x7f263419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:41.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263c3a4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f263410de10 0x7f263419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:41.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263c3a4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2634113a70 con 0x7f2634105300 2024-09-21T05:52:41.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263c3a4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f26341138f0 con 0x7f263410de10 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263c3a4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2634113bf0 con 0x7f26341049b0 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263993f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634105300 0x7f263419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263993f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634105300 0x7f263419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43354/0 (socket says 172.21.15.7:43354) 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263993f640 1 -- 172.21.15.7:0/3529635680 learned_addr learned my addr 172.21.15.7:0/3529635680 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263a140640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26341049b0 0x7f263419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263a941640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f263410de10 0x7f263419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263993f640 1 -- 172.21.15.7:0/3529635680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26341049b0 msgr2=0x7f263419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.142+0000 7f263993f640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26341049b0 0x7f263419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.143+0000 7f263993f640 1 -- 172.21.15.7:0/3529635680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f263410de10 msgr2=0x7f263419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.143+0000 7f263993f640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f263410de10 0x7f263419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.143+0000 7f263993f640 1 -- 172.21.15.7:0/3529635680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26341a0410 con 0x7f2634105300 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.143+0000 7f263a941640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f263410de10 0x7f263419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.143+0000 7f263a140640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26341049b0 0x7f263419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:41.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.143+0000 7f263993f640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634105300 0x7f263419aa40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f262400e9f0 tx=0x7f262400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:41.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.143+0000 7f262b7fe640 1 -- 172.21.15.7:0/3529635680 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262400ccc0 con 0x7f2634105300 2024-09-21T05:52:41.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.143+0000 7f262b7fe640 1 -- 172.21.15.7:0/3529635680 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26240108e0 con 0x7f2634105300 2024-09-21T05:52:41.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.143+0000 7f263c3a4640 1 -- 172.21.15.7:0/3529635680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26341a0700 con 0x7f2634105300 2024-09-21T05:52:41.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.143+0000 7f262b7fe640 1 -- 172.21.15.7:0/3529635680 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2624018860 con 0x7f2634105300 2024-09-21T05:52:41.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.143+0000 7f263c3a4640 1 -- 172.21.15.7:0/3529635680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26341a6e60 con 0x7f2634105300 2024-09-21T05:52:41.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.144+0000 7f263c3a4640 1 -- 172.21.15.7:0/3529635680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2634104dc0 con 0x7f2634105300 2024-09-21T05:52:41.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.147+0000 7f262b7fe640 1 -- 172.21.15.7:0/3529635680 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f2624010430 con 0x7f2634105300 2024-09-21T05:52:41.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.148+0000 7f262b7fe640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26200b65f0 0x7f26200b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:41.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.148+0000 7f262b7fe640 1 -- 172.21.15.7:0/3529635680 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f26240e7dd0 con 0x7f2634105300 2024-09-21T05:52:41.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.148+0000 7f263a140640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26200b65f0 0x7f26200b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:41.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.149+0000 7f263a140640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26200b65f0 0x7f26200b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f263406bc60 tx=0x7f2630005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.152+0000 7f262b7fe640 1 -- 172.21.15.7:0/3529635680 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26240ae460 con 0x7f2634105300 2024-09-21T05:52:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.343+0000 7f263c3a4640 1 -- 172.21.15.7:0/3529635680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2634102750 con 0x7f2634105300 2024-09-21T05:52:41.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.344+0000 7f262b7fe640 1 -- 172.21.15.7:0/3529635680 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f26240b2840 con 0x7f2634105300 2024-09-21T05:52:41.346 INFO:teuthology.orchestra.run.smithi007.stdout:150323855413 2024-09-21T05:52:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.346+0000 7f263c3a4640 1 -- 172.21.15.7:0/3529635680 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26200b65f0 msgr2=0x7f26200b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.346+0000 7f263c3a4640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26200b65f0 0x7f26200b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f263406bc60 tx=0x7f2630005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.346+0000 7f263c3a4640 1 -- 172.21.15.7:0/3529635680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634105300 msgr2=0x7f263419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.346+0000 7f263c3a4640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634105300 0x7f263419aa40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f262400e9f0 tx=0x7f262400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.346+0000 7f263c3a4640 1 -- 172.21.15.7:0/3529635680 shutdown_connections 2024-09-21T05:52:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.346+0000 7f263c3a4640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26200b65f0 0x7f26200b8b00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.346+0000 7f263c3a4640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634105300 0x7f263419aa40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.346+0000 7f263c3a4640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f263410de10 0x7f263419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.346+0000 7f263c3a4640 1 --2- 172.21.15.7:0/3529635680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26341049b0 0x7f263419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.346+0000 7f263c3a4640 1 -- 172.21.15.7:0/3529635680 >> 172.21.15.7:0/3529635680 conn(0x7f2634079730 msgr2=0x7f26340ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.346+0000 7f263c3a4640 1 -- 172.21.15.7:0/3529635680 shutdown_connections 2024-09-21T05:52:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:41.346+0000 7f263c3a4640 1 -- 172.21.15.7:0/3529635680 wait complete. 2024-09-21T05:52:41.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:41 smithi027 ceph-mon[34364]: pgmap v282: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T05:52:41.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:41 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3377926872' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T05:52:41.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:41 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3529635680' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T05:52:42.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:41 smithi007 ceph-mon[30983]: pgmap v282: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T05:52:42.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:41 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3377926872' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T05:52:42.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:41 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3529635680' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T05:52:42.047 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855410 got 150323855413 for osd.5 2024-09-21T05:52:42.047 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:42.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:41 smithi119 ceph-mon[34833]: pgmap v282: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T05:52:42.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:41 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3377926872' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T05:52:42.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:41 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3529635680' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T05:52:42.639 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986231 got 133143986234 for osd.4 2024-09-21T05:52:42.639 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:43.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.333+0000 7f98ea461640 1 -- 172.21.15.7:0/2029907385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e41083d0 msgr2=0x7f98e41087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.333+0000 7f98ea461640 1 --2- 172.21.15.7:0/2029907385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e41083d0 0x7f98e41087e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009900 tx=0x7f98cc02a410 comp rx=0 tx=0).stop 2024-09-21T05:52:43.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.333+0000 7f98ea461640 1 -- 172.21.15.7:0/2029907385 shutdown_connections 2024-09-21T05:52:43.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.333+0000 7f98ea461640 1 --2- 172.21.15.7:0/2029907385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e41083d0 0x7f98e41087e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.333+0000 7f98ea461640 1 --2- 172.21.15.7:0/2029907385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98e4108d20 0x7f98e410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.333+0000 7f98ea461640 1 --2- 172.21.15.7:0/2029907385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98e4102ae0 0x7f98e4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.333+0000 7f98ea461640 1 -- 172.21.15.7:0/2029907385 >> 172.21.15.7:0/2029907385 conn(0x7f98e4079790 msgr2=0x7f98e4079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.334+0000 7f98ea461640 1 -- 172.21.15.7:0/2029907385 shutdown_connections 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.334+0000 7f98ea461640 1 -- 172.21.15.7:0/2029907385 wait complete. 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.334+0000 7f98ea461640 1 Processor -- start 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.334+0000 7f98ea461640 1 -- start start 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.334+0000 7f98ea461640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98e4102ae0 0x7f98e419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98ea461640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98e41083d0 0x7f98e419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98ea461640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e4108d20 0x7f98e419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98ea461640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f98e41129e0 con 0x7f98e4108d20 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98ea461640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f98e4112860 con 0x7f98e41083d0 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98ea461640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f98e4112b60 con 0x7f98e4102ae0 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98e89fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e4108d20 0x7f98e419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98e89fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e4108d20 0x7f98e419fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43364/0 (socket says 172.21.15.7:43364) 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98e89fe640 1 -- 172.21.15.7:0/815539363 learned_addr learned my addr 172.21.15.7:0/815539363 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98dbfff640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98e41083d0 0x7f98e419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98e3fff640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98e4102ae0 0x7f98e419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98e89fe640 1 -- 172.21.15.7:0/815539363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98e4102ae0 msgr2=0x7f98e419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98e89fe640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98e4102ae0 0x7f98e419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98e89fe640 1 -- 172.21.15.7:0/815539363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98e41083d0 msgr2=0x7f98e419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98e89fe640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98e41083d0 0x7f98e419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98e89fe640 1 -- 172.21.15.7:0/815539363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e41a0490 con 0x7f98e4108d20 2024-09-21T05:52:43.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98e89fe640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e4108d20 0x7f98e419fd60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f98dc009fd0 tx=0x7f98dc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:43.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.335+0000 7f98e1ffb640 1 -- 172.21.15.7:0/815539363 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc017070 con 0x7f98e4108d20 2024-09-21T05:52:43.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.336+0000 7f98e1ffb640 1 -- 172.21.15.7:0/815539363 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98dc003e20 con 0x7f98e4108d20 2024-09-21T05:52:43.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.336+0000 7f98ea461640 1 -- 172.21.15.7:0/815539363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e41a0780 con 0x7f98e4108d20 2024-09-21T05:52:43.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.336+0000 7f98e1ffb640 1 -- 172.21.15.7:0/815539363 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc010460 con 0x7f98e4108d20 2024-09-21T05:52:43.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.336+0000 7f98ea461640 1 -- 172.21.15.7:0/815539363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e41a6ee0 con 0x7f98e4108d20 2024-09-21T05:52:43.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.337+0000 7f98ea461640 1 -- 172.21.15.7:0/815539363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e4103d10 con 0x7f98e4108d20 2024-09-21T05:52:43.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.338+0000 7f98e1ffb640 1 -- 172.21.15.7:0/815539363 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f98dc003970 con 0x7f98e4108d20 2024-09-21T05:52:43.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.339+0000 7f98e1ffb640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f98d00b6670 0x7f98d00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.339+0000 7f98e3fff640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f98d00b6670 0x7f98d00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.339+0000 7f98e1ffb640 1 -- 172.21.15.7:0/815539363 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f98dc0e71f0 con 0x7f98e4108d20 2024-09-21T05:52:43.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.339+0000 7f98e3fff640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f98d00b6670 0x7f98d00b8b80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009bd0 tx=0x7f98d4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.344+0000 7f98e1ffb640 1 -- 172.21.15.7:0/815539363 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f98dc0b1c60 con 0x7f98e4108d20 2024-09-21T05:52:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.493+0000 7f83140f1640 1 -- 172.21.15.7:0/3153284619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c104a30 msgr2=0x7f830c104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.493+0000 7f83140f1640 1 --2- 172.21.15.7:0/3153284619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c104a30 0x7f830c104e40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8308009900 tx=0x7f830802a410 comp rx=0 tx=0).stop 2024-09-21T05:52:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.493+0000 7f83140f1640 1 -- 172.21.15.7:0/3153284619 shutdown_connections 2024-09-21T05:52:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.493+0000 7f83140f1640 1 --2- 172.21.15.7:0/3153284619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f830c10de60 0x7f830c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.493+0000 7f83140f1640 1 --2- 172.21.15.7:0/3153284619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f830c105380 0x7f830c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.493+0000 7f83140f1640 1 --2- 172.21.15.7:0/3153284619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c104a30 0x7f830c104e40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.493+0000 7f83140f1640 1 -- 172.21.15.7:0/3153284619 >> 172.21.15.7:0/3153284619 conn(0x7f830c0797b0 msgr2=0x7f830c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.493+0000 7f83140f1640 1 -- 172.21.15.7:0/3153284619 shutdown_connections 2024-09-21T05:52:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.493+0000 7f83140f1640 1 -- 172.21.15.7:0/3153284619 wait complete. 2024-09-21T05:52:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.494+0000 7f83140f1640 1 Processor -- start 2024-09-21T05:52:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.494+0000 7f83140f1640 1 -- start start 2024-09-21T05:52:43.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.494+0000 7f83140f1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f830c104a30 0x7f830c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.494+0000 7f83140f1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c105380 0x7f830c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.494+0000 7f83140f1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f830c10de60 0x7f830c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.494+0000 7f83140f1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f830c113ac0 con 0x7f830c105380 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.494+0000 7f83140f1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f830c113940 con 0x7f830c104a30 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.494+0000 7f83140f1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f830c113c40 con 0x7f830c10de60 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.494+0000 7f831168c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c105380 0x7f830c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.494+0000 7f8311e8d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f830c104a30 0x7f830c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.494+0000 7f831168c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c105380 0x7f830c19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43372/0 (socket says 172.21.15.7:43372) 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.494+0000 7f831168c640 1 -- 172.21.15.7:0/2674307832 learned_addr learned my addr 172.21.15.7:0/2674307832 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.495+0000 7f831268e640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f830c10de60 0x7f830c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.495+0000 7f8311e8d640 1 -- 172.21.15.7:0/2674307832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f830c10de60 msgr2=0x7f830c19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.495+0000 7f8311e8d640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f830c10de60 0x7f830c19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.495+0000 7f8311e8d640 1 -- 172.21.15.7:0/2674307832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c105380 msgr2=0x7f830c19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.495+0000 7f8311e8d640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c105380 0x7f830c19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.495+0000 7f8311e8d640 1 -- 172.21.15.7:0/2674307832 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830c1a0480 con 0x7f830c104a30 2024-09-21T05:52:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.495+0000 7f831168c640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c105380 0x7f830c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.495+0000 7f8311e8d640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f830c104a30 0x7f830c19a510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8308006010 tx=0x7f8308004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.495+0000 7f8302ffd640 1 -- 172.21.15.7:0/2674307832 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830803f070 con 0x7f830c104a30 2024-09-21T05:52:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.495+0000 7f83140f1640 1 -- 172.21.15.7:0/2674307832 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f830c1a0710 con 0x7f830c104a30 2024-09-21T05:52:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.495+0000 7f8302ffd640 1 -- 172.21.15.7:0/2674307832 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8308003ca0 con 0x7f830c104a30 2024-09-21T05:52:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.495+0000 7f8302ffd640 1 -- 172.21.15.7:0/2674307832 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308035070 con 0x7f830c104a30 2024-09-21T05:52:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.495+0000 7f83140f1640 1 -- 172.21.15.7:0/2674307832 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f830c1a6ed0 con 0x7f830c104a30 2024-09-21T05:52:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.496+0000 7f83140f1640 1 -- 172.21.15.7:0/2674307832 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f830c104e40 con 0x7f830c104a30 2024-09-21T05:52:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.498+0000 7f8302ffd640 1 -- 172.21.15.7:0/2674307832 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f830803b460 con 0x7f830c104a30 2024-09-21T05:52:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.499+0000 7f8302ffd640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f82f80b65f0 0x7f82f80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.499+0000 7f831168c640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f82f80b65f0 0x7f82f80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.499+0000 7f8302ffd640 1 -- 172.21.15.7:0/2674307832 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f8308107cf0 con 0x7f830c104a30 2024-09-21T05:52:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.500+0000 7f831168c640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f82f80b65f0 0x7f82f80b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f830c100260 tx=0x7f82fc00b440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:43.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.503+0000 7f8302ffd640 1 -- 172.21.15.7:0/2674307832 <== mon.2 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83080d2700 con 0x7f830c104a30 2024-09-21T05:52:43.508 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.541+0000 7f98ea461640 1 -- 172.21.15.7:0/815539363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f98e410bb00 con 0x7f98e4108d20 2024-09-21T05:52:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.541+0000 7f98e1ffb640 1 -- 172.21.15.7:0/815539363 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f98dc0b6ba0 con 0x7f98e4108d20 2024-09-21T05:52:43.543 INFO:teuthology.orchestra.run.smithi007.stdout:111669149759 2024-09-21T05:52:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.543+0000 7f98ea461640 1 -- 172.21.15.7:0/815539363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f98d00b6670 msgr2=0x7f98d00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.543+0000 7f98ea461640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f98d00b6670 0x7f98d00b8b80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009bd0 tx=0x7f98d4005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.543+0000 7f98ea461640 1 -- 172.21.15.7:0/815539363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e4108d20 msgr2=0x7f98e419fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.543+0000 7f98ea461640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e4108d20 0x7f98e419fd60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f98dc009fd0 tx=0x7f98dc00b260 comp rx=0 tx=0).stop 2024-09-21T05:52:43.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.544+0000 7f98ea461640 1 -- 172.21.15.7:0/815539363 shutdown_connections 2024-09-21T05:52:43.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.544+0000 7f98ea461640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f98d00b6670 0x7f98d00b8b80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.544+0000 7f98ea461640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e4108d20 0x7f98e419fd60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.544+0000 7f98ea461640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98e41083d0 0x7f98e419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.544+0000 7f98ea461640 1 --2- 172.21.15.7:0/815539363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98e4102ae0 0x7f98e419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.544+0000 7f98ea461640 1 -- 172.21.15.7:0/815539363 >> 172.21.15.7:0/815539363 conn(0x7f98e4079790 msgr2=0x7f98e4101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:43.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.544+0000 7f98ea461640 1 -- 172.21.15.7:0/815539363 shutdown_connections 2024-09-21T05:52:43.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.544+0000 7f98ea461640 1 -- 172.21.15.7:0/815539363 wait complete. 2024-09-21T05:52:43.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.708+0000 7f83140f1640 1 -- 172.21.15.7:0/2674307832 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f830c19b640 con 0x7f830c104a30 2024-09-21T05:52:43.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.708+0000 7f8302ffd640 1 -- 172.21.15.7:0/2674307832 <== mon.2 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f83080d7640 con 0x7f830c104a30 2024-09-21T05:52:43.710 INFO:teuthology.orchestra.run.smithi007.stdout:81604378693 2024-09-21T05:52:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.710+0000 7f83140f1640 1 -- 172.21.15.7:0/2674307832 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f82f80b65f0 msgr2=0x7f82f80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.710+0000 7f83140f1640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f82f80b65f0 0x7f82f80b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f830c100260 tx=0x7f82fc00b440 comp rx=0 tx=0).stop 2024-09-21T05:52:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.710+0000 7f83140f1640 1 -- 172.21.15.7:0/2674307832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f830c104a30 msgr2=0x7f830c19a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.710+0000 7f83140f1640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f830c104a30 0x7f830c19a510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8308006010 tx=0x7f8308004060 comp rx=0 tx=0).stop 2024-09-21T05:52:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.710+0000 7f83140f1640 1 -- 172.21.15.7:0/2674307832 shutdown_connections 2024-09-21T05:52:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.710+0000 7f83140f1640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f82f80b65f0 0x7f82f80b8b00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.710+0000 7f83140f1640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f830c105380 0x7f830c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.710+0000 7f83140f1640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f830c10de60 0x7f830c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.710+0000 7f83140f1640 1 --2- 172.21.15.7:0/2674307832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f830c104a30 0x7f830c19a510 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.710+0000 7f83140f1640 1 -- 172.21.15.7:0/2674307832 >> 172.21.15.7:0/2674307832 conn(0x7f830c0797b0 msgr2=0x7f830c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.711+0000 7f83140f1640 1 -- 172.21.15.7:0/2674307832 shutdown_connections 2024-09-21T05:52:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:43.711+0000 7f83140f1640 1 -- 172.21.15.7:0/2674307832 wait complete. 2024-09-21T05:52:43.759 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:43 smithi007 ceph-mon[30983]: pgmap v283: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:52:43.759 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:43 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/815539363' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T05:52:43.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:43 smithi027 ceph-mon[34364]: pgmap v283: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:52:43.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:43 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/815539363' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T05:52:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:43 smithi119 ceph-mon[34833]: pgmap v283: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:52:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:43 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/815539363' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T05:52:44.717 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378690 got 81604378693 for osd.2 2024-09-21T05:52:44.717 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:44.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:44 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2674307832' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T05:52:44.959 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:44 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3973857242' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T05:52:44.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:44 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2674307832' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T05:52:44.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:44 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3973857242' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T05:52:45.042 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:45.042 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:45.043 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:45.043 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:45.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.061+0000 7fa4ddb79640 1 -- 172.21.15.7:0/702310703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d810a1b0 msgr2=0x7fa4d810a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:45.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.061+0000 7fa4ddb79640 1 --2- 172.21.15.7:0/702310703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d810a1b0 0x7fa4d810a5c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009900 tx=0x7fa4c802a410 comp rx=0 tx=0).stop 2024-09-21T05:52:45.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.062+0000 7fa4ddb79640 1 -- 172.21.15.7:0/702310703 shutdown_connections 2024-09-21T05:52:45.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.062+0000 7fa4ddb79640 1 --2- 172.21.15.7:0/702310703 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d8110440 0x7fa4d8116c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.062+0000 7fa4ddb79640 1 --2- 172.21.15.7:0/702310703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4d810faf0 0x7fa4d810ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.062+0000 7fa4ddb79640 1 --2- 172.21.15.7:0/702310703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d810a1b0 0x7fa4d810a5c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.062+0000 7fa4ddb79640 1 -- 172.21.15.7:0/702310703 >> 172.21.15.7:0/702310703 conn(0x7fa4d80780e0 msgr2=0x7fa4d81081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:45.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.062+0000 7fa4ddb79640 1 -- 172.21.15.7:0/702310703 shutdown_connections 2024-09-21T05:52:45.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.062+0000 7fa4ddb79640 1 -- 172.21.15.7:0/702310703 wait complete. 2024-09-21T05:52:45.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.063+0000 7fa4ddb79640 1 Processor -- start 2024-09-21T05:52:45.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.063+0000 7fa4ddb79640 1 -- start start 2024-09-21T05:52:45.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.064+0000 7fa4ddb79640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d810a1b0 0x7fa4d8074e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:45.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.064+0000 7fa4ddb79640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d810faf0 0x7fa4d806e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:45.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.064+0000 7fa4ddb79640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4d8110440 0x7fa4d806e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:45.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.064+0000 7fa4ddb79640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d811a0f0 con 0x7fa4d810a1b0 2024-09-21T05:52:45.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.064+0000 7fa4ddb79640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d8119f70 con 0x7fa4d8110440 2024-09-21T05:52:45.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.064+0000 7fa4ddb79640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d811a270 con 0x7fa4d810faf0 2024-09-21T05:52:45.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.064+0000 7fa4d7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4d8110440 0x7fa4d806e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:45.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.064+0000 7fa4d7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4d8110440 0x7fa4d806e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:44780/0 (socket says 172.21.15.7:44780) 2024-09-21T05:52:45.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.064+0000 7fa4d7fff640 1 -- 172.21.15.7:0/2573686363 learned_addr learned my addr 172.21.15.7:0/2573686363 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:45.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.064+0000 7fa4d77fe640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d810a1b0 0x7fa4d8074e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:45.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.064+0000 7fa4cffff640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d810faf0 0x7fa4d806e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:45.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.065+0000 7fa4d77fe640 1 -- 172.21.15.7:0/2573686363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d810faf0 msgr2=0x7fa4d806e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:45.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.065+0000 7fa4d77fe640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d810faf0 0x7fa4d806e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.065+0000 7fa4d77fe640 1 -- 172.21.15.7:0/2573686363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4d8110440 msgr2=0x7fa4d806e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:45.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.065+0000 7fa4d77fe640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4d8110440 0x7fa4d806e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.065+0000 7fa4d77fe640 1 -- 172.21.15.7:0/2573686363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d806ee50 con 0x7fa4d810a1b0 2024-09-21T05:52:45.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.066+0000 7fa4d77fe640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d810a1b0 0x7fa4d8074e20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8000c00 tx=0x7fa4c80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:45.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.067+0000 7fa4d57fa640 1 -- 172.21.15.7:0/2573686363 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8040070 con 0x7fa4d810a1b0 2024-09-21T05:52:45.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.067+0000 7fa4d57fa640 1 -- 172.21.15.7:0/2573686363 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4c8004b60 con 0x7fa4d810a1b0 2024-09-21T05:52:45.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.067+0000 7fa4d57fa640 1 -- 172.21.15.7:0/2573686363 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8040070 con 0x7fa4d810a1b0 2024-09-21T05:52:45.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.070+0000 7fa4ddb79640 1 -- 172.21.15.7:0/2573686363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d8073a90 con 0x7fa4d810a1b0 2024-09-21T05:52:45.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.070+0000 7fa4ddb79640 1 -- 172.21.15.7:0/2573686363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d8073f20 con 0x7fa4d810a1b0 2024-09-21T05:52:45.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.071+0000 7fa4ddb79640 1 -- 172.21.15.7:0/2573686363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d810b430 con 0x7fa4d810a1b0 2024-09-21T05:52:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.074+0000 7fa4d57fa640 1 -- 172.21.15.7:0/2573686363 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fa4c8043070 con 0x7fa4d810a1b0 2024-09-21T05:52:45.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.076+0000 7fa4d57fa640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa4c40b69f0 0x7fa4c40b8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:45.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.076+0000 7fa4d57fa640 1 -- 172.21.15.7:0/2573686363 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa4c8005020 con 0x7fa4d810a1b0 2024-09-21T05:52:45.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.077+0000 7fa4cffff640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa4c40b69f0 0x7fa4c40b8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:45.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.078+0000 7fa4cffff640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa4c40b69f0 0x7fa4c40b8f00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa4d810d770 tx=0x7fa4c0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:45.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.079+0000 7fa4d57fa640 1 -- 172.21.15.7:0/2573686363 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4c80ce960 con 0x7fa4d810a1b0 2024-09-21T05:52:45.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:44 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2674307832' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T05:52:45.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:44 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3973857242' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T05:52:45.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.281+0000 7fa4ddb79640 1 -- 172.21.15.7:0/2573686363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa4d8111cc0 con 0x7fa4d810a1b0 2024-09-21T05:52:45.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.281+0000 7fa4d57fa640 1 -- 172.21.15.7:0/2573686363 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa4c80d2d40 con 0x7fa4d810a1b0 2024-09-21T05:52:45.283 INFO:teuthology.orchestra.run.smithi007.stdout:266287972380 2024-09-21T05:52:45.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.284+0000 7fa4ddb79640 1 -- 172.21.15.7:0/2573686363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa4c40b69f0 msgr2=0x7fa4c40b8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.284+0000 7fa4ddb79640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa4c40b69f0 0x7fa4c40b8f00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa4d810d770 tx=0x7fa4c0005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.284+0000 7fa4ddb79640 1 -- 172.21.15.7:0/2573686363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d810a1b0 msgr2=0x7fa4d8074e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.284+0000 7fa4ddb79640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d810a1b0 0x7fa4d8074e20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8000c00 tx=0x7fa4c80045e0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.284+0000 7fa4ddb79640 1 -- 172.21.15.7:0/2573686363 shutdown_connections 2024-09-21T05:52:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.284+0000 7fa4ddb79640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa4c40b69f0 0x7fa4c40b8f00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.284+0000 7fa4ddb79640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4d8110440 0x7fa4d806e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.284+0000 7fa4ddb79640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d810faf0 0x7fa4d806e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.284+0000 7fa4ddb79640 1 --2- 172.21.15.7:0/2573686363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d810a1b0 0x7fa4d8074e20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.284+0000 7fa4ddb79640 1 -- 172.21.15.7:0/2573686363 >> 172.21.15.7:0/2573686363 conn(0x7fa4d80780e0 msgr2=0x7fa4d810bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.284+0000 7fa4ddb79640 1 -- 172.21.15.7:0/2573686363 shutdown_connections 2024-09-21T05:52:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:45.284+0000 7fa4ddb79640 1 -- 172.21.15.7:0/2573686363 wait complete. 2024-09-21T05:52:45.815 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:45 smithi007 ceph-mon[30983]: pgmap v284: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T05:52:45.815 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:52:45.815 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:45 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2573686363' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T05:52:45.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:45 smithi027 ceph-mon[34364]: pgmap v284: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T05:52:45.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:45 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:52:45.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:45 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2573686363' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T05:52:46.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:45 smithi119 ceph-mon[34833]: pgmap v284: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T05:52:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:45 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:52:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:45 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2573686363' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T05:52:46.203 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149756 got 111669149759 for osd.3 2024-09-21T05:52:46.203 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:46.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.047+0000 7f364e813640 1 -- 172.21.15.7:0/855886725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36481094a0 msgr2=0x7f36481098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.047+0000 7f364e813640 1 --2- 172.21.15.7:0/855886725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36481094a0 0x7f36481098b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f363c009900 tx=0x7f363c02a410 comp rx=0 tx=0).stop 2024-09-21T05:52:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.047+0000 7f364e813640 1 -- 172.21.15.7:0/855886725 shutdown_connections 2024-09-21T05:52:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.047+0000 7f364e813640 1 --2- 172.21.15.7:0/855886725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36481094a0 0x7f36481098b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.047+0000 7f364e813640 1 --2- 172.21.15.7:0/855886725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3648109df0 0x7f3648110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.047+0000 7f364e813640 1 --2- 172.21.15.7:0/855886725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3648103b60 0x7f3648103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.047+0000 7f364e813640 1 -- 172.21.15.7:0/855886725 >> 172.21.15.7:0/855886725 conn(0x7f364807b850 msgr2=0x7f364807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.047+0000 7f364e813640 1 -- 172.21.15.7:0/855886725 shutdown_connections 2024-09-21T05:52:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.047+0000 7f364e813640 1 -- 172.21.15.7:0/855886725 wait complete. 2024-09-21T05:52:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.048+0000 7f364e813640 1 Processor -- start 2024-09-21T05:52:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.048+0000 7f364e813640 1 -- start start 2024-09-21T05:52:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.048+0000 7f364e813640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3648103b60 0x7f3648074ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:46.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.048+0000 7f364e813640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36481094a0 0x7f364806e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.048+0000 7f364e813640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3648109df0 0x7f364806e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.048+0000 7f364e813640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3648113ab0 con 0x7f3648109df0 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.048+0000 7f364e813640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3648113930 con 0x7f36481094a0 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.048+0000 7f364e813640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3648113c30 con 0x7f3648103b60 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.048+0000 7f364cdb0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3648109df0 0x7f364806e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.048+0000 7f36477fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36481094a0 0x7f364806e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.048+0000 7f364cdb0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3648109df0 0x7f364806e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43394/0 (socket says 172.21.15.7:43394) 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.048+0000 7f364cdb0640 1 -- 172.21.15.7:0/3973857242 learned_addr learned my addr 172.21.15.7:0/3973857242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.049+0000 7f3647fff640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3648103b60 0x7f3648074ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.049+0000 7f364cdb0640 1 -- 172.21.15.7:0/3973857242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3648103b60 msgr2=0x7f3648074ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.049+0000 7f364cdb0640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3648103b60 0x7f3648074ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.049+0000 7f364cdb0640 1 -- 172.21.15.7:0/3973857242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36481094a0 msgr2=0x7f364806e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.049+0000 7f364cdb0640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36481094a0 0x7f364806e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.049+0000 7f364cdb0640 1 -- 172.21.15.7:0/3973857242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364806efd0 con 0x7f3648109df0 2024-09-21T05:52:46.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.049+0000 7f36477fe640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36481094a0 0x7f364806e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:46.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.049+0000 7f364cdb0640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3648109df0 0x7f364806e7b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f364000eb10 tx=0x7f364000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:46.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.049+0000 7f36457fa640 1 -- 172.21.15.7:0/3973857242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640004b20 con 0x7f3648109df0 2024-09-21T05:52:46.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.049+0000 7f364e813640 1 -- 172.21.15.7:0/3973857242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3648073c70 con 0x7f3648109df0 2024-09-21T05:52:46.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.049+0000 7f36457fa640 1 -- 172.21.15.7:0/3973857242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3640004cc0 con 0x7f3648109df0 2024-09-21T05:52:46.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.049+0000 7f36457fa640 1 -- 172.21.15.7:0/3973857242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640010690 con 0x7f3648109df0 2024-09-21T05:52:46.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.049+0000 7f364e813640 1 -- 172.21.15.7:0/3973857242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3648074180 con 0x7f3648109df0 2024-09-21T05:52:46.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.050+0000 7f364e813640 1 -- 172.21.15.7:0/3973857242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3648103f70 con 0x7f3648109df0 2024-09-21T05:52:46.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.052+0000 7f36457fa640 1 -- 172.21.15.7:0/3973857242 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f3640005000 con 0x7f3648109df0 2024-09-21T05:52:46.285 INFO:teuthology.orchestra.run.smithi007.stdout:60129542217 2024-09-21T05:52:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.053+0000 7f36457fa640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f36300b65f0 0x7f36300b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.053+0000 7f3647fff640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f36300b65f0 0x7f36300b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.053+0000 7f36457fa640 1 -- 172.21.15.7:0/3973857242 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f36400e7d20 con 0x7f3648109df0 2024-09-21T05:52:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.054+0000 7f3647fff640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f36300b65f0 0x7f36300b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3638009bd0 tx=0x7f3638005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.057+0000 7f36457fa640 1 -- 172.21.15.7:0/3973857242 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3640056710 con 0x7f3648109df0 2024-09-21T05:52:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.257+0000 7f364e813640 1 -- 172.21.15.7:0/3973857242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f364806f4b0 con 0x7f3648109df0 2024-09-21T05:52:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.257+0000 7f36457fa640 1 -- 172.21.15.7:0/3973857242 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f364806f4b0 con 0x7f3648109df0 2024-09-21T05:52:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.259+0000 7f364e813640 1 -- 172.21.15.7:0/3973857242 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f36300b65f0 msgr2=0x7f36300b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.259+0000 7f364e813640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f36300b65f0 0x7f36300b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3638009bd0 tx=0x7f3638005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:46.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.259+0000 7f364e813640 1 -- 172.21.15.7:0/3973857242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3648109df0 msgr2=0x7f364806e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.259+0000 7f364e813640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3648109df0 0x7f364806e7b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f364000eb10 tx=0x7f364000c2d0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.259+0000 7f364e813640 1 -- 172.21.15.7:0/3973857242 shutdown_connections 2024-09-21T05:52:46.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.260+0000 7f364e813640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f36300b65f0 0x7f36300b8b00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.260+0000 7f364e813640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3648109df0 0x7f364806e7b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.260+0000 7f364e813640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36481094a0 0x7f364806e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.260+0000 7f364e813640 1 --2- 172.21.15.7:0/3973857242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3648103b60 0x7f3648074ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.260+0000 7f364e813640 1 -- 172.21.15.7:0/3973857242 >> 172.21.15.7:0/3973857242 conn(0x7f364807b850 msgr2=0x7f36481075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:46.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.260+0000 7f364e813640 1 -- 172.21.15.7:0/3973857242 shutdown_connections 2024-09-21T05:52:46.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:44.260+0000 7f364e813640 1 -- 172.21.15.7:0/3973857242 wait complete. 2024-09-21T05:52:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.634+0000 7f1ab167c640 1 -- 172.21.15.7:0/1272250993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aac1062a0 msgr2=0x7f1aac1066b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.634+0000 7f1ab167c640 1 --2- 172.21.15.7:0/1272250993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aac1062a0 0x7f1aac1066b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009900 tx=0x7f1a9402a410 comp rx=0 tx=0).stop 2024-09-21T05:52:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.634+0000 7f1ab167c640 1 -- 172.21.15.7:0/1272250993 shutdown_connections 2024-09-21T05:52:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.634+0000 7f1ab167c640 1 --2- 172.21.15.7:0/1272250993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aac1062a0 0x7f1aac1066b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.634+0000 7f1ab167c640 1 --2- 172.21.15.7:0/1272250993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aac106bf0 0x7f1aac110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.634+0000 7f1ab167c640 1 --2- 172.21.15.7:0/1272250993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1aac102050 0x7f1aac102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.634+0000 7f1ab167c640 1 -- 172.21.15.7:0/1272250993 >> 172.21.15.7:0/1272250993 conn(0x7f1aac077c60 msgr2=0x7f1aac0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.634+0000 7f1ab167c640 1 -- 172.21.15.7:0/1272250993 shutdown_connections 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.634+0000 7f1ab167c640 1 -- 172.21.15.7:0/1272250993 wait complete. 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.635+0000 7f1ab167c640 1 Processor -- start 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.635+0000 7f1ab167c640 1 -- start start 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.635+0000 7f1ab167c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aac102050 0x7f1aac102ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.635+0000 7f1ab167c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aac1062a0 0x7f1aac103530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.635+0000 7f1ab167c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1aac106bf0 0x7f1aac103a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.635+0000 7f1ab167c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac113aa0 con 0x7f1aac1062a0 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.635+0000 7f1ab167c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac113920 con 0x7f1aac102050 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.635+0000 7f1ab167c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac113c20 con 0x7f1aac106bf0 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.635+0000 7f1aaa7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aac1062a0 0x7f1aac103530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.635+0000 7f1aaa7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aac1062a0 0x7f1aac103530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43434/0 (socket says 172.21.15.7:43434) 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.635+0000 7f1aaa7fc640 1 -- 172.21.15.7:0/809081044 learned_addr learned my addr 172.21.15.7:0/809081044 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.635+0000 7f1aaaffd640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aac102050 0x7f1aac102ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.635+0000 7f1aab7fe640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1aac106bf0 0x7f1aac103a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.636+0000 7f1aaa7fc640 1 -- 172.21.15.7:0/809081044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1aac106bf0 msgr2=0x7f1aac103a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.636+0000 7f1aaa7fc640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1aac106bf0 0x7f1aac103a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.636+0000 7f1aaa7fc640 1 -- 172.21.15.7:0/809081044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aac102050 msgr2=0x7f1aac102ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.636+0000 7f1aaa7fc640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aac102050 0x7f1aac102ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.636+0000 7f1aaa7fc640 1 -- 172.21.15.7:0/809081044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aac1a8730 con 0x7f1aac1062a0 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.636+0000 7f1aaa7fc640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aac1062a0 0x7f1aac103530 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1a94005940 tx=0x7f1a940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.636+0000 7f1aa3fff640 1 -- 172.21.15.7:0/809081044 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9403f030 con 0x7f1aac1062a0 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.636+0000 7f1aa3fff640 1 -- 172.21.15.7:0/809081044 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a94003cb0 con 0x7f1aac1062a0 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.636+0000 7f1ab167c640 1 -- 172.21.15.7:0/809081044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aac1a89c0 con 0x7f1aac1062a0 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.636+0000 7f1aa3fff640 1 -- 172.21.15.7:0/809081044 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a94035070 con 0x7f1aac1062a0 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.636+0000 7f1ab167c640 1 -- 172.21.15.7:0/809081044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aac1a8ef0 con 0x7f1aac1062a0 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.637+0000 7f1ab167c640 1 -- 172.21.15.7:0/809081044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aac102460 con 0x7f1aac1062a0 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.639+0000 7f1aa3fff640 1 -- 172.21.15.7:0/809081044 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f1a94042030 con 0x7f1aac1062a0 2024-09-21T05:52:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.640+0000 7f1aa3fff640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1a980b6670 0x7f1a980b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:46.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.640+0000 7f1aaaffd640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1a980b6670 0x7f1a980b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:46.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.640+0000 7f1aa3fff640 1 -- 172.21.15.7:0/809081044 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f1a94107a20 con 0x7f1aac1062a0 2024-09-21T05:52:46.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.640+0000 7f1aaaffd640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1a980b6670 0x7f1a980b8b80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1aac104a40 tx=0x7f1a9c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:46.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.644+0000 7f1aa3fff640 1 -- 172.21.15.7:0/809081044 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1a940ce0b0 con 0x7f1aac1062a0 2024-09-21T05:52:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.832+0000 7f1ab167c640 1 -- 172.21.15.7:0/809081044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f1aac02e640 con 0x7f1aac1062a0 2024-09-21T05:52:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.833+0000 7f1aa3fff640 1 -- 172.21.15.7:0/809081044 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1a940d2490 con 0x7f1aac1062a0 2024-09-21T05:52:46.836 INFO:teuthology.orchestra.run.smithi007.stdout:219043332135 2024-09-21T05:52:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.835+0000 7f1ab167c640 1 -- 172.21.15.7:0/809081044 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1a980b6670 msgr2=0x7f1a980b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.835+0000 7f1ab167c640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1a980b6670 0x7f1a980b8b80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1aac104a40 tx=0x7f1a9c00b410 comp rx=0 tx=0).stop 2024-09-21T05:52:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.835+0000 7f1ab167c640 1 -- 172.21.15.7:0/809081044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aac1062a0 msgr2=0x7f1aac103530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.835+0000 7f1ab167c640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aac1062a0 0x7f1aac103530 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1a94005940 tx=0x7f1a940042f0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.835+0000 7f1ab167c640 1 -- 172.21.15.7:0/809081044 shutdown_connections 2024-09-21T05:52:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.835+0000 7f1ab167c640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1a980b6670 0x7f1a980b8b80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.835+0000 7f1ab167c640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aac1062a0 0x7f1aac103530 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.835+0000 7f1ab167c640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1aac106bf0 0x7f1aac103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.835+0000 7f1ab167c640 1 --2- 172.21.15.7:0/809081044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1aac102050 0x7f1aac102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.835+0000 7f1ab167c640 1 -- 172.21.15.7:0/809081044 >> 172.21.15.7:0/809081044 conn(0x7f1aac077c60 msgr2=0x7f1aac105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.835+0000 7f1ab167c640 1 -- 172.21.15.7:0/809081044 shutdown_connections 2024-09-21T05:52:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:46.835+0000 7f1ab167c640 1 -- 172.21.15.7:0/809081044 wait complete. 2024-09-21T05:52:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.127+0000 7f5e2961d640 1 -- 172.21.15.7:0/1034457593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e241083d0 msgr2=0x7f5e241087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.127+0000 7f5e2961d640 1 --2- 172.21.15.7:0/1034457593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e241083d0 0x7f5e241087e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009900 tx=0x7f5e1802a410 comp rx=0 tx=0).stop 2024-09-21T05:52:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.127+0000 7f5e2961d640 1 -- 172.21.15.7:0/1034457593 shutdown_connections 2024-09-21T05:52:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.127+0000 7f5e2961d640 1 --2- 172.21.15.7:0/1034457593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e241083d0 0x7f5e241087e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.127+0000 7f5e2961d640 1 --2- 172.21.15.7:0/1034457593 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e24108d20 0x7f5e2410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.127+0000 7f5e2961d640 1 --2- 172.21.15.7:0/1034457593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e24102ae0 0x7f5e24102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.127+0000 7f5e2961d640 1 -- 172.21.15.7:0/1034457593 >> 172.21.15.7:0/1034457593 conn(0x7f5e24079760 msgr2=0x7f5e24079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.127+0000 7f5e2961d640 1 -- 172.21.15.7:0/1034457593 shutdown_connections 2024-09-21T05:52:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.127+0000 7f5e2961d640 1 -- 172.21.15.7:0/1034457593 wait complete. 2024-09-21T05:52:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.128+0000 7f5e2961d640 1 Processor -- start 2024-09-21T05:52:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.128+0000 7f5e2961d640 1 -- start start 2024-09-21T05:52:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.128+0000 7f5e2961d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e24102ae0 0x7f5e2419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.128+0000 7f5e2961d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e241083d0 0x7f5e2419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.128+0000 7f5e2961d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e24108d20 0x7f5e241a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.128+0000 7f5e2961d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5e24112990 con 0x7f5e241083d0 2024-09-21T05:52:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.128+0000 7f5e2961d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5e24112810 con 0x7f5e24108d20 2024-09-21T05:52:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.128+0000 7f5e2961d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5e24112b10 con 0x7f5e24102ae0 2024-09-21T05:52:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.128+0000 7f5e227fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e241083d0 0x7f5e2419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.128+0000 7f5e227fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e241083d0 0x7f5e2419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43466/0 (socket says 172.21.15.7:43466) 2024-09-21T05:52:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.128+0000 7f5e227fc640 1 -- 172.21.15.7:0/1168671354 learned_addr learned my addr 172.21.15.7:0/1168671354 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.128+0000 7f5e237fe640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e24108d20 0x7f5e241a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.129+0000 7f5e22ffd640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e24102ae0 0x7f5e2419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.129+0000 7f5e227fc640 1 -- 172.21.15.7:0/1168671354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e24102ae0 msgr2=0x7f5e2419c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.129+0000 7f5e227fc640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e24102ae0 0x7f5e2419c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.129+0000 7f5e227fc640 1 -- 172.21.15.7:0/1168671354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e24108d20 msgr2=0x7f5e241a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.129+0000 7f5e227fc640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e24108d20 0x7f5e241a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.129+0000 7f5e227fc640 1 -- 172.21.15.7:0/1168671354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e241a2610 con 0x7f5e241083d0 2024-09-21T05:52:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.129+0000 7f5e237fe640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e24108d20 0x7f5e241a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.129+0000 7f5e227fc640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e241083d0 0x7f5e2419cc40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5e18032fd0 tx=0x7f5e18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.129+0000 7f5e0bfff640 1 -- 172.21.15.7:0/1168671354 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1803f030 con 0x7f5e241083d0 2024-09-21T05:52:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.129+0000 7f5e0bfff640 1 -- 172.21.15.7:0/1168671354 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e18004490 con 0x7f5e241083d0 2024-09-21T05:52:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.129+0000 7f5e2961d640 1 -- 172.21.15.7:0/1168671354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e241a28a0 con 0x7f5e241083d0 2024-09-21T05:52:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.129+0000 7f5e0bfff640 1 -- 172.21.15.7:0/1168671354 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18035070 con 0x7f5e241083d0 2024-09-21T05:52:47.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.129+0000 7f5e2961d640 1 -- 172.21.15.7:0/1168671354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e241a9060 con 0x7f5e241083d0 2024-09-21T05:52:47.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.130+0000 7f5e2961d640 1 -- 172.21.15.7:0/1168671354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e24103d10 con 0x7f5e241083d0 2024-09-21T05:52:47.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.132+0000 7f5e0bfff640 1 -- 172.21.15.7:0/1168671354 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f5e18042030 con 0x7f5e241083d0 2024-09-21T05:52:47.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.133+0000 7f5e0bfff640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5e0c0b6670 0x7f5e0c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:47.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.133+0000 7f5e22ffd640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5e0c0b6670 0x7f5e0c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:47.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.133+0000 7f5e0bfff640 1 -- 172.21.15.7:0/1168671354 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f5e18107e60 con 0x7f5e241083d0 2024-09-21T05:52:47.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.133+0000 7f5e22ffd640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5e0c0b6670 0x7f5e0c0b8b80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5e14005fd0 tx=0x7f5e1400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:47.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.136+0000 7f5e0bfff640 1 -- 172.21.15.7:0/1168671354 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e180ce4f0 con 0x7f5e241083d0 2024-09-21T05:52:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.320+0000 7f96f06ff640 1 -- 172.21.15.7:0/1247612602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96e8108d10 msgr2=0x7f96e810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.320+0000 7f96f06ff640 1 --2- 172.21.15.7:0/1247612602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96e8108d10 0x7f96e810f540 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009ca0 tx=0x7f96e002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.320+0000 7f96f06ff640 1 -- 172.21.15.7:0/1247612602 shutdown_connections 2024-09-21T05:52:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.320+0000 7f96f06ff640 1 --2- 172.21.15.7:0/1247612602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96e8108d10 0x7f96e810f540 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.320+0000 7f96f06ff640 1 --2- 172.21.15.7:0/1247612602 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e81083c0 0x7f96e81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.320+0000 7f96f06ff640 1 --2- 172.21.15.7:0/1247612602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e8102a80 0x7f96e8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.320+0000 7f96f06ff640 1 -- 172.21.15.7:0/1247612602 >> 172.21.15.7:0/1247612602 conn(0x7f96e8079740 msgr2=0x7f96e8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.320+0000 7f96f06ff640 1 -- 172.21.15.7:0/1247612602 shutdown_connections 2024-09-21T05:52:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.320+0000 7f96f06ff640 1 -- 172.21.15.7:0/1247612602 wait complete. 2024-09-21T05:52:47.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.320+0000 7f96f06ff640 1 Processor -- start 2024-09-21T05:52:47.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96f06ff640 1 -- start start 2024-09-21T05:52:47.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96f06ff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e8102a80 0x7f96e819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96f06ff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96e81083c0 0x7f96e819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96f06ff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e8108d10 0x7f96e819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96f06ff640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96e806c230 con 0x7f96e81083c0 2024-09-21T05:52:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96f06ff640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f96e806c0b0 con 0x7f96e8102a80 2024-09-21T05:52:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96f06ff640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96e806c3b0 con 0x7f96e8108d10 2024-09-21T05:52:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96edc9a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96e81083c0 0x7f96e819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96edc9a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96e81083c0 0x7f96e819a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43498/0 (socket says 172.21.15.7:43498) 2024-09-21T05:52:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96edc9a640 1 -- 172.21.15.7:0/1138851922 learned_addr learned my addr 172.21.15.7:0/1138851922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96ee49b640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e8102a80 0x7f96e819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96eec9c640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e8108d10 0x7f96e819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96edc9a640 1 -- 172.21.15.7:0/1138851922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e8108d10 msgr2=0x7f96e819fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96edc9a640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e8108d10 0x7f96e819fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96edc9a640 1 -- 172.21.15.7:0/1138851922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e8102a80 msgr2=0x7f96e819a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96edc9a640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e8102a80 0x7f96e819a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.321+0000 7f96edc9a640 1 -- 172.21.15.7:0/1138851922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e81a0350 con 0x7f96e81083c0 2024-09-21T05:52:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.322+0000 7f96edc9a640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96e81083c0 0x7f96e819a980 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f96d800e9c0 tx=0x7f96d800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.322+0000 7f96df7fe640 1 -- 172.21.15.7:0/1138851922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d800cd80 con 0x7f96e81083c0 2024-09-21T05:52:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.322+0000 7f96f06ff640 1 -- 172.21.15.7:0/1138851922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e81a0640 con 0x7f96e81083c0 2024-09-21T05:52:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.322+0000 7f96df7fe640 1 -- 172.21.15.7:0/1138851922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96d80054d0 con 0x7f96e81083c0 2024-09-21T05:52:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.322+0000 7f96df7fe640 1 -- 172.21.15.7:0/1138851922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8010430 con 0x7f96e81083c0 2024-09-21T05:52:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.322+0000 7f96f06ff640 1 -- 172.21.15.7:0/1138851922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e81a6da0 con 0x7f96e81083c0 2024-09-21T05:52:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.323+0000 7f96f06ff640 1 -- 172.21.15.7:0/1138851922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e8102e90 con 0x7f96e81083c0 2024-09-21T05:52:47.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.325+0000 7f96df7fe640 1 -- 172.21.15.7:0/1138851922 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f96d8004fb0 con 0x7f96e81083c0 2024-09-21T05:52:47.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.326+0000 7f96df7fe640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96d40b65f0 0x7f96d40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:47.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.326+0000 7f96ee49b640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96d40b65f0 0x7f96d40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:47.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.326+0000 7f96df7fe640 1 -- 172.21.15.7:0/1138851922 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f96d80e7c80 con 0x7f96e81083c0 2024-09-21T05:52:47.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.326+0000 7f96ee49b640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96d40b65f0 0x7f96d40b8b00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f96e400bbe0 tx=0x7f96e400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:47.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.329+0000 7f96df7fe640 1 -- 172.21.15.7:0/1138851922 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f96d8056710 con 0x7f96e81083c0 2024-09-21T05:52:47.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:47.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:47.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:47.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:47.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:47 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/809081044' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T05:52:47.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.329+0000 7f5e2961d640 1 -- 172.21.15.7:0/1168671354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f5e24102ef0 con 0x7f5e241083d0 2024-09-21T05:52:47.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.330+0000 7f5e0bfff640 1 -- 172.21.15.7:0/1168671354 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5e24102ef0 con 0x7f5e241083d0 2024-09-21T05:52:47.333 INFO:teuthology.orchestra.run.smithi007.stdout:287762808856 2024-09-21T05:52:47.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.332+0000 7f5e2961d640 1 -- 172.21.15.7:0/1168671354 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5e0c0b6670 msgr2=0x7f5e0c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.332+0000 7f5e2961d640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5e0c0b6670 0x7f5e0c0b8b80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5e14005fd0 tx=0x7f5e1400b390 comp rx=0 tx=0).stop 2024-09-21T05:52:47.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.332+0000 7f5e2961d640 1 -- 172.21.15.7:0/1168671354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e241083d0 msgr2=0x7f5e2419cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.332+0000 7f5e2961d640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e241083d0 0x7f5e2419cc40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5e18032fd0 tx=0x7f5e18004270 comp rx=0 tx=0).stop 2024-09-21T05:52:47.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.332+0000 7f5e2961d640 1 -- 172.21.15.7:0/1168671354 shutdown_connections 2024-09-21T05:52:47.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.332+0000 7f5e2961d640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5e0c0b6670 0x7f5e0c0b8b80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.332+0000 7f5e2961d640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e241083d0 0x7f5e2419cc40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.332+0000 7f5e2961d640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e24108d20 0x7f5e241a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.332+0000 7f5e2961d640 1 --2- 172.21.15.7:0/1168671354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e24102ae0 0x7f5e2419c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.332+0000 7f5e2961d640 1 -- 172.21.15.7:0/1168671354 >> 172.21.15.7:0/1168671354 conn(0x7f5e24079760 msgr2=0x7f5e241044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:47.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.332+0000 7f5e2961d640 1 -- 172.21.15.7:0/1168671354 shutdown_connections 2024-09-21T05:52:47.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.332+0000 7f5e2961d640 1 -- 172.21.15.7:0/1168671354 wait complete. 2024-09-21T05:52:47.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:47 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:47.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:47 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/809081044' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T05:52:47.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:47.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:47 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:47.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:47 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/809081044' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T05:52:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.525+0000 7ffad40fa640 1 -- 172.21.15.7:0/3064181686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffacc1083a0 msgr2=0x7ffacc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.525+0000 7ffad40fa640 1 --2- 172.21.15.7:0/3064181686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffacc1083a0 0x7ffacc1087b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009900 tx=0x7ffabc02a410 comp rx=0 tx=0).stop 2024-09-21T05:52:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.525+0000 7ffad40fa640 1 -- 172.21.15.7:0/3064181686 shutdown_connections 2024-09-21T05:52:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.525+0000 7ffad40fa640 1 --2- 172.21.15.7:0/3064181686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffacc1083a0 0x7ffacc1087b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.525+0000 7ffad40fa640 1 --2- 172.21.15.7:0/3064181686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffacc108cf0 0x7ffacc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.525+0000 7ffad40fa640 1 --2- 172.21.15.7:0/3064181686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffacc102a60 0x7ffacc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.525+0000 7ffad40fa640 1 -- 172.21.15.7:0/3064181686 >> 172.21.15.7:0/3064181686 conn(0x7ffacc079730 msgr2=0x7ffacc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.525+0000 7ffad40fa640 1 -- 172.21.15.7:0/3064181686 shutdown_connections 2024-09-21T05:52:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.525+0000 7ffad40fa640 1 -- 172.21.15.7:0/3064181686 wait complete. 2024-09-21T05:52:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.525+0000 7ffad40fa640 1 Processor -- start 2024-09-21T05:52:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad40fa640 1 -- start start 2024-09-21T05:52:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad40fa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffacc102a60 0x7ffacc06b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad40fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffacc1083a0 0x7ffacc06b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad40fa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffacc108cf0 0x7ffacc19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad40fa640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc112960 con 0x7ffacc102a60 2024-09-21T05:52:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad40fa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc1127e0 con 0x7ffacc108cf0 2024-09-21T05:52:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad40fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc112ae0 con 0x7ffacc1083a0 2024-09-21T05:52:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad1e96640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffacc102a60 0x7ffacc06b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad1e96640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffacc102a60 0x7ffacc06b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43510/0 (socket says 172.21.15.7:43510) 2024-09-21T05:52:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad1e96640 1 -- 172.21.15.7:0/1771486922 learned_addr learned my addr 172.21.15.7:0/1771486922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad2697640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffacc108cf0 0x7ffacc19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad1695640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffacc1083a0 0x7ffacc06b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad1e96640 1 -- 172.21.15.7:0/1771486922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffacc1083a0 msgr2=0x7ffacc06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad1e96640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffacc1083a0 0x7ffacc06b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad1e96640 1 -- 172.21.15.7:0/1771486922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffacc108cf0 msgr2=0x7ffacc19fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7f96f06ff640 1 -- 172.21.15.7:0/1138851922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f96e819b510 con 0x7f96e81083c0 2024-09-21T05:52:47.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad1e96640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffacc108cf0 0x7ffacc19fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad1e96640 1 -- 172.21.15.7:0/1771486922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc1a0500 con 0x7ffacc102a60 2024-09-21T05:52:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.526+0000 7ffad1695640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffacc1083a0 0x7ffacc06b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.527+0000 7ffad1e96640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffacc102a60 0x7ffacc06b130 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffac800e9f0 tx=0x7ffac800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.527+0000 7ffac2ffd640 1 -- 172.21.15.7:0/1771486922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac800cd80 con 0x7ffacc102a60 2024-09-21T05:52:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.527+0000 7ffac2ffd640 1 -- 172.21.15.7:0/1771486922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffac80108e0 con 0x7ffacc102a60 2024-09-21T05:52:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.527+0000 7ffad40fa640 1 -- 172.21.15.7:0/1771486922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffacc1a07f0 con 0x7ffacc102a60 2024-09-21T05:52:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.527+0000 7ffac2ffd640 1 -- 172.21.15.7:0/1771486922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac8018980 con 0x7ffacc102a60 2024-09-21T05:52:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.527+0000 7f96df7fe640 1 -- 172.21.15.7:0/1138851922 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f96e819b510 con 0x7f96e81083c0 2024-09-21T05:52:47.534 INFO:teuthology.orchestra.run.smithi007.stdout:193273528364 2024-09-21T05:52:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.528+0000 7ffad40fa640 1 -- 172.21.15.7:0/1771486922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffacc1a6f50 con 0x7ffacc102a60 2024-09-21T05:52:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.529+0000 7ffad40fa640 1 -- 172.21.15.7:0/1771486922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffacc103ce0 con 0x7ffacc102a60 2024-09-21T05:52:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.529+0000 7f96f06ff640 1 -- 172.21.15.7:0/1138851922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96d40b65f0 msgr2=0x7f96d40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.529+0000 7f96f06ff640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96d40b65f0 0x7f96d40b8b00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f96e400bbe0 tx=0x7f96e400b390 comp rx=0 tx=0).stop 2024-09-21T05:52:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.529+0000 7f96f06ff640 1 -- 172.21.15.7:0/1138851922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96e81083c0 msgr2=0x7f96e819a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.529+0000 7f96f06ff640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96e81083c0 0x7f96e819a980 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f96d800e9c0 tx=0x7f96d800ee80 comp rx=0 tx=0).stop 2024-09-21T05:52:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.529+0000 7f96f06ff640 1 -- 172.21.15.7:0/1138851922 shutdown_connections 2024-09-21T05:52:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.529+0000 7f96f06ff640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96d40b65f0 0x7f96d40b8b00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.529+0000 7f96f06ff640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96e81083c0 0x7f96e819a980 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.530+0000 7f96f06ff640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96e8108d10 0x7f96e819fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.530+0000 7f96f06ff640 1 --2- 172.21.15.7:0/1138851922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e8102a80 0x7f96e819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.530+0000 7f96f06ff640 1 -- 172.21.15.7:0/1138851922 >> 172.21.15.7:0/1138851922 conn(0x7f96e8079740 msgr2=0x7f96e8104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.530+0000 7f96f06ff640 1 -- 172.21.15.7:0/1138851922 shutdown_connections 2024-09-21T05:52:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.530+0000 7f96f06ff640 1 -- 172.21.15.7:0/1138851922 wait complete. 2024-09-21T05:52:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.532+0000 7ffac2ffd640 1 -- 172.21.15.7:0/1771486922 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7ffac8010430 con 0x7ffacc102a60 2024-09-21T05:52:47.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.533+0000 7ffac2ffd640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ffab80b65f0 0x7ffab80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:47.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.533+0000 7ffad1695640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ffab80b65f0 0x7ffab80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:47.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.533+0000 7ffac2ffd640 1 -- 172.21.15.7:0/1771486922 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7ffac80e7e30 con 0x7ffacc102a60 2024-09-21T05:52:47.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.534+0000 7ffad1695640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ffab80b65f0 0x7ffab80b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffabc000c00 tx=0x7ffabc032cc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:47.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.536+0000 7ffac2ffd640 1 -- 172.21.15.7:0/1771486922 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffac80ae4c0 con 0x7ffacc102a60 2024-09-21T05:52:47.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.737+0000 7ffad40fa640 1 -- 172.21.15.7:0/1771486922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7ffacc10aac0 con 0x7ffacc102a60 2024-09-21T05:52:47.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.737+0000 7ffac2ffd640 1 -- 172.21.15.7:0/1771486922 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ffac80b28a0 con 0x7ffacc102a60 2024-09-21T05:52:47.740 INFO:teuthology.orchestra.run.smithi007.stdout:240518168610 2024-09-21T05:52:47.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.740+0000 7ffad40fa640 1 -- 172.21.15.7:0/1771486922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ffab80b65f0 msgr2=0x7ffab80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.740+0000 7ffad40fa640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ffab80b65f0 0x7ffab80b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffabc000c00 tx=0x7ffabc032cc0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.740+0000 7ffad40fa640 1 -- 172.21.15.7:0/1771486922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffacc102a60 msgr2=0x7ffacc06b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:47.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.740+0000 7ffad40fa640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffacc102a60 0x7ffacc06b130 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffac800e9f0 tx=0x7ffac800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.740+0000 7ffad40fa640 1 -- 172.21.15.7:0/1771486922 shutdown_connections 2024-09-21T05:52:47.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.740+0000 7ffad40fa640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ffab80b65f0 0x7ffab80b8b00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.740+0000 7ffad40fa640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffacc108cf0 0x7ffacc19fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.740+0000 7ffad40fa640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffacc1083a0 0x7ffacc06b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.740+0000 7ffad40fa640 1 --2- 172.21.15.7:0/1771486922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffacc102a60 0x7ffacc06b130 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:47.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.740+0000 7ffad40fa640 1 -- 172.21.15.7:0/1771486922 >> 172.21.15.7:0/1771486922 conn(0x7ffacc079730 msgr2=0x7ffacc1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:47.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.740+0000 7ffad40fa640 1 -- 172.21.15.7:0/1771486922 shutdown_connections 2024-09-21T05:52:47.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:47.740+0000 7ffad40fa640 1 -- 172.21.15.7:0/1771486922 wait complete. 2024-09-21T05:52:48.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:48 smithi007 ceph-mon[30983]: pgmap v285: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:52:48.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:48 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1168671354' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T05:52:48.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:48 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1138851922' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T05:52:48.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:48 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1771486922' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T05:52:48.335 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542215 got 60129542217 for osd.1 2024-09-21T05:52:48.335 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:48.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:48 smithi027 ceph-mon[34364]: pgmap v285: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:52:48.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:48 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1168671354' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T05:52:48.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:48 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1138851922' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T05:52:48.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:48 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1771486922' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T05:52:48.542 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:48.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:48 smithi119 ceph-mon[34833]: pgmap v285: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:52:48.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:48 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1168671354' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T05:52:48.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:48 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1138851922' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T05:52:48.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:48 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1771486922' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T05:52:48.944 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972378 got 266287972380 for osd.10 2024-09-21T05:52:48.944 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:49.813 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168608 got 240518168610 for osd.9 2024-09-21T05:52:49.813 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:50.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:50 smithi027 ceph-mon[34364]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T05:52:50.481 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:50 smithi007 ceph-mon[30983]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T05:52:50.519 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332132 got 219043332135 for osd.8 2024-09-21T05:52:50.519 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:50.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:50 smithi119 ceph-mon[34833]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T05:52:50.921 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528362 got 193273528364 for osd.7 2024-09-21T05:52:50.921 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.101+0000 7f84a0808640 1 -- 172.21.15.7:0/1453987531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c108d70 msgr2=0x7f849c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.101+0000 7f84a0808640 1 --2- 172.21.15.7:0/1453987531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c108d70 0x7f849c10f5a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8494009ca0 tx=0x7f849402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.101+0000 7f84a0808640 1 -- 172.21.15.7:0/1453987531 shutdown_connections 2024-09-21T05:52:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.101+0000 7f84a0808640 1 --2- 172.21.15.7:0/1453987531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c108d70 0x7f849c10f5a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.101+0000 7f84a0808640 1 --2- 172.21.15.7:0/1453987531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f849c108420 0x7f849c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.101+0000 7f84a0808640 1 --2- 172.21.15.7:0/1453987531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f849c102ae0 0x7f849c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.101+0000 7f84a0808640 1 -- 172.21.15.7:0/1453987531 >> 172.21.15.7:0/1453987531 conn(0x7f849c0796b0 msgr2=0x7f849c079ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.101+0000 7f84a0808640 1 -- 172.21.15.7:0/1453987531 shutdown_connections 2024-09-21T05:52:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.101+0000 7f84a0808640 1 -- 172.21.15.7:0/1453987531 wait complete. 2024-09-21T05:52:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.102+0000 7f84a0808640 1 Processor -- start 2024-09-21T05:52:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.102+0000 7f84a0808640 1 -- start start 2024-09-21T05:52:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.102+0000 7f84a0808640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f849c102ae0 0x7f849c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.102+0000 7f84a0808640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c108420 0x7f849c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.102+0000 7f84a0808640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f849c108d70 0x7f849c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.102+0000 7f84a0808640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f849c113b40 con 0x7f849c108420 2024-09-21T05:52:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.102+0000 7f84a0808640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f849c1139c0 con 0x7f849c108d70 2024-09-21T05:52:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.102+0000 7f84a0808640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f849c113cc0 con 0x7f849c102ae0 2024-09-21T05:52:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.102+0000 7f8493fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c108420 0x7f849c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.102+0000 7f8493fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c108420 0x7f849c19aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49464/0 (socket says 172.21.15.7:49464) 2024-09-21T05:52:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.102+0000 7f8493fff640 1 -- 172.21.15.7:0/2781386323 learned_addr learned my addr 172.21.15.7:0/2781386323 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.103+0000 7f849ad9d640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f849c108d70 0x7f849c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.103+0000 7f849a59c640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f849c102ae0 0x7f849c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.103+0000 7f8493fff640 1 -- 172.21.15.7:0/2781386323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f849c102ae0 msgr2=0x7f849c19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.103+0000 7f8493fff640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f849c102ae0 0x7f849c19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.103+0000 7f8493fff640 1 -- 172.21.15.7:0/2781386323 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f849c108d70 msgr2=0x7f849c19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.103+0000 7f8493fff640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f849c108d70 0x7f849c19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.103+0000 7f8493fff640 1 -- 172.21.15.7:0/2781386323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c1a0460 con 0x7f849c108420 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.103+0000 7f8493fff640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c108420 0x7f849c19aa90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f848400e9c0 tx=0x7f848400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.103+0000 7f84937fe640 1 -- 172.21.15.7:0/2781386323 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848400ccc0 con 0x7f849c108420 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.103+0000 7f84937fe640 1 -- 172.21.15.7:0/2781386323 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84840054d0 con 0x7f849c108420 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.103+0000 7f84a0808640 1 -- 172.21.15.7:0/2781386323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849c1a0750 con 0x7f849c108420 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.103+0000 7f84937fe640 1 -- 172.21.15.7:0/2781386323 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484010430 con 0x7f849c108420 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.103+0000 7f84a0808640 1 -- 172.21.15.7:0/2781386323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849c1a6eb0 con 0x7f849c108420 2024-09-21T05:52:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.105+0000 7f84a0808640 1 -- 172.21.15.7:0/2781386323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f849c103d60 con 0x7f849c108420 2024-09-21T05:52:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.106+0000 7f84937fe640 1 -- 172.21.15.7:0/2781386323 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f8484005000 con 0x7f849c108420 2024-09-21T05:52:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.107+0000 7f84937fe640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f84880b65f0 0x7f84880b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.107+0000 7f849a59c640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f84880b65f0 0x7f84880b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.107+0000 7f84937fe640 1 -- 172.21.15.7:0/2781386323 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f84840e7ad0 con 0x7f849c108420 2024-09-21T05:52:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.108+0000 7f849a59c640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f84880b65f0 0x7f84880b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f848c009bd0 tx=0x7f848c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.110+0000 7f84937fe640 1 -- 172.21.15.7:0/2781386323 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8484056710 con 0x7f849c108420 2024-09-21T05:52:51.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.307+0000 7f84a0808640 1 -- 172.21.15.7:0/2781386323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f849c19b620 con 0x7f849c108420 2024-09-21T05:52:51.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.308+0000 7f84937fe640 1 -- 172.21.15.7:0/2781386323 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f849c19b620 con 0x7f849c108420 2024-09-21T05:52:51.313 INFO:teuthology.orchestra.run.smithi007.stdout:38654705744 2024-09-21T05:52:51.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.310+0000 7f84a0808640 1 -- 172.21.15.7:0/2781386323 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f84880b65f0 msgr2=0x7f84880b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.310+0000 7f84a0808640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f84880b65f0 0x7f84880b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f848c009bd0 tx=0x7f848c005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:51.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.310+0000 7f84a0808640 1 -- 172.21.15.7:0/2781386323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c108420 msgr2=0x7f849c19aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:51.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.310+0000 7f84a0808640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c108420 0x7f849c19aa90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f848400e9c0 tx=0x7f848400ee80 comp rx=0 tx=0).stop 2024-09-21T05:52:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.310+0000 7f84a0808640 1 -- 172.21.15.7:0/2781386323 shutdown_connections 2024-09-21T05:52:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.310+0000 7f84a0808640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f84880b65f0 0x7f84880b8b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.310+0000 7f84a0808640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c108420 0x7f849c19aa90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.310+0000 7f84a0808640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f849c108d70 0x7f849c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.310+0000 7f84a0808640 1 --2- 172.21.15.7:0/2781386323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f849c102ae0 0x7f849c19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.310+0000 7f84a0808640 1 -- 172.21.15.7:0/2781386323 >> 172.21.15.7:0/2781386323 conn(0x7f849c0796b0 msgr2=0x7f849c106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.310+0000 7f84a0808640 1 -- 172.21.15.7:0/2781386323 shutdown_connections 2024-09-21T05:52:51.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:51.310+0000 7f84a0808640 1 -- 172.21.15.7:0/2781386323 wait complete. 2024-09-21T05:52:51.658 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808854 got 287762808856 for osd.11 2024-09-21T05:52:51.659 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:52.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:52 smithi007 ceph-mon[30983]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:52:52.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:52 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2781386323' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T05:52:52.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:52 smithi027 ceph-mon[34364]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:52:52.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:52 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2781386323' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T05:52:52.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:52 smithi119 ceph-mon[34833]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:52:52.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:52 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2781386323' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T05:52:52.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.680+0000 7f27133fe640 1 -- 172.21.15.7:0/2068522194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270c10ded0 msgr2=0x7f270c110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:52.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.680+0000 7f27133fe640 1 --2- 172.21.15.7:0/2068522194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270c10ded0 0x7f270c110330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2704009ca0 tx=0x7f270402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:52.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.681+0000 7f27133fe640 1 -- 172.21.15.7:0/2068522194 shutdown_connections 2024-09-21T05:52:52.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.681+0000 7f27133fe640 1 --2- 172.21.15.7:0/2068522194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270c10ded0 0x7f270c110330 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:52.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.681+0000 7f27133fe640 1 --2- 172.21.15.7:0/2068522194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f270c105270 0x7f270c10d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:52.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.681+0000 7f27133fe640 1 --2- 172.21.15.7:0/2068522194 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f270c104920 0x7f270c104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:52.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.681+0000 7f27133fe640 1 -- 172.21.15.7:0/2068522194 >> 172.21.15.7:0/2068522194 conn(0x7f270c079790 msgr2=0x7f270c079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:52.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.681+0000 7f27133fe640 1 -- 172.21.15.7:0/2068522194 shutdown_connections 2024-09-21T05:52:52.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.681+0000 7f27133fe640 1 -- 172.21.15.7:0/2068522194 wait complete. 2024-09-21T05:52:52.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.681+0000 7f27133fe640 1 Processor -- start 2024-09-21T05:52:52.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.681+0000 7f27133fe640 1 -- start start 2024-09-21T05:52:52.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f27133fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f270c104920 0x7f270c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:52.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f27133fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270c105270 0x7f270c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:52.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f27133fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f270c10ded0 0x7f270c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:52.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f27133fe640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f270c113ac0 con 0x7f270c105270 2024-09-21T05:52:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f27133fe640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f270c113940 con 0x7f270c10ded0 2024-09-21T05:52:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f27133fe640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f270c113c40 con 0x7f270c104920 2024-09-21T05:52:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f2710999640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270c105270 0x7f270c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f2710999640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270c105270 0x7f270c19aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49480/0 (socket says 172.21.15.7:49480) 2024-09-21T05:52:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f2710999640 1 -- 172.21.15.7:0/1284476682 learned_addr learned my addr 172.21.15.7:0/1284476682 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f271199b640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f270c10ded0 0x7f270c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f271119a640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f270c104920 0x7f270c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f2710999640 1 -- 172.21.15.7:0/1284476682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f270c104920 msgr2=0x7f270c19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f2710999640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f270c104920 0x7f270c19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f2710999640 1 -- 172.21.15.7:0/1284476682 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f270c10ded0 msgr2=0x7f270c19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f2710999640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f270c10ded0 0x7f270c19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f2710999640 1 -- 172.21.15.7:0/1284476682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270c1a0400 con 0x7f270c105270 2024-09-21T05:52:52.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f271119a640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f270c104920 0x7f270c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:52:52.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.682+0000 7f2710999640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270c105270 0x7f270c19aa30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00d750 tx=0x7f26fc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:52.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.683+0000 7f27027fc640 1 -- 172.21.15.7:0/1284476682 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc017070 con 0x7f270c105270 2024-09-21T05:52:52.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.683+0000 7f27027fc640 1 -- 172.21.15.7:0/1284476682 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26fc0054d0 con 0x7f270c105270 2024-09-21T05:52:52.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.683+0000 7f27027fc640 1 -- 172.21.15.7:0/1284476682 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc004c30 con 0x7f270c105270 2024-09-21T05:52:52.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.683+0000 7f27133fe640 1 -- 172.21.15.7:0/1284476682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f270c1a06f0 con 0x7f270c105270 2024-09-21T05:52:52.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.683+0000 7f27133fe640 1 -- 172.21.15.7:0/1284476682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f270c1a6e50 con 0x7f270c105270 2024-09-21T05:52:52.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.684+0000 7f27133fe640 1 -- 172.21.15.7:0/1284476682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f270c104d30 con 0x7f270c105270 2024-09-21T05:52:52.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.686+0000 7f27027fc640 1 -- 172.21.15.7:0/1284476682 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f26fc004dd0 con 0x7f270c105270 2024-09-21T05:52:52.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.686+0000 7f27027fc640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26f80b6670 0x7f26f80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:52.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.687+0000 7f271119a640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26f80b6670 0x7f26f80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:52.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.687+0000 7f27027fc640 1 -- 172.21.15.7:0/1284476682 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f26fc0e7360 con 0x7f270c105270 2024-09-21T05:52:52.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.687+0000 7f271119a640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26f80b6670 0x7f26f80b8b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2708009b50 tx=0x7f2708005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:52.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.690+0000 7f27027fc640 1 -- 172.21.15.7:0/1284476682 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26fc0ada70 con 0x7f270c105270 2024-09-21T05:52:52.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.883+0000 7f27133fe640 1 -- 172.21.15.7:0/1284476682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f270c19b5c0 con 0x7f270c105270 2024-09-21T05:52:52.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.884+0000 7f27027fc640 1 -- 172.21.15.7:0/1284476682 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f270c19b5c0 con 0x7f270c105270 2024-09-21T05:52:52.887 INFO:teuthology.orchestra.run.smithi007.stdout:171798691890 2024-09-21T05:52:52.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.886+0000 7f27133fe640 1 -- 172.21.15.7:0/1284476682 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26f80b6670 msgr2=0x7f26f80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:52.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.886+0000 7f27133fe640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26f80b6670 0x7f26f80b8b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2708009b50 tx=0x7f2708005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:52.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.886+0000 7f27133fe640 1 -- 172.21.15.7:0/1284476682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270c105270 msgr2=0x7f270c19aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:52.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.886+0000 7f27133fe640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270c105270 0x7f270c19aa30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00d750 tx=0x7f26fc00dc10 comp rx=0 tx=0).stop 2024-09-21T05:52:52.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.886+0000 7f27133fe640 1 -- 172.21.15.7:0/1284476682 shutdown_connections 2024-09-21T05:52:52.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.886+0000 7f27133fe640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26f80b6670 0x7f26f80b8b80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:52.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.886+0000 7f27133fe640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f270c105270 0x7f270c19aa30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:52.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.886+0000 7f27133fe640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f270c10ded0 0x7f270c19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:52.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.886+0000 7f27133fe640 1 --2- 172.21.15.7:0/1284476682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f270c104920 0x7f270c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:52.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.886+0000 7f27133fe640 1 -- 172.21.15.7:0/1284476682 >> 172.21.15.7:0/1284476682 conn(0x7f270c079790 msgr2=0x7f270c100900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:52.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.886+0000 7f27133fe640 1 -- 172.21.15.7:0/1284476682 shutdown_connections 2024-09-21T05:52:52.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:52.886+0000 7f27133fe640 1 -- 172.21.15.7:0/1284476682 wait complete. 2024-09-21T05:52:53.121 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705741 got 38654705744 for osd.0 2024-09-21T05:52:53.121 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:53.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:53 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1284476682' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T05:52:53.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:53 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1284476682' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T05:52:53.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:53 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1284476682' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T05:52:53.704 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691886 got 171798691890 for osd.6 2024-09-21T05:52:53.704 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:53.704 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T05:52:53.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:52:53.995 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:54.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:54 smithi007 ceph-mon[30983]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:52:54.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:54 smithi027 ceph-mon[34364]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:52:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.492+0000 7ff24fe34640 1 -- 172.21.15.7:0/2888034935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff24810de60 msgr2=0x7ff248110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.492+0000 7ff24fe34640 1 --2- 172.21.15.7:0/2888034935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff24810de60 0x7ff248110330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff240009ca0 tx=0x7ff24002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.493+0000 7ff24fe34640 1 -- 172.21.15.7:0/2888034935 shutdown_connections 2024-09-21T05:52:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.493+0000 7ff24fe34640 1 --2- 172.21.15.7:0/2888034935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff24810de60 0x7ff248110330 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.493+0000 7ff24fe34640 1 --2- 172.21.15.7:0/2888034935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff248105380 0x7ff24810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.493+0000 7ff24fe34640 1 --2- 172.21.15.7:0/2888034935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff248104a30 0x7ff248104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.493+0000 7ff24fe34640 1 -- 172.21.15.7:0/2888034935 >> 172.21.15.7:0/2888034935 conn(0x7ff2480797b0 msgr2=0x7ff248079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.493+0000 7ff24fe34640 1 -- 172.21.15.7:0/2888034935 shutdown_connections 2024-09-21T05:52:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.493+0000 7ff24fe34640 1 -- 172.21.15.7:0/2888034935 wait complete. 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.493+0000 7ff24fe34640 1 Processor -- start 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.493+0000 7ff24fe34640 1 -- start start 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24fe34640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff248104a30 0x7ff24819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24fe34640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff248105380 0x7ff24819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24fe34640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff24810de60 0x7ff24819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24fe34640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff248113ac0 con 0x7ff24810de60 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24fe34640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff248113940 con 0x7ff248105380 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24fe34640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff248113c40 con 0x7ff248104a30 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24e3d1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff24810de60 0x7ff24819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24e3d1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff24810de60 0x7ff24819fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49492/0 (socket says 172.21.15.7:49492) 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24e3d1640 1 -- 172.21.15.7:0/741972577 learned_addr learned my addr 172.21.15.7:0/741972577 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24d3cf640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff248105380 0x7ff24819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24dbd0640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff248104a30 0x7ff24819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24e3d1640 1 -- 172.21.15.7:0/741972577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff248104a30 msgr2=0x7ff24819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24e3d1640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff248104a30 0x7ff24819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:54.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24e3d1640 1 -- 172.21.15.7:0/741972577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff248105380 msgr2=0x7ff24819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:54.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24e3d1640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff248105380 0x7ff24819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:54.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24e3d1640 1 -- 172.21.15.7:0/741972577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2481a03e0 con 0x7ff24810de60 2024-09-21T05:52:54.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.494+0000 7ff24e3d1640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff24810de60 0x7ff24819fcb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff240005cc0 tx=0x7ff24002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:54.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.495+0000 7ff23effd640 1 -- 172.21.15.7:0/741972577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240003bf0 con 0x7ff24810de60 2024-09-21T05:52:54.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.495+0000 7ff24fe34640 1 -- 172.21.15.7:0/741972577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2481a0670 con 0x7ff24810de60 2024-09-21T05:52:54.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.495+0000 7ff23effd640 1 -- 172.21.15.7:0/741972577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff240003d90 con 0x7ff24810de60 2024-09-21T05:52:54.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.495+0000 7ff23effd640 1 -- 172.21.15.7:0/741972577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24002fbc0 con 0x7ff24810de60 2024-09-21T05:52:54.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.495+0000 7ff24fe34640 1 -- 172.21.15.7:0/741972577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2481a6e30 con 0x7ff24810de60 2024-09-21T05:52:54.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.496+0000 7ff24fe34640 1 -- 172.21.15.7:0/741972577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff248104e40 con 0x7ff24810de60 2024-09-21T05:52:54.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.498+0000 7ff23effd640 1 -- 172.21.15.7:0/741972577 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7ff24002fd60 con 0x7ff24810de60 2024-09-21T05:52:54.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.499+0000 7ff23effd640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff2340b65f0 0x7ff2340b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:54.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.500+0000 7ff24dbd0640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff2340b65f0 0x7ff2340b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:54.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.500+0000 7ff23effd640 1 -- 172.21.15.7:0/741972577 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7ff240108c40 con 0x7ff24810de60 2024-09-21T05:52:54.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.500+0000 7ff24dbd0640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff2340b65f0 0x7ff2340b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff244005fd0 tx=0x7ff244005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:54.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.503+0000 7ff23effd640 1 -- 172.21.15.7:0/741972577 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff2400cf2d0 con 0x7ff24810de60 2024-09-21T05:52:54.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:54 smithi119 ceph-mon[34833]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:52:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.711+0000 7ff24fe34640 1 -- 172.21.15.7:0/741972577 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff248108080 con 0x7ff2340b65f0 2024-09-21T05:52:54.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.716+0000 7ff23effd640 1 -- 172.21.15.7:0/741972577 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258703 (secure 0 0 0) 0x7ff248108080 con 0x7ff2340b65f0 2024-09-21T05:52:54.721 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:52:54.722 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T05:52:54.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.719+0000 7ff24fe34640 1 -- 172.21.15.7:0/741972577 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff2340b65f0 msgr2=0x7ff2340b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:54.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.719+0000 7ff24fe34640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff2340b65f0 0x7ff2340b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff244005fd0 tx=0x7ff244005850 comp rx=0 tx=0).stop 2024-09-21T05:52:54.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.719+0000 7ff24fe34640 1 -- 172.21.15.7:0/741972577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff24810de60 msgr2=0x7ff24819fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.719+0000 7ff24fe34640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff24810de60 0x7ff24819fcb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff240005cc0 tx=0x7ff24002f380 comp rx=0 tx=0).stop 2024-09-21T05:52:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.719+0000 7ff24fe34640 1 -- 172.21.15.7:0/741972577 shutdown_connections 2024-09-21T05:52:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.719+0000 7ff24fe34640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff2340b65f0 0x7ff2340b8b00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.719+0000 7ff24fe34640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff24810de60 0x7ff24819fcb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.719+0000 7ff24fe34640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff248105380 0x7ff24819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.719+0000 7ff24fe34640 1 --2- 172.21.15.7:0/741972577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff248104a30 0x7ff24819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.719+0000 7ff24fe34640 1 -- 172.21.15.7:0/741972577 >> 172.21.15.7:0/741972577 conn(0x7ff2480797b0 msgr2=0x7ff248107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.719+0000 7ff24fe34640 1 -- 172.21.15.7:0/741972577 shutdown_connections 2024-09-21T05:52:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:54.719+0000 7ff24fe34640 1 -- 172.21.15.7:0/741972577 wait complete. 2024-09-21T05:52:55.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:55 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:55.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:55 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:55.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:55 smithi007 ceph-mon[30983]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T05:52:55.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:55 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:52:55.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:55 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:52:55.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:55 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:55.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:55 smithi007 ceph-mon[30983]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:55.412 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-09-21T05:52:54.480587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658505,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":426,"num_read_kb":314,"num_write":289,"num_write_kb":2267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2951840,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390192,"kb_used_data":11736,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551632,"statfs":{"total":1151940427776,"available":1151540871168,"internally_reserved":0,"allocated":12017664,"data_stored":6850503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003342"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590625+0000","last_change":"2024-09-21T05:51:50.266316+0000","last_active":"2024-09-21T05:52:23.590625+0000","last_peered":"2024-09-21T05:52:23.590625+0000","last_clean":"2024-09-21T05:52:23.590625+0000","last_became_active":"2024-09-21T05:51:50.265970+0000","last_became_peered":"2024-09-21T05:51:50.265970+0000","last_unstale":"2024-09-21T05:52:23.590625+0000","last_undegraded":"2024-09-21T05:52:23.590625+0000","last_fullsized":"2024-09-21T05:52:23.590625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:31.728635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703754+0000","last_change":"2024-09-21T05:51:50.254215+0000","last_active":"2024-09-21T05:52:23.703754+0000","last_peered":"2024-09-21T05:52:23.703754+0000","last_clean":"2024-09-21T05:52:23.703754+0000","last_became_active":"2024-09-21T05:51:50.253701+0000","last_became_peered":"2024-09-21T05:51:50.253701+0000","last_unstale":"2024-09-21T05:52:23.703754+0000","last_undegraded":"2024-09-21T05:52:23.703754+0000","last_fullsized":"2024-09-21T05:52:23.703754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:56.211706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703707+0000","last_change":"2024-09-21T05:51:50.258535+0000","last_active":"2024-09-21T05:52:23.703707+0000","last_peered":"2024-09-21T05:52:23.703707+0000","last_clean":"2024-09-21T05:52:23.703707+0000","last_became_active":"2024-09-21T05:51:50.258186+0000","last_became_peered":"2024-09-21T05:51:50.258186+0000","last_unstale":"2024-09-21T05:52:23.703707+0000","last_undegraded":"2024-09-21T05:52:23.703707+0000","last_fullsized":"2024-09-21T05:52:23.703707+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:15.134574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.687728+0000","last_change":"2024-09-21T05:51:50.254832+0000","last_active":"2024-09-21T05:52:23.687728+0000","last_peered":"2024-09-21T05:52:23.687728+0000","last_clean":"2024-09-21T05:52:23.687728+0000","last_became_active":"2024-09-21T05:51:50.254449+0000","last_became_peered":"2024-09-21T05:51:50.254449+0000","last_unstale":"2024-09-21T05:52:23.687728+0000","last_undegraded":"2024-09-21T05:52:23.687728+0000","last_fullsized":"2024-09-21T05:52:23.687728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:31.411808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589809+0000","last_change":"2024-09-21T05:51:50.251144+0000","last_active":"2024-09-21T05:52:23.589809+0000","last_peered":"2024-09-21T05:52:23.589809+0000","last_clean":"2024-09-21T05:52:23.589809+0000","last_became_active":"2024-09-21T05:51:50.250782+0000","last_became_peered":"2024-09-21T05:51:50.250782+0000","last_unstale":"2024-09-21T05:52:23.589809+0000","last_undegraded":"2024-09-21T05:52:23.589809+0000","last_fullsized":"2024-09-21T05:52:23.589809+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:15.055805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.585358+0000","last_change":"2024-09-21T05:51:50.259758+0000","last_active":"2024-09-21T05:52:23.585358+0000","last_peered":"2024-09-21T05:52:23.585358+0000","last_clean":"2024-09-21T05:52:23.585358+0000","last_became_active":"2024-09-21T05:51:50.259358+0000","last_became_peered":"2024-09-21T05:51:50.259358+0000","last_unstale":"2024-09-21T05:52:23.585358+0000","last_undegraded":"2024-09-21T05:52:23.585358+0000","last_fullsized":"2024-09-21T05:52:23.585358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:08.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587243+0000","last_change":"2024-09-21T05:51:50.260018+0000","last_active":"2024-09-21T05:52:23.587243+0000","last_peered":"2024-09-21T05:52:23.587243+0000","last_clean":"2024-09-21T05:52:23.587243+0000","last_became_active":"2024-09-21T05:51:50.257143+0000","last_became_peered":"2024-09-21T05:51:50.257143+0000","last_unstale":"2024-09-21T05:52:23.587243+0000","last_undegraded":"2024-09-21T05:52:23.587243+0000","last_fullsized":"2024-09-21T05:52:23.587243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:05.579662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589326+0000","last_change":"2024-09-21T05:51:50.256867+0000","last_active":"2024-09-21T05:52:23.589326+0000","last_peered":"2024-09-21T05:52:23.589326+0000","last_clean":"2024-09-21T05:52:23.589326+0000","last_became_active":"2024-09-21T05:51:50.256392+0000","last_became_peered":"2024-09-21T05:51:50.256392+0000","last_unstale":"2024-09-21T05:52:23.589326+0000","last_undegraded":"2024-09-21T05:52:23.589326+0000","last_fullsized":"2024-09-21T05:52:23.589326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:43.169607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.704260+0000","last_change":"2024-09-21T05:51:50.260430+0000","last_active":"2024-09-21T05:52:23.704260+0000","last_peered":"2024-09-21T05:52:23.704260+0000","last_clean":"2024-09-21T05:52:23.704260+0000","last_became_active":"2024-09-21T05:51:50.259993+0000","last_became_peered":"2024-09-21T05:51:50.259993+0000","last_unstale":"2024-09-21T05:52:23.704260+0000","last_undegraded":"2024-09-21T05:52:23.704260+0000","last_fullsized":"2024-09-21T05:52:23.704260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:31.811151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.586095+0000","last_change":"2024-09-21T05:51:50.263027+0000","last_active":"2024-09-21T05:52:23.586095+0000","last_peered":"2024-09-21T05:52:23.586095+0000","last_clean":"2024-09-21T05:52:23.586095+0000","last_became_active":"2024-09-21T05:51:50.261816+0000","last_became_peered":"2024-09-21T05:51:50.261816+0000","last_unstale":"2024-09-21T05:52:23.586095+0000","last_undegraded":"2024-09-21T05:52:23.586095+0000","last_fullsized":"2024-09-21T05:52:23.586095+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:39.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587722+0000","last_change":"2024-09-21T05:51:50.263976+0000","last_active":"2024-09-21T05:52:23.587722+0000","last_peered":"2024-09-21T05:52:23.587722+0000","last_clean":"2024-09-21T05:52:23.587722+0000","last_became_active":"2024-09-21T05:51:50.263179+0000","last_became_peered":"2024-09-21T05:51:50.263179+0000","last_unstale":"2024-09-21T05:52:23.587722+0000","last_undegraded":"2024-09-21T05:52:23.587722+0000","last_fullsized":"2024-09-21T05:52:23.587722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:08.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.687787+0000","last_change":"2024-09-21T05:51:50.259967+0000","last_active":"2024-09-21T05:52:23.687787+0000","last_peered":"2024-09-21T05:52:23.687787+0000","last_clean":"2024-09-21T05:52:23.687787+0000","last_became_active":"2024-09-21T05:51:50.259460+0000","last_became_peered":"2024-09-21T05:51:50.259460+0000","last_unstale":"2024-09-21T05:52:23.687787+0000","last_undegraded":"2024-09-21T05:52:23.687787+0000","last_fullsized":"2024-09-21T05:52:23.687787+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:48.576362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584168+0000","last_change":"2024-09-21T05:51:50.252949+0000","last_active":"2024-09-21T05:52:23.584168+0000","last_peered":"2024-09-21T05:52:23.584168+0000","last_clean":"2024-09-21T05:52:23.584168+0000","last_became_active":"2024-09-21T05:51:50.252518+0000","last_became_peered":"2024-09-21T05:51:50.252518+0000","last_unstale":"2024-09-21T05:52:23.584168+0000","last_undegraded":"2024-09-21T05:52:23.584168+0000","last_fullsized":"2024-09-21T05:52:23.584168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:38.145947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703470+0000","last_change":"2024-09-21T05:51:50.250309+0000","last_active":"2024-09-21T05:52:23.703470+0000","last_peered":"2024-09-21T05:52:23.703470+0000","last_clean":"2024-09-21T05:52:23.703470+0000","last_became_active":"2024-09-21T05:51:50.249629+0000","last_became_peered":"2024-09-21T05:51:50.249629+0000","last_unstale":"2024-09-21T05:52:23.703470+0000","last_undegraded":"2024-09-21T05:52:23.703470+0000","last_fullsized":"2024-09-21T05:52:23.703470+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:28.551654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703437+0000","last_change":"2024-09-21T05:51:50.242211+0000","last_active":"2024-09-21T05:52:23.703437+0000","last_peered":"2024-09-21T05:52:23.703437+0000","last_clean":"2024-09-21T05:52:23.703437+0000","last_became_active":"2024-09-21T05:51:50.241861+0000","last_became_peered":"2024-09-21T05:51:50.241861+0000","last_unstale":"2024-09-21T05:52:23.703437+0000","last_undegraded":"2024-09-21T05:52:23.703437+0000","last_fullsized":"2024-09-21T05:52:23.703437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:46.045907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703677+0000","last_change":"2024-09-21T05:51:50.268926+0000","last_active":"2024-09-21T05:52:23.703677+0000","last_peered":"2024-09-21T05:52:23.703677+0000","last_clean":"2024-09-21T05:52:23.703677+0000","last_became_active":"2024-09-21T05:51:50.268164+0000","last_became_peered":"2024-09-21T05:51:50.268164+0000","last_unstale":"2024-09-21T05:52:23.703677+0000","last_undegraded":"2024-09-21T05:52:23.703677+0000","last_fullsized":"2024-09-21T05:52:23.703677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:43.021303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590750+0000","last_change":"2024-09-21T05:51:50.266365+0000","last_active":"2024-09-21T05:52:23.590750+0000","last_peered":"2024-09-21T05:52:23.590750+0000","last_clean":"2024-09-21T05:52:23.590750+0000","last_became_active":"2024-09-21T05:51:50.265803+0000","last_became_peered":"2024-09-21T05:51:50.265803+0000","last_unstale":"2024-09-21T05:52:23.590750+0000","last_undegraded":"2024-09-21T05:52:23.590750+0000","last_fullsized":"2024-09-21T05:52:23.590750+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:45.574795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587368+0000","last_change":"2024-09-21T05:51:50.257129+0000","last_active":"2024-09-21T05:52:23.587368+0000","last_peered":"2024-09-21T05:52:23.587368+0000","last_clean":"2024-09-21T05:52:23.587368+0000","last_became_active":"2024-09-21T05:51:50.256721+0000","last_became_peered":"2024-09-21T05:51:50.256721+0000","last_unstale":"2024-09-21T05:52:23.587368+0000","last_undegraded":"2024-09-21T05:52:23.587368+0000","last_fullsized":"2024-09-21T05:52:23.587368+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:26.688743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587645+0000","last_change":"2024-09-21T05:51:50.243460+0000","last_active":"2024-09-21T05:52:23.587645+0000","last_peered":"2024-09-21T05:52:23.587645+0000","last_clean":"2024-09-21T05:52:23.587645+0000","last_became_active":"2024-09-21T05:51:50.243094+0000","last_became_peered":"2024-09-21T05:51:50.243094+0000","last_unstale":"2024-09-21T05:52:23.587645+0000","last_undegraded":"2024-09-21T05:52:23.587645+0000","last_fullsized":"2024-09-21T05:52:23.587645+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:16.751564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.595819+0000","last_change":"2024-09-21T05:52:23.595697+0000","last_active":"2024-09-21T05:52:23.595819+0000","last_peered":"2024-09-21T05:52:23.595819+0000","last_clean":"2024-09-21T05:52:23.595819+0000","last_became_active":"2024-09-21T05:52:23.595173+0000","last_became_peered":"2024-09-21T05:52:23.595173+0000","last_unstale":"2024-09-21T05:52:23.595819+0000","last_undegraded":"2024-09-21T05:52:23.595819+0000","last_fullsized":"2024-09-21T05:52:23.595819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.036215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584294+0000","last_change":"2024-09-21T05:51:50.251288+0000","last_active":"2024-09-21T05:52:23.584294+0000","last_peered":"2024-09-21T05:52:23.584294+0000","last_clean":"2024-09-21T05:52:23.584294+0000","last_became_active":"2024-09-21T05:51:50.250841+0000","last_became_peered":"2024-09-21T05:51:50.250841+0000","last_unstale":"2024-09-21T05:52:23.584294+0000","last_undegraded":"2024-09-21T05:52:23.584294+0000","last_fullsized":"2024-09-21T05:52:23.584294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:44.196822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703980+0000","last_change":"2024-09-21T05:51:50.259418+0000","last_active":"2024-09-21T05:52:23.703980+0000","last_peered":"2024-09-21T05:52:23.703980+0000","last_clean":"2024-09-21T05:52:23.703980+0000","last_became_active":"2024-09-21T05:51:50.257641+0000","last_became_peered":"2024-09-21T05:51:50.257641+0000","last_unstale":"2024-09-21T05:52:23.703980+0000","last_undegraded":"2024-09-21T05:52:23.703980+0000","last_fullsized":"2024-09-21T05:52:23.703980+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:23.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589491+0000","last_change":"2024-09-21T05:51:50.252746+0000","last_active":"2024-09-21T05:52:23.589491+0000","last_peered":"2024-09-21T05:52:23.589491+0000","last_clean":"2024-09-21T05:52:23.589491+0000","last_became_active":"2024-09-21T05:51:50.250551+0000","last_became_peered":"2024-09-21T05:51:50.250551+0000","last_unstale":"2024-09-21T05:52:23.589491+0000","last_undegraded":"2024-09-21T05:52:23.589491+0000","last_fullsized":"2024-09-21T05:52:23.589491+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:05.821737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596144+0000","last_change":"2024-09-21T05:51:50.246170+0000","last_active":"2024-09-21T05:52:23.596144+0000","last_peered":"2024-09-21T05:52:23.596144+0000","last_clean":"2024-09-21T05:52:23.596144+0000","last_became_active":"2024-09-21T05:51:50.245747+0000","last_became_peered":"2024-09-21T05:51:50.245747+0000","last_unstale":"2024-09-21T05:52:23.596144+0000","last_undegraded":"2024-09-21T05:52:23.596144+0000","last_fullsized":"2024-09-21T05:52:23.596144+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:05.005437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590264+0000","last_change":"2024-09-21T05:51:50.258248+0000","last_active":"2024-09-21T05:52:23.590264+0000","last_peered":"2024-09-21T05:52:23.590264+0000","last_clean":"2024-09-21T05:52:23.590264+0000","last_became_active":"2024-09-21T05:51:50.257891+0000","last_became_peered":"2024-09-21T05:51:50.257891+0000","last_unstale":"2024-09-21T05:52:23.590264+0000","last_undegraded":"2024-09-21T05:52:23.590264+0000","last_fullsized":"2024-09-21T05:52:23.590264+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:44.093064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587701+0000","last_change":"2024-09-21T05:51:50.258497+0000","last_active":"2024-09-21T05:52:23.587701+0000","last_peered":"2024-09-21T05:52:23.587701+0000","last_clean":"2024-09-21T05:52:23.587701+0000","last_became_active":"2024-09-21T05:51:50.257633+0000","last_became_peered":"2024-09-21T05:51:50.257633+0000","last_unstale":"2024-09-21T05:52:23.587701+0000","last_undegraded":"2024-09-21T05:52:23.587701+0000","last_fullsized":"2024-09-21T05:52:23.587701+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:41.793650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591006+0000","last_change":"2024-09-21T05:51:50.255336+0000","last_active":"2024-09-21T05:52:23.591006+0000","last_peered":"2024-09-21T05:52:23.591006+0000","last_clean":"2024-09-21T05:52:23.591006+0000","last_became_active":"2024-09-21T05:51:50.254955+0000","last_became_peered":"2024-09-21T05:51:50.254955+0000","last_unstale":"2024-09-21T05:52:23.591006+0000","last_undegraded":"2024-09-21T05:52:23.591006+0000","last_fullsized":"2024-09-21T05:52:23.591006+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:28.198455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584145+0000","last_change":"2024-09-21T05:51:50.242391+0000","last_active":"2024-09-21T05:52:23.584145+0000","last_peered":"2024-09-21T05:52:23.584145+0000","last_clean":"2024-09-21T05:52:23.584145+0000","last_became_active":"2024-09-21T05:51:50.242055+0000","last_became_peered":"2024-09-21T05:51:50.242055+0000","last_unstale":"2024-09-21T05:52:23.584145+0000","last_undegraded":"2024-09-21T05:52:23.584145+0000","last_fullsized":"2024-09-21T05:52:23.584145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:48.937516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703613+0000","last_change":"2024-09-21T05:51:50.243343+0000","last_active":"2024-09-21T05:52:23.703613+0000","last_peered":"2024-09-21T05:52:23.703613+0000","last_clean":"2024-09-21T05:52:23.703613+0000","last_became_active":"2024-09-21T05:51:50.243005+0000","last_became_peered":"2024-09-21T05:51:50.243005+0000","last_unstale":"2024-09-21T05:52:23.703613+0000","last_undegraded":"2024-09-21T05:52:23.703613+0000","last_fullsized":"2024-09-21T05:52:23.703613+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:51.975966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587154+0000","last_change":"2024-09-21T05:51:50.250290+0000","last_active":"2024-09-21T05:52:23.587154+0000","last_peered":"2024-09-21T05:52:23.587154+0000","last_clean":"2024-09-21T05:52:23.587154+0000","last_became_active":"2024-09-21T05:51:50.249867+0000","last_became_peered":"2024-09-21T05:51:50.249867+0000","last_unstale":"2024-09-21T05:52:23.587154+0000","last_undegraded":"2024-09-21T05:52:23.587154+0000","last_fullsized":"2024-09-21T05:52:23.587154+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:33.852383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587202+0000","last_change":"2024-09-21T05:51:50.244908+0000","last_active":"2024-09-21T05:52:23.587202+0000","last_peered":"2024-09-21T05:52:23.587202+0000","last_clean":"2024-09-21T05:52:23.587202+0000","last_became_active":"2024-09-21T05:51:50.244473+0000","last_became_peered":"2024-09-21T05:51:50.244473+0000","last_unstale":"2024-09-21T05:52:23.587202+0000","last_undegraded":"2024-09-21T05:52:23.587202+0000","last_fullsized":"2024-09-21T05:52:23.587202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:08.040920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589800+0000","last_change":"2024-09-21T05:51:50.259926+0000","last_active":"2024-09-21T05:52:23.589800+0000","last_peered":"2024-09-21T05:52:23.589800+0000","last_clean":"2024-09-21T05:52:23.589800+0000","last_became_active":"2024-09-21T05:51:50.259511+0000","last_became_peered":"2024-09-21T05:51:50.259511+0000","last_unstale":"2024-09-21T05:52:23.589800+0000","last_undegraded":"2024-09-21T05:52:23.589800+0000","last_fullsized":"2024-09-21T05:52:23.589800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:46.735741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589813+0000","last_change":"2024-09-21T05:51:50.249474+0000","last_active":"2024-09-21T05:52:23.589813+0000","last_peered":"2024-09-21T05:52:23.589813+0000","last_clean":"2024-09-21T05:52:23.589813+0000","last_became_active":"2024-09-21T05:51:50.247503+0000","last_became_peered":"2024-09-21T05:51:50.247503+0000","last_unstale":"2024-09-21T05:52:23.589813+0000","last_undegraded":"2024-09-21T05:52:23.589813+0000","last_fullsized":"2024-09-21T05:52:23.589813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:11.639218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":80,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.408678+0000","last_change":"2024-09-21T05:51:48.236001+0000","last_active":"2024-09-21T05:52:48.408678+0000","last_peered":"2024-09-21T05:52:48.408678+0000","last_clean":"2024-09-21T05:52:48.408678+0000","last_became_active":"2024-09-21T05:51:48.235603+0000","last_became_peered":"2024-09-21T05:51:48.235603+0000","last_unstale":"2024-09-21T05:52:48.408678+0000","last_undegraded":"2024-09-21T05:52:48.408678+0000","last_fullsized":"2024-09-21T05:52:48.408678+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:33.217248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.599234+0000","last_change":"2024-09-21T05:52:23.599125+0000","last_active":"2024-09-21T05:52:23.599234+0000","last_peered":"2024-09-21T05:52:23.599234+0000","last_clean":"2024-09-21T05:52:23.599234+0000","last_became_active":"2024-09-21T05:52:23.598739+0000","last_became_peered":"2024-09-21T05:52:23.598739+0000","last_unstale":"2024-09-21T05:52:23.599234+0000","last_undegraded":"2024-09-21T05:52:23.599234+0000","last_fullsized":"2024-09-21T05:52:23.599234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:20.838698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.585476+0000","last_change":"2024-09-21T05:51:48.230191+0000","last_active":"2024-09-21T05:52:23.585476+0000","last_peered":"2024-09-21T05:52:23.585476+0000","last_clean":"2024-09-21T05:52:23.585476+0000","last_became_active":"2024-09-21T05:51:48.229780+0000","last_became_peered":"2024-09-21T05:51:48.229780+0000","last_unstale":"2024-09-21T05:52:23.585476+0000","last_undegraded":"2024-09-21T05:52:23.585476+0000","last_fullsized":"2024-09-21T05:52:23.585476+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:34.950404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584118+0000","last_change":"2024-09-21T05:51:48.224115+0000","last_active":"2024-09-21T05:52:23.584118+0000","last_peered":"2024-09-21T05:52:23.584118+0000","last_clean":"2024-09-21T05:52:23.584118+0000","last_became_active":"2024-09-21T05:51:48.223714+0000","last_became_peered":"2024-09-21T05:51:48.223714+0000","last_unstale":"2024-09-21T05:52:23.584118+0000","last_undegraded":"2024-09-21T05:52:23.584118+0000","last_fullsized":"2024-09-21T05:52:23.584118+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:29.450354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589402+0000","last_change":"2024-09-21T05:51:50.250129+0000","last_active":"2024-09-21T05:52:23.589402+0000","last_peered":"2024-09-21T05:52:23.589402+0000","last_clean":"2024-09-21T05:52:23.589402+0000","last_became_active":"2024-09-21T05:51:50.249743+0000","last_became_peered":"2024-09-21T05:51:50.249743+0000","last_unstale":"2024-09-21T05:52:23.589402+0000","last_undegraded":"2024-09-21T05:52:23.589402+0000","last_fullsized":"2024-09-21T05:52:23.589402+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:37.204476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596516+0000","last_change":"2024-09-21T05:51:48.236289+0000","last_active":"2024-09-21T05:52:23.596516+0000","last_peered":"2024-09-21T05:52:23.596516+0000","last_clean":"2024-09-21T05:52:23.596516+0000","last_became_active":"2024-09-21T05:51:48.235898+0000","last_became_peered":"2024-09-21T05:51:48.235898+0000","last_unstale":"2024-09-21T05:52:23.596516+0000","last_undegraded":"2024-09-21T05:52:23.596516+0000","last_fullsized":"2024-09-21T05:52:23.596516+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:05.457237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587120+0000","last_change":"2024-09-21T05:51:50.251905+0000","last_active":"2024-09-21T05:52:23.587120+0000","last_peered":"2024-09-21T05:52:23.587120+0000","last_clean":"2024-09-21T05:52:23.587120+0000","last_became_active":"2024-09-21T05:51:50.251537+0000","last_became_peered":"2024-09-21T05:51:50.251537+0000","last_unstale":"2024-09-21T05:52:23.587120+0000","last_undegraded":"2024-09-21T05:52:23.587120+0000","last_fullsized":"2024-09-21T05:52:23.587120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:57.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:51.412524+0000","last_change":"2024-09-21T05:51:48.232007+0000","last_active":"2024-09-21T05:52:51.412524+0000","last_peered":"2024-09-21T05:52:51.412524+0000","last_clean":"2024-09-21T05:52:51.412524+0000","last_became_active":"2024-09-21T05:51:48.231534+0000","last_became_peered":"2024-09-21T05:51:48.231534+0000","last_unstale":"2024-09-21T05:52:51.412524+0000","last_undegraded":"2024-09-21T05:52:51.412524+0000","last_fullsized":"2024-09-21T05:52:51.412524+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:05.874618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.704110+0000","last_change":"2024-09-21T05:51:50.265224+0000","last_active":"2024-09-21T05:52:23.704110+0000","last_peered":"2024-09-21T05:52:23.704110+0000","last_clean":"2024-09-21T05:52:23.704110+0000","last_became_active":"2024-09-21T05:51:50.264690+0000","last_became_peered":"2024-09-21T05:51:50.264690+0000","last_unstale":"2024-09-21T05:52:23.704110+0000","last_undegraded":"2024-09-21T05:52:23.704110+0000","last_fullsized":"2024-09-21T05:52:23.704110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:15.835492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587907+0000","last_change":"2024-09-21T05:51:48.233092+0000","last_active":"2024-09-21T05:52:23.587907+0000","last_peered":"2024-09-21T05:52:23.587907+0000","last_clean":"2024-09-21T05:52:23.587907+0000","last_became_active":"2024-09-21T05:51:48.232684+0000","last_became_peered":"2024-09-21T05:51:48.232684+0000","last_unstale":"2024-09-21T05:52:23.587907+0000","last_undegraded":"2024-09-21T05:52:23.587907+0000","last_fullsized":"2024-09-21T05:52:23.587907+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:21.664828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703881+0000","last_change":"2024-09-21T05:51:50.248419+0000","last_active":"2024-09-21T05:52:23.703881+0000","last_peered":"2024-09-21T05:52:23.703881+0000","last_clean":"2024-09-21T05:52:23.703881+0000","last_became_active":"2024-09-21T05:51:50.247871+0000","last_became_peered":"2024-09-21T05:51:50.247871+0000","last_unstale":"2024-09-21T05:52:23.703881+0000","last_undegraded":"2024-09-21T05:52:23.703881+0000","last_fullsized":"2024-09-21T05:52:23.703881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:49.851685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596905+0000","last_change":"2024-09-21T05:51:48.338367+0000","last_active":"2024-09-21T05:52:23.596905+0000","last_peered":"2024-09-21T05:52:23.596905+0000","last_clean":"2024-09-21T05:52:23.596905+0000","last_became_active":"2024-09-21T05:51:48.337992+0000","last_became_peered":"2024-09-21T05:51:48.337992+0000","last_unstale":"2024-09-21T05:52:23.596905+0000","last_undegraded":"2024-09-21T05:52:23.596905+0000","last_fullsized":"2024-09-21T05:52:23.596905+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:52.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703856+0000","last_change":"2024-09-21T05:51:50.267046+0000","last_active":"2024-09-21T05:52:23.703856+0000","last_peered":"2024-09-21T05:52:23.703856+0000","last_clean":"2024-09-21T05:52:23.703856+0000","last_became_active":"2024-09-21T05:51:50.266672+0000","last_became_peered":"2024-09-21T05:51:50.266672+0000","last_unstale":"2024-09-21T05:52:23.703856+0000","last_undegraded":"2024-09-21T05:52:23.703856+0000","last_fullsized":"2024-09-21T05:52:23.703856+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:53.628646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'28","reported_seq":166,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:52.414101+0000","last_change":"2024-09-21T05:51:48.233804+0000","last_active":"2024-09-21T05:52:52.414101+0000","last_peered":"2024-09-21T05:52:52.414101+0000","last_clean":"2024-09-21T05:52:52.414101+0000","last_became_active":"2024-09-21T05:51:48.233386+0000","last_became_peered":"2024-09-21T05:51:48.233386+0000","last_unstale":"2024-09-21T05:52:52.414101+0000","last_undegraded":"2024-09-21T05:52:52.414101+0000","last_fullsized":"2024-09-21T05:52:52.414101+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:45.644005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63902,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":115,"num_read_kb":119,"num_write":29,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590604+0000","last_change":"2024-09-21T05:51:50.257673+0000","last_active":"2024-09-21T05:52:23.590604+0000","last_peered":"2024-09-21T05:52:23.590604+0000","last_clean":"2024-09-21T05:52:23.590604+0000","last_became_active":"2024-09-21T05:51:50.257319+0000","last_became_peered":"2024-09-21T05:51:50.257319+0000","last_unstale":"2024-09-21T05:52:23.590604+0000","last_undegraded":"2024-09-21T05:52:23.590604+0000","last_fullsized":"2024-09-21T05:52:23.590604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:26.008964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587400+0000","last_change":"2024-09-21T05:51:48.233264+0000","last_active":"2024-09-21T05:52:23.587400+0000","last_peered":"2024-09-21T05:52:23.587400+0000","last_clean":"2024-09-21T05:52:23.587400+0000","last_became_active":"2024-09-21T05:51:48.232808+0000","last_became_peered":"2024-09-21T05:51:48.232808+0000","last_unstale":"2024-09-21T05:52:23.587400+0000","last_undegraded":"2024-09-21T05:52:23.587400+0000","last_fullsized":"2024-09-21T05:52:23.587400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:05.105861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.583952+0000","last_change":"2024-09-21T05:51:50.251727+0000","last_active":"2024-09-21T05:52:23.583952+0000","last_peered":"2024-09-21T05:52:23.583952+0000","last_clean":"2024-09-21T05:52:23.583952+0000","last_became_active":"2024-09-21T05:51:50.251382+0000","last_became_peered":"2024-09-21T05:51:50.251382+0000","last_unstale":"2024-09-21T05:52:23.583952+0000","last_undegraded":"2024-09-21T05:52:23.583952+0000","last_fullsized":"2024-09-21T05:52:23.583952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:30.098548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596648+0000","last_change":"2024-09-21T05:51:48.235226+0000","last_active":"2024-09-21T05:52:23.596648+0000","last_peered":"2024-09-21T05:52:23.596648+0000","last_clean":"2024-09-21T05:52:23.596648+0000","last_became_active":"2024-09-21T05:51:48.234432+0000","last_became_peered":"2024-09-21T05:51:48.234432+0000","last_unstale":"2024-09-21T05:52:23.596648+0000","last_undegraded":"2024-09-21T05:52:23.596648+0000","last_fullsized":"2024-09-21T05:52:23.596648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:49.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587958+0000","last_change":"2024-09-21T05:51:50.260276+0000","last_active":"2024-09-21T05:52:23.587958+0000","last_peered":"2024-09-21T05:52:23.587958+0000","last_clean":"2024-09-21T05:52:23.587958+0000","last_became_active":"2024-09-21T05:51:50.257448+0000","last_became_peered":"2024-09-21T05:51:50.257448+0000","last_unstale":"2024-09-21T05:52:23.587958+0000","last_undegraded":"2024-09-21T05:52:23.587958+0000","last_fullsized":"2024-09-21T05:52:23.587958+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:46.052226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:52.415076+0000","last_change":"2024-09-21T05:51:48.230764+0000","last_active":"2024-09-21T05:52:52.415076+0000","last_peered":"2024-09-21T05:52:52.415076+0000","last_clean":"2024-09-21T05:52:52.415076+0000","last_became_active":"2024-09-21T05:51:48.230332+0000","last_became_peered":"2024-09-21T05:51:48.230332+0000","last_unstale":"2024-09-21T05:52:52.415076+0000","last_undegraded":"2024-09-21T05:52:52.415076+0000","last_fullsized":"2024-09-21T05:52:52.415076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:33.459588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590129+0000","last_change":"2024-09-21T05:52:23.589989+0000","last_active":"2024-09-21T05:52:23.590129+0000","last_peered":"2024-09-21T05:52:23.590129+0000","last_clean":"2024-09-21T05:52:23.590129+0000","last_became_active":"2024-09-21T05:52:23.589358+0000","last_became_peered":"2024-09-21T05:52:23.589358+0000","last_unstale":"2024-09-21T05:52:23.590129+0000","last_undegraded":"2024-09-21T05:52:23.590129+0000","last_fullsized":"2024-09-21T05:52:23.590129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:48.706509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589658+0000","last_change":"2024-09-21T05:51:48.338309+0000","last_active":"2024-09-21T05:52:23.589658+0000","last_peered":"2024-09-21T05:52:23.589658+0000","last_clean":"2024-09-21T05:52:23.589658+0000","last_became_active":"2024-09-21T05:51:48.337903+0000","last_became_peered":"2024-09-21T05:51:48.337903+0000","last_unstale":"2024-09-21T05:52:23.589658+0000","last_undegraded":"2024-09-21T05:52:23.589658+0000","last_fullsized":"2024-09-21T05:52:23.589658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:54.634956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.595791+0000","last_change":"2024-09-21T05:51:50.259257+0000","last_active":"2024-09-21T05:52:23.595791+0000","last_peered":"2024-09-21T05:52:23.595791+0000","last_clean":"2024-09-21T05:52:23.595791+0000","last_became_active":"2024-09-21T05:51:50.258892+0000","last_became_peered":"2024-09-21T05:51:50.258892+0000","last_unstale":"2024-09-21T05:52:23.595791+0000","last_undegraded":"2024-09-21T05:52:23.595791+0000","last_fullsized":"2024-09-21T05:52:23.595791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:46.683115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591128+0000","last_change":"2024-09-21T05:51:48.226956+0000","last_active":"2024-09-21T05:52:23.591128+0000","last_peered":"2024-09-21T05:52:23.591128+0000","last_clean":"2024-09-21T05:52:23.591128+0000","last_became_active":"2024-09-21T05:51:48.226531+0000","last_became_peered":"2024-09-21T05:51:48.226531+0000","last_unstale":"2024-09-21T05:52:23.591128+0000","last_undegraded":"2024-09-21T05:52:23.591128+0000","last_fullsized":"2024-09-21T05:52:23.591128+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:14.888074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591095+0000","last_change":"2024-09-21T05:51:50.261080+0000","last_active":"2024-09-21T05:52:23.591095+0000","last_peered":"2024-09-21T05:52:23.591095+0000","last_clean":"2024-09-21T05:52:23.591095+0000","last_became_active":"2024-09-21T05:51:50.260700+0000","last_became_peered":"2024-09-21T05:51:50.260700+0000","last_unstale":"2024-09-21T05:52:23.591095+0000","last_undegraded":"2024-09-21T05:52:23.591095+0000","last_fullsized":"2024-09-21T05:52:23.591095+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.033889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584270+0000","last_change":"2024-09-21T05:51:48.230236+0000","last_active":"2024-09-21T05:52:23.584270+0000","last_peered":"2024-09-21T05:52:23.584270+0000","last_clean":"2024-09-21T05:52:23.584270+0000","last_became_active":"2024-09-21T05:51:48.229775+0000","last_became_peered":"2024-09-21T05:51:48.229775+0000","last_unstale":"2024-09-21T05:52:23.584270+0000","last_undegraded":"2024-09-21T05:52:23.584270+0000","last_fullsized":"2024-09-21T05:52:23.584270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:25.371256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587939+0000","last_change":"2024-09-21T05:51:50.260749+0000","last_active":"2024-09-21T05:52:23.587939+0000","last_peered":"2024-09-21T05:52:23.587939+0000","last_clean":"2024-09-21T05:52:23.587939+0000","last_became_active":"2024-09-21T05:51:50.257406+0000","last_became_peered":"2024-09-21T05:51:50.257406+0000","last_unstale":"2024-09-21T05:52:23.587939+0000","last_undegraded":"2024-09-21T05:52:23.587939+0000","last_fullsized":"2024-09-21T05:52:23.587939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:18.293144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596986+0000","last_change":"2024-09-21T05:51:48.228752+0000","last_active":"2024-09-21T05:52:23.596986+0000","last_peered":"2024-09-21T05:52:23.596986+0000","last_clean":"2024-09-21T05:52:23.596986+0000","last_became_active":"2024-09-21T05:51:48.228361+0000","last_became_peered":"2024-09-21T05:51:48.228361+0000","last_unstale":"2024-09-21T05:52:23.596986+0000","last_undegraded":"2024-09-21T05:52:23.596986+0000","last_fullsized":"2024-09-21T05:52:23.596986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:05.868153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587408+0000","last_change":"2024-09-21T05:51:50.256183+0000","last_active":"2024-09-21T05:52:23.587408+0000","last_peered":"2024-09-21T05:52:23.587408+0000","last_clean":"2024-09-21T05:52:23.587408+0000","last_became_active":"2024-09-21T05:51:50.255746+0000","last_became_peered":"2024-09-21T05:51:50.255746+0000","last_unstale":"2024-09-21T05:52:23.587408+0000","last_undegraded":"2024-09-21T05:52:23.587408+0000","last_fullsized":"2024-09-21T05:52:23.587408+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:29.044470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587539+0000","last_change":"2024-09-21T05:51:48.852935+0000","last_active":"2024-09-21T05:52:23.587539+0000","last_peered":"2024-09-21T05:52:23.587539+0000","last_clean":"2024-09-21T05:52:23.587539+0000","last_became_active":"2024-09-21T05:51:48.852457+0000","last_became_peered":"2024-09-21T05:51:48.852457+0000","last_unstale":"2024-09-21T05:52:23.587539+0000","last_undegraded":"2024-09-21T05:52:23.587539+0000","last_fullsized":"2024-09-21T05:52:23.587539+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:12.109669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587750+0000","last_change":"2024-09-21T05:51:50.261136+0000","last_active":"2024-09-21T05:52:23.587750+0000","last_peered":"2024-09-21T05:52:23.587750+0000","last_clean":"2024-09-21T05:52:23.587750+0000","last_became_active":"2024-09-21T05:51:50.260698+0000","last_became_peered":"2024-09-21T05:51:50.260698+0000","last_unstale":"2024-09-21T05:52:23.587750+0000","last_undegraded":"2024-09-21T05:52:23.587750+0000","last_fullsized":"2024-09-21T05:52:23.587750+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:34.480352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.588534+0000","last_change":"2024-09-21T05:50:40.836627+0000","last_active":"2024-09-21T05:52:23.588534+0000","last_peered":"2024-09-21T05:52:23.588534+0000","last_clean":"2024-09-21T05:52:23.588534+0000","last_became_active":"2024-09-21T05:50:40.830426+0000","last_became_peered":"2024-09-21T05:50:40.830426+0000","last_unstale":"2024-09-21T05:52:23.588534+0000","last_undegraded":"2024-09-21T05:52:23.588534+0000","last_fullsized":"2024-09-21T05:52:23.588534+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_clean_scrub_stamp":"2024-09-21T05:47:21.634945+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:33.394077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.687599+0000","last_change":"2024-09-21T05:51:48.228187+0000","last_active":"2024-09-21T05:52:23.687599+0000","last_peered":"2024-09-21T05:52:23.687599+0000","last_clean":"2024-09-21T05:52:23.687599+0000","last_became_active":"2024-09-21T05:51:48.227690+0000","last_became_peered":"2024-09-21T05:51:48.227690+0000","last_unstale":"2024-09-21T05:52:23.687599+0000","last_undegraded":"2024-09-21T05:52:23.687599+0000","last_fullsized":"2024-09-21T05:52:23.687599+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:37.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.705224+0000","last_change":"2024-09-21T05:52:23.705127+0000","last_active":"2024-09-21T05:52:23.705224+0000","last_peered":"2024-09-21T05:52:23.705224+0000","last_clean":"2024-09-21T05:52:23.705224+0000","last_became_active":"2024-09-21T05:52:23.704731+0000","last_became_peered":"2024-09-21T05:52:23.704731+0000","last_unstale":"2024-09-21T05:52:23.705224+0000","last_undegraded":"2024-09-21T05:52:23.705224+0000","last_fullsized":"2024-09-21T05:52:23.705224+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:49.264072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.588183+0000","last_change":"2024-09-21T05:51:48.234444+0000","last_active":"2024-09-21T05:52:23.588183+0000","last_peered":"2024-09-21T05:52:23.588183+0000","last_clean":"2024-09-21T05:52:23.588183+0000","last_became_active":"2024-09-21T05:51:48.233997+0000","last_became_peered":"2024-09-21T05:51:48.233997+0000","last_unstale":"2024-09-21T05:52:23.588183+0000","last_undegraded":"2024-09-21T05:52:23.588183+0000","last_fullsized":"2024-09-21T05:52:23.588183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:12.931628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.583914+0000","last_change":"2024-09-21T05:51:50.242267+0000","last_active":"2024-09-21T05:52:23.583914+0000","last_peered":"2024-09-21T05:52:23.583914+0000","last_clean":"2024-09-21T05:52:23.583914+0000","last_became_active":"2024-09-21T05:51:50.241927+0000","last_became_peered":"2024-09-21T05:51:50.241927+0000","last_unstale":"2024-09-21T05:52:23.583914+0000","last_undegraded":"2024-09-21T05:52:23.583914+0000","last_fullsized":"2024-09-21T05:52:23.583914+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:28.954451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:52.414554+0000","last_change":"2024-09-21T05:51:48.338372+0000","last_active":"2024-09-21T05:52:52.414554+0000","last_peered":"2024-09-21T05:52:52.414554+0000","last_clean":"2024-09-21T05:52:52.414554+0000","last_became_active":"2024-09-21T05:51:48.337966+0000","last_became_peered":"2024-09-21T05:51:48.337966+0000","last_unstale":"2024-09-21T05:52:52.414554+0000","last_undegraded":"2024-09-21T05:52:52.414554+0000","last_fullsized":"2024-09-21T05:52:52.414554+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:10.301871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596254+0000","last_change":"2024-09-21T05:51:50.253151+0000","last_active":"2024-09-21T05:52:23.596254+0000","last_peered":"2024-09-21T05:52:23.596254+0000","last_clean":"2024-09-21T05:52:23.596254+0000","last_became_active":"2024-09-21T05:51:50.252770+0000","last_became_peered":"2024-09-21T05:51:50.252770+0000","last_unstale":"2024-09-21T05:52:23.596254+0000","last_undegraded":"2024-09-21T05:52:23.596254+0000","last_fullsized":"2024-09-21T05:52:23.596254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:48.784229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587728+0000","last_change":"2024-09-21T05:51:48.233273+0000","last_active":"2024-09-21T05:52:23.587728+0000","last_peered":"2024-09-21T05:52:23.587728+0000","last_clean":"2024-09-21T05:52:23.587728+0000","last_became_active":"2024-09-21T05:51:48.232724+0000","last_became_peered":"2024-09-21T05:51:48.232724+0000","last_unstale":"2024-09-21T05:52:23.587728+0000","last_undegraded":"2024-09-21T05:52:23.587728+0000","last_fullsized":"2024-09-21T05:52:23.587728+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:50.869396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.585577+0000","last_change":"2024-09-21T05:51:50.262521+0000","last_active":"2024-09-21T05:52:23.585577+0000","last_peered":"2024-09-21T05:52:23.585577+0000","last_clean":"2024-09-21T05:52:23.585577+0000","last_became_active":"2024-09-21T05:51:50.262135+0000","last_became_peered":"2024-09-21T05:51:50.262135+0000","last_unstale":"2024-09-21T05:52:23.585577+0000","last_undegraded":"2024-09-21T05:52:23.585577+0000","last_fullsized":"2024-09-21T05:52:23.585577+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:18.347182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587326+0000","last_change":"2024-09-21T05:51:48.338532+0000","last_active":"2024-09-21T05:52:23.587326+0000","last_peered":"2024-09-21T05:52:23.587326+0000","last_clean":"2024-09-21T05:52:23.587326+0000","last_became_active":"2024-09-21T05:51:48.338099+0000","last_became_peered":"2024-09-21T05:51:48.338099+0000","last_unstale":"2024-09-21T05:52:23.587326+0000","last_undegraded":"2024-09-21T05:52:23.587326+0000","last_fullsized":"2024-09-21T05:52:23.587326+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:48.670988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.585832+0000","last_change":"2024-09-21T05:51:50.251814+0000","last_active":"2024-09-21T05:52:23.585832+0000","last_peered":"2024-09-21T05:52:23.585832+0000","last_clean":"2024-09-21T05:52:23.585832+0000","last_became_active":"2024-09-21T05:51:50.251401+0000","last_became_peered":"2024-09-21T05:51:50.251401+0000","last_unstale":"2024-09-21T05:52:23.585832+0000","last_undegraded":"2024-09-21T05:52:23.585832+0000","last_fullsized":"2024-09-21T05:52:23.585832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:12.972300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590808+0000","last_change":"2024-09-21T05:51:48.338312+0000","last_active":"2024-09-21T05:52:23.590808+0000","last_peered":"2024-09-21T05:52:23.590808+0000","last_clean":"2024-09-21T05:52:23.590808+0000","last_became_active":"2024-09-21T05:51:48.337872+0000","last_became_peered":"2024-09-21T05:51:48.337872+0000","last_unstale":"2024-09-21T05:52:23.590808+0000","last_undegraded":"2024-09-21T05:52:23.590808+0000","last_fullsized":"2024-09-21T05:52:23.590808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:26.158650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584236+0000","last_change":"2024-09-21T05:51:50.245129+0000","last_active":"2024-09-21T05:52:23.584236+0000","last_peered":"2024-09-21T05:52:23.584236+0000","last_clean":"2024-09-21T05:52:23.584236+0000","last_became_active":"2024-09-21T05:51:50.244439+0000","last_became_peered":"2024-09-21T05:51:50.244439+0000","last_unstale":"2024-09-21T05:52:23.584236+0000","last_undegraded":"2024-09-21T05:52:23.584236+0000","last_fullsized":"2024-09-21T05:52:23.584236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:19.241921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'12","reported_seq":48,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.600370+0000","last_change":"2024-09-21T05:52:23.600272+0000","last_active":"2024-09-21T05:52:23.600370+0000","last_peered":"2024-09-21T05:52:23.600370+0000","last_clean":"2024-09-21T05:52:23.600370+0000","last_became_active":"2024-09-21T05:52:23.592946+0000","last_became_peered":"2024-09-21T05:52:23.592946+0000","last_unstale":"2024-09-21T05:52:23.600370+0000","last_undegraded":"2024-09-21T05:52:23.600370+0000","last_fullsized":"2024-09-21T05:52:23.600370+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:52.892645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590329+0000","last_change":"2024-09-21T05:51:50.253411+0000","last_active":"2024-09-21T05:52:23.590329+0000","last_peered":"2024-09-21T05:52:23.590329+0000","last_clean":"2024-09-21T05:52:23.590329+0000","last_became_active":"2024-09-21T05:51:50.252816+0000","last_became_peered":"2024-09-21T05:51:50.252816+0000","last_unstale":"2024-09-21T05:52:23.590329+0000","last_undegraded":"2024-09-21T05:52:23.590329+0000","last_fullsized":"2024-09-21T05:52:23.590329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:33.444176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.688065+0000","last_change":"2024-09-21T05:51:48.852668+0000","last_active":"2024-09-21T05:52:23.688065+0000","last_peered":"2024-09-21T05:52:23.688065+0000","last_clean":"2024-09-21T05:52:23.688065+0000","last_became_active":"2024-09-21T05:51:48.852298+0000","last_became_peered":"2024-09-21T05:51:48.852298+0000","last_unstale":"2024-09-21T05:52:23.688065+0000","last_undegraded":"2024-09-21T05:52:23.688065+0000","last_fullsized":"2024-09-21T05:52:23.688065+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:19.529194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703764+0000","last_change":"2024-09-21T05:51:50.246720+0000","last_active":"2024-09-21T05:52:23.703764+0000","last_peered":"2024-09-21T05:52:23.703764+0000","last_clean":"2024-09-21T05:52:23.703764+0000","last_became_active":"2024-09-21T05:51:50.246318+0000","last_became_peered":"2024-09-21T05:51:50.246318+0000","last_unstale":"2024-09-21T05:52:23.703764+0000","last_undegraded":"2024-09-21T05:52:23.703764+0000","last_fullsized":"2024-09-21T05:52:23.703764+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:45.737949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703802+0000","last_change":"2024-09-21T05:51:48.338346+0000","last_active":"2024-09-21T05:52:23.703802+0000","last_peered":"2024-09-21T05:52:23.703802+0000","last_clean":"2024-09-21T05:52:23.703802+0000","last_became_active":"2024-09-21T05:51:48.337968+0000","last_became_peered":"2024-09-21T05:51:48.337968+0000","last_unstale":"2024-09-21T05:52:23.703802+0000","last_undegraded":"2024-09-21T05:52:23.703802+0000","last_fullsized":"2024-09-21T05:52:23.703802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:32.450546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589631+0000","last_change":"2024-09-21T05:51:50.255993+0000","last_active":"2024-09-21T05:52:23.589631+0000","last_peered":"2024-09-21T05:52:23.589631+0000","last_clean":"2024-09-21T05:52:23.589631+0000","last_became_active":"2024-09-21T05:51:50.255645+0000","last_became_peered":"2024-09-21T05:51:50.255645+0000","last_unstale":"2024-09-21T05:52:23.589631+0000","last_undegraded":"2024-09-21T05:52:23.589631+0000","last_fullsized":"2024-09-21T05:52:23.589631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.890940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589612+0000","last_change":"2024-09-21T05:51:48.231659+0000","last_active":"2024-09-21T05:52:23.589612+0000","last_peered":"2024-09-21T05:52:23.589612+0000","last_clean":"2024-09-21T05:52:23.589612+0000","last_became_active":"2024-09-21T05:51:48.231137+0000","last_became_peered":"2024-09-21T05:51:48.231137+0000","last_unstale":"2024-09-21T05:52:23.589612+0000","last_undegraded":"2024-09-21T05:52:23.589612+0000","last_fullsized":"2024-09-21T05:52:23.589612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:06.166268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589952+0000","last_change":"2024-09-21T05:51:50.251904+0000","last_active":"2024-09-21T05:52:23.589952+0000","last_peered":"2024-09-21T05:52:23.589952+0000","last_clean":"2024-09-21T05:52:23.589952+0000","last_became_active":"2024-09-21T05:51:50.251403+0000","last_became_peered":"2024-09-21T05:51:50.251403+0000","last_unstale":"2024-09-21T05:52:23.589952+0000","last_undegraded":"2024-09-21T05:52:23.589952+0000","last_fullsized":"2024-09-21T05:52:23.589952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:47.702083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.603022+0000","last_change":"2024-09-21T05:52:23.602925+0000","last_active":"2024-09-21T05:52:23.603022+0000","last_peered":"2024-09-21T05:52:23.603022+0000","last_clean":"2024-09-21T05:52:23.603022+0000","last_became_active":"2024-09-21T05:52:23.598086+0000","last_became_peered":"2024-09-21T05:52:23.598086+0000","last_unstale":"2024-09-21T05:52:23.603022+0000","last_undegraded":"2024-09-21T05:52:23.603022+0000","last_fullsized":"2024-09-21T05:52:23.603022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:03.260218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589767+0000","last_change":"2024-09-21T05:51:50.256654+0000","last_active":"2024-09-21T05:52:23.589767+0000","last_peered":"2024-09-21T05:52:23.589767+0000","last_clean":"2024-09-21T05:52:23.589767+0000","last_became_active":"2024-09-21T05:51:50.255830+0000","last_became_peered":"2024-09-21T05:51:50.255830+0000","last_unstale":"2024-09-21T05:52:23.589767+0000","last_undegraded":"2024-09-21T05:52:23.589767+0000","last_fullsized":"2024-09-21T05:52:23.589767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:49.643890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591174+0000","last_change":"2024-09-21T05:51:48.233608+0000","last_active":"2024-09-21T05:52:23.591174+0000","last_peered":"2024-09-21T05:52:23.591174+0000","last_clean":"2024-09-21T05:52:23.591174+0000","last_became_active":"2024-09-21T05:51:48.233187+0000","last_became_peered":"2024-09-21T05:51:48.233187+0000","last_unstale":"2024-09-21T05:52:23.591174+0000","last_undegraded":"2024-09-21T05:52:23.591174+0000","last_fullsized":"2024-09-21T05:52:23.591174+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:57.815632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587685+0000","last_change":"2024-09-21T05:51:50.266753+0000","last_active":"2024-09-21T05:52:23.587685+0000","last_peered":"2024-09-21T05:52:23.587685+0000","last_clean":"2024-09-21T05:52:23.587685+0000","last_became_active":"2024-09-21T05:51:50.266368+0000","last_became_peered":"2024-09-21T05:51:50.266368+0000","last_unstale":"2024-09-21T05:52:23.587685+0000","last_undegraded":"2024-09-21T05:52:23.587685+0000","last_fullsized":"2024-09-21T05:52:23.587685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:02.011213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596871+0000","last_change":"2024-09-21T05:51:50.257731+0000","last_active":"2024-09-21T05:52:23.596871+0000","last_peered":"2024-09-21T05:52:23.596871+0000","last_clean":"2024-09-21T05:52:23.596871+0000","last_became_active":"2024-09-21T05:51:50.257396+0000","last_became_peered":"2024-09-21T05:51:50.257396+0000","last_unstale":"2024-09-21T05:52:23.596871+0000","last_undegraded":"2024-09-21T05:52:23.596871+0000","last_fullsized":"2024-09-21T05:52:23.596871+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:58.109069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590778+0000","last_change":"2024-09-21T05:51:48.234067+0000","last_active":"2024-09-21T05:52:23.590778+0000","last_peered":"2024-09-21T05:52:23.590778+0000","last_clean":"2024-09-21T05:52:23.590778+0000","last_became_active":"2024-09-21T05:51:48.233532+0000","last_became_peered":"2024-09-21T05:51:48.233532+0000","last_unstale":"2024-09-21T05:52:23.590778+0000","last_undegraded":"2024-09-21T05:52:23.590778+0000","last_fullsized":"2024-09-21T05:52:23.590778+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:40.997254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703737+0000","last_change":"2024-09-21T05:51:50.265453+0000","last_active":"2024-09-21T05:52:23.703737+0000","last_peered":"2024-09-21T05:52:23.703737+0000","last_clean":"2024-09-21T05:52:23.703737+0000","last_became_active":"2024-09-21T05:51:50.265073+0000","last_became_peered":"2024-09-21T05:51:50.265073+0000","last_unstale":"2024-09-21T05:52:23.703737+0000","last_undegraded":"2024-09-21T05:52:23.703737+0000","last_fullsized":"2024-09-21T05:52:23.703737+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:15.295822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.694313+0000","last_change":"2024-09-21T05:52:23.694236+0000","last_active":"2024-09-21T05:52:23.694313+0000","last_peered":"2024-09-21T05:52:23.694313+0000","last_clean":"2024-09-21T05:52:23.694313+0000","last_became_active":"2024-09-21T05:52:23.688964+0000","last_became_peered":"2024-09-21T05:52:23.688964+0000","last_unstale":"2024-09-21T05:52:23.694313+0000","last_undegraded":"2024-09-21T05:52:23.694313+0000","last_fullsized":"2024-09-21T05:52:23.694313+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:25.453769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703860+0000","last_change":"2024-09-21T05:51:50.267110+0000","last_active":"2024-09-21T05:52:23.703860+0000","last_peered":"2024-09-21T05:52:23.703860+0000","last_clean":"2024-09-21T05:52:23.703860+0000","last_became_active":"2024-09-21T05:51:50.266504+0000","last_became_peered":"2024-09-21T05:51:50.266504+0000","last_unstale":"2024-09-21T05:52:23.703860+0000","last_undegraded":"2024-09-21T05:52:23.703860+0000","last_fullsized":"2024-09-21T05:52:23.703860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:10.618361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590428+0000","last_change":"2024-09-21T05:51:48.337971+0000","last_active":"2024-09-21T05:52:23.590428+0000","last_peered":"2024-09-21T05:52:23.590428+0000","last_clean":"2024-09-21T05:52:23.590428+0000","last_became_active":"2024-09-21T05:51:48.337487+0000","last_became_peered":"2024-09-21T05:51:48.337487+0000","last_unstale":"2024-09-21T05:52:23.590428+0000","last_undegraded":"2024-09-21T05:52:23.590428+0000","last_fullsized":"2024-09-21T05:52:23.590428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.150563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590264+0000","last_change":"2024-09-21T05:51:50.253826+0000","last_active":"2024-09-21T05:52:23.590264+0000","last_peered":"2024-09-21T05:52:23.590264+0000","last_clean":"2024-09-21T05:52:23.590264+0000","last_became_active":"2024-09-21T05:51:50.251700+0000","last_became_peered":"2024-09-21T05:51:50.251700+0000","last_unstale":"2024-09-21T05:52:23.590264+0000","last_undegraded":"2024-09-21T05:52:23.590264+0000","last_fullsized":"2024-09-21T05:52:23.590264+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:02.929651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587502+0000","last_change":"2024-09-21T05:51:48.234358+0000","last_active":"2024-09-21T05:52:23.587502+0000","last_peered":"2024-09-21T05:52:23.587502+0000","last_clean":"2024-09-21T05:52:23.587502+0000","last_became_active":"2024-09-21T05:51:48.233982+0000","last_became_peered":"2024-09-21T05:51:48.233982+0000","last_unstale":"2024-09-21T05:52:23.587502+0000","last_undegraded":"2024-09-21T05:52:23.587502+0000","last_fullsized":"2024-09-21T05:52:23.587502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:42.510872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67903,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":345,"num_read_kb":245,"num_write":164,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":203709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808858,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":819200,"data_stored":406831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972382,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36836,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708316,"statfs":{"total":95995035648,"available":95957315584,"internally_reserved":0,"allocated":1519616,"data_stored":1062605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168612,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":407067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332137,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":406987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528365,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1429504,"data_stored":998917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691891,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":823296,"data_stored":406456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855415,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36760,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708392,"statfs":{"total":95995035648,"available":95957393408,"internally_reserved":0,"allocated":1441792,"data_stored":998210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":827392,"data_stored":407284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":406767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378695,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":913408,"data_stored":471501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542219,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":888832,"data_stored":470151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40336,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704816,"statfs":{"total":95995035648,"available":95953731584,"internally_reserved":0,"allocated":843776,"data_stored":407727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:52:55.416 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:52:55.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:55 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:55.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:55 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:55.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:55 smithi119 ceph-mon[34833]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T05:52:55.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:55 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:52:55.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:55 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:52:55.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:55 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:55.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:55 smithi119 ceph-mon[34833]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:55.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:55 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:55.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:55 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:55.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:55 smithi027 ceph-mon[34364]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T05:52:55.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:55 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:52:55.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:55 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:52:55.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:55 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:52:55.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:55 smithi027 ceph-mon[34364]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:56.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.149+0000 7fe3233af640 1 -- 172.21.15.7:0/2170770841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe31c1083b0 msgr2=0x7fe31c1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:56.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.149+0000 7fe3233af640 1 --2- 172.21.15.7:0/2170770841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe31c1083b0 0x7fe31c1087c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009900 tx=0x7fe30c02a410 comp rx=0 tx=0).stop 2024-09-21T05:52:56.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.149+0000 7fe3233af640 1 -- 172.21.15.7:0/2170770841 shutdown_connections 2024-09-21T05:52:56.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.149+0000 7fe3233af640 1 --2- 172.21.15.7:0/2170770841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe31c1083b0 0x7fe31c1087c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:56.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.149+0000 7fe3233af640 1 --2- 172.21.15.7:0/2170770841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe31c108d00 0x7fe31c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:56.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.149+0000 7fe3233af640 1 --2- 172.21.15.7:0/2170770841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe31c102a70 0x7fe31c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:56.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.149+0000 7fe3233af640 1 -- 172.21.15.7:0/2170770841 >> 172.21.15.7:0/2170770841 conn(0x7fe31c079710 msgr2=0x7fe31c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:56.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.149+0000 7fe3233af640 1 -- 172.21.15.7:0/2170770841 shutdown_connections 2024-09-21T05:52:56.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.149+0000 7fe3233af640 1 -- 172.21.15.7:0/2170770841 wait complete. 2024-09-21T05:52:56.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.150+0000 7fe3233af640 1 Processor -- start 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.150+0000 7fe3233af640 1 -- start start 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.150+0000 7fe3233af640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe31c102a70 0x7fe31c19c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe3233af640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe31c1083b0 0x7fe31c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe3233af640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe31c108d00 0x7fe31c1a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe3233af640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c1129c0 con 0x7fe31c1083b0 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe3233af640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c112840 con 0x7fe31c102a70 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe3233af640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c112b40 con 0x7fe31c108d00 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe32094a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe31c1083b0 0x7fe31c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe32094a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe31c1083b0 0x7fe31c19cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49510/0 (socket says 172.21.15.7:49510) 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe32114b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe31c102a70 0x7fe31c19c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe32094a640 1 -- 172.21.15.7:0/411793557 learned_addr learned my addr 172.21.15.7:0/411793557 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe32194c640 1 --2- 172.21.15.7:0/411793557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe31c108d00 0x7fe31c1a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe32094a640 1 -- 172.21.15.7:0/411793557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe31c108d00 msgr2=0x7fe31c1a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:56.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe32094a640 1 --2- 172.21.15.7:0/411793557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe31c108d00 0x7fe31c1a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe32094a640 1 -- 172.21.15.7:0/411793557 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe31c102a70 msgr2=0x7fe31c19c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe32094a640 1 --2- 172.21.15.7:0/411793557 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe31c102a70 0x7fe31c19c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe32094a640 1 -- 172.21.15.7:0/411793557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c1a2560 con 0x7fe31c1083b0 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe32094a640 1 --2- 172.21.15.7:0/411793557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe31c1083b0 0x7fe31c19cc50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe30c006010 tx=0x7fe30c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe3127fc640 1 -- 172.21.15.7:0/411793557 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c03f030 con 0x7fe31c1083b0 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.151+0000 7fe3127fc640 1 -- 172.21.15.7:0/411793557 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe30c004460 con 0x7fe31c1083b0 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.152+0000 7fe3233af640 1 -- 172.21.15.7:0/411793557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31c1a27f0 con 0x7fe31c1083b0 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.152+0000 7fe3127fc640 1 -- 172.21.15.7:0/411793557 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c035070 con 0x7fe31c1083b0 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.152+0000 7fe3233af640 1 -- 172.21.15.7:0/411793557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31c1a2cd0 con 0x7fe31c1083b0 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.153+0000 7fe3233af640 1 -- 172.21.15.7:0/411793557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31c103cf0 con 0x7fe31c1083b0 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.154+0000 7fe3127fc640 1 -- 172.21.15.7:0/411793557 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fe30c042030 con 0x7fe31c1083b0 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.155+0000 7fe3127fc640 1 --2- 172.21.15.7:0/411793557 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe3080b6620 0x7fe3080b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.155+0000 7fe32114b640 1 --2- 172.21.15.7:0/411793557 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe3080b6620 0x7fe3080b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:56.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.155+0000 7fe3127fc640 1 -- 172.21.15.7:0/411793557 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fe30c107920 con 0x7fe31c1083b0 2024-09-21T05:52:56.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.155+0000 7fe32114b640 1 --2- 172.21.15.7:0/411793557 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe3080b6620 0x7fe3080b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe31800abe0 tx=0x7fe31800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:56.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.159+0000 7fe3127fc640 1 -- 172.21.15.7:0/411793557 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe30c0cdfb0 con 0x7fe31c1083b0 2024-09-21T05:52:56.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.346+0000 7fe3233af640 1 -- 172.21.15.7:0/411793557 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe31c063800 con 0x7fe3080b6620 2024-09-21T05:52:56.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.350+0000 7fe3127fc640 1 -- 172.21.15.7:0/411793557 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258703 (secure 0 0 0) 0x7fe31c063800 con 0x7fe3080b6620 2024-09-21T05:52:56.355 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:52:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T05:52:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.353+0000 7fe3233af640 1 -- 172.21.15.7:0/411793557 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe3080b6620 msgr2=0x7fe3080b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.353+0000 7fe3233af640 1 --2- 172.21.15.7:0/411793557 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe3080b6620 0x7fe3080b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe31800abe0 tx=0x7fe31800a2d0 comp rx=0 tx=0).stop 2024-09-21T05:52:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.353+0000 7fe3233af640 1 -- 172.21.15.7:0/411793557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe31c1083b0 msgr2=0x7fe31c19cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.353+0000 7fe3233af640 1 --2- 172.21.15.7:0/411793557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe31c1083b0 0x7fe31c19cc50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe30c006010 tx=0x7fe30c004060 comp rx=0 tx=0).stop 2024-09-21T05:52:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.353+0000 7fe3233af640 1 -- 172.21.15.7:0/411793557 shutdown_connections 2024-09-21T05:52:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.353+0000 7fe3233af640 1 --2- 172.21.15.7:0/411793557 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe3080b6620 0x7fe3080b8b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.353+0000 7fe3233af640 1 --2- 172.21.15.7:0/411793557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe31c1083b0 0x7fe31c19cc50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:56.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.353+0000 7fe3233af640 1 --2- 172.21.15.7:0/411793557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe31c108d00 0x7fe31c1a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:56.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.353+0000 7fe3233af640 1 --2- 172.21.15.7:0/411793557 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe31c102a70 0x7fe31c19c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:56.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.353+0000 7fe3233af640 1 -- 172.21.15.7:0/411793557 >> 172.21.15.7:0/411793557 conn(0x7fe31c079710 msgr2=0x7fe31c1065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:56.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.354+0000 7fe3233af640 1 -- 172.21.15.7:0/411793557 shutdown_connections 2024-09-21T05:52:56.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:56.354+0000 7fe3233af640 1 -- 172.21.15.7:0/411793557 wait complete. 2024-09-21T05:52:57.068 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-09-21T05:52:54.480587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658505,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":426,"num_read_kb":314,"num_write":289,"num_write_kb":2267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2951840,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390192,"kb_used_data":11736,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551632,"statfs":{"total":1151940427776,"available":1151540871168,"internally_reserved":0,"allocated":12017664,"data_stored":6850503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003342"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590625+0000","last_change":"2024-09-21T05:51:50.266316+0000","last_active":"2024-09-21T05:52:23.590625+0000","last_peered":"2024-09-21T05:52:23.590625+0000","last_clean":"2024-09-21T05:52:23.590625+0000","last_became_active":"2024-09-21T05:51:50.265970+0000","last_became_peered":"2024-09-21T05:51:50.265970+0000","last_unstale":"2024-09-21T05:52:23.590625+0000","last_undegraded":"2024-09-21T05:52:23.590625+0000","last_fullsized":"2024-09-21T05:52:23.590625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:31.728635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703754+0000","last_change":"2024-09-21T05:51:50.254215+0000","last_active":"2024-09-21T05:52:23.703754+0000","last_peered":"2024-09-21T05:52:23.703754+0000","last_clean":"2024-09-21T05:52:23.703754+0000","last_became_active":"2024-09-21T05:51:50.253701+0000","last_became_peered":"2024-09-21T05:51:50.253701+0000","last_unstale":"2024-09-21T05:52:23.703754+0000","last_undegraded":"2024-09-21T05:52:23.703754+0000","last_fullsized":"2024-09-21T05:52:23.703754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:56.211706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703707+0000","last_change":"2024-09-21T05:51:50.258535+0000","last_active":"2024-09-21T05:52:23.703707+0000","last_peered":"2024-09-21T05:52:23.703707+0000","last_clean":"2024-09-21T05:52:23.703707+0000","last_became_active":"2024-09-21T05:51:50.258186+0000","last_became_peered":"2024-09-21T05:51:50.258186+0000","last_unstale":"2024-09-21T05:52:23.703707+0000","last_undegraded":"2024-09-21T05:52:23.703707+0000","last_fullsized":"2024-09-21T05:52:23.703707+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:15.134574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.687728+0000","last_change":"2024-09-21T05:51:50.254832+0000","last_active":"2024-09-21T05:52:23.687728+0000","last_peered":"2024-09-21T05:52:23.687728+0000","last_clean":"2024-09-21T05:52:23.687728+0000","last_became_active":"2024-09-21T05:51:50.254449+0000","last_became_peered":"2024-09-21T05:51:50.254449+0000","last_unstale":"2024-09-21T05:52:23.687728+0000","last_undegraded":"2024-09-21T05:52:23.687728+0000","last_fullsized":"2024-09-21T05:52:23.687728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:31.411808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589809+0000","last_change":"2024-09-21T05:51:50.251144+0000","last_active":"2024-09-21T05:52:23.589809+0000","last_peered":"2024-09-21T05:52:23.589809+0000","last_clean":"2024-09-21T05:52:23.589809+0000","last_became_active":"2024-09-21T05:51:50.250782+0000","last_became_peered":"2024-09-21T05:51:50.250782+0000","last_unstale":"2024-09-21T05:52:23.589809+0000","last_undegraded":"2024-09-21T05:52:23.589809+0000","last_fullsized":"2024-09-21T05:52:23.589809+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:15.055805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.585358+0000","last_change":"2024-09-21T05:51:50.259758+0000","last_active":"2024-09-21T05:52:23.585358+0000","last_peered":"2024-09-21T05:52:23.585358+0000","last_clean":"2024-09-21T05:52:23.585358+0000","last_became_active":"2024-09-21T05:51:50.259358+0000","last_became_peered":"2024-09-21T05:51:50.259358+0000","last_unstale":"2024-09-21T05:52:23.585358+0000","last_undegraded":"2024-09-21T05:52:23.585358+0000","last_fullsized":"2024-09-21T05:52:23.585358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:08.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587243+0000","last_change":"2024-09-21T05:51:50.260018+0000","last_active":"2024-09-21T05:52:23.587243+0000","last_peered":"2024-09-21T05:52:23.587243+0000","last_clean":"2024-09-21T05:52:23.587243+0000","last_became_active":"2024-09-21T05:51:50.257143+0000","last_became_peered":"2024-09-21T05:51:50.257143+0000","last_unstale":"2024-09-21T05:52:23.587243+0000","last_undegraded":"2024-09-21T05:52:23.587243+0000","last_fullsized":"2024-09-21T05:52:23.587243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:05.579662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589326+0000","last_change":"2024-09-21T05:51:50.256867+0000","last_active":"2024-09-21T05:52:23.589326+0000","last_peered":"2024-09-21T05:52:23.589326+0000","last_clean":"2024-09-21T05:52:23.589326+0000","last_became_active":"2024-09-21T05:51:50.256392+0000","last_became_peered":"2024-09-21T05:51:50.256392+0000","last_unstale":"2024-09-21T05:52:23.589326+0000","last_undegraded":"2024-09-21T05:52:23.589326+0000","last_fullsized":"2024-09-21T05:52:23.589326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:43.169607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.704260+0000","last_change":"2024-09-21T05:51:50.260430+0000","last_active":"2024-09-21T05:52:23.704260+0000","last_peered":"2024-09-21T05:52:23.704260+0000","last_clean":"2024-09-21T05:52:23.704260+0000","last_became_active":"2024-09-21T05:51:50.259993+0000","last_became_peered":"2024-09-21T05:51:50.259993+0000","last_unstale":"2024-09-21T05:52:23.704260+0000","last_undegraded":"2024-09-21T05:52:23.704260+0000","last_fullsized":"2024-09-21T05:52:23.704260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:31.811151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.586095+0000","last_change":"2024-09-21T05:51:50.263027+0000","last_active":"2024-09-21T05:52:23.586095+0000","last_peered":"2024-09-21T05:52:23.586095+0000","last_clean":"2024-09-21T05:52:23.586095+0000","last_became_active":"2024-09-21T05:51:50.261816+0000","last_became_peered":"2024-09-21T05:51:50.261816+0000","last_unstale":"2024-09-21T05:52:23.586095+0000","last_undegraded":"2024-09-21T05:52:23.586095+0000","last_fullsized":"2024-09-21T05:52:23.586095+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:39.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587722+0000","last_change":"2024-09-21T05:51:50.263976+0000","last_active":"2024-09-21T05:52:23.587722+0000","last_peered":"2024-09-21T05:52:23.587722+0000","last_clean":"2024-09-21T05:52:23.587722+0000","last_became_active":"2024-09-21T05:51:50.263179+0000","last_became_peered":"2024-09-21T05:51:50.263179+0000","last_unstale":"2024-09-21T05:52:23.587722+0000","last_undegraded":"2024-09-21T05:52:23.587722+0000","last_fullsized":"2024-09-21T05:52:23.587722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:08.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.687787+0000","last_change":"2024-09-21T05:51:50.259967+0000","last_active":"2024-09-21T05:52:23.687787+0000","last_peered":"2024-09-21T05:52:23.687787+0000","last_clean":"2024-09-21T05:52:23.687787+0000","last_became_active":"2024-09-21T05:51:50.259460+0000","last_became_peered":"2024-09-21T05:51:50.259460+0000","last_unstale":"2024-09-21T05:52:23.687787+0000","last_undegraded":"2024-09-21T05:52:23.687787+0000","last_fullsized":"2024-09-21T05:52:23.687787+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:48.576362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584168+0000","last_change":"2024-09-21T05:51:50.252949+0000","last_active":"2024-09-21T05:52:23.584168+0000","last_peered":"2024-09-21T05:52:23.584168+0000","last_clean":"2024-09-21T05:52:23.584168+0000","last_became_active":"2024-09-21T05:51:50.252518+0000","last_became_peered":"2024-09-21T05:51:50.252518+0000","last_unstale":"2024-09-21T05:52:23.584168+0000","last_undegraded":"2024-09-21T05:52:23.584168+0000","last_fullsized":"2024-09-21T05:52:23.584168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:38.145947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703470+0000","last_change":"2024-09-21T05:51:50.250309+0000","last_active":"2024-09-21T05:52:23.703470+0000","last_peered":"2024-09-21T05:52:23.703470+0000","last_clean":"2024-09-21T05:52:23.703470+0000","last_became_active":"2024-09-21T05:51:50.249629+0000","last_became_peered":"2024-09-21T05:51:50.249629+0000","last_unstale":"2024-09-21T05:52:23.703470+0000","last_undegraded":"2024-09-21T05:52:23.703470+0000","last_fullsized":"2024-09-21T05:52:23.703470+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:28.551654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703437+0000","last_change":"2024-09-21T05:51:50.242211+0000","last_active":"2024-09-21T05:52:23.703437+0000","last_peered":"2024-09-21T05:52:23.703437+0000","last_clean":"2024-09-21T05:52:23.703437+0000","last_became_active":"2024-09-21T05:51:50.241861+0000","last_became_peered":"2024-09-21T05:51:50.241861+0000","last_unstale":"2024-09-21T05:52:23.703437+0000","last_undegraded":"2024-09-21T05:52:23.703437+0000","last_fullsized":"2024-09-21T05:52:23.703437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:46.045907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703677+0000","last_change":"2024-09-21T05:51:50.268926+0000","last_active":"2024-09-21T05:52:23.703677+0000","last_peered":"2024-09-21T05:52:23.703677+0000","last_clean":"2024-09-21T05:52:23.703677+0000","last_became_active":"2024-09-21T05:51:50.268164+0000","last_became_peered":"2024-09-21T05:51:50.268164+0000","last_unstale":"2024-09-21T05:52:23.703677+0000","last_undegraded":"2024-09-21T05:52:23.703677+0000","last_fullsized":"2024-09-21T05:52:23.703677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:43.021303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590750+0000","last_change":"2024-09-21T05:51:50.266365+0000","last_active":"2024-09-21T05:52:23.590750+0000","last_peered":"2024-09-21T05:52:23.590750+0000","last_clean":"2024-09-21T05:52:23.590750+0000","last_became_active":"2024-09-21T05:51:50.265803+0000","last_became_peered":"2024-09-21T05:51:50.265803+0000","last_unstale":"2024-09-21T05:52:23.590750+0000","last_undegraded":"2024-09-21T05:52:23.590750+0000","last_fullsized":"2024-09-21T05:52:23.590750+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:45.574795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587368+0000","last_change":"2024-09-21T05:51:50.257129+0000","last_active":"2024-09-21T05:52:23.587368+0000","last_peered":"2024-09-21T05:52:23.587368+0000","last_clean":"2024-09-21T05:52:23.587368+0000","last_became_active":"2024-09-21T05:51:50.256721+0000","last_became_peered":"2024-09-21T05:51:50.256721+0000","last_unstale":"2024-09-21T05:52:23.587368+0000","last_undegraded":"2024-09-21T05:52:23.587368+0000","last_fullsized":"2024-09-21T05:52:23.587368+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:26.688743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587645+0000","last_change":"2024-09-21T05:51:50.243460+0000","last_active":"2024-09-21T05:52:23.587645+0000","last_peered":"2024-09-21T05:52:23.587645+0000","last_clean":"2024-09-21T05:52:23.587645+0000","last_became_active":"2024-09-21T05:51:50.243094+0000","last_became_peered":"2024-09-21T05:51:50.243094+0000","last_unstale":"2024-09-21T05:52:23.587645+0000","last_undegraded":"2024-09-21T05:52:23.587645+0000","last_fullsized":"2024-09-21T05:52:23.587645+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:16.751564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.595819+0000","last_change":"2024-09-21T05:52:23.595697+0000","last_active":"2024-09-21T05:52:23.595819+0000","last_peered":"2024-09-21T05:52:23.595819+0000","last_clean":"2024-09-21T05:52:23.595819+0000","last_became_active":"2024-09-21T05:52:23.595173+0000","last_became_peered":"2024-09-21T05:52:23.595173+0000","last_unstale":"2024-09-21T05:52:23.595819+0000","last_undegraded":"2024-09-21T05:52:23.595819+0000","last_fullsized":"2024-09-21T05:52:23.595819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.036215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584294+0000","last_change":"2024-09-21T05:51:50.251288+0000","last_active":"2024-09-21T05:52:23.584294+0000","last_peered":"2024-09-21T05:52:23.584294+0000","last_clean":"2024-09-21T05:52:23.584294+0000","last_became_active":"2024-09-21T05:51:50.250841+0000","last_became_peered":"2024-09-21T05:51:50.250841+0000","last_unstale":"2024-09-21T05:52:23.584294+0000","last_undegraded":"2024-09-21T05:52:23.584294+0000","last_fullsized":"2024-09-21T05:52:23.584294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:44.196822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703980+0000","last_change":"2024-09-21T05:51:50.259418+0000","last_active":"2024-09-21T05:52:23.703980+0000","last_peered":"2024-09-21T05:52:23.703980+0000","last_clean":"2024-09-21T05:52:23.703980+0000","last_became_active":"2024-09-21T05:51:50.257641+0000","last_became_peered":"2024-09-21T05:51:50.257641+0000","last_unstale":"2024-09-21T05:52:23.703980+0000","last_undegraded":"2024-09-21T05:52:23.703980+0000","last_fullsized":"2024-09-21T05:52:23.703980+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:23.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589491+0000","last_change":"2024-09-21T05:51:50.252746+0000","last_active":"2024-09-21T05:52:23.589491+0000","last_peered":"2024-09-21T05:52:23.589491+0000","last_clean":"2024-09-21T05:52:23.589491+0000","last_became_active":"2024-09-21T05:51:50.250551+0000","last_became_peered":"2024-09-21T05:51:50.250551+0000","last_unstale":"2024-09-21T05:52:23.589491+0000","last_undegraded":"2024-09-21T05:52:23.589491+0000","last_fullsized":"2024-09-21T05:52:23.589491+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:05.821737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596144+0000","last_change":"2024-09-21T05:51:50.246170+0000","last_active":"2024-09-21T05:52:23.596144+0000","last_peered":"2024-09-21T05:52:23.596144+0000","last_clean":"2024-09-21T05:52:23.596144+0000","last_became_active":"2024-09-21T05:51:50.245747+0000","last_became_peered":"2024-09-21T05:51:50.245747+0000","last_unstale":"2024-09-21T05:52:23.596144+0000","last_undegraded":"2024-09-21T05:52:23.596144+0000","last_fullsized":"2024-09-21T05:52:23.596144+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:05.005437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590264+0000","last_change":"2024-09-21T05:51:50.258248+0000","last_active":"2024-09-21T05:52:23.590264+0000","last_peered":"2024-09-21T05:52:23.590264+0000","last_clean":"2024-09-21T05:52:23.590264+0000","last_became_active":"2024-09-21T05:51:50.257891+0000","last_became_peered":"2024-09-21T05:51:50.257891+0000","last_unstale":"2024-09-21T05:52:23.590264+0000","last_undegraded":"2024-09-21T05:52:23.590264+0000","last_fullsized":"2024-09-21T05:52:23.590264+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:44.093064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587701+0000","last_change":"2024-09-21T05:51:50.258497+0000","last_active":"2024-09-21T05:52:23.587701+0000","last_peered":"2024-09-21T05:52:23.587701+0000","last_clean":"2024-09-21T05:52:23.587701+0000","last_became_active":"2024-09-21T05:51:50.257633+0000","last_became_peered":"2024-09-21T05:51:50.257633+0000","last_unstale":"2024-09-21T05:52:23.587701+0000","last_undegraded":"2024-09-21T05:52:23.587701+0000","last_fullsized":"2024-09-21T05:52:23.587701+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:41.793650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591006+0000","last_change":"2024-09-21T05:51:50.255336+0000","last_active":"2024-09-21T05:52:23.591006+0000","last_peered":"2024-09-21T05:52:23.591006+0000","last_clean":"2024-09-21T05:52:23.591006+0000","last_became_active":"2024-09-21T05:51:50.254955+0000","last_became_peered":"2024-09-21T05:51:50.254955+0000","last_unstale":"2024-09-21T05:52:23.591006+0000","last_undegraded":"2024-09-21T05:52:23.591006+0000","last_fullsized":"2024-09-21T05:52:23.591006+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:28.198455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584145+0000","last_change":"2024-09-21T05:51:50.242391+0000","last_active":"2024-09-21T05:52:23.584145+0000","last_peered":"2024-09-21T05:52:23.584145+0000","last_clean":"2024-09-21T05:52:23.584145+0000","last_became_active":"2024-09-21T05:51:50.242055+0000","last_became_peered":"2024-09-21T05:51:50.242055+0000","last_unstale":"2024-09-21T05:52:23.584145+0000","last_undegraded":"2024-09-21T05:52:23.584145+0000","last_fullsized":"2024-09-21T05:52:23.584145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:48.937516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703613+0000","last_change":"2024-09-21T05:51:50.243343+0000","last_active":"2024-09-21T05:52:23.703613+0000","last_peered":"2024-09-21T05:52:23.703613+0000","last_clean":"2024-09-21T05:52:23.703613+0000","last_became_active":"2024-09-21T05:51:50.243005+0000","last_became_peered":"2024-09-21T05:51:50.243005+0000","last_unstale":"2024-09-21T05:52:23.703613+0000","last_undegraded":"2024-09-21T05:52:23.703613+0000","last_fullsized":"2024-09-21T05:52:23.703613+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:51.975966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587154+0000","last_change":"2024-09-21T05:51:50.250290+0000","last_active":"2024-09-21T05:52:23.587154+0000","last_peered":"2024-09-21T05:52:23.587154+0000","last_clean":"2024-09-21T05:52:23.587154+0000","last_became_active":"2024-09-21T05:51:50.249867+0000","last_became_peered":"2024-09-21T05:51:50.249867+0000","last_unstale":"2024-09-21T05:52:23.587154+0000","last_undegraded":"2024-09-21T05:52:23.587154+0000","last_fullsized":"2024-09-21T05:52:23.587154+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:33.852383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587202+0000","last_change":"2024-09-21T05:51:50.244908+0000","last_active":"2024-09-21T05:52:23.587202+0000","last_peered":"2024-09-21T05:52:23.587202+0000","last_clean":"2024-09-21T05:52:23.587202+0000","last_became_active":"2024-09-21T05:51:50.244473+0000","last_became_peered":"2024-09-21T05:51:50.244473+0000","last_unstale":"2024-09-21T05:52:23.587202+0000","last_undegraded":"2024-09-21T05:52:23.587202+0000","last_fullsized":"2024-09-21T05:52:23.587202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:08.040920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589800+0000","last_change":"2024-09-21T05:51:50.259926+0000","last_active":"2024-09-21T05:52:23.589800+0000","last_peered":"2024-09-21T05:52:23.589800+0000","last_clean":"2024-09-21T05:52:23.589800+0000","last_became_active":"2024-09-21T05:51:50.259511+0000","last_became_peered":"2024-09-21T05:51:50.259511+0000","last_unstale":"2024-09-21T05:52:23.589800+0000","last_undegraded":"2024-09-21T05:52:23.589800+0000","last_fullsized":"2024-09-21T05:52:23.589800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:46.735741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589813+0000","last_change":"2024-09-21T05:51:50.249474+0000","last_active":"2024-09-21T05:52:23.589813+0000","last_peered":"2024-09-21T05:52:23.589813+0000","last_clean":"2024-09-21T05:52:23.589813+0000","last_became_active":"2024-09-21T05:51:50.247503+0000","last_became_peered":"2024-09-21T05:51:50.247503+0000","last_unstale":"2024-09-21T05:52:23.589813+0000","last_undegraded":"2024-09-21T05:52:23.589813+0000","last_fullsized":"2024-09-21T05:52:23.589813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:11.639218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":80,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.408678+0000","last_change":"2024-09-21T05:51:48.236001+0000","last_active":"2024-09-21T05:52:48.408678+0000","last_peered":"2024-09-21T05:52:48.408678+0000","last_clean":"2024-09-21T05:52:48.408678+0000","last_became_active":"2024-09-21T05:51:48.235603+0000","last_became_peered":"2024-09-21T05:51:48.235603+0000","last_unstale":"2024-09-21T05:52:48.408678+0000","last_undegraded":"2024-09-21T05:52:48.408678+0000","last_fullsized":"2024-09-21T05:52:48.408678+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:33.217248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.599234+0000","last_change":"2024-09-21T05:52:23.599125+0000","last_active":"2024-09-21T05:52:23.599234+0000","last_peered":"2024-09-21T05:52:23.599234+0000","last_clean":"2024-09-21T05:52:23.599234+0000","last_became_active":"2024-09-21T05:52:23.598739+0000","last_became_peered":"2024-09-21T05:52:23.598739+0000","last_unstale":"2024-09-21T05:52:23.599234+0000","last_undegraded":"2024-09-21T05:52:23.599234+0000","last_fullsized":"2024-09-21T05:52:23.599234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:20.838698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.585476+0000","last_change":"2024-09-21T05:51:48.230191+0000","last_active":"2024-09-21T05:52:23.585476+0000","last_peered":"2024-09-21T05:52:23.585476+0000","last_clean":"2024-09-21T05:52:23.585476+0000","last_became_active":"2024-09-21T05:51:48.229780+0000","last_became_peered":"2024-09-21T05:51:48.229780+0000","last_unstale":"2024-09-21T05:52:23.585476+0000","last_undegraded":"2024-09-21T05:52:23.585476+0000","last_fullsized":"2024-09-21T05:52:23.585476+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:34.950404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584118+0000","last_change":"2024-09-21T05:51:48.224115+0000","last_active":"2024-09-21T05:52:23.584118+0000","last_peered":"2024-09-21T05:52:23.584118+0000","last_clean":"2024-09-21T05:52:23.584118+0000","last_became_active":"2024-09-21T05:51:48.223714+0000","last_became_peered":"2024-09-21T05:51:48.223714+0000","last_unstale":"2024-09-21T05:52:23.584118+0000","last_undegraded":"2024-09-21T05:52:23.584118+0000","last_fullsized":"2024-09-21T05:52:23.584118+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:29.450354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589402+0000","last_change":"2024-09-21T05:51:50.250129+0000","last_active":"2024-09-21T05:52:23.589402+0000","last_peered":"2024-09-21T05:52:23.589402+0000","last_clean":"2024-09-21T05:52:23.589402+0000","last_became_active":"2024-09-21T05:51:50.249743+0000","last_became_peered":"2024-09-21T05:51:50.249743+0000","last_unstale":"2024-09-21T05:52:23.589402+0000","last_undegraded":"2024-09-21T05:52:23.589402+0000","last_fullsized":"2024-09-21T05:52:23.589402+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:37.204476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596516+0000","last_change":"2024-09-21T05:51:48.236289+0000","last_active":"2024-09-21T05:52:23.596516+0000","last_peered":"2024-09-21T05:52:23.596516+0000","last_clean":"2024-09-21T05:52:23.596516+0000","last_became_active":"2024-09-21T05:51:48.235898+0000","last_became_peered":"2024-09-21T05:51:48.235898+0000","last_unstale":"2024-09-21T05:52:23.596516+0000","last_undegraded":"2024-09-21T05:52:23.596516+0000","last_fullsized":"2024-09-21T05:52:23.596516+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:05.457237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587120+0000","last_change":"2024-09-21T05:51:50.251905+0000","last_active":"2024-09-21T05:52:23.587120+0000","last_peered":"2024-09-21T05:52:23.587120+0000","last_clean":"2024-09-21T05:52:23.587120+0000","last_became_active":"2024-09-21T05:51:50.251537+0000","last_became_peered":"2024-09-21T05:51:50.251537+0000","last_unstale":"2024-09-21T05:52:23.587120+0000","last_undegraded":"2024-09-21T05:52:23.587120+0000","last_fullsized":"2024-09-21T05:52:23.587120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:57.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:51.412524+0000","last_change":"2024-09-21T05:51:48.232007+0000","last_active":"2024-09-21T05:52:51.412524+0000","last_peered":"2024-09-21T05:52:51.412524+0000","last_clean":"2024-09-21T05:52:51.412524+0000","last_became_active":"2024-09-21T05:51:48.231534+0000","last_became_peered":"2024-09-21T05:51:48.231534+0000","last_unstale":"2024-09-21T05:52:51.412524+0000","last_undegraded":"2024-09-21T05:52:51.412524+0000","last_fullsized":"2024-09-21T05:52:51.412524+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:05.874618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.704110+0000","last_change":"2024-09-21T05:51:50.265224+0000","last_active":"2024-09-21T05:52:23.704110+0000","last_peered":"2024-09-21T05:52:23.704110+0000","last_clean":"2024-09-21T05:52:23.704110+0000","last_became_active":"2024-09-21T05:51:50.264690+0000","last_became_peered":"2024-09-21T05:51:50.264690+0000","last_unstale":"2024-09-21T05:52:23.704110+0000","last_undegraded":"2024-09-21T05:52:23.704110+0000","last_fullsized":"2024-09-21T05:52:23.704110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:15.835492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587907+0000","last_change":"2024-09-21T05:51:48.233092+0000","last_active":"2024-09-21T05:52:23.587907+0000","last_peered":"2024-09-21T05:52:23.587907+0000","last_clean":"2024-09-21T05:52:23.587907+0000","last_became_active":"2024-09-21T05:51:48.232684+0000","last_became_peered":"2024-09-21T05:51:48.232684+0000","last_unstale":"2024-09-21T05:52:23.587907+0000","last_undegraded":"2024-09-21T05:52:23.587907+0000","last_fullsized":"2024-09-21T05:52:23.587907+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:21.664828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703881+0000","last_change":"2024-09-21T05:51:50.248419+0000","last_active":"2024-09-21T05:52:23.703881+0000","last_peered":"2024-09-21T05:52:23.703881+0000","last_clean":"2024-09-21T05:52:23.703881+0000","last_became_active":"2024-09-21T05:51:50.247871+0000","last_became_peered":"2024-09-21T05:51:50.247871+0000","last_unstale":"2024-09-21T05:52:23.703881+0000","last_undegraded":"2024-09-21T05:52:23.703881+0000","last_fullsized":"2024-09-21T05:52:23.703881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:49.851685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596905+0000","last_change":"2024-09-21T05:51:48.338367+0000","last_active":"2024-09-21T05:52:23.596905+0000","last_peered":"2024-09-21T05:52:23.596905+0000","last_clean":"2024-09-21T05:52:23.596905+0000","last_became_active":"2024-09-21T05:51:48.337992+0000","last_became_peered":"2024-09-21T05:51:48.337992+0000","last_unstale":"2024-09-21T05:52:23.596905+0000","last_undegraded":"2024-09-21T05:52:23.596905+0000","last_fullsized":"2024-09-21T05:52:23.596905+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:52.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703856+0000","last_change":"2024-09-21T05:51:50.267046+0000","last_active":"2024-09-21T05:52:23.703856+0000","last_peered":"2024-09-21T05:52:23.703856+0000","last_clean":"2024-09-21T05:52:23.703856+0000","last_became_active":"2024-09-21T05:51:50.266672+0000","last_became_peered":"2024-09-21T05:51:50.266672+0000","last_unstale":"2024-09-21T05:52:23.703856+0000","last_undegraded":"2024-09-21T05:52:23.703856+0000","last_fullsized":"2024-09-21T05:52:23.703856+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:53.628646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'28","reported_seq":166,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:52.414101+0000","last_change":"2024-09-21T05:51:48.233804+0000","last_active":"2024-09-21T05:52:52.414101+0000","last_peered":"2024-09-21T05:52:52.414101+0000","last_clean":"2024-09-21T05:52:52.414101+0000","last_became_active":"2024-09-21T05:51:48.233386+0000","last_became_peered":"2024-09-21T05:51:48.233386+0000","last_unstale":"2024-09-21T05:52:52.414101+0000","last_undegraded":"2024-09-21T05:52:52.414101+0000","last_fullsized":"2024-09-21T05:52:52.414101+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:45.644005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63902,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":115,"num_read_kb":119,"num_write":29,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590604+0000","last_change":"2024-09-21T05:51:50.257673+0000","last_active":"2024-09-21T05:52:23.590604+0000","last_peered":"2024-09-21T05:52:23.590604+0000","last_clean":"2024-09-21T05:52:23.590604+0000","last_became_active":"2024-09-21T05:51:50.257319+0000","last_became_peered":"2024-09-21T05:51:50.257319+0000","last_unstale":"2024-09-21T05:52:23.590604+0000","last_undegraded":"2024-09-21T05:52:23.590604+0000","last_fullsized":"2024-09-21T05:52:23.590604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:26.008964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587400+0000","last_change":"2024-09-21T05:51:48.233264+0000","last_active":"2024-09-21T05:52:23.587400+0000","last_peered":"2024-09-21T05:52:23.587400+0000","last_clean":"2024-09-21T05:52:23.587400+0000","last_became_active":"2024-09-21T05:51:48.232808+0000","last_became_peered":"2024-09-21T05:51:48.232808+0000","last_unstale":"2024-09-21T05:52:23.587400+0000","last_undegraded":"2024-09-21T05:52:23.587400+0000","last_fullsized":"2024-09-21T05:52:23.587400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:05.105861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.583952+0000","last_change":"2024-09-21T05:51:50.251727+0000","last_active":"2024-09-21T05:52:23.583952+0000","last_peered":"2024-09-21T05:52:23.583952+0000","last_clean":"2024-09-21T05:52:23.583952+0000","last_became_active":"2024-09-21T05:51:50.251382+0000","last_became_peered":"2024-09-21T05:51:50.251382+0000","last_unstale":"2024-09-21T05:52:23.583952+0000","last_undegraded":"2024-09-21T05:52:23.583952+0000","last_fullsized":"2024-09-21T05:52:23.583952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:30.098548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596648+0000","last_change":"2024-09-21T05:51:48.235226+0000","last_active":"2024-09-21T05:52:23.596648+0000","last_peered":"2024-09-21T05:52:23.596648+0000","last_clean":"2024-09-21T05:52:23.596648+0000","last_became_active":"2024-09-21T05:51:48.234432+0000","last_became_peered":"2024-09-21T05:51:48.234432+0000","last_unstale":"2024-09-21T05:52:23.596648+0000","last_undegraded":"2024-09-21T05:52:23.596648+0000","last_fullsized":"2024-09-21T05:52:23.596648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:49.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587958+0000","last_change":"2024-09-21T05:51:50.260276+0000","last_active":"2024-09-21T05:52:23.587958+0000","last_peered":"2024-09-21T05:52:23.587958+0000","last_clean":"2024-09-21T05:52:23.587958+0000","last_became_active":"2024-09-21T05:51:50.257448+0000","last_became_peered":"2024-09-21T05:51:50.257448+0000","last_unstale":"2024-09-21T05:52:23.587958+0000","last_undegraded":"2024-09-21T05:52:23.587958+0000","last_fullsized":"2024-09-21T05:52:23.587958+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:46.052226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:52.415076+0000","last_change":"2024-09-21T05:51:48.230764+0000","last_active":"2024-09-21T05:52:52.415076+0000","last_peered":"2024-09-21T05:52:52.415076+0000","last_clean":"2024-09-21T05:52:52.415076+0000","last_became_active":"2024-09-21T05:51:48.230332+0000","last_became_peered":"2024-09-21T05:51:48.230332+0000","last_unstale":"2024-09-21T05:52:52.415076+0000","last_undegraded":"2024-09-21T05:52:52.415076+0000","last_fullsized":"2024-09-21T05:52:52.415076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:33.459588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590129+0000","last_change":"2024-09-21T05:52:23.589989+0000","last_active":"2024-09-21T05:52:23.590129+0000","last_peered":"2024-09-21T05:52:23.590129+0000","last_clean":"2024-09-21T05:52:23.590129+0000","last_became_active":"2024-09-21T05:52:23.589358+0000","last_became_peered":"2024-09-21T05:52:23.589358+0000","last_unstale":"2024-09-21T05:52:23.590129+0000","last_undegraded":"2024-09-21T05:52:23.590129+0000","last_fullsized":"2024-09-21T05:52:23.590129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:48.706509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589658+0000","last_change":"2024-09-21T05:51:48.338309+0000","last_active":"2024-09-21T05:52:23.589658+0000","last_peered":"2024-09-21T05:52:23.589658+0000","last_clean":"2024-09-21T05:52:23.589658+0000","last_became_active":"2024-09-21T05:51:48.337903+0000","last_became_peered":"2024-09-21T05:51:48.337903+0000","last_unstale":"2024-09-21T05:52:23.589658+0000","last_undegraded":"2024-09-21T05:52:23.589658+0000","last_fullsized":"2024-09-21T05:52:23.589658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:54.634956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.595791+0000","last_change":"2024-09-21T05:51:50.259257+0000","last_active":"2024-09-21T05:52:23.595791+0000","last_peered":"2024-09-21T05:52:23.595791+0000","last_clean":"2024-09-21T05:52:23.595791+0000","last_became_active":"2024-09-21T05:51:50.258892+0000","last_became_peered":"2024-09-21T05:51:50.258892+0000","last_unstale":"2024-09-21T05:52:23.595791+0000","last_undegraded":"2024-09-21T05:52:23.595791+0000","last_fullsized":"2024-09-21T05:52:23.595791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:46.683115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591128+0000","last_change":"2024-09-21T05:51:48.226956+0000","last_active":"2024-09-21T05:52:23.591128+0000","last_peered":"2024-09-21T05:52:23.591128+0000","last_clean":"2024-09-21T05:52:23.591128+0000","last_became_active":"2024-09-21T05:51:48.226531+0000","last_became_peered":"2024-09-21T05:51:48.226531+0000","last_unstale":"2024-09-21T05:52:23.591128+0000","last_undegraded":"2024-09-21T05:52:23.591128+0000","last_fullsized":"2024-09-21T05:52:23.591128+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:14.888074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591095+0000","last_change":"2024-09-21T05:51:50.261080+0000","last_active":"2024-09-21T05:52:23.591095+0000","last_peered":"2024-09-21T05:52:23.591095+0000","last_clean":"2024-09-21T05:52:23.591095+0000","last_became_active":"2024-09-21T05:51:50.260700+0000","last_became_peered":"2024-09-21T05:51:50.260700+0000","last_unstale":"2024-09-21T05:52:23.591095+0000","last_undegraded":"2024-09-21T05:52:23.591095+0000","last_fullsized":"2024-09-21T05:52:23.591095+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.033889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584270+0000","last_change":"2024-09-21T05:51:48.230236+0000","last_active":"2024-09-21T05:52:23.584270+0000","last_peered":"2024-09-21T05:52:23.584270+0000","last_clean":"2024-09-21T05:52:23.584270+0000","last_became_active":"2024-09-21T05:51:48.229775+0000","last_became_peered":"2024-09-21T05:51:48.229775+0000","last_unstale":"2024-09-21T05:52:23.584270+0000","last_undegraded":"2024-09-21T05:52:23.584270+0000","last_fullsized":"2024-09-21T05:52:23.584270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:25.371256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587939+0000","last_change":"2024-09-21T05:51:50.260749+0000","last_active":"2024-09-21T05:52:23.587939+0000","last_peered":"2024-09-21T05:52:23.587939+0000","last_clean":"2024-09-21T05:52:23.587939+0000","last_became_active":"2024-09-21T05:51:50.257406+0000","last_became_peered":"2024-09-21T05:51:50.257406+0000","last_unstale":"2024-09-21T05:52:23.587939+0000","last_undegraded":"2024-09-21T05:52:23.587939+0000","last_fullsized":"2024-09-21T05:52:23.587939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:18.293144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596986+0000","last_change":"2024-09-21T05:51:48.228752+0000","last_active":"2024-09-21T05:52:23.596986+0000","last_peered":"2024-09-21T05:52:23.596986+0000","last_clean":"2024-09-21T05:52:23.596986+0000","last_became_active":"2024-09-21T05:51:48.228361+0000","last_became_peered":"2024-09-21T05:51:48.228361+0000","last_unstale":"2024-09-21T05:52:23.596986+0000","last_undegraded":"2024-09-21T05:52:23.596986+0000","last_fullsized":"2024-09-21T05:52:23.596986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:05.868153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587408+0000","last_change":"2024-09-21T05:51:50.256183+0000","last_active":"2024-09-21T05:52:23.587408+0000","last_peered":"2024-09-21T05:52:23.587408+0000","last_clean":"2024-09-21T05:52:23.587408+0000","last_became_active":"2024-09-21T05:51:50.255746+0000","last_became_peered":"2024-09-21T05:51:50.255746+0000","last_unstale":"2024-09-21T05:52:23.587408+0000","last_undegraded":"2024-09-21T05:52:23.587408+0000","last_fullsized":"2024-09-21T05:52:23.587408+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:29.044470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587539+0000","last_change":"2024-09-21T05:51:48.852935+0000","last_active":"2024-09-21T05:52:23.587539+0000","last_peered":"2024-09-21T05:52:23.587539+0000","last_clean":"2024-09-21T05:52:23.587539+0000","last_became_active":"2024-09-21T05:51:48.852457+0000","last_became_peered":"2024-09-21T05:51:48.852457+0000","last_unstale":"2024-09-21T05:52:23.587539+0000","last_undegraded":"2024-09-21T05:52:23.587539+0000","last_fullsized":"2024-09-21T05:52:23.587539+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:12.109669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587750+0000","last_change":"2024-09-21T05:51:50.261136+0000","last_active":"2024-09-21T05:52:23.587750+0000","last_peered":"2024-09-21T05:52:23.587750+0000","last_clean":"2024-09-21T05:52:23.587750+0000","last_became_active":"2024-09-21T05:51:50.260698+0000","last_became_peered":"2024-09-21T05:51:50.260698+0000","last_unstale":"2024-09-21T05:52:23.587750+0000","last_undegraded":"2024-09-21T05:52:23.587750+0000","last_fullsized":"2024-09-21T05:52:23.587750+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:34.480352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.588534+0000","last_change":"2024-09-21T05:50:40.836627+0000","last_active":"2024-09-21T05:52:23.588534+0000","last_peered":"2024-09-21T05:52:23.588534+0000","last_clean":"2024-09-21T05:52:23.588534+0000","last_became_active":"2024-09-21T05:50:40.830426+0000","last_became_peered":"2024-09-21T05:50:40.830426+0000","last_unstale":"2024-09-21T05:52:23.588534+0000","last_undegraded":"2024-09-21T05:52:23.588534+0000","last_fullsized":"2024-09-21T05:52:23.588534+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_clean_scrub_stamp":"2024-09-21T05:47:21.634945+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:33.394077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.687599+0000","last_change":"2024-09-21T05:51:48.228187+0000","last_active":"2024-09-21T05:52:23.687599+0000","last_peered":"2024-09-21T05:52:23.687599+0000","last_clean":"2024-09-21T05:52:23.687599+0000","last_became_active":"2024-09-21T05:51:48.227690+0000","last_became_peered":"2024-09-21T05:51:48.227690+0000","last_unstale":"2024-09-21T05:52:23.687599+0000","last_undegraded":"2024-09-21T05:52:23.687599+0000","last_fullsized":"2024-09-21T05:52:23.687599+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:37.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.705224+0000","last_change":"2024-09-21T05:52:23.705127+0000","last_active":"2024-09-21T05:52:23.705224+0000","last_peered":"2024-09-21T05:52:23.705224+0000","last_clean":"2024-09-21T05:52:23.705224+0000","last_became_active":"2024-09-21T05:52:23.704731+0000","last_became_peered":"2024-09-21T05:52:23.704731+0000","last_unstale":"2024-09-21T05:52:23.705224+0000","last_undegraded":"2024-09-21T05:52:23.705224+0000","last_fullsized":"2024-09-21T05:52:23.705224+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:49.264072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.588183+0000","last_change":"2024-09-21T05:51:48.234444+0000","last_active":"2024-09-21T05:52:23.588183+0000","last_peered":"2024-09-21T05:52:23.588183+0000","last_clean":"2024-09-21T05:52:23.588183+0000","last_became_active":"2024-09-21T05:51:48.233997+0000","last_became_peered":"2024-09-21T05:51:48.233997+0000","last_unstale":"2024-09-21T05:52:23.588183+0000","last_undegraded":"2024-09-21T05:52:23.588183+0000","last_fullsized":"2024-09-21T05:52:23.588183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:12.931628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.583914+0000","last_change":"2024-09-21T05:51:50.242267+0000","last_active":"2024-09-21T05:52:23.583914+0000","last_peered":"2024-09-21T05:52:23.583914+0000","last_clean":"2024-09-21T05:52:23.583914+0000","last_became_active":"2024-09-21T05:51:50.241927+0000","last_became_peered":"2024-09-21T05:51:50.241927+0000","last_unstale":"2024-09-21T05:52:23.583914+0000","last_undegraded":"2024-09-21T05:52:23.583914+0000","last_fullsized":"2024-09-21T05:52:23.583914+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:28.954451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:52.414554+0000","last_change":"2024-09-21T05:51:48.338372+0000","last_active":"2024-09-21T05:52:52.414554+0000","last_peered":"2024-09-21T05:52:52.414554+0000","last_clean":"2024-09-21T05:52:52.414554+0000","last_became_active":"2024-09-21T05:51:48.337966+0000","last_became_peered":"2024-09-21T05:51:48.337966+0000","last_unstale":"2024-09-21T05:52:52.414554+0000","last_undegraded":"2024-09-21T05:52:52.414554+0000","last_fullsized":"2024-09-21T05:52:52.414554+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:10.301871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596254+0000","last_change":"2024-09-21T05:51:50.253151+0000","last_active":"2024-09-21T05:52:23.596254+0000","last_peered":"2024-09-21T05:52:23.596254+0000","last_clean":"2024-09-21T05:52:23.596254+0000","last_became_active":"2024-09-21T05:51:50.252770+0000","last_became_peered":"2024-09-21T05:51:50.252770+0000","last_unstale":"2024-09-21T05:52:23.596254+0000","last_undegraded":"2024-09-21T05:52:23.596254+0000","last_fullsized":"2024-09-21T05:52:23.596254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:48.784229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587728+0000","last_change":"2024-09-21T05:51:48.233273+0000","last_active":"2024-09-21T05:52:23.587728+0000","last_peered":"2024-09-21T05:52:23.587728+0000","last_clean":"2024-09-21T05:52:23.587728+0000","last_became_active":"2024-09-21T05:51:48.232724+0000","last_became_peered":"2024-09-21T05:51:48.232724+0000","last_unstale":"2024-09-21T05:52:23.587728+0000","last_undegraded":"2024-09-21T05:52:23.587728+0000","last_fullsized":"2024-09-21T05:52:23.587728+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:50.869396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.585577+0000","last_change":"2024-09-21T05:51:50.262521+0000","last_active":"2024-09-21T05:52:23.585577+0000","last_peered":"2024-09-21T05:52:23.585577+0000","last_clean":"2024-09-21T05:52:23.585577+0000","last_became_active":"2024-09-21T05:51:50.262135+0000","last_became_peered":"2024-09-21T05:51:50.262135+0000","last_unstale":"2024-09-21T05:52:23.585577+0000","last_undegraded":"2024-09-21T05:52:23.585577+0000","last_fullsized":"2024-09-21T05:52:23.585577+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:18.347182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587326+0000","last_change":"2024-09-21T05:51:48.338532+0000","last_active":"2024-09-21T05:52:23.587326+0000","last_peered":"2024-09-21T05:52:23.587326+0000","last_clean":"2024-09-21T05:52:23.587326+0000","last_became_active":"2024-09-21T05:51:48.338099+0000","last_became_peered":"2024-09-21T05:51:48.338099+0000","last_unstale":"2024-09-21T05:52:23.587326+0000","last_undegraded":"2024-09-21T05:52:23.587326+0000","last_fullsized":"2024-09-21T05:52:23.587326+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:48.670988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.585832+0000","last_change":"2024-09-21T05:51:50.251814+0000","last_active":"2024-09-21T05:52:23.585832+0000","last_peered":"2024-09-21T05:52:23.585832+0000","last_clean":"2024-09-21T05:52:23.585832+0000","last_became_active":"2024-09-21T05:51:50.251401+0000","last_became_peered":"2024-09-21T05:51:50.251401+0000","last_unstale":"2024-09-21T05:52:23.585832+0000","last_undegraded":"2024-09-21T05:52:23.585832+0000","last_fullsized":"2024-09-21T05:52:23.585832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:12.972300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590808+0000","last_change":"2024-09-21T05:51:48.338312+0000","last_active":"2024-09-21T05:52:23.590808+0000","last_peered":"2024-09-21T05:52:23.590808+0000","last_clean":"2024-09-21T05:52:23.590808+0000","last_became_active":"2024-09-21T05:51:48.337872+0000","last_became_peered":"2024-09-21T05:51:48.337872+0000","last_unstale":"2024-09-21T05:52:23.590808+0000","last_undegraded":"2024-09-21T05:52:23.590808+0000","last_fullsized":"2024-09-21T05:52:23.590808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:26.158650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584236+0000","last_change":"2024-09-21T05:51:50.245129+0000","last_active":"2024-09-21T05:52:23.584236+0000","last_peered":"2024-09-21T05:52:23.584236+0000","last_clean":"2024-09-21T05:52:23.584236+0000","last_became_active":"2024-09-21T05:51:50.244439+0000","last_became_peered":"2024-09-21T05:51:50.244439+0000","last_unstale":"2024-09-21T05:52:23.584236+0000","last_undegraded":"2024-09-21T05:52:23.584236+0000","last_fullsized":"2024-09-21T05:52:23.584236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:19.241921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'12","reported_seq":48,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.600370+0000","last_change":"2024-09-21T05:52:23.600272+0000","last_active":"2024-09-21T05:52:23.600370+0000","last_peered":"2024-09-21T05:52:23.600370+0000","last_clean":"2024-09-21T05:52:23.600370+0000","last_became_active":"2024-09-21T05:52:23.592946+0000","last_became_peered":"2024-09-21T05:52:23.592946+0000","last_unstale":"2024-09-21T05:52:23.600370+0000","last_undegraded":"2024-09-21T05:52:23.600370+0000","last_fullsized":"2024-09-21T05:52:23.600370+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:52.892645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590329+0000","last_change":"2024-09-21T05:51:50.253411+0000","last_active":"2024-09-21T05:52:23.590329+0000","last_peered":"2024-09-21T05:52:23.590329+0000","last_clean":"2024-09-21T05:52:23.590329+0000","last_became_active":"2024-09-21T05:51:50.252816+0000","last_became_peered":"2024-09-21T05:51:50.252816+0000","last_unstale":"2024-09-21T05:52:23.590329+0000","last_undegraded":"2024-09-21T05:52:23.590329+0000","last_fullsized":"2024-09-21T05:52:23.590329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:33.444176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.688065+0000","last_change":"2024-09-21T05:51:48.852668+0000","last_active":"2024-09-21T05:52:23.688065+0000","last_peered":"2024-09-21T05:52:23.688065+0000","last_clean":"2024-09-21T05:52:23.688065+0000","last_became_active":"2024-09-21T05:51:48.852298+0000","last_became_peered":"2024-09-21T05:51:48.852298+0000","last_unstale":"2024-09-21T05:52:23.688065+0000","last_undegraded":"2024-09-21T05:52:23.688065+0000","last_fullsized":"2024-09-21T05:52:23.688065+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:19.529194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703764+0000","last_change":"2024-09-21T05:51:50.246720+0000","last_active":"2024-09-21T05:52:23.703764+0000","last_peered":"2024-09-21T05:52:23.703764+0000","last_clean":"2024-09-21T05:52:23.703764+0000","last_became_active":"2024-09-21T05:51:50.246318+0000","last_became_peered":"2024-09-21T05:51:50.246318+0000","last_unstale":"2024-09-21T05:52:23.703764+0000","last_undegraded":"2024-09-21T05:52:23.703764+0000","last_fullsized":"2024-09-21T05:52:23.703764+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:45.737949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703802+0000","last_change":"2024-09-21T05:51:48.338346+0000","last_active":"2024-09-21T05:52:23.703802+0000","last_peered":"2024-09-21T05:52:23.703802+0000","last_clean":"2024-09-21T05:52:23.703802+0000","last_became_active":"2024-09-21T05:51:48.337968+0000","last_became_peered":"2024-09-21T05:51:48.337968+0000","last_unstale":"2024-09-21T05:52:23.703802+0000","last_undegraded":"2024-09-21T05:52:23.703802+0000","last_fullsized":"2024-09-21T05:52:23.703802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:32.450546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589631+0000","last_change":"2024-09-21T05:51:50.255993+0000","last_active":"2024-09-21T05:52:23.589631+0000","last_peered":"2024-09-21T05:52:23.589631+0000","last_clean":"2024-09-21T05:52:23.589631+0000","last_became_active":"2024-09-21T05:51:50.255645+0000","last_became_peered":"2024-09-21T05:51:50.255645+0000","last_unstale":"2024-09-21T05:52:23.589631+0000","last_undegraded":"2024-09-21T05:52:23.589631+0000","last_fullsized":"2024-09-21T05:52:23.589631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.890940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589612+0000","last_change":"2024-09-21T05:51:48.231659+0000","last_active":"2024-09-21T05:52:23.589612+0000","last_peered":"2024-09-21T05:52:23.589612+0000","last_clean":"2024-09-21T05:52:23.589612+0000","last_became_active":"2024-09-21T05:51:48.231137+0000","last_became_peered":"2024-09-21T05:51:48.231137+0000","last_unstale":"2024-09-21T05:52:23.589612+0000","last_undegraded":"2024-09-21T05:52:23.589612+0000","last_fullsized":"2024-09-21T05:52:23.589612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:06.166268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589952+0000","last_change":"2024-09-21T05:51:50.251904+0000","last_active":"2024-09-21T05:52:23.589952+0000","last_peered":"2024-09-21T05:52:23.589952+0000","last_clean":"2024-09-21T05:52:23.589952+0000","last_became_active":"2024-09-21T05:51:50.251403+0000","last_became_peered":"2024-09-21T05:51:50.251403+0000","last_unstale":"2024-09-21T05:52:23.589952+0000","last_undegraded":"2024-09-21T05:52:23.589952+0000","last_fullsized":"2024-09-21T05:52:23.589952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:47.702083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.603022+0000","last_change":"2024-09-21T05:52:23.602925+0000","last_active":"2024-09-21T05:52:23.603022+0000","last_peered":"2024-09-21T05:52:23.603022+0000","last_clean":"2024-09-21T05:52:23.603022+0000","last_became_active":"2024-09-21T05:52:23.598086+0000","last_became_peered":"2024-09-21T05:52:23.598086+0000","last_unstale":"2024-09-21T05:52:23.603022+0000","last_undegraded":"2024-09-21T05:52:23.603022+0000","last_fullsized":"2024-09-21T05:52:23.603022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:03.260218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589767+0000","last_change":"2024-09-21T05:51:50.256654+0000","last_active":"2024-09-21T05:52:23.589767+0000","last_peered":"2024-09-21T05:52:23.589767+0000","last_clean":"2024-09-21T05:52:23.589767+0000","last_became_active":"2024-09-21T05:51:50.255830+0000","last_became_peered":"2024-09-21T05:51:50.255830+0000","last_unstale":"2024-09-21T05:52:23.589767+0000","last_undegraded":"2024-09-21T05:52:23.589767+0000","last_fullsized":"2024-09-21T05:52:23.589767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:49.643890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591174+0000","last_change":"2024-09-21T05:51:48.233608+0000","last_active":"2024-09-21T05:52:23.591174+0000","last_peered":"2024-09-21T05:52:23.591174+0000","last_clean":"2024-09-21T05:52:23.591174+0000","last_became_active":"2024-09-21T05:51:48.233187+0000","last_became_peered":"2024-09-21T05:51:48.233187+0000","last_unstale":"2024-09-21T05:52:23.591174+0000","last_undegraded":"2024-09-21T05:52:23.591174+0000","last_fullsized":"2024-09-21T05:52:23.591174+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:57.815632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587685+0000","last_change":"2024-09-21T05:51:50.266753+0000","last_active":"2024-09-21T05:52:23.587685+0000","last_peered":"2024-09-21T05:52:23.587685+0000","last_clean":"2024-09-21T05:52:23.587685+0000","last_became_active":"2024-09-21T05:51:50.266368+0000","last_became_peered":"2024-09-21T05:51:50.266368+0000","last_unstale":"2024-09-21T05:52:23.587685+0000","last_undegraded":"2024-09-21T05:52:23.587685+0000","last_fullsized":"2024-09-21T05:52:23.587685+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:02.011213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596871+0000","last_change":"2024-09-21T05:51:50.257731+0000","last_active":"2024-09-21T05:52:23.596871+0000","last_peered":"2024-09-21T05:52:23.596871+0000","last_clean":"2024-09-21T05:52:23.596871+0000","last_became_active":"2024-09-21T05:51:50.257396+0000","last_became_peered":"2024-09-21T05:51:50.257396+0000","last_unstale":"2024-09-21T05:52:23.596871+0000","last_undegraded":"2024-09-21T05:52:23.596871+0000","last_fullsized":"2024-09-21T05:52:23.596871+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:58.109069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590778+0000","last_change":"2024-09-21T05:51:48.234067+0000","last_active":"2024-09-21T05:52:23.590778+0000","last_peered":"2024-09-21T05:52:23.590778+0000","last_clean":"2024-09-21T05:52:23.590778+0000","last_became_active":"2024-09-21T05:51:48.233532+0000","last_became_peered":"2024-09-21T05:51:48.233532+0000","last_unstale":"2024-09-21T05:52:23.590778+0000","last_undegraded":"2024-09-21T05:52:23.590778+0000","last_fullsized":"2024-09-21T05:52:23.590778+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:40.997254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703737+0000","last_change":"2024-09-21T05:51:50.265453+0000","last_active":"2024-09-21T05:52:23.703737+0000","last_peered":"2024-09-21T05:52:23.703737+0000","last_clean":"2024-09-21T05:52:23.703737+0000","last_became_active":"2024-09-21T05:51:50.265073+0000","last_became_peered":"2024-09-21T05:51:50.265073+0000","last_unstale":"2024-09-21T05:52:23.703737+0000","last_undegraded":"2024-09-21T05:52:23.703737+0000","last_fullsized":"2024-09-21T05:52:23.703737+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:15.295822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.694313+0000","last_change":"2024-09-21T05:52:23.694236+0000","last_active":"2024-09-21T05:52:23.694313+0000","last_peered":"2024-09-21T05:52:23.694313+0000","last_clean":"2024-09-21T05:52:23.694313+0000","last_became_active":"2024-09-21T05:52:23.688964+0000","last_became_peered":"2024-09-21T05:52:23.688964+0000","last_unstale":"2024-09-21T05:52:23.694313+0000","last_undegraded":"2024-09-21T05:52:23.694313+0000","last_fullsized":"2024-09-21T05:52:23.694313+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:25.453769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703860+0000","last_change":"2024-09-21T05:51:50.267110+0000","last_active":"2024-09-21T05:52:23.703860+0000","last_peered":"2024-09-21T05:52:23.703860+0000","last_clean":"2024-09-21T05:52:23.703860+0000","last_became_active":"2024-09-21T05:51:50.266504+0000","last_became_peered":"2024-09-21T05:51:50.266504+0000","last_unstale":"2024-09-21T05:52:23.703860+0000","last_undegraded":"2024-09-21T05:52:23.703860+0000","last_fullsized":"2024-09-21T05:52:23.703860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:10.618361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590428+0000","last_change":"2024-09-21T05:51:48.337971+0000","last_active":"2024-09-21T05:52:23.590428+0000","last_peered":"2024-09-21T05:52:23.590428+0000","last_clean":"2024-09-21T05:52:23.590428+0000","last_became_active":"2024-09-21T05:51:48.337487+0000","last_became_peered":"2024-09-21T05:51:48.337487+0000","last_unstale":"2024-09-21T05:52:23.590428+0000","last_undegraded":"2024-09-21T05:52:23.590428+0000","last_fullsized":"2024-09-21T05:52:23.590428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.150563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590264+0000","last_change":"2024-09-21T05:51:50.253826+0000","last_active":"2024-09-21T05:52:23.590264+0000","last_peered":"2024-09-21T05:52:23.590264+0000","last_clean":"2024-09-21T05:52:23.590264+0000","last_became_active":"2024-09-21T05:51:50.251700+0000","last_became_peered":"2024-09-21T05:51:50.251700+0000","last_unstale":"2024-09-21T05:52:23.590264+0000","last_undegraded":"2024-09-21T05:52:23.590264+0000","last_fullsized":"2024-09-21T05:52:23.590264+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:02.929651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587502+0000","last_change":"2024-09-21T05:51:48.234358+0000","last_active":"2024-09-21T05:52:23.587502+0000","last_peered":"2024-09-21T05:52:23.587502+0000","last_clean":"2024-09-21T05:52:23.587502+0000","last_became_active":"2024-09-21T05:51:48.233982+0000","last_became_peered":"2024-09-21T05:51:48.233982+0000","last_unstale":"2024-09-21T05:52:23.587502+0000","last_undegraded":"2024-09-21T05:52:23.587502+0000","last_fullsized":"2024-09-21T05:52:23.587502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:42.510872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67903,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":345,"num_read_kb":245,"num_write":164,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":203709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808858,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":819200,"data_stored":406831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972382,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36836,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708316,"statfs":{"total":95995035648,"available":95957315584,"internally_reserved":0,"allocated":1519616,"data_stored":1062605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168612,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":407067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332137,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":406987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528365,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1429504,"data_stored":998917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691891,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":823296,"data_stored":406456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855415,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36760,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708392,"statfs":{"total":95995035648,"available":95957393408,"internally_reserved":0,"allocated":1441792,"data_stored":998210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":827392,"data_stored":407284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":406767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378695,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":913408,"data_stored":471501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542219,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":888832,"data_stored":470151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40336,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704816,"statfs":{"total":95995035648,"available":95953731584,"internally_reserved":0,"allocated":843776,"data_stored":407727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:52:57.072 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T05:52:57.072 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T05:52:57.072 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T05:52:57.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T05:52:57.334 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:57.725 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:57 smithi007 ceph-mon[30983]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:57.726 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:57 smithi007 ceph-mon[30983]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:52:57.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.814+0000 7f9e8e20a640 1 -- 172.21.15.7:0/1940687271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e88103b60 msgr2=0x7f9e88103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:57.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.814+0000 7f9e8e20a640 1 --2- 172.21.15.7:0/1940687271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e88103b60 0x7f9e88103f70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009900 tx=0x7f9e7802a410 comp rx=0 tx=0).stop 2024-09-21T05:52:57.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.814+0000 7f9e8e20a640 1 -- 172.21.15.7:0/1940687271 shutdown_connections 2024-09-21T05:52:57.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.814+0000 7f9e8e20a640 1 --2- 172.21.15.7:0/1940687271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e88109df0 0x7f9e88110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.814+0000 7f9e8e20a640 1 --2- 172.21.15.7:0/1940687271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e881094a0 0x7f9e881098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.814+0000 7f9e8e20a640 1 --2- 172.21.15.7:0/1940687271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e88103b60 0x7f9e88103f70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.814+0000 7f9e8e20a640 1 -- 172.21.15.7:0/1940687271 >> 172.21.15.7:0/1940687271 conn(0x7f9e8807b850 msgr2=0x7f9e8807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:57.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.814+0000 7f9e8e20a640 1 -- 172.21.15.7:0/1940687271 shutdown_connections 2024-09-21T05:52:57.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.814+0000 7f9e8e20a640 1 -- 172.21.15.7:0/1940687271 wait complete. 2024-09-21T05:52:57.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.815+0000 7f9e8e20a640 1 Processor -- start 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.815+0000 7f9e8e20a640 1 -- start start 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e8e20a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e88103b60 0x7f9e88075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e8e20a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e881094a0 0x7f9e88075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e8e20a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e88109df0 0x7f9e88076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e8e20a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9e88113b00 con 0x7f9e88109df0 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e8e20a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9e88113980 con 0x7f9e88103b60 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e8e20a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9e88113c80 con 0x7f9e881094a0 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e88109df0 0x7f9e88076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e88109df0 0x7f9e88076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49522/0 (socket says 172.21.15.7:49522) 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e87fff640 1 -- 172.21.15.7:0/2976599748 learned_addr learned my addr 172.21.15.7:0/2976599748 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e86ffd640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e881094a0 0x7f9e88075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e877fe640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e88103b60 0x7f9e88075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e87fff640 1 -- 172.21.15.7:0/2976599748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e881094a0 msgr2=0x7f9e88075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:57.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e87fff640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e881094a0 0x7f9e88075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e87fff640 1 -- 172.21.15.7:0/2976599748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e88103b60 msgr2=0x7f9e88075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e87fff640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e88103b60 0x7f9e88075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e87fff640 1 -- 172.21.15.7:0/2976599748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e881a86c0 con 0x7f9e88109df0 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e87fff640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e88109df0 0x7f9e88076190 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000cce0 tx=0x7f9e8000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e84ff9640 1 -- 172.21.15.7:0/2976599748 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8000f450 con 0x7f9e88109df0 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e84ff9640 1 -- 172.21.15.7:0/2976599748 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e8000faa0 con 0x7f9e88109df0 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e8e20a640 1 -- 172.21.15.7:0/2976599748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e881a89b0 con 0x7f9e88109df0 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.816+0000 7f9e84ff9640 1 -- 172.21.15.7:0/2976599748 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80018b70 con 0x7f9e88109df0 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.817+0000 7f9e8e20a640 1 -- 172.21.15.7:0/2976599748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e881a8ec0 con 0x7f9e88109df0 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.817+0000 7f9e8e20a640 1 -- 172.21.15.7:0/2976599748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e88103f70 con 0x7f9e88109df0 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.819+0000 7f9e84ff9640 1 -- 172.21.15.7:0/2976599748 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f9e80018d10 con 0x7f9e88109df0 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.820+0000 7f9e84ff9640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e700b6670 0x7f9e700b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.820+0000 7f9e84ff9640 1 -- 172.21.15.7:0/2976599748 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9e800e7960 con 0x7f9e88109df0 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.820+0000 7f9e877fe640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e700b6670 0x7f9e700b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:57.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.820+0000 7f9e877fe640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e700b6670 0x7f9e700b8b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9e78005ab0 tx=0x7f9e78005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:57.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:57.823+0000 7f9e84ff9640 1 -- 172.21.15.7:0/2976599748 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e80014030 con 0x7f9e88109df0 2024-09-21T05:52:57.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:57 smithi119 ceph-mon[34833]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:57.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:57 smithi119 ceph-mon[34833]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:52:57.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:57 smithi027 ceph-mon[34364]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:57.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:57 smithi027 ceph-mon[34364]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:52:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.048+0000 7f9e8e20a640 1 -- 172.21.15.7:0/2976599748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9e88076a10 con 0x7f9e88109df0 2024-09-21T05:52:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.048+0000 7f9e84ff9640 1 -- 172.21.15.7:0/2976599748 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9e88076a10 con 0x7f9e88109df0 2024-09-21T05:52:58.051 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:52:58.051 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T05:52:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.051+0000 7f9e8e20a640 1 -- 172.21.15.7:0/2976599748 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e700b6670 msgr2=0x7f9e700b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.051+0000 7f9e8e20a640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e700b6670 0x7f9e700b8b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9e78005ab0 tx=0x7f9e78005a20 comp rx=0 tx=0).stop 2024-09-21T05:52:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.051+0000 7f9e8e20a640 1 -- 172.21.15.7:0/2976599748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e88109df0 msgr2=0x7f9e88076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.051+0000 7f9e8e20a640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e88109df0 0x7f9e88076190 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000cce0 tx=0x7f9e8000a620 comp rx=0 tx=0).stop 2024-09-21T05:52:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.051+0000 7f9e8e20a640 1 -- 172.21.15.7:0/2976599748 shutdown_connections 2024-09-21T05:52:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.051+0000 7f9e8e20a640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9e700b6670 0x7f9e700b8b80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.051+0000 7f9e8e20a640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e88109df0 0x7f9e88076190 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.051+0000 7f9e8e20a640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e881094a0 0x7f9e88075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.051+0000 7f9e8e20a640 1 --2- 172.21.15.7:0/2976599748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e88103b60 0x7f9e88075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.051+0000 7f9e8e20a640 1 -- 172.21.15.7:0/2976599748 >> 172.21.15.7:0/2976599748 conn(0x7f9e8807b850 msgr2=0x7f9e88107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.051+0000 7f9e8e20a640 1 -- 172.21.15.7:0/2976599748 shutdown_connections 2024-09-21T05:52:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:58.051+0000 7f9e8e20a640 1 -- 172.21.15.7:0/2976599748 wait complete. 2024-09-21T05:52:58.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:58 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2976599748' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T05:52:58.678 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T05:52:58.678 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:52:58.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:58 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2976599748' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T05:52:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:58.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:58 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2976599748' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T05:52:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.373+0000 7ff82de4f640 1 -- 172.21.15.7:0/2133762542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8281083a0 msgr2=0x7ff8281087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.373+0000 7ff82de4f640 1 --2- 172.21.15.7:0/2133762542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8281083a0 0x7ff8281087b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff810009900 tx=0x7ff81002a410 comp rx=0 tx=0).stop 2024-09-21T05:52:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.373+0000 7ff82de4f640 1 -- 172.21.15.7:0/2133762542 shutdown_connections 2024-09-21T05:52:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.373+0000 7ff82de4f640 1 --2- 172.21.15.7:0/2133762542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8281083a0 0x7ff8281087b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.373+0000 7ff82de4f640 1 --2- 172.21.15.7:0/2133762542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff828108cf0 0x7ff82810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.373+0000 7ff82de4f640 1 --2- 172.21.15.7:0/2133762542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff828102a60 0x7ff828102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.373+0000 7ff82de4f640 1 -- 172.21.15.7:0/2133762542 >> 172.21.15.7:0/2133762542 conn(0x7ff828079730 msgr2=0x7ff828079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.373+0000 7ff82de4f640 1 -- 172.21.15.7:0/2133762542 shutdown_connections 2024-09-21T05:52:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.373+0000 7ff82de4f640 1 -- 172.21.15.7:0/2133762542 wait complete. 2024-09-21T05:52:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.374+0000 7ff82de4f640 1 Processor -- start 2024-09-21T05:52:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.374+0000 7ff82de4f640 1 -- start start 2024-09-21T05:52:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff82de4f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff828102a60 0x7ff82819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff82de4f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8281083a0 0x7ff82819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff82de4f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff828108cf0 0x7ff82819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff82de4f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff828113aa0 con 0x7ff828102a60 2024-09-21T05:52:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff82de4f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff828113920 con 0x7ff828108cf0 2024-09-21T05:52:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff82de4f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff828113c20 con 0x7ff8281083a0 2024-09-21T05:52:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff8277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff828102a60 0x7ff82819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff8277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff828102a60 0x7ff82819a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44370/0 (socket says 172.21.15.7:44370) 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff8277fe640 1 -- 172.21.15.7:0/3653993439 learned_addr learned my addr 172.21.15.7:0/3653993439 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff826ffd640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8281083a0 0x7ff82819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff827fff640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff828108cf0 0x7ff82819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff8277fe640 1 -- 172.21.15.7:0/3653993439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8281083a0 msgr2=0x7ff82819aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff8277fe640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8281083a0 0x7ff82819aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff8277fe640 1 -- 172.21.15.7:0/3653993439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff828108cf0 msgr2=0x7ff82819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff8277fe640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff828108cf0 0x7ff82819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff8277fe640 1 -- 172.21.15.7:0/3653993439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8281a0380 con 0x7ff828102a60 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff827fff640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff828108cf0 0x7ff82819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff8277fe640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff828102a60 0x7ff82819a4d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff81800b4a0 tx=0x7ff81800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff824ff9640 1 -- 172.21.15.7:0/3653993439 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff818014070 con 0x7ff828102a60 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.375+0000 7ff824ff9640 1 -- 172.21.15.7:0/3653993439 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff818010ac0 con 0x7ff828102a60 2024-09-21T05:52:59.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.376+0000 7ff82de4f640 1 -- 172.21.15.7:0/3653993439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8281a0670 con 0x7ff828102a60 2024-09-21T05:52:59.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.376+0000 7ff824ff9640 1 -- 172.21.15.7:0/3653993439 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff818017c30 con 0x7ff828102a60 2024-09-21T05:52:59.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.376+0000 7ff82de4f640 1 -- 172.21.15.7:0/3653993439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8281a6e90 con 0x7ff828102a60 2024-09-21T05:52:59.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.377+0000 7ff82de4f640 1 -- 172.21.15.7:0/3653993439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff828103ce0 con 0x7ff828102a60 2024-09-21T05:52:59.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.378+0000 7ff824ff9640 1 -- 172.21.15.7:0/3653993439 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7ff818017070 con 0x7ff828102a60 2024-09-21T05:52:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.379+0000 7ff824ff9640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff8140b6620 0x7ff8140b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.379+0000 7ff826ffd640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff8140b6620 0x7ff8140b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.380+0000 7ff824ff9640 1 -- 172.21.15.7:0/3653993439 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7ff8180e6be0 con 0x7ff828102a60 2024-09-21T05:52:59.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.380+0000 7ff826ffd640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff8140b6620 0x7ff8140b8b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff810000c00 tx=0x7ff810031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:59.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.383+0000 7ff824ff9640 1 -- 172.21.15.7:0/3653993439 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff8180ad270 con 0x7ff828102a60 2024-09-21T05:52:59.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.609+0000 7ff82de4f640 1 -- 172.21.15.7:0/3653993439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff828102e70 con 0x7ff828102a60 2024-09-21T05:52:59.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:52:59 smithi007 ceph-mon[30983]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:52:59.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.610+0000 7ff824ff9640 1 -- 172.21.15.7:0/3653993439 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11896 (secure 0 0 0) 0x7ff828102e70 con 0x7ff828102a60 2024-09-21T05:52:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:52:59.613 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-21T05:52:02:324811+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:52:01.894944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24679,24686,24691]},"id":1}]} 2024-09-21T05:52:59.613 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T05:52:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.612+0000 7ff82de4f640 1 -- 172.21.15.7:0/3653993439 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff8140b6620 msgr2=0x7ff8140b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.612+0000 7ff82de4f640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff8140b6620 0x7ff8140b8b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff810000c00 tx=0x7ff810031400 comp rx=0 tx=0).stop 2024-09-21T05:52:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.612+0000 7ff82de4f640 1 -- 172.21.15.7:0/3653993439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff828102a60 msgr2=0x7ff82819a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.612+0000 7ff82de4f640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff828102a60 0x7ff82819a4d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff81800b4a0 tx=0x7ff81800b960 comp rx=0 tx=0).stop 2024-09-21T05:52:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.612+0000 7ff82de4f640 1 -- 172.21.15.7:0/3653993439 shutdown_connections 2024-09-21T05:52:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.612+0000 7ff82de4f640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff8140b6620 0x7ff8140b8b30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.612+0000 7ff82de4f640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff828108cf0 0x7ff82819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.612+0000 7ff82de4f640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8281083a0 0x7ff82819aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.612+0000 7ff82de4f640 1 --2- 172.21.15.7:0/3653993439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff828102a60 0x7ff82819a4d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.612+0000 7ff82de4f640 1 -- 172.21.15.7:0/3653993439 >> 172.21.15.7:0/3653993439 conn(0x7ff828079730 msgr2=0x7ff8281052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:59.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.612+0000 7ff82de4f640 1 -- 172.21.15.7:0/3653993439 shutdown_connections 2024-09-21T05:52:59.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:52:59.612+0000 7ff82de4f640 1 -- 172.21.15.7:0/3653993439 wait complete. 2024-09-21T05:52:59.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:52:59 smithi119 ceph-mon[34833]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:52:59.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:52:59 smithi027 ceph-mon[34364]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:53:00.236 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:00.496 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:00.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3653993439' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:00.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:00 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3653993439' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:00.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:00 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3653993439' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:01.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.006+0000 7fcd8b100640 1 -- 172.21.15.7:0/2638860067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd841083d0 msgr2=0x7fcd841087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:01.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.006+0000 7fcd8b100640 1 --2- 172.21.15.7:0/2638860067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd841083d0 0x7fcd841087e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009900 tx=0x7fcd6c02a410 comp rx=0 tx=0).stop 2024-09-21T05:53:01.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.006+0000 7fcd8b100640 1 -- 172.21.15.7:0/2638860067 shutdown_connections 2024-09-21T05:53:01.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.006+0000 7fcd8b100640 1 --2- 172.21.15.7:0/2638860067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd841083d0 0x7fcd841087e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.006+0000 7fcd8b100640 1 --2- 172.21.15.7:0/2638860067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd84108d20 0x7fcd8410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.006+0000 7fcd8b100640 1 --2- 172.21.15.7:0/2638860067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd84102ae0 0x7fcd84102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.006+0000 7fcd8b100640 1 -- 172.21.15.7:0/2638860067 >> 172.21.15.7:0/2638860067 conn(0x7fcd84079760 msgr2=0x7fcd84079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:01.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.006+0000 7fcd8b100640 1 -- 172.21.15.7:0/2638860067 shutdown_connections 2024-09-21T05:53:01.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.006+0000 7fcd8b100640 1 -- 172.21.15.7:0/2638860067 wait complete. 2024-09-21T05:53:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.007+0000 7fcd8b100640 1 Processor -- start 2024-09-21T05:53:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.007+0000 7fcd8b100640 1 -- start start 2024-09-21T05:53:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.007+0000 7fcd8b100640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd84102ae0 0x7fcd841993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.007+0000 7fcd8b100640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd841083d0 0x7fcd84199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.007+0000 7fcd8b100640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd84108d20 0x7fcd8419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.007+0000 7fcd8b100640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcd84112990 con 0x7fcd841083d0 2024-09-21T05:53:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.007+0000 7fcd8b100640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcd84112810 con 0x7fcd84108d20 2024-09-21T05:53:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.007+0000 7fcd8b100640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcd84112b10 con 0x7fcd84102ae0 2024-09-21T05:53:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd841083d0 0x7fcd84199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd88e9c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd84102ae0 0x7fcd841993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd841083d0 0x7fcd84199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44386/0 (socket says 172.21.15.7:44386) 2024-09-21T05:53:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd83fff640 1 -- 172.21.15.7:0/1330387686 learned_addr learned my addr 172.21.15.7:0/1330387686 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:01.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd8969d640 1 --2- 172.21.15.7:0/1330387686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd84108d20 0x7fcd8419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd83fff640 1 -- 172.21.15.7:0/1330387686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd84102ae0 msgr2=0x7fcd841993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd83fff640 1 --2- 172.21.15.7:0/1330387686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd84102ae0 0x7fcd841993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd83fff640 1 -- 172.21.15.7:0/1330387686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd84108d20 msgr2=0x7fcd8419ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd83fff640 1 --2- 172.21.15.7:0/1330387686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd84108d20 0x7fcd8419ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd83fff640 1 -- 172.21.15.7:0/1330387686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8419f330 con 0x7fcd841083d0 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd83fff640 1 --2- 172.21.15.7:0/1330387686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd841083d0 0x7fcd84199960 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c032fd0 tx=0x7fcd6c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd81ffb640 1 -- 172.21.15.7:0/1330387686 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c03f030 con 0x7fcd841083d0 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd81ffb640 1 -- 172.21.15.7:0/1330387686 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd6c004490 con 0x7fcd841083d0 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd8b100640 1 -- 172.21.15.7:0/1330387686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8419f5c0 con 0x7fcd841083d0 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.008+0000 7fcd81ffb640 1 -- 172.21.15.7:0/1330387686 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c035070 con 0x7fcd841083d0 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.009+0000 7fcd8b100640 1 -- 172.21.15.7:0/1330387686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd841a5d80 con 0x7fcd841083d0 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.010+0000 7fcd8b100640 1 -- 172.21.15.7:0/1330387686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd84103d10 con 0x7fcd841083d0 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.012+0000 7fcd81ffb640 1 -- 172.21.15.7:0/1330387686 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fcd6c042030 con 0x7fcd841083d0 2024-09-21T05:53:01.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.013+0000 7fcd81ffb640 1 --2- 172.21.15.7:0/1330387686 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcd700b6670 0x7fcd700b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:01.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.013+0000 7fcd88e9c640 1 --2- 172.21.15.7:0/1330387686 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcd700b6670 0x7fcd700b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:01.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.013+0000 7fcd81ffb640 1 -- 172.21.15.7:0/1330387686 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fcd6c107e10 con 0x7fcd841083d0 2024-09-21T05:53:01.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.014+0000 7fcd88e9c640 1 --2- 172.21.15.7:0/1330387686 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcd700b6670 0x7fcd700b8b80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400bbe0 tx=0x7fcd7400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:01.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.016+0000 7fcd81ffb640 1 -- 172.21.15.7:0/1330387686 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd6c0d2820 con 0x7fcd841083d0 2024-09-21T05:53:01.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.245+0000 7fcd8b100640 1 -- 172.21.15.7:0/1330387686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd84102ef0 con 0x7fcd841083d0 2024-09-21T05:53:01.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.246+0000 7fcd81ffb640 1 -- 172.21.15.7:0/1330387686 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11896 (secure 0 0 0) 0x7fcd6c0d7760 con 0x7fcd841083d0 2024-09-21T05:53:01.248 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:01.248 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-21T05:52:02:324811+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:52:01.894944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24679,24686,24691]},"id":1}]} 2024-09-21T05:53:01.248 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T05:53:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.249+0000 7fcd8b100640 1 -- 172.21.15.7:0/1330387686 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcd700b6670 msgr2=0x7fcd700b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.249+0000 7fcd8b100640 1 --2- 172.21.15.7:0/1330387686 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcd700b6670 0x7fcd700b8b80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400bbe0 tx=0x7fcd7400b390 comp rx=0 tx=0).stop 2024-09-21T05:53:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.249+0000 7fcd8b100640 1 -- 172.21.15.7:0/1330387686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd841083d0 msgr2=0x7fcd84199960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.249+0000 7fcd8b100640 1 --2- 172.21.15.7:0/1330387686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd841083d0 0x7fcd84199960 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c032fd0 tx=0x7fcd6c004270 comp rx=0 tx=0).stop 2024-09-21T05:53:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.249+0000 7fcd8b100640 1 -- 172.21.15.7:0/1330387686 shutdown_connections 2024-09-21T05:53:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.249+0000 7fcd8b100640 1 --2- 172.21.15.7:0/1330387686 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcd700b6670 0x7fcd700b8b80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.249+0000 7fcd8b100640 1 --2- 172.21.15.7:0/1330387686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd841083d0 0x7fcd84199960 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.249+0000 7fcd8b100640 1 --2- 172.21.15.7:0/1330387686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd84108d20 0x7fcd8419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.249+0000 7fcd8b100640 1 --2- 172.21.15.7:0/1330387686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd84102ae0 0x7fcd841993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.249+0000 7fcd8b100640 1 -- 172.21.15.7:0/1330387686 >> 172.21.15.7:0/1330387686 conn(0x7fcd84079760 msgr2=0x7fcd84104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:01.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.249+0000 7fcd8b100640 1 -- 172.21.15.7:0/1330387686 shutdown_connections 2024-09-21T05:53:01.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:01.249+0000 7fcd8b100640 1 -- 172.21.15.7:0/1330387686 wait complete. 2024-09-21T05:53:01.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:01 smithi007 ceph-mon[30983]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:53:01.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:01 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1330387686' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:01.826 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:53:01.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:01 smithi119 ceph-mon[34833]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:53:01.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:01 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1330387686' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:01.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:01 smithi027 ceph-mon[34364]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:53:01.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:01 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1330387686' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:02.082 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:02.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.514+0000 7f69a0d8e640 1 -- 172.21.15.7:0/3964579214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f699c106280 msgr2=0x7f699c106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:02.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.514+0000 7f69a0d8e640 1 --2- 172.21.15.7:0/3964579214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f699c106280 0x7f699c106690 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6990009ca0 tx=0x7f699002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:02.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.514+0000 7f69a0d8e640 1 -- 172.21.15.7:0/3964579214 shutdown_connections 2024-09-21T05:53:02.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.514+0000 7f69a0d8e640 1 --2- 172.21.15.7:0/3964579214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f699c106280 0x7f699c106690 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:02.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.514+0000 7f69a0d8e640 1 --2- 172.21.15.7:0/3964579214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f699c106bd0 0x7f699c110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:02.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.514+0000 7f69a0d8e640 1 --2- 172.21.15.7:0/3964579214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c102090 0x7f699c1024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:02.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.514+0000 7f69a0d8e640 1 -- 172.21.15.7:0/3964579214 >> 172.21.15.7:0/3964579214 conn(0x7f699c077c60 msgr2=0x7f699c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:02.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.514+0000 7f69a0d8e640 1 -- 172.21.15.7:0/3964579214 shutdown_connections 2024-09-21T05:53:02.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.514+0000 7f69a0d8e640 1 -- 172.21.15.7:0/3964579214 wait complete. 2024-09-21T05:53:02.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.515+0000 7f69a0d8e640 1 Processor -- start 2024-09-21T05:53:02.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.515+0000 7f69a0d8e640 1 -- start start 2024-09-21T05:53:02.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f69a0d8e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f699c102090 0x7f699c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:02.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f69a0d8e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f699c106280 0x7f699c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:02.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f69a0d8e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c106bd0 0x7f699c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:02.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f69a0d8e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f699c113aa0 con 0x7f699c106280 2024-09-21T05:53:02.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f69a0d8e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f699c113920 con 0x7f699c102090 2024-09-21T05:53:02.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f69a0d8e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f699c113c20 con 0x7f699c106bd0 2024-09-21T05:53:02.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f6999d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f699c106280 0x7f699c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:02.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f6999d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f699c106280 0x7f699c19aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44408/0 (socket says 172.21.15.7:44408) 2024-09-21T05:53:02.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f6999d9b640 1 -- 172.21.15.7:0/176848173 learned_addr learned my addr 172.21.15.7:0/176848173 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:02.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f699a59c640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f699c102090 0x7f699c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:02.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f699ad9d640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c106bd0 0x7f699c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:02.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f6999d9b640 1 -- 172.21.15.7:0/176848173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c106bd0 msgr2=0x7f699c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:02.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f6999d9b640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c106bd0 0x7f699c19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:02.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f6999d9b640 1 -- 172.21.15.7:0/176848173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f699c102090 msgr2=0x7f699c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:02.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f6999d9b640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f699c102090 0x7f699c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f6999d9b640 1 -- 172.21.15.7:0/176848173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699c1a0440 con 0x7f699c106280 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f699ad9d640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c106bd0 0x7f699c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f6999d9b640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f699c106280 0x7f699c19aa70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6990009430 tx=0x7f69900317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.516+0000 7f698b7fe640 1 -- 172.21.15.7:0/176848173 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6990003b70 con 0x7f699c106280 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.517+0000 7f69a0d8e640 1 -- 172.21.15.7:0/176848173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699c1a06d0 con 0x7f699c106280 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.517+0000 7f698b7fe640 1 -- 172.21.15.7:0/176848173 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6990003d10 con 0x7f699c106280 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.517+0000 7f698b7fe640 1 -- 172.21.15.7:0/176848173 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699002fb00 con 0x7f699c106280 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.517+0000 7f69a0d8e640 1 -- 172.21.15.7:0/176848173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f699c1a6e90 con 0x7f699c106280 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.518+0000 7f69a0d8e640 1 -- 172.21.15.7:0/176848173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f699c06ab30 con 0x7f699c106280 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.519+0000 7f698b7fe640 1 -- 172.21.15.7:0/176848173 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f699002fca0 con 0x7f699c106280 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.520+0000 7f698b7fe640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69840b65f0 0x7f69840b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.520+0000 7f699a59c640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69840b65f0 0x7f69840b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.520+0000 7f698b7fe640 1 -- 172.21.15.7:0/176848173 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f6990108850 con 0x7f699c106280 2024-09-21T05:53:02.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.520+0000 7f699a59c640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69840b65f0 0x7f69840b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f698c005fd0 tx=0x7f698c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:02.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.526+0000 7f698b7fe640 1 -- 172.21.15.7:0/176848173 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69900ceee0 con 0x7f699c106280 2024-09-21T05:53:02.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.715+0000 7f69a0d8e640 1 -- 172.21.15.7:0/176848173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f699c10bc60 con 0x7f699c106280 2024-09-21T05:53:02.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.717+0000 7f698b7fe640 1 -- 172.21.15.7:0/176848173 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22826 (secure 0 0 0) 0x7f69900d32c0 con 0x7f699c106280 2024-09-21T05:53:02.719 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:02.719 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:43:32.863896+0000","modified":"2024-09-21T05:52:23.580753+0000","last_up_change":"2024-09-21T05:51:02.074799+0000","last_in_change":"2024-09-21T05:50:39.016405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:47:20.844179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:51:46.238763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:51:48.832249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d7a68ba-a599-44a9-a0de-a1d6df51f437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6803","nonce":536257283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6805","nonce":536257283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6809","nonce":536257283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6807","nonce":536257283}]},"public_addr":"172.21.15.7:6803/536257283","cluster_addr":"172.21.15.7:6805/536257283","heartbeat_back_addr":"172.21.15.7:6809/536257283","heartbeat_front_addr":"172.21.15.7:6807/536257283","state":["exists","up"]},{"osd":1,"uuid":"d4600805-1cb5-432a-8ae0-a40107a6c6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6801","nonce":2299402871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6803","nonce":2299402871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6807","nonce":2299402871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6805","nonce":2299402871}]},"public_addr":"172.21.15.27:6801/2299402871","cluster_addr":"172.21.15.27:6803/2299402871","heartbeat_back_addr":"172.21.15.27:6807/2299402871","heartbeat_front_addr":"172.21.15.27:6805/2299402871","state":["exists","up"]},{"osd":2,"uuid":"aa435f82-5819-4497-9053-1d891e712b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6801","nonce":1043408043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6803","nonce":1043408043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6807","nonce":1043408043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6805","nonce":1043408043}]},"public_addr":"172.21.15.119:6801/1043408043","cluster_addr":"172.21.15.119:6803/1043408043","heartbeat_back_addr":"172.21.15.119:6807/1043408043","heartbeat_front_addr":"172.21.15.119:6805/1043408043","state":["exists","up"]},{"osd":3,"uuid":"55803f97-02e1-43c0-b8da-9b8af32fd1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6811","nonce":1261229771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6813","nonce":1261229771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6817","nonce":1261229771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6815","nonce":1261229771}]},"public_addr":"172.21.15.7:6811/1261229771","cluster_addr":"172.21.15.7:6813/1261229771","heartbeat_back_addr":"172.21.15.7:6817/1261229771","heartbeat_front_addr":"172.21.15.7:6815/1261229771","state":["exists","up"]},{"osd":4,"uuid":"987ce230-5bfc-45a7-a33e-6291545afded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6809","nonce":631467792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6811","nonce":631467792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6815","nonce":631467792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6813","nonce":631467792}]},"public_addr":"172.21.15.27:6809/631467792","cluster_addr":"172.21.15.27:6811/631467792","heartbeat_back_addr":"172.21.15.27:6815/631467792","heartbeat_front_addr":"172.21.15.27:6813/631467792","state":["exists","up"]},{"osd":5,"uuid":"e768fbfa-8983-4ff6-8dca-b7df2304cf91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6809","nonce":2530968619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6811","nonce":2530968619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6815","nonce":2530968619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6813","nonce":2530968619}]},"public_addr":"172.21.15.119:6809/2530968619","cluster_addr":"172.21.15.119:6811/2530968619","heartbeat_back_addr":"172.21.15.119:6815/2530968619","heartbeat_front_addr":"172.21.15.119:6813/2530968619","state":["exists","up"]},{"osd":6,"uuid":"22496f13-64be-479b-89ea-bf51544199c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6819","nonce":856032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6821","nonce":856032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6825","nonce":856032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6823","nonce":856032021}]},"public_addr":"172.21.15.7:6819/856032021","cluster_addr":"172.21.15.7:6821/856032021","heartbeat_back_addr":"172.21.15.7:6825/856032021","heartbeat_front_addr":"172.21.15.7:6823/856032021","state":["exists","up"]},{"osd":7,"uuid":"53fc5616-b06a-498e-a60e-d7d7d6ba2a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6817","nonce":2862843529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6819","nonce":2862843529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6823","nonce":2862843529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6821","nonce":2862843529}]},"public_addr":"172.21.15.27:6817/2862843529","cluster_addr":"172.21.15.27:6819/2862843529","heartbeat_back_addr":"172.21.15.27:6823/2862843529","heartbeat_front_addr":"172.21.15.27:6821/2862843529","state":["exists","up"]},{"osd":8,"uuid":"53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6817","nonce":3663835202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6819","nonce":3663835202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6823","nonce":3663835202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6821","nonce":3663835202}]},"public_addr":"172.21.15.119:6817/3663835202","cluster_addr":"172.21.15.119:6819/3663835202","heartbeat_back_addr":"172.21.15.119:6823/3663835202","heartbeat_front_addr":"172.21.15.119:6821/3663835202","state":["exists","up"]},{"osd":9,"uuid":"a69a747d-1e6c-4940-9d96-4315ab384588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6827","nonce":2348805959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6829","nonce":2348805959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6833","nonce":2348805959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6831","nonce":2348805959}]},"public_addr":"172.21.15.7:6827/2348805959","cluster_addr":"172.21.15.7:6829/2348805959","heartbeat_back_addr":"172.21.15.7:6833/2348805959","heartbeat_front_addr":"172.21.15.7:6831/2348805959","state":["exists","up"]},{"osd":10,"uuid":"a8f67271-99bb-4fb7-b0f5-a24730cd96cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6825","nonce":2363600090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6827","nonce":2363600090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6831","nonce":2363600090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6829","nonce":2363600090}]},"public_addr":"172.21.15.27:6825/2363600090","cluster_addr":"172.21.15.27:6827/2363600090","heartbeat_back_addr":"172.21.15.27:6831/2363600090","heartbeat_front_addr":"172.21.15.27:6829/2363600090","state":["exists","up"]},{"osd":11,"uuid":"88456735-00b1-479c-b201-588a9ee0c881","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6825","nonce":3937692826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6827","nonce":3937692826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6831","nonce":3937692826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6829","nonce":3937692826}]},"public_addr":"172.21.15.119:6825/3937692826","cluster_addr":"172.21.15.119:6827/3937692826","heartbeat_back_addr":"172.21.15.119:6831/3937692826","heartbeat_front_addr":"172.21.15.119:6829/3937692826","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:26.217550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:51.830871+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:17.201362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:41.990894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:07.357782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.114180+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:56.808155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:22.565234+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:46.981522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:10.600602+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:35.973766+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:51:00.216062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/4143746508":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/1505943829":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/1622456881":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/833696585":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/2055984288":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6801/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3995317885":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2229583478":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/468393974":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/1009303060":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2125734440":"2024-09-22T05:45:22.373420+0000","172.21.15.7:6800/3995317885":"2024-09-22T05:45:22.373420+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:53:02.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.719+0000 7f69a0d8e640 1 -- 172.21.15.7:0/176848173 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69840b65f0 msgr2=0x7f69840b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:02.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.719+0000 7f69a0d8e640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69840b65f0 0x7f69840b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f698c005fd0 tx=0x7f698c00b390 comp rx=0 tx=0).stop 2024-09-21T05:53:02.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.719+0000 7f69a0d8e640 1 -- 172.21.15.7:0/176848173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f699c106280 msgr2=0x7f699c19aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:02.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.719+0000 7f69a0d8e640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f699c106280 0x7f699c19aa70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6990009430 tx=0x7f69900317c0 comp rx=0 tx=0).stop 2024-09-21T05:53:02.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.719+0000 7f69a0d8e640 1 -- 172.21.15.7:0/176848173 shutdown_connections 2024-09-21T05:53:02.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.719+0000 7f69a0d8e640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69840b65f0 0x7f69840b8b00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:02.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.719+0000 7f69a0d8e640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f699c106280 0x7f699c19aa70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:02.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.719+0000 7f69a0d8e640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c106bd0 0x7f699c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:02.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.719+0000 7f69a0d8e640 1 --2- 172.21.15.7:0/176848173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f699c102090 0x7f699c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:02.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.719+0000 7f69a0d8e640 1 -- 172.21.15.7:0/176848173 >> 172.21.15.7:0/176848173 conn(0x7f699c077c60 msgr2=0x7f699c107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:02.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.719+0000 7f69a0d8e640 1 -- 172.21.15.7:0/176848173 shutdown_connections 2024-09-21T05:53:02.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:02.719+0000 7f69a0d8e640 1 -- 172.21.15.7:0/176848173 wait complete. 2024-09-21T05:53:03.379 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:03.640 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:03.761 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:03 smithi007 ceph-mon[30983]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:53:03.761 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:03 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/176848173' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:03.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:03 smithi119 ceph-mon[34833]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:53:03.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:03 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/176848173' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:03.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:03 smithi027 ceph-mon[34364]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:53:03.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:03 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/176848173' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:04.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.122+0000 7fda0b2ec640 1 -- 172.21.15.7:0/822928533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda041083a0 msgr2=0x7fda041087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:04.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.122+0000 7fda0b2ec640 1 --2- 172.21.15.7:0/822928533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda041083a0 0x7fda041087b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009900 tx=0x7fd9f402a410 comp rx=0 tx=0).stop 2024-09-21T05:53:04.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.123+0000 7fda0b2ec640 1 -- 172.21.15.7:0/822928533 shutdown_connections 2024-09-21T05:53:04.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.123+0000 7fda0b2ec640 1 --2- 172.21.15.7:0/822928533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda041083a0 0x7fda041087b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:04.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.123+0000 7fda0b2ec640 1 --2- 172.21.15.7:0/822928533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda04108cf0 0x7fda0410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:04.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.123+0000 7fda0b2ec640 1 --2- 172.21.15.7:0/822928533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda04102a60 0x7fda04102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:04.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.123+0000 7fda0b2ec640 1 -- 172.21.15.7:0/822928533 >> 172.21.15.7:0/822928533 conn(0x7fda04079730 msgr2=0x7fda04079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:04.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.123+0000 7fda0b2ec640 1 -- 172.21.15.7:0/822928533 shutdown_connections 2024-09-21T05:53:04.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.123+0000 7fda0b2ec640 1 -- 172.21.15.7:0/822928533 wait complete. 2024-09-21T05:53:04.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.123+0000 7fda0b2ec640 1 Processor -- start 2024-09-21T05:53:04.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.123+0000 7fda0b2ec640 1 -- start start 2024-09-21T05:53:04.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda0b2ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda04102a60 0x7fda0419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:04.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda0b2ec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda041083a0 0x7fda0419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:04.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda0b2ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda04108cf0 0x7fda0419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:04.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda0b2ec640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fda04112960 con 0x7fda04102a60 2024-09-21T05:53:04.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda0b2ec640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fda041127e0 con 0x7fda041083a0 2024-09-21T05:53:04.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda0b2ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fda04112ae0 con 0x7fda04108cf0 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda09088640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda04102a60 0x7fda0419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda09088640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda04102a60 0x7fda0419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44418/0 (socket says 172.21.15.7:44418) 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda09088640 1 -- 172.21.15.7:0/3741939846 learned_addr learned my addr 172.21.15.7:0/3741939846 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda08887640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda041083a0 0x7fda0419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda09889640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda04108cf0 0x7fda0419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda09088640 1 -- 172.21.15.7:0/3741939846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda04108cf0 msgr2=0x7fda0419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda09088640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda04108cf0 0x7fda0419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda09088640 1 -- 172.21.15.7:0/3741939846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda041083a0 msgr2=0x7fda0419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda09088640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda041083a0 0x7fda0419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda09088640 1 -- 172.21.15.7:0/3741939846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda041a0310 con 0x7fda04102a60 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda09889640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda04108cf0 0x7fda0419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fda09088640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda04102a60 0x7fda0419a460 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c920 tx=0x7fda0000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.124+0000 7fd9fa7fc640 1 -- 172.21.15.7:0/3741939846 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00007c70 con 0x7fda04102a60 2024-09-21T05:53:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.125+0000 7fda0b2ec640 1 -- 172.21.15.7:0/3741939846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda041a0600 con 0x7fda04102a60 2024-09-21T05:53:04.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.125+0000 7fd9fa7fc640 1 -- 172.21.15.7:0/3741939846 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda00007e10 con 0x7fda04102a60 2024-09-21T05:53:04.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.125+0000 7fd9fa7fc640 1 -- 172.21.15.7:0/3741939846 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00018820 con 0x7fda04102a60 2024-09-21T05:53:04.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.125+0000 7fda0b2ec640 1 -- 172.21.15.7:0/3741939846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda041a6e20 con 0x7fda04102a60 2024-09-21T05:53:04.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.126+0000 7fda0b2ec640 1 -- 172.21.15.7:0/3741939846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda04103ce0 con 0x7fda04102a60 2024-09-21T05:53:04.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.128+0000 7fd9fa7fc640 1 -- 172.21.15.7:0/3741939846 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fda0000f450 con 0x7fda04102a60 2024-09-21T05:53:04.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.129+0000 7fd9fa7fc640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd9f00b6620 0x7fd9f00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:04.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.129+0000 7fda08887640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd9f00b6620 0x7fd9f00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:04.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.129+0000 7fd9fa7fc640 1 -- 172.21.15.7:0/3741939846 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fda000e7a90 con 0x7fda04102a60 2024-09-21T05:53:04.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.130+0000 7fda08887640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd9f00b6620 0x7fd9f00b8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4000c00 tx=0x7fd9f4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:04.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.132+0000 7fd9fa7fc640 1 -- 172.21.15.7:0/3741939846 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fda00014030 con 0x7fda04102a60 2024-09-21T05:53:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.359+0000 7fda0b2ec640 1 -- 172.21.15.7:0/3741939846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda04102e70 con 0x7fda04102a60 2024-09-21T05:53:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.360+0000 7fd9fa7fc640 1 -- 172.21.15.7:0/3741939846 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11896 (secure 0 0 0) 0x7fda000ae150 con 0x7fda04102a60 2024-09-21T05:53:04.362 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:04.362 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-21T05:52:02:324811+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:52:01.894944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24679,24686,24691]},"id":1}]} 2024-09-21T05:53:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T05:53:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.362+0000 7fda0b2ec640 1 -- 172.21.15.7:0/3741939846 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd9f00b6620 msgr2=0x7fd9f00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.362+0000 7fda0b2ec640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd9f00b6620 0x7fd9f00b8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4000c00 tx=0x7fd9f4031400 comp rx=0 tx=0).stop 2024-09-21T05:53:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.362+0000 7fda0b2ec640 1 -- 172.21.15.7:0/3741939846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda04102a60 msgr2=0x7fda0419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.362+0000 7fda0b2ec640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda04102a60 0x7fda0419a460 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c920 tx=0x7fda0000cde0 comp rx=0 tx=0).stop 2024-09-21T05:53:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.362+0000 7fda0b2ec640 1 -- 172.21.15.7:0/3741939846 shutdown_connections 2024-09-21T05:53:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.362+0000 7fda0b2ec640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd9f00b6620 0x7fd9f00b8b30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.362+0000 7fda0b2ec640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda04108cf0 0x7fda0419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.362+0000 7fda0b2ec640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda041083a0 0x7fda0419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.362+0000 7fda0b2ec640 1 --2- 172.21.15.7:0/3741939846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda04102a60 0x7fda0419a460 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.362+0000 7fda0b2ec640 1 -- 172.21.15.7:0/3741939846 >> 172.21.15.7:0/3741939846 conn(0x7fda04079730 msgr2=0x7fda0406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.362+0000 7fda0b2ec640 1 -- 172.21.15.7:0/3741939846 shutdown_connections 2024-09-21T05:53:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:04.362+0000 7fda0b2ec640 1 -- 172.21.15.7:0/3741939846 wait complete. 2024-09-21T05:53:04.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:04 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3741939846' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:04.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:04 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3741939846' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:04.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:04 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3741939846' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:05.112 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T05:51:50.882920+0000', 'modified': '2024-09-21T05:52:01.894944+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24691, 'mds_1': 24686, 'mds_2': 24679}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24637': {'gid': 24637, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6833/1234076482', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6832', 'nonce': 1234076482}, {'type': 'v1', 'addr': '172.21.15.119:6833', 'nonce': 1234076482}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24659': {'gid': 24659, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.27:6837/1469000794', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6836', 'nonce': 1469000794}, {'type': 'v1', 'addr': '172.21.15.27:6837', 'nonce': 1469000794}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6835/4262162696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 4262162696}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 4262162696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24679': {'gid': 24679, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.119:6837/3266640886', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6836', 'nonce': 3266640886}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 3266640886}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24686': {'gid': 24686, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.27:6839/556391029', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6838', 'nonce': 556391029}, {'type': 'v1', 'addr': '172.21.15.27:6839', 'nonce': 556391029}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24691': {'gid': 24691, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.119:6839/1840148228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 1840148228}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 1840148228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24691, 'qdb_cluster': [24679, 24686, 24691]} 2024-09-21T05:53:05.112 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T05:53:05.113 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T05:53:05.375 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:05.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:05 smithi007 ceph-mon[30983]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:53:05.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:05 smithi119 ceph-mon[34833]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:53:05.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.855+0000 7f4b11c62640 1 -- 172.21.15.7:0/2025514362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c114800 msgr2=0x7f4b0c11b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.855+0000 7f4b11c62640 1 --2- 172.21.15.7:0/2025514362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c114800 0x7f4b0c11b030 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009ca0 tx=0x7f4b0402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.855+0000 7f4b11c62640 1 -- 172.21.15.7:0/2025514362 shutdown_connections 2024-09-21T05:53:05.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.855+0000 7f4b11c62640 1 --2- 172.21.15.7:0/2025514362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c114800 0x7f4b0c11b030 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.855+0000 7f4b11c62640 1 --2- 172.21.15.7:0/2025514362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b0c113eb0 0x7f4b0c1142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.855+0000 7f4b11c62640 1 --2- 172.21.15.7:0/2025514362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b0c10e5c0 0x7f4b0c10e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.855+0000 7f4b11c62640 1 -- 172.21.15.7:0/2025514362 >> 172.21.15.7:0/2025514362 conn(0x7f4b0c10a3c0 msgr2=0x7f4b0c10c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:05.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.855+0000 7f4b11c62640 1 -- 172.21.15.7:0/2025514362 shutdown_connections 2024-09-21T05:53:05.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.855+0000 7f4b11c62640 1 -- 172.21.15.7:0/2025514362 wait complete. 2024-09-21T05:53:05.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.855+0000 7f4b11c62640 1 Processor -- start 2024-09-21T05:53:05.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b11c62640 1 -- start start 2024-09-21T05:53:05.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b11c62640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b0c10e5c0 0x7f4b0c1a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b11c62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c113eb0 0x7f4b0c1a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b11c62640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b0c114800 0x7f4b0c1aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b11c62640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c11e520 con 0x7f4b0c113eb0 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b11c62640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c11e3a0 con 0x7f4b0c114800 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b11c62640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c11e6a0 con 0x7f4b0c10e5c0 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b0affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c113eb0 0x7f4b0c1a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b0affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c113eb0 0x7f4b0c1a5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44426/0 (socket says 172.21.15.7:44426) 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b0affd640 1 -- 172.21.15.7:0/1665582597 learned_addr learned my addr 172.21.15.7:0/1665582597 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b0c10e5c0 0x7f4b0c1a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b0bfff640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b0c114800 0x7f4b0c1aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b0affd640 1 -- 172.21.15.7:0/1665582597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b0c10e5c0 msgr2=0x7f4b0c1a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b0affd640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b0c10e5c0 0x7f4b0c1a4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b0affd640 1 -- 172.21.15.7:0/1665582597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b0c114800 msgr2=0x7f4b0c1aa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b0affd640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b0c114800 0x7f4b0c1aa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b0affd640 1 -- 172.21.15.7:0/1665582597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0c1aae00 con 0x7f4b0c113eb0 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.856+0000 7f4b0bfff640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b0c114800 0x7f4b0c1aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.857+0000 7f4b0affd640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c113eb0 0x7f4b0c1a5430 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000e9f0 tx=0x7f4b0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.857+0000 7f4b08ff9640 1 -- 172.21.15.7:0/1665582597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000ccc0 con 0x7f4b0c113eb0 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.857+0000 7f4b11c62640 1 -- 172.21.15.7:0/1665582597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0c1ab0f0 con 0x7f4b0c113eb0 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.857+0000 7f4b08ff9640 1 -- 172.21.15.7:0/1665582597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b000108e0 con 0x7f4b0c113eb0 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.857+0000 7f4b11c62640 1 -- 172.21.15.7:0/1665582597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b0c1b18d0 con 0x7f4b0c113eb0 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.857+0000 7f4b08ff9640 1 -- 172.21.15.7:0/1665582597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00018860 con 0x7f4b0c113eb0 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.859+0000 7f4b181d6740 1 Processor -- start 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.859+0000 7f4b181d6740 1 -- start start 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b08ff9640 1 -- 172.21.15.7:0/1665582597 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f4b00018a00 con 0x7f4b0c113eb0 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b181d6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516aa0cf60 0x56516adb2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b181d6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516a9e40a0 0x56516adb3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b181d6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9ec280 0x56516adb3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b181d6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56516ad2ac10 con 0x56516aa0cf60 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b181d6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56516ad1a040 con 0x56516a9e40a0 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b181d6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56516ad1de50 con 0x56516a9ec280 2024-09-21T05:53:05.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516aa0cf60 0x56516adb2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516aa0cf60 0x56516adb2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44440/0 (socket says 172.21.15.7:44440) 2024-09-21T05:53:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b0bfff640 1 -- 172.21.15.7:0/336372421 learned_addr learned my addr 172.21.15.7:0/336372421 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/336372421 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516a9e40a0 0x56516adb3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b0affd640 1 --2- 172.21.15.7:0/336372421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9ec280 0x56516adb3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b0bfff640 1 -- 172.21.15.7:0/336372421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9ec280 msgr2=0x56516adb3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b0bfff640 1 --2- 172.21.15.7:0/336372421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9ec280 0x56516adb3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b0bfff640 1 -- 172.21.15.7:0/336372421 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516a9e40a0 msgr2=0x56516adb3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b0bfff640 1 --2- 172.21.15.7:0/336372421 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516a9e40a0 0x56516adb3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b0bfff640 1 -- 172.21.15.7:0/336372421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56516aa78540 con 0x56516aa0cf60 2024-09-21T05:53:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/336372421 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516a9e40a0 0x56516adb3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.860+0000 7f4b0bfff640 1 --2- 172.21.15.7:0/336372421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516aa0cf60 0x56516adb2f00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b04006010 tx=0x7f4b04009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6c4afdbfb078f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.861+0000 7f4af1ffb640 1 -- 172.21.15.7:0/336372421 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b04031cf0 con 0x56516aa0cf60 2024-09-21T05:53:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.861+0000 7f4b08ff9640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4af40b65f0 0x7f4af40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.861+0000 7f4af1ffb640 1 -- 172.21.15.7:0/336372421 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b04036070 con 0x56516aa0cf60 2024-09-21T05:53:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.861+0000 7f4af1ffb640 1 -- 172.21.15.7:0/336372421 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b040042a0 con 0x56516aa0cf60 2024-09-21T05:53:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.861+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4af40b65f0 0x7f4af40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.861+0000 7f4b08ff9640 1 -- 172.21.15.7:0/1665582597 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4b000e7a10 con 0x7f4b0c113eb0 2024-09-21T05:53:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.862+0000 7f4b181d6740 1 -- 172.21.15.7:0/336372421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516aa0cf60 msgr2=0x56516adb2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.862+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4af40b65f0 0x7f4af40b8b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x56516adb1b80 tx=0x7f4afc008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.862+0000 7f4b181d6740 1 --2- 172.21.15.7:0/336372421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516aa0cf60 0x56516adb2f00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b04006010 tx=0x7f4b04009800 comp rx=0 tx=0).stop 2024-09-21T05:53:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.862+0000 7f4b181d6740 1 -- 172.21.15.7:0/336372421 shutdown_connections 2024-09-21T05:53:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.862+0000 7f4b181d6740 1 --2- 172.21.15.7:0/336372421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9ec280 0x56516adb3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.862+0000 7f4b181d6740 1 --2- 172.21.15.7:0/336372421 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516a9e40a0 0x56516adb3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.862+0000 7f4b181d6740 1 --2- 172.21.15.7:0/336372421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516aa0cf60 0x56516adb2f00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.862+0000 7f4b181d6740 1 -- 172.21.15.7:0/336372421 >> 172.21.15.7:0/336372421 conn(0x56516aa01350 msgr2=0x56516adb0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.862+0000 7f4b181d6740 1 -- 172.21.15.7:0/336372421 shutdown_connections 2024-09-21T05:53:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.862+0000 7f4b181d6740 1 -- 172.21.15.7:0/336372421 wait complete. 2024-09-21T05:53:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.862+0000 7f4b181d6740 1 -- start start 2024-09-21T05:53:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.862+0000 7f4b181d6740 1 Processor -- start 2024-09-21T05:53:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b181d6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9e40a0 0x56516adbe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b181d6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516a9ec280 0x56516adbedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b181d6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516aa0cf60 0x56516adca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b181d6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56516ab7b5f0 con 0x56516a9e40a0 2024-09-21T05:53:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b181d6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56516acb5010 con 0x56516a9ec280 2024-09-21T05:53:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b181d6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56516adc1680 con 0x56516aa0cf60 2024-09-21T05:53:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b0b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9e40a0 0x56516adbe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b181d6740 10 client.0 _ll_register_callbacks cb 0x56516ad14340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b0b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9e40a0 0x56516adbe7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44452/0 (socket says 172.21.15.7:44452) 2024-09-21T05:53:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b0b7fe640 1 -- 172.21.15.7:0/322424845 learned_addr learned my addr 172.21.15.7:0/322424845 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b0affd640 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516a9ec280 0x56516adbedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b0bfff640 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516aa0cf60 0x56516adca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b0b7fe640 1 -- 172.21.15.7:0/322424845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516aa0cf60 msgr2=0x56516adca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516aa0cf60 0x56516adca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b0b7fe640 1 -- 172.21.15.7:0/322424845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516a9ec280 msgr2=0x56516adbedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516a9ec280 0x56516adbedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b0b7fe640 1 -- 172.21.15.7:0/322424845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56516ace2a00 con 0x56516a9e40a0 2024-09-21T05:53:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b0bfff640 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516aa0cf60 0x56516adca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9e40a0 0x56516adbe7d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4afc016800 tx=0x7f4afc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225485ff2d00df39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.863+0000 7f4aeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4aeaffd640 1 -- 172.21.15.7:0/322424845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0148c0 con 0x56516a9e40a0 2024-09-21T05:53:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4aeaffd640 1 -- 172.21.15.7:0/322424845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4afc014a60 con 0x56516a9e40a0 2024-09-21T05:53:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4b181d6740 1 -- 172.21.15.7:0/322424845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b04036070 con 0x56516a9e40a0 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4aeaffd640 1 -- 172.21.15.7:0/322424845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4afc014c60 con 0x56516a9e40a0 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4b181d6740 10 client.15222 fetch_fsmap learned FSMap version 24 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4b181d6740 1 -- 172.21.15.7:0/322424845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56516adcd5d0 con 0x56516a9e40a0 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4aeaffd640 1 -- 172.21.15.7:0/322424845 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b04036070 con 0x56516a9e40a0 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4aeaffd640 1 -- 172.21.15.7:0/322424845 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4afc0203d0 con 0x56516a9e40a0 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4b181d6740 10 client.15222 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4b181d6740 10 client.15222 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4b181d6740 20 client.15222 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4b181d6740 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56516a9cb8e0 0x56516add1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4b181d6740 4 client.15222 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.864+0000 7f4b181d6740 1 -- 172.21.15.7:0/322424845 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56516ad2cb60 con 0x56516a9cb8e0 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.865+0000 7f4b0affd640 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56516a9cb8e0 0x56516add1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.865+0000 7f4aeaffd640 10 client.15222 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.865+0000 7f4b0affd640 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56516a9cb8e0 0x56516add1100 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=365f0a4bd9be990a server_cookie=94a1f907594336ac in_seq=0 out_seq=0 2024-09-21T05:53:05.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.866+0000 7f4aeaffd640 1 -- 172.21.15.7:0/322424845 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56516ad2cb60 con 0x56516a9cb8e0 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.866+0000 7f4aeaffd640 10 client.15222 handle_command_reply: tid=0 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.866+0000 7f4b181d6740 1 client.15222 shutdown 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.866+0000 7f4b181d6740 1 -- 172.21.15.7:0/322424845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9e40a0 msgr2=0x56516adbe7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.866+0000 7f4b181d6740 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9e40a0 0x56516adbe7d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4afc016800 tx=0x7f4afc0046c0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.866+0000 7f4b181d6740 1 -- 172.21.15.7:0/322424845 shutdown_connections 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.866+0000 7f4b181d6740 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56516a9cb8e0 0x56516add1100 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.866+0000 7f4b181d6740 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516aa0cf60 0x56516adca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.866+0000 7f4b181d6740 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516a9ec280 0x56516adbedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.866+0000 7f4aeaffd640 0 client.15222 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.866+0000 7f4b181d6740 1 --2- 172.21.15.7:0/322424845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9e40a0 0x56516adbe7d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.866+0000 7f4b181d6740 1 -- 172.21.15.7:0/322424845 >> 172.21.15.7:0/322424845 conn(0x56516aa01350 msgr2=0x56516adb60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.866+0000 7f4b181d6740 1 -- 172.21.15.7:0/322424845 shutdown_connections 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.867+0000 7f4b181d6740 1 -- 172.21.15.7:0/322424845 wait complete. 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.867+0000 7f4b181d6740 20 client.15222 trim_cache size 0 max 16384 2024-09-21T05:53:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b181d6740 1 Processor -- start 2024-09-21T05:53:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b181d6740 1 -- start start 2024-09-21T05:53:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b181d6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9e40a0 0x56516adbd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b181d6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 0x56516adbd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b181d6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516aa0cf60 0x56516adb0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b181d6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56516adcf440 con 0x56516a9ec280 2024-09-21T05:53:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b181d6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56516adcfb10 con 0x56516aa0cf60 2024-09-21T05:53:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b181d6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56516add01e0 con 0x56516a9e40a0 2024-09-21T05:53:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b0affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 0x56516adbd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b0affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 0x56516adbd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44454/0 (socket says 172.21.15.7:44454) 2024-09-21T05:53:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b0affd640 1 -- 172.21.15.7:0/3341116948 learned_addr learned my addr 172.21.15.7:0/3341116948 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/3341116948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9e40a0 0x56516adbd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b0affd640 1 -- 172.21.15.7:0/3341116948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9e40a0 msgr2=0x56516adbd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b0bfff640 1 --2- 172.21.15.7:0/3341116948 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516aa0cf60 0x56516adb0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b0affd640 1 --2- 172.21.15.7:0/3341116948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9e40a0 0x56516adbd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b0affd640 1 -- 172.21.15.7:0/3341116948 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516aa0cf60 msgr2=0x56516adb0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b0affd640 1 --2- 172.21.15.7:0/3341116948 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516aa0cf60 0x56516adb0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b0affd640 1 -- 172.21.15.7:0/3341116948 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56516adb5d60 con 0x56516a9ec280 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/3341116948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9e40a0 0x56516adbd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.885+0000 7f4b0affd640 1 --2- 172.21.15.7:0/3341116948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 0x56516adbd590 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000c6a0 tx=0x7f4b000eb560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebb51c93d012884 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.886+0000 7f4af17fa640 1 -- 172.21.15.7:0/3341116948 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000ad2f0 con 0x56516a9ec280 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.886+0000 7f4af17fa640 1 -- 172.21.15.7:0/3341116948 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b000ad4b0 con 0x56516a9ec280 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.886+0000 7f4af17fa640 1 -- 172.21.15.7:0/3341116948 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000a9110 con 0x56516a9ec280 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.886+0000 7f4b181d6740 1 -- 172.21.15.7:0/3341116948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 msgr2=0x56516adbd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.886+0000 7f4b181d6740 1 --2- 172.21.15.7:0/3341116948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 0x56516adbd590 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000c6a0 tx=0x7f4b000eb560 comp rx=0 tx=0).stop 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.886+0000 7f4b181d6740 1 -- 172.21.15.7:0/3341116948 shutdown_connections 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.886+0000 7f4b181d6740 1 --2- 172.21.15.7:0/3341116948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 0x56516adbd590 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.886+0000 7f4b181d6740 1 --2- 172.21.15.7:0/3341116948 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516aa0cf60 0x56516adb0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.886+0000 7f4b181d6740 1 --2- 172.21.15.7:0/3341116948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9e40a0 0x56516adbd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.886+0000 7f4b181d6740 1 -- 172.21.15.7:0/3341116948 >> 172.21.15.7:0/3341116948 conn(0x56516aa01350 msgr2=0x56516adcea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.886+0000 7f4b181d6740 1 -- 172.21.15.7:0/3341116948 shutdown_connections 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.887+0000 7f4b181d6740 1 -- 172.21.15.7:0/3341116948 wait complete. 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.887+0000 7f4b181d6740 1 -- start start 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.887+0000 7f4b181d6740 1 Processor -- start 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.887+0000 7f4b181d6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9e40a0 0x56516add38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.887+0000 7f4b181d6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 0x56516add3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.887+0000 7f4b181d6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516aa0cf60 0x56516add8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.887+0000 7f4b181d6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56516add0f80 con 0x56516a9ec280 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.887+0000 7f4b181d6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56516add08b0 con 0x56516aa0cf60 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.887+0000 7f4b181d6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56516add1650 con 0x56516a9e40a0 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.887+0000 7f4b181d6740 10 client.0 _ll_register_callbacks cb 0x7f4afc00b7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b0affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 0x56516add3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b0affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 0x56516add3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44470/0 (socket says 172.21.15.7:44470) 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b0affd640 1 -- 172.21.15.7:0/3068266343 learned_addr learned my addr 172.21.15.7:0/3068266343 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516aa0cf60 0x56516add8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/3068266343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9e40a0 0x56516add38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b0affd640 1 -- 172.21.15.7:0/3068266343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9e40a0 msgr2=0x56516add38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b0affd640 1 --2- 172.21.15.7:0/3068266343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9e40a0 0x56516add38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b0affd640 1 -- 172.21.15.7:0/3068266343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516aa0cf60 msgr2=0x56516add8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b0affd640 1 --2- 172.21.15.7:0/3068266343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516aa0cf60 0x56516add8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b0affd640 1 -- 172.21.15.7:0/3068266343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56516add93e0 con 0x56516a9ec280 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/3068266343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9e40a0 0x56516add38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b0affd640 1 --2- 172.21.15.7:0/3068266343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 0x56516add3e20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4b000e58a0 tx=0x7f4b0000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7823e8d51ab98e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4aeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4aeaffd640 1 -- 172.21.15.7:0/3068266343 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000ad110 con 0x56516a9ec280 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4aeaffd640 1 -- 172.21.15.7:0/3068266343 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4b000b2090 con 0x56516a9ec280 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b181d6740 1 -- 172.21.15.7:0/3068266343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b000ad4b0 con 0x56516a9ec280 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4aeaffd640 1 -- 172.21.15.7:0/3068266343 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4b000b2480 con 0x56516a9ec280 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b181d6740 10 client.15228 fetch_fsmap learned FSMap version 24 2024-09-21T05:53:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4b181d6740 1 -- 172.21.15.7:0/3068266343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56516ae3cb60 con 0x56516a9ec280 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.888+0000 7f4aeaffd640 1 -- 172.21.15.7:0/3068266343 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b000ad4b0 con 0x56516a9ec280 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.889+0000 7f4aeaffd640 1 -- 172.21.15.7:0/3068266343 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4b000a92f0 con 0x56516a9ec280 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.889+0000 7f4b181d6740 10 client.15228 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.889+0000 7f4b181d6740 10 client.15228 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.889+0000 7f4b181d6740 20 client.15228 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.889+0000 7f4b181d6740 1 --2- 172.21.15.7:0/3068266343 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56516a9a0c90 0x56516ae3fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.889+0000 7f4b181d6740 4 client.15228 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.889+0000 7f4b181d6740 1 -- 172.21.15.7:0/3068266343 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "status"}) -- 0x56516ad28610 con 0x56516a9a0c90 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.889+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/3068266343 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56516a9a0c90 0x56516ae3fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4aeaffd640 10 client.15228 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4b0b7fe640 1 --2- 172.21.15.7:0/3068266343 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56516a9a0c90 0x56516ae3fff0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=79e3db32d50b835 server_cookie=67cb41608336fa1b in_seq=0 out_seq=0 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4aeaffd640 1 -- 172.21.15.7:0/3068266343 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56516ad28610 con 0x56516a9a0c90 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4aeaffd640 10 client.15228 handle_command_reply: tid=0 2024-09-21T05:53:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4b181d6740 1 client.15228 shutdown 2024-09-21T05:53:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4b181d6740 1 -- 172.21.15.7:0/3068266343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 msgr2=0x56516add3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4b181d6740 1 --2- 172.21.15.7:0/3068266343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 0x56516add3e20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4b000e58a0 tx=0x7f4b0000cef0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4b181d6740 1 -- 172.21.15.7:0/3068266343 shutdown_connections 2024-09-21T05:53:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4b181d6740 1 --2- 172.21.15.7:0/3068266343 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56516a9a0c90 0x56516ae3fff0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4b181d6740 1 --2- 172.21.15.7:0/3068266343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56516a9ec280 0x56516add3e20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4b181d6740 1 --2- 172.21.15.7:0/3068266343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56516aa0cf60 0x56516add8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4aeaffd640 0 client.15228 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:53:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4b181d6740 1 --2- 172.21.15.7:0/3068266343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56516a9e40a0 0x56516add38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4b181d6740 1 -- 172.21.15.7:0/3068266343 >> 172.21.15.7:0/3068266343 conn(0x56516aa01350 msgr2=0x56516adbe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4b181d6740 1 -- 172.21.15.7:0/3068266343 shutdown_connections 2024-09-21T05:53:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4b181d6740 1 -- 172.21.15.7:0/3068266343 wait complete. 2024-09-21T05:53:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.890+0000 7f4b181d6740 20 client.15228 trim_cache size 0 max 16384 2024-09-21T05:53:05.925 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:53:05.925 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "397810bc-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:53:05.925 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-09-21T05:53:05.925 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24679, 2024-09-21T05:53:05.925 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-21T05:53:05.925 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-21T05:53:05.925 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-21T05:53:05.925 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 66.578378537999996, 2024-09-21T05:53:05.925 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-21T05:53:05.925 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 75, 2024-09-21T05:53:05.925 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T05:53:05.925 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 98.543697753999993 2024-09-21T05:53:05.925 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:53:05.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.891+0000 7f4b11c62640 1 -- 172.21.15.7:0/1665582597 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4af40b65f0 msgr2=0x7f4af40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.891+0000 7f4b11c62640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4af40b65f0 0x7f4af40b8b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x56516adb1b80 tx=0x7f4afc008040 comp rx=0 tx=0).stop 2024-09-21T05:53:05.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.891+0000 7f4b11c62640 1 -- 172.21.15.7:0/1665582597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c113eb0 msgr2=0x7f4b0c1a5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.891+0000 7f4b11c62640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c113eb0 0x7f4b0c1a5430 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000e9f0 tx=0x7f4b0000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.891+0000 7f4b11c62640 1 -- 172.21.15.7:0/1665582597 shutdown_connections 2024-09-21T05:53:05.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.891+0000 7f4b11c62640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4af40b65f0 0x7f4af40b8b00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.891+0000 7f4b11c62640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b0c113eb0 0x7f4b0c1a5430 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.891+0000 7f4b11c62640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b0c114800 0x7f4b0c1aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.891+0000 7f4b11c62640 1 --2- 172.21.15.7:0/1665582597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b0c10e5c0 0x7f4b0c1a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.891+0000 7f4b11c62640 1 -- 172.21.15.7:0/1665582597 >> 172.21.15.7:0/1665582597 conn(0x7f4b0c10a3c0 msgr2=0x7f4b0c1113b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:05.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.891+0000 7f4b11c62640 1 -- 172.21.15.7:0/1665582597 shutdown_connections 2024-09-21T05:53:05.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:05.891+0000 7f4b11c62640 1 -- 172.21.15.7:0/1665582597 wait complete. 2024-09-21T05:53:05.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:05 smithi027 ceph-mon[34364]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:53:06.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T05:53:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.290+0000 7f9b50a6d640 1 -- 172.21.15.7:0/3339489096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b4c102a60 msgr2=0x7f9b4c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.290+0000 7f9b50a6d640 1 --2- 172.21.15.7:0/3339489096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b4c102a60 0x7f9b4c102e70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009ca0 tx=0x7f9b4002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.290+0000 7f9b50a6d640 1 -- 172.21.15.7:0/3339489096 shutdown_connections 2024-09-21T05:53:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.290+0000 7f9b50a6d640 1 --2- 172.21.15.7:0/3339489096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b4c108cf0 0x7f9b4c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.290+0000 7f9b50a6d640 1 --2- 172.21.15.7:0/3339489096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4c1083a0 0x7f9b4c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.290+0000 7f9b50a6d640 1 --2- 172.21.15.7:0/3339489096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b4c102a60 0x7f9b4c102e70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.290+0000 7f9b50a6d640 1 -- 172.21.15.7:0/3339489096 >> 172.21.15.7:0/3339489096 conn(0x7f9b4c079730 msgr2=0x7f9b4c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.290+0000 7f9b50a6d640 1 -- 172.21.15.7:0/3339489096 shutdown_connections 2024-09-21T05:53:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.290+0000 7f9b50a6d640 1 -- 172.21.15.7:0/3339489096 wait complete. 2024-09-21T05:53:07.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.291+0000 7f9b50a6d640 1 Processor -- start 2024-09-21T05:53:07.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.291+0000 7f9b50a6d640 1 -- start start 2024-09-21T05:53:07.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b50a6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4c102a60 0x7f9b4c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b50a6d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b4c1083a0 0x7f9b4c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b50a6d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b4c108cf0 0x7f9b4c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b50a6d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c113a80 con 0x7f9b4c108cf0 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b50a6d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c113900 con 0x7f9b4c1083a0 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b50a6d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c113c00 con 0x7f9b4c102a60 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b4c108cf0 0x7f9b4c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b4a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4c102a60 0x7f9b4c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b4c108cf0 0x7f9b4c19fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44492/0 (socket says 172.21.15.7:44492) 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b4ad9d640 1 -- 172.21.15.7:0/178379195 learned_addr learned my addr 172.21.15.7:0/178379195 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b49d9b640 1 --2- 172.21.15.7:0/178379195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b4c1083a0 0x7f9b4c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b4ad9d640 1 -- 172.21.15.7:0/178379195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4c102a60 msgr2=0x7f9b4c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b4ad9d640 1 --2- 172.21.15.7:0/178379195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4c102a60 0x7f9b4c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b4ad9d640 1 -- 172.21.15.7:0/178379195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b4c1083a0 msgr2=0x7f9b4c19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b4ad9d640 1 --2- 172.21.15.7:0/178379195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b4c1083a0 0x7f9b4c19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b4ad9d640 1 -- 172.21.15.7:0/178379195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4c1a0440 con 0x7f9b4c108cf0 2024-09-21T05:53:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.292+0000 7f9b4ad9d640 1 --2- 172.21.15.7:0/178379195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b4c108cf0 0x7f9b4c19fd10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400d750 tx=0x7f9b4400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.293+0000 7f9b3b7fe640 1 -- 172.21.15.7:0/178379195 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44017070 con 0x7f9b4c108cf0 2024-09-21T05:53:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.293+0000 7f9b50a6d640 1 -- 172.21.15.7:0/178379195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4c1a0730 con 0x7f9b4c108cf0 2024-09-21T05:53:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.293+0000 7f9b3b7fe640 1 -- 172.21.15.7:0/178379195 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b440054d0 con 0x7f9b4c108cf0 2024-09-21T05:53:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.293+0000 7f9b3b7fe640 1 -- 172.21.15.7:0/178379195 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44004c60 con 0x7f9b4c108cf0 2024-09-21T05:53:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.293+0000 7f9b50a6d640 1 -- 172.21.15.7:0/178379195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4c1a6e90 con 0x7f9b4c108cf0 2024-09-21T05:53:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.295+0000 7f9b3b7fe640 1 -- 172.21.15.7:0/178379195 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f9b44009bd0 con 0x7f9b4c108cf0 2024-09-21T05:53:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.295+0000 7f9b56fe1740 1 Processor -- start 2024-09-21T05:53:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b56fe1740 1 -- start start 2024-09-21T05:53:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b56fe1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 0x5589c192ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b56fe1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 0x5589c192f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b56fe1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c192f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b56fe1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5589c18a6c10 con 0x5589c1568280 2024-09-21T05:53:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b56fe1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5589c1896040 con 0x5589c1588f60 2024-09-21T05:53:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b56fe1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5589c1899e50 con 0x5589c15600a0 2024-09-21T05:53:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b49d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c192f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b49d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c192f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44508/0 (socket says 172.21.15.7:44508) 2024-09-21T05:53:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b49d9b640 1 -- 172.21.15.7:0/597111352 learned_addr learned my addr 172.21.15.7:0/597111352 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b49d9b640 1 --2- 172.21.15.7:0/597111352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 0x5589c192ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b4a59c640 1 --2- 172.21.15.7:0/597111352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 0x5589c192f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b49d9b640 1 -- 172.21.15.7:0/597111352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 msgr2=0x5589c192f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b49d9b640 1 --2- 172.21.15.7:0/597111352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 0x5589c192f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b49d9b640 1 -- 172.21.15.7:0/597111352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 msgr2=0x5589c192ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b49d9b640 1 --2- 172.21.15.7:0/597111352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 0x5589c192ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.296+0000 7f9b49d9b640 1 -- 172.21.15.7:0/597111352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589c15f4540 con 0x5589c1568280 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.297+0000 7f9b3b7fe640 1 --2- 172.21.15.7:0/178379195 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9b340b65f0 0x7f9b340b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.297+0000 7f9b49d9b640 1 --2- 172.21.15.7:0/597111352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c192f980 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c005c30 tx=0x7f9b3c00a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45903fb06c4b0879 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.297+0000 7f9b4a59c640 1 --2- 172.21.15.7:0/178379195 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9b340b65f0 0x7f9b340b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.297+0000 7f9b38ff9640 1 -- 172.21.15.7:0/597111352 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c004220 con 0x5589c1568280 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.297+0000 7f9b3b7fe640 1 -- 172.21.15.7:0/178379195 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9b440e6e40 con 0x7f9b4c108cf0 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.297+0000 7f9b38ff9640 1 -- 172.21.15.7:0/597111352 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b3c0043c0 con 0x5589c1568280 2024-09-21T05:53:07.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.297+0000 7f9b38ff9640 1 -- 172.21.15.7:0/597111352 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c00f690 con 0x5589c1568280 2024-09-21T05:53:07.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.298+0000 7f9b56fe1740 1 -- 172.21.15.7:0/597111352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 msgr2=0x5589c192f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.298+0000 7f9b4a59c640 1 --2- 172.21.15.7:0/178379195 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9b340b65f0 0x7f9b340b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x5589c192db80 tx=0x7f9b40009440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:07.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.298+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/597111352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c192f980 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c005c30 tx=0x7f9b3c00a750 comp rx=0 tx=0).stop 2024-09-21T05:53:07.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.298+0000 7f9b56fe1740 1 -- 172.21.15.7:0/597111352 shutdown_connections 2024-09-21T05:53:07.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.298+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/597111352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c192f980 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.298+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/597111352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 0x5589c192f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.298+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/597111352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 0x5589c192ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.298+0000 7f9b56fe1740 1 -- 172.21.15.7:0/597111352 >> 172.21.15.7:0/597111352 conn(0x5589c157d350 msgr2=0x5589c192cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.298+0000 7f9b56fe1740 1 -- 172.21.15.7:0/597111352 shutdown_connections 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.298+0000 7f9b56fe1740 1 -- 172.21.15.7:0/597111352 wait complete. 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.298+0000 7f9b56fe1740 1 -- start start 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b56fe1740 1 Processor -- start 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b56fe1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 0x5589c193a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b56fe1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c193ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b56fe1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 0x5589c1946a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b56fe1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5589c16f75f0 con 0x5589c1568280 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b56fe1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5589c1831010 con 0x5589c1588f60 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b56fe1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5589c193d730 con 0x5589c15600a0 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b56fe1740 10 client.0 _ll_register_callbacks cb 0x5589c1890340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b49d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c193ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b49d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c193ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44512/0 (socket says 172.21.15.7:44512) 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b49d9b640 1 -- 172.21.15.7:0/6573998 learned_addr learned my addr 172.21.15.7:0/6573998 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:07.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b4ad9d640 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 0x5589c1946a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b4a59c640 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 0x5589c193a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b49d9b640 1 -- 172.21.15.7:0/6573998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 msgr2=0x5589c193a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.299+0000 7f9b49d9b640 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 0x5589c193a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.300+0000 7f9b49d9b640 1 -- 172.21.15.7:0/6573998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 msgr2=0x5589c1946a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.300+0000 7f9b49d9b640 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 0x5589c1946a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.300+0000 7f9b49d9b640 1 -- 172.21.15.7:0/6573998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589c185ea00 con 0x5589c1568280 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.300+0000 7f9b4a59c640 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 0x5589c193a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.300+0000 7f9b49d9b640 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c193ad40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00a500 tx=0x7f9b3c0042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25a0c064231e394 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.300+0000 7f9b31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.300+0000 7f9b31ffb640 1 -- 172.21.15.7:0/6573998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c02b060 con 0x5589c1568280 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.300+0000 7f9b31ffb640 1 -- 172.21.15.7:0/6573998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9b3c005230 con 0x5589c1568280 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.300+0000 7f9b56fe1740 1 -- 172.21.15.7:0/6573998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b3c0043c0 con 0x5589c1568280 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.300+0000 7f9b31ffb640 1 -- 172.21.15.7:0/6573998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9b3c0046c0 con 0x5589c1568280 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.300+0000 7f9b56fe1740 10 client.15240 fetch_fsmap learned FSMap version 24 2024-09-21T05:53:07.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.300+0000 7f9b56fe1740 1 -- 172.21.15.7:0/6573998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5589c1949620 con 0x5589c1568280 2024-09-21T05:53:07.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.300+0000 7f9b31ffb640 1 -- 172.21.15.7:0/6573998 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b3c0043c0 con 0x5589c1568280 2024-09-21T05:53:07.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.301+0000 7f9b31ffb640 1 -- 172.21.15.7:0/6573998 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9b3c01b030 con 0x5589c1568280 2024-09-21T05:53:07.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.301+0000 7f9b56fe1740 10 client.15240 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T05:53:07.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.301+0000 7f9b56fe1740 10 client.15240 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:53:07.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.301+0000 7f9b56fe1740 20 client.15240 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:07.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.301+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5589c15478e0 0x5589c194cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.301+0000 7f9b56fe1740 4 client.15240 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:53:07.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.301+0000 7f9b56fe1740 1 -- 172.21.15.7:0/6573998 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589c18a8b60 con 0x5589c15478e0 2024-09-21T05:53:07.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.301+0000 7f9b4a59c640 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5589c15478e0 0x5589c194cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.302+0000 7f9b4a59c640 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5589c15478e0 0x5589c194cdf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ad3b0117c4a0162c server_cookie=d9b48afd51535594 in_seq=0 out_seq=0 2024-09-21T05:53:07.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.302+0000 7f9b31ffb640 10 client.15240 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:53:07.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.302+0000 7f9b31ffb640 1 -- 172.21.15.7:0/6573998 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5589c18a8b60 con 0x5589c15478e0 2024-09-21T05:53:07.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.302+0000 7f9b31ffb640 10 client.15240 handle_command_reply: tid=0 2024-09-21T05:53:07.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.302+0000 7f9b56fe1740 1 client.15240 shutdown 2024-09-21T05:53:07.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.303+0000 7f9b56fe1740 1 -- 172.21.15.7:0/6573998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 msgr2=0x5589c193ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.303+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c193ad40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00a500 tx=0x7f9b3c0042d0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.303+0000 7f9b56fe1740 1 -- 172.21.15.7:0/6573998 shutdown_connections 2024-09-21T05:53:07.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.303+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5589c15478e0 0x5589c194cdf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.303+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c193ad40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.303+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 0x5589c1946a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.303+0000 7f9b31ffb640 0 client.15240 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:53:07.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.303+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/6573998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 0x5589c193a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.303+0000 7f9b56fe1740 1 -- 172.21.15.7:0/6573998 >> 172.21.15.7:0/6573998 conn(0x5589c157d350 msgr2=0x5589c19308f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:07.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.303+0000 7f9b56fe1740 1 -- 172.21.15.7:0/6573998 shutdown_connections 2024-09-21T05:53:07.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.303+0000 7f9b56fe1740 1 -- 172.21.15.7:0/6573998 wait complete. 2024-09-21T05:53:07.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.303+0000 7f9b56fe1740 20 client.15240 trim_cache size 0 max 16384 2024-09-21T05:53:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.321+0000 7f9b56fe1740 1 Processor -- start 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.321+0000 7f9b56fe1740 1 -- start start 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.321+0000 7f9b56fe1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c15600a0 0x5589c1927ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.321+0000 7f9b56fe1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c1568280 0x5589c1934160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.321+0000 7f9b56fe1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1588f60 0x5589c19469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.321+0000 7f9b56fe1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5589c194b130 con 0x5589c1588f60 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.321+0000 7f9b56fe1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5589c194b800 con 0x5589c15600a0 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.321+0000 7f9b56fe1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5589c194bed0 con 0x5589c1568280 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.321+0000 7f9b4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1588f60 0x5589c19469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.321+0000 7f9b4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1588f60 0x5589c19469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44514/0 (socket says 172.21.15.7:44514) 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.322+0000 7f9b4ad9d640 1 -- 172.21.15.7:0/1195310236 learned_addr learned my addr 172.21.15.7:0/1195310236 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.322+0000 7f9b4a59c640 1 --2- 172.21.15.7:0/1195310236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c15600a0 0x5589c1927ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.322+0000 7f9b49d9b640 1 --2- 172.21.15.7:0/1195310236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c1568280 0x5589c1934160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.322+0000 7f9b4ad9d640 1 -- 172.21.15.7:0/1195310236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c1568280 msgr2=0x5589c1934160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.322+0000 7f9b4ad9d640 1 --2- 172.21.15.7:0/1195310236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c1568280 0x5589c1934160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.322+0000 7f9b4ad9d640 1 -- 172.21.15.7:0/1195310236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c15600a0 msgr2=0x5589c1927ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.322+0000 7f9b4ad9d640 1 --2- 172.21.15.7:0/1195310236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c15600a0 0x5589c1927ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.322+0000 7f9b4ad9d640 1 -- 172.21.15.7:0/1195310236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589c19311f0 con 0x5589c1588f60 2024-09-21T05:53:07.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.322+0000 7f9b4ad9d640 1 --2- 172.21.15.7:0/1195310236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1588f60 0x5589c19469c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9b44004770 tx=0x7f9b440a94d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7390584c44eaedc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.322+0000 7f9b33fff640 1 -- 172.21.15.7:0/1195310236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44020040 con 0x5589c1588f60 2024-09-21T05:53:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.322+0000 7f9b33fff640 1 -- 172.21.15.7:0/1195310236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b440b18b0 con 0x5589c1588f60 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.322+0000 7f9b33fff640 1 -- 172.21.15.7:0/1195310236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b440a8a30 con 0x5589c1588f60 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.323+0000 7f9b56fe1740 1 -- 172.21.15.7:0/1195310236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1588f60 msgr2=0x5589c19469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.323+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/1195310236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1588f60 0x5589c19469c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9b44004770 tx=0x7f9b440a94d0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.323+0000 7f9b56fe1740 1 -- 172.21.15.7:0/1195310236 shutdown_connections 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.323+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/1195310236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1588f60 0x5589c19469c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.323+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/1195310236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c1568280 0x5589c1934160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.323+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/1195310236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c15600a0 0x5589c1927ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.323+0000 7f9b56fe1740 1 -- 172.21.15.7:0/1195310236 >> 172.21.15.7:0/1195310236 conn(0x5589c157d350 msgr2=0x5589c1938fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.323+0000 7f9b56fe1740 1 -- 172.21.15.7:0/1195310236 shutdown_connections 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.323+0000 7f9b56fe1740 1 -- 172.21.15.7:0/1195310236 wait complete. 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.323+0000 7f9b56fe1740 1 -- start start 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b56fe1740 1 Processor -- start 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b56fe1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 0x5589c1955050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b56fe1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c1955590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b56fe1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 0x5589c194dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b56fe1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5589c194cc70 con 0x5589c1568280 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b56fe1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5589c194c5a0 con 0x5589c1588f60 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b56fe1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5589c194d340 con 0x5589c15600a0 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b56fe1740 10 client.0 _ll_register_callbacks cb 0x7f9b3c00af20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b49d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c1955590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b49d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c1955590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44518/0 (socket says 172.21.15.7:44518) 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b49d9b640 1 -- 172.21.15.7:0/467667380 learned_addr learned my addr 172.21.15.7:0/467667380 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b4ad9d640 1 --2- 172.21.15.7:0/467667380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 0x5589c194dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b4a59c640 1 --2- 172.21.15.7:0/467667380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 0x5589c1955050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b49d9b640 1 -- 172.21.15.7:0/467667380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 msgr2=0x5589c1955050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b49d9b640 1 --2- 172.21.15.7:0/467667380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 0x5589c1955050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b49d9b640 1 -- 172.21.15.7:0/467667380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 msgr2=0x5589c194dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b49d9b640 1 --2- 172.21.15.7:0/467667380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 0x5589c194dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.324+0000 7f9b49d9b640 1 -- 172.21.15.7:0/467667380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589c194e530 con 0x5589c1568280 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b49d9b640 1 --2- 172.21.15.7:0/467667380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c1955590 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c005e70 tx=0x7f9b3c003640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fa8c687a46bafd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b31ffb640 1 -- 172.21.15.7:0/467667380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c02b040 con 0x5589c1568280 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b31ffb640 1 -- 172.21.15.7:0/467667380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9b3c00a570 con 0x5589c1568280 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b56fe1740 1 -- 172.21.15.7:0/467667380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b440b18b0 con 0x5589c1568280 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b31ffb640 1 -- 172.21.15.7:0/467667380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9b3c004340 con 0x5589c1568280 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b56fe1740 10 client.15246 fetch_fsmap learned FSMap version 24 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b56fe1740 1 -- 172.21.15.7:0/467667380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5589c19b88e0 con 0x5589c1568280 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b31ffb640 1 -- 172.21.15.7:0/467667380 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b440b18b0 con 0x5589c1568280 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b31ffb640 1 -- 172.21.15.7:0/467667380 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9b3c01b050 con 0x5589c1568280 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b56fe1740 10 client.15246 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b56fe1740 10 client.15246 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b56fe1740 20 client.15246 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/467667380 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5589c151cc90 0x5589c19bc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b56fe1740 4 client.15246 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:53:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.325+0000 7f9b56fe1740 1 -- 172.21.15.7:0/467667380 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "status"}) -- 0x5589c18a4610 con 0x5589c151cc90 2024-09-21T05:53:07.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.326+0000 7f9b4a59c640 1 --2- 172.21.15.7:0/467667380 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5589c151cc90 0x5589c19bc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.326+0000 7f9b4a59c640 1 --2- 172.21.15.7:0/467667380 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5589c151cc90 0x5589c19bc140 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=39d77951fb6156e server_cookie=4ab8d179ac9f0cdd in_seq=0 out_seq=0 2024-09-21T05:53:07.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.326+0000 7f9b31ffb640 10 client.15246 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.326+0000 7f9b31ffb640 1 -- 172.21.15.7:0/467667380 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5589c18a4610 con 0x5589c151cc90 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.326+0000 7f9b31ffb640 10 client.15246 handle_command_reply: tid=0 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.326+0000 7f9b56fe1740 1 client.15246 shutdown 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b56fe1740 1 -- 172.21.15.7:0/467667380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 msgr2=0x5589c1955590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/467667380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c1955590 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c005e70 tx=0x7f9b3c003640 comp rx=0 tx=0).stop 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b56fe1740 1 -- 172.21.15.7:0/467667380 shutdown_connections 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/467667380 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5589c151cc90 0x5589c19bc140 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/467667380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589c1568280 0x5589c1955590 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/467667380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5589c1588f60 0x5589c194dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b56fe1740 1 --2- 172.21.15.7:0/467667380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5589c15600a0 0x5589c1955050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b31ffb640 0 client.15246 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b56fe1740 1 -- 172.21.15.7:0/467667380 >> 172.21.15.7:0/467667380 conn(0x5589c157d350 msgr2=0x5589c1932000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b56fe1740 1 -- 172.21.15.7:0/467667380 shutdown_connections 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b56fe1740 1 -- 172.21.15.7:0/467667380 wait complete. 2024-09-21T05:53:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b56fe1740 20 client.15246 trim_cache size 0 max 16384 2024-09-21T05:53:07.333 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:53:07.333 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "397810bc-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:53:07.333 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-09-21T05:53:07.333 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24686, 2024-09-21T05:53:07.333 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-21T05:53:07.333 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-21T05:53:07.333 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-21T05:53:07.333 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 69.022984523999995, 2024-09-21T05:53:07.333 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-21T05:53:07.333 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 75, 2024-09-21T05:53:07.333 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T05:53:07.333 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 87.255762834999999 2024-09-21T05:53:07.333 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:53:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b50a6d640 1 -- 172.21.15.7:0/178379195 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9b340b65f0 msgr2=0x7f9b340b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b50a6d640 1 --2- 172.21.15.7:0/178379195 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9b340b65f0 0x7f9b340b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x5589c192db80 tx=0x7f9b40009440 comp rx=0 tx=0).stop 2024-09-21T05:53:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b50a6d640 1 -- 172.21.15.7:0/178379195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b4c108cf0 msgr2=0x7f9b4c19fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.327+0000 7f9b50a6d640 1 --2- 172.21.15.7:0/178379195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b4c108cf0 0x7f9b4c19fd10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400d750 tx=0x7f9b4400dc10 comp rx=0 tx=0).stop 2024-09-21T05:53:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.328+0000 7f9b50a6d640 1 -- 172.21.15.7:0/178379195 shutdown_connections 2024-09-21T05:53:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.328+0000 7f9b50a6d640 1 --2- 172.21.15.7:0/178379195 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9b340b65f0 0x7f9b340b8b00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.328+0000 7f9b50a6d640 1 --2- 172.21.15.7:0/178379195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b4c108cf0 0x7f9b4c19fd10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.328+0000 7f9b50a6d640 1 --2- 172.21.15.7:0/178379195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b4c1083a0 0x7f9b4c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.328+0000 7f9b50a6d640 1 --2- 172.21.15.7:0/178379195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4c102a60 0x7f9b4c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.328+0000 7f9b50a6d640 1 -- 172.21.15.7:0/178379195 >> 172.21.15.7:0/178379195 conn(0x7f9b4c079730 msgr2=0x7f9b4c1014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.328+0000 7f9b50a6d640 1 -- 172.21.15.7:0/178379195 shutdown_connections 2024-09-21T05:53:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:07.328+0000 7f9b50a6d640 1 -- 172.21.15.7:0/178379195 wait complete. 2024-09-21T05:53:07.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:07 smithi007 ceph-mon[30983]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:53:07.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:07 smithi119 ceph-mon[34833]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:53:07.933 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T05:53:07.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:07 smithi027 ceph-mon[34364]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:53:08.192 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.590+0000 7fef2054d640 1 -- 172.21.15.7:0/2421879729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef18102a80 msgr2=0x7fef18102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.590+0000 7fef2054d640 1 --2- 172.21.15.7:0/2421879729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef18102a80 0x7fef18102e90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fef14009900 tx=0x7fef1402a3f0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.590+0000 7fef2054d640 1 -- 172.21.15.7:0/2421879729 shutdown_connections 2024-09-21T05:53:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.590+0000 7fef2054d640 1 --2- 172.21.15.7:0/2421879729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef18108d10 0x7fef1810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.590+0000 7fef2054d640 1 --2- 172.21.15.7:0/2421879729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef181083c0 0x7fef181087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.590+0000 7fef2054d640 1 --2- 172.21.15.7:0/2421879729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef18102a80 0x7fef18102e90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.590+0000 7fef2054d640 1 -- 172.21.15.7:0/2421879729 >> 172.21.15.7:0/2421879729 conn(0x7fef18079740 msgr2=0x7fef18079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.590+0000 7fef2054d640 1 -- 172.21.15.7:0/2421879729 shutdown_connections 2024-09-21T05:53:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.590+0000 7fef2054d640 1 -- 172.21.15.7:0/2421879729 wait complete. 2024-09-21T05:53:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef2054d640 1 Processor -- start 2024-09-21T05:53:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef2054d640 1 -- start start 2024-09-21T05:53:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef2054d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef18102a80 0x7fef1819b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef2054d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef181083c0 0x7fef1819b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef2054d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef18108d10 0x7fef1819bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef2054d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fef18112980 con 0x7fef18102a80 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef2054d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fef18112800 con 0x7fef18108d10 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef2054d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fef18112b00 con 0x7fef181083c0 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef1e2e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef18102a80 0x7fef1819b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef1e2e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef18102a80 0x7fef1819b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48352/0 (socket says 172.21.15.7:48352) 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef1e2e9640 1 -- 172.21.15.7:0/1464259143 learned_addr learned my addr 172.21.15.7:0/1464259143 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef1dae8640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef181083c0 0x7fef1819b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef1eaea640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef18108d10 0x7fef1819bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef1e2e9640 1 -- 172.21.15.7:0/1464259143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef181083c0 msgr2=0x7fef1819b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef1e2e9640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef181083c0 0x7fef1819b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef1e2e9640 1 -- 172.21.15.7:0/1464259143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef18108d10 msgr2=0x7fef1819bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef1e2e9640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef18108d10 0x7fef1819bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.591+0000 7fef1e2e9640 1 -- 172.21.15.7:0/1464259143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef181a63f0 con 0x7fef18102a80 2024-09-21T05:53:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.592+0000 7fef1e2e9640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef18102a80 0x7fef1819b1f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fef14006010 tx=0x7fef140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:08.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.592+0000 7fef0f7fe640 1 -- 172.21.15.7:0/1464259143 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1403f030 con 0x7fef18102a80 2024-09-21T05:53:08.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.592+0000 7fef2054d640 1 -- 172.21.15.7:0/1464259143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef181a6680 con 0x7fef18102a80 2024-09-21T05:53:08.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.592+0000 7fef2054d640 1 -- 172.21.15.7:0/1464259143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef181a6bb0 con 0x7fef18102a80 2024-09-21T05:53:08.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.592+0000 7fef0f7fe640 1 -- 172.21.15.7:0/1464259143 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef14003800 con 0x7fef18102a80 2024-09-21T05:53:08.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.592+0000 7fef0f7fe640 1 -- 172.21.15.7:0/1464259143 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14035070 con 0x7fef18102a80 2024-09-21T05:53:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.595+0000 7fef26ac1740 1 Processor -- start 2024-09-21T05:53:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.595+0000 7fef26ac1740 1 -- start start 2024-09-21T05:53:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.595+0000 7fef0f7fe640 1 -- 172.21.15.7:0/1464259143 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fef14003cb0 con 0x7fef18102a80 2024-09-21T05:53:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.595+0000 7fef26ac1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d735b6f60 0x556d7395cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.595+0000 7fef26ac1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d7358e0a0 0x556d7395d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.595+0000 7fef26ac1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d73596280 0x556d7395d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.595+0000 7fef26ac1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556d738d4c10 con 0x556d73596280 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.595+0000 7fef26ac1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556d738c4040 con 0x556d7358e0a0 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.595+0000 7fef26ac1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556d738c7e50 con 0x556d735b6f60 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.596+0000 7fef1dae8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d73596280 0x556d7395d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.596+0000 7fef1dae8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d73596280 0x556d7395d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48362/0 (socket says 172.21.15.7:48362) 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.596+0000 7fef1dae8640 1 -- 172.21.15.7:0/3253672972 learned_addr learned my addr 172.21.15.7:0/3253672972 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.596+0000 7fef1eaea640 1 --2- 172.21.15.7:0/3253672972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d735b6f60 0x556d7395cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.596+0000 7fef1e2e9640 1 --2- 172.21.15.7:0/3253672972 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d7358e0a0 0x556d7395d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.596+0000 7fef1dae8640 1 -- 172.21.15.7:0/3253672972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d735b6f60 msgr2=0x556d7395cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.596+0000 7fef1dae8640 1 --2- 172.21.15.7:0/3253672972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d735b6f60 0x556d7395cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.596+0000 7fef1dae8640 1 -- 172.21.15.7:0/3253672972 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d7358e0a0 msgr2=0x556d7395d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.596+0000 7fef1dae8640 1 --2- 172.21.15.7:0/3253672972 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d7358e0a0 0x556d7395d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.596+0000 7fef1dae8640 1 -- 172.21.15.7:0/3253672972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d73622540 con 0x556d73596280 2024-09-21T05:53:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.596+0000 7fef1dae8640 1 --2- 172.21.15.7:0/3253672972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d73596280 0x556d7395d980 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fef0800ac70 tx=0x7fef0800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5287f9e170584af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.596+0000 7fef0f7fe640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fef040b66a0 0x7fef040b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.596+0000 7fef0cff9640 1 -- 172.21.15.7:0/3253672972 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0801d070 con 0x556d73596280 2024-09-21T05:53:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.597+0000 7fef1eaea640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fef040b66a0 0x7fef040b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.597+0000 7fef0cff9640 1 -- 172.21.15.7:0/3253672972 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef08018af0 con 0x556d73596280 2024-09-21T05:53:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.597+0000 7fef0cff9640 1 -- 172.21.15.7:0/3253672972 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef08010b70 con 0x556d73596280 2024-09-21T05:53:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.597+0000 7fef0f7fe640 1 -- 172.21.15.7:0/1464259143 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fef14107ae0 con 0x7fef18102a80 2024-09-21T05:53:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.597+0000 7fef26ac1740 1 -- 172.21.15.7:0/3253672972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d73596280 msgr2=0x556d7395d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.597+0000 7fef1eaea640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fef040b66a0 0x7fef040b8bb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fef10007ed0 tx=0x7fef10007680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.597+0000 7fef26ac1740 1 --2- 172.21.15.7:0/3253672972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d73596280 0x556d7395d980 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fef0800ac70 tx=0x7fef0800f790 comp rx=0 tx=0).stop 2024-09-21T05:53:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.598+0000 7fef26ac1740 1 -- 172.21.15.7:0/3253672972 shutdown_connections 2024-09-21T05:53:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.598+0000 7fef26ac1740 1 --2- 172.21.15.7:0/3253672972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d73596280 0x556d7395d980 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.598+0000 7fef26ac1740 1 --2- 172.21.15.7:0/3253672972 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d7358e0a0 0x556d7395d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.598+0000 7fef26ac1740 1 --2- 172.21.15.7:0/3253672972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d735b6f60 0x556d7395cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.598+0000 7fef26ac1740 1 -- 172.21.15.7:0/3253672972 >> 172.21.15.7:0/3253672972 conn(0x556d735ab350 msgr2=0x556d7395adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.598+0000 7fef26ac1740 1 -- 172.21.15.7:0/3253672972 shutdown_connections 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.598+0000 7fef26ac1740 1 -- 172.21.15.7:0/3253672972 wait complete. 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.598+0000 7fef26ac1740 1 -- start start 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.598+0000 7fef26ac1740 1 Processor -- start 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.598+0000 7fef26ac1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d7358e0a0 0x556d73968770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.598+0000 7fef26ac1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d73596280 0x556d73968d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.598+0000 7fef26ac1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d735b6f60 0x556d73974a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef26ac1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556d737255f0 con 0x556d735b6f60 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef26ac1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556d7385f010 con 0x556d7358e0a0 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef26ac1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556d7396b6e0 con 0x556d73596280 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef26ac1740 10 client.0 _ll_register_callbacks cb 0x556d738be340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef1eaea640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d735b6f60 0x556d73974a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef1eaea640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d735b6f60 0x556d73974a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48368/0 (socket says 172.21.15.7:48368) 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef1eaea640 1 -- 172.21.15.7:0/77511431 learned_addr learned my addr 172.21.15.7:0/77511431 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef1e2e9640 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d7358e0a0 0x556d73968770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef1dae8640 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d73596280 0x556d73968d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef1eaea640 1 -- 172.21.15.7:0/77511431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d73596280 msgr2=0x556d73968d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef1eaea640 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d73596280 0x556d73968d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef1eaea640 1 -- 172.21.15.7:0/77511431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d7358e0a0 msgr2=0x556d73968770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef1eaea640 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d7358e0a0 0x556d73968770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef1eaea640 1 -- 172.21.15.7:0/77511431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d7388ca00 con 0x556d735b6f60 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef1dae8640 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d73596280 0x556d73968d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef1e2e9640 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d7358e0a0 0x556d73968770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef1eaea640 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d735b6f60 0x556d73974a00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fef1000ed30 tx=0x7fef10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f73bedb12204256 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.599+0000 7fef01ffb640 1 -- 172.21.15.7:0/77511431 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1001cd30 con 0x556d735b6f60 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.600+0000 7fef01ffb640 1 -- 172.21.15.7:0/77511431 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fef1001d410 con 0x556d735b6f60 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.600+0000 7fef26ac1740 1 -- 172.21.15.7:0/77511431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef08018af0 con 0x556d735b6f60 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.600+0000 7fef01ffb640 1 -- 172.21.15.7:0/77511431 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fef1001d610 con 0x556d735b6f60 2024-09-21T05:53:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.600+0000 7fef26ac1740 10 client.15258 fetch_fsmap learned FSMap version 24 2024-09-21T05:53:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.600+0000 7fef26ac1740 1 -- 172.21.15.7:0/77511431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556d73977630 con 0x556d735b6f60 2024-09-21T05:53:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.600+0000 7fef01ffb640 1 -- 172.21.15.7:0/77511431 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef08018af0 con 0x556d735b6f60 2024-09-21T05:53:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.600+0000 7fef01ffb640 1 -- 172.21.15.7:0/77511431 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fef100287d0 con 0x556d735b6f60 2024-09-21T05:53:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.600+0000 7fef26ac1740 10 client.15258 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T05:53:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.600+0000 7fef26ac1740 10 client.15258 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T05:53:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.600+0000 7fef26ac1740 20 client.15258 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.600+0000 7fef26ac1740 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556d735758e0 0x556d7397b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.600+0000 7fef26ac1740 4 client.15258 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:53:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.600+0000 7fef26ac1740 1 -- 172.21.15.7:0/77511431 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d738d6b60 con 0x556d735758e0 2024-09-21T05:53:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.601+0000 7fef1e2e9640 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556d735758e0 0x556d7397b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.601+0000 7fef1e2e9640 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556d735758e0 0x556d7397b0d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18a7b68cf2e546b3 server_cookie=a854f6232285c8f9 in_seq=0 out_seq=0 2024-09-21T05:53:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.601+0000 7fef01ffb640 10 client.15258 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef01ffb640 1 -- 172.21.15.7:0/77511431 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556d738d6b60 con 0x556d735758e0 2024-09-21T05:53:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef01ffb640 10 client.15258 handle_command_reply: tid=0 2024-09-21T05:53:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef26ac1740 1 client.15258 shutdown 2024-09-21T05:53:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef26ac1740 1 -- 172.21.15.7:0/77511431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d735b6f60 msgr2=0x556d73974a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef26ac1740 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d735b6f60 0x556d73974a00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fef1000ed30 tx=0x7fef10004a40 comp rx=0 tx=0).stop 2024-09-21T05:53:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef26ac1740 1 -- 172.21.15.7:0/77511431 shutdown_connections 2024-09-21T05:53:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef26ac1740 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556d735758e0 0x556d7397b0d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef26ac1740 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d735b6f60 0x556d73974a00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef26ac1740 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d73596280 0x556d73968d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef26ac1740 1 --2- 172.21.15.7:0/77511431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d7358e0a0 0x556d73968770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef01ffb640 0 client.15258 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef26ac1740 1 -- 172.21.15.7:0/77511431 >> 172.21.15.7:0/77511431 conn(0x556d735ab350 msgr2=0x556d73960090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef26ac1740 1 -- 172.21.15.7:0/77511431 shutdown_connections 2024-09-21T05:53:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef26ac1740 1 -- 172.21.15.7:0/77511431 wait complete. 2024-09-21T05:53:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.602+0000 7fef26ac1740 20 client.15258 trim_cache size 0 max 16384 2024-09-21T05:53:08.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.620+0000 7fef26ac1740 1 Processor -- start 2024-09-21T05:53:08.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.620+0000 7fef26ac1740 1 -- start start 2024-09-21T05:53:08.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef26ac1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d735758e0 0x556d7397b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef26ac1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 0x556d73978aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef26ac1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d73596280 0x556d73974970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef26ac1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556d73979410 con 0x556d7358e0a0 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef26ac1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556d73979ae0 con 0x556d735758e0 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef26ac1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556d7397a1b0 con 0x556d73596280 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef1dae8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 0x556d73978aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef1dae8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 0x556d73978aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48382/0 (socket says 172.21.15.7:48382) 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef1dae8640 1 -- 172.21.15.7:0/2134824646 learned_addr learned my addr 172.21.15.7:0/2134824646 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef1eaea640 1 --2- 172.21.15.7:0/2134824646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d73596280 0x556d73974970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef1e2e9640 1 --2- 172.21.15.7:0/2134824646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d735758e0 0x556d7397b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef1dae8640 1 -- 172.21.15.7:0/2134824646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d73596280 msgr2=0x556d73974970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef1dae8640 1 --2- 172.21.15.7:0/2134824646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d73596280 0x556d73974970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef1dae8640 1 -- 172.21.15.7:0/2134824646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d735758e0 msgr2=0x556d7397b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef1dae8640 1 --2- 172.21.15.7:0/2134824646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d735758e0 0x556d7397b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef1dae8640 1 -- 172.21.15.7:0/2134824646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d7395f1f0 con 0x556d7358e0a0 2024-09-21T05:53:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef1eaea640 1 --2- 172.21.15.7:0/2134824646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d73596280 0x556d73974970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef1e2e9640 1 --2- 172.21.15.7:0/2134824646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d735758e0 0x556d7397b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef1dae8640 1 --2- 172.21.15.7:0/2134824646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 0x556d73978aa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fef0800ab90 tx=0x7fef080107d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3973f4c4f44e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef03fff640 1 -- 172.21.15.7:0/2134824646 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0801d040 con 0x556d7358e0a0 2024-09-21T05:53:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef03fff640 1 -- 172.21.15.7:0/2134824646 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef0800a870 con 0x556d7358e0a0 2024-09-21T05:53:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.621+0000 7fef03fff640 1 -- 172.21.15.7:0/2134824646 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef08004660 con 0x556d7358e0a0 2024-09-21T05:53:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.622+0000 7fef26ac1740 1 -- 172.21.15.7:0/2134824646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 msgr2=0x556d73978aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.622+0000 7fef26ac1740 1 --2- 172.21.15.7:0/2134824646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 0x556d73978aa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fef0800ab90 tx=0x7fef080107d0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.622+0000 7fef26ac1740 1 -- 172.21.15.7:0/2134824646 shutdown_connections 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.622+0000 7fef26ac1740 1 --2- 172.21.15.7:0/2134824646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 0x556d73978aa0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.622+0000 7fef26ac1740 1 --2- 172.21.15.7:0/2134824646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d73596280 0x556d73974970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.622+0000 7fef26ac1740 1 --2- 172.21.15.7:0/2134824646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d735758e0 0x556d7397b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.622+0000 7fef26ac1740 1 -- 172.21.15.7:0/2134824646 >> 172.21.15.7:0/2134824646 conn(0x556d735ab350 msgr2=0x556d73963920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.622+0000 7fef26ac1740 1 -- 172.21.15.7:0/2134824646 shutdown_connections 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.622+0000 7fef26ac1740 1 -- 172.21.15.7:0/2134824646 wait complete. 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef26ac1740 1 -- start start 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef26ac1740 1 Processor -- start 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef26ac1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d735758e0 0x556d73983ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef26ac1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 0x556d7397cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef26ac1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d73596280 0x556d7397d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef26ac1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556d7397af50 con 0x556d7358e0a0 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef26ac1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556d7397a880 con 0x556d73596280 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef26ac1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556d7397b620 con 0x556d735758e0 2024-09-21T05:53:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef26ac1740 10 client.0 _ll_register_callbacks cb 0x7fef10007b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef1dae8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 0x556d7397cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef1dae8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 0x556d7397cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48390/0 (socket says 172.21.15.7:48390) 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef1dae8640 1 -- 172.21.15.7:0/4063582900 learned_addr learned my addr 172.21.15.7:0/4063582900 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef1eaea640 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d73596280 0x556d7397d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef1e2e9640 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d735758e0 0x556d73983ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef1dae8640 1 -- 172.21.15.7:0/4063582900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d735758e0 msgr2=0x556d73983ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef1dae8640 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d735758e0 0x556d73983ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef1dae8640 1 -- 172.21.15.7:0/4063582900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d73596280 msgr2=0x556d7397d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef1dae8640 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d73596280 0x556d7397d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef1dae8640 1 -- 172.21.15.7:0/4063582900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d7397db90 con 0x556d7358e0a0 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.623+0000 7fef1eaea640 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d73596280 0x556d7397d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.624+0000 7fef1dae8640 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 0x556d7397cf60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fef0800a710 tx=0x7fef08010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4008212cab8dd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.624+0000 7fef01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.624+0000 7fef01ffb640 1 -- 172.21.15.7:0/4063582900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef08033070 con 0x556d7358e0a0 2024-09-21T05:53:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.624+0000 7fef01ffb640 1 -- 172.21.15.7:0/4063582900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fef08010a40 con 0x556d7358e0a0 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.624+0000 7fef26ac1740 1 -- 172.21.15.7:0/4063582900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556d738d2610 con 0x556d7358e0a0 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.624+0000 7fef01ffb640 1 -- 172.21.15.7:0/4063582900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fef0803f050 con 0x556d7358e0a0 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.624+0000 7fef26ac1740 10 client.15264 fetch_fsmap learned FSMap version 24 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.624+0000 7fef26ac1740 1 -- 172.21.15.7:0/4063582900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556d739834c0 con 0x556d7358e0a0 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.624+0000 7fef01ffb640 1 -- 172.21.15.7:0/4063582900 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556d738d2610 con 0x556d7358e0a0 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.624+0000 7fef01ffb640 1 -- 172.21.15.7:0/4063582900 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fef08018440 con 0x556d7358e0a0 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.625+0000 7fef26ac1740 10 client.15264 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.625+0000 7fef26ac1740 10 client.15264 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.625+0000 7fef26ac1740 20 client.15264 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.625+0000 7fef26ac1740 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556d735b6f60 0x556d739e94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.625+0000 7fef26ac1740 4 client.15264 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.625+0000 7fef26ac1740 1 -- 172.21.15.7:0/4063582900 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "status"}) -- 0x556d738cfa40 con 0x556d735b6f60 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.625+0000 7fef1e2e9640 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556d735b6f60 0x556d739e94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.625+0000 7fef1e2e9640 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556d735b6f60 0x556d739e94f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f69879e64e77ff36 server_cookie=1a792073a29f1a57 in_seq=0 out_seq=0 2024-09-21T05:53:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.625+0000 7fef01ffb640 10 client.15264 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef01ffb640 1 -- 172.21.15.7:0/4063582900 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556d738cfa40 con 0x556d735b6f60 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef01ffb640 10 client.15264 handle_command_reply: tid=0 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef26ac1740 1 client.15264 shutdown 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef26ac1740 1 -- 172.21.15.7:0/4063582900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 msgr2=0x556d7397cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef26ac1740 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 0x556d7397cf60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fef0800a710 tx=0x7fef08010590 comp rx=0 tx=0).stop 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef26ac1740 1 -- 172.21.15.7:0/4063582900 shutdown_connections 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef26ac1740 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556d735b6f60 0x556d739e94f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef01ffb640 0 client.15264 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef26ac1740 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d7358e0a0 0x556d7397cf60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef26ac1740 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d73596280 0x556d7397d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef26ac1740 1 --2- 172.21.15.7:0/4063582900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d735758e0 0x556d73983ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef26ac1740 1 -- 172.21.15.7:0/4063582900 >> 172.21.15.7:0/4063582900 conn(0x556d735ab350 msgr2=0x556d73966fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef26ac1740 1 -- 172.21.15.7:0/4063582900 shutdown_connections 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef26ac1740 1 -- 172.21.15.7:0/4063582900 wait complete. 2024-09-21T05:53:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef26ac1740 20 client.15264 trim_cache size 0 max 16384 2024-09-21T05:53:08.633 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:53:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "397810bc-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:53:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-21T05:53:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24691, 2024-09-21T05:53:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-21T05:53:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-21T05:53:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-21T05:53:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 77.370614527000001, 2024-09-21T05:53:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-21T05:53:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 75, 2024-09-21T05:53:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T05:53:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 96.398336130000004 2024-09-21T05:53:08.634 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:53:08.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef2054d640 1 -- 172.21.15.7:0/1464259143 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fef040b66a0 msgr2=0x7fef040b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:08.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef2054d640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fef040b66a0 0x7fef040b8bb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fef10007ed0 tx=0x7fef10007680 comp rx=0 tx=0).stop 2024-09-21T05:53:08.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef2054d640 1 -- 172.21.15.7:0/1464259143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef18102a80 msgr2=0x7fef1819b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:08.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.626+0000 7fef2054d640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef18102a80 0x7fef1819b1f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fef14006010 tx=0x7fef140042f0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.627+0000 7fef2054d640 1 -- 172.21.15.7:0/1464259143 shutdown_connections 2024-09-21T05:53:08.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.627+0000 7fef2054d640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fef040b66a0 0x7fef040b8bb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.627+0000 7fef2054d640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fef18108d10 0x7fef1819bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.627+0000 7fef2054d640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef181083c0 0x7fef1819b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.627+0000 7fef2054d640 1 --2- 172.21.15.7:0/1464259143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef18102a80 0x7fef1819b1f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.627+0000 7fef2054d640 1 -- 172.21.15.7:0/1464259143 >> 172.21.15.7:0/1464259143 conn(0x7fef18079740 msgr2=0x7fef181013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.627+0000 7fef2054d640 1 -- 172.21.15.7:0/1464259143 shutdown_connections 2024-09-21T05:53:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:08.627+0000 7fef2054d640 1 -- 172.21.15.7:0/1464259143 wait complete. 2024-09-21T05:53:09.399 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T05:53:09.399 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T05:53:09.408 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T05:53:09.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T05:53:09.669 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:09.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:09 smithi007 ceph-mon[30983]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:53:09.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:09 smithi119 ceph-mon[34833]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:53:09.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:09 smithi027 ceph-mon[34364]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:53:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.156+0000 7fcd993aa640 1 -- 172.21.15.7:0/415301358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd941094f0 msgr2=0x7fcd94109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.156+0000 7fcd993aa640 1 --2- 172.21.15.7:0/415301358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd941094f0 0x7fcd94109900 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009900 tx=0x7fcd7c02a3f0 comp rx=0 tx=0).stop 2024-09-21T05:53:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.156+0000 7fcd993aa640 1 -- 172.21.15.7:0/415301358 shutdown_connections 2024-09-21T05:53:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.156+0000 7fcd993aa640 1 --2- 172.21.15.7:0/415301358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd941094f0 0x7fcd94109900 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.156+0000 7fcd993aa640 1 --2- 172.21.15.7:0/415301358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd94109e40 0x7fcd94110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.156+0000 7fcd993aa640 1 --2- 172.21.15.7:0/415301358 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd94103bb0 0x7fcd94103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.156+0000 7fcd993aa640 1 -- 172.21.15.7:0/415301358 >> 172.21.15.7:0/415301358 conn(0x7fcd940ff600 msgr2=0x7fcd94101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.156+0000 7fcd993aa640 1 -- 172.21.15.7:0/415301358 shutdown_connections 2024-09-21T05:53:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.156+0000 7fcd993aa640 1 -- 172.21.15.7:0/415301358 wait complete. 2024-09-21T05:53:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.156+0000 7fcd993aa640 1 Processor -- start 2024-09-21T05:53:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd993aa640 1 -- start start 2024-09-21T05:53:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd993aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd94103bb0 0x7fcd9419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd993aa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd941094f0 0x7fcd9419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd993aa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd94109e40 0x7fcd9419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd993aa640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94113b00 con 0x7fcd94103bb0 2024-09-21T05:53:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd993aa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94113980 con 0x7fcd941094f0 2024-09-21T05:53:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd993aa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94113c80 con 0x7fcd94109e40 2024-09-21T05:53:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd92ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd94103bb0 0x7fcd9419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd92ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd94103bb0 0x7fcd9419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48408/0 (socket says 172.21.15.7:48408) 2024-09-21T05:53:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd92ffd640 1 -- 172.21.15.7:0/1281523013 learned_addr learned my addr 172.21.15.7:0/1281523013 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd927fc640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd941094f0 0x7fcd9419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd937fe640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd94109e40 0x7fcd9419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd92ffd640 1 -- 172.21.15.7:0/1281523013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd94109e40 msgr2=0x7fcd9419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd92ffd640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd94109e40 0x7fcd9419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd92ffd640 1 -- 172.21.15.7:0/1281523013 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd941094f0 msgr2=0x7fcd9419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd92ffd640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd941094f0 0x7fcd9419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd92ffd640 1 -- 172.21.15.7:0/1281523013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd941a0340 con 0x7fcd94103bb0 2024-09-21T05:53:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.157+0000 7fcd92ffd640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd94103bb0 0x7fcd9419a490 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400cce0 tx=0x7fcd8400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.158+0000 7fcd8bfff640 1 -- 172.21.15.7:0/1281523013 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8400f650 con 0x7fcd94103bb0 2024-09-21T05:53:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.158+0000 7fcd993aa640 1 -- 172.21.15.7:0/1281523013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd941a0630 con 0x7fcd94103bb0 2024-09-21T05:53:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.158+0000 7fcd8bfff640 1 -- 172.21.15.7:0/1281523013 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd8400fca0 con 0x7fcd94103bb0 2024-09-21T05:53:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.158+0000 7fcd8bfff640 1 -- 172.21.15.7:0/1281523013 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84018b40 con 0x7fcd94103bb0 2024-09-21T05:53:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.158+0000 7fcd993aa640 1 -- 172.21.15.7:0/1281523013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd941a6e50 con 0x7fcd94103bb0 2024-09-21T05:53:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.159+0000 7fcd993aa640 1 -- 172.21.15.7:0/1281523013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd94103fc0 con 0x7fcd94103bb0 2024-09-21T05:53:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.161+0000 7fcd8bfff640 1 -- 172.21.15.7:0/1281523013 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fcd84018ce0 con 0x7fcd94103bb0 2024-09-21T05:53:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.161+0000 7fcd8bfff640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcd800b6620 0x7fcd800b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.161+0000 7fcd927fc640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcd800b6620 0x7fcd800b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.162+0000 7fcd8bfff640 1 -- 172.21.15.7:0/1281523013 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fcd840e7cf0 con 0x7fcd94103bb0 2024-09-21T05:53:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.162+0000 7fcd927fc640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcd800b6620 0x7fcd800b8b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009230 tx=0x7fcd7c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.165+0000 7fcd8bfff640 1 -- 172.21.15.7:0/1281523013 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd84014030 con 0x7fcd94103bb0 2024-09-21T05:53:10.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.372+0000 7fcd993aa640 1 -- 172.21.15.7:0/1281523013 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fcd94063800 con 0x7fcd800b6620 2024-09-21T05:53:10.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.374+0000 7fcd8bfff640 1 -- 172.21.15.7:0/1281523013 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fcd94063800 con 0x7fcd800b6620 2024-09-21T05:53:10.375 INFO:teuthology.orchestra.run.smithi007.stdout:Backend: cephadm 2024-09-21T05:53:10.376 INFO:teuthology.orchestra.run.smithi007.stdout:Available: Yes 2024-09-21T05:53:10.376 INFO:teuthology.orchestra.run.smithi007.stdout:Paused: No 2024-09-21T05:53:10.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.376+0000 7fcd993aa640 1 -- 172.21.15.7:0/1281523013 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcd800b6620 msgr2=0x7fcd800b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:10.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.376+0000 7fcd993aa640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcd800b6620 0x7fcd800b8b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009230 tx=0x7fcd7c031400 comp rx=0 tx=0).stop 2024-09-21T05:53:10.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.376+0000 7fcd993aa640 1 -- 172.21.15.7:0/1281523013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd94103bb0 msgr2=0x7fcd9419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:10.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.376+0000 7fcd993aa640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd94103bb0 0x7fcd9419a490 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400cce0 tx=0x7fcd8400a620 comp rx=0 tx=0).stop 2024-09-21T05:53:10.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.376+0000 7fcd993aa640 1 -- 172.21.15.7:0/1281523013 shutdown_connections 2024-09-21T05:53:10.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.376+0000 7fcd993aa640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcd800b6620 0x7fcd800b8b30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:10.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.376+0000 7fcd993aa640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd94109e40 0x7fcd9419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:10.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.376+0000 7fcd993aa640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd941094f0 0x7fcd9419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:10.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.376+0000 7fcd993aa640 1 --2- 172.21.15.7:0/1281523013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd94103bb0 0x7fcd9419a490 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:10.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.376+0000 7fcd993aa640 1 -- 172.21.15.7:0/1281523013 >> 172.21.15.7:0/1281523013 conn(0x7fcd940ff600 msgr2=0x7fcd94101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:10.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.376+0000 7fcd993aa640 1 -- 172.21.15.7:0/1281523013 shutdown_connections 2024-09-21T05:53:10.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:10.376+0000 7fcd993aa640 1 -- 172.21.15.7:0/1281523013 wait complete. 2024-09-21T05:53:11.021 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T05:53:11.284 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:11.723 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:11 smithi007 ceph-mon[30983]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:11.723 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:11 smithi007 ceph-mon[30983]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:53:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.738+0000 7f2ad7bec640 1 -- 172.21.15.7:0/2194244035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad0109e00 msgr2=0x7f2ad0110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.738+0000 7f2ad7bec640 1 --2- 172.21.15.7:0/2194244035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad0109e00 0x7f2ad0110630 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009ca0 tx=0x7f2ac802a8e0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.738+0000 7f2ad7bec640 1 -- 172.21.15.7:0/2194244035 shutdown_connections 2024-09-21T05:53:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.738+0000 7f2ad7bec640 1 --2- 172.21.15.7:0/2194244035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad0109e00 0x7f2ad0110630 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.738+0000 7f2ad7bec640 1 --2- 172.21.15.7:0/2194244035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ad01094b0 0x7f2ad01098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.738+0000 7f2ad7bec640 1 --2- 172.21.15.7:0/2194244035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ad0103b70 0x7f2ad0103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.738+0000 7f2ad7bec640 1 -- 172.21.15.7:0/2194244035 >> 172.21.15.7:0/2194244035 conn(0x7f2ad00ff5e0 msgr2=0x7f2ad0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:11.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.738+0000 7f2ad7bec640 1 -- 172.21.15.7:0/2194244035 shutdown_connections 2024-09-21T05:53:11.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.738+0000 7f2ad7bec640 1 -- 172.21.15.7:0/2194244035 wait complete. 2024-09-21T05:53:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.739+0000 7f2ad7bec640 1 Processor -- start 2024-09-21T05:53:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.739+0000 7f2ad7bec640 1 -- start start 2024-09-21T05:53:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.739+0000 7f2ad7bec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ad0103b70 0x7f2ad0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.739+0000 7f2ad7bec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad01094b0 0x7f2ad0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.739+0000 7f2ad7bec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ad0109e00 0x7f2ad0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.739+0000 7f2ad7bec640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0113b50 con 0x7f2ad01094b0 2024-09-21T05:53:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.739+0000 7f2ad7bec640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01139d0 con 0x7f2ad0103b70 2024-09-21T05:53:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.739+0000 7f2ad7bec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0113cd0 con 0x7f2ad0109e00 2024-09-21T05:53:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.739+0000 7f2ad5187640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad01094b0 0x7f2ad0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.739+0000 7f2ad5187640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad01094b0 0x7f2ad0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48416/0 (socket says 172.21.15.7:48416) 2024-09-21T05:53:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.739+0000 7f2ad5187640 1 -- 172.21.15.7:0/992631922 learned_addr learned my addr 172.21.15.7:0/992631922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.739+0000 7f2ad5988640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ad0103b70 0x7f2ad0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.740+0000 7f2ad6189640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ad0109e00 0x7f2ad0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.740+0000 7f2ad5187640 1 -- 172.21.15.7:0/992631922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ad0109e00 msgr2=0x7f2ad0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.740+0000 7f2ad5187640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ad0109e00 0x7f2ad0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.740+0000 7f2ad5187640 1 -- 172.21.15.7:0/992631922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ad0103b70 msgr2=0x7f2ad0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.740+0000 7f2ad5187640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ad0103b70 0x7f2ad0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.740+0000 7f2ad5187640 1 -- 172.21.15.7:0/992631922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad01a8780 con 0x7f2ad01094b0 2024-09-21T05:53:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.740+0000 7f2ad5187640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad01094b0 0x7f2ad0075c50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0006fd0 tx=0x7f2ac000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.740+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/992631922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0011830 con 0x7f2ad01094b0 2024-09-21T05:53:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.740+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/992631922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac0016070 con 0x7f2ad01094b0 2024-09-21T05:53:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.740+0000 7f2ad7bec640 1 -- 172.21.15.7:0/992631922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad01a8a70 con 0x7f2ad01094b0 2024-09-21T05:53:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.740+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/992631922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0010e00 con 0x7f2ad01094b0 2024-09-21T05:53:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.740+0000 7f2ad7bec640 1 -- 172.21.15.7:0/992631922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad01a8fe0 con 0x7f2ad01094b0 2024-09-21T05:53:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.741+0000 7f2ad7bec640 1 -- 172.21.15.7:0/992631922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad0103f80 con 0x7f2ad01094b0 2024-09-21T05:53:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.743+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/992631922 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f2ac00119d0 con 0x7f2ad01094b0 2024-09-21T05:53:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.743+0000 7f2ac6ffd640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2abc0b65f0 0x7f2abc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.744+0000 7f2ad5988640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2abc0b65f0 0x7f2abc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.744+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/992631922 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f2ac00e71a0 con 0x7f2ad01094b0 2024-09-21T05:53:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.744+0000 7f2ad5988640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2abc0b65f0 0x7f2abc0b8b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0058c0 tx=0x7f2acc00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.747+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/992631922 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ac00ad830 con 0x7f2ad01094b0 2024-09-21T05:53:11.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:11 smithi119 ceph-mon[34833]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:11.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:11 smithi119 ceph-mon[34833]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:53:11.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.945+0000 7f2ad7bec640 1 -- 172.21.15.7:0/992631922 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2ad0063800 con 0x7f2abc0b65f0 2024-09-21T05:53:11.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.958+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/992631922 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f2ad0063800 con 0x7f2abc0b65f0 2024-09-21T05:53:11.960 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:53:11.960 INFO:teuthology.orchestra.run.smithi007.stdout:mds.a smithi007 running (94s) 17s ago 94s 82.3M - 19.3.0-5120-g18432218 ddce307e1f32 c90d9e0c0da3 2024-09-21T05:53:11.960 INFO:teuthology.orchestra.run.smithi007.stdout:mds.b smithi027 running (92s) 25s ago 91s 85.6M - 19.3.0-5120-g18432218 ddce307e1f32 efeb32a1386f 2024-09-21T05:53:11.960 INFO:teuthology.orchestra.run.smithi007.stdout:mds.c smithi119 running (104s) 25s ago 104s 86.0M - 19.3.0-5120-g18432218 ddce307e1f32 0c730a46804a 2024-09-21T05:53:11.960 INFO:teuthology.orchestra.run.smithi007.stdout:mds.d smithi007 running (113s) 17s ago 111s 81.5M - 19.3.0-5120-g18432218 ddce307e1f32 4195a80c7f36 2024-09-21T05:53:11.960 INFO:teuthology.orchestra.run.smithi007.stdout:mds.e smithi027 running (109s) 25s ago 109s 81.9M - 19.3.0-5120-g18432218 ddce307e1f32 083fb9d6ae63 2024-09-21T05:53:11.960 INFO:teuthology.orchestra.run.smithi007.stdout:mds.f smithi119 running (107s) 25s ago 106s 85.2M - 19.3.0-5120-g18432218 ddce307e1f32 7fde12298b05 2024-09-21T05:53:11.960 INFO:teuthology.orchestra.run.smithi007.stdout:mds.g smithi007 running (97s) 17s ago 96s 82.4M - 19.3.0-5120-g18432218 ddce307e1f32 c668caa707e3 2024-09-21T05:53:11.960 INFO:teuthology.orchestra.run.smithi007.stdout:mds.h smithi027 running (102s) 25s ago 102s 83.9M - 19.3.0-5120-g18432218 ddce307e1f32 c33e1a46a8c1 2024-09-21T05:53:11.960 INFO:teuthology.orchestra.run.smithi007.stdout:mds.i smithi119 running (100s) 25s ago 99s 93.5M - 19.3.0-5120-g18432218 ddce307e1f32 b4ccc69700e7 2024-09-21T05:53:11.960 INFO:teuthology.orchestra.run.smithi007.stdout:mds.j smithi007 running (115s) 17s ago 115s 82.4M - 19.3.0-5120-g18432218 ddce307e1f32 d7598d5edaaf 2024-09-21T05:53:11.960 INFO:teuthology.orchestra.run.smithi007.stdout:mds.k smithi027 running (118s) 25s ago 118s 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 7821dfe3d882 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:mds.l smithi119 running (2m) 25s ago 2m 84.7M - 19.3.0-5120-g18432218 ddce307e1f32 1509638beea9 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi007 *:9283,8765 running (9m) 17s ago 9m 584M - 19.3.0-5120-g18432218 ddce307e1f32 ef771cd10fa8 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi027 *:8443,8765 running (7m) 25s ago 7m 524M - 19.3.0-5120-g18432218 ddce307e1f32 03fe0b91433b 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.z smithi119 *:8443,8765 running (7m) 25s ago 7m 526M - 19.3.0-5120-g18432218 ddce307e1f32 6a6bf2f07240 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (9m) 17s ago 9m 121M 2048M 19.3.0-5120-g18432218 ddce307e1f32 2b401bd9ca81 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi027 running (8m) 25s ago 8m 111M 2048M 19.3.0-5120-g18432218 ddce307e1f32 c32ce2120a6c 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi119 running (8m) 25s ago 8m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 8660d449d50e 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (6m) 17s ago 6m 121M 4273M 19.3.0-5120-g18432218 ddce307e1f32 7d17161e76cd 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi027 running (6m) 25s ago 6m 116M 4272M 19.3.0-5120-g18432218 ddce307e1f32 a5e8c44ae01d 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi119 running (6m) 25s ago 6m 127M 4272M 19.3.0-5120-g18432218 ddce307e1f32 aae2ce0fe6a9 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (5m) 17s ago 5m 114M 4273M 19.3.0-5120-g18432218 ddce307e1f32 57ce2904553c 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi027 running (5m) 25s ago 5m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 5a126e8c96c7 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi119 running (4m) 25s ago 4m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 17888a9e8809 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi007 running (4m) 17s ago 4m 112M 4273M 19.3.0-5120-g18432218 ddce307e1f32 c4bd63cdf689 2024-09-21T05:53:11.961 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi027 running (3m) 25s ago 3m 116M 4272M 19.3.0-5120-g18432218 ddce307e1f32 d76dfdb91ab8 2024-09-21T05:53:11.962 INFO:teuthology.orchestra.run.smithi007.stdout:osd.8 smithi119 running (3m) 25s ago 3m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 9b4128b506da 2024-09-21T05:53:11.962 INFO:teuthology.orchestra.run.smithi007.stdout:osd.9 smithi007 running (3m) 17s ago 3m 111M 4273M 19.3.0-5120-g18432218 ddce307e1f32 50b1f198c680 2024-09-21T05:53:11.962 INFO:teuthology.orchestra.run.smithi007.stdout:osd.10 smithi027 running (2m) 25s ago 2m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 c4955ca2c4dc 2024-09-21T05:53:11.962 INFO:teuthology.orchestra.run.smithi007.stdout:osd.11 smithi119 running (2m) 25s ago 2m 113M 4272M 19.3.0-5120-g18432218 ddce307e1f32 0c1423556edf 2024-09-21T05:53:11.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.960+0000 7f2ad7bec640 1 -- 172.21.15.7:0/992631922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2abc0b65f0 msgr2=0x7f2abc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:11.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.960+0000 7f2ad7bec640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2abc0b65f0 0x7f2abc0b8b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0058c0 tx=0x7f2acc00a2d0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.960+0000 7f2ad7bec640 1 -- 172.21.15.7:0/992631922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad01094b0 msgr2=0x7f2ad0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:11.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.960+0000 7f2ad7bec640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad01094b0 0x7f2ad0075c50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0006fd0 tx=0x7f2ac000b8e0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.960+0000 7f2ad7bec640 1 -- 172.21.15.7:0/992631922 shutdown_connections 2024-09-21T05:53:11.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.960+0000 7f2ad7bec640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2abc0b65f0 0x7f2abc0b8b00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.960+0000 7f2ad7bec640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad01094b0 0x7f2ad0075c50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.960+0000 7f2ad7bec640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ad0109e00 0x7f2ad0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.960+0000 7f2ad7bec640 1 --2- 172.21.15.7:0/992631922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ad0103b70 0x7f2ad0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.960+0000 7f2ad7bec640 1 -- 172.21.15.7:0/992631922 >> 172.21.15.7:0/992631922 conn(0x7f2ad00ff5e0 msgr2=0x7f2ad0108ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:11.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.960+0000 7f2ad7bec640 1 -- 172.21.15.7:0/992631922 shutdown_connections 2024-09-21T05:53:11.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:11.960+0000 7f2ad7bec640 1 -- 172.21.15.7:0/992631922 wait complete. 2024-09-21T05:53:11.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:11 smithi027 ceph-mon[34364]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:11.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:11 smithi027 ceph-mon[34364]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:53:12.605 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T05:53:12.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:12 smithi119 ceph-mon[34833]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:12.864 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:12.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:12 smithi027 ceph-mon[34364]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:12.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:12 smithi007 ceph-mon[30983]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.313+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2918483324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3f41020c0 msgr2=0x7fb3f41024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.313+0000 7fb3fb84c640 1 --2- 172.21.15.7:0/2918483324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3f41020c0 0x7fb3f41024d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009900 tx=0x7fb3f002a410 comp rx=0 tx=0).stop 2024-09-21T05:53:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.313+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2918483324 shutdown_connections 2024-09-21T05:53:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.313+0000 7fb3fb84c640 1 --2- 172.21.15.7:0/2918483324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3f4106c00 0x7fb3f4110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.314+0000 7fb3fb84c640 1 --2- 172.21.15.7:0/2918483324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3f41062b0 0x7fb3f41066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.314+0000 7fb3fb84c640 1 --2- 172.21.15.7:0/2918483324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3f41020c0 0x7fb3f41024d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.314+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2918483324 >> 172.21.15.7:0/2918483324 conn(0x7fb3f4079e40 msgr2=0x7fb3f407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.314+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2918483324 shutdown_connections 2024-09-21T05:53:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.314+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2918483324 wait complete. 2024-09-21T05:53:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.314+0000 7fb3fb84c640 1 Processor -- start 2024-09-21T05:53:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.314+0000 7fb3fb84c640 1 -- start start 2024-09-21T05:53:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3fb84c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3f41020c0 0x7fb3f419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3fb84c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3f41062b0 0x7fb3f419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3fb84c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3f4106c00 0x7fb3f419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3fb84c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f4113b00 con 0x7fb3f41062b0 2024-09-21T05:53:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3fb84c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f4113980 con 0x7fb3f41020c0 2024-09-21T05:53:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3fb84c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f4113c80 con 0x7fb3f4106c00 2024-09-21T05:53:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3f8de7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3f41062b0 0x7fb3f419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3f95e8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3f41020c0 0x7fb3f419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3f8de7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3f41062b0 0x7fb3f419aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48438/0 (socket says 172.21.15.7:48438) 2024-09-21T05:53:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3f8de7640 1 -- 172.21.15.7:0/2710481701 learned_addr learned my addr 172.21.15.7:0/2710481701 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3f9de9640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3f4106c00 0x7fb3f419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3f8de7640 1 -- 172.21.15.7:0/2710481701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3f4106c00 msgr2=0x7fb3f419fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:13.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3f8de7640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3f4106c00 0x7fb3f419fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3f8de7640 1 -- 172.21.15.7:0/2710481701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3f41020c0 msgr2=0x7fb3f419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3f8de7640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3f41020c0 0x7fb3f419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3f8de7640 1 -- 172.21.15.7:0/2710481701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f41a0480 con 0x7fb3f41062b0 2024-09-21T05:53:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3f95e8640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3f41020c0 0x7fb3f419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.315+0000 7fb3f8de7640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3f41062b0 0x7fb3f419aab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400e9f0 tx=0x7fb3e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.316+0000 7fb3ea7fc640 1 -- 172.21.15.7:0/2710481701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400ccc0 con 0x7fb3f41062b0 2024-09-21T05:53:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.316+0000 7fb3ea7fc640 1 -- 172.21.15.7:0/2710481701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e40108e0 con 0x7fb3f41062b0 2024-09-21T05:53:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.316+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2710481701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f41a0770 con 0x7fb3f41062b0 2024-09-21T05:53:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.316+0000 7fb3ea7fc640 1 -- 172.21.15.7:0/2710481701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4018860 con 0x7fb3f41062b0 2024-09-21T05:53:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.316+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2710481701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f41a6ed0 con 0x7fb3f41062b0 2024-09-21T05:53:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.317+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2710481701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f41024d0 con 0x7fb3f41062b0 2024-09-21T05:53:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.319+0000 7fb3ea7fc640 1 -- 172.21.15.7:0/2710481701 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fb3e4010430 con 0x7fb3f41062b0 2024-09-21T05:53:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.320+0000 7fb3ea7fc640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb3e00b6670 0x7fb3e00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.320+0000 7fb3f95e8640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb3e00b6670 0x7fb3e00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.320+0000 7fb3ea7fc640 1 -- 172.21.15.7:0/2710481701 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb3e40e7c90 con 0x7fb3f41062b0 2024-09-21T05:53:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.321+0000 7fb3f95e8640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb3e00b6670 0x7fb3e00b8b80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0031440 tx=0x7fb3f0032ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.324+0000 7fb3ea7fc640 1 -- 172.21.15.7:0/2710481701 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3e40b2700 con 0x7fb3f41062b0 2024-09-21T05:53:13.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.522+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2710481701 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fb3f4063800 con 0x7fb3e00b6670 2024-09-21T05:53:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.528+0000 7fb3ea7fc640 1 -- 172.21.15.7:0/2710481701 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fb3f4063800 con 0x7fb3e00b6670 2024-09-21T05:53:13.529 INFO:teuthology.orchestra.run.smithi007.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T05:53:13.530 INFO:teuthology.orchestra.run.smithi007.stdout:mds.all 12/12 27s ago 2m smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi027=b;smithi027=e;smithi027=h;smithi027=k;smithi119=c;smithi119=f;smithi119=i;smithi119=l;count:12 2024-09-21T05:53:13.530 INFO:teuthology.orchestra.run.smithi007.stdout:mgr 3/3 27s ago 7m smithi007=x;smithi027=y;smithi119=z;count:3 2024-09-21T05:53:13.530 INFO:teuthology.orchestra.run.smithi007.stdout:mon 3/3 27s ago 8m smithi007:172.21.15.7=a;smithi027:172.21.15.27=b;smithi119:172.21.15.119=c;count:3 2024-09-21T05:53:13.530 INFO:teuthology.orchestra.run.smithi007.stdout:osd 12 27s ago - 2024-09-21T05:53:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.530+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2710481701 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb3e00b6670 msgr2=0x7fb3e00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.530+0000 7fb3fb84c640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb3e00b6670 0x7fb3e00b8b80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0031440 tx=0x7fb3f0032ed0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.530+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2710481701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3f41062b0 msgr2=0x7fb3f419aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.530+0000 7fb3fb84c640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3f41062b0 0x7fb3f419aab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400e9f0 tx=0x7fb3e400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.530+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2710481701 shutdown_connections 2024-09-21T05:53:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.530+0000 7fb3fb84c640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb3e00b6670 0x7fb3e00b8b80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.530+0000 7fb3fb84c640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3f41062b0 0x7fb3f419aab0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.530+0000 7fb3fb84c640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3f4106c00 0x7fb3f419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.530+0000 7fb3fb84c640 1 --2- 172.21.15.7:0/2710481701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3f41020c0 0x7fb3f419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.530+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2710481701 >> 172.21.15.7:0/2710481701 conn(0x7fb3f4079e40 msgr2=0x7fb3f41080f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:13.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.530+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2710481701 shutdown_connections 2024-09-21T05:53:13.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:13.530+0000 7fb3fb84c640 1 -- 172.21.15.7:0/2710481701 wait complete. 2024-09-21T05:53:13.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:13 smithi119 ceph-mon[34833]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:53:13.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:13 smithi027 ceph-mon[34364]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:53:14.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:13 smithi007 ceph-mon[30983]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:53:14.218 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T05:53:14.480 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:14.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:14 smithi119 ceph-mon[34833]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:14.872 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:14 smithi007 ceph-mon[30983]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:14.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.965+0000 7fab396b3640 1 -- 172.21.15.7:0/900043274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab341083c0 msgr2=0x7fab341087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:14.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.965+0000 7fab396b3640 1 --2- 172.21.15.7:0/900043274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab341083c0 0x7fab341087d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fab28009900 tx=0x7fab2802a410 comp rx=0 tx=0).stop 2024-09-21T05:53:14.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.965+0000 7fab396b3640 1 -- 172.21.15.7:0/900043274 shutdown_connections 2024-09-21T05:53:14.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.965+0000 7fab396b3640 1 --2- 172.21.15.7:0/900043274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab341083c0 0x7fab341087d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:14.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.965+0000 7fab396b3640 1 --2- 172.21.15.7:0/900043274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab34108d10 0x7fab3410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:14.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.965+0000 7fab396b3640 1 --2- 172.21.15.7:0/900043274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab34102a80 0x7fab34102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:14.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.965+0000 7fab396b3640 1 -- 172.21.15.7:0/900043274 >> 172.21.15.7:0/900043274 conn(0x7fab34079740 msgr2=0x7fab34079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:14.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.965+0000 7fab396b3640 1 -- 172.21.15.7:0/900043274 shutdown_connections 2024-09-21T05:53:14.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.965+0000 7fab396b3640 1 -- 172.21.15.7:0/900043274 wait complete. 2024-09-21T05:53:14.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.965+0000 7fab396b3640 1 Processor -- start 2024-09-21T05:53:14.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab396b3640 1 -- start start 2024-09-21T05:53:14.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab396b3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab34102a80 0x7fab3419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:14.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab396b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab341083c0 0x7fab3419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:14.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab396b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab34108d10 0x7fab3419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:14.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab396b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fab34112980 con 0x7fab34108d10 2024-09-21T05:53:14.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab396b3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fab34112800 con 0x7fab34102a80 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab396b3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fab34112b00 con 0x7fab341083c0 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab34108d10 0x7fab3419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab34108d10 0x7fab3419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48456/0 (socket says 172.21.15.7:48456) 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab337fe640 1 -- 172.21.15.7:0/2662438788 learned_addr learned my addr 172.21.15.7:0/2662438788 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab32ffd640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab34102a80 0x7fab3419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab327fc640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab341083c0 0x7fab3419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab337fe640 1 -- 172.21.15.7:0/2662438788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab341083c0 msgr2=0x7fab3419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab337fe640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab341083c0 0x7fab3419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab337fe640 1 -- 172.21.15.7:0/2662438788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab34102a80 msgr2=0x7fab3419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab337fe640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab34102a80 0x7fab3419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab337fe640 1 -- 172.21.15.7:0/2662438788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab341a0390 con 0x7fab34108d10 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab327fc640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab341083c0 0x7fab3419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.966+0000 7fab32ffd640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab34102a80 0x7fab3419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.967+0000 7fab337fe640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab34108d10 0x7fab3419fd20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00eaa0 tx=0x7fab2c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:14.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.967+0000 7fab1bfff640 1 -- 172.21.15.7:0/2662438788 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c00cdb0 con 0x7fab34108d10 2024-09-21T05:53:14.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.967+0000 7fab1bfff640 1 -- 172.21.15.7:0/2662438788 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab2c005020 con 0x7fab34108d10 2024-09-21T05:53:14.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.967+0000 7fab396b3640 1 -- 172.21.15.7:0/2662438788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab341a0680 con 0x7fab34108d10 2024-09-21T05:53:14.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.967+0000 7fab1bfff640 1 -- 172.21.15.7:0/2662438788 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c0116d0 con 0x7fab34108d10 2024-09-21T05:53:14.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.967+0000 7fab396b3640 1 -- 172.21.15.7:0/2662438788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab341a6ea0 con 0x7fab34108d10 2024-09-21T05:53:14.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.968+0000 7fab396b3640 1 -- 172.21.15.7:0/2662438788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab34103d00 con 0x7fab34108d10 2024-09-21T05:53:14.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.969+0000 7fab1bfff640 1 -- 172.21.15.7:0/2662438788 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fab2c0051d0 con 0x7fab34108d10 2024-09-21T05:53:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.970+0000 7fab1bfff640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab1c0b6620 0x7fab1c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.970+0000 7fab32ffd640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab1c0b6620 0x7fab1c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:14.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.970+0000 7fab1bfff640 1 -- 172.21.15.7:0/2662438788 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fab2c0e7be0 con 0x7fab34108d10 2024-09-21T05:53:14.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.971+0000 7fab32ffd640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab1c0b6620 0x7fab1c0b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fab2400abe0 tx=0x7fab2400a5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:14.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:14.973+0000 7fab1bfff640 1 -- 172.21.15.7:0/2662438788 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab2c016030 con 0x7fab34108d10 2024-09-21T05:53:14.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:14 smithi027 ceph-mon[34364]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.166+0000 7fab396b3640 1 -- 172.21.15.7:0/2662438788 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fab3410bb70 con 0x7fab1c0b6620 2024-09-21T05:53:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.168+0000 7fab1bfff640 1 -- 172.21.15.7:0/2662438788 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fab3410bb70 con 0x7fab1c0b6620 2024-09-21T05:53:15.170 INFO:teuthology.orchestra.run.smithi007.stdout:HOST ADDR LABELS STATUS 2024-09-21T05:53:15.170 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007 172.21.15.7 2024-09-21T05:53:15.171 INFO:teuthology.orchestra.run.smithi007.stdout:smithi027 172.21.15.27 2024-09-21T05:53:15.171 INFO:teuthology.orchestra.run.smithi007.stdout:smithi119 172.21.15.119 2024-09-21T05:53:15.171 INFO:teuthology.orchestra.run.smithi007.stdout:3 hosts in cluster 2024-09-21T05:53:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.170+0000 7fab396b3640 1 -- 172.21.15.7:0/2662438788 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab1c0b6620 msgr2=0x7fab1c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.170+0000 7fab396b3640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab1c0b6620 0x7fab1c0b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fab2400abe0 tx=0x7fab2400a5c0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.170+0000 7fab396b3640 1 -- 172.21.15.7:0/2662438788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab34108d10 msgr2=0x7fab3419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.170+0000 7fab396b3640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab34108d10 0x7fab3419fd20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00eaa0 tx=0x7fab2c00ef60 comp rx=0 tx=0).stop 2024-09-21T05:53:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.170+0000 7fab396b3640 1 -- 172.21.15.7:0/2662438788 shutdown_connections 2024-09-21T05:53:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.170+0000 7fab396b3640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab1c0b6620 0x7fab1c0b8b30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.170+0000 7fab396b3640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab34108d10 0x7fab3419fd20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.170+0000 7fab396b3640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab341083c0 0x7fab3419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.170+0000 7fab396b3640 1 --2- 172.21.15.7:0/2662438788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab34102a80 0x7fab3419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.170+0000 7fab396b3640 1 -- 172.21.15.7:0/2662438788 >> 172.21.15.7:0/2662438788 conn(0x7fab34079740 msgr2=0x7fab3406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.170+0000 7fab396b3640 1 -- 172.21.15.7:0/2662438788 shutdown_connections 2024-09-21T05:53:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:15.170+0000 7fab396b3640 1 -- 172.21.15.7:0/2662438788 wait complete. 2024-09-21T05:53:15.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:15 smithi007 ceph-mon[30983]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:53:15.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:15 smithi007 ceph-mon[30983]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:15.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:15 smithi119 ceph-mon[34833]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:53:15.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:15 smithi119 ceph-mon[34833]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:15.858 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T05:53:15.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:15 smithi027 ceph-mon[34364]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:53:15.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:15 smithi027 ceph-mon[34364]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:16.120 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.531+0000 7f6b6c672640 1 -- 172.21.15.7:0/851467127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b64102a70 msgr2=0x7f6b64102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.531+0000 7f6b6c672640 1 --2- 172.21.15.7:0/851467127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b64102a70 0x7f6b64102e80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009900 tx=0x7f6b6002a410 comp rx=0 tx=0).stop 2024-09-21T05:53:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.531+0000 7f6b6c672640 1 -- 172.21.15.7:0/851467127 shutdown_connections 2024-09-21T05:53:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.531+0000 7f6b6c672640 1 --2- 172.21.15.7:0/851467127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b64108d00 0x7f6b6410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.531+0000 7f6b6c672640 1 --2- 172.21.15.7:0/851467127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b641083b0 0x7f6b641087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.531+0000 7f6b6c672640 1 --2- 172.21.15.7:0/851467127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b64102a70 0x7f6b64102e80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.531+0000 7f6b6c672640 1 -- 172.21.15.7:0/851467127 >> 172.21.15.7:0/851467127 conn(0x7f6b64079730 msgr2=0x7f6b64079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.531+0000 7f6b6c672640 1 -- 172.21.15.7:0/851467127 shutdown_connections 2024-09-21T05:53:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.531+0000 7f6b6c672640 1 -- 172.21.15.7:0/851467127 wait complete. 2024-09-21T05:53:16.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.532+0000 7f6b6c672640 1 Processor -- start 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.532+0000 7f6b6c672640 1 -- start start 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.532+0000 7f6b6c672640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b64102a70 0x7f6b6419b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.532+0000 7f6b6c672640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b641083b0 0x7f6b6419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.532+0000 7f6b6c672640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b64108d00 0x7f6b6419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.532+0000 7f6b6c672640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b64112970 con 0x7f6b64108d00 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.532+0000 7f6b6c672640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6b641127f0 con 0x7f6b64102a70 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.532+0000 7f6b6c672640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6b64112af0 con 0x7f6b641083b0 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.532+0000 7f6b6ac0f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b64108d00 0x7f6b6419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.532+0000 7f6b6ac0f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b64108d00 0x7f6b6419bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48478/0 (socket says 172.21.15.7:48478) 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.532+0000 7f6b6ac0f640 1 -- 172.21.15.7:0/26725622 learned_addr learned my addr 172.21.15.7:0/26725622 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.533+0000 7f6b6a40e640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b64102a70 0x7f6b6419b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.533+0000 7f6b69c0d640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b641083b0 0x7f6b6419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.533+0000 7f6b6ac0f640 1 -- 172.21.15.7:0/26725622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b641083b0 msgr2=0x7f6b6419b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.533+0000 7f6b6ac0f640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b641083b0 0x7f6b6419b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.533+0000 7f6b6ac0f640 1 -- 172.21.15.7:0/26725622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b64102a70 msgr2=0x7f6b6419b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.533+0000 7f6b6ac0f640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b64102a70 0x7f6b6419b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.533+0000 7f6b6ac0f640 1 -- 172.21.15.7:0/26725622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b641a6530 con 0x7f6b64108d00 2024-09-21T05:53:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.533+0000 7f6b6ac0f640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b64108d00 0x7f6b6419bd20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00eaa0 tx=0x7f6b5c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.533+0000 7f6b5b7fe640 1 -- 172.21.15.7:0/26725622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00cdb0 con 0x7f6b64108d00 2024-09-21T05:53:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.533+0000 7f6b6c672640 1 -- 172.21.15.7:0/26725622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b641a6820 con 0x7f6b64108d00 2024-09-21T05:53:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.533+0000 7f6b5b7fe640 1 -- 172.21.15.7:0/26725622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b5c005020 con 0x7f6b64108d00 2024-09-21T05:53:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.533+0000 7f6b5b7fe640 1 -- 172.21.15.7:0/26725622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c0116d0 con 0x7f6b64108d00 2024-09-21T05:53:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.533+0000 7f6b6c672640 1 -- 172.21.15.7:0/26725622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b641a6db0 con 0x7f6b64108d00 2024-09-21T05:53:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.534+0000 7f6b6c672640 1 -- 172.21.15.7:0/26725622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b64103cf0 con 0x7f6b64108d00 2024-09-21T05:53:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.537+0000 7f6b5b7fe640 1 -- 172.21.15.7:0/26725622 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f6b5c0054a0 con 0x7f6b64108d00 2024-09-21T05:53:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.538+0000 7f6b5b7fe640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6b500b6620 0x7f6b500b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.538+0000 7f6b6a40e640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6b500b6620 0x7f6b500b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.538+0000 7f6b5b7fe640 1 -- 172.21.15.7:0/26725622 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f6b5c0e7a60 con 0x7f6b64108d00 2024-09-21T05:53:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.538+0000 7f6b6a40e640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6b500b6620 0x7f6b500b8b30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6b60000c00 tx=0x7f6b60031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.541+0000 7f6b5b7fe640 1 -- 172.21.15.7:0/26725622 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b5c016030 con 0x7f6b64108d00 2024-09-21T05:53:16.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.740+0000 7f6b6c672640 1 -- 172.21.15.7:0/26725622 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f6b64063800 con 0x7f6b500b6620 2024-09-21T05:53:16.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.742+0000 7f6b5b7fe640 1 -- 172.21.15.7:0/26725622 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f6b64063800 con 0x7f6b500b6620 2024-09-21T05:53:16.744 INFO:teuthology.orchestra.run.smithi007.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T05:53:16.744 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300GE480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T05:53:16.744 INFO:teuthology.orchestra.run.smithi007.stdout:smithi027 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331001C400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T05:53:16.744 INFO:teuthology.orchestra.run.smithi007.stdout:smithi119 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y1400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T05:53:16.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.744+0000 7f6b6c672640 1 -- 172.21.15.7:0/26725622 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6b500b6620 msgr2=0x7f6b500b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:16.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.744+0000 7f6b6c672640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6b500b6620 0x7f6b500b8b30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6b60000c00 tx=0x7f6b60031400 comp rx=0 tx=0).stop 2024-09-21T05:53:16.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.744+0000 7f6b6c672640 1 -- 172.21.15.7:0/26725622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b64108d00 msgr2=0x7f6b6419bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:16.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.744+0000 7f6b6c672640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b64108d00 0x7f6b6419bd20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00eaa0 tx=0x7f6b5c00ef60 comp rx=0 tx=0).stop 2024-09-21T05:53:16.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.744+0000 7f6b6c672640 1 -- 172.21.15.7:0/26725622 shutdown_connections 2024-09-21T05:53:16.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.744+0000 7f6b6c672640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6b500b6620 0x7f6b500b8b30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:16.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.744+0000 7f6b6c672640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b64108d00 0x7f6b6419bd20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:16.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.745+0000 7f6b6c672640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b641083b0 0x7f6b6419b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:16.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.745+0000 7f6b6c672640 1 --2- 172.21.15.7:0/26725622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b64102a70 0x7f6b6419b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:16.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.745+0000 7f6b6c672640 1 -- 172.21.15.7:0/26725622 >> 172.21.15.7:0/26725622 conn(0x7f6b64079730 msgr2=0x7f6b64101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:16.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.745+0000 7f6b6c672640 1 -- 172.21.15.7:0/26725622 shutdown_connections 2024-09-21T05:53:16.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:16.745+0000 7f6b6c672640 1 -- 172.21.15.7:0/26725622 wait complete. 2024-09-21T05:53:17.390 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T05:53:17.399 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T05:53:17.399 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T05:53:17.657 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:17.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:17 smithi007 ceph-mon[30983]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:53:17.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:17 smithi007 ceph-mon[30983]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:17.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:17 smithi119 ceph-mon[34833]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:53:17.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:17 smithi119 ceph-mon[34833]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:17.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:17 smithi027 ceph-mon[34364]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:53:17.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:17 smithi027 ceph-mon[34364]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:18.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.130+0000 7f497c88a640 1 -- 172.21.15.7:0/1161336951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f497810ddf0 msgr2=0x7f4978110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:18.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.130+0000 7f497c88a640 1 --2- 172.21.15.7:0/1161336951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f497810ddf0 0x7f4978110300 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4970009ca0 tx=0x7f497002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:18.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.130+0000 7f497c88a640 1 -- 172.21.15.7:0/1161336951 shutdown_connections 2024-09-21T05:53:18.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.130+0000 7f497c88a640 1 --2- 172.21.15.7:0/1161336951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f497810ddf0 0x7f4978110300 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:18.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.130+0000 7f497c88a640 1 --2- 172.21.15.7:0/1161336951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4978105270 0x7f497810d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:18.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.130+0000 7f497c88a640 1 --2- 172.21.15.7:0/1161336951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4978104840 0x7f4978104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:18.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.130+0000 7f497c88a640 1 -- 172.21.15.7:0/1161336951 >> 172.21.15.7:0/1161336951 conn(0x7f4978079730 msgr2=0x7f4978079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:18.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.130+0000 7f497c88a640 1 -- 172.21.15.7:0/1161336951 shutdown_connections 2024-09-21T05:53:18.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.130+0000 7f497c88a640 1 -- 172.21.15.7:0/1161336951 wait complete. 2024-09-21T05:53:18.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497c88a640 1 Processor -- start 2024-09-21T05:53:18.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497c88a640 1 -- start start 2024-09-21T05:53:18.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497c88a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4978104840 0x7f497819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497c88a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4978105270 0x7f497819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497c88a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f497810ddf0 0x7f49781a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497c88a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4978113a90 con 0x7f4978104840 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497c88a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4978113910 con 0x7f4978105270 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497c88a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4978113c10 con 0x7f497810ddf0 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4978104840 0x7f497819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4978104840 0x7f497819c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48508/0 (socket says 172.21.15.7:48508) 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497659c640 1 -- 172.21.15.7:0/3181066025 learned_addr learned my addr 172.21.15.7:0/3181066025 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f4975d9b640 1 --2- 172.21.15.7:0/3181066025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4978105270 0x7f497819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497659c640 1 -- 172.21.15.7:0/3181066025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f497810ddf0 msgr2=0x7f49781a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497659c640 1 --2- 172.21.15.7:0/3181066025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f497810ddf0 0x7f49781a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497659c640 1 -- 172.21.15.7:0/3181066025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4978105270 msgr2=0x7f497819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497659c640 1 --2- 172.21.15.7:0/3181066025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4978105270 0x7f497819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.131+0000 7f497659c640 1 -- 172.21.15.7:0/3181066025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49781a2670 con 0x7f4978104840 2024-09-21T05:53:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.132+0000 7f497659c640 1 --2- 172.21.15.7:0/3181066025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4978104840 0x7f497819c700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f496800d950 tx=0x7f496800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:18.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.132+0000 7f49677fe640 1 -- 172.21.15.7:0/3181066025 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968017070 con 0x7f4978104840 2024-09-21T05:53:18.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.132+0000 7f497c88a640 1 -- 172.21.15.7:0/3181066025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49781a2960 con 0x7f4978104840 2024-09-21T05:53:18.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.132+0000 7f49677fe640 1 -- 172.21.15.7:0/3181066025 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4968009c30 con 0x7f4978104840 2024-09-21T05:53:18.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.132+0000 7f49677fe640 1 -- 172.21.15.7:0/3181066025 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496800f620 con 0x7f4978104840 2024-09-21T05:53:18.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.132+0000 7f497c88a640 1 -- 172.21.15.7:0/3181066025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49781a90c0 con 0x7f4978104840 2024-09-21T05:53:18.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.133+0000 7f497c88a640 1 -- 172.21.15.7:0/3181066025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4978104c50 con 0x7f4978104840 2024-09-21T05:53:18.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.135+0000 7f49677fe640 1 -- 172.21.15.7:0/3181066025 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7f496801a070 con 0x7f4978104840 2024-09-21T05:53:18.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.135+0000 7f49677fe640 1 --2- 172.21.15.7:0/3181066025 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f49600b65f0 0x7f49600b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:18.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.136+0000 7f4975d9b640 1 --2- 172.21.15.7:0/3181066025 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f49600b65f0 0x7f49600b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:18.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.136+0000 7f49677fe640 1 -- 172.21.15.7:0/3181066025 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f49680e7070 con 0x7f4978104840 2024-09-21T05:53:18.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.136+0000 7f4975d9b640 1 --2- 172.21.15.7:0/3181066025 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f49600b65f0 0x7f49600b8b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f496c005d80 tx=0x7f496c005c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:18.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.139+0000 7f49677fe640 1 -- 172.21.15.7:0/3181066025 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4968009de0 con 0x7f4978104840 2024-09-21T05:53:18.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.374+0000 7f497c88a640 1 -- 172.21.15.7:0/3181066025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f49781a9440 con 0x7f4978104840 2024-09-21T05:53:18.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.374+0000 7f49677fe640 1 -- 172.21.15.7:0/3181066025 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3076 (secure 0 0 0) 0x7f49680ad700 con 0x7f4978104840 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:e24 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:btime 2024-09-21T05:52:02:324811+0000 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:legacy client fscid: 1 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:Filesystem 'cephfs' (1) 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:fs_name cephfs 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 24 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-21T05:51:50.882920+0000 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-09-21T05:52:01.894944+0000 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:tableserver 0 2024-09-21T05:53:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:root 0 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:session_timeout 300 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:session_autoclose 300 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:max_file_size 1099511627776 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:max_xattr_size 65536 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:required_client_features {} 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:last_failure 0 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:last_failure_osd_epoch 0 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:max_mds 3 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:in 0,1,2 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:up {0=24691,1=24686,2=24679} 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:failed 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:damaged 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:stopped 2024-09-21T05:53:18.378 INFO:teuthology.orchestra.run.smithi007.stdout:data_pools [3] 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout:metadata_pool 2 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout:inline_data disabled 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout:balancer 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout:bal_rank_mask -1 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout:standby_count_wanted 0 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout:qdb_cluster leader: 24691 members: 24679,24686,24691 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.i{0:24691} state up:active seq 6 addr [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.f{0:24667} state up:standby-replay seq 1 addr [v2:172.21.15.119:6834/4262162696,v1:172.21.15.119:6835/4262162696] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b{1:24686} state up:active seq 6 addr [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.h{1:24659} state up:standby-replay seq 1 addr [v2:172.21.15.27:6836/1469000794,v1:172.21.15.27:6837/1469000794] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c{2:24679} state up:active seq 9 addr [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.l{2:24637} state up:standby-replay seq 1 addr [v2:172.21.15.119:6832/1234076482,v1:172.21.15.119:6833/1234076482] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout:Standby daemons: 2024-09-21T05:53:18.379 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:18.380 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.j{-1:14793} state up:standby seq 1 addr [v2:172.21.15.7:6834/806638499,v1:172.21.15.7:6835/806638499] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:18.380 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d{-1:14805} state up:standby seq 1 addr [v2:172.21.15.7:6836/3313125359,v1:172.21.15.7:6837/3313125359] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:18.380 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.g{-1:14850} state up:standby seq 1 addr [v2:172.21.15.7:6838/1135458977,v1:172.21.15.7:6839/1135458977] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:18.380 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a{-1:14856} state up:standby seq 1 addr [v2:172.21.15.7:6840/1570509958,v1:172.21.15.7:6841/1570509958] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:18.380 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.k{-1:24605} state up:standby seq 1 addr [v2:172.21.15.27:6832/3377430896,v1:172.21.15.27:6833/3377430896] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:18.380 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.e{-1:24632} state up:standby seq 1 addr [v2:172.21.15.27:6834/1038330056,v1:172.21.15.27:6835/1038330056] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T05:53:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.377+0000 7f497c88a640 1 -- 172.21.15.7:0/3181066025 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f49600b65f0 msgr2=0x7f49600b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.377+0000 7f497c88a640 1 --2- 172.21.15.7:0/3181066025 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f49600b65f0 0x7f49600b8b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f496c005d80 tx=0x7f496c005c90 comp rx=0 tx=0).stop 2024-09-21T05:53:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.377+0000 7f497c88a640 1 -- 172.21.15.7:0/3181066025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4978104840 msgr2=0x7f497819c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.377+0000 7f497c88a640 1 --2- 172.21.15.7:0/3181066025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4978104840 0x7f497819c700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f496800d950 tx=0x7f496800de10 comp rx=0 tx=0).stop 2024-09-21T05:53:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.377+0000 7f497c88a640 1 -- 172.21.15.7:0/3181066025 shutdown_connections 2024-09-21T05:53:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.377+0000 7f497c88a640 1 --2- 172.21.15.7:0/3181066025 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f49600b65f0 0x7f49600b8b00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.377+0000 7f497c88a640 1 --2- 172.21.15.7:0/3181066025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f497810ddf0 0x7f49781a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.377+0000 7f497c88a640 1 --2- 172.21.15.7:0/3181066025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4978105270 0x7f497819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.377+0000 7f497c88a640 1 --2- 172.21.15.7:0/3181066025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4978104840 0x7f497819c700 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.377+0000 7f497c88a640 1 -- 172.21.15.7:0/3181066025 >> 172.21.15.7:0/3181066025 conn(0x7f4978079730 msgr2=0x7f4978100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.377+0000 7f497c88a640 1 -- 172.21.15.7:0/3181066025 shutdown_connections 2024-09-21T05:53:18.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:18.377+0000 7f497c88a640 1 -- 172.21.15.7:0/3181066025 wait complete. 2024-09-21T05:53:18.797 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:18 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3181066025' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T05:53:18.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:18 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3181066025' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T05:53:19.032 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T05:53:19.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:18 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3181066025' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T05:53:19.291 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:19.739 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:19 smithi007 ceph-mon[30983]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:53:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.747+0000 7fbf86cfb640 1 -- 172.21.15.7:0/1061499158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf80108d00 msgr2=0x7fbf8010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.747+0000 7fbf86cfb640 1 --2- 172.21.15.7:0/1061499158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf80108d00 0x7fbf8010f530 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009ca0 tx=0x7fbf7802a8e0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.747+0000 7fbf86cfb640 1 -- 172.21.15.7:0/1061499158 shutdown_connections 2024-09-21T05:53:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.747+0000 7fbf86cfb640 1 --2- 172.21.15.7:0/1061499158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf80108d00 0x7fbf8010f530 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.747+0000 7fbf86cfb640 1 --2- 172.21.15.7:0/1061499158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf801083b0 0x7fbf801087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.747+0000 7fbf86cfb640 1 --2- 172.21.15.7:0/1061499158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf80102ac0 0x7fbf80102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.747+0000 7fbf86cfb640 1 -- 172.21.15.7:0/1061499158 >> 172.21.15.7:0/1061499158 conn(0x7fbf80079720 msgr2=0x7fbf80079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.747+0000 7fbf86cfb640 1 -- 172.21.15.7:0/1061499158 shutdown_connections 2024-09-21T05:53:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.747+0000 7fbf86cfb640 1 -- 172.21.15.7:0/1061499158 wait complete. 2024-09-21T05:53:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.748+0000 7fbf86cfb640 1 Processor -- start 2024-09-21T05:53:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.748+0000 7fbf86cfb640 1 -- start start 2024-09-21T05:53:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.748+0000 7fbf86cfb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf80102ac0 0x7fbf8019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.748+0000 7fbf86cfb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf801083b0 0x7fbf8019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.748+0000 7fbf86cfb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf80108d00 0x7fbf8019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.748+0000 7fbf86cfb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbf80112a80 con 0x7fbf80102ac0 2024-09-21T05:53:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.748+0000 7fbf86cfb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbf80112900 con 0x7fbf801083b0 2024-09-21T05:53:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.748+0000 7fbf86cfb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbf80112c00 con 0x7fbf80108d00 2024-09-21T05:53:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.748+0000 7fbf84a97640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf80102ac0 0x7fbf8019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.748+0000 7fbf84a97640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf80102ac0 0x7fbf8019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45156/0 (socket says 172.21.15.7:45156) 2024-09-21T05:53:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf84a97640 1 -- 172.21.15.7:0/2053567007 learned_addr learned my addr 172.21.15.7:0/2053567007 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf7ffff640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf801083b0 0x7fbf8019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf85298640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf80108d00 0x7fbf8019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf84a97640 1 -- 172.21.15.7:0/2053567007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf80108d00 msgr2=0x7fbf8019fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf84a97640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf80108d00 0x7fbf8019fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf84a97640 1 -- 172.21.15.7:0/2053567007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf801083b0 msgr2=0x7fbf8019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf84a97640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf801083b0 0x7fbf8019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf84a97640 1 -- 172.21.15.7:0/2053567007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf801a0510 con 0x7fbf80102ac0 2024-09-21T05:53:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf85298640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf80108d00 0x7fbf8019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf84a97640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf80102ac0 0x7fbf8019a5a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000b4a0 tx=0x7fbf7000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf7dffb640 1 -- 172.21.15.7:0/2053567007 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70015020 con 0x7fbf80102ac0 2024-09-21T05:53:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf86cfb640 1 -- 172.21.15.7:0/2053567007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf801a0800 con 0x7fbf80102ac0 2024-09-21T05:53:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf7dffb640 1 -- 172.21.15.7:0/2053567007 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf70011ce0 con 0x7fbf80102ac0 2024-09-21T05:53:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.749+0000 7fbf7dffb640 1 -- 172.21.15.7:0/2053567007 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70010dc0 con 0x7fbf80102ac0 2024-09-21T05:53:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.750+0000 7fbf86cfb640 1 -- 172.21.15.7:0/2053567007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf801a6f60 con 0x7fbf80102ac0 2024-09-21T05:53:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.750+0000 7fbf86cfb640 1 -- 172.21.15.7:0/2053567007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf80102f50 con 0x7fbf80102ac0 2024-09-21T05:53:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.752+0000 7fbf7dffb640 1 -- 172.21.15.7:0/2053567007 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fbf70018020 con 0x7fbf80102ac0 2024-09-21T05:53:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.753+0000 7fbf7dffb640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbf680b65f0 0x7fbf680b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.753+0000 7fbf7ffff640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbf680b65f0 0x7fbf680b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.753+0000 7fbf7dffb640 1 -- 172.21.15.7:0/2053567007 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fbf700e7350 con 0x7fbf80102ac0 2024-09-21T05:53:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.754+0000 7fbf7ffff640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbf680b65f0 0x7fbf680b8b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf80079f30 tx=0x7fbf74009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.756+0000 7fbf7dffb640 1 -- 172.21.15.7:0/2053567007 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf7001f020 con 0x7fbf80102ac0 2024-09-21T05:53:19.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.944+0000 7fbf86cfb640 1 -- 172.21.15.7:0/2053567007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fbf8002e640 con 0x7fbf80102ac0 2024-09-21T05:53:19.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.945+0000 7fbf7dffb640 1 -- 172.21.15.7:0/2053567007 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v75) ==== 56+0+5596 (secure 0 0 0) 0x7fbf700ad980 con 0x7fbf80102ac0 2024-09-21T05:53:19.947 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 75 2024-09-21T05:53:19.947 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T05:53:19.947 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-21T05:43:32.863896+0000 2024-09-21T05:53:19.947 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-09-21T05:52:23.580753+0000 2024-09-21T05:53:19.948 INFO:teuthology.orchestra.run.smithi007.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T05:53:19.948 INFO:teuthology.orchestra.run.smithi007.stdout:crush_version 26 2024-09-21T05:53:19.948 INFO:teuthology.orchestra.run.smithi007.stdout:full_ratio 0.95 2024-09-21T05:53:19.948 INFO:teuthology.orchestra.run.smithi007.stdout:backfillfull_ratio 0.9 2024-09-21T05:53:19.948 INFO:teuthology.orchestra.run.smithi007.stdout:nearfull_ratio 0.85 2024-09-21T05:53:19.948 INFO:teuthology.orchestra.run.smithi007.stdout:require_min_compat_client luminous 2024-09-21T05:53:19.948 INFO:teuthology.orchestra.run.smithi007.stdout:min_compat_client luminous 2024-09-21T05:53:19.948 INFO:teuthology.orchestra.run.smithi007.stdout:require_osd_release squid 2024-09-21T05:53:19.948 INFO:teuthology.orchestra.run.smithi007.stdout:stretch_mode_enabled false 2024-09-21T05:53:19.948 INFO:teuthology.orchestra.run.smithi007.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T05:53:19.948 INFO:teuthology.orchestra.run.smithi007.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-21T05:53:19.948 INFO:teuthology.orchestra.run.smithi007.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:max_osd 12 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 up in weight 1 up_from 9 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6802/536257283,v1:172.21.15.7:6803/536257283] [v2:172.21.15.7:6804/536257283,v1:172.21.15.7:6805/536257283] exists,up 6d7a68ba-a599-44a9-a0de-a1d6df51f437 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 up in weight 1 up_from 14 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6800/2299402871,v1:172.21.15.27:6801/2299402871] [v2:172.21.15.27:6802/2299402871,v1:172.21.15.27:6803/2299402871] exists,up d4600805-1cb5-432a-8ae0-a40107a6c6b0 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 up in weight 1 up_from 19 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6800/1043408043,v1:172.21.15.119:6801/1043408043] [v2:172.21.15.119:6802/1043408043,v1:172.21.15.119:6803/1043408043] exists,up aa435f82-5819-4497-9053-1d891e712b0c 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 up in weight 1 up_from 26 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6810/1261229771,v1:172.21.15.7:6811/1261229771] [v2:172.21.15.7:6812/1261229771,v1:172.21.15.7:6813/1261229771] exists,up 55803f97-02e1-43c0-b8da-9b8af32fd1eb 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 up in weight 1 up_from 31 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6808/631467792,v1:172.21.15.27:6809/631467792] [v2:172.21.15.27:6810/631467792,v1:172.21.15.27:6811/631467792] exists,up 987ce230-5bfc-45a7-a33e-6291545afded 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 up in weight 1 up_from 35 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6808/2530968619,v1:172.21.15.119:6809/2530968619] [v2:172.21.15.119:6810/2530968619,v1:172.21.15.119:6811/2530968619] exists,up e768fbfa-8983-4ff6-8dca-b7df2304cf91 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 up in weight 1 up_from 40 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6818/856032021,v1:172.21.15.7:6819/856032021] [v2:172.21.15.7:6820/856032021,v1:172.21.15.7:6821/856032021] exists,up 22496f13-64be-479b-89ea-bf51544199c3 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 up in weight 1 up_from 45 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6816/2862843529,v1:172.21.15.27:6817/2862843529] [v2:172.21.15.27:6818/2862843529,v1:172.21.15.27:6819/2862843529] exists,up 53fc5616-b06a-498e-a60e-d7d7d6ba2a59 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.8 up in weight 1 up_from 51 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6816/3663835202,v1:172.21.15.119:6817/3663835202] [v2:172.21.15.119:6818/3663835202,v1:172.21.15.119:6819/3663835202] exists,up 53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.9 up in weight 1 up_from 56 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6826/2348805959,v1:172.21.15.7:6827/2348805959] [v2:172.21.15.7:6828/2348805959,v1:172.21.15.7:6829/2348805959] exists,up a69a747d-1e6c-4940-9d96-4315ab384588 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.10 up in weight 1 up_from 62 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6824/2363600090,v1:172.21.15.27:6825/2363600090] [v2:172.21.15.27:6826/2363600090,v1:172.21.15.27:6827/2363600090] exists,up a8f67271-99bb-4fb7-b0f5-a24730cd96cf 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.11 up in weight 1 up_from 67 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6824/3937692826,v1:172.21.15.119:6825/3937692826] [v2:172.21.15.119:6826/3937692826,v1:172.21.15.119:6827/3937692826] exists,up 88456735-00b1-479c-b201-588a9ee0c881 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.6 [8,11] 2024-09-21T05:53:19.949 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.a [2,11] 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.1d [2,4] 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.2 [3,9] 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.10 [5,9] 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.1b [4,8] 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.2c [4,9] 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/4143746508 expires 2024-09-22T05:45:22.373420+0000 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/1505943829 expires 2024-09-22T05:43:54.947457+0000 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/1622456881 expires 2024-09-22T05:44:20.678295+0000 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/833696585 expires 2024-09-22T05:43:54.947457+0000 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/2055984288 expires 2024-09-22T05:43:54.947457+0000 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/3203783640 expires 2024-09-22T05:43:54.947457+0000 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/2964502604 expires 2024-09-22T05:44:20.678295+0000 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/3203783640 expires 2024-09-22T05:43:54.947457+0000 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/2964502604 expires 2024-09-22T05:44:20.678295+0000 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/3995317885 expires 2024-09-22T05:45:22.373420+0000 2024-09-21T05:53:19.950 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/2229583478 expires 2024-09-22T05:44:20.678295+0000 2024-09-21T05:53:19.951 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/468393974 expires 2024-09-22T05:44:20.678295+0000 2024-09-21T05:53:19.951 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/1009303060 expires 2024-09-22T05:45:22.373420+0000 2024-09-21T05:53:19.951 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/2125734440 expires 2024-09-22T05:45:22.373420+0000 2024-09-21T05:53:19.951 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/3995317885 expires 2024-09-22T05:45:22.373420+0000 2024-09-21T05:53:19.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.947+0000 7fbf86cfb640 1 -- 172.21.15.7:0/2053567007 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbf680b65f0 msgr2=0x7fbf680b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:19.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.947+0000 7fbf86cfb640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbf680b65f0 0x7fbf680b8b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf80079f30 tx=0x7fbf74009110 comp rx=0 tx=0).stop 2024-09-21T05:53:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.947+0000 7fbf86cfb640 1 -- 172.21.15.7:0/2053567007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf80102ac0 msgr2=0x7fbf8019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.948+0000 7fbf86cfb640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf80102ac0 0x7fbf8019a5a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000b4a0 tx=0x7fbf7000b8a0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.948+0000 7fbf86cfb640 1 -- 172.21.15.7:0/2053567007 shutdown_connections 2024-09-21T05:53:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.948+0000 7fbf86cfb640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbf680b65f0 0x7fbf680b8b00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.948+0000 7fbf86cfb640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf80108d00 0x7fbf8019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.948+0000 7fbf86cfb640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbf801083b0 0x7fbf8019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.948+0000 7fbf86cfb640 1 --2- 172.21.15.7:0/2053567007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf80102ac0 0x7fbf8019a5a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.948+0000 7fbf86cfb640 1 -- 172.21.15.7:0/2053567007 >> 172.21.15.7:0/2053567007 conn(0x7fbf80079720 msgr2=0x7fbf80101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.948+0000 7fbf86cfb640 1 -- 172.21.15.7:0/2053567007 shutdown_connections 2024-09-21T05:53:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:19.948+0000 7fbf86cfb640 1 -- 172.21.15.7:0/2053567007 wait complete. 2024-09-21T05:53:19.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:19 smithi027 ceph-mon[34364]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:53:20.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:19 smithi119 ceph-mon[34833]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:53:20.649 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:20 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2053567007' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T05:53:20.651 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T05:53:20.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:20.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:20 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2053567007' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T05:53:21.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:20 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2053567007' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T05:53:21.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.411+0000 7fc994254640 1 -- 172.21.15.7:0/619161709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c1083c0 msgr2=0x7fc98c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.411+0000 7fc994254640 1 --2- 172.21.15.7:0/619161709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c1083c0 0x7fc98c1087d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009900 tx=0x7fc97c02a410 comp rx=0 tx=0).stop 2024-09-21T05:53:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.411+0000 7fc994254640 1 -- 172.21.15.7:0/619161709 shutdown_connections 2024-09-21T05:53:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.411+0000 7fc994254640 1 --2- 172.21.15.7:0/619161709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c1083c0 0x7fc98c1087d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.411+0000 7fc994254640 1 --2- 172.21.15.7:0/619161709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc98c108d10 0x7fc98c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.411+0000 7fc994254640 1 --2- 172.21.15.7:0/619161709 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc98c102a80 0x7fc98c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.411+0000 7fc994254640 1 -- 172.21.15.7:0/619161709 >> 172.21.15.7:0/619161709 conn(0x7fc98c079740 msgr2=0x7fc98c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.411+0000 7fc994254640 1 -- 172.21.15.7:0/619161709 shutdown_connections 2024-09-21T05:53:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.411+0000 7fc994254640 1 -- 172.21.15.7:0/619161709 wait complete. 2024-09-21T05:53:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc994254640 1 Processor -- start 2024-09-21T05:53:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc994254640 1 -- start start 2024-09-21T05:53:21.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc994254640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc98c102a80 0x7fc98c19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:21.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc994254640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c1083c0 0x7fc98c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:21.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc994254640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc98c108d10 0x7fc98c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:21.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc994254640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c113a90 con 0x7fc98c1083c0 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc994254640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c113910 con 0x7fc98c108d10 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc994254640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c113c10 con 0x7fc98c102a80 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc9917ef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c1083c0 0x7fc98c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc9917ef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c1083c0 0x7fc98c19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45168/0 (socket says 172.21.15.7:45168) 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc9917ef640 1 -- 172.21.15.7:0/902850014 learned_addr learned my addr 172.21.15.7:0/902850014 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc9927f1640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc98c108d10 0x7fc98c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc991ff0640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc98c102a80 0x7fc98c19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc9917ef640 1 -- 172.21.15.7:0/902850014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc98c102a80 msgr2=0x7fc98c19a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.412+0000 7fc9917ef640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc98c102a80 0x7fc98c19a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.413+0000 7fc9917ef640 1 -- 172.21.15.7:0/902850014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc98c108d10 msgr2=0x7fc98c19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.413+0000 7fc9917ef640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc98c108d10 0x7fc98c19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.413+0000 7fc9917ef640 1 -- 172.21.15.7:0/902850014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c1a03f0 con 0x7fc98c1083c0 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.413+0000 7fc9927f1640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc98c108d10 0x7fc98c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.413+0000 7fc991ff0640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc98c102a80 0x7fc98c19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.413+0000 7fc9917ef640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c1083c0 0x7fc98c19aae0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc97c006010 tx=0x7fc97c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:21.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.413+0000 7fc982ffd640 1 -- 172.21.15.7:0/902850014 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c03f030 con 0x7fc98c1083c0 2024-09-21T05:53:21.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.413+0000 7fc982ffd640 1 -- 172.21.15.7:0/902850014 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc97c003aa0 con 0x7fc98c1083c0 2024-09-21T05:53:21.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.413+0000 7fc994254640 1 -- 172.21.15.7:0/902850014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98c1a0680 con 0x7fc98c1083c0 2024-09-21T05:53:21.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.413+0000 7fc982ffd640 1 -- 172.21.15.7:0/902850014 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c035070 con 0x7fc98c1083c0 2024-09-21T05:53:21.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.413+0000 7fc994254640 1 -- 172.21.15.7:0/902850014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98c1a0bb0 con 0x7fc98c1083c0 2024-09-21T05:53:21.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.414+0000 7fc994254640 1 -- 172.21.15.7:0/902850014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc98c103d00 con 0x7fc98c1083c0 2024-09-21T05:53:21.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.416+0000 7fc982ffd640 1 -- 172.21.15.7:0/902850014 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fc97c042030 con 0x7fc98c1083c0 2024-09-21T05:53:21.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.416+0000 7fc982ffd640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc9780b66a0 0x7fc9780b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:21.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.417+0000 7fc991ff0640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc9780b66a0 0x7fc9780b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:21.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.417+0000 7fc982ffd640 1 -- 172.21.15.7:0/902850014 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fc97c107a10 con 0x7fc98c1083c0 2024-09-21T05:53:21.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.417+0000 7fc991ff0640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc9780b66a0 0x7fc9780b8bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc988009b50 tx=0x7fc988005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:21.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.421+0000 7fc982ffd640 1 -- 172.21.15.7:0/902850014 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc98c1a0bb0 con 0x7fc98c1083c0 2024-09-21T05:53:21.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.647+0000 7fc994254640 1 -- 172.21.15.7:0/902850014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc98c102e90 con 0x7fc98c1083c0 2024-09-21T05:53:21.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.648+0000 7fc982ffd640 1 -- 172.21.15.7:0/902850014 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11896 (secure 0 0 0) 0x7fc97c0ce0a0 con 0x7fc98c1083c0 2024-09-21T05:53:21.650 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:21.650 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-21T05:52:02:324811+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:52:01.894944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24679,24686,24691]},"id":1}]} 2024-09-21T05:53:21.651 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T05:53:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.650+0000 7fc994254640 1 -- 172.21.15.7:0/902850014 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc9780b66a0 msgr2=0x7fc9780b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.650+0000 7fc994254640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc9780b66a0 0x7fc9780b8bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc988009b50 tx=0x7fc988005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.650+0000 7fc994254640 1 -- 172.21.15.7:0/902850014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c1083c0 msgr2=0x7fc98c19aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.650+0000 7fc994254640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c1083c0 0x7fc98c19aae0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc97c006010 tx=0x7fc97c004060 comp rx=0 tx=0).stop 2024-09-21T05:53:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.650+0000 7fc994254640 1 -- 172.21.15.7:0/902850014 shutdown_connections 2024-09-21T05:53:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.650+0000 7fc994254640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc9780b66a0 0x7fc9780b8bb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.650+0000 7fc994254640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c1083c0 0x7fc98c19aae0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.650+0000 7fc994254640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc98c108d10 0x7fc98c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.650+0000 7fc994254640 1 --2- 172.21.15.7:0/902850014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc98c102a80 0x7fc98c19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.650+0000 7fc994254640 1 -- 172.21.15.7:0/902850014 >> 172.21.15.7:0/902850014 conn(0x7fc98c079740 msgr2=0x7fc98c1044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:21.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.650+0000 7fc994254640 1 -- 172.21.15.7:0/902850014 shutdown_connections 2024-09-21T05:53:21.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:21.650+0000 7fc994254640 1 -- 172.21.15.7:0/902850014 wait complete. 2024-09-21T05:53:21.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:21 smithi027 ceph-mon[34364]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:53:22.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:21 smithi007 ceph-mon[30983]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:53:22.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:21 smithi119 ceph-mon[34833]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:53:22.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:22.550 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:22.963 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:22 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/902850014' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:22.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:22 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/902850014' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:23.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.053+0000 7fe50eab5640 1 -- 172.21.15.7:0/3891602082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe508109df0 msgr2=0x7fe508110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:23.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.053+0000 7fe50eab5640 1 --2- 172.21.15.7:0/3891602082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe508109df0 0x7fe508110620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe500009ca0 tx=0x7fe50002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.053+0000 7fe50eab5640 1 -- 172.21.15.7:0/3891602082 shutdown_connections 2024-09-21T05:53:23.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.053+0000 7fe50eab5640 1 --2- 172.21.15.7:0/3891602082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe508109df0 0x7fe508110620 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.053+0000 7fe50eab5640 1 --2- 172.21.15.7:0/3891602082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5081094a0 0x7fe5081098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.053+0000 7fe50eab5640 1 --2- 172.21.15.7:0/3891602082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe508103b60 0x7fe508103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.053+0000 7fe50eab5640 1 -- 172.21.15.7:0/3891602082 >> 172.21.15.7:0/3891602082 conn(0x7fe50807b850 msgr2=0x7fe50807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:23.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.053+0000 7fe50eab5640 1 -- 172.21.15.7:0/3891602082 shutdown_connections 2024-09-21T05:53:23.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.053+0000 7fe50eab5640 1 -- 172.21.15.7:0/3891602082 wait complete. 2024-09-21T05:53:23.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50eab5640 1 Processor -- start 2024-09-21T05:53:23.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50eab5640 1 -- start start 2024-09-21T05:53:23.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50eab5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe508103b60 0x7fe508075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:23.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50eab5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5081094a0 0x7fe508075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:23.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50eab5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe508109df0 0x7fe508076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:23.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50eab5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe508113ab0 con 0x7fe508103b60 2024-09-21T05:53:23.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50eab5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe508113930 con 0x7fe508109df0 2024-09-21T05:53:23.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50eab5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe508113c30 con 0x7fe5081094a0 2024-09-21T05:53:23.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50c851640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe508103b60 0x7fe508075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:23.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50c851640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe508103b60 0x7fe508075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45178/0 (socket says 172.21.15.7:45178) 2024-09-21T05:53:23.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50c851640 1 -- 172.21.15.7:0/1005921918 learned_addr learned my addr 172.21.15.7:0/1005921918 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:23.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50d052640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe508109df0 0x7fe508076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:23.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50c851640 1 -- 172.21.15.7:0/1005921918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5081094a0 msgr2=0x7fe508075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:23.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50c851640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5081094a0 0x7fe508075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50c851640 1 -- 172.21.15.7:0/1005921918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe508109df0 msgr2=0x7fe508076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50c851640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe508109df0 0x7fe508076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50c851640 1 -- 172.21.15.7:0/1005921918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5081a86c0 con 0x7fe508103b60 2024-09-21T05:53:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.054+0000 7fe50d052640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe508109df0 0x7fe508076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.055+0000 7fe50c851640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe508103b60 0x7fe508075710 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800d950 tx=0x7fe4f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.055+0000 7fe505ffb640 1 -- 172.21.15.7:0/1005921918 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8017030 con 0x7fe508103b60 2024-09-21T05:53:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.055+0000 7fe505ffb640 1 -- 172.21.15.7:0/1005921918 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4f8004020 con 0x7fe508103b60 2024-09-21T05:53:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.055+0000 7fe50eab5640 1 -- 172.21.15.7:0/1005921918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5081a89b0 con 0x7fe508103b60 2024-09-21T05:53:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.055+0000 7fe505ffb640 1 -- 172.21.15.7:0/1005921918 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f80047a0 con 0x7fe508103b60 2024-09-21T05:53:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.055+0000 7fe50eab5640 1 -- 172.21.15.7:0/1005921918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5081a8ef0 con 0x7fe508103b60 2024-09-21T05:53:23.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.056+0000 7fe50eab5640 1 -- 172.21.15.7:0/1005921918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe508103f70 con 0x7fe508103b60 2024-09-21T05:53:23.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.058+0000 7fe505ffb640 1 -- 172.21.15.7:0/1005921918 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154579+0+0 (secure 0 0 0) 0x7fe4f8009a30 con 0x7fe508103b60 2024-09-21T05:53:23.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.058+0000 7fe505ffb640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe4f00b65f0 0x7fe4f00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:23.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.059+0000 7fe507fff640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe4f00b65f0 0x7fe4f00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:23.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.059+0000 7fe505ffb640 1 -- 172.21.15.7:0/1005921918 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fe4f80e77c0 con 0x7fe508103b60 2024-09-21T05:53:23.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.059+0000 7fe507fff640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe4f00b65f0 0x7fe4f00b8b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe508109170 tx=0x7fe4fc005b60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:23.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.062+0000 7fe505ffb640 1 -- 172.21.15.7:0/1005921918 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4f80ade50 con 0x7fe508103b60 2024-09-21T05:53:23.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:22 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/902850014' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.291+0000 7fe50eab5640 1 -- 172.21.15.7:0/1005921918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe508076a10 con 0x7fe508103b60 2024-09-21T05:53:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.292+0000 7fe505ffb640 1 -- 172.21.15.7:0/1005921918 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11896 (secure 0 0 0) 0x7fe4f80b2230 con 0x7fe508103b60 2024-09-21T05:53:23.294 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:23.294 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-21T05:52:02:324811+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:52:01.894944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24679,24686,24691]},"id":1}]} 2024-09-21T05:53:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T05:53:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.294+0000 7fe50eab5640 1 -- 172.21.15.7:0/1005921918 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe4f00b65f0 msgr2=0x7fe4f00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.294+0000 7fe50eab5640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe4f00b65f0 0x7fe4f00b8b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe508109170 tx=0x7fe4fc005b60 comp rx=0 tx=0).stop 2024-09-21T05:53:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.294+0000 7fe50eab5640 1 -- 172.21.15.7:0/1005921918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe508103b60 msgr2=0x7fe508075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.294+0000 7fe50eab5640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe508103b60 0x7fe508075710 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800d950 tx=0x7fe4f800de10 comp rx=0 tx=0).stop 2024-09-21T05:53:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.295+0000 7fe50eab5640 1 -- 172.21.15.7:0/1005921918 shutdown_connections 2024-09-21T05:53:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.295+0000 7fe50eab5640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe4f00b65f0 0x7fe4f00b8b00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.295+0000 7fe50eab5640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe508109df0 0x7fe508076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.295+0000 7fe50eab5640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5081094a0 0x7fe508075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.295+0000 7fe50eab5640 1 --2- 172.21.15.7:0/1005921918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe508103b60 0x7fe508075710 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.295+0000 7fe50eab5640 1 -- 172.21.15.7:0/1005921918 >> 172.21.15.7:0/1005921918 conn(0x7fe50807b850 msgr2=0x7fe508107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.295+0000 7fe50eab5640 1 -- 172.21.15.7:0/1005921918 shutdown_connections 2024-09-21T05:53:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:23.295+0000 7fe50eab5640 1 -- 172.21.15.7:0/1005921918 wait complete. 2024-09-21T05:53:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:23 smithi007 ceph-mon[30983]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:53:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:23 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1005921918' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:23.925 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:53:23.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:23 smithi027 ceph-mon[34364]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:53:23.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:23 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1005921918' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:24.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:23 smithi119 ceph-mon[34833]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:53:24.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:23 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1005921918' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:24.184 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:24.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.695+0000 7f88b2976640 1 -- 172.21.15.7:0/2002225986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88ac102ac0 msgr2=0x7f88ac102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:24.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.695+0000 7f88b2976640 1 --2- 172.21.15.7:0/2002225986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88ac102ac0 0x7f88ac102ed0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f889c009900 tx=0x7f889c02a410 comp rx=0 tx=0).stop 2024-09-21T05:53:24.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.695+0000 7f88b2976640 1 -- 172.21.15.7:0/2002225986 shutdown_connections 2024-09-21T05:53:24.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.695+0000 7f88b2976640 1 --2- 172.21.15.7:0/2002225986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88ac108d00 0x7f88ac10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.695+0000 7f88b2976640 1 --2- 172.21.15.7:0/2002225986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88ac1083b0 0x7f88ac1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.695+0000 7f88b2976640 1 --2- 172.21.15.7:0/2002225986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88ac102ac0 0x7f88ac102ed0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.695+0000 7f88b2976640 1 -- 172.21.15.7:0/2002225986 >> 172.21.15.7:0/2002225986 conn(0x7f88ac079720 msgr2=0x7f88ac079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:24.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.695+0000 7f88b2976640 1 -- 172.21.15.7:0/2002225986 shutdown_connections 2024-09-21T05:53:24.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.695+0000 7f88b2976640 1 -- 172.21.15.7:0/2002225986 wait complete. 2024-09-21T05:53:24.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.696+0000 7f88b2976640 1 Processor -- start 2024-09-21T05:53:24.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.696+0000 7f88b2976640 1 -- start start 2024-09-21T05:53:24.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.696+0000 7f88b2976640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88ac102ac0 0x7f88ac19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.696+0000 7f88b2976640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88ac1083b0 0x7f88ac19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.696+0000 7f88b2976640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88ac108d00 0x7f88ac19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88b2976640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac1129c0 con 0x7f88ac108d00 2024-09-21T05:53:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88b2976640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac112840 con 0x7f88ac102ac0 2024-09-21T05:53:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88b2976640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac112b40 con 0x7f88ac1083b0 2024-09-21T05:53:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88b0f13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88ac108d00 0x7f88ac19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88b0f13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88ac108d00 0x7f88ac19fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45202/0 (socket says 172.21.15.7:45202) 2024-09-21T05:53:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88b0f13640 1 -- 172.21.15.7:0/1369611165 learned_addr learned my addr 172.21.15.7:0/1369611165 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88ab7fe640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88ac1083b0 0x7f88ac19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88abfff640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88ac102ac0 0x7f88ac19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88b0f13640 1 -- 172.21.15.7:0/1369611165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88ac1083b0 msgr2=0x7f88ac19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88b0f13640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88ac1083b0 0x7f88ac19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88b0f13640 1 -- 172.21.15.7:0/1369611165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88ac102ac0 msgr2=0x7f88ac19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:24.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88b0f13640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88ac102ac0 0x7f88ac19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88b0f13640 1 -- 172.21.15.7:0/1369611165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac1a0450 con 0x7f88ac108d00 2024-09-21T05:53:24.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88b0f13640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88ac108d00 0x7f88ac19fd20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009fd0 tx=0x7f88a400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:24.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88a97fa640 1 -- 172.21.15.7:0/1369611165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4017070 con 0x7f88ac108d00 2024-09-21T05:53:24.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88a97fa640 1 -- 172.21.15.7:0/1369611165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88a4003e20 con 0x7f88ac108d00 2024-09-21T05:53:24.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88b2976640 1 -- 172.21.15.7:0/1369611165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac1a0740 con 0x7f88ac108d00 2024-09-21T05:53:24.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.697+0000 7f88a97fa640 1 -- 172.21.15.7:0/1369611165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4010460 con 0x7f88ac108d00 2024-09-21T05:53:24.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.698+0000 7f88b2976640 1 -- 172.21.15.7:0/1369611165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac1a6ea0 con 0x7f88ac108d00 2024-09-21T05:53:24.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.699+0000 7f88b2976640 1 -- 172.21.15.7:0/1369611165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac103cf0 con 0x7f88ac108d00 2024-09-21T05:53:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.700+0000 7f88a97fa640 1 -- 172.21.15.7:0/1369611165 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f88a4003970 con 0x7f88ac108d00 2024-09-21T05:53:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.701+0000 7f88a97fa640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f88940b6560 0x7f88940b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.701+0000 7f88abfff640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f88940b6560 0x7f88940b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.701+0000 7f88a97fa640 1 -- 172.21.15.7:0/1369611165 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f88a40e7500 con 0x7f88ac108d00 2024-09-21T05:53:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.701+0000 7f88abfff640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f88940b6560 0x7f88940b8a70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f889c031440 tx=0x7f889c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:24.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.704+0000 7f88a97fa640 1 -- 172.21.15.7:0/1369611165 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f88a40b2070 con 0x7f88ac108d00 2024-09-21T05:53:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.893+0000 7f88b2976640 1 -- 172.21.15.7:0/1369611165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88ac102ed0 con 0x7f88ac108d00 2024-09-21T05:53:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.894+0000 7f88a97fa640 1 -- 172.21.15.7:0/1369611165 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22826 (secure 0 0 0) 0x7f88ac102ed0 con 0x7f88ac108d00 2024-09-21T05:53:24.897 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:24.897 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:43:32.863896+0000","modified":"2024-09-21T05:52:23.580753+0000","last_up_change":"2024-09-21T05:51:02.074799+0000","last_in_change":"2024-09-21T05:50:39.016405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:47:20.844179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:51:46.238763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:51:48.832249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d7a68ba-a599-44a9-a0de-a1d6df51f437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6803","nonce":536257283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6805","nonce":536257283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6809","nonce":536257283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6807","nonce":536257283}]},"public_addr":"172.21.15.7:6803/536257283","cluster_addr":"172.21.15.7:6805/536257283","heartbeat_back_addr":"172.21.15.7:6809/536257283","heartbeat_front_addr":"172.21.15.7:6807/536257283","state":["exists","up"]},{"osd":1,"uuid":"d4600805-1cb5-432a-8ae0-a40107a6c6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6801","nonce":2299402871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6803","nonce":2299402871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6807","nonce":2299402871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6805","nonce":2299402871}]},"public_addr":"172.21.15.27:6801/2299402871","cluster_addr":"172.21.15.27:6803/2299402871","heartbeat_back_addr":"172.21.15.27:6807/2299402871","heartbeat_front_addr":"172.21.15.27:6805/2299402871","state":["exists","up"]},{"osd":2,"uuid":"aa435f82-5819-4497-9053-1d891e712b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6801","nonce":1043408043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6803","nonce":1043408043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6807","nonce":1043408043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6805","nonce":1043408043}]},"public_addr":"172.21.15.119:6801/1043408043","cluster_addr":"172.21.15.119:6803/1043408043","heartbeat_back_addr":"172.21.15.119:6807/1043408043","heartbeat_front_addr":"172.21.15.119:6805/1043408043","state":["exists","up"]},{"osd":3,"uuid":"55803f97-02e1-43c0-b8da-9b8af32fd1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6811","nonce":1261229771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6813","nonce":1261229771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6817","nonce":1261229771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6815","nonce":1261229771}]},"public_addr":"172.21.15.7:6811/1261229771","cluster_addr":"172.21.15.7:6813/1261229771","heartbeat_back_addr":"172.21.15.7:6817/1261229771","heartbeat_front_addr":"172.21.15.7:6815/1261229771","state":["exists","up"]},{"osd":4,"uuid":"987ce230-5bfc-45a7-a33e-6291545afded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6809","nonce":631467792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6811","nonce":631467792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6815","nonce":631467792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6813","nonce":631467792}]},"public_addr":"172.21.15.27:6809/631467792","cluster_addr":"172.21.15.27:6811/631467792","heartbeat_back_addr":"172.21.15.27:6815/631467792","heartbeat_front_addr":"172.21.15.27:6813/631467792","state":["exists","up"]},{"osd":5,"uuid":"e768fbfa-8983-4ff6-8dca-b7df2304cf91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6809","nonce":2530968619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6811","nonce":2530968619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6815","nonce":2530968619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6813","nonce":2530968619}]},"public_addr":"172.21.15.119:6809/2530968619","cluster_addr":"172.21.15.119:6811/2530968619","heartbeat_back_addr":"172.21.15.119:6815/2530968619","heartbeat_front_addr":"172.21.15.119:6813/2530968619","state":["exists","up"]},{"osd":6,"uuid":"22496f13-64be-479b-89ea-bf51544199c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6819","nonce":856032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6821","nonce":856032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6825","nonce":856032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6823","nonce":856032021}]},"public_addr":"172.21.15.7:6819/856032021","cluster_addr":"172.21.15.7:6821/856032021","heartbeat_back_addr":"172.21.15.7:6825/856032021","heartbeat_front_addr":"172.21.15.7:6823/856032021","state":["exists","up"]},{"osd":7,"uuid":"53fc5616-b06a-498e-a60e-d7d7d6ba2a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6817","nonce":2862843529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6819","nonce":2862843529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6823","nonce":2862843529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6821","nonce":2862843529}]},"public_addr":"172.21.15.27:6817/2862843529","cluster_addr":"172.21.15.27:6819/2862843529","heartbeat_back_addr":"172.21.15.27:6823/2862843529","heartbeat_front_addr":"172.21.15.27:6821/2862843529","state":["exists","up"]},{"osd":8,"uuid":"53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6817","nonce":3663835202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6819","nonce":3663835202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6823","nonce":3663835202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6821","nonce":3663835202}]},"public_addr":"172.21.15.119:6817/3663835202","cluster_addr":"172.21.15.119:6819/3663835202","heartbeat_back_addr":"172.21.15.119:6823/3663835202","heartbeat_front_addr":"172.21.15.119:6821/3663835202","state":["exists","up"]},{"osd":9,"uuid":"a69a747d-1e6c-4940-9d96-4315ab384588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6827","nonce":2348805959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6829","nonce":2348805959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6833","nonce":2348805959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6831","nonce":2348805959}]},"public_addr":"172.21.15.7:6827/2348805959","cluster_addr":"172.21.15.7:6829/2348805959","heartbeat_back_addr":"172.21.15.7:6833/2348805959","heartbeat_front_addr":"172.21.15.7:6831/2348805959","state":["exists","up"]},{"osd":10,"uuid":"a8f67271-99bb-4fb7-b0f5-a24730cd96cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6825","nonce":2363600090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6827","nonce":2363600090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6831","nonce":2363600090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6829","nonce":2363600090}]},"public_addr":"172.21.15.27:6825/2363600090","cluster_addr":"172.21.15.27:6827/2363600090","heartbeat_back_addr":"172.21.15.27:6831/2363600090","heartbeat_front_addr":"172.21.15.27:6829/2363600090","state":["exists","up"]},{"osd":11,"uuid":"88456735-00b1-479c-b201-588a9ee0c881","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6825","nonce":3937692826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6827","nonce":3937692826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6831","nonce":3937692826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6829","nonce":3937692826}]},"public_addr":"172.21.15.119:6825/3937692826","cluster_addr":"172.21.15.119:6827/3937692826","heartbeat_back_addr":"172.21.15.119:6831/3937692826","heartbeat_front_addr":"172.21.15.119:6829/3937692826","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:26.217550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:51.830871+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:17.201362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:41.990894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:07.357782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.114180+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:56.808155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:22.565234+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:46.981522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:10.600602+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:35.973766+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:51:00.216062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/4143746508":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/1505943829":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/1622456881":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/833696585":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/2055984288":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6801/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3995317885":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2229583478":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/468393974":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/1009303060":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2125734440":"2024-09-22T05:45:22.373420+0000","172.21.15.7:6800/3995317885":"2024-09-22T05:45:22.373420+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:53:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.896+0000 7f88b2976640 1 -- 172.21.15.7:0/1369611165 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f88940b6560 msgr2=0x7f88940b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.896+0000 7f88b2976640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f88940b6560 0x7f88940b8a70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f889c031440 tx=0x7f889c009560 comp rx=0 tx=0).stop 2024-09-21T05:53:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.896+0000 7f88b2976640 1 -- 172.21.15.7:0/1369611165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88ac108d00 msgr2=0x7f88ac19fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.896+0000 7f88b2976640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88ac108d00 0x7f88ac19fd20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009fd0 tx=0x7f88a400b260 comp rx=0 tx=0).stop 2024-09-21T05:53:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.897+0000 7f88b2976640 1 -- 172.21.15.7:0/1369611165 shutdown_connections 2024-09-21T05:53:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.897+0000 7f88b2976640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f88940b6560 0x7f88940b8a70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.897+0000 7f88b2976640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88ac108d00 0x7f88ac19fd20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.897+0000 7f88b2976640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88ac1083b0 0x7f88ac19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.897+0000 7f88b2976640 1 --2- 172.21.15.7:0/1369611165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88ac102ac0 0x7f88ac19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.897+0000 7f88b2976640 1 -- 172.21.15.7:0/1369611165 >> 172.21.15.7:0/1369611165 conn(0x7f88ac079720 msgr2=0x7f88ac101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.897+0000 7f88b2976640 1 -- 172.21.15.7:0/1369611165 shutdown_connections 2024-09-21T05:53:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:24.897+0000 7f88b2976640 1 -- 172.21.15.7:0/1369611165 wait complete. 2024-09-21T05:53:25.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T05:51:50.882920+0000', 'modified': '2024-09-21T05:52:01.894944+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24691, 'mds_1': 24686, 'mds_2': 24679}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24637': {'gid': 24637, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6833/1234076482', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6832', 'nonce': 1234076482}, {'type': 'v1', 'addr': '172.21.15.119:6833', 'nonce': 1234076482}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24659': {'gid': 24659, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.27:6837/1469000794', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6836', 'nonce': 1469000794}, {'type': 'v1', 'addr': '172.21.15.27:6837', 'nonce': 1469000794}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.119:6835/4262162696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 4262162696}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 4262162696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24679': {'gid': 24679, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.119:6837/3266640886', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6836', 'nonce': 3266640886}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 3266640886}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24686': {'gid': 24686, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.27:6839/556391029', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6838', 'nonce': 556391029}, {'type': 'v1', 'addr': '172.21.15.27:6839', 'nonce': 556391029}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24691': {'gid': 24691, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.119:6839/1840148228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 1840148228}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 1840148228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24691, 'qdb_cluster': [24679, 24686, 24691]} 2024-09-21T05:53:25.504 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T05:53:25.504 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T05:53:25.763 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:25.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:25 smithi007 ceph-mon[30983]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T05:53:25.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:25 smithi007 ceph-mon[30983]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T05:53:25.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:25 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1369611165' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:25.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:25 smithi027 ceph-mon[34364]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T05:53:25.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:25 smithi027 ceph-mon[34364]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T05:53:25.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:25 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1369611165' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:26.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:25 smithi119 ceph-mon[34833]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T05:53:26.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:25 smithi119 ceph-mon[34833]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T05:53:26.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:25 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1369611165' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:26.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.195+0000 7f09a92ae640 1 -- 172.21.15.7:0/3820007105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09a41083d0 msgr2=0x7f09a41087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:26.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.195+0000 7f09a92ae640 1 --2- 172.21.15.7:0/3820007105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09a41083d0 0x7f09a41087e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0998009ca0 tx=0x7f099802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.195+0000 7f09a92ae640 1 -- 172.21.15.7:0/3820007105 shutdown_connections 2024-09-21T05:53:26.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.195+0000 7f09a92ae640 1 --2- 172.21.15.7:0/3820007105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09a41083d0 0x7f09a41087e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.195+0000 7f09a92ae640 1 --2- 172.21.15.7:0/3820007105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09a4108d20 0x7f09a410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.195+0000 7f09a92ae640 1 --2- 172.21.15.7:0/3820007105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09a4102ae0 0x7f09a4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.195+0000 7f09a92ae640 1 -- 172.21.15.7:0/3820007105 >> 172.21.15.7:0/3820007105 conn(0x7f09a4079760 msgr2=0x7f09a4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.195+0000 7f09a92ae640 1 -- 172.21.15.7:0/3820007105 shutdown_connections 2024-09-21T05:53:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.195+0000 7f09a92ae640 1 -- 172.21.15.7:0/3820007105 wait complete. 2024-09-21T05:53:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.196+0000 7f09a92ae640 1 Processor -- start 2024-09-21T05:53:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.196+0000 7f09a92ae640 1 -- start start 2024-09-21T05:53:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a92ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09a4102ae0 0x7f09a4198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a92ae640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09a41083d0 0x7f09a4199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a92ae640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09a4108d20 0x7f09a419ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a92ae640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09a4113ab0 con 0x7f09a4108d20 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a92ae640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f09a4113930 con 0x7f09a41083d0 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a92ae640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f09a4113c30 con 0x7f09a4102ae0 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09a4108d20 0x7f09a419ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09a4108d20 0x7f09a419ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45214/0 (socket says 172.21.15.7:45214) 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a37fe640 1 -- 172.21.15.7:0/2301251785 learned_addr learned my addr 172.21.15.7:0/2301251785 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a2ffd640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09a4102ae0 0x7f09a4198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a27fc640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09a41083d0 0x7f09a4199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a37fe640 1 -- 172.21.15.7:0/2301251785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09a4102ae0 msgr2=0x7f09a4198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a37fe640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09a4102ae0 0x7f09a4198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a37fe640 1 -- 172.21.15.7:0/2301251785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09a41083d0 msgr2=0x7f09a4199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a37fe640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09a41083d0 0x7f09a4199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a37fe640 1 -- 172.21.15.7:0/2301251785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a41a04c0 con 0x7f09a4108d20 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a27fc640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09a41083d0 0x7f09a4199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f09a37fe640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09a4108d20 0x7f09a419ff80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f099c00d750 tx=0x7f099c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.197+0000 7f098bfff640 1 -- 172.21.15.7:0/2301251785 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c017070 con 0x7f09a4108d20 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.198+0000 7f098bfff640 1 -- 172.21.15.7:0/2301251785 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f099c0054d0 con 0x7f09a4108d20 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.198+0000 7f09a92ae640 1 -- 172.21.15.7:0/2301251785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a41a07b0 con 0x7f09a4108d20 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.198+0000 7f098bfff640 1 -- 172.21.15.7:0/2301251785 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c004c60 con 0x7f09a4108d20 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.198+0000 7f09a92ae640 1 -- 172.21.15.7:0/2301251785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a41a0cf0 con 0x7f09a4108d20 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.200+0000 7f09af822740 1 Processor -- start 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f098bfff640 1 -- 172.21.15.7:0/2301251785 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f099c009bd0 con 0x7f09a4108d20 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09af822740 1 -- start start 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09af822740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d8665f60 0x55b5d8a0bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09af822740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d863d0a0 0x55b5d8a0c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09af822740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 0x55b5d8a0c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09af822740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b5d8983c10 con 0x55b5d8665f60 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09af822740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b5d8973040 con 0x55b5d8645280 2024-09-21T05:53:26.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09af822740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b5d8976e50 con 0x55b5d863d0a0 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d8665f60 0x55b5d8a0bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d8665f60 0x55b5d8a0bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45226/0 (socket says 172.21.15.7:45226) 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09a27fc640 1 -- 172.21.15.7:0/3798326146 learned_addr learned my addr 172.21.15.7:0/3798326146 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09a27fc640 1 --2- 172.21.15.7:0/3798326146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 0x55b5d8a0c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09a2ffd640 1 --2- 172.21.15.7:0/3798326146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d863d0a0 0x55b5d8a0c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09a27fc640 1 -- 172.21.15.7:0/3798326146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d863d0a0 msgr2=0x55b5d8a0c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09a27fc640 1 --2- 172.21.15.7:0/3798326146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d863d0a0 0x55b5d8a0c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09a27fc640 1 -- 172.21.15.7:0/3798326146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 msgr2=0x55b5d8a0c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09a27fc640 1 --2- 172.21.15.7:0/3798326146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 0x55b5d8a0c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.201+0000 7f09a27fc640 1 -- 172.21.15.7:0/3798326146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5d86d1540 con 0x55b5d8665f60 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.202+0000 7f09a27fc640 1 --2- 172.21.15.7:0/3798326146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d8665f60 0x55b5d8a0bf00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0998006010 tx=0x7f0998005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8650f41a440748 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.202+0000 7f098bfff640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f098c0b65e0 0x7f098c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.202+0000 7f09a2ffd640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f098c0b65e0 0x7f098c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.202+0000 7f09897fa640 1 -- 172.21.15.7:0/3798326146 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0998044020 con 0x55b5d8665f60 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.202+0000 7f098bfff640 1 -- 172.21.15.7:0/2301251785 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f099c0e6cf0 con 0x7f09a4108d20 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.202+0000 7f09897fa640 1 -- 172.21.15.7:0/3798326146 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0998036050 con 0x55b5d8665f60 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.203+0000 7f09897fa640 1 -- 172.21.15.7:0/3798326146 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0998004290 con 0x55b5d8665f60 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.203+0000 7f09af822740 1 -- 172.21.15.7:0/3798326146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d8665f60 msgr2=0x55b5d8a0bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.203+0000 7f09a2ffd640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f098c0b65e0 0x7f098c0b8af0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55b5d8a0ab80 tx=0x7f099400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.203+0000 7f09af822740 1 --2- 172.21.15.7:0/3798326146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d8665f60 0x55b5d8a0bf00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0998006010 tx=0x7f0998005da0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.203+0000 7f09af822740 1 -- 172.21.15.7:0/3798326146 shutdown_connections 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.203+0000 7f09af822740 1 --2- 172.21.15.7:0/3798326146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 0x55b5d8a0c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.203+0000 7f09af822740 1 --2- 172.21.15.7:0/3798326146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d863d0a0 0x55b5d8a0c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.203+0000 7f09af822740 1 --2- 172.21.15.7:0/3798326146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d8665f60 0x55b5d8a0bf00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.204+0000 7f09af822740 1 -- 172.21.15.7:0/3798326146 >> 172.21.15.7:0/3798326146 conn(0x55b5d865a350 msgr2=0x55b5d8a09df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.204+0000 7f09af822740 1 -- 172.21.15.7:0/3798326146 shutdown_connections 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.204+0000 7f09af822740 1 -- 172.21.15.7:0/3798326146 wait complete. 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.204+0000 7f09af822740 1 -- start start 2024-09-21T05:53:26.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.204+0000 7f09af822740 1 Processor -- start 2024-09-21T05:53:26.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09af822740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d863d0a0 0x55b5d8a179a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09af822740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 0x55b5d8a17ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09af822740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d8665f60 0x55b5d8a23a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09af822740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b5d87d45f0 con 0x55b5d8665f60 2024-09-21T05:53:26.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09af822740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b5d890e010 con 0x55b5d8645280 2024-09-21T05:53:26.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09af822740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b5d8a1a6d0 con 0x55b5d863d0a0 2024-09-21T05:53:26.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09af822740 10 client.0 _ll_register_callbacks cb 0x55b5d896d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:26.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09a27fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 0x55b5d8a17ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09a2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d863d0a0 0x55b5d8a179a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09a27fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 0x55b5d8a17ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:50778/0 (socket says 172.21.15.7:50778) 2024-09-21T05:53:26.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09a27fc640 1 -- 172.21.15.7:0/2181991540 learned_addr learned my addr 172.21.15.7:0/2181991540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:26.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09a37fe640 1 --2- 172.21.15.7:0/2181991540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d8665f60 0x55b5d8a23a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09a2ffd640 1 -- 172.21.15.7:0/2181991540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 msgr2=0x55b5d8a17ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09a2ffd640 1 --2- 172.21.15.7:0/2181991540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 0x55b5d8a17ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09a2ffd640 1 -- 172.21.15.7:0/2181991540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d8665f60 msgr2=0x55b5d8a23a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09a2ffd640 1 --2- 172.21.15.7:0/2181991540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d8665f60 0x55b5d8a23a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09a2ffd640 1 -- 172.21.15.7:0/2181991540 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5d893ba00 con 0x55b5d863d0a0 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f09a2ffd640 1 --2- 172.21.15.7:0/2181991540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d863d0a0 0x55b5d8a179a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f09a410f4b0 tx=0x7f09940046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56880fc423673a03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.205+0000 7f0986ff5640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.206+0000 7f0986ff5640 1 -- 172.21.15.7:0/2181991540 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994005220 con 0x55b5d863d0a0 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.206+0000 7f0986ff5640 1 -- 172.21.15.7:0/2181991540 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f09940053c0 con 0x55b5d863d0a0 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.206+0000 7f09af822740 1 -- 172.21.15.7:0/2181991540 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0998036050 con 0x55b5d863d0a0 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.206+0000 7f0986ff5640 1 -- 172.21.15.7:0/2181991540 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f09940055c0 con 0x55b5d863d0a0 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.206+0000 7f09af822740 10 client.25051 fetch_fsmap learned FSMap version 24 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.206+0000 7f09af822740 1 -- 172.21.15.7:0/2181991540 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b5d8a266c0 con 0x55b5d863d0a0 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.206+0000 7f0986ff5640 1 -- 172.21.15.7:0/2181991540 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0998036050 con 0x55b5d863d0a0 2024-09-21T05:53:26.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.207+0000 7f0986ff5640 1 -- 172.21.15.7:0/2181991540 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f099401fbb0 con 0x55b5d863d0a0 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.207+0000 7f09af822740 10 client.25051 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.207+0000 7f09af822740 10 client.25051 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.207+0000 7f09af822740 20 client.25051 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.207+0000 7f09af822740 1 --2- 172.21.15.7:0/2181991540 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b5d86248e0 0x55b5d8a2a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.207+0000 7f09af822740 4 client.25051 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.207+0000 7f09af822740 1 -- 172.21.15.7:0/2181991540 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5d8985b60 con 0x55b5d86248e0 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.207+0000 7f09a27fc640 1 --2- 172.21.15.7:0/2181991540 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b5d86248e0 0x55b5d8a2a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.207+0000 7f09a27fc640 1 --2- 172.21.15.7:0/2181991540 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b5d86248e0 0x55b5d8a2a180 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d86c6306062783c server_cookie=530cf0bca0ef67c6 in_seq=0 out_seq=0 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.207+0000 7f0986ff5640 10 client.25051 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.208+0000 7f0986ff5640 1 -- 172.21.15.7:0/2181991540 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b5d8985b60 con 0x55b5d86248e0 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.208+0000 7f0986ff5640 10 client.25051 handle_command_reply: tid=0 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.208+0000 7f09af822740 1 client.25051 shutdown 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.208+0000 7f09af822740 1 -- 172.21.15.7:0/2181991540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d863d0a0 msgr2=0x55b5d8a179a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:26.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.208+0000 7f09af822740 1 --2- 172.21.15.7:0/2181991540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d863d0a0 0x55b5d8a179a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f09a410f4b0 tx=0x7f09940046c0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.208+0000 7f09af822740 1 -- 172.21.15.7:0/2181991540 shutdown_connections 2024-09-21T05:53:26.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.208+0000 7f09af822740 1 --2- 172.21.15.7:0/2181991540 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b5d86248e0 0x55b5d8a2a180 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.208+0000 7f09af822740 1 --2- 172.21.15.7:0/2181991540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d8665f60 0x55b5d8a23a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.208+0000 7f09af822740 1 --2- 172.21.15.7:0/2181991540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 0x55b5d8a17ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.208+0000 7f0986ff5640 0 client.25051 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:53:26.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.208+0000 7f09af822740 1 --2- 172.21.15.7:0/2181991540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d863d0a0 0x55b5d8a179a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.209+0000 7f09af822740 1 -- 172.21.15.7:0/2181991540 >> 172.21.15.7:0/2181991540 conn(0x55b5d865a350 msgr2=0x55b5d8a0f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:26.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.209+0000 7f09af822740 1 -- 172.21.15.7:0/2181991540 shutdown_connections 2024-09-21T05:53:26.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.209+0000 7f09af822740 1 -- 172.21.15.7:0/2181991540 wait complete. 2024-09-21T05:53:26.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.209+0000 7f09af822740 20 client.25051 trim_cache size 0 max 16384 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09af822740 1 Processor -- start 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09af822740 1 -- start start 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09af822740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d86248e0 0x55b5d8a23980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09af822740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 0x55b5d8a23ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09af822740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d8645280 0x55b5d8a12980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09af822740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b5d8a284c0 con 0x55b5d863d0a0 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09af822740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b5d8a28b90 con 0x55b5d86248e0 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09af822740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b5d8a29260 con 0x55b5d8645280 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 0x55b5d8a23ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 0x55b5d8a23ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45244/0 (socket says 172.21.15.7:45244) 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09a27fc640 1 -- 172.21.15.7:0/2260191132 learned_addr learned my addr 172.21.15.7:0/2260191132 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09a37fe640 1 --2- 172.21.15.7:0/2260191132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d8645280 0x55b5d8a12980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09a2ffd640 1 --2- 172.21.15.7:0/2260191132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d86248e0 0x55b5d8a23980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09a27fc640 1 -- 172.21.15.7:0/2260191132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d8645280 msgr2=0x55b5d8a12980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09a27fc640 1 --2- 172.21.15.7:0/2260191132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d8645280 0x55b5d8a12980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09a27fc640 1 -- 172.21.15.7:0/2260191132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d86248e0 msgr2=0x55b5d8a23980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09a27fc640 1 --2- 172.21.15.7:0/2260191132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d86248e0 0x55b5d8a23980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.229+0000 7f09a27fc640 1 -- 172.21.15.7:0/2260191132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5d8a0ed60 con 0x55b5d863d0a0 2024-09-21T05:53:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.230+0000 7f09a27fc640 1 --2- 172.21.15.7:0/2260191132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 0x55b5d8a23ec0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0998000f80 tx=0x7f099803f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a483032e98853f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.230+0000 7f0988ff9640 1 -- 172.21.15.7:0/2260191132 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0998055020 con 0x55b5d863d0a0 2024-09-21T05:53:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.230+0000 7f0988ff9640 1 -- 172.21.15.7:0/2260191132 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0998036040 con 0x55b5d863d0a0 2024-09-21T05:53:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.230+0000 7f0988ff9640 1 -- 172.21.15.7:0/2260191132 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0998044040 con 0x55b5d863d0a0 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.231+0000 7f09af822740 1 -- 172.21.15.7:0/2260191132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 msgr2=0x55b5d8a23ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.231+0000 7f09af822740 1 --2- 172.21.15.7:0/2260191132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 0x55b5d8a23ec0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0998000f80 tx=0x7f099803f040 comp rx=0 tx=0).stop 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.231+0000 7f09af822740 1 -- 172.21.15.7:0/2260191132 shutdown_connections 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.231+0000 7f09af822740 1 --2- 172.21.15.7:0/2260191132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 0x55b5d8a23ec0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.231+0000 7f09af822740 1 --2- 172.21.15.7:0/2260191132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d8645280 0x55b5d8a12980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.231+0000 7f09af822740 1 --2- 172.21.15.7:0/2260191132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d86248e0 0x55b5d8a23980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.231+0000 7f09af822740 1 -- 172.21.15.7:0/2260191132 >> 172.21.15.7:0/2260191132 conn(0x55b5d865a350 msgr2=0x55b5d8a17980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.231+0000 7f09af822740 1 -- 172.21.15.7:0/2260191132 shutdown_connections 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.231+0000 7f09af822740 1 -- 172.21.15.7:0/2260191132 wait complete. 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.231+0000 7f09af822740 1 -- start start 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.231+0000 7f09af822740 1 Processor -- start 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09af822740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d86248e0 0x55b5d8a2cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09af822740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 0x55b5d8a2d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09af822740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 0x55b5d8a30d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09af822740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b5d8a2a000 con 0x55b5d863d0a0 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09af822740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b5d8a29930 con 0x55b5d8645280 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09af822740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b5d8a2a6d0 con 0x55b5d86248e0 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09af822740 10 client.0 _ll_register_callbacks cb 0x7f099400b9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 0x55b5d8a2d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 0x55b5d8a2d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45252/0 (socket says 172.21.15.7:45252) 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09a27fc640 1 -- 172.21.15.7:0/4259716240 learned_addr learned my addr 172.21.15.7:0/4259716240 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09a2ffd640 1 --2- 172.21.15.7:0/4259716240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d86248e0 0x55b5d8a2cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09a37fe640 1 --2- 172.21.15.7:0/4259716240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 0x55b5d8a30d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09a27fc640 1 -- 172.21.15.7:0/4259716240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d86248e0 msgr2=0x55b5d8a2cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09a27fc640 1 --2- 172.21.15.7:0/4259716240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d86248e0 0x55b5d8a2cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09a27fc640 1 -- 172.21.15.7:0/4259716240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 msgr2=0x55b5d8a30d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09a27fc640 1 --2- 172.21.15.7:0/4259716240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 0x55b5d8a30d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09a27fc640 1 -- 172.21.15.7:0/4259716240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5d8a313f0 con 0x55b5d863d0a0 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09a27fc640 1 --2- 172.21.15.7:0/4259716240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 0x55b5d8a2d2d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0998009960 tx=0x7f0998003bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6dabc20a9b713 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f0986ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f0986ff5640 1 -- 172.21.15.7:0/4259716240 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099805e020 con 0x55b5d863d0a0 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f09af822740 1 -- 172.21.15.7:0/4259716240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0998036040 con 0x55b5d863d0a0 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.232+0000 7f0986ff5640 1 -- 172.21.15.7:0/4259716240 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f099802fcf0 con 0x55b5d863d0a0 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.233+0000 7f0986ff5640 1 -- 172.21.15.7:0/4259716240 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0998069050 con 0x55b5d863d0a0 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.233+0000 7f09af822740 10 client.15342 fetch_fsmap learned FSMap version 24 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.233+0000 7f09af822740 1 -- 172.21.15.7:0/4259716240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b5d8a327b0 con 0x55b5d863d0a0 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.233+0000 7f0986ff5640 1 -- 172.21.15.7:0/4259716240 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0998036040 con 0x55b5d863d0a0 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.233+0000 7f0986ff5640 1 -- 172.21.15.7:0/4259716240 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0998030b90 con 0x55b5d863d0a0 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.233+0000 7f09af822740 10 client.15342 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.233+0000 7f09af822740 10 client.15342 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.233+0000 7f09af822740 20 client.15342 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:26.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.233+0000 7f09af822740 1 --2- 172.21.15.7:0/4259716240 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b5d8665f60 0x55b5d8a97da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.233+0000 7f09af822740 4 client.15342 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.233+0000 7f09af822740 1 -- 172.21.15.7:0/4259716240 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "status"}) -- 0x55b5d8981610 con 0x55b5d8665f60 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f09a2ffd640 1 --2- 172.21.15.7:0/4259716240 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b5d8665f60 0x55b5d8a97da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f0986ff5640 10 client.15342 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f09a2ffd640 1 --2- 172.21.15.7:0/4259716240 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b5d8665f60 0x55b5d8a97da0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fe69dd3336cf227d server_cookie=5ea670ad07c6c257 in_seq=0 out_seq=0 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f0986ff5640 1 -- 172.21.15.7:0/4259716240 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b5d8981610 con 0x55b5d8665f60 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f0986ff5640 10 client.15342 handle_command_reply: tid=0 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f09af822740 1 client.15342 shutdown 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f09af822740 1 -- 172.21.15.7:0/4259716240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 msgr2=0x55b5d8a2d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f09af822740 1 --2- 172.21.15.7:0/4259716240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 0x55b5d8a2d2d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0998009960 tx=0x7f0998003bb0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f09af822740 1 -- 172.21.15.7:0/4259716240 shutdown_connections 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f09af822740 1 --2- 172.21.15.7:0/4259716240 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b5d8665f60 0x55b5d8a97da0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f09af822740 1 --2- 172.21.15.7:0/4259716240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5d863d0a0 0x55b5d8a2d2d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f09af822740 1 --2- 172.21.15.7:0/4259716240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b5d8645280 0x55b5d8a30d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f09af822740 1 --2- 172.21.15.7:0/4259716240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b5d86248e0 0x55b5d8a2cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f09af822740 1 -- 172.21.15.7:0/4259716240 >> 172.21.15.7:0/4259716240 conn(0x55b5d865a350 msgr2=0x55b5d8a12980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:26.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.234+0000 7f0986ff5640 0 client.15342 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:53:26.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09af822740 1 -- 172.21.15.7:0/4259716240 shutdown_connections 2024-09-21T05:53:26.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09af822740 1 -- 172.21.15.7:0/4259716240 wait complete. 2024-09-21T05:53:26.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09af822740 20 client.15342 trim_cache size 0 max 16384 2024-09-21T05:53:26.241 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:53:26.241 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "397810bc-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:53:26.241 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-09-21T05:53:26.241 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24679, 2024-09-21T05:53:26.241 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-21T05:53:26.241 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-21T05:53:26.242 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-21T05:53:26.242 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 86.922678349999998, 2024-09-21T05:53:26.242 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-21T05:53:26.242 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 75, 2024-09-21T05:53:26.242 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T05:53:26.242 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 118.887999955 2024-09-21T05:53:26.242 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:53:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09a92ae640 1 -- 172.21.15.7:0/2301251785 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f098c0b65e0 msgr2=0x7f098c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09a92ae640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f098c0b65e0 0x7f098c0b8af0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55b5d8a0ab80 tx=0x7f099400b390 comp rx=0 tx=0).stop 2024-09-21T05:53:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09a92ae640 1 -- 172.21.15.7:0/2301251785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09a4108d20 msgr2=0x7f09a419ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09a92ae640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09a4108d20 0x7f09a419ff80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f099c00d750 tx=0x7f099c00dc10 comp rx=0 tx=0).stop 2024-09-21T05:53:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09a92ae640 1 -- 172.21.15.7:0/2301251785 shutdown_connections 2024-09-21T05:53:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09a92ae640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f098c0b65e0 0x7f098c0b8af0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09a92ae640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09a4108d20 0x7f09a419ff80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09a92ae640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09a41083d0 0x7f09a4199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09a92ae640 1 --2- 172.21.15.7:0/2301251785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09a4102ae0 0x7f09a4198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09a92ae640 1 -- 172.21.15.7:0/2301251785 >> 172.21.15.7:0/2301251785 conn(0x7f09a4079760 msgr2=0x7f09a4110000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09a92ae640 1 -- 172.21.15.7:0/2301251785 shutdown_connections 2024-09-21T05:53:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:26.235+0000 7f09a92ae640 1 -- 172.21.15.7:0/2301251785 wait complete. 2024-09-21T05:53:26.892 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T05:53:27.154 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:27.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.691+0000 7fe121ae0640 1 -- 172.21.15.7:0/3805047346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c108cf0 msgr2=0x7fe11c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:27.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.691+0000 7fe121ae0640 1 --2- 172.21.15.7:0/3805047346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c108cf0 0x7fe11c10f520 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe114009ca0 tx=0x7fe11402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.692+0000 7fe121ae0640 1 -- 172.21.15.7:0/3805047346 shutdown_connections 2024-09-21T05:53:27.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.692+0000 7fe121ae0640 1 --2- 172.21.15.7:0/3805047346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c108cf0 0x7fe11c10f520 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.692+0000 7fe121ae0640 1 --2- 172.21.15.7:0/3805047346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe11c1083a0 0x7fe11c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.692+0000 7fe121ae0640 1 --2- 172.21.15.7:0/3805047346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe11c102a60 0x7fe11c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.692+0000 7fe121ae0640 1 -- 172.21.15.7:0/3805047346 >> 172.21.15.7:0/3805047346 conn(0x7fe11c079730 msgr2=0x7fe11c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.692+0000 7fe121ae0640 1 -- 172.21.15.7:0/3805047346 shutdown_connections 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.692+0000 7fe121ae0640 1 -- 172.21.15.7:0/3805047346 wait complete. 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.692+0000 7fe121ae0640 1 Processor -- start 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe121ae0640 1 -- start start 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe121ae0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c102a60 0x7fe11c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe121ae0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe11c1083a0 0x7fe11c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe121ae0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe11c108cf0 0x7fe11c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe121ae0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c112960 con 0x7fe11c102a60 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe121ae0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1127e0 con 0x7fe11c108cf0 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe121ae0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c112ae0 con 0x7fe11c1083a0 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c102a60 0x7fe11c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c102a60 0x7fe11c0ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45272/0 (socket says 172.21.15.7:45272) 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe11b7fe640 1 -- 172.21.15.7:0/1234524160 learned_addr learned my addr 172.21.15.7:0/1234524160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe11bfff640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe11c108cf0 0x7fe11c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe11affd640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe11c1083a0 0x7fe11c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe11b7fe640 1 -- 172.21.15.7:0/1234524160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe11c1083a0 msgr2=0x7fe11c0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe11c1083a0 0x7fe11c0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe11b7fe640 1 -- 172.21.15.7:0/1234524160 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe11c108cf0 msgr2=0x7fe11c1000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.693+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe11c108cf0 0x7fe11c1000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.694+0000 7fe11b7fe640 1 -- 172.21.15.7:0/1234524160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11c1a86e0 con 0x7fe11c102a60 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.694+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c102a60 0x7fe11c0ff670 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c890 tx=0x7fe10c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.694+0000 7fe118ff9640 1 -- 172.21.15.7:0/1234524160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c004220 con 0x7fe11c102a60 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.694+0000 7fe118ff9640 1 -- 172.21.15.7:0/1234524160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe10c0043c0 con 0x7fe11c102a60 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.694+0000 7fe118ff9640 1 -- 172.21.15.7:0/1234524160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c004a00 con 0x7fe11c102a60 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.694+0000 7fe121ae0640 1 -- 172.21.15.7:0/1234524160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe11c1a89d0 con 0x7fe11c102a60 2024-09-21T05:53:27.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.694+0000 7fe121ae0640 1 -- 172.21.15.7:0/1234524160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe11c1a8f60 con 0x7fe11c102a60 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.697+0000 7fe118ff9640 1 -- 172.21.15.7:0/1234524160 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7fe10c0079b0 con 0x7fe11c102a60 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.697+0000 7fe128054740 1 Processor -- start 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.697+0000 7fe128054740 1 -- start start 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.697+0000 7fe128054740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a7cf60 0x559ee0e22f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.697+0000 7fe128054740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e23440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.697+0000 7fe128054740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a5c280 0x559ee0e23980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe128054740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559ee0d9ac10 con 0x559ee0a540a0 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe128054740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559ee0d8a040 con 0x559ee0a7cf60 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe128054740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559ee0d8de50 con 0x559ee0a5c280 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e23440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e23440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45282/0 (socket says 172.21.15.7:45282) 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe11b7fe640 1 -- 172.21.15.7:0/3504897009 learned_addr learned my addr 172.21.15.7:0/3504897009 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe11bfff640 1 --2- 172.21.15.7:0/3504897009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a7cf60 0x559ee0e22f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe11affd640 1 --2- 172.21.15.7:0/3504897009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a5c280 0x559ee0e23980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe11b7fe640 1 -- 172.21.15.7:0/3504897009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a5c280 msgr2=0x559ee0e23980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:27.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe118ff9640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe1040b65e0 0x7fe1040b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/3504897009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a5c280 0x559ee0e23980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe11b7fe640 1 -- 172.21.15.7:0/3504897009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a7cf60 msgr2=0x559ee0e22f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:27.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/3504897009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a7cf60 0x559ee0e22f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe11b7fe640 1 -- 172.21.15.7:0/3504897009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ee0ae8540 con 0x559ee0a540a0 2024-09-21T05:53:27.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe11bfff640 1 --2- 172.21.15.7:0/3504897009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a7cf60 0x559ee0e22f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:27.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe11bfff640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe1040b65e0 0x7fe1040b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/3504897009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e23440 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0ba4b0 tx=0x7fe10c0ad3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f191d60874b201e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:27.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.698+0000 7fe118ff9640 1 -- 172.21.15.7:0/1234524160 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fe10c0e7010 con 0x7fe11c102a60 2024-09-21T05:53:27.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.699+0000 7fe101ffb640 1 -- 172.21.15.7:0/3504897009 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c01d070 con 0x559ee0a540a0 2024-09-21T05:53:27.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.699+0000 7fe101ffb640 1 -- 172.21.15.7:0/3504897009 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe10c0ba6e0 con 0x559ee0a540a0 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.699+0000 7fe101ffb640 1 -- 172.21.15.7:0/3504897009 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0acf80 con 0x559ee0a540a0 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.700+0000 7fe128054740 1 -- 172.21.15.7:0/3504897009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 msgr2=0x559ee0e23440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.700+0000 7fe11bfff640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe1040b65e0 0x7fe1040b8af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe114009a60 tx=0x7fe1140095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.700+0000 7fe128054740 1 --2- 172.21.15.7:0/3504897009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e23440 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0ba4b0 tx=0x7fe10c0ad3a0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.700+0000 7fe128054740 1 -- 172.21.15.7:0/3504897009 shutdown_connections 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.700+0000 7fe128054740 1 --2- 172.21.15.7:0/3504897009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e23440 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.700+0000 7fe128054740 1 --2- 172.21.15.7:0/3504897009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a5c280 0x559ee0e23980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.700+0000 7fe128054740 1 --2- 172.21.15.7:0/3504897009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a7cf60 0x559ee0e22f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.700+0000 7fe128054740 1 -- 172.21.15.7:0/3504897009 >> 172.21.15.7:0/3504897009 conn(0x559ee0a71350 msgr2=0x559ee0e20df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.700+0000 7fe128054740 1 -- 172.21.15.7:0/3504897009 shutdown_connections 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.700+0000 7fe128054740 1 -- 172.21.15.7:0/3504897009 wait complete. 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.700+0000 7fe128054740 1 -- start start 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.700+0000 7fe128054740 1 Processor -- start 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe128054740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e2e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe128054740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a5c280 0x559ee0e2ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe128054740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a7cf60 0x559ee0e3a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe128054740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559ee0beb5f0 con 0x559ee0a540a0 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe128054740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559ee0d25010 con 0x559ee0a5c280 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e2e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe128054740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559ee0e316e0 con 0x559ee0a7cf60 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e2e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45294/0 (socket says 172.21.15.7:45294) 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe11b7fe640 1 -- 172.21.15.7:0/932426090 learned_addr learned my addr 172.21.15.7:0/932426090 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe128054740 10 client.0 _ll_register_callbacks cb 0x559ee0d84340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe11bfff640 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a7cf60 0x559ee0e3a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe11affd640 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a5c280 0x559ee0e2ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe11b7fe640 1 -- 172.21.15.7:0/932426090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a7cf60 msgr2=0x559ee0e3a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a7cf60 0x559ee0e3a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe11b7fe640 1 -- 172.21.15.7:0/932426090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a5c280 msgr2=0x559ee0e2ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:27.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a5c280 0x559ee0e2ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe11b7fe640 1 -- 172.21.15.7:0/932426090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ee0d52a00 con 0x559ee0a540a0 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe11bfff640 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a7cf60 0x559ee0e3a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e2e760 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0aa420 tx=0x7fe10c0a89e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6ffd79dd17704f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe0faffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.701+0000 7fe0faffd640 1 -- 172.21.15.7:0/932426090 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c01d030 con 0x559ee0a540a0 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.702+0000 7fe0faffd640 1 -- 172.21.15.7:0/932426090 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fe10c0ad410 con 0x559ee0a540a0 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.702+0000 7fe128054740 1 -- 172.21.15.7:0/932426090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559ee0d9cb60 con 0x559ee0a540a0 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.702+0000 7fe0faffd640 1 -- 172.21.15.7:0/932426090 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe10c0ba4e0 con 0x559ee0a540a0 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.702+0000 7fe128054740 10 client.15354 fetch_fsmap learned FSMap version 24 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.702+0000 7fe128054740 1 -- 172.21.15.7:0/932426090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559ee0e3d550 con 0x559ee0a540a0 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.702+0000 7fe0faffd640 1 -- 172.21.15.7:0/932426090 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559ee0d9cb60 con 0x559ee0a540a0 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.702+0000 7fe0faffd640 1 -- 172.21.15.7:0/932426090 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe10c0b6690 con 0x559ee0a540a0 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.702+0000 7fe128054740 10 client.15354 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T05:53:27.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.702+0000 7fe128054740 10 client.15354 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.702+0000 7fe128054740 20 client.15354 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.702+0000 7fe128054740 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559ee0a3b8e0 0x559ee0e40a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.702+0000 7fe128054740 4 client.15354 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.702+0000 7fe128054740 1 -- 172.21.15.7:0/932426090 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ee0d98610 con 0x559ee0a3b8e0 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.703+0000 7fe11affd640 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559ee0a3b8e0 0x559ee0e40a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.703+0000 7fe11affd640 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559ee0a3b8e0 0x559ee0e40a00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7b62bcf7313f0cda server_cookie=4b26e1ec9edaa78c in_seq=0 out_seq=0 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.703+0000 7fe0faffd640 10 client.15354 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe0faffd640 1 -- 172.21.15.7:0/932426090 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559ee0d98610 con 0x559ee0a3b8e0 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe0faffd640 10 client.15354 handle_command_reply: tid=0 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe128054740 1 client.15354 shutdown 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe128054740 1 -- 172.21.15.7:0/932426090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 msgr2=0x559ee0e2e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe128054740 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e2e760 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0aa420 tx=0x7fe10c0a89e0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe128054740 1 -- 172.21.15.7:0/932426090 shutdown_connections 2024-09-21T05:53:27.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe128054740 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559ee0a3b8e0 0x559ee0e40a00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe128054740 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a7cf60 0x559ee0e3a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe128054740 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a5c280 0x559ee0e2ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe128054740 1 --2- 172.21.15.7:0/932426090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e2e760 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe0faffd640 0 client.15354 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:53:27.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe128054740 1 -- 172.21.15.7:0/932426090 >> 172.21.15.7:0/932426090 conn(0x559ee0a71350 msgr2=0x559ee0e26090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:27.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe128054740 1 -- 172.21.15.7:0/932426090 shutdown_connections 2024-09-21T05:53:27.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.704+0000 7fe128054740 1 -- 172.21.15.7:0/932426090 wait complete. 2024-09-21T05:53:27.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.705+0000 7fe128054740 20 client.15354 trim_cache size 0 max 16384 2024-09-21T05:53:27.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe128054740 1 Processor -- start 2024-09-21T05:53:27.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe128054740 1 -- start start 2024-09-21T05:53:27.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe128054740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e29020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe128054740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a5c280 0x559ee0e20c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe128054740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a7cf60 0x559ee0e30390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe128054740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559ee0e3ed40 con 0x559ee0a540a0 2024-09-21T05:53:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe128054740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559ee0e3f410 con 0x559ee0a7cf60 2024-09-21T05:53:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe128054740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559ee0e3fae0 con 0x559ee0a5c280 2024-09-21T05:53:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e29020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e29020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45310/0 (socket says 172.21.15.7:45310) 2024-09-21T05:53:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe11b7fe640 1 -- 172.21.15.7:0/429262774 learned_addr learned my addr 172.21.15.7:0/429262774 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe11bfff640 1 --2- 172.21.15.7:0/429262774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a7cf60 0x559ee0e30390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe11affd640 1 --2- 172.21.15.7:0/429262774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a5c280 0x559ee0e20c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe11b7fe640 1 -- 172.21.15.7:0/429262774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a5c280 msgr2=0x559ee0e20c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/429262774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a5c280 0x559ee0e20c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe11b7fe640 1 -- 172.21.15.7:0/429262774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a7cf60 msgr2=0x559ee0e30390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/429262774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a7cf60 0x559ee0e30390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe11b7fe640 1 -- 172.21.15.7:0/429262774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ee0d89fd0 con 0x559ee0a540a0 2024-09-21T05:53:27.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.723+0000 7fe11bfff640 1 --2- 172.21.15.7:0/429262774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a7cf60 0x559ee0e30390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:27.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.724+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/429262774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e29020 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0aceb0 tx=0x7fe10c007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679b01cec4bce3b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.724+0000 7fe1017fa640 1 -- 172.21.15.7:0/429262774 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c01d040 con 0x559ee0a540a0 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.724+0000 7fe1017fa640 1 -- 172.21.15.7:0/429262774 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe10c005290 con 0x559ee0a540a0 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.724+0000 7fe1017fa640 1 -- 172.21.15.7:0/429262774 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0ac920 con 0x559ee0a540a0 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.724+0000 7fe128054740 1 -- 172.21.15.7:0/429262774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 msgr2=0x559ee0e29020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.724+0000 7fe128054740 1 --2- 172.21.15.7:0/429262774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e29020 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0aceb0 tx=0x7fe10c007eb0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.725+0000 7fe128054740 1 -- 172.21.15.7:0/429262774 shutdown_connections 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.725+0000 7fe128054740 1 --2- 172.21.15.7:0/429262774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a7cf60 0x559ee0e30390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.725+0000 7fe128054740 1 --2- 172.21.15.7:0/429262774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a5c280 0x559ee0e20c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.725+0000 7fe128054740 1 --2- 172.21.15.7:0/429262774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a540a0 0x559ee0e29020 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.725+0000 7fe128054740 1 -- 172.21.15.7:0/429262774 >> 172.21.15.7:0/429262774 conn(0x559ee0a71350 msgr2=0x559ee0e2fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.725+0000 7fe128054740 1 -- 172.21.15.7:0/429262774 shutdown_connections 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.725+0000 7fe128054740 1 -- 172.21.15.7:0/429262774 wait complete. 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.725+0000 7fe128054740 1 -- start start 2024-09-21T05:53:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.725+0000 7fe128054740 1 Processor -- start 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe128054740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a540a0 0x559ee0e496f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe128054740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a5c280 0x559ee0e42c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe128054740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a7cf60 0x559ee0e43350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe128054740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559ee0e40880 con 0x559ee0a7cf60 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe128054740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559ee0e401b0 con 0x559ee0a5c280 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe128054740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559ee0e40f50 con 0x559ee0a540a0 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe128054740 10 client.0 _ll_register_callbacks cb 0x7fe114009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe11bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a7cf60 0x559ee0e43350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe11bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a7cf60 0x559ee0e43350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45326/0 (socket says 172.21.15.7:45326) 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe11bfff640 1 -- 172.21.15.7:0/259784971 learned_addr learned my addr 172.21.15.7:0/259784971 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a540a0 0x559ee0e496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe11affd640 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a5c280 0x559ee0e42c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe11bfff640 1 -- 172.21.15.7:0/259784971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a540a0 msgr2=0x559ee0e496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe11bfff640 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a540a0 0x559ee0e496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe11bfff640 1 -- 172.21.15.7:0/259784971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a5c280 msgr2=0x559ee0e42c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe11bfff640 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a5c280 0x559ee0e42c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe11bfff640 1 -- 172.21.15.7:0/259784971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ee0e48330 con 0x559ee0a7cf60 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe11affd640 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a5c280 0x559ee0e42c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe11bfff640 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a7cf60 0x559ee0e43350 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe114035000 tx=0x7fe114042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e181a53e870c7904 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.726+0000 7fe0faffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe0faffd640 1 -- 172.21.15.7:0/259784971 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe114059060 con 0x559ee0a7cf60 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe0faffd640 1 -- 172.21.15.7:0/259784971 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fe114004040 con 0x559ee0a7cf60 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe128054740 1 -- 172.21.15.7:0/259784971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559ee0d95a40 con 0x559ee0a7cf60 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe0faffd640 1 -- 172.21.15.7:0/259784971 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe114004240 con 0x559ee0a7cf60 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe128054740 10 client.15360 fetch_fsmap learned FSMap version 24 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe128054740 1 -- 172.21.15.7:0/259784971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559ee0eac0c0 con 0x559ee0a7cf60 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe0faffd640 1 -- 172.21.15.7:0/259784971 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559ee0d95a40 con 0x559ee0a7cf60 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe0faffd640 1 -- 172.21.15.7:0/259784971 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe11402fd40 con 0x559ee0a7cf60 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe128054740 10 client.15360 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T05:53:27.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe128054740 10 client.15360 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe128054740 20 client.15360 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe128054740 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559ee0a10c90 0x559ee0eaf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe128054740 4 client.15360 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe128054740 1 -- 172.21.15.7:0/259784971 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "status"}) -- 0x559ee0d0b950 con 0x559ee0a10c90 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.727+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559ee0a10c90 0x559ee0eaf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe11b7fe640 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559ee0a10c90 0x559ee0eaf9b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9b26aef9a4baecf5 server_cookie=be0841aaa8004c8c in_seq=0 out_seq=0 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe0faffd640 10 client.15360 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe0faffd640 1 -- 172.21.15.7:0/259784971 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559ee0d0b950 con 0x559ee0a10c90 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe0faffd640 10 client.15360 handle_command_reply: tid=0 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe128054740 1 client.15360 shutdown 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe128054740 1 -- 172.21.15.7:0/259784971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a7cf60 msgr2=0x559ee0e43350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe128054740 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a7cf60 0x559ee0e43350 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe114035000 tx=0x7fe114042000 comp rx=0 tx=0).stop 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe128054740 1 -- 172.21.15.7:0/259784971 shutdown_connections 2024-09-21T05:53:27.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe128054740 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559ee0a10c90 0x559ee0eaf9b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe128054740 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559ee0a7cf60 0x559ee0e43350 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe128054740 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559ee0a5c280 0x559ee0e42c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe0faffd640 0 client.15360 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:53:27.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe128054740 1 --2- 172.21.15.7:0/259784971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559ee0a540a0 0x559ee0e496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.728+0000 7fe128054740 1 -- 172.21.15.7:0/259784971 >> 172.21.15.7:0/259784971 conn(0x559ee0a71350 msgr2=0x559ee0e2fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:27.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe128054740 1 -- 172.21.15.7:0/259784971 shutdown_connections 2024-09-21T05:53:27.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe128054740 1 -- 172.21.15.7:0/259784971 wait complete. 2024-09-21T05:53:27.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe128054740 20 client.15360 trim_cache size 0 max 16384 2024-09-21T05:53:27.735 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:53:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "397810bc-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:53:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-09-21T05:53:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24686, 2024-09-21T05:53:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-21T05:53:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-21T05:53:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-21T05:53:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 89.424760562000003, 2024-09-21T05:53:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-21T05:53:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 75, 2024-09-21T05:53:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T05:53:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 107.657538766 2024-09-21T05:53:27.736 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:53:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe121ae0640 1 -- 172.21.15.7:0/1234524160 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe1040b65e0 msgr2=0x7fe1040b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe121ae0640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe1040b65e0 0x7fe1040b8af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe114009a60 tx=0x7fe1140095c0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe121ae0640 1 -- 172.21.15.7:0/1234524160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c102a60 msgr2=0x7fe11c0ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe121ae0640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c102a60 0x7fe11c0ff670 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c890 tx=0x7fe10c00cd50 comp rx=0 tx=0).stop 2024-09-21T05:53:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe121ae0640 1 -- 172.21.15.7:0/1234524160 shutdown_connections 2024-09-21T05:53:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe121ae0640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe1040b65e0 0x7fe1040b8af0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe121ae0640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe11c108cf0 0x7fe11c1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe121ae0640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe11c1083a0 0x7fe11c0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe121ae0640 1 --2- 172.21.15.7:0/1234524160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c102a60 0x7fe11c0ff670 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe121ae0640 1 -- 172.21.15.7:0/1234524160 >> 172.21.15.7:0/1234524160 conn(0x7fe11c079730 msgr2=0x7fe11c06b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe121ae0640 1 -- 172.21.15.7:0/1234524160 shutdown_connections 2024-09-21T05:53:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:27.729+0000 7fe121ae0640 1 -- 172.21.15.7:0/1234524160 wait complete. 2024-09-21T05:53:27.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:27 smithi007 ceph-mon[30983]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T05:53:27.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:27 smithi027 ceph-mon[34364]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T05:53:28.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:27 smithi119 ceph-mon[34833]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T05:53:28.267 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T05:53:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.023+0000 7f9a29bef640 1 -- 172.21.15.7:0/1288317203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a24108420 msgr2=0x7f9a24108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.023+0000 7f9a29bef640 1 --2- 172.21.15.7:0/1288317203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a24108420 0x7f9a24108830 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009900 tx=0x7f9a1802a410 comp rx=0 tx=0).stop 2024-09-21T05:53:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.023+0000 7f9a29bef640 1 -- 172.21.15.7:0/1288317203 shutdown_connections 2024-09-21T05:53:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.023+0000 7f9a29bef640 1 --2- 172.21.15.7:0/1288317203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a24108420 0x7f9a24108830 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.023+0000 7f9a29bef640 1 --2- 172.21.15.7:0/1288317203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a24108d70 0x7f9a2410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.023+0000 7f9a29bef640 1 --2- 172.21.15.7:0/1288317203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24102ae0 0x7f9a24102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.023+0000 7f9a29bef640 1 -- 172.21.15.7:0/1288317203 >> 172.21.15.7:0/1288317203 conn(0x7f9a24079770 msgr2=0x7f9a24079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.023+0000 7f9a29bef640 1 -- 172.21.15.7:0/1288317203 shutdown_connections 2024-09-21T05:53:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.023+0000 7f9a29bef640 1 -- 172.21.15.7:0/1288317203 wait complete. 2024-09-21T05:53:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.024+0000 7f9a29bef640 1 Processor -- start 2024-09-21T05:53:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.024+0000 7f9a29bef640 1 -- start start 2024-09-21T05:53:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.024+0000 7f9a29bef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24102ae0 0x7f9a2419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.024+0000 7f9a29bef640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a24108420 0x7f9a2419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.024+0000 7f9a29bef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a24108d70 0x7f9a2419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.024+0000 7f9a29bef640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9a24113b50 con 0x7f9a24108d70 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.024+0000 7f9a29bef640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9a241139d0 con 0x7f9a24108420 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.024+0000 7f9a29bef640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9a24113cd0 con 0x7f9a24102ae0 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.024+0000 7f9a23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a24108d70 0x7f9a2419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.024+0000 7f9a23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a24108d70 0x7f9a2419fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59200/0 (socket says 172.21.15.7:59200) 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.024+0000 7f9a23fff640 1 -- 172.21.15.7:0/2041313096 learned_addr learned my addr 172.21.15.7:0/2041313096 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.024+0000 7f9a237fe640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24102ae0 0x7f9a2419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.024+0000 7f9a22ffd640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a24108420 0x7f9a2419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.025+0000 7f9a23fff640 1 -- 172.21.15.7:0/2041313096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24102ae0 msgr2=0x7f9a2419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.025+0000 7f9a23fff640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24102ae0 0x7f9a2419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.025+0000 7f9a23fff640 1 -- 172.21.15.7:0/2041313096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a24108420 msgr2=0x7f9a2419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.025+0000 7f9a23fff640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a24108420 0x7f9a2419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.025+0000 7f9a23fff640 1 -- 172.21.15.7:0/2041313096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a241a0530 con 0x7f9a24108d70 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.025+0000 7f9a23fff640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a24108d70 0x7f9a2419fe00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00eaa0 tx=0x7f9a1c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.025+0000 7f9a20ff9640 1 -- 172.21.15.7:0/2041313096 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00cdb0 con 0x7f9a24108d70 2024-09-21T05:53:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.025+0000 7f9a20ff9640 1 -- 172.21.15.7:0/2041313096 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a1c005020 con 0x7f9a24108d70 2024-09-21T05:53:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.025+0000 7f9a29bef640 1 -- 172.21.15.7:0/2041313096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a241a0820 con 0x7f9a24108d70 2024-09-21T05:53:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.025+0000 7f9a20ff9640 1 -- 172.21.15.7:0/2041313096 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c0116d0 con 0x7f9a24108d70 2024-09-21T05:53:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.025+0000 7f9a29bef640 1 -- 172.21.15.7:0/2041313096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a241a6f80 con 0x7f9a24108d70 2024-09-21T05:53:29.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.028+0000 7f9a30163740 1 Processor -- start 2024-09-21T05:53:29.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.028+0000 7f9a20ff9640 1 -- 172.21.15.7:0/2041313096 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f9a1c0051d0 con 0x7f9a24108d70 2024-09-21T05:53:29.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.028+0000 7f9a30163740 1 -- start start 2024-09-21T05:53:29.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.028+0000 7f9a30163740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f05372f60 0x561f05718f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.028+0000 7f9a30163740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f0534a0a0 0x561f05719440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.028+0000 7f9a30163740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05352280 0x561f05719980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.028+0000 7f9a30163740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561f05690c10 con 0x561f0534a0a0 2024-09-21T05:53:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.028+0000 7f9a30163740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561f05680040 con 0x561f05372f60 2024-09-21T05:53:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.028+0000 7f9a30163740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561f05683e50 con 0x561f05352280 2024-09-21T05:53:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f0534a0a0 0x561f05719440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f0534a0a0 0x561f05719440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59202/0 (socket says 172.21.15.7:59202) 2024-09-21T05:53:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a237fe640 1 -- 172.21.15.7:0/117364066 learned_addr learned my addr 172.21.15.7:0/117364066 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a22ffd640 1 --2- 172.21.15.7:0/117364066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f05372f60 0x561f05718f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a22ffd640 1 --2- 172.21.15.7:0/117364066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05352280 0x561f05719980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a237fe640 1 -- 172.21.15.7:0/117364066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05352280 msgr2=0x561f05719980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a237fe640 1 --2- 172.21.15.7:0/117364066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05352280 0x561f05719980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a237fe640 1 -- 172.21.15.7:0/117364066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f05372f60 msgr2=0x561f05718f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a237fe640 1 --2- 172.21.15.7:0/117364066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f05372f60 0x561f05718f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a237fe640 1 -- 172.21.15.7:0/117364066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f053de540 con 0x561f0534a0a0 2024-09-21T05:53:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a22ffd640 1 --2- 172.21.15.7:0/117364066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f05372f60 0x561f05718f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a237fe640 1 --2- 172.21.15.7:0/117364066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f0534a0a0 0x561f05719440 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400b760 tx=0x7f9a1400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26722da18a90953 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a20ff9640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9a0c0b6560 0x7f9a0c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a09ffb640 1 -- 172.21.15.7:0/117364066 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14003dd0 con 0x561f0534a0a0 2024-09-21T05:53:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a22ffd640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9a0c0b6560 0x7f9a0c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a09ffb640 1 -- 172.21.15.7:0/117364066 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a14015070 con 0x561f0534a0a0 2024-09-21T05:53:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a09ffb640 1 -- 172.21.15.7:0/117364066 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14004d90 con 0x561f0534a0a0 2024-09-21T05:53:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.029+0000 7f9a20ff9640 1 -- 172.21.15.7:0/2041313096 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9a1c0e7490 con 0x7f9a24108d70 2024-09-21T05:53:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.030+0000 7f9a30163740 1 -- 172.21.15.7:0/117364066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f0534a0a0 msgr2=0x561f05719440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.030+0000 7f9a22ffd640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9a0c0b6560 0x7f9a0c0b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009230 tx=0x7f9a18000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.030+0000 7f9a30163740 1 --2- 172.21.15.7:0/117364066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f0534a0a0 0x561f05719440 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400b760 tx=0x7f9a1400bc20 comp rx=0 tx=0).stop 2024-09-21T05:53:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.030+0000 7f9a30163740 1 -- 172.21.15.7:0/117364066 shutdown_connections 2024-09-21T05:53:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.030+0000 7f9a30163740 1 --2- 172.21.15.7:0/117364066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f0534a0a0 0x561f05719440 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.030+0000 7f9a30163740 1 --2- 172.21.15.7:0/117364066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05352280 0x561f05719980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.030+0000 7f9a30163740 1 --2- 172.21.15.7:0/117364066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f05372f60 0x561f05718f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.030+0000 7f9a30163740 1 -- 172.21.15.7:0/117364066 >> 172.21.15.7:0/117364066 conn(0x561f05367350 msgr2=0x561f05716df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.030+0000 7f9a30163740 1 -- 172.21.15.7:0/117364066 shutdown_connections 2024-09-21T05:53:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.030+0000 7f9a30163740 1 -- 172.21.15.7:0/117364066 wait complete. 2024-09-21T05:53:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.031+0000 7f9a30163740 1 -- start start 2024-09-21T05:53:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.031+0000 7f9a30163740 1 Processor -- start 2024-09-21T05:53:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.031+0000 7f9a30163740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05724a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.031+0000 7f9a30163740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05352280 0x561f05724f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.031+0000 7f9a30163740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05372f60 0x561f05730a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.031+0000 7f9a30163740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561f054e15f0 con 0x561f05372f60 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.031+0000 7f9a30163740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561f0561b010 con 0x561f0534a0a0 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.031+0000 7f9a30163740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561f057276e0 con 0x561f05352280 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.031+0000 7f9a30163740 10 client.0 _ll_register_callbacks cb 0x561f0567a340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05372f60 0x561f05730a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05372f60 0x561f05730a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59218/0 (socket says 172.21.15.7:59218) 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a23fff640 1 -- 172.21.15.7:0/2466264339 learned_addr learned my addr 172.21.15.7:0/2466264339 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a237fe640 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05724a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a22ffd640 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05352280 0x561f05724f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a23fff640 1 -- 172.21.15.7:0/2466264339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05352280 msgr2=0x561f05724f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a23fff640 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05352280 0x561f05724f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a23fff640 1 -- 172.21.15.7:0/2466264339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 msgr2=0x561f05724a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a23fff640 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05724a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a23fff640 1 -- 172.21.15.7:0/2466264339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f05648a00 con 0x561f05372f60 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a237fe640 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05724a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a23fff640 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05372f60 0x561f05730a00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0ad330 tx=0x7f9a1c0ace10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce7cdb91948da6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a02ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a02ffd640 1 -- 172.21.15.7:0/2466264339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c01f040 con 0x561f05372f60 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a02ffd640 1 -- 172.21.15.7:0/2466264339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9a1c0a8f80 con 0x561f05372f60 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a30163740 1 -- 172.21.15.7:0/2466264339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a14015070 con 0x561f05372f60 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a02ffd640 1 -- 172.21.15.7:0/2466264339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9a1c0b6fa0 con 0x561f05372f60 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a30163740 10 client.15372 fetch_fsmap learned FSMap version 24 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.032+0000 7f9a30163740 1 -- 172.21.15.7:0/2466264339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561f05733660 con 0x561f05372f60 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.033+0000 7f9a02ffd640 1 -- 172.21.15.7:0/2466264339 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a14015070 con 0x561f05372f60 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.033+0000 7f9a02ffd640 1 -- 172.21.15.7:0/2466264339 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9a1c00f040 con 0x561f05372f60 2024-09-21T05:53:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.033+0000 7f9a30163740 10 client.15372 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T05:53:29.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.033+0000 7f9a30163740 10 client.15372 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T05:53:29.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.033+0000 7f9a30163740 20 client.15372 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:29.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.033+0000 7f9a30163740 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561f053318e0 0x561f057370b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.033+0000 7f9a30163740 4 client.15372 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:53:29.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.033+0000 7f9a30163740 1 -- 172.21.15.7:0/2466264339 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f05692b60 con 0x561f053318e0 2024-09-21T05:53:29.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.033+0000 7f9a237fe640 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561f053318e0 0x561f057370b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.034+0000 7f9a237fe640 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561f053318e0 0x561f057370b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=913ea8be0c786173 server_cookie=91d071c3507a4e20 in_seq=0 out_seq=0 2024-09-21T05:53:29.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.034+0000 7f9a02ffd640 10 client.15372 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:29.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.034+0000 7f9a02ffd640 1 -- 172.21.15.7:0/2466264339 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561f05692b60 con 0x561f053318e0 2024-09-21T05:53:29.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.034+0000 7f9a02ffd640 10 client.15372 handle_command_reply: tid=0 2024-09-21T05:53:29.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.034+0000 7f9a30163740 1 client.15372 shutdown 2024-09-21T05:53:29.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.035+0000 7f9a30163740 1 -- 172.21.15.7:0/2466264339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05372f60 msgr2=0x561f05730a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.035+0000 7f9a30163740 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05372f60 0x561f05730a00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0ad330 tx=0x7f9a1c0ace10 comp rx=0 tx=0).stop 2024-09-21T05:53:29.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.035+0000 7f9a30163740 1 -- 172.21.15.7:0/2466264339 shutdown_connections 2024-09-21T05:53:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.035+0000 7f9a30163740 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561f053318e0 0x561f057370b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.035+0000 7f9a30163740 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05372f60 0x561f05730a00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.035+0000 7f9a30163740 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05352280 0x561f05724f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.035+0000 7f9a30163740 1 --2- 172.21.15.7:0/2466264339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05724a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.035+0000 7f9a30163740 1 -- 172.21.15.7:0/2466264339 >> 172.21.15.7:0/2466264339 conn(0x561f05367350 msgr2=0x561f0571c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.035+0000 7f9a02ffd640 0 client.15372 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.035+0000 7f9a30163740 1 -- 172.21.15.7:0/2466264339 shutdown_connections 2024-09-21T05:53:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.035+0000 7f9a30163740 1 -- 172.21.15.7:0/2466264339 wait complete. 2024-09-21T05:53:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.035+0000 7f9a30163740 20 client.15372 trim_cache size 0 max 16384 2024-09-21T05:53:29.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.053+0000 7f9a30163740 1 Processor -- start 2024-09-21T05:53:29.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.053+0000 7f9a30163740 1 -- start start 2024-09-21T05:53:29.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a30163740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05730970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a30163740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 0x561f05730eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a30163740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05372f60 0x561f05716600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a30163740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561f057353f0 con 0x561f05352280 2024-09-21T05:53:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a30163740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561f05735ac0 con 0x561f0534a0a0 2024-09-21T05:53:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a30163740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561f05736190 con 0x561f05372f60 2024-09-21T05:53:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a22ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 0x561f05730eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a22ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 0x561f05730eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59220/0 (socket says 172.21.15.7:59220) 2024-09-21T05:53:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a22ffd640 1 -- 172.21.15.7:0/2526637158 learned_addr learned my addr 172.21.15.7:0/2526637158 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a23fff640 1 --2- 172.21.15.7:0/2526637158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05372f60 0x561f05716600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a237fe640 1 --2- 172.21.15.7:0/2526637158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05730970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a22ffd640 1 -- 172.21.15.7:0/2526637158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05372f60 msgr2=0x561f05716600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a22ffd640 1 --2- 172.21.15.7:0/2526637158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05372f60 0x561f05716600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a22ffd640 1 -- 172.21.15.7:0/2526637158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 msgr2=0x561f05730970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a22ffd640 1 --2- 172.21.15.7:0/2526637158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05730970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a22ffd640 1 -- 172.21.15.7:0/2526637158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f05711080 con 0x561f05352280 2024-09-21T05:53:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a237fe640 1 --2- 172.21.15.7:0/2526637158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05730970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a23fff640 1 --2- 172.21.15.7:0/2526637158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05372f60 0x561f05716600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.054+0000 7f9a22ffd640 1 --2- 172.21.15.7:0/2526637158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 0x561f05730eb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009900 tx=0x7f9a1803f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dda8070d10e9a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.055+0000 7f9a097fa640 1 -- 172.21.15.7:0/2526637158 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a18035040 con 0x561f05352280 2024-09-21T05:53:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.055+0000 7f9a097fa640 1 -- 172.21.15.7:0/2526637158 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a1803dc10 con 0x561f05352280 2024-09-21T05:53:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.055+0000 7f9a097fa640 1 -- 172.21.15.7:0/2526637158 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a18003830 con 0x561f05352280 2024-09-21T05:53:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.055+0000 7f9a30163740 1 -- 172.21.15.7:0/2526637158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 msgr2=0x561f05730eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.055+0000 7f9a30163740 1 --2- 172.21.15.7:0/2526637158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 0x561f05730eb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009900 tx=0x7f9a1803f070 comp rx=0 tx=0).stop 2024-09-21T05:53:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.055+0000 7f9a30163740 1 -- 172.21.15.7:0/2526637158 shutdown_connections 2024-09-21T05:53:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.055+0000 7f9a30163740 1 --2- 172.21.15.7:0/2526637158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 0x561f05730eb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.055+0000 7f9a30163740 1 --2- 172.21.15.7:0/2526637158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05372f60 0x561f05716600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.055+0000 7f9a30163740 1 --2- 172.21.15.7:0/2526637158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05730970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.055+0000 7f9a30163740 1 -- 172.21.15.7:0/2526637158 >> 172.21.15.7:0/2526637158 conn(0x561f05367350 msgr2=0x561f05723080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.055+0000 7f9a30163740 1 -- 172.21.15.7:0/2526637158 shutdown_connections 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.055+0000 7f9a30163740 1 -- 172.21.15.7:0/2526637158 wait complete. 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.056+0000 7f9a30163740 1 -- start start 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.056+0000 7f9a30163740 1 Processor -- start 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.056+0000 7f9a30163740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05739400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.056+0000 7f9a30163740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 0x561f05739940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.056+0000 7f9a30163740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05372f60 0x561f05739e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.056+0000 7f9a30163740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561f05736f30 con 0x561f05352280 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.056+0000 7f9a30163740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561f05736860 con 0x561f0534a0a0 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.056+0000 7f9a30163740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561f05737600 con 0x561f05372f60 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.056+0000 7f9a30163740 10 client.0 _ll_register_callbacks cb 0x7f9a1c00cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a22ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 0x561f05739940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a22ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 0x561f05739940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59232/0 (socket says 172.21.15.7:59232) 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a22ffd640 1 -- 172.21.15.7:0/3758429044 learned_addr learned my addr 172.21.15.7:0/3758429044 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a237fe640 1 --2- 172.21.15.7:0/3758429044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05739400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a23fff640 1 --2- 172.21.15.7:0/3758429044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05372f60 0x561f05739e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a22ffd640 1 -- 172.21.15.7:0/3758429044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05372f60 msgr2=0x561f05739e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a22ffd640 1 --2- 172.21.15.7:0/3758429044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05372f60 0x561f05739e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a22ffd640 1 -- 172.21.15.7:0/3758429044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 msgr2=0x561f05739400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a22ffd640 1 --2- 172.21.15.7:0/3758429044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05739400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a22ffd640 1 -- 172.21.15.7:0/3758429044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f0573ebc0 con 0x561f05352280 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a22ffd640 1 --2- 172.21.15.7:0/3758429044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 0x561f05739940 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9a1802a930 tx=0x7f9a1803df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd852f45efd10c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a02ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a02ffd640 1 -- 172.21.15.7:0/3758429044 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a18035040 con 0x561f05352280 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a02ffd640 1 -- 172.21.15.7:0/3758429044 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9a18060480 con 0x561f05352280 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a30163740 1 -- 172.21.15.7:0/3758429044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a1803dc10 con 0x561f05352280 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.057+0000 7f9a02ffd640 1 -- 172.21.15.7:0/3758429044 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9a18060680 con 0x561f05352280 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.058+0000 7f9a30163740 10 client.15378 fetch_fsmap learned FSMap version 24 2024-09-21T05:53:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.058+0000 7f9a30163740 1 -- 172.21.15.7:0/3758429044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561f057a2870 con 0x561f05352280 2024-09-21T05:53:29.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.058+0000 7f9a02ffd640 1 -- 172.21.15.7:0/3758429044 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a1803dc10 con 0x561f05352280 2024-09-21T05:53:29.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.058+0000 7f9a02ffd640 1 -- 172.21.15.7:0/3758429044 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9a1806a8f0 con 0x561f05352280 2024-09-21T05:53:29.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.058+0000 7f9a30163740 10 client.15378 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T05:53:29.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.058+0000 7f9a30163740 10 client.15378 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T05:53:29.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.058+0000 7f9a30163740 20 client.15378 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:29.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.058+0000 7f9a30163740 1 --2- 172.21.15.7:0/3758429044 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561f05306c90 0x561f057a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.058+0000 7f9a30163740 4 client.15378 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:53:29.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.058+0000 7f9a30163740 1 -- 172.21.15.7:0/3758429044 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "status"}) -- 0x561f0568e610 con 0x561f05306c90 2024-09-21T05:53:29.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.058+0000 7f9a237fe640 1 --2- 172.21.15.7:0/3758429044 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561f05306c90 0x561f057a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a237fe640 1 --2- 172.21.15.7:0/3758429044 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561f05306c90 0x561f057a5d50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52ff1a4588308452 server_cookie=8990b7ead1f481ef in_seq=0 out_seq=0 2024-09-21T05:53:29.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a02ffd640 10 client.15378 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:29.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a02ffd640 1 -- 172.21.15.7:0/3758429044 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561f0568e610 con 0x561f05306c90 2024-09-21T05:53:29.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a02ffd640 10 client.15378 handle_command_reply: tid=0 2024-09-21T05:53:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a30163740 1 client.15378 shutdown 2024-09-21T05:53:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a30163740 1 -- 172.21.15.7:0/3758429044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 msgr2=0x561f05739940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a30163740 1 --2- 172.21.15.7:0/3758429044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 0x561f05739940 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9a1802a930 tx=0x7f9a1803df30 comp rx=0 tx=0).stop 2024-09-21T05:53:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a30163740 1 -- 172.21.15.7:0/3758429044 shutdown_connections 2024-09-21T05:53:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a30163740 1 --2- 172.21.15.7:0/3758429044 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561f05306c90 0x561f057a5d50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a30163740 1 --2- 172.21.15.7:0/3758429044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f05352280 0x561f05739940 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a30163740 1 --2- 172.21.15.7:0/3758429044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561f05372f60 0x561f05739e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a30163740 1 --2- 172.21.15.7:0/3758429044 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561f0534a0a0 0x561f05739400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a30163740 1 -- 172.21.15.7:0/3758429044 >> 172.21.15.7:0/3758429044 conn(0x561f05367350 msgr2=0x561f0571c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a02ffd640 0 client.15378 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a30163740 1 -- 172.21.15.7:0/3758429044 shutdown_connections 2024-09-21T05:53:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a30163740 1 -- 172.21.15.7:0/3758429044 wait complete. 2024-09-21T05:53:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.059+0000 7f9a30163740 20 client.15378 trim_cache size 0 max 16384 2024-09-21T05:53:29.067 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:53:29.067 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "397810bc-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:53:29.067 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-21T05:53:29.067 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24691, 2024-09-21T05:53:29.067 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-21T05:53:29.067 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-21T05:53:29.067 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-21T05:53:29.067 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 97.803909544999996, 2024-09-21T05:53:29.067 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-21T05:53:29.067 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 75, 2024-09-21T05:53:29.067 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T05:53:29.067 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 116.83162983299999 2024-09-21T05:53:29.068 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:53:29.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.060+0000 7f9a29bef640 1 -- 172.21.15.7:0/2041313096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9a0c0b6560 msgr2=0x7f9a0c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.060+0000 7f9a29bef640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9a0c0b6560 0x7f9a0c0b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009230 tx=0x7f9a18000bc0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.060+0000 7f9a29bef640 1 -- 172.21.15.7:0/2041313096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a24108d70 msgr2=0x7f9a2419fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.060+0000 7f9a29bef640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a24108d70 0x7f9a2419fe00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00eaa0 tx=0x7f9a1c00ef60 comp rx=0 tx=0).stop 2024-09-21T05:53:29.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.060+0000 7f9a29bef640 1 -- 172.21.15.7:0/2041313096 shutdown_connections 2024-09-21T05:53:29.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.060+0000 7f9a29bef640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9a0c0b6560 0x7f9a0c0b8a70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.060+0000 7f9a29bef640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a24108d70 0x7f9a2419fe00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.060+0000 7f9a29bef640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a24108420 0x7f9a2419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.060+0000 7f9a29bef640 1 --2- 172.21.15.7:0/2041313096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a24102ae0 0x7f9a2419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.060+0000 7f9a29bef640 1 -- 172.21.15.7:0/2041313096 >> 172.21.15.7:0/2041313096 conn(0x7f9a24079770 msgr2=0x7f9a24104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:29.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.060+0000 7f9a29bef640 1 -- 172.21.15.7:0/2041313096 shutdown_connections 2024-09-21T05:53:29.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:29.060+0000 7f9a29bef640 1 -- 172.21.15.7:0/2041313096 wait complete. 2024-09-21T05:53:29.752 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T05:53:29.778 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T05:53:29.778 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T05:53:29.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:29.778 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-21T05:53:29.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:29.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-09-21T05:53:29.868 INFO:teuthology.orchestra.run.smithi007.stderr:Cannot find device "ceph-brx" 2024-09-21T05:53:29.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:53:29.869 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-21T05:53:29.870 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T05:53:29.870 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:29.870 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T05:53:29.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:29 smithi007 ceph-mon[30983]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T05:53:29.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:29 smithi027 ceph-mon[34364]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T05:53:30.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:29 smithi119 ceph-mon[34833]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T05:53:30.169 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.648+0000 7fa6a001e640 1 -- 172.21.15.7:0/3332682232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6981083a0 msgr2=0x7fa6981087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.648+0000 7fa6a001e640 1 --2- 172.21.15.7:0/3332682232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6981083a0 0x7fa6981087b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa688009900 tx=0x7fa68802a410 comp rx=0 tx=0).stop 2024-09-21T05:53:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.648+0000 7fa6a001e640 1 -- 172.21.15.7:0/3332682232 shutdown_connections 2024-09-21T05:53:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.648+0000 7fa6a001e640 1 --2- 172.21.15.7:0/3332682232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6981083a0 0x7fa6981087b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.648+0000 7fa6a001e640 1 --2- 172.21.15.7:0/3332682232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa698108cf0 0x7fa69810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.648+0000 7fa6a001e640 1 --2- 172.21.15.7:0/3332682232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa698102a60 0x7fa698102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.648+0000 7fa6a001e640 1 -- 172.21.15.7:0/3332682232 >> 172.21.15.7:0/3332682232 conn(0x7fa698079730 msgr2=0x7fa698079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.648+0000 7fa6a001e640 1 -- 172.21.15.7:0/3332682232 shutdown_connections 2024-09-21T05:53:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.648+0000 7fa6a001e640 1 -- 172.21.15.7:0/3332682232 wait complete. 2024-09-21T05:53:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.649+0000 7fa6a001e640 1 Processor -- start 2024-09-21T05:53:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.649+0000 7fa6a001e640 1 -- start start 2024-09-21T05:53:30.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.649+0000 7fa6a001e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa698102a60 0x7fa69819b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:30.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.649+0000 7fa6a001e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6981083a0 0x7fa69819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:30.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.649+0000 7fa6a001e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa698108cf0 0x7fa69819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:30.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.649+0000 7fa6a001e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa698112960 con 0x7fa6981083a0 2024-09-21T05:53:30.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.649+0000 7fa6a001e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa6981127e0 con 0x7fa698108cf0 2024-09-21T05:53:30.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.649+0000 7fa6a001e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa698112ae0 con 0x7fa698102a60 2024-09-21T05:53:30.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.649+0000 7fa69d5b9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6981083a0 0x7fa69819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:30.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.649+0000 7fa69d5b9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6981083a0 0x7fa69819b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59250/0 (socket says 172.21.15.7:59250) 2024-09-21T05:53:30.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.649+0000 7fa69d5b9640 1 -- 172.21.15.7:0/1261839161 learned_addr learned my addr 172.21.15.7:0/1261839161 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:30.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.650+0000 7fa69e5bb640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa698108cf0 0x7fa69819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.650+0000 7fa69ddba640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa698102a60 0x7fa69819b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.650+0000 7fa69d5b9640 1 -- 172.21.15.7:0/1261839161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa698102a60 msgr2=0x7fa69819b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.650+0000 7fa69d5b9640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa698102a60 0x7fa69819b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.650+0000 7fa69d5b9640 1 -- 172.21.15.7:0/1261839161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa698108cf0 msgr2=0x7fa69819bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.650+0000 7fa69d5b9640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa698108cf0 0x7fa69819bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.650+0000 7fa69d5b9640 1 -- 172.21.15.7:0/1261839161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6981a65c0 con 0x7fa6981083a0 2024-09-21T05:53:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.650+0000 7fa69d5b9640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6981083a0 0x7fa69819b7f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa688032fd0 tx=0x7fa688004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.650+0000 7fa68effd640 1 -- 172.21.15.7:0/1261839161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68803f030 con 0x7fa6981083a0 2024-09-21T05:53:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.650+0000 7fa68effd640 1 -- 172.21.15.7:0/1261839161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa688004490 con 0x7fa6981083a0 2024-09-21T05:53:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.650+0000 7fa6a001e640 1 -- 172.21.15.7:0/1261839161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6981a6850 con 0x7fa6981083a0 2024-09-21T05:53:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.650+0000 7fa68effd640 1 -- 172.21.15.7:0/1261839161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688035070 con 0x7fa6981083a0 2024-09-21T05:53:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.650+0000 7fa6a001e640 1 -- 172.21.15.7:0/1261839161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6981a6d30 con 0x7fa6981083a0 2024-09-21T05:53:30.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.651+0000 7fa6a001e640 1 -- 172.21.15.7:0/1261839161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa698102e70 con 0x7fa6981083a0 2024-09-21T05:53:30.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.653+0000 7fa68effd640 1 -- 172.21.15.7:0/1261839161 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7fa688042030 con 0x7fa6981083a0 2024-09-21T05:53:30.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.654+0000 7fa68effd640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa6840b6560 0x7fa6840b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:30.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.654+0000 7fa69ddba640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa6840b6560 0x7fa6840b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:30.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.654+0000 7fa68effd640 1 -- 172.21.15.7:0/1261839161 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa688107db0 con 0x7fa6981083a0 2024-09-21T05:53:30.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.654+0000 7fa69ddba640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa6840b6560 0x7fa6840b8a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa694005fd0 tx=0x7fa694005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:30.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.657+0000 7fa68effd640 1 -- 172.21.15.7:0/1261839161 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6880ce540 con 0x7fa6981083a0 2024-09-21T05:53:30.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.884+0000 7fa6a001e640 1 -- 172.21.15.7:0/1261839161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa69806b2d0 con 0x7fa6981083a0 2024-09-21T05:53:30.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.885+0000 7fa68effd640 1 -- 172.21.15.7:0/1261839161 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fa69806b2d0 con 0x7fa6981083a0 2024-09-21T05:53:30.887 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T05:53:30.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.887+0000 7fa6a001e640 1 -- 172.21.15.7:0/1261839161 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa6840b6560 msgr2=0x7fa6840b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:30.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.887+0000 7fa6a001e640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa6840b6560 0x7fa6840b8a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa694005fd0 tx=0x7fa694005850 comp rx=0 tx=0).stop 2024-09-21T05:53:30.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.887+0000 7fa6a001e640 1 -- 172.21.15.7:0/1261839161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6981083a0 msgr2=0x7fa69819b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:30.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.887+0000 7fa6a001e640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6981083a0 0x7fa69819b7f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa688032fd0 tx=0x7fa688004270 comp rx=0 tx=0).stop 2024-09-21T05:53:30.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.887+0000 7fa6a001e640 1 -- 172.21.15.7:0/1261839161 shutdown_connections 2024-09-21T05:53:30.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.887+0000 7fa6a001e640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa6840b6560 0x7fa6840b8a70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.887+0000 7fa6a001e640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6981083a0 0x7fa69819b7f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.887+0000 7fa6a001e640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa698108cf0 0x7fa69819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.887+0000 7fa6a001e640 1 --2- 172.21.15.7:0/1261839161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa698102a60 0x7fa69819b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.887+0000 7fa6a001e640 1 -- 172.21.15.7:0/1261839161 >> 172.21.15.7:0/1261839161 conn(0x7fa698079730 msgr2=0x7fa698104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:30.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.887+0000 7fa6a001e640 1 -- 172.21.15.7:0/1261839161 shutdown_connections 2024-09-21T05:53:30.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:30.887+0000 7fa6a001e640 1 -- 172.21.15.7:0/1261839161 wait complete. 2024-09-21T05:53:31.629 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T05:53:31.629 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T05:53:31.629 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-09-21T05:53:31.629 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T05:53:31.630 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:31.630 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T05:53:31.630 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T05:53:31.630 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T05:53:31.630 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T05:53:31.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:31.630 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-09-21T05:53:31.688 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T05:53:31.688 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T05:53:31.688 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T05:53:31.688 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:53:31.688 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-09-21T05:53:31.688 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42144sec preferred_lft 42144sec 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-09-21T05:53:31.689 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-09-21T05:53:31.690 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T05:53:31.690 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:53:31.690 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-21T05:53:31.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2024-09-21T05:53:31.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2024-09-21T05:53:31.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2024-09-21T05:53:31.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T05:53:31.690 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-21T05:53:31.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:53:31.853 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:31 smithi007 ceph-mon[30983]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T05:53:31.853 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:31 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1261839161' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:53:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:31.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:31.909 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T05:53:31.936 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-09-21T05:53:31.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:31.938 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-09-21T05:53:31.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:31 smithi027 ceph-mon[34364]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T05:53:31.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:31 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1261839161' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:53:32.012 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-09-21T05:53:32.013 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T05:53:32.013 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T05:53:32.013 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T05:53:32.013 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T05:53:32.013 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:53:32.013 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-21T05:53:32.013 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T05:53:32.013 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T05:53:32.013 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T05:53:32.013 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-21T05:53:32.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:31 smithi119 ceph-mon[34833]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T05:53:32.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:31 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1261839161' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:53:32.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:53:32.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:32.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:32.307 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-21T05:53:32.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:32.323 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-09-21T05:53:32.378 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:53:32.379 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-21T05:53:32.379 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T05:53:32.379 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T05:53:32.379 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-21T05:53:32.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:53:32.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:32.501 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T05:53:32.501 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:53:32.501 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-21T05:53:32.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T05:53:32.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T05:53:32.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T05:53:32.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T05:53:32.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T05:53:32.501 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-21T05:53:32.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:53:32.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:32.633 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:53:32.633 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-21T05:53:32.633 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-09-21T05:53:32.633 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T05:53:32.633 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-21T05:53:32.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:53:32.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:32.713 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T05:53:32.713 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:32.728 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T05:53:32.728 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T05:53:32.728 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:32.784 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T05:53:32.784 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T05:53:32.784 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/d0c2e36f-f6f1-4af4-b189-75287cc7d12e 2024-09-21T05:53:32.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:32.785 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/d0c2e36f-f6f1-4af4-b189-75287cc7d12e /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-21T05:53:32.898 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-21T05:53:32.898 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-21T05:53:32.898 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-09-21T05:53:33.036 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-21T05:53:33.036 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-21T05:53:33.036 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-09-21T05:53:33.037 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.27:3300,172.21.15.119:3300" 2024-09-21T05:53:33.037 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:3300,172.21.15.27:3300,172.21.15.119:3300:/volumes/qa/sv_1/d0c2e36f-f6f1-4af4-b189-75287cc7d12e 2024-09-21T05:53:33.037 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=397810bc-77dc-11ef-baf5-efdc52797490" will pass to kernel 2024-09-21T05:53:33.038 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T05:53:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-09-21T05:53:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T05:53:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T05:53:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T05:53:33.040 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T05:53:33.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:33.040 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:33.066 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T05:53:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T05:53:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:33.165 INFO:teuthology.orchestra.run.smithi007.stdout:client25112 2024-09-21T05:53:33.165 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:53:33.165 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T05:53:33.183 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T05:53:33.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T05:53:33.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:33.280 INFO:teuthology.orchestra.run.smithi007.stdout:client25112 2024-09-21T05:53:33.280 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T05:53:33.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T05:53:33.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:33.338 INFO:teuthology.orchestra.run.smithi007.stdout:client25112 2024-09-21T05:53:33.338 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/397810bc-77dc-11ef-baf5-efdc52797490.client25112/status') 2024-09-21T05:53:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:53:33.398 INFO:teuthology.orchestra.run.smithi007.stdout:instance: client.25112 (3)172.21.15.7:0/2789987356 2024-09-21T05:53:33.398 INFO:teuthology.orchestra.run.smithi007.stdout:blocklisted: false 2024-09-21T05:53:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records in 2024-09-21T05:53:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records out 2024-09-21T05:53:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:70 bytes copied, 2.8153e-05 s, 2.5 MB/s 2024-09-21T05:53:33.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:33.405 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T05:53:33.415 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T05:53:33.415 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T05:53:33.416 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-21T05:53:33.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.528+0000 7f69d1494640 1 -- 172.21.15.7:0/1079090486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69cc10dd80 msgr2=0x7f69cc110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:33.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.528+0000 7f69d1494640 1 --2- 172.21.15.7:0/1079090486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69cc10dd80 0x7f69cc110270 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009ca0 tx=0x7f69c402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:33.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.528+0000 7f69d1494640 1 -- 172.21.15.7:0/1079090486 shutdown_connections 2024-09-21T05:53:33.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.528+0000 7f69d1494640 1 --2- 172.21.15.7:0/1079090486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69cc10dd80 0x7f69cc110270 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:33.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.528+0000 7f69d1494640 1 --2- 172.21.15.7:0/1079090486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69cc105270 0x7f69cc10d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.528+0000 7f69d1494640 1 --2- 172.21.15.7:0/1079090486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69cc104920 0x7f69cc104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.528+0000 7f69d1494640 1 -- 172.21.15.7:0/1079090486 >> 172.21.15.7:0/1079090486 conn(0x7f69cc07a710 msgr2=0x7f69cc07ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.528+0000 7f69d1494640 1 -- 172.21.15.7:0/1079090486 shutdown_connections 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.528+0000 7f69d1494640 1 -- 172.21.15.7:0/1079090486 wait complete. 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.529+0000 7f69d1494640 1 Processor -- start 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.529+0000 7f69d1494640 1 -- start start 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.529+0000 7f69d1494640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69cc104920 0x7f69cc19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.529+0000 7f69d1494640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69cc105270 0x7f69cc19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.529+0000 7f69d1494640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69cc10dd80 0x7f69cc19fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.529+0000 7f69d1494640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc113a50 con 0x7f69cc10dd80 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.529+0000 7f69d1494640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc1138d0 con 0x7f69cc105270 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.529+0000 7f69d1494640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc113bd0 con 0x7f69cc104920 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.529+0000 7f69cb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69cc10dd80 0x7f69cc19fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.529+0000 7f69cb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69cc10dd80 0x7f69cc19fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59260/0 (socket says 172.21.15.7:59260) 2024-09-21T05:53:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.529+0000 7f69cb7fe640 1 -- 172.21.15.7:0/3855961020 learned_addr learned my addr 172.21.15.7:0/3855961020 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.529+0000 7f69ca7fc640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69cc105270 0x7f69cc19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.530+0000 7f69caffd640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69cc104920 0x7f69cc19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.530+0000 7f69cb7fe640 1 -- 172.21.15.7:0/3855961020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69cc104920 msgr2=0x7f69cc19a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.530+0000 7f69cb7fe640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69cc104920 0x7f69cc19a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.530+0000 7f69cb7fe640 1 -- 172.21.15.7:0/3855961020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69cc105270 msgr2=0x7f69cc19a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.530+0000 7f69cb7fe640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69cc105270 0x7f69cc19a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.530+0000 7f69cb7fe640 1 -- 172.21.15.7:0/3855961020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc1a02e0 con 0x7f69cc10dd80 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.530+0000 7f69caffd640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69cc104920 0x7f69cc19a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.530+0000 7f69cb7fe640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69cc10dd80 0x7f69cc19fbe0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009430 tx=0x7f69c40319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.530+0000 7f69b3fff640 1 -- 172.21.15.7:0/3855961020 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c4003c30 con 0x7f69cc10dd80 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.530+0000 7f69b3fff640 1 -- 172.21.15.7:0/3855961020 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69c4003dd0 con 0x7f69cc10dd80 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.530+0000 7f69d1494640 1 -- 172.21.15.7:0/3855961020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69cc1a0570 con 0x7f69cc10dd80 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.530+0000 7f69b3fff640 1 -- 172.21.15.7:0/3855961020 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c402faa0 con 0x7f69cc10dd80 2024-09-21T05:53:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.530+0000 7f69d1494640 1 -- 172.21.15.7:0/3855961020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69cc1a6d60 con 0x7f69cc10dd80 2024-09-21T05:53:33.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.531+0000 7f69d1494640 1 -- 172.21.15.7:0/3855961020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69cc06c050 con 0x7f69cc10dd80 2024-09-21T05:53:33.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.533+0000 7f69b3fff640 1 -- 172.21.15.7:0/3855961020 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f69c402fc40 con 0x7f69cc10dd80 2024-09-21T05:53:33.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.533+0000 7f69b3fff640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69b40b6560 0x7f69b40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:33.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.533+0000 7f69b3fff640 1 -- 172.21.15.7:0/3855961020 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f69c4108980 con 0x7f69cc10dd80 2024-09-21T05:53:33.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.533+0000 7f69caffd640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69b40b6560 0x7f69b40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:33.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.534+0000 7f69caffd640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69b40b6560 0x7f69b40b8a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0058c0 tx=0x7f69bc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:33.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.536+0000 7f69b3fff640 1 -- 172.21.15.7:0/3855961020 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69c40cf170 con 0x7f69cc10dd80 2024-09-21T05:53:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:33.765+0000 7f69d1494640 1 -- 172.21.15.7:0/3855961020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f69cc104d30 con 0x7f69cc10dd80 2024-09-21T05:53:33.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:33 smithi007 ceph-mon[30983]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 425 B/s wr, 5 op/s 2024-09-21T05:53:33.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:33 smithi027 ceph-mon[34364]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 425 B/s wr, 5 op/s 2024-09-21T05:53:34.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:33 smithi119 ceph-mon[34833]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 425 B/s wr, 5 op/s 2024-09-21T05:53:34.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.632+0000 7f69b3fff640 1 -- 172.21.15.7:0/3855961020 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f69c40d3550 con 0x7f69cc10dd80 2024-09-21T05:53:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.635+0000 7f69d1494640 1 -- 172.21.15.7:0/3855961020 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69b40b6560 msgr2=0x7f69b40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.635+0000 7f69d1494640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69b40b6560 0x7f69b40b8a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0058c0 tx=0x7f69bc005850 comp rx=0 tx=0).stop 2024-09-21T05:53:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.636+0000 7f69d1494640 1 -- 172.21.15.7:0/3855961020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69cc10dd80 msgr2=0x7f69cc19fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.636+0000 7f69d1494640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69cc10dd80 0x7f69cc19fbe0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009430 tx=0x7f69c40319f0 comp rx=0 tx=0).stop 2024-09-21T05:53:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.636+0000 7f69d1494640 1 -- 172.21.15.7:0/3855961020 shutdown_connections 2024-09-21T05:53:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.636+0000 7f69d1494640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f69b40b6560 0x7f69b40b8a70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.636+0000 7f69d1494640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69cc10dd80 0x7f69cc19fbe0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.636+0000 7f69d1494640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69cc105270 0x7f69cc19a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.636+0000 7f69d1494640 1 --2- 172.21.15.7:0/3855961020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69cc104920 0x7f69cc19a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.636+0000 7f69d1494640 1 -- 172.21.15.7:0/3855961020 >> 172.21.15.7:0/3855961020 conn(0x7f69cc07a710 msgr2=0x7f69cc101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.636+0000 7f69d1494640 1 -- 172.21.15.7:0/3855961020 shutdown_connections 2024-09-21T05:53:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.636+0000 7f69d1494640 1 -- 172.21.15.7:0/3855961020 wait complete. 2024-09-21T05:53:34.652 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T05:53:34.663 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T05:53:34.686 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T05:53:34.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.808+0000 7f63ff89d640 1 -- 172.21.15.7:0/2061743958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f806bc80 msgr2=0x7f63f806c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:34.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.808+0000 7f63ff89d640 1 --2- 172.21.15.7:0/2061743958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f806bc80 0x7f63f806c090 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009900 tx=0x7f63f402a410 comp rx=0 tx=0).stop 2024-09-21T05:53:34.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.808+0000 7f63ff89d640 1 -- 172.21.15.7:0/2061743958 shutdown_connections 2024-09-21T05:53:34.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.808+0000 7f63ff89d640 1 --2- 172.21.15.7:0/2061743958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63f8106b20 0x7f63f8110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:34.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.808+0000 7f63ff89d640 1 --2- 172.21.15.7:0/2061743958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63f81061d0 0x7f63f81065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:34.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.808+0000 7f63ff89d640 1 --2- 172.21.15.7:0/2061743958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f806bc80 0x7f63f806c090 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:34.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.808+0000 7f63ff89d640 1 -- 172.21.15.7:0/2061743958 >> 172.21.15.7:0/2061743958 conn(0x7f63f8078740 msgr2=0x7f63f8078b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:34.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.808+0000 7f63ff89d640 1 -- 172.21.15.7:0/2061743958 shutdown_connections 2024-09-21T05:53:34.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.808+0000 7f63ff89d640 1 -- 172.21.15.7:0/2061743958 wait complete. 2024-09-21T05:53:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.809+0000 7f63ff89d640 1 Processor -- start 2024-09-21T05:53:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.809+0000 7f63ff89d640 1 -- start start 2024-09-21T05:53:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.809+0000 7f63ff89d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63f806bc80 0x7f63f819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.809+0000 7f63ff89d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f81061d0 0x7f63f819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.809+0000 7f63ff89d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63f8106b20 0x7f63f819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.809+0000 7f63ff89d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8113a20 con 0x7f63f81061d0 2024-09-21T05:53:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.809+0000 7f63ff89d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f63f81138a0 con 0x7f63f8106b20 2024-09-21T05:53:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.809+0000 7f63ff89d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8113ba0 con 0x7f63f806bc80 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.809+0000 7f63fce38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f81061d0 0x7f63f819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.809+0000 7f63fce38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f81061d0 0x7f63f819a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59282/0 (socket says 172.21.15.7:59282) 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.809+0000 7f63fce38640 1 -- 172.21.15.7:0/2484729659 learned_addr learned my addr 172.21.15.7:0/2484729659 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.810+0000 7f63fd639640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63f806bc80 0x7f63f819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.810+0000 7f63fde3a640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63f8106b20 0x7f63f819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.810+0000 7f63fce38640 1 -- 172.21.15.7:0/2484729659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63f806bc80 msgr2=0x7f63f819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.810+0000 7f63fce38640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63f806bc80 0x7f63f819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.810+0000 7f63fce38640 1 -- 172.21.15.7:0/2484729659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63f8106b20 msgr2=0x7f63f819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.810+0000 7f63fce38640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63f8106b20 0x7f63f819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.810+0000 7f63fce38640 1 -- 172.21.15.7:0/2484729659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f81a0330 con 0x7f63f81061d0 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.810+0000 7f63fce38640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f81061d0 0x7f63f819a9a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f63e800e9f0 tx=0x7f63e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.810+0000 7f63ee7fc640 1 -- 172.21.15.7:0/2484729659 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e800ccc0 con 0x7f63f81061d0 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.810+0000 7f63ee7fc640 1 -- 172.21.15.7:0/2484729659 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63e80108e0 con 0x7f63f81061d0 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.810+0000 7f63ff89d640 1 -- 172.21.15.7:0/2484729659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f81a0620 con 0x7f63f81061d0 2024-09-21T05:53:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.810+0000 7f63ee7fc640 1 -- 172.21.15.7:0/2484729659 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e8018860 con 0x7f63f81061d0 2024-09-21T05:53:34.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.810+0000 7f63ff89d640 1 -- 172.21.15.7:0/2484729659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f81a6db0 con 0x7f63f81061d0 2024-09-21T05:53:34.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.811+0000 7f63ff89d640 1 -- 172.21.15.7:0/2484729659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f806c090 con 0x7f63f81061d0 2024-09-21T05:53:34.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.813+0000 7f63ee7fc640 1 -- 172.21.15.7:0/2484729659 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f63e8010430 con 0x7f63f81061d0 2024-09-21T05:53:34.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.814+0000 7f63ee7fc640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f63e40b6560 0x7f63e40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:34.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.814+0000 7f63fd639640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f63e40b6560 0x7f63e40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:34.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.814+0000 7f63ee7fc640 1 -- 172.21.15.7:0/2484729659 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f63e80e7b40 con 0x7f63f81061d0 2024-09-21T05:53:34.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.814+0000 7f63fd639640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f63e40b6560 0x7f63e40b8a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f63f4031440 tx=0x7f63f4009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:34.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:34.817+0000 7f63ee7fc640 1 -- 172.21.15.7:0/2484729659 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f63e80b2710 con 0x7f63f81061d0 2024-09-21T05:53:34.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:34 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3855961020' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T05:53:35.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.006+0000 7f63ff89d640 1 -- 172.21.15.7:0/2484729659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63f819b520 con 0x7f63f81061d0 2024-09-21T05:53:35.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.007+0000 7f63ee7fc640 1 -- 172.21.15.7:0/2484729659 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22826 (secure 0 0 0) 0x7f63f819b520 con 0x7f63f81061d0 2024-09-21T05:53:35.009 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:35.010 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:43:32.863896+0000","modified":"2024-09-21T05:52:23.580753+0000","last_up_change":"2024-09-21T05:51:02.074799+0000","last_in_change":"2024-09-21T05:50:39.016405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:47:20.844179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:51:46.238763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:51:48.832249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d7a68ba-a599-44a9-a0de-a1d6df51f437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6803","nonce":536257283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6805","nonce":536257283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6809","nonce":536257283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6807","nonce":536257283}]},"public_addr":"172.21.15.7:6803/536257283","cluster_addr":"172.21.15.7:6805/536257283","heartbeat_back_addr":"172.21.15.7:6809/536257283","heartbeat_front_addr":"172.21.15.7:6807/536257283","state":["exists","up"]},{"osd":1,"uuid":"d4600805-1cb5-432a-8ae0-a40107a6c6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6801","nonce":2299402871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6803","nonce":2299402871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6807","nonce":2299402871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6805","nonce":2299402871}]},"public_addr":"172.21.15.27:6801/2299402871","cluster_addr":"172.21.15.27:6803/2299402871","heartbeat_back_addr":"172.21.15.27:6807/2299402871","heartbeat_front_addr":"172.21.15.27:6805/2299402871","state":["exists","up"]},{"osd":2,"uuid":"aa435f82-5819-4497-9053-1d891e712b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6801","nonce":1043408043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6803","nonce":1043408043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6807","nonce":1043408043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6805","nonce":1043408043}]},"public_addr":"172.21.15.119:6801/1043408043","cluster_addr":"172.21.15.119:6803/1043408043","heartbeat_back_addr":"172.21.15.119:6807/1043408043","heartbeat_front_addr":"172.21.15.119:6805/1043408043","state":["exists","up"]},{"osd":3,"uuid":"55803f97-02e1-43c0-b8da-9b8af32fd1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6811","nonce":1261229771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6813","nonce":1261229771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6817","nonce":1261229771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6815","nonce":1261229771}]},"public_addr":"172.21.15.7:6811/1261229771","cluster_addr":"172.21.15.7:6813/1261229771","heartbeat_back_addr":"172.21.15.7:6817/1261229771","heartbeat_front_addr":"172.21.15.7:6815/1261229771","state":["exists","up"]},{"osd":4,"uuid":"987ce230-5bfc-45a7-a33e-6291545afded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6809","nonce":631467792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6811","nonce":631467792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6815","nonce":631467792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6813","nonce":631467792}]},"public_addr":"172.21.15.27:6809/631467792","cluster_addr":"172.21.15.27:6811/631467792","heartbeat_back_addr":"172.21.15.27:6815/631467792","heartbeat_front_addr":"172.21.15.27:6813/631467792","state":["exists","up"]},{"osd":5,"uuid":"e768fbfa-8983-4ff6-8dca-b7df2304cf91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6809","nonce":2530968619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6811","nonce":2530968619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6815","nonce":2530968619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6813","nonce":2530968619}]},"public_addr":"172.21.15.119:6809/2530968619","cluster_addr":"172.21.15.119:6811/2530968619","heartbeat_back_addr":"172.21.15.119:6815/2530968619","heartbeat_front_addr":"172.21.15.119:6813/2530968619","state":["exists","up"]},{"osd":6,"uuid":"22496f13-64be-479b-89ea-bf51544199c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6819","nonce":856032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6821","nonce":856032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6825","nonce":856032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6823","nonce":856032021}]},"public_addr":"172.21.15.7:6819/856032021","cluster_addr":"172.21.15.7:6821/856032021","heartbeat_back_addr":"172.21.15.7:6825/856032021","heartbeat_front_addr":"172.21.15.7:6823/856032021","state":["exists","up"]},{"osd":7,"uuid":"53fc5616-b06a-498e-a60e-d7d7d6ba2a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6817","nonce":2862843529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6819","nonce":2862843529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6823","nonce":2862843529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6821","nonce":2862843529}]},"public_addr":"172.21.15.27:6817/2862843529","cluster_addr":"172.21.15.27:6819/2862843529","heartbeat_back_addr":"172.21.15.27:6823/2862843529","heartbeat_front_addr":"172.21.15.27:6821/2862843529","state":["exists","up"]},{"osd":8,"uuid":"53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6817","nonce":3663835202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6819","nonce":3663835202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6823","nonce":3663835202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6821","nonce":3663835202}]},"public_addr":"172.21.15.119:6817/3663835202","cluster_addr":"172.21.15.119:6819/3663835202","heartbeat_back_addr":"172.21.15.119:6823/3663835202","heartbeat_front_addr":"172.21.15.119:6821/3663835202","state":["exists","up"]},{"osd":9,"uuid":"a69a747d-1e6c-4940-9d96-4315ab384588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6827","nonce":2348805959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6829","nonce":2348805959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6833","nonce":2348805959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6831","nonce":2348805959}]},"public_addr":"172.21.15.7:6827/2348805959","cluster_addr":"172.21.15.7:6829/2348805959","heartbeat_back_addr":"172.21.15.7:6833/2348805959","heartbeat_front_addr":"172.21.15.7:6831/2348805959","state":["exists","up"]},{"osd":10,"uuid":"a8f67271-99bb-4fb7-b0f5-a24730cd96cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6825","nonce":2363600090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6827","nonce":2363600090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6831","nonce":2363600090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6829","nonce":2363600090}]},"public_addr":"172.21.15.27:6825/2363600090","cluster_addr":"172.21.15.27:6827/2363600090","heartbeat_back_addr":"172.21.15.27:6831/2363600090","heartbeat_front_addr":"172.21.15.27:6829/2363600090","state":["exists","up"]},{"osd":11,"uuid":"88456735-00b1-479c-b201-588a9ee0c881","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6825","nonce":3937692826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6827","nonce":3937692826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6831","nonce":3937692826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6829","nonce":3937692826}]},"public_addr":"172.21.15.119:6825/3937692826","cluster_addr":"172.21.15.119:6827/3937692826","heartbeat_back_addr":"172.21.15.119:6831/3937692826","heartbeat_front_addr":"172.21.15.119:6829/3937692826","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:26.217550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:51.830871+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:17.201362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:41.990894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:07.357782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.114180+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:56.808155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:22.565234+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:46.981522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:10.600602+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:35.973766+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:51:00.216062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/4143746508":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/1505943829":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/1622456881":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/833696585":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/2055984288":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6801/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3995317885":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2229583478":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/468393974":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/1009303060":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2125734440":"2024-09-22T05:45:22.373420+0000","172.21.15.7:6800/3995317885":"2024-09-22T05:45:22.373420+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:53:35.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.010+0000 7f63ff89d640 1 -- 172.21.15.7:0/2484729659 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f63e40b6560 msgr2=0x7f63e40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.010+0000 7f63ff89d640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f63e40b6560 0x7f63e40b8a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f63f4031440 tx=0x7f63f4009560 comp rx=0 tx=0).stop 2024-09-21T05:53:35.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.010+0000 7f63ff89d640 1 -- 172.21.15.7:0/2484729659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f81061d0 msgr2=0x7f63f819a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.010+0000 7f63ff89d640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f81061d0 0x7f63f819a9a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f63e800e9f0 tx=0x7f63e800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.010+0000 7f63ff89d640 1 -- 172.21.15.7:0/2484729659 shutdown_connections 2024-09-21T05:53:35.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.010+0000 7f63ff89d640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f63e40b6560 0x7f63e40b8a70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.010+0000 7f63ff89d640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f81061d0 0x7f63f819a9a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.010+0000 7f63ff89d640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63f8106b20 0x7f63f819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.010+0000 7f63ff89d640 1 --2- 172.21.15.7:0/2484729659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63f806bc80 0x7f63f819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.010+0000 7f63ff89d640 1 -- 172.21.15.7:0/2484729659 >> 172.21.15.7:0/2484729659 conn(0x7f63f8078740 msgr2=0x7f63f8107ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:35.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.010+0000 7f63ff89d640 1 -- 172.21.15.7:0/2484729659 shutdown_connections 2024-09-21T05:53:35.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.010+0000 7f63ff89d640 1 -- 172.21.15.7:0/2484729659 wait complete. 2024-09-21T05:53:35.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:34 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3855961020' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T05:53:35.023 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T05:47:20.844179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T05:51:46.238763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T05:51:48.832249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T05:53:35.023 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T05:53:35.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:34 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3855961020' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T05:53:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.137+0000 7f4f5aea9640 1 -- 172.21.15.7:0/2357333356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f541029b0 msgr2=0x7f4f54102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.137+0000 7f4f5aea9640 1 --2- 172.21.15.7:0/2357333356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f541029b0 0x7f4f54102dc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009900 tx=0x7f4f3c02a410 comp rx=0 tx=0).stop 2024-09-21T05:53:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.137+0000 7f4f5aea9640 1 -- 172.21.15.7:0/2357333356 shutdown_connections 2024-09-21T05:53:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.137+0000 7f4f5aea9640 1 --2- 172.21.15.7:0/2357333356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f54108c50 0x7f4f5410f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.137+0000 7f4f5aea9640 1 --2- 172.21.15.7:0/2357333356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f54108300 0x7f4f54108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.137+0000 7f4f5aea9640 1 --2- 172.21.15.7:0/2357333356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f541029b0 0x7f4f54102dc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.137+0000 7f4f5aea9640 1 -- 172.21.15.7:0/2357333356 >> 172.21.15.7:0/2357333356 conn(0x7f4f54079570 msgr2=0x7f4f54079980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.137+0000 7f4f5aea9640 1 -- 172.21.15.7:0/2357333356 shutdown_connections 2024-09-21T05:53:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.137+0000 7f4f5aea9640 1 -- 172.21.15.7:0/2357333356 wait complete. 2024-09-21T05:53:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.138+0000 7f4f5aea9640 1 Processor -- start 2024-09-21T05:53:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.138+0000 7f4f5aea9640 1 -- start start 2024-09-21T05:53:35.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.138+0000 7f4f5aea9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f541029b0 0x7f4f5419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.138+0000 7f4f5aea9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f54108300 0x7f4f5419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.138+0000 7f4f5aea9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f54108c50 0x7f4f5419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.138+0000 7f4f5aea9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f541128f0 con 0x7f4f54108c50 2024-09-21T05:53:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.138+0000 7f4f5aea9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4f54112770 con 0x7f4f54108300 2024-09-21T05:53:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.138+0000 7f4f5aea9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4f54112a70 con 0x7f4f541029b0 2024-09-21T05:53:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f59446640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f54108c50 0x7f4f5419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f59446640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f54108c50 0x7f4f5419fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59296/0 (socket says 172.21.15.7:59296) 2024-09-21T05:53:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f59446640 1 -- 172.21.15.7:0/3537762705 learned_addr learned my addr 172.21.15.7:0/3537762705 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f58c45640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f541029b0 0x7f4f5419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f53fff640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f54108300 0x7f4f5419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f59446640 1 -- 172.21.15.7:0/3537762705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f541029b0 msgr2=0x7f4f5419a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f59446640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f541029b0 0x7f4f5419a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f59446640 1 -- 172.21.15.7:0/3537762705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f54108300 msgr2=0x7f4f5419a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f59446640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f54108300 0x7f4f5419a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f59446640 1 -- 172.21.15.7:0/3537762705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f541a0310 con 0x7f4f54108c50 2024-09-21T05:53:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f53fff640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f54108300 0x7f4f5419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f59446640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f54108c50 0x7f4f5419fc10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00c970 tx=0x7f4f4c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f51ffb640 1 -- 172.21.15.7:0/3537762705 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c007bb0 con 0x7f4f54108c50 2024-09-21T05:53:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f51ffb640 1 -- 172.21.15.7:0/3537762705 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f4c007d50 con 0x7f4f54108c50 2024-09-21T05:53:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f5aea9640 1 -- 172.21.15.7:0/3537762705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f541a0600 con 0x7f4f54108c50 2024-09-21T05:53:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.139+0000 7f4f51ffb640 1 -- 172.21.15.7:0/3537762705 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c004e60 con 0x7f4f54108c50 2024-09-21T05:53:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.140+0000 7f4f5aea9640 1 -- 172.21.15.7:0/3537762705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f541a6d90 con 0x7f4f54108c50 2024-09-21T05:53:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.140+0000 7f4f5aea9640 1 -- 172.21.15.7:0/3537762705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f54102dc0 con 0x7f4f54108c50 2024-09-21T05:53:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.142+0000 7f4f51ffb640 1 -- 172.21.15.7:0/3537762705 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f4f4c005000 con 0x7f4f54108c50 2024-09-21T05:53:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.143+0000 7f4f51ffb640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4f400b6560 0x7f4f400b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.143+0000 7f4f58c45640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4f400b6560 0x7f4f400b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.143+0000 7f4f51ffb640 1 -- 172.21.15.7:0/3537762705 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4f4c0e73e0 con 0x7f4f54108c50 2024-09-21T05:53:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.143+0000 7f4f58c45640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4f400b6560 0x7f4f400b8a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c031440 tx=0x7f4f3c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.146+0000 7f4f51ffb640 1 -- 172.21.15.7:0/3537762705 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f4c014030 con 0x7f4f54108c50 2024-09-21T05:53:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.335+0000 7f4f5aea9640 1 -- 172.21.15.7:0/3537762705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4f5402e640 con 0x7f4f54108c50 2024-09-21T05:53:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.336+0000 7f4f51ffb640 1 -- 172.21.15.7:0/3537762705 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f4f4c0adb70 con 0x7f4f54108c50 2024-09-21T05:53:35.338 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-21T05:53:35.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.338+0000 7f4f5aea9640 1 -- 172.21.15.7:0/3537762705 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4f400b6560 msgr2=0x7f4f400b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.338+0000 7f4f5aea9640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4f400b6560 0x7f4f400b8a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c031440 tx=0x7f4f3c009560 comp rx=0 tx=0).stop 2024-09-21T05:53:35.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.338+0000 7f4f5aea9640 1 -- 172.21.15.7:0/3537762705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f54108c50 msgr2=0x7f4f5419fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.338+0000 7f4f5aea9640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f54108c50 0x7f4f5419fc10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00c970 tx=0x7f4f4c00ce30 comp rx=0 tx=0).stop 2024-09-21T05:53:35.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.338+0000 7f4f5aea9640 1 -- 172.21.15.7:0/3537762705 shutdown_connections 2024-09-21T05:53:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.338+0000 7f4f5aea9640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4f400b6560 0x7f4f400b8a70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.338+0000 7f4f5aea9640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f54108c50 0x7f4f5419fc10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.338+0000 7f4f5aea9640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4f54108300 0x7f4f5419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.338+0000 7f4f5aea9640 1 --2- 172.21.15.7:0/3537762705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f541029b0 0x7f4f5419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.338+0000 7f4f5aea9640 1 -- 172.21.15.7:0/3537762705 >> 172.21.15.7:0/3537762705 conn(0x7f4f54079570 msgr2=0x7f4f5406bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.338+0000 7f4f5aea9640 1 -- 172.21.15.7:0/3537762705 shutdown_connections 2024-09-21T05:53:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.338+0000 7f4f5aea9640 1 -- 172.21.15.7:0/3537762705 wait complete. 2024-09-21T05:53:35.351 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T05:53:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.465+0000 7fb6b3c77640 1 -- 172.21.15.7:0/3505617765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6ac1029a0 msgr2=0x7fb6ac102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.465+0000 7fb6b3c77640 1 --2- 172.21.15.7:0/3505617765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6ac1029a0 0x7fb6ac102db0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009900 tx=0x7fb69c02a410 comp rx=0 tx=0).stop 2024-09-21T05:53:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.466+0000 7fb6b3c77640 1 -- 172.21.15.7:0/3505617765 shutdown_connections 2024-09-21T05:53:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.466+0000 7fb6b3c77640 1 --2- 172.21.15.7:0/3505617765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6ac108c20 0x7fb6ac10f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.466+0000 7fb6b3c77640 1 --2- 172.21.15.7:0/3505617765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6ac1082d0 0x7fb6ac1086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.466+0000 7fb6b3c77640 1 --2- 172.21.15.7:0/3505617765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6ac1029a0 0x7fb6ac102db0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.466+0000 7fb6b3c77640 1 -- 172.21.15.7:0/3505617765 >> 172.21.15.7:0/3505617765 conn(0x7fb6ac0fe3e0 msgr2=0x7fb6ac100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.466+0000 7fb6b3c77640 1 -- 172.21.15.7:0/3505617765 shutdown_connections 2024-09-21T05:53:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.466+0000 7fb6b3c77640 1 -- 172.21.15.7:0/3505617765 wait complete. 2024-09-21T05:53:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.466+0000 7fb6b3c77640 1 Processor -- start 2024-09-21T05:53:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.466+0000 7fb6b3c77640 1 -- start start 2024-09-21T05:53:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b3c77640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6ac1029a0 0x7fb6ac19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b3c77640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6ac1082d0 0x7fb6ac19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b3c77640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6ac108c20 0x7fb6ac1a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b3c77640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac112930 con 0x7fb6ac108c20 2024-09-21T05:53:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b3c77640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac1127b0 con 0x7fb6ac1029a0 2024-09-21T05:53:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b3c77640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac112ab0 con 0x7fb6ac1082d0 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b2214640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6ac108c20 0x7fb6ac1a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b2214640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6ac108c20 0x7fb6ac1a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59306/0 (socket says 172.21.15.7:59306) 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b2214640 1 -- 172.21.15.7:0/557065966 learned_addr learned my addr 172.21.15.7:0/557065966 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b1212640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6ac1082d0 0x7fb6ac19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b1a13640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6ac1029a0 0x7fb6ac19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b2214640 1 -- 172.21.15.7:0/557065966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6ac1082d0 msgr2=0x7fb6ac19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b2214640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6ac1082d0 0x7fb6ac19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b2214640 1 -- 172.21.15.7:0/557065966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6ac1029a0 msgr2=0x7fb6ac19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b2214640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6ac1029a0 0x7fb6ac19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b2214640 1 -- 172.21.15.7:0/557065966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ac1a2540 con 0x7fb6ac108c20 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b1a13640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6ac1029a0 0x7fb6ac19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b1212640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6ac1082d0 0x7fb6ac19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b2214640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6ac108c20 0x7fb6ac1a1e40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400eaa0 tx=0x7fb6a400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:35.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6aaffd640 1 -- 172.21.15.7:0/557065966 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a400cdb0 con 0x7fb6ac108c20 2024-09-21T05:53:35.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6aaffd640 1 -- 172.21.15.7:0/557065966 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6a4005020 con 0x7fb6ac108c20 2024-09-21T05:53:35.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6b3c77640 1 -- 172.21.15.7:0/557065966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6ac1a2830 con 0x7fb6ac108c20 2024-09-21T05:53:35.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.467+0000 7fb6aaffd640 1 -- 172.21.15.7:0/557065966 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40116d0 con 0x7fb6ac108c20 2024-09-21T05:53:35.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.468+0000 7fb6b3c77640 1 -- 172.21.15.7:0/557065966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6ac1a8fc0 con 0x7fb6ac108c20 2024-09-21T05:53:35.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.469+0000 7fb6b3c77640 1 -- 172.21.15.7:0/557065966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6ac103c10 con 0x7fb6ac108c20 2024-09-21T05:53:35.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.470+0000 7fb6aaffd640 1 -- 172.21.15.7:0/557065966 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7fb6a40051d0 con 0x7fb6ac108c20 2024-09-21T05:53:35.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.471+0000 7fb6aaffd640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb6940b6560 0x7fb6940b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:35.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.471+0000 7fb6b1a13640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb6940b6560 0x7fb6940b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:35.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.471+0000 7fb6aaffd640 1 -- 172.21.15.7:0/557065966 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb6a40e7a90 con 0x7fb6ac108c20 2024-09-21T05:53:35.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.471+0000 7fb6b1a13640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb6940b6560 0x7fb6940b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb69c02a930 tx=0x7fb69c005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:35.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.474+0000 7fb6aaffd640 1 -- 172.21.15.7:0/557065966 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6a4016030 con 0x7fb6ac108c20 2024-09-21T05:53:35.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.663+0000 7fb6b3c77640 1 -- 172.21.15.7:0/557065966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb6ac19d730 con 0x7fb6ac108c20 2024-09-21T05:53:35.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.663+0000 7fb6aaffd640 1 -- 172.21.15.7:0/557065966 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7fb6a40ae280 con 0x7fb6ac108c20 2024-09-21T05:53:35.665 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-21T05:53:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.666+0000 7fb6b3c77640 1 -- 172.21.15.7:0/557065966 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb6940b6560 msgr2=0x7fb6940b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.666+0000 7fb6b3c77640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb6940b6560 0x7fb6940b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb69c02a930 tx=0x7fb69c005fd0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.666+0000 7fb6b3c77640 1 -- 172.21.15.7:0/557065966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6ac108c20 msgr2=0x7fb6ac1a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.666+0000 7fb6b3c77640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6ac108c20 0x7fb6ac1a1e40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400eaa0 tx=0x7fb6a400ef60 comp rx=0 tx=0).stop 2024-09-21T05:53:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.666+0000 7fb6b3c77640 1 -- 172.21.15.7:0/557065966 shutdown_connections 2024-09-21T05:53:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.666+0000 7fb6b3c77640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb6940b6560 0x7fb6940b8a70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.666+0000 7fb6b3c77640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6ac108c20 0x7fb6ac1a1e40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.666+0000 7fb6b3c77640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6ac1082d0 0x7fb6ac19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.666+0000 7fb6b3c77640 1 --2- 172.21.15.7:0/557065966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6ac1029a0 0x7fb6ac19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.666+0000 7fb6b3c77640 1 -- 172.21.15.7:0/557065966 >> 172.21.15.7:0/557065966 conn(0x7fb6ac0fe3e0 msgr2=0x7fb6ac107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:35.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.666+0000 7fb6b3c77640 1 -- 172.21.15.7:0/557065966 shutdown_connections 2024-09-21T05:53:35.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.666+0000 7fb6b3c77640 1 -- 172.21.15.7:0/557065966 wait complete. 2024-09-21T05:53:35.679 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T05:53:35.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.793+0000 7f6e44951640 1 -- 172.21.15.7:0/2696183018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e40101f80 msgr2=0x7f6e40102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.793+0000 7f6e44951640 1 --2- 172.21.15.7:0/2696183018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e40101f80 0x7f6e40102390 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009900 tx=0x7f6e3002a410 comp rx=0 tx=0).stop 2024-09-21T05:53:35.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.794+0000 7f6e44951640 1 -- 172.21.15.7:0/2696183018 shutdown_connections 2024-09-21T05:53:35.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.794+0000 7f6e44951640 1 --2- 172.21.15.7:0/2696183018 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e40106b10 0x7f6e401105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.794+0000 7f6e44951640 1 --2- 172.21.15.7:0/2696183018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e401061c0 0x7f6e401065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.794+0000 7f6e44951640 1 --2- 172.21.15.7:0/2696183018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e40101f80 0x7f6e40102390 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.794+0000 7f6e44951640 1 -- 172.21.15.7:0/2696183018 >> 172.21.15.7:0/2696183018 conn(0x7f6e40077bb0 msgr2=0x7f6e40077ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:35.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.794+0000 7f6e44951640 1 -- 172.21.15.7:0/2696183018 shutdown_connections 2024-09-21T05:53:35.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.794+0000 7f6e44951640 1 -- 172.21.15.7:0/2696183018 wait complete. 2024-09-21T05:53:35.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.794+0000 7f6e44951640 1 Processor -- start 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e44951640 1 -- start start 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e44951640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e40101f80 0x7f6e4019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e44951640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e401061c0 0x7f6e4019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e44951640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e40106b10 0x7f6e4019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e44951640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6e40113a00 con 0x7f6e40101f80 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e44951640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6e40113880 con 0x7f6e40106b10 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e44951640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6e40113b80 con 0x7f6e401061c0 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e3e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e40101f80 0x7f6e4019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e3e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e40101f80 0x7f6e4019a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59314/0 (socket says 172.21.15.7:59314) 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e3e59c640 1 -- 172.21.15.7:0/3224353134 learned_addr learned my addr 172.21.15.7:0/3224353134 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e3dd9b640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e401061c0 0x7f6e4019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e3ed9d640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e40106b10 0x7f6e4019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e3e59c640 1 -- 172.21.15.7:0/3224353134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e401061c0 msgr2=0x7f6e4019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e3e59c640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e401061c0 0x7f6e4019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e3e59c640 1 -- 172.21.15.7:0/3224353134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e40106b10 msgr2=0x7f6e4019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e3e59c640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e40106b10 0x7f6e4019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e3e59c640 1 -- 172.21.15.7:0/3224353134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e401a0390 con 0x7f6e40101f80 2024-09-21T05:53:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.795+0000 7f6e3dd9b640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e401061c0 0x7f6e4019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.796+0000 7f6e3e59c640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e40101f80 0x7f6e4019a460 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6e30006010 tx=0x7f6e30004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.796+0000 7f6e2f7fe640 1 -- 172.21.15.7:0/3224353134 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3003f030 con 0x7f6e40101f80 2024-09-21T05:53:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.796+0000 7f6e44951640 1 -- 172.21.15.7:0/3224353134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e401a0620 con 0x7f6e40101f80 2024-09-21T05:53:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.796+0000 7f6e2f7fe640 1 -- 172.21.15.7:0/3224353134 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e30003aa0 con 0x7f6e40101f80 2024-09-21T05:53:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.796+0000 7f6e2f7fe640 1 -- 172.21.15.7:0/3224353134 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30035070 con 0x7f6e40101f80 2024-09-21T05:53:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.796+0000 7f6e44951640 1 -- 172.21.15.7:0/3224353134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e401a6e10 con 0x7f6e40101f80 2024-09-21T05:53:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.797+0000 7f6e44951640 1 -- 172.21.15.7:0/3224353134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e40102390 con 0x7f6e40101f80 2024-09-21T05:53:35.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.799+0000 7f6e2f7fe640 1 -- 172.21.15.7:0/3224353134 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f6e30042030 con 0x7f6e40101f80 2024-09-21T05:53:35.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.800+0000 7f6e2f7fe640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e280b6560 0x7f6e280b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:35.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.800+0000 7f6e3dd9b640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e280b6560 0x7f6e280b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:35.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.800+0000 7f6e2f7fe640 1 -- 172.21.15.7:0/3224353134 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f6e30107db0 con 0x7f6e40101f80 2024-09-21T05:53:35.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.801+0000 7f6e3dd9b640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e280b6560 0x7f6e280b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6e401091e0 tx=0x7f6e34005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:35.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.803+0000 7f6e2f7fe640 1 -- 172.21.15.7:0/3224353134 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6e300ce540 con 0x7f6e40101f80 2024-09-21T05:53:35.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:35 smithi027 ceph-mon[34364]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 596 B/s wr, 8 op/s 2024-09-21T05:53:35.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:35 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3855961020' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T05:53:35.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:35 smithi027 ceph-mon[34364]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T05:53:35.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:35 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2484729659' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:35.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:35 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3537762705' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:53:35.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.991+0000 7f6e44951640 1 -- 172.21.15.7:0/3224353134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6e4010bc30 con 0x7f6e40101f80 2024-09-21T05:53:35.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.991+0000 7f6e2f7fe640 1 -- 172.21.15.7:0/3224353134 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7f6e300d2920 con 0x7f6e40101f80 2024-09-21T05:53:35.993 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-21T05:53:35.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.994+0000 7f6e44951640 1 -- 172.21.15.7:0/3224353134 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e280b6560 msgr2=0x7f6e280b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.994+0000 7f6e44951640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e280b6560 0x7f6e280b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6e401091e0 tx=0x7f6e34005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:35.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.994+0000 7f6e44951640 1 -- 172.21.15.7:0/3224353134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e40101f80 msgr2=0x7f6e4019a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:35.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.994+0000 7f6e44951640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e40101f80 0x7f6e4019a460 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6e30006010 tx=0x7f6e30004060 comp rx=0 tx=0).stop 2024-09-21T05:53:35.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.994+0000 7f6e44951640 1 -- 172.21.15.7:0/3224353134 shutdown_connections 2024-09-21T05:53:35.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.994+0000 7f6e44951640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6e280b6560 0x7f6e280b8a70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.994+0000 7f6e44951640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e40106b10 0x7f6e4019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.994+0000 7f6e44951640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e401061c0 0x7f6e4019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.994+0000 7f6e44951640 1 --2- 172.21.15.7:0/3224353134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e40101f80 0x7f6e4019a460 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:35.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.994+0000 7f6e44951640 1 -- 172.21.15.7:0/3224353134 >> 172.21.15.7:0/3224353134 conn(0x7f6e40077bb0 msgr2=0x7f6e40107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:35.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.994+0000 7f6e44951640 1 -- 172.21.15.7:0/3224353134 shutdown_connections 2024-09-21T05:53:35.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:35.994+0000 7f6e44951640 1 -- 172.21.15.7:0/3224353134 wait complete. 2024-09-21T05:53:36.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:35 smithi007 ceph-mon[30983]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 596 B/s wr, 8 op/s 2024-09-21T05:53:36.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3855961020' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T05:53:36.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:35 smithi007 ceph-mon[30983]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T05:53:36.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2484729659' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:36.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3537762705' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:53:36.007 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T05:53:36.007 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:36.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:35 smithi119 ceph-mon[34833]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 596 B/s wr, 8 op/s 2024-09-21T05:53:36.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:35 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3855961020' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T05:53:36.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:35 smithi119 ceph-mon[34833]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T05:53:36.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:35 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2484729659' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:36.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:35 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3537762705' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:53:36.264 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:36.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.770+0000 7f3771881640 1 -- 172.21.15.7:0/1222834495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376c1083c0 msgr2=0x7f376c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.770+0000 7f3771881640 1 --2- 172.21.15.7:0/1222834495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376c1083c0 0x7f376c1087d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3754009900 tx=0x7f375402a410 comp rx=0 tx=0).stop 2024-09-21T05:53:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.770+0000 7f3771881640 1 -- 172.21.15.7:0/1222834495 shutdown_connections 2024-09-21T05:53:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.770+0000 7f3771881640 1 --2- 172.21.15.7:0/1222834495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376c1083c0 0x7f376c1087d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.770+0000 7f3771881640 1 --2- 172.21.15.7:0/1222834495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376c108d10 0x7f376c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.770+0000 7f3771881640 1 --2- 172.21.15.7:0/1222834495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f376c102a80 0x7f376c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.770+0000 7f3771881640 1 -- 172.21.15.7:0/1222834495 >> 172.21.15.7:0/1222834495 conn(0x7f376c079740 msgr2=0x7f376c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.770+0000 7f3771881640 1 -- 172.21.15.7:0/1222834495 shutdown_connections 2024-09-21T05:53:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.770+0000 7f3771881640 1 -- 172.21.15.7:0/1222834495 wait complete. 2024-09-21T05:53:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.770+0000 7f3771881640 1 Processor -- start 2024-09-21T05:53:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.771+0000 7f3771881640 1 -- start start 2024-09-21T05:53:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.771+0000 7f3771881640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f376c102a80 0x7f376c19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.771+0000 7f3771881640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376c1083c0 0x7f376c19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.771+0000 7f3771881640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376c108d10 0x7f376c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.771+0000 7f3771881640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f376c112980 con 0x7f376c1083c0 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.771+0000 7f3771881640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f376c112800 con 0x7f376c108d10 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.771+0000 7f3771881640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f376c112b00 con 0x7f376c102a80 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.771+0000 7f3763fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376c1083c0 0x7f376c19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.771+0000 7f3763fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376c1083c0 0x7f376c19b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59338/0 (socket says 172.21.15.7:59338) 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.771+0000 7f376affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f376c102a80 0x7f376c19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.771+0000 7f3763fff640 1 -- 172.21.15.7:0/2687781774 learned_addr learned my addr 172.21.15.7:0/2687781774 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.771+0000 7f376b7fe640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376c108d10 0x7f376c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.772+0000 7f3763fff640 1 -- 172.21.15.7:0/2687781774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f376c102a80 msgr2=0x7f376c19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.772+0000 7f3763fff640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f376c102a80 0x7f376c19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.772+0000 7f3763fff640 1 -- 172.21.15.7:0/2687781774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376c108d10 msgr2=0x7f376c19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.772+0000 7f3763fff640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376c108d10 0x7f376c19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.772+0000 7f3763fff640 1 -- 172.21.15.7:0/2687781774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376c1a65e0 con 0x7f376c1083c0 2024-09-21T05:53:36.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.772+0000 7f376affd640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f376c102a80 0x7f376c19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:36.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.772+0000 7f3763fff640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376c1083c0 0x7f376c19b810 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3754032fd0 tx=0x7f3754031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:36.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.772+0000 7f377087f640 1 -- 172.21.15.7:0/2687781774 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375403f030 con 0x7f376c1083c0 2024-09-21T05:53:36.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.772+0000 7f3771881640 1 -- 172.21.15.7:0/2687781774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376c1a6870 con 0x7f376c1083c0 2024-09-21T05:53:36.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.772+0000 7f377087f640 1 -- 172.21.15.7:0/2687781774 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3754004490 con 0x7f376c1083c0 2024-09-21T05:53:36.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.772+0000 7f377087f640 1 -- 172.21.15.7:0/2687781774 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754035070 con 0x7f376c1083c0 2024-09-21T05:53:36.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.772+0000 7f3771881640 1 -- 172.21.15.7:0/2687781774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f376c1a6da0 con 0x7f376c1083c0 2024-09-21T05:53:36.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.773+0000 7f3771881640 1 -- 172.21.15.7:0/2687781774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f376c103d00 con 0x7f376c1083c0 2024-09-21T05:53:36.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.776+0000 7f377087f640 1 -- 172.21.15.7:0/2687781774 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f3754042030 con 0x7f376c1083c0 2024-09-21T05:53:36.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.777+0000 7f377087f640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f37580b6560 0x7f37580b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:36.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.777+0000 7f376affd640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f37580b6560 0x7f37580b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:36.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.777+0000 7f377087f640 1 -- 172.21.15.7:0/2687781774 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f3754107b70 con 0x7f376c1083c0 2024-09-21T05:53:36.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.777+0000 7f376affd640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f37580b6560 0x7f37580b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f376c06c700 tx=0x7f375c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:36.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:36.780+0000 7f377087f640 1 -- 172.21.15.7:0/2687781774 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f37540d26e0 con 0x7f376c1083c0 2024-09-21T05:53:36.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:36 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/557065966' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T05:53:36.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:36 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3224353134' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T05:53:37.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.005+0000 7f3771881640 1 -- 172.21.15.7:0/2687781774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f376c102e90 con 0x7f376c1083c0 2024-09-21T05:53:37.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:36 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/557065966' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T05:53:37.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:36 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3224353134' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T05:53:37.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.006+0000 7f377087f640 1 -- 172.21.15.7:0/2687781774 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f37540d7620 con 0x7f376c1083c0 2024-09-21T05:53:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:37.009 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:53:37.009 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:53:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.008+0000 7f3771881640 1 -- 172.21.15.7:0/2687781774 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f37580b6560 msgr2=0x7f37580b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.008+0000 7f3771881640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f37580b6560 0x7f37580b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f376c06c700 tx=0x7f375c005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.008+0000 7f3771881640 1 -- 172.21.15.7:0/2687781774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376c1083c0 msgr2=0x7f376c19b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.008+0000 7f3771881640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376c1083c0 0x7f376c19b810 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3754032fd0 tx=0x7f3754031a20 comp rx=0 tx=0).stop 2024-09-21T05:53:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.008+0000 7f3771881640 1 -- 172.21.15.7:0/2687781774 shutdown_connections 2024-09-21T05:53:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.008+0000 7f3771881640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f37580b6560 0x7f37580b8a70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.009+0000 7f3771881640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376c1083c0 0x7f376c19b810 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.009+0000 7f3771881640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f376c108d10 0x7f376c19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.009+0000 7f3771881640 1 --2- 172.21.15.7:0/2687781774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f376c102a80 0x7f376c19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.009+0000 7f3771881640 1 -- 172.21.15.7:0/2687781774 >> 172.21.15.7:0/2687781774 conn(0x7f376c079740 msgr2=0x7f376c104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.009+0000 7f3771881640 1 -- 172.21.15.7:0/2687781774 shutdown_connections 2024-09-21T05:53:37.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.009+0000 7f3771881640 1 -- 172.21.15.7:0/2687781774 wait complete. 2024-09-21T05:53:37.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:36 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/557065966' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T05:53:37.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:36 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3224353134' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T05:53:37.748 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:37 smithi007 ceph-mon[30983]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T05:53:37.749 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:37 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2687781774' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:37.785 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T05:53:37.785 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T05:53:37.785 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T05:53:37.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.907+0000 7f19d1ab6640 1 -- 172.21.15.7:0/391841324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19cc1061d0 msgr2=0x7f19cc1065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:37.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.907+0000 7f19d1ab6640 1 --2- 172.21.15.7:0/391841324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19cc1061d0 0x7f19cc1065e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009900 tx=0x7f19c002a410 comp rx=0 tx=0).stop 2024-09-21T05:53:37.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.907+0000 7f19d1ab6640 1 -- 172.21.15.7:0/391841324 shutdown_connections 2024-09-21T05:53:37.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.907+0000 7f19d1ab6640 1 --2- 172.21.15.7:0/391841324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19cc1061d0 0x7f19cc1065e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.907+0000 7f19d1ab6640 1 --2- 172.21.15.7:0/391841324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19cc106b20 0x7f19cc110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.907+0000 7f19d1ab6640 1 --2- 172.21.15.7:0/391841324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19cc06bc80 0x7f19cc06c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.907+0000 7f19d1ab6640 1 -- 172.21.15.7:0/391841324 >> 172.21.15.7:0/391841324 conn(0x7f19cc078740 msgr2=0x7f19cc078b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:37.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.907+0000 7f19d1ab6640 1 -- 172.21.15.7:0/391841324 shutdown_connections 2024-09-21T05:53:37.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.907+0000 7f19d1ab6640 1 -- 172.21.15.7:0/391841324 wait complete. 2024-09-21T05:53:37.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.908+0000 7f19d1ab6640 1 Processor -- start 2024-09-21T05:53:37.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.908+0000 7f19d1ab6640 1 -- start start 2024-09-21T05:53:37.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.908+0000 7f19d1ab6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19cc06bc80 0x7f19cc19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:37.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.908+0000 7f19d1ab6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19cc1061d0 0x7f19cc19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:37.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.908+0000 7f19d1ab6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19cc106b20 0x7f19cc19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:37.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19d1ab6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc113a20 con 0x7f19cc06bc80 2024-09-21T05:53:37.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19d1ab6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc1138a0 con 0x7f19cc1061d0 2024-09-21T05:53:37.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19d1ab6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc113ba0 con 0x7f19cc106b20 2024-09-21T05:53:37.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19cb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19cc06bc80 0x7f19cc19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:37.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19cb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19cc06bc80 0x7f19cc19a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59344/0 (socket says 172.21.15.7:59344) 2024-09-21T05:53:37.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19cb7fe640 1 -- 172.21.15.7:0/2870576781 learned_addr learned my addr 172.21.15.7:0/2870576781 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:37.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19cbfff640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19cc106b20 0x7f19cc19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:37.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19caffd640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19cc1061d0 0x7f19cc19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:37.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19cb7fe640 1 -- 172.21.15.7:0/2870576781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19cc106b20 msgr2=0x7f19cc19fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:37.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19cb7fe640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19cc106b20 0x7f19cc19fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19cb7fe640 1 -- 172.21.15.7:0/2870576781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19cc1061d0 msgr2=0x7f19cc19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:37.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19cb7fe640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19cc1061d0 0x7f19cc19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19cb7fe640 1 -- 172.21.15.7:0/2870576781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19cc1a0350 con 0x7f19cc06bc80 2024-09-21T05:53:37.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19caffd640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19cc1061d0 0x7f19cc19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:37.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19cb7fe640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19cc06bc80 0x7f19cc19a420 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00d950 tx=0x7f19bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:37.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19c8ff9640 1 -- 172.21.15.7:0/2870576781 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc017070 con 0x7f19cc06bc80 2024-09-21T05:53:37.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19c8ff9640 1 -- 172.21.15.7:0/2870576781 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19bc009c30 con 0x7f19cc06bc80 2024-09-21T05:53:37.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19d1ab6640 1 -- 172.21.15.7:0/2870576781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19cc1a0640 con 0x7f19cc06bc80 2024-09-21T05:53:37.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.909+0000 7f19c8ff9640 1 -- 172.21.15.7:0/2870576781 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00f620 con 0x7f19cc06bc80 2024-09-21T05:53:37.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.910+0000 7f19d1ab6640 1 -- 172.21.15.7:0/2870576781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19cc1a6dd0 con 0x7f19cc06bc80 2024-09-21T05:53:37.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.910+0000 7f19d1ab6640 1 -- 172.21.15.7:0/2870576781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19cc06c090 con 0x7f19cc06bc80 2024-09-21T05:53:37.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.912+0000 7f19c8ff9640 1 -- 172.21.15.7:0/2870576781 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f19bc010460 con 0x7f19cc06bc80 2024-09-21T05:53:37.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.913+0000 7f19c8ff9640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f19b40b65e0 0x7f19b40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:37.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.913+0000 7f19caffd640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f19b40b65e0 0x7f19b40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:37.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.913+0000 7f19c8ff9640 1 -- 172.21.15.7:0/2870576781 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f19bc0e6fa0 con 0x7f19cc06bc80 2024-09-21T05:53:37.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.914+0000 7f19caffd640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f19b40b65e0 0x7f19b40b8af0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009230 tx=0x7f19c0000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:37.917+0000 7f19c8ff9640 1 -- 172.21.15.7:0/2870576781 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19bc0ad810 con 0x7f19cc06bc80 2024-09-21T05:53:37.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:37 smithi027 ceph-mon[34364]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T05:53:37.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:37 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2687781774' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:37.993 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:37 smithi119 ceph-mon[34833]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T05:53:37.993 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:37 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2687781774' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:38.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.104+0000 7f19d1ab6640 1 -- 172.21.15.7:0/2870576781 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19cc0ff750 con 0x7f19b40b65e0 2024-09-21T05:53:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.108+0000 7f19c8ff9640 1 -- 172.21.15.7:0/2870576781 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258815 (secure 0 0 0) 0x7f19cc0ff750 con 0x7f19b40b65e0 2024-09-21T05:53:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T05:53:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.112+0000 7f19d1ab6640 1 -- 172.21.15.7:0/2870576781 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f19b40b65e0 msgr2=0x7f19b40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.112+0000 7f19d1ab6640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f19b40b65e0 0x7f19b40b8af0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009230 tx=0x7f19c0000bc0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.112+0000 7f19d1ab6640 1 -- 172.21.15.7:0/2870576781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19cc06bc80 msgr2=0x7f19cc19a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.112+0000 7f19d1ab6640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19cc06bc80 0x7f19cc19a420 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00d950 tx=0x7f19bc00de10 comp rx=0 tx=0).stop 2024-09-21T05:53:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.112+0000 7f19d1ab6640 1 -- 172.21.15.7:0/2870576781 shutdown_connections 2024-09-21T05:53:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.112+0000 7f19d1ab6640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f19b40b65e0 0x7f19b40b8af0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.112+0000 7f19d1ab6640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19cc106b20 0x7f19cc19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.112+0000 7f19d1ab6640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19cc1061d0 0x7f19cc19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.112+0000 7f19d1ab6640 1 --2- 172.21.15.7:0/2870576781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19cc06bc80 0x7f19cc19a420 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.112+0000 7f19d1ab6640 1 -- 172.21.15.7:0/2870576781 >> 172.21.15.7:0/2870576781 conn(0x7f19cc078740 msgr2=0x7f19cc100a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.112+0000 7f19d1ab6640 1 -- 172.21.15.7:0/2870576781 shutdown_connections 2024-09-21T05:53:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.112+0000 7f19d1ab6640 1 -- 172.21.15.7:0/2870576781 wait complete. 2024-09-21T05:53:38.126 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-21T05:53:36.508475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659203,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":673,"num_read_kb":436,"num_write":299,"num_write_kb":2274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2951840,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390104,"kb_used_data":11736,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551720,"statfs":{"total":1151940427776,"available":1151540961280,"internally_reserved":0,"allocated":12017664,"data_stored":6852289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003231"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884672+0000","last_change":"2024-09-21T05:51:50.266316+0000","last_active":"2024-09-21T05:53:22.884672+0000","last_peered":"2024-09-21T05:53:22.884672+0000","last_clean":"2024-09-21T05:53:22.884672+0000","last_became_active":"2024-09-21T05:51:50.265970+0000","last_became_peered":"2024-09-21T05:51:50.265970+0000","last_unstale":"2024-09-21T05:53:22.884672+0000","last_undegraded":"2024-09-21T05:53:22.884672+0000","last_fullsized":"2024-09-21T05:53:22.884672+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:31.728635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882665+0000","last_change":"2024-09-21T05:51:50.254215+0000","last_active":"2024-09-21T05:53:22.882665+0000","last_peered":"2024-09-21T05:53:22.882665+0000","last_clean":"2024-09-21T05:53:22.882665+0000","last_became_active":"2024-09-21T05:51:50.253701+0000","last_became_peered":"2024-09-21T05:51:50.253701+0000","last_unstale":"2024-09-21T05:53:22.882665+0000","last_undegraded":"2024-09-21T05:53:22.882665+0000","last_fullsized":"2024-09-21T05:53:22.882665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:56.211706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884357+0000","last_change":"2024-09-21T05:51:50.258535+0000","last_active":"2024-09-21T05:53:22.884357+0000","last_peered":"2024-09-21T05:53:22.884357+0000","last_clean":"2024-09-21T05:53:22.884357+0000","last_became_active":"2024-09-21T05:51:50.258186+0000","last_became_peered":"2024-09-21T05:51:50.258186+0000","last_unstale":"2024-09-21T05:53:22.884357+0000","last_undegraded":"2024-09-21T05:53:22.884357+0000","last_fullsized":"2024-09-21T05:53:22.884357+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:15.134574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.888046+0000","last_change":"2024-09-21T05:51:50.254832+0000","last_active":"2024-09-21T05:53:22.888046+0000","last_peered":"2024-09-21T05:53:22.888046+0000","last_clean":"2024-09-21T05:53:22.888046+0000","last_became_active":"2024-09-21T05:51:50.254449+0000","last_became_peered":"2024-09-21T05:51:50.254449+0000","last_unstale":"2024-09-21T05:53:22.888046+0000","last_undegraded":"2024-09-21T05:53:22.888046+0000","last_fullsized":"2024-09-21T05:53:22.888046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:31.411808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.870896+0000","last_change":"2024-09-21T05:51:50.251144+0000","last_active":"2024-09-21T05:53:22.870896+0000","last_peered":"2024-09-21T05:53:22.870896+0000","last_clean":"2024-09-21T05:53:22.870896+0000","last_became_active":"2024-09-21T05:51:50.250782+0000","last_became_peered":"2024-09-21T05:51:50.250782+0000","last_unstale":"2024-09-21T05:53:22.870896+0000","last_undegraded":"2024-09-21T05:53:22.870896+0000","last_fullsized":"2024-09-21T05:53:22.870896+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:15.055805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882829+0000","last_change":"2024-09-21T05:51:50.259758+0000","last_active":"2024-09-21T05:53:22.882829+0000","last_peered":"2024-09-21T05:53:22.882829+0000","last_clean":"2024-09-21T05:53:22.882829+0000","last_became_active":"2024-09-21T05:51:50.259358+0000","last_became_peered":"2024-09-21T05:51:50.259358+0000","last_unstale":"2024-09-21T05:53:22.882829+0000","last_undegraded":"2024-09-21T05:53:22.882829+0000","last_fullsized":"2024-09-21T05:53:22.882829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:08.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883614+0000","last_change":"2024-09-21T05:51:50.260018+0000","last_active":"2024-09-21T05:53:22.883614+0000","last_peered":"2024-09-21T05:53:22.883614+0000","last_clean":"2024-09-21T05:53:22.883614+0000","last_became_active":"2024-09-21T05:51:50.257143+0000","last_became_peered":"2024-09-21T05:51:50.257143+0000","last_unstale":"2024-09-21T05:53:22.883614+0000","last_undegraded":"2024-09-21T05:53:22.883614+0000","last_fullsized":"2024-09-21T05:53:22.883614+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:05.579662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882872+0000","last_change":"2024-09-21T05:51:50.256867+0000","last_active":"2024-09-21T05:53:22.882872+0000","last_peered":"2024-09-21T05:53:22.882872+0000","last_clean":"2024-09-21T05:53:22.882872+0000","last_became_active":"2024-09-21T05:51:50.256392+0000","last_became_peered":"2024-09-21T05:51:50.256392+0000","last_unstale":"2024-09-21T05:53:22.882872+0000","last_undegraded":"2024-09-21T05:53:22.882872+0000","last_fullsized":"2024-09-21T05:53:22.882872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:43.169607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882375+0000","last_change":"2024-09-21T05:51:50.260430+0000","last_active":"2024-09-21T05:53:22.882375+0000","last_peered":"2024-09-21T05:53:22.882375+0000","last_clean":"2024-09-21T05:53:22.882375+0000","last_became_active":"2024-09-21T05:51:50.259993+0000","last_became_peered":"2024-09-21T05:51:50.259993+0000","last_unstale":"2024-09-21T05:53:22.882375+0000","last_undegraded":"2024-09-21T05:53:22.882375+0000","last_fullsized":"2024-09-21T05:53:22.882375+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:31.811151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885323+0000","last_change":"2024-09-21T05:51:50.263027+0000","last_active":"2024-09-21T05:53:22.885323+0000","last_peered":"2024-09-21T05:53:22.885323+0000","last_clean":"2024-09-21T05:53:22.885323+0000","last_became_active":"2024-09-21T05:51:50.261816+0000","last_became_peered":"2024-09-21T05:51:50.261816+0000","last_unstale":"2024-09-21T05:53:22.885323+0000","last_undegraded":"2024-09-21T05:53:22.885323+0000","last_fullsized":"2024-09-21T05:53:22.885323+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:39.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.890919+0000","last_change":"2024-09-21T05:51:50.263976+0000","last_active":"2024-09-21T05:53:22.890919+0000","last_peered":"2024-09-21T05:53:22.890919+0000","last_clean":"2024-09-21T05:53:22.890919+0000","last_became_active":"2024-09-21T05:51:50.263179+0000","last_became_peered":"2024-09-21T05:51:50.263179+0000","last_unstale":"2024-09-21T05:53:22.890919+0000","last_undegraded":"2024-09-21T05:53:22.890919+0000","last_fullsized":"2024-09-21T05:53:22.890919+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:08.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.888587+0000","last_change":"2024-09-21T05:51:50.259967+0000","last_active":"2024-09-21T05:53:22.888587+0000","last_peered":"2024-09-21T05:53:22.888587+0000","last_clean":"2024-09-21T05:53:22.888587+0000","last_became_active":"2024-09-21T05:51:50.259460+0000","last_became_peered":"2024-09-21T05:51:50.259460+0000","last_unstale":"2024-09-21T05:53:22.888587+0000","last_undegraded":"2024-09-21T05:53:22.888587+0000","last_fullsized":"2024-09-21T05:53:22.888587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:48.576362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.874864+0000","last_change":"2024-09-21T05:51:50.252949+0000","last_active":"2024-09-21T05:53:22.874864+0000","last_peered":"2024-09-21T05:53:22.874864+0000","last_clean":"2024-09-21T05:53:22.874864+0000","last_became_active":"2024-09-21T05:51:50.252518+0000","last_became_peered":"2024-09-21T05:51:50.252518+0000","last_unstale":"2024-09-21T05:53:22.874864+0000","last_undegraded":"2024-09-21T05:53:22.874864+0000","last_fullsized":"2024-09-21T05:53:22.874864+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:38.145947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884022+0000","last_change":"2024-09-21T05:51:50.250309+0000","last_active":"2024-09-21T05:53:22.884022+0000","last_peered":"2024-09-21T05:53:22.884022+0000","last_clean":"2024-09-21T05:53:22.884022+0000","last_became_active":"2024-09-21T05:51:50.249629+0000","last_became_peered":"2024-09-21T05:51:50.249629+0000","last_unstale":"2024-09-21T05:53:22.884022+0000","last_undegraded":"2024-09-21T05:53:22.884022+0000","last_fullsized":"2024-09-21T05:53:22.884022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:28.551654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885421+0000","last_change":"2024-09-21T05:51:50.242211+0000","last_active":"2024-09-21T05:53:22.885421+0000","last_peered":"2024-09-21T05:53:22.885421+0000","last_clean":"2024-09-21T05:53:22.885421+0000","last_became_active":"2024-09-21T05:51:50.241861+0000","last_became_peered":"2024-09-21T05:51:50.241861+0000","last_unstale":"2024-09-21T05:53:22.885421+0000","last_undegraded":"2024-09-21T05:53:22.885421+0000","last_fullsized":"2024-09-21T05:53:22.885421+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:46.045907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.887928+0000","last_change":"2024-09-21T05:51:50.268926+0000","last_active":"2024-09-21T05:53:22.887928+0000","last_peered":"2024-09-21T05:53:22.887928+0000","last_clean":"2024-09-21T05:53:22.887928+0000","last_became_active":"2024-09-21T05:51:50.268164+0000","last_became_peered":"2024-09-21T05:51:50.268164+0000","last_unstale":"2024-09-21T05:53:22.887928+0000","last_undegraded":"2024-09-21T05:53:22.887928+0000","last_fullsized":"2024-09-21T05:53:22.887928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:43.021303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884646+0000","last_change":"2024-09-21T05:51:50.266365+0000","last_active":"2024-09-21T05:53:22.884646+0000","last_peered":"2024-09-21T05:53:22.884646+0000","last_clean":"2024-09-21T05:53:22.884646+0000","last_became_active":"2024-09-21T05:51:50.265803+0000","last_became_peered":"2024-09-21T05:51:50.265803+0000","last_unstale":"2024-09-21T05:53:22.884646+0000","last_undegraded":"2024-09-21T05:53:22.884646+0000","last_fullsized":"2024-09-21T05:53:22.884646+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:45.574795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.877825+0000","last_change":"2024-09-21T05:51:50.257129+0000","last_active":"2024-09-21T05:53:22.877825+0000","last_peered":"2024-09-21T05:53:22.877825+0000","last_clean":"2024-09-21T05:53:22.877825+0000","last_became_active":"2024-09-21T05:51:50.256721+0000","last_became_peered":"2024-09-21T05:51:50.256721+0000","last_unstale":"2024-09-21T05:53:22.877825+0000","last_undegraded":"2024-09-21T05:53:22.877825+0000","last_fullsized":"2024-09-21T05:53:22.877825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:26.688743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.881613+0000","last_change":"2024-09-21T05:51:50.243460+0000","last_active":"2024-09-21T05:53:22.881613+0000","last_peered":"2024-09-21T05:53:22.881613+0000","last_clean":"2024-09-21T05:53:22.881613+0000","last_became_active":"2024-09-21T05:51:50.243094+0000","last_became_peered":"2024-09-21T05:51:50.243094+0000","last_unstale":"2024-09-21T05:53:22.881613+0000","last_undegraded":"2024-09-21T05:53:22.881613+0000","last_fullsized":"2024-09-21T05:53:22.881613+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:16.751564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.871108+0000","last_change":"2024-09-21T05:52:23.595697+0000","last_active":"2024-09-21T05:53:22.871108+0000","last_peered":"2024-09-21T05:53:22.871108+0000","last_clean":"2024-09-21T05:53:22.871108+0000","last_became_active":"2024-09-21T05:52:23.595173+0000","last_became_peered":"2024-09-21T05:52:23.595173+0000","last_unstale":"2024-09-21T05:53:22.871108+0000","last_undegraded":"2024-09-21T05:53:22.871108+0000","last_fullsized":"2024-09-21T05:53:22.871108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.036215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883343+0000","last_change":"2024-09-21T05:51:50.251288+0000","last_active":"2024-09-21T05:53:22.883343+0000","last_peered":"2024-09-21T05:53:22.883343+0000","last_clean":"2024-09-21T05:53:22.883343+0000","last_became_active":"2024-09-21T05:51:50.250841+0000","last_became_peered":"2024-09-21T05:51:50.250841+0000","last_unstale":"2024-09-21T05:53:22.883343+0000","last_undegraded":"2024-09-21T05:53:22.883343+0000","last_fullsized":"2024-09-21T05:53:22.883343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:44.196822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.890690+0000","last_change":"2024-09-21T05:51:50.259418+0000","last_active":"2024-09-21T05:53:22.890690+0000","last_peered":"2024-09-21T05:53:22.890690+0000","last_clean":"2024-09-21T05:53:22.890690+0000","last_became_active":"2024-09-21T05:51:50.257641+0000","last_became_peered":"2024-09-21T05:51:50.257641+0000","last_unstale":"2024-09-21T05:53:22.890690+0000","last_undegraded":"2024-09-21T05:53:22.890690+0000","last_fullsized":"2024-09-21T05:53:22.890690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:23.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.873706+0000","last_change":"2024-09-21T05:51:50.252746+0000","last_active":"2024-09-21T05:53:22.873706+0000","last_peered":"2024-09-21T05:53:22.873706+0000","last_clean":"2024-09-21T05:53:22.873706+0000","last_became_active":"2024-09-21T05:51:50.250551+0000","last_became_peered":"2024-09-21T05:51:50.250551+0000","last_unstale":"2024-09-21T05:53:22.873706+0000","last_undegraded":"2024-09-21T05:53:22.873706+0000","last_fullsized":"2024-09-21T05:53:22.873706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:05.821737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883838+0000","last_change":"2024-09-21T05:51:50.246170+0000","last_active":"2024-09-21T05:53:22.883838+0000","last_peered":"2024-09-21T05:53:22.883838+0000","last_clean":"2024-09-21T05:53:22.883838+0000","last_became_active":"2024-09-21T05:51:50.245747+0000","last_became_peered":"2024-09-21T05:51:50.245747+0000","last_unstale":"2024-09-21T05:53:22.883838+0000","last_undegraded":"2024-09-21T05:53:22.883838+0000","last_fullsized":"2024-09-21T05:53:22.883838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:05.005437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.873161+0000","last_change":"2024-09-21T05:51:50.258248+0000","last_active":"2024-09-21T05:53:22.873161+0000","last_peered":"2024-09-21T05:53:22.873161+0000","last_clean":"2024-09-21T05:53:22.873161+0000","last_became_active":"2024-09-21T05:51:50.257891+0000","last_became_peered":"2024-09-21T05:51:50.257891+0000","last_unstale":"2024-09-21T05:53:22.873161+0000","last_undegraded":"2024-09-21T05:53:22.873161+0000","last_fullsized":"2024-09-21T05:53:22.873161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:44.093064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.888481+0000","last_change":"2024-09-21T05:51:50.258497+0000","last_active":"2024-09-21T05:53:22.888481+0000","last_peered":"2024-09-21T05:53:22.888481+0000","last_clean":"2024-09-21T05:53:22.888481+0000","last_became_active":"2024-09-21T05:51:50.257633+0000","last_became_peered":"2024-09-21T05:51:50.257633+0000","last_unstale":"2024-09-21T05:53:22.888481+0000","last_undegraded":"2024-09-21T05:53:22.888481+0000","last_fullsized":"2024-09-21T05:53:22.888481+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:41.793650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.875220+0000","last_change":"2024-09-21T05:51:50.255336+0000","last_active":"2024-09-21T05:53:22.875220+0000","last_peered":"2024-09-21T05:53:22.875220+0000","last_clean":"2024-09-21T05:53:22.875220+0000","last_became_active":"2024-09-21T05:51:50.254955+0000","last_became_peered":"2024-09-21T05:51:50.254955+0000","last_unstale":"2024-09-21T05:53:22.875220+0000","last_undegraded":"2024-09-21T05:53:22.875220+0000","last_fullsized":"2024-09-21T05:53:22.875220+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:28.198455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.887359+0000","last_change":"2024-09-21T05:51:50.242391+0000","last_active":"2024-09-21T05:53:22.887359+0000","last_peered":"2024-09-21T05:53:22.887359+0000","last_clean":"2024-09-21T05:53:22.887359+0000","last_became_active":"2024-09-21T05:51:50.242055+0000","last_became_peered":"2024-09-21T05:51:50.242055+0000","last_unstale":"2024-09-21T05:53:22.887359+0000","last_undegraded":"2024-09-21T05:53:22.887359+0000","last_fullsized":"2024-09-21T05:53:22.887359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:48.937516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885688+0000","last_change":"2024-09-21T05:51:50.243343+0000","last_active":"2024-09-21T05:53:22.885688+0000","last_peered":"2024-09-21T05:53:22.885688+0000","last_clean":"2024-09-21T05:53:22.885688+0000","last_became_active":"2024-09-21T05:51:50.243005+0000","last_became_peered":"2024-09-21T05:51:50.243005+0000","last_unstale":"2024-09-21T05:53:22.885688+0000","last_undegraded":"2024-09-21T05:53:22.885688+0000","last_fullsized":"2024-09-21T05:53:22.885688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:51.975966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883168+0000","last_change":"2024-09-21T05:51:50.250290+0000","last_active":"2024-09-21T05:53:22.883168+0000","last_peered":"2024-09-21T05:53:22.883168+0000","last_clean":"2024-09-21T05:53:22.883168+0000","last_became_active":"2024-09-21T05:51:50.249867+0000","last_became_peered":"2024-09-21T05:51:50.249867+0000","last_unstale":"2024-09-21T05:53:22.883168+0000","last_undegraded":"2024-09-21T05:53:22.883168+0000","last_fullsized":"2024-09-21T05:53:22.883168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:33.852383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.881035+0000","last_change":"2024-09-21T05:51:50.244908+0000","last_active":"2024-09-21T05:53:22.881035+0000","last_peered":"2024-09-21T05:53:22.881035+0000","last_clean":"2024-09-21T05:53:22.881035+0000","last_became_active":"2024-09-21T05:51:50.244473+0000","last_became_peered":"2024-09-21T05:51:50.244473+0000","last_unstale":"2024-09-21T05:53:22.881035+0000","last_undegraded":"2024-09-21T05:53:22.881035+0000","last_fullsized":"2024-09-21T05:53:22.881035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:08.040920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.876658+0000","last_change":"2024-09-21T05:51:50.259926+0000","last_active":"2024-09-21T05:53:22.876658+0000","last_peered":"2024-09-21T05:53:22.876658+0000","last_clean":"2024-09-21T05:53:22.876658+0000","last_became_active":"2024-09-21T05:51:50.259511+0000","last_became_peered":"2024-09-21T05:51:50.259511+0000","last_unstale":"2024-09-21T05:53:22.876658+0000","last_undegraded":"2024-09-21T05:53:22.876658+0000","last_fullsized":"2024-09-21T05:53:22.876658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:46.735741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.858517+0000","last_change":"2024-09-21T05:51:50.249474+0000","last_active":"2024-09-21T05:53:22.858517+0000","last_peered":"2024-09-21T05:53:22.858517+0000","last_clean":"2024-09-21T05:53:22.858517+0000","last_became_active":"2024-09-21T05:51:50.247503+0000","last_became_peered":"2024-09-21T05:51:50.247503+0000","last_unstale":"2024-09-21T05:53:22.858517+0000","last_undegraded":"2024-09-21T05:53:22.858517+0000","last_fullsized":"2024-09-21T05:53:22.858517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:11.639218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:33.480859+0000","last_change":"2024-09-21T05:51:48.236001+0000","last_active":"2024-09-21T05:53:33.480859+0000","last_peered":"2024-09-21T05:53:33.480859+0000","last_clean":"2024-09-21T05:53:33.480859+0000","last_became_active":"2024-09-21T05:51:48.235603+0000","last_became_peered":"2024-09-21T05:51:48.235603+0000","last_unstale":"2024-09-21T05:53:33.480859+0000","last_undegraded":"2024-09-21T05:53:33.480859+0000","last_fullsized":"2024-09-21T05:53:33.480859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:33.217248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885281+0000","last_change":"2024-09-21T05:52:23.599125+0000","last_active":"2024-09-21T05:53:22.885281+0000","last_peered":"2024-09-21T05:53:22.885281+0000","last_clean":"2024-09-21T05:53:22.885281+0000","last_became_active":"2024-09-21T05:52:23.598739+0000","last_became_peered":"2024-09-21T05:52:23.598739+0000","last_unstale":"2024-09-21T05:53:22.885281+0000","last_undegraded":"2024-09-21T05:53:22.885281+0000","last_fullsized":"2024-09-21T05:53:22.885281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:20.838698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.585476+0000","last_change":"2024-09-21T05:51:48.230191+0000","last_active":"2024-09-21T05:52:23.585476+0000","last_peered":"2024-09-21T05:52:23.585476+0000","last_clean":"2024-09-21T05:52:23.585476+0000","last_became_active":"2024-09-21T05:51:48.229780+0000","last_became_peered":"2024-09-21T05:51:48.229780+0000","last_unstale":"2024-09-21T05:52:23.585476+0000","last_undegraded":"2024-09-21T05:52:23.585476+0000","last_fullsized":"2024-09-21T05:52:23.585476+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:34.950404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584118+0000","last_change":"2024-09-21T05:51:48.224115+0000","last_active":"2024-09-21T05:52:23.584118+0000","last_peered":"2024-09-21T05:52:23.584118+0000","last_clean":"2024-09-21T05:52:23.584118+0000","last_became_active":"2024-09-21T05:51:48.223714+0000","last_became_peered":"2024-09-21T05:51:48.223714+0000","last_unstale":"2024-09-21T05:52:23.584118+0000","last_undegraded":"2024-09-21T05:52:23.584118+0000","last_fullsized":"2024-09-21T05:52:23.584118+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:29.450354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.875426+0000","last_change":"2024-09-21T05:51:50.250129+0000","last_active":"2024-09-21T05:53:22.875426+0000","last_peered":"2024-09-21T05:53:22.875426+0000","last_clean":"2024-09-21T05:53:22.875426+0000","last_became_active":"2024-09-21T05:51:50.249743+0000","last_became_peered":"2024-09-21T05:51:50.249743+0000","last_unstale":"2024-09-21T05:53:22.875426+0000","last_undegraded":"2024-09-21T05:53:22.875426+0000","last_fullsized":"2024-09-21T05:53:22.875426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:37.204476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596516+0000","last_change":"2024-09-21T05:51:48.236289+0000","last_active":"2024-09-21T05:52:23.596516+0000","last_peered":"2024-09-21T05:52:23.596516+0000","last_clean":"2024-09-21T05:52:23.596516+0000","last_became_active":"2024-09-21T05:51:48.235898+0000","last_became_peered":"2024-09-21T05:51:48.235898+0000","last_unstale":"2024-09-21T05:52:23.596516+0000","last_undegraded":"2024-09-21T05:52:23.596516+0000","last_fullsized":"2024-09-21T05:52:23.596516+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:05.457237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.877338+0000","last_change":"2024-09-21T05:51:50.251905+0000","last_active":"2024-09-21T05:53:22.877338+0000","last_peered":"2024-09-21T05:53:22.877338+0000","last_clean":"2024-09-21T05:53:22.877338+0000","last_became_active":"2024-09-21T05:51:50.251537+0000","last_became_peered":"2024-09-21T05:51:50.251537+0000","last_unstale":"2024-09-21T05:53:22.877338+0000","last_undegraded":"2024-09-21T05:53:22.877338+0000","last_fullsized":"2024-09-21T05:53:22.877338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:57.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":119,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:31.477025+0000","last_change":"2024-09-21T05:51:48.232007+0000","last_active":"2024-09-21T05:53:31.477025+0000","last_peered":"2024-09-21T05:53:31.477025+0000","last_clean":"2024-09-21T05:53:31.477025+0000","last_became_active":"2024-09-21T05:51:48.231534+0000","last_became_peered":"2024-09-21T05:51:48.231534+0000","last_unstale":"2024-09-21T05:53:31.477025+0000","last_undegraded":"2024-09-21T05:53:31.477025+0000","last_fullsized":"2024-09-21T05:53:31.477025+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:05.874618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.879196+0000","last_change":"2024-09-21T05:51:50.265224+0000","last_active":"2024-09-21T05:53:22.879196+0000","last_peered":"2024-09-21T05:53:22.879196+0000","last_clean":"2024-09-21T05:53:22.879196+0000","last_became_active":"2024-09-21T05:51:50.264690+0000","last_became_peered":"2024-09-21T05:51:50.264690+0000","last_unstale":"2024-09-21T05:53:22.879196+0000","last_undegraded":"2024-09-21T05:53:22.879196+0000","last_fullsized":"2024-09-21T05:53:22.879196+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:15.835492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587907+0000","last_change":"2024-09-21T05:51:48.233092+0000","last_active":"2024-09-21T05:52:23.587907+0000","last_peered":"2024-09-21T05:52:23.587907+0000","last_clean":"2024-09-21T05:52:23.587907+0000","last_became_active":"2024-09-21T05:51:48.232684+0000","last_became_peered":"2024-09-21T05:51:48.232684+0000","last_unstale":"2024-09-21T05:52:23.587907+0000","last_undegraded":"2024-09-21T05:52:23.587907+0000","last_fullsized":"2024-09-21T05:52:23.587907+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:21.664828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885615+0000","last_change":"2024-09-21T05:51:50.248419+0000","last_active":"2024-09-21T05:53:22.885615+0000","last_peered":"2024-09-21T05:53:22.885615+0000","last_clean":"2024-09-21T05:53:22.885615+0000","last_became_active":"2024-09-21T05:51:50.247871+0000","last_became_peered":"2024-09-21T05:51:50.247871+0000","last_unstale":"2024-09-21T05:53:22.885615+0000","last_undegraded":"2024-09-21T05:53:22.885615+0000","last_fullsized":"2024-09-21T05:53:22.885615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:49.851685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596905+0000","last_change":"2024-09-21T05:51:48.338367+0000","last_active":"2024-09-21T05:52:23.596905+0000","last_peered":"2024-09-21T05:52:23.596905+0000","last_clean":"2024-09-21T05:52:23.596905+0000","last_became_active":"2024-09-21T05:51:48.337992+0000","last_became_peered":"2024-09-21T05:51:48.337992+0000","last_unstale":"2024-09-21T05:52:23.596905+0000","last_undegraded":"2024-09-21T05:52:23.596905+0000","last_fullsized":"2024-09-21T05:52:23.596905+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:52.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.889702+0000","last_change":"2024-09-21T05:51:50.267046+0000","last_active":"2024-09-21T05:53:22.889702+0000","last_peered":"2024-09-21T05:53:22.889702+0000","last_clean":"2024-09-21T05:53:22.889702+0000","last_became_active":"2024-09-21T05:51:50.266672+0000","last_became_peered":"2024-09-21T05:51:50.266672+0000","last_unstale":"2024-09-21T05:53:22.889702+0000","last_undegraded":"2024-09-21T05:53:22.889702+0000","last_fullsized":"2024-09-21T05:53:22.889702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:53.628646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'32","reported_seq":251,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:32.479617+0000","last_change":"2024-09-21T05:51:48.233804+0000","last_active":"2024-09-21T05:53:32.479617+0000","last_peered":"2024-09-21T05:53:32.479617+0000","last_clean":"2024-09-21T05:53:32.479617+0000","last_became_active":"2024-09-21T05:51:48.233386+0000","last_became_peered":"2024-09-21T05:51:48.233386+0000","last_unstale":"2024-09-21T05:53:32.479617+0000","last_undegraded":"2024-09-21T05:53:32.479617+0000","last_fullsized":"2024-09-21T05:53:32.479617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:45.644005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64459,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":160,"num_write":33,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.868907+0000","last_change":"2024-09-21T05:51:50.257673+0000","last_active":"2024-09-21T05:53:22.868907+0000","last_peered":"2024-09-21T05:53:22.868907+0000","last_clean":"2024-09-21T05:53:22.868907+0000","last_became_active":"2024-09-21T05:51:50.257319+0000","last_became_peered":"2024-09-21T05:51:50.257319+0000","last_unstale":"2024-09-21T05:53:22.868907+0000","last_undegraded":"2024-09-21T05:53:22.868907+0000","last_fullsized":"2024-09-21T05:53:22.868907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:26.008964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587400+0000","last_change":"2024-09-21T05:51:48.233264+0000","last_active":"2024-09-21T05:52:23.587400+0000","last_peered":"2024-09-21T05:52:23.587400+0000","last_clean":"2024-09-21T05:52:23.587400+0000","last_became_active":"2024-09-21T05:51:48.232808+0000","last_became_peered":"2024-09-21T05:51:48.232808+0000","last_unstale":"2024-09-21T05:52:23.587400+0000","last_undegraded":"2024-09-21T05:52:23.587400+0000","last_fullsized":"2024-09-21T05:52:23.587400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:05.105861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883211+0000","last_change":"2024-09-21T05:51:50.251727+0000","last_active":"2024-09-21T05:53:22.883211+0000","last_peered":"2024-09-21T05:53:22.883211+0000","last_clean":"2024-09-21T05:53:22.883211+0000","last_became_active":"2024-09-21T05:51:50.251382+0000","last_became_peered":"2024-09-21T05:51:50.251382+0000","last_unstale":"2024-09-21T05:53:22.883211+0000","last_undegraded":"2024-09-21T05:53:22.883211+0000","last_fullsized":"2024-09-21T05:53:22.883211+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:30.098548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596648+0000","last_change":"2024-09-21T05:51:48.235226+0000","last_active":"2024-09-21T05:52:23.596648+0000","last_peered":"2024-09-21T05:52:23.596648+0000","last_clean":"2024-09-21T05:52:23.596648+0000","last_became_active":"2024-09-21T05:51:48.234432+0000","last_became_peered":"2024-09-21T05:51:48.234432+0000","last_unstale":"2024-09-21T05:52:23.596648+0000","last_undegraded":"2024-09-21T05:52:23.596648+0000","last_fullsized":"2024-09-21T05:52:23.596648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:49.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.892298+0000","last_change":"2024-09-21T05:51:50.260276+0000","last_active":"2024-09-21T05:53:22.892298+0000","last_peered":"2024-09-21T05:53:22.892298+0000","last_clean":"2024-09-21T05:53:22.892298+0000","last_became_active":"2024-09-21T05:51:50.257448+0000","last_became_peered":"2024-09-21T05:51:50.257448+0000","last_unstale":"2024-09-21T05:53:22.892298+0000","last_undegraded":"2024-09-21T05:53:22.892298+0000","last_fullsized":"2024-09-21T05:53:22.892298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:46.052226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:32.479720+0000","last_change":"2024-09-21T05:51:48.230764+0000","last_active":"2024-09-21T05:53:32.479720+0000","last_peered":"2024-09-21T05:53:32.479720+0000","last_clean":"2024-09-21T05:53:32.479720+0000","last_became_active":"2024-09-21T05:51:48.230332+0000","last_became_peered":"2024-09-21T05:51:48.230332+0000","last_unstale":"2024-09-21T05:53:32.479720+0000","last_undegraded":"2024-09-21T05:53:32.479720+0000","last_fullsized":"2024-09-21T05:53:32.479720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:33.459588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.889695+0000","last_change":"2024-09-21T05:52:23.589989+0000","last_active":"2024-09-21T05:53:22.889695+0000","last_peered":"2024-09-21T05:53:22.889695+0000","last_clean":"2024-09-21T05:53:22.889695+0000","last_became_active":"2024-09-21T05:52:23.589358+0000","last_became_peered":"2024-09-21T05:52:23.589358+0000","last_unstale":"2024-09-21T05:53:22.889695+0000","last_undegraded":"2024-09-21T05:53:22.889695+0000","last_fullsized":"2024-09-21T05:53:22.889695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:48.706509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589658+0000","last_change":"2024-09-21T05:51:48.338309+0000","last_active":"2024-09-21T05:52:23.589658+0000","last_peered":"2024-09-21T05:52:23.589658+0000","last_clean":"2024-09-21T05:52:23.589658+0000","last_became_active":"2024-09-21T05:51:48.337903+0000","last_became_peered":"2024-09-21T05:51:48.337903+0000","last_unstale":"2024-09-21T05:52:23.589658+0000","last_undegraded":"2024-09-21T05:52:23.589658+0000","last_fullsized":"2024-09-21T05:52:23.589658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:54.634956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.881414+0000","last_change":"2024-09-21T05:51:50.259257+0000","last_active":"2024-09-21T05:53:22.881414+0000","last_peered":"2024-09-21T05:53:22.881414+0000","last_clean":"2024-09-21T05:53:22.881414+0000","last_became_active":"2024-09-21T05:51:50.258892+0000","last_became_peered":"2024-09-21T05:51:50.258892+0000","last_unstale":"2024-09-21T05:53:22.881414+0000","last_undegraded":"2024-09-21T05:53:22.881414+0000","last_fullsized":"2024-09-21T05:53:22.881414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:46.683115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591128+0000","last_change":"2024-09-21T05:51:48.226956+0000","last_active":"2024-09-21T05:52:23.591128+0000","last_peered":"2024-09-21T05:52:23.591128+0000","last_clean":"2024-09-21T05:52:23.591128+0000","last_became_active":"2024-09-21T05:51:48.226531+0000","last_became_peered":"2024-09-21T05:51:48.226531+0000","last_unstale":"2024-09-21T05:52:23.591128+0000","last_undegraded":"2024-09-21T05:52:23.591128+0000","last_fullsized":"2024-09-21T05:52:23.591128+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:14.888074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.874822+0000","last_change":"2024-09-21T05:51:50.261080+0000","last_active":"2024-09-21T05:53:22.874822+0000","last_peered":"2024-09-21T05:53:22.874822+0000","last_clean":"2024-09-21T05:53:22.874822+0000","last_became_active":"2024-09-21T05:51:50.260700+0000","last_became_peered":"2024-09-21T05:51:50.260700+0000","last_unstale":"2024-09-21T05:53:22.874822+0000","last_undegraded":"2024-09-21T05:53:22.874822+0000","last_fullsized":"2024-09-21T05:53:22.874822+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.033889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584270+0000","last_change":"2024-09-21T05:51:48.230236+0000","last_active":"2024-09-21T05:52:23.584270+0000","last_peered":"2024-09-21T05:52:23.584270+0000","last_clean":"2024-09-21T05:52:23.584270+0000","last_became_active":"2024-09-21T05:51:48.229775+0000","last_became_peered":"2024-09-21T05:51:48.229775+0000","last_unstale":"2024-09-21T05:52:23.584270+0000","last_undegraded":"2024-09-21T05:52:23.584270+0000","last_fullsized":"2024-09-21T05:52:23.584270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:25.371256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.888276+0000","last_change":"2024-09-21T05:51:50.260749+0000","last_active":"2024-09-21T05:53:22.888276+0000","last_peered":"2024-09-21T05:53:22.888276+0000","last_clean":"2024-09-21T05:53:22.888276+0000","last_became_active":"2024-09-21T05:51:50.257406+0000","last_became_peered":"2024-09-21T05:51:50.257406+0000","last_unstale":"2024-09-21T05:53:22.888276+0000","last_undegraded":"2024-09-21T05:53:22.888276+0000","last_fullsized":"2024-09-21T05:53:22.888276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:18.293144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596986+0000","last_change":"2024-09-21T05:51:48.228752+0000","last_active":"2024-09-21T05:52:23.596986+0000","last_peered":"2024-09-21T05:52:23.596986+0000","last_clean":"2024-09-21T05:52:23.596986+0000","last_became_active":"2024-09-21T05:51:48.228361+0000","last_became_peered":"2024-09-21T05:51:48.228361+0000","last_unstale":"2024-09-21T05:52:23.596986+0000","last_undegraded":"2024-09-21T05:52:23.596986+0000","last_fullsized":"2024-09-21T05:52:23.596986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:05.868153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883312+0000","last_change":"2024-09-21T05:51:50.256183+0000","last_active":"2024-09-21T05:53:22.883312+0000","last_peered":"2024-09-21T05:53:22.883312+0000","last_clean":"2024-09-21T05:53:22.883312+0000","last_became_active":"2024-09-21T05:51:50.255746+0000","last_became_peered":"2024-09-21T05:51:50.255746+0000","last_unstale":"2024-09-21T05:53:22.883312+0000","last_undegraded":"2024-09-21T05:53:22.883312+0000","last_fullsized":"2024-09-21T05:53:22.883312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:29.044470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587539+0000","last_change":"2024-09-21T05:51:48.852935+0000","last_active":"2024-09-21T05:52:23.587539+0000","last_peered":"2024-09-21T05:52:23.587539+0000","last_clean":"2024-09-21T05:52:23.587539+0000","last_became_active":"2024-09-21T05:51:48.852457+0000","last_became_peered":"2024-09-21T05:51:48.852457+0000","last_unstale":"2024-09-21T05:52:23.587539+0000","last_undegraded":"2024-09-21T05:52:23.587539+0000","last_fullsized":"2024-09-21T05:52:23.587539+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:12.109669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.891006+0000","last_change":"2024-09-21T05:51:50.261136+0000","last_active":"2024-09-21T05:53:22.891006+0000","last_peered":"2024-09-21T05:53:22.891006+0000","last_clean":"2024-09-21T05:53:22.891006+0000","last_became_active":"2024-09-21T05:51:50.260698+0000","last_became_peered":"2024-09-21T05:51:50.260698+0000","last_unstale":"2024-09-21T05:53:22.891006+0000","last_undegraded":"2024-09-21T05:53:22.891006+0000","last_fullsized":"2024-09-21T05:53:22.891006+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:34.480352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.588600+0000","last_change":"2024-09-21T05:50:40.836627+0000","last_active":"2024-09-21T05:52:23.588600+0000","last_peered":"2024-09-21T05:52:23.588600+0000","last_clean":"2024-09-21T05:52:23.588600+0000","last_became_active":"2024-09-21T05:50:40.830426+0000","last_became_peered":"2024-09-21T05:50:40.830426+0000","last_unstale":"2024-09-21T05:52:23.588600+0000","last_undegraded":"2024-09-21T05:52:23.588600+0000","last_fullsized":"2024-09-21T05:52:23.588600+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_clean_scrub_stamp":"2024-09-21T05:47:21.634945+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:33.394077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.687599+0000","last_change":"2024-09-21T05:51:48.228187+0000","last_active":"2024-09-21T05:52:23.687599+0000","last_peered":"2024-09-21T05:52:23.687599+0000","last_clean":"2024-09-21T05:52:23.687599+0000","last_became_active":"2024-09-21T05:51:48.227690+0000","last_became_peered":"2024-09-21T05:51:48.227690+0000","last_unstale":"2024-09-21T05:52:23.687599+0000","last_undegraded":"2024-09-21T05:52:23.687599+0000","last_fullsized":"2024-09-21T05:52:23.687599+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:37.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.877903+0000","last_change":"2024-09-21T05:52:23.705127+0000","last_active":"2024-09-21T05:53:22.877903+0000","last_peered":"2024-09-21T05:53:22.877903+0000","last_clean":"2024-09-21T05:53:22.877903+0000","last_became_active":"2024-09-21T05:52:23.704731+0000","last_became_peered":"2024-09-21T05:52:23.704731+0000","last_unstale":"2024-09-21T05:53:22.877903+0000","last_undegraded":"2024-09-21T05:53:22.877903+0000","last_fullsized":"2024-09-21T05:53:22.877903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:49.264072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.588183+0000","last_change":"2024-09-21T05:51:48.234444+0000","last_active":"2024-09-21T05:52:23.588183+0000","last_peered":"2024-09-21T05:52:23.588183+0000","last_clean":"2024-09-21T05:52:23.588183+0000","last_became_active":"2024-09-21T05:51:48.233997+0000","last_became_peered":"2024-09-21T05:51:48.233997+0000","last_unstale":"2024-09-21T05:52:23.588183+0000","last_undegraded":"2024-09-21T05:52:23.588183+0000","last_fullsized":"2024-09-21T05:52:23.588183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:12.931628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885618+0000","last_change":"2024-09-21T05:51:50.242267+0000","last_active":"2024-09-21T05:53:22.885618+0000","last_peered":"2024-09-21T05:53:22.885618+0000","last_clean":"2024-09-21T05:53:22.885618+0000","last_became_active":"2024-09-21T05:51:50.241927+0000","last_became_peered":"2024-09-21T05:51:50.241927+0000","last_unstale":"2024-09-21T05:53:22.885618+0000","last_undegraded":"2024-09-21T05:53:22.885618+0000","last_fullsized":"2024-09-21T05:53:22.885618+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:28.954451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":122,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:32.479109+0000","last_change":"2024-09-21T05:51:48.338372+0000","last_active":"2024-09-21T05:53:32.479109+0000","last_peered":"2024-09-21T05:53:32.479109+0000","last_clean":"2024-09-21T05:53:32.479109+0000","last_became_active":"2024-09-21T05:51:48.337966+0000","last_became_peered":"2024-09-21T05:51:48.337966+0000","last_unstale":"2024-09-21T05:53:32.479109+0000","last_undegraded":"2024-09-21T05:53:32.479109+0000","last_fullsized":"2024-09-21T05:53:32.479109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:10.301871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.880256+0000","last_change":"2024-09-21T05:51:50.253151+0000","last_active":"2024-09-21T05:53:22.880256+0000","last_peered":"2024-09-21T05:53:22.880256+0000","last_clean":"2024-09-21T05:53:22.880256+0000","last_became_active":"2024-09-21T05:51:50.252770+0000","last_became_peered":"2024-09-21T05:51:50.252770+0000","last_unstale":"2024-09-21T05:53:22.880256+0000","last_undegraded":"2024-09-21T05:53:22.880256+0000","last_fullsized":"2024-09-21T05:53:22.880256+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:48.784229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587728+0000","last_change":"2024-09-21T05:51:48.233273+0000","last_active":"2024-09-21T05:52:23.587728+0000","last_peered":"2024-09-21T05:52:23.587728+0000","last_clean":"2024-09-21T05:52:23.587728+0000","last_became_active":"2024-09-21T05:51:48.232724+0000","last_became_peered":"2024-09-21T05:51:48.232724+0000","last_unstale":"2024-09-21T05:52:23.587728+0000","last_undegraded":"2024-09-21T05:52:23.587728+0000","last_fullsized":"2024-09-21T05:52:23.587728+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:50.869396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.878794+0000","last_change":"2024-09-21T05:51:50.262521+0000","last_active":"2024-09-21T05:53:22.878794+0000","last_peered":"2024-09-21T05:53:22.878794+0000","last_clean":"2024-09-21T05:53:22.878794+0000","last_became_active":"2024-09-21T05:51:50.262135+0000","last_became_peered":"2024-09-21T05:51:50.262135+0000","last_unstale":"2024-09-21T05:53:22.878794+0000","last_undegraded":"2024-09-21T05:53:22.878794+0000","last_fullsized":"2024-09-21T05:53:22.878794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:18.347182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587326+0000","last_change":"2024-09-21T05:51:48.338532+0000","last_active":"2024-09-21T05:52:23.587326+0000","last_peered":"2024-09-21T05:52:23.587326+0000","last_clean":"2024-09-21T05:52:23.587326+0000","last_became_active":"2024-09-21T05:51:48.338099+0000","last_became_peered":"2024-09-21T05:51:48.338099+0000","last_unstale":"2024-09-21T05:52:23.587326+0000","last_undegraded":"2024-09-21T05:52:23.587326+0000","last_fullsized":"2024-09-21T05:52:23.587326+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:48.670988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.877307+0000","last_change":"2024-09-21T05:51:50.251814+0000","last_active":"2024-09-21T05:53:22.877307+0000","last_peered":"2024-09-21T05:53:22.877307+0000","last_clean":"2024-09-21T05:53:22.877307+0000","last_became_active":"2024-09-21T05:51:50.251401+0000","last_became_peered":"2024-09-21T05:51:50.251401+0000","last_unstale":"2024-09-21T05:53:22.877307+0000","last_undegraded":"2024-09-21T05:53:22.877307+0000","last_fullsized":"2024-09-21T05:53:22.877307+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:12.972300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590808+0000","last_change":"2024-09-21T05:51:48.338312+0000","last_active":"2024-09-21T05:52:23.590808+0000","last_peered":"2024-09-21T05:52:23.590808+0000","last_clean":"2024-09-21T05:52:23.590808+0000","last_became_active":"2024-09-21T05:51:48.337872+0000","last_became_peered":"2024-09-21T05:51:48.337872+0000","last_unstale":"2024-09-21T05:52:23.590808+0000","last_undegraded":"2024-09-21T05:52:23.590808+0000","last_fullsized":"2024-09-21T05:52:23.590808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:26.158650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.879034+0000","last_change":"2024-09-21T05:51:50.245129+0000","last_active":"2024-09-21T05:53:22.879034+0000","last_peered":"2024-09-21T05:53:22.879034+0000","last_clean":"2024-09-21T05:53:22.879034+0000","last_became_active":"2024-09-21T05:51:50.244439+0000","last_became_peered":"2024-09-21T05:51:50.244439+0000","last_unstale":"2024-09-21T05:53:22.879034+0000","last_undegraded":"2024-09-21T05:53:22.879034+0000","last_fullsized":"2024-09-21T05:53:22.879034+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:19.241921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'14","reported_seq":50,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:23.275479+0000","last_change":"2024-09-21T05:52:23.600272+0000","last_active":"2024-09-21T05:53:23.275479+0000","last_peered":"2024-09-21T05:53:23.275479+0000","last_clean":"2024-09-21T05:53:23.275479+0000","last_became_active":"2024-09-21T05:52:23.592946+0000","last_became_peered":"2024-09-21T05:52:23.592946+0000","last_unstale":"2024-09-21T05:53:23.275479+0000","last_undegraded":"2024-09-21T05:53:23.275479+0000","last_fullsized":"2024-09-21T05:53:23.275479+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:52.892645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.887100+0000","last_change":"2024-09-21T05:51:50.253411+0000","last_active":"2024-09-21T05:53:22.887100+0000","last_peered":"2024-09-21T05:53:22.887100+0000","last_clean":"2024-09-21T05:53:22.887100+0000","last_became_active":"2024-09-21T05:51:50.252816+0000","last_became_peered":"2024-09-21T05:51:50.252816+0000","last_unstale":"2024-09-21T05:53:22.887100+0000","last_undegraded":"2024-09-21T05:53:22.887100+0000","last_fullsized":"2024-09-21T05:53:22.887100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:33.444176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.688065+0000","last_change":"2024-09-21T05:51:48.852668+0000","last_active":"2024-09-21T05:52:23.688065+0000","last_peered":"2024-09-21T05:52:23.688065+0000","last_clean":"2024-09-21T05:52:23.688065+0000","last_became_active":"2024-09-21T05:51:48.852298+0000","last_became_peered":"2024-09-21T05:51:48.852298+0000","last_unstale":"2024-09-21T05:52:23.688065+0000","last_undegraded":"2024-09-21T05:52:23.688065+0000","last_fullsized":"2024-09-21T05:52:23.688065+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:19.529194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885939+0000","last_change":"2024-09-21T05:51:50.246720+0000","last_active":"2024-09-21T05:53:22.885939+0000","last_peered":"2024-09-21T05:53:22.885939+0000","last_clean":"2024-09-21T05:53:22.885939+0000","last_became_active":"2024-09-21T05:51:50.246318+0000","last_became_peered":"2024-09-21T05:51:50.246318+0000","last_unstale":"2024-09-21T05:53:22.885939+0000","last_undegraded":"2024-09-21T05:53:22.885939+0000","last_fullsized":"2024-09-21T05:53:22.885939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:45.737949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703802+0000","last_change":"2024-09-21T05:51:48.338346+0000","last_active":"2024-09-21T05:52:23.703802+0000","last_peered":"2024-09-21T05:52:23.703802+0000","last_clean":"2024-09-21T05:52:23.703802+0000","last_became_active":"2024-09-21T05:51:48.337968+0000","last_became_peered":"2024-09-21T05:51:48.337968+0000","last_unstale":"2024-09-21T05:52:23.703802+0000","last_undegraded":"2024-09-21T05:52:23.703802+0000","last_fullsized":"2024-09-21T05:52:23.703802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:32.450546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.840051+0000","last_change":"2024-09-21T05:51:50.255993+0000","last_active":"2024-09-21T05:53:22.840051+0000","last_peered":"2024-09-21T05:53:22.840051+0000","last_clean":"2024-09-21T05:53:22.840051+0000","last_became_active":"2024-09-21T05:51:50.255645+0000","last_became_peered":"2024-09-21T05:51:50.255645+0000","last_unstale":"2024-09-21T05:53:22.840051+0000","last_undegraded":"2024-09-21T05:53:22.840051+0000","last_fullsized":"2024-09-21T05:53:22.840051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.890940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589612+0000","last_change":"2024-09-21T05:51:48.231659+0000","last_active":"2024-09-21T05:52:23.589612+0000","last_peered":"2024-09-21T05:52:23.589612+0000","last_clean":"2024-09-21T05:52:23.589612+0000","last_became_active":"2024-09-21T05:51:48.231137+0000","last_became_peered":"2024-09-21T05:51:48.231137+0000","last_unstale":"2024-09-21T05:52:23.589612+0000","last_undegraded":"2024-09-21T05:52:23.589612+0000","last_fullsized":"2024-09-21T05:52:23.589612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:06.166268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884218+0000","last_change":"2024-09-21T05:51:50.251904+0000","last_active":"2024-09-21T05:53:22.884218+0000","last_peered":"2024-09-21T05:53:22.884218+0000","last_clean":"2024-09-21T05:53:22.884218+0000","last_became_active":"2024-09-21T05:51:50.251403+0000","last_became_peered":"2024-09-21T05:51:50.251403+0000","last_unstale":"2024-09-21T05:53:22.884218+0000","last_undegraded":"2024-09-21T05:53:22.884218+0000","last_fullsized":"2024-09-21T05:53:22.884218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:47.702083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.603022+0000","last_change":"2024-09-21T05:52:23.602925+0000","last_active":"2024-09-21T05:52:23.603022+0000","last_peered":"2024-09-21T05:52:23.603022+0000","last_clean":"2024-09-21T05:52:23.603022+0000","last_became_active":"2024-09-21T05:52:23.598086+0000","last_became_peered":"2024-09-21T05:52:23.598086+0000","last_unstale":"2024-09-21T05:52:23.603022+0000","last_undegraded":"2024-09-21T05:52:23.603022+0000","last_fullsized":"2024-09-21T05:52:23.603022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:03.260218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.871098+0000","last_change":"2024-09-21T05:51:50.256654+0000","last_active":"2024-09-21T05:53:22.871098+0000","last_peered":"2024-09-21T05:53:22.871098+0000","last_clean":"2024-09-21T05:53:22.871098+0000","last_became_active":"2024-09-21T05:51:50.255830+0000","last_became_peered":"2024-09-21T05:51:50.255830+0000","last_unstale":"2024-09-21T05:53:22.871098+0000","last_undegraded":"2024-09-21T05:53:22.871098+0000","last_fullsized":"2024-09-21T05:53:22.871098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:49.643890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591174+0000","last_change":"2024-09-21T05:51:48.233608+0000","last_active":"2024-09-21T05:52:23.591174+0000","last_peered":"2024-09-21T05:52:23.591174+0000","last_clean":"2024-09-21T05:52:23.591174+0000","last_became_active":"2024-09-21T05:51:48.233187+0000","last_became_peered":"2024-09-21T05:51:48.233187+0000","last_unstale":"2024-09-21T05:52:23.591174+0000","last_undegraded":"2024-09-21T05:52:23.591174+0000","last_fullsized":"2024-09-21T05:52:23.591174+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:57.815632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.890931+0000","last_change":"2024-09-21T05:51:50.266753+0000","last_active":"2024-09-21T05:53:22.890931+0000","last_peered":"2024-09-21T05:53:22.890931+0000","last_clean":"2024-09-21T05:53:22.890931+0000","last_became_active":"2024-09-21T05:51:50.266368+0000","last_became_peered":"2024-09-21T05:51:50.266368+0000","last_unstale":"2024-09-21T05:53:22.890931+0000","last_undegraded":"2024-09-21T05:53:22.890931+0000","last_fullsized":"2024-09-21T05:53:22.890931+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:02.011213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882162+0000","last_change":"2024-09-21T05:51:50.257731+0000","last_active":"2024-09-21T05:53:22.882162+0000","last_peered":"2024-09-21T05:53:22.882162+0000","last_clean":"2024-09-21T05:53:22.882162+0000","last_became_active":"2024-09-21T05:51:50.257396+0000","last_became_peered":"2024-09-21T05:51:50.257396+0000","last_unstale":"2024-09-21T05:53:22.882162+0000","last_undegraded":"2024-09-21T05:53:22.882162+0000","last_fullsized":"2024-09-21T05:53:22.882162+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:58.109069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590778+0000","last_change":"2024-09-21T05:51:48.234067+0000","last_active":"2024-09-21T05:52:23.590778+0000","last_peered":"2024-09-21T05:52:23.590778+0000","last_clean":"2024-09-21T05:52:23.590778+0000","last_became_active":"2024-09-21T05:51:48.233532+0000","last_became_peered":"2024-09-21T05:51:48.233532+0000","last_unstale":"2024-09-21T05:52:23.590778+0000","last_undegraded":"2024-09-21T05:52:23.590778+0000","last_fullsized":"2024-09-21T05:52:23.590778+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:40.997254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.880925+0000","last_change":"2024-09-21T05:51:50.265453+0000","last_active":"2024-09-21T05:53:22.880925+0000","last_peered":"2024-09-21T05:53:22.880925+0000","last_clean":"2024-09-21T05:53:22.880925+0000","last_became_active":"2024-09-21T05:51:50.265073+0000","last_became_peered":"2024-09-21T05:51:50.265073+0000","last_unstale":"2024-09-21T05:53:22.880925+0000","last_undegraded":"2024-09-21T05:53:22.880925+0000","last_fullsized":"2024-09-21T05:53:22.880925+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:15.295822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.694313+0000","last_change":"2024-09-21T05:52:23.694236+0000","last_active":"2024-09-21T05:52:23.694313+0000","last_peered":"2024-09-21T05:52:23.694313+0000","last_clean":"2024-09-21T05:52:23.694313+0000","last_became_active":"2024-09-21T05:52:23.688964+0000","last_became_peered":"2024-09-21T05:52:23.688964+0000","last_unstale":"2024-09-21T05:52:23.694313+0000","last_undegraded":"2024-09-21T05:52:23.694313+0000","last_fullsized":"2024-09-21T05:52:23.694313+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:25.453769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.881242+0000","last_change":"2024-09-21T05:51:50.267110+0000","last_active":"2024-09-21T05:53:22.881242+0000","last_peered":"2024-09-21T05:53:22.881242+0000","last_clean":"2024-09-21T05:53:22.881242+0000","last_became_active":"2024-09-21T05:51:50.266504+0000","last_became_peered":"2024-09-21T05:51:50.266504+0000","last_unstale":"2024-09-21T05:53:22.881242+0000","last_undegraded":"2024-09-21T05:53:22.881242+0000","last_fullsized":"2024-09-21T05:53:22.881242+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:10.618361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590428+0000","last_change":"2024-09-21T05:51:48.337971+0000","last_active":"2024-09-21T05:52:23.590428+0000","last_peered":"2024-09-21T05:52:23.590428+0000","last_clean":"2024-09-21T05:52:23.590428+0000","last_became_active":"2024-09-21T05:51:48.337487+0000","last_became_peered":"2024-09-21T05:51:48.337487+0000","last_unstale":"2024-09-21T05:52:23.590428+0000","last_undegraded":"2024-09-21T05:52:23.590428+0000","last_fullsized":"2024-09-21T05:52:23.590428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.150563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882678+0000","last_change":"2024-09-21T05:51:50.253826+0000","last_active":"2024-09-21T05:53:22.882678+0000","last_peered":"2024-09-21T05:53:22.882678+0000","last_clean":"2024-09-21T05:53:22.882678+0000","last_became_active":"2024-09-21T05:51:50.251700+0000","last_became_peered":"2024-09-21T05:51:50.251700+0000","last_unstale":"2024-09-21T05:53:22.882678+0000","last_undegraded":"2024-09-21T05:53:22.882678+0000","last_fullsized":"2024-09-21T05:53:22.882678+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:02.929651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587502+0000","last_change":"2024-09-21T05:51:48.234358+0000","last_active":"2024-09-21T05:52:23.587502+0000","last_peered":"2024-09-21T05:52:23.587502+0000","last_clean":"2024-09-21T05:52:23.587502+0000","last_became_active":"2024-09-21T05:51:48.233982+0000","last_became_peered":"2024-09-21T05:51:48.233982+0000","last_unstale":"2024-09-21T05:52:23.587502+0000","last_undegraded":"2024-09-21T05:52:23.587502+0000","last_fullsized":"2024-09-21T05:52:23.587502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:42.510872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68601,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":592,"num_read_kb":367,"num_write":174,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":205803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":406831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972390,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1519616,"data_stored":1062995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168620,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":407067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332145,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":406987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528374,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1429504,"data_stored":999058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691899,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":406456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36752,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708400,"statfs":{"total":95995035648,"available":95957401600,"internally_reserved":0,"allocated":1441792,"data_stored":998210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":407425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":406767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378704,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":472058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542228,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":470708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40328,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704824,"statfs":{"total":95995035648,"available":95953739776,"internally_reserved":0,"allocated":843776,"data_stored":407727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:53:38.130 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T05:53:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.277+0000 7f38f90b6640 1 -- 172.21.15.7:0/2785844445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f41029d0 msgr2=0x7f38f4102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.277+0000 7f38f90b6640 1 --2- 172.21.15.7:0/2785844445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f41029d0 0x7f38f4102de0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009900 tx=0x7f38e402a410 comp rx=0 tx=0).stop 2024-09-21T05:53:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.277+0000 7f38f90b6640 1 -- 172.21.15.7:0/2785844445 shutdown_connections 2024-09-21T05:53:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.277+0000 7f38f90b6640 1 --2- 172.21.15.7:0/2785844445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f4108c50 0x7f38f410f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.277+0000 7f38f90b6640 1 --2- 172.21.15.7:0/2785844445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38f4108300 0x7f38f4108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.277+0000 7f38f90b6640 1 --2- 172.21.15.7:0/2785844445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f41029d0 0x7f38f4102de0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.277+0000 7f38f90b6640 1 -- 172.21.15.7:0/2785844445 >> 172.21.15.7:0/2785844445 conn(0x7f38f40fe3b0 msgr2=0x7f38f4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.277+0000 7f38f90b6640 1 -- 172.21.15.7:0/2785844445 shutdown_connections 2024-09-21T05:53:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.277+0000 7f38f90b6640 1 -- 172.21.15.7:0/2785844445 wait complete. 2024-09-21T05:53:38.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.278+0000 7f38f90b6640 1 Processor -- start 2024-09-21T05:53:38.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.278+0000 7f38f90b6640 1 -- start start 2024-09-21T05:53:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f90b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38f41029d0 0x7f38f419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f90b6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f4108300 0x7f38f419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f90b6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f4108c50 0x7f38f419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f90b6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f38f4112910 con 0x7f38f4108c50 2024-09-21T05:53:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f90b6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f38f4112790 con 0x7f38f4108300 2024-09-21T05:53:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f90b6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f38f4112a90 con 0x7f38f41029d0 2024-09-21T05:53:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f359e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f4108c50 0x7f38f419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f359e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f4108c50 0x7f38f419fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59364/0 (socket says 172.21.15.7:59364) 2024-09-21T05:53:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f359e640 1 -- 172.21.15.7:0/2395278986 learned_addr learned my addr 172.21.15.7:0/2395278986 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f2d9d640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38f41029d0 0x7f38f419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f259c640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f4108300 0x7f38f419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f359e640 1 -- 172.21.15.7:0/2395278986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38f41029d0 msgr2=0x7f38f419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f359e640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38f41029d0 0x7f38f419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f359e640 1 -- 172.21.15.7:0/2395278986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f4108300 msgr2=0x7f38f419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f359e640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f4108300 0x7f38f419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f359e640 1 -- 172.21.15.7:0/2395278986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f41a0370 con 0x7f38f4108c50 2024-09-21T05:53:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f259c640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f4108300 0x7f38f419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.279+0000 7f38f359e640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f4108c50 0x7f38f419fc70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00cad0 tx=0x7f38ec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.280+0000 7f38dbfff640 1 -- 172.21.15.7:0/2395278986 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec00ae20 con 0x7f38f4108c50 2024-09-21T05:53:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.280+0000 7f38f90b6640 1 -- 172.21.15.7:0/2395278986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f41a0660 con 0x7f38f4108c50 2024-09-21T05:53:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.280+0000 7f38dbfff640 1 -- 172.21.15.7:0/2395278986 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38ec005020 con 0x7f38f4108c50 2024-09-21T05:53:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.280+0000 7f38dbfff640 1 -- 172.21.15.7:0/2395278986 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec00f6b0 con 0x7f38f4108c50 2024-09-21T05:53:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.280+0000 7f38f90b6640 1 -- 172.21.15.7:0/2395278986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f41a6df0 con 0x7f38f4108c50 2024-09-21T05:53:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.281+0000 7f38f90b6640 1 -- 172.21.15.7:0/2395278986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38f4102de0 con 0x7f38f4108c50 2024-09-21T05:53:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.282+0000 7f38dbfff640 1 -- 172.21.15.7:0/2395278986 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f38ec0051d0 con 0x7f38f4108c50 2024-09-21T05:53:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.283+0000 7f38dbfff640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38dc0b6560 0x7f38dc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.283+0000 7f38f2d9d640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38dc0b6560 0x7f38dc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.283+0000 7f38dbfff640 1 -- 172.21.15.7:0/2395278986 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f38ec0e78c0 con 0x7f38f4108c50 2024-09-21T05:53:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.284+0000 7f38f2d9d640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38dc0b6560 0x7f38dc0b8a70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38e4031440 tx=0x7f38e4009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:38.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.286+0000 7f38dbfff640 1 -- 172.21.15.7:0/2395278986 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38ec014030 con 0x7f38f4108c50 2024-09-21T05:53:38.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.472+0000 7f38f90b6640 1 -- 172.21.15.7:0/2395278986 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f38f4063800 con 0x7f38dc0b6560 2024-09-21T05:53:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.476+0000 7f38dbfff640 1 -- 172.21.15.7:0/2395278986 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258815 (secure 0 0 0) 0x7f38f4063800 con 0x7f38dc0b6560 2024-09-21T05:53:38.481 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T05:53:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.479+0000 7f38f90b6640 1 -- 172.21.15.7:0/2395278986 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38dc0b6560 msgr2=0x7f38dc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.479+0000 7f38f90b6640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38dc0b6560 0x7f38dc0b8a70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38e4031440 tx=0x7f38e4009560 comp rx=0 tx=0).stop 2024-09-21T05:53:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.479+0000 7f38f90b6640 1 -- 172.21.15.7:0/2395278986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f4108c50 msgr2=0x7f38f419fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.479+0000 7f38f90b6640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f4108c50 0x7f38f419fc70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00cad0 tx=0x7f38ec00cf90 comp rx=0 tx=0).stop 2024-09-21T05:53:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.480+0000 7f38f90b6640 1 -- 172.21.15.7:0/2395278986 shutdown_connections 2024-09-21T05:53:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.480+0000 7f38f90b6640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38dc0b6560 0x7f38dc0b8a70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.480+0000 7f38f90b6640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38f4108c50 0x7f38f419fc70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.480+0000 7f38f90b6640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f4108300 0x7f38f419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.480+0000 7f38f90b6640 1 --2- 172.21.15.7:0/2395278986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38f41029d0 0x7f38f419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.480+0000 7f38f90b6640 1 -- 172.21.15.7:0/2395278986 >> 172.21.15.7:0/2395278986 conn(0x7f38f40fe3b0 msgr2=0x7f38f406a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:38.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.480+0000 7f38f90b6640 1 -- 172.21.15.7:0/2395278986 shutdown_connections 2024-09-21T05:53:38.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.480+0000 7f38f90b6640 1 -- 172.21.15.7:0/2395278986 wait complete. 2024-09-21T05:53:38.493 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-21T05:53:36.508475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659203,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":673,"num_read_kb":436,"num_write":299,"num_write_kb":2274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2951840,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390104,"kb_used_data":11736,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551720,"statfs":{"total":1151940427776,"available":1151540961280,"internally_reserved":0,"allocated":12017664,"data_stored":6852289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003231"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884672+0000","last_change":"2024-09-21T05:51:50.266316+0000","last_active":"2024-09-21T05:53:22.884672+0000","last_peered":"2024-09-21T05:53:22.884672+0000","last_clean":"2024-09-21T05:53:22.884672+0000","last_became_active":"2024-09-21T05:51:50.265970+0000","last_became_peered":"2024-09-21T05:51:50.265970+0000","last_unstale":"2024-09-21T05:53:22.884672+0000","last_undegraded":"2024-09-21T05:53:22.884672+0000","last_fullsized":"2024-09-21T05:53:22.884672+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:31.728635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882665+0000","last_change":"2024-09-21T05:51:50.254215+0000","last_active":"2024-09-21T05:53:22.882665+0000","last_peered":"2024-09-21T05:53:22.882665+0000","last_clean":"2024-09-21T05:53:22.882665+0000","last_became_active":"2024-09-21T05:51:50.253701+0000","last_became_peered":"2024-09-21T05:51:50.253701+0000","last_unstale":"2024-09-21T05:53:22.882665+0000","last_undegraded":"2024-09-21T05:53:22.882665+0000","last_fullsized":"2024-09-21T05:53:22.882665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:56.211706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884357+0000","last_change":"2024-09-21T05:51:50.258535+0000","last_active":"2024-09-21T05:53:22.884357+0000","last_peered":"2024-09-21T05:53:22.884357+0000","last_clean":"2024-09-21T05:53:22.884357+0000","last_became_active":"2024-09-21T05:51:50.258186+0000","last_became_peered":"2024-09-21T05:51:50.258186+0000","last_unstale":"2024-09-21T05:53:22.884357+0000","last_undegraded":"2024-09-21T05:53:22.884357+0000","last_fullsized":"2024-09-21T05:53:22.884357+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:15.134574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.888046+0000","last_change":"2024-09-21T05:51:50.254832+0000","last_active":"2024-09-21T05:53:22.888046+0000","last_peered":"2024-09-21T05:53:22.888046+0000","last_clean":"2024-09-21T05:53:22.888046+0000","last_became_active":"2024-09-21T05:51:50.254449+0000","last_became_peered":"2024-09-21T05:51:50.254449+0000","last_unstale":"2024-09-21T05:53:22.888046+0000","last_undegraded":"2024-09-21T05:53:22.888046+0000","last_fullsized":"2024-09-21T05:53:22.888046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:31.411808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.870896+0000","last_change":"2024-09-21T05:51:50.251144+0000","last_active":"2024-09-21T05:53:22.870896+0000","last_peered":"2024-09-21T05:53:22.870896+0000","last_clean":"2024-09-21T05:53:22.870896+0000","last_became_active":"2024-09-21T05:51:50.250782+0000","last_became_peered":"2024-09-21T05:51:50.250782+0000","last_unstale":"2024-09-21T05:53:22.870896+0000","last_undegraded":"2024-09-21T05:53:22.870896+0000","last_fullsized":"2024-09-21T05:53:22.870896+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:15.055805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882829+0000","last_change":"2024-09-21T05:51:50.259758+0000","last_active":"2024-09-21T05:53:22.882829+0000","last_peered":"2024-09-21T05:53:22.882829+0000","last_clean":"2024-09-21T05:53:22.882829+0000","last_became_active":"2024-09-21T05:51:50.259358+0000","last_became_peered":"2024-09-21T05:51:50.259358+0000","last_unstale":"2024-09-21T05:53:22.882829+0000","last_undegraded":"2024-09-21T05:53:22.882829+0000","last_fullsized":"2024-09-21T05:53:22.882829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:08.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883614+0000","last_change":"2024-09-21T05:51:50.260018+0000","last_active":"2024-09-21T05:53:22.883614+0000","last_peered":"2024-09-21T05:53:22.883614+0000","last_clean":"2024-09-21T05:53:22.883614+0000","last_became_active":"2024-09-21T05:51:50.257143+0000","last_became_peered":"2024-09-21T05:51:50.257143+0000","last_unstale":"2024-09-21T05:53:22.883614+0000","last_undegraded":"2024-09-21T05:53:22.883614+0000","last_fullsized":"2024-09-21T05:53:22.883614+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:05.579662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882872+0000","last_change":"2024-09-21T05:51:50.256867+0000","last_active":"2024-09-21T05:53:22.882872+0000","last_peered":"2024-09-21T05:53:22.882872+0000","last_clean":"2024-09-21T05:53:22.882872+0000","last_became_active":"2024-09-21T05:51:50.256392+0000","last_became_peered":"2024-09-21T05:51:50.256392+0000","last_unstale":"2024-09-21T05:53:22.882872+0000","last_undegraded":"2024-09-21T05:53:22.882872+0000","last_fullsized":"2024-09-21T05:53:22.882872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:43.169607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882375+0000","last_change":"2024-09-21T05:51:50.260430+0000","last_active":"2024-09-21T05:53:22.882375+0000","last_peered":"2024-09-21T05:53:22.882375+0000","last_clean":"2024-09-21T05:53:22.882375+0000","last_became_active":"2024-09-21T05:51:50.259993+0000","last_became_peered":"2024-09-21T05:51:50.259993+0000","last_unstale":"2024-09-21T05:53:22.882375+0000","last_undegraded":"2024-09-21T05:53:22.882375+0000","last_fullsized":"2024-09-21T05:53:22.882375+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:31.811151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885323+0000","last_change":"2024-09-21T05:51:50.263027+0000","last_active":"2024-09-21T05:53:22.885323+0000","last_peered":"2024-09-21T05:53:22.885323+0000","last_clean":"2024-09-21T05:53:22.885323+0000","last_became_active":"2024-09-21T05:51:50.261816+0000","last_became_peered":"2024-09-21T05:51:50.261816+0000","last_unstale":"2024-09-21T05:53:22.885323+0000","last_undegraded":"2024-09-21T05:53:22.885323+0000","last_fullsized":"2024-09-21T05:53:22.885323+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:39.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.890919+0000","last_change":"2024-09-21T05:51:50.263976+0000","last_active":"2024-09-21T05:53:22.890919+0000","last_peered":"2024-09-21T05:53:22.890919+0000","last_clean":"2024-09-21T05:53:22.890919+0000","last_became_active":"2024-09-21T05:51:50.263179+0000","last_became_peered":"2024-09-21T05:51:50.263179+0000","last_unstale":"2024-09-21T05:53:22.890919+0000","last_undegraded":"2024-09-21T05:53:22.890919+0000","last_fullsized":"2024-09-21T05:53:22.890919+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:08.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.888587+0000","last_change":"2024-09-21T05:51:50.259967+0000","last_active":"2024-09-21T05:53:22.888587+0000","last_peered":"2024-09-21T05:53:22.888587+0000","last_clean":"2024-09-21T05:53:22.888587+0000","last_became_active":"2024-09-21T05:51:50.259460+0000","last_became_peered":"2024-09-21T05:51:50.259460+0000","last_unstale":"2024-09-21T05:53:22.888587+0000","last_undegraded":"2024-09-21T05:53:22.888587+0000","last_fullsized":"2024-09-21T05:53:22.888587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:48.576362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.874864+0000","last_change":"2024-09-21T05:51:50.252949+0000","last_active":"2024-09-21T05:53:22.874864+0000","last_peered":"2024-09-21T05:53:22.874864+0000","last_clean":"2024-09-21T05:53:22.874864+0000","last_became_active":"2024-09-21T05:51:50.252518+0000","last_became_peered":"2024-09-21T05:51:50.252518+0000","last_unstale":"2024-09-21T05:53:22.874864+0000","last_undegraded":"2024-09-21T05:53:22.874864+0000","last_fullsized":"2024-09-21T05:53:22.874864+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:38.145947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884022+0000","last_change":"2024-09-21T05:51:50.250309+0000","last_active":"2024-09-21T05:53:22.884022+0000","last_peered":"2024-09-21T05:53:22.884022+0000","last_clean":"2024-09-21T05:53:22.884022+0000","last_became_active":"2024-09-21T05:51:50.249629+0000","last_became_peered":"2024-09-21T05:51:50.249629+0000","last_unstale":"2024-09-21T05:53:22.884022+0000","last_undegraded":"2024-09-21T05:53:22.884022+0000","last_fullsized":"2024-09-21T05:53:22.884022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:28.551654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885421+0000","last_change":"2024-09-21T05:51:50.242211+0000","last_active":"2024-09-21T05:53:22.885421+0000","last_peered":"2024-09-21T05:53:22.885421+0000","last_clean":"2024-09-21T05:53:22.885421+0000","last_became_active":"2024-09-21T05:51:50.241861+0000","last_became_peered":"2024-09-21T05:51:50.241861+0000","last_unstale":"2024-09-21T05:53:22.885421+0000","last_undegraded":"2024-09-21T05:53:22.885421+0000","last_fullsized":"2024-09-21T05:53:22.885421+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:46.045907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.887928+0000","last_change":"2024-09-21T05:51:50.268926+0000","last_active":"2024-09-21T05:53:22.887928+0000","last_peered":"2024-09-21T05:53:22.887928+0000","last_clean":"2024-09-21T05:53:22.887928+0000","last_became_active":"2024-09-21T05:51:50.268164+0000","last_became_peered":"2024-09-21T05:51:50.268164+0000","last_unstale":"2024-09-21T05:53:22.887928+0000","last_undegraded":"2024-09-21T05:53:22.887928+0000","last_fullsized":"2024-09-21T05:53:22.887928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:43.021303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884646+0000","last_change":"2024-09-21T05:51:50.266365+0000","last_active":"2024-09-21T05:53:22.884646+0000","last_peered":"2024-09-21T05:53:22.884646+0000","last_clean":"2024-09-21T05:53:22.884646+0000","last_became_active":"2024-09-21T05:51:50.265803+0000","last_became_peered":"2024-09-21T05:51:50.265803+0000","last_unstale":"2024-09-21T05:53:22.884646+0000","last_undegraded":"2024-09-21T05:53:22.884646+0000","last_fullsized":"2024-09-21T05:53:22.884646+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:45.574795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.877825+0000","last_change":"2024-09-21T05:51:50.257129+0000","last_active":"2024-09-21T05:53:22.877825+0000","last_peered":"2024-09-21T05:53:22.877825+0000","last_clean":"2024-09-21T05:53:22.877825+0000","last_became_active":"2024-09-21T05:51:50.256721+0000","last_became_peered":"2024-09-21T05:51:50.256721+0000","last_unstale":"2024-09-21T05:53:22.877825+0000","last_undegraded":"2024-09-21T05:53:22.877825+0000","last_fullsized":"2024-09-21T05:53:22.877825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:26.688743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.881613+0000","last_change":"2024-09-21T05:51:50.243460+0000","last_active":"2024-09-21T05:53:22.881613+0000","last_peered":"2024-09-21T05:53:22.881613+0000","last_clean":"2024-09-21T05:53:22.881613+0000","last_became_active":"2024-09-21T05:51:50.243094+0000","last_became_peered":"2024-09-21T05:51:50.243094+0000","last_unstale":"2024-09-21T05:53:22.881613+0000","last_undegraded":"2024-09-21T05:53:22.881613+0000","last_fullsized":"2024-09-21T05:53:22.881613+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:16.751564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.871108+0000","last_change":"2024-09-21T05:52:23.595697+0000","last_active":"2024-09-21T05:53:22.871108+0000","last_peered":"2024-09-21T05:53:22.871108+0000","last_clean":"2024-09-21T05:53:22.871108+0000","last_became_active":"2024-09-21T05:52:23.595173+0000","last_became_peered":"2024-09-21T05:52:23.595173+0000","last_unstale":"2024-09-21T05:53:22.871108+0000","last_undegraded":"2024-09-21T05:53:22.871108+0000","last_fullsized":"2024-09-21T05:53:22.871108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.036215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883343+0000","last_change":"2024-09-21T05:51:50.251288+0000","last_active":"2024-09-21T05:53:22.883343+0000","last_peered":"2024-09-21T05:53:22.883343+0000","last_clean":"2024-09-21T05:53:22.883343+0000","last_became_active":"2024-09-21T05:51:50.250841+0000","last_became_peered":"2024-09-21T05:51:50.250841+0000","last_unstale":"2024-09-21T05:53:22.883343+0000","last_undegraded":"2024-09-21T05:53:22.883343+0000","last_fullsized":"2024-09-21T05:53:22.883343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:44.196822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.890690+0000","last_change":"2024-09-21T05:51:50.259418+0000","last_active":"2024-09-21T05:53:22.890690+0000","last_peered":"2024-09-21T05:53:22.890690+0000","last_clean":"2024-09-21T05:53:22.890690+0000","last_became_active":"2024-09-21T05:51:50.257641+0000","last_became_peered":"2024-09-21T05:51:50.257641+0000","last_unstale":"2024-09-21T05:53:22.890690+0000","last_undegraded":"2024-09-21T05:53:22.890690+0000","last_fullsized":"2024-09-21T05:53:22.890690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:23.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.873706+0000","last_change":"2024-09-21T05:51:50.252746+0000","last_active":"2024-09-21T05:53:22.873706+0000","last_peered":"2024-09-21T05:53:22.873706+0000","last_clean":"2024-09-21T05:53:22.873706+0000","last_became_active":"2024-09-21T05:51:50.250551+0000","last_became_peered":"2024-09-21T05:51:50.250551+0000","last_unstale":"2024-09-21T05:53:22.873706+0000","last_undegraded":"2024-09-21T05:53:22.873706+0000","last_fullsized":"2024-09-21T05:53:22.873706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:05.821737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883838+0000","last_change":"2024-09-21T05:51:50.246170+0000","last_active":"2024-09-21T05:53:22.883838+0000","last_peered":"2024-09-21T05:53:22.883838+0000","last_clean":"2024-09-21T05:53:22.883838+0000","last_became_active":"2024-09-21T05:51:50.245747+0000","last_became_peered":"2024-09-21T05:51:50.245747+0000","last_unstale":"2024-09-21T05:53:22.883838+0000","last_undegraded":"2024-09-21T05:53:22.883838+0000","last_fullsized":"2024-09-21T05:53:22.883838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:05.005437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.873161+0000","last_change":"2024-09-21T05:51:50.258248+0000","last_active":"2024-09-21T05:53:22.873161+0000","last_peered":"2024-09-21T05:53:22.873161+0000","last_clean":"2024-09-21T05:53:22.873161+0000","last_became_active":"2024-09-21T05:51:50.257891+0000","last_became_peered":"2024-09-21T05:51:50.257891+0000","last_unstale":"2024-09-21T05:53:22.873161+0000","last_undegraded":"2024-09-21T05:53:22.873161+0000","last_fullsized":"2024-09-21T05:53:22.873161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:44.093064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.888481+0000","last_change":"2024-09-21T05:51:50.258497+0000","last_active":"2024-09-21T05:53:22.888481+0000","last_peered":"2024-09-21T05:53:22.888481+0000","last_clean":"2024-09-21T05:53:22.888481+0000","last_became_active":"2024-09-21T05:51:50.257633+0000","last_became_peered":"2024-09-21T05:51:50.257633+0000","last_unstale":"2024-09-21T05:53:22.888481+0000","last_undegraded":"2024-09-21T05:53:22.888481+0000","last_fullsized":"2024-09-21T05:53:22.888481+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:41.793650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.875220+0000","last_change":"2024-09-21T05:51:50.255336+0000","last_active":"2024-09-21T05:53:22.875220+0000","last_peered":"2024-09-21T05:53:22.875220+0000","last_clean":"2024-09-21T05:53:22.875220+0000","last_became_active":"2024-09-21T05:51:50.254955+0000","last_became_peered":"2024-09-21T05:51:50.254955+0000","last_unstale":"2024-09-21T05:53:22.875220+0000","last_undegraded":"2024-09-21T05:53:22.875220+0000","last_fullsized":"2024-09-21T05:53:22.875220+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:28.198455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.887359+0000","last_change":"2024-09-21T05:51:50.242391+0000","last_active":"2024-09-21T05:53:22.887359+0000","last_peered":"2024-09-21T05:53:22.887359+0000","last_clean":"2024-09-21T05:53:22.887359+0000","last_became_active":"2024-09-21T05:51:50.242055+0000","last_became_peered":"2024-09-21T05:51:50.242055+0000","last_unstale":"2024-09-21T05:53:22.887359+0000","last_undegraded":"2024-09-21T05:53:22.887359+0000","last_fullsized":"2024-09-21T05:53:22.887359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:48.937516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885688+0000","last_change":"2024-09-21T05:51:50.243343+0000","last_active":"2024-09-21T05:53:22.885688+0000","last_peered":"2024-09-21T05:53:22.885688+0000","last_clean":"2024-09-21T05:53:22.885688+0000","last_became_active":"2024-09-21T05:51:50.243005+0000","last_became_peered":"2024-09-21T05:51:50.243005+0000","last_unstale":"2024-09-21T05:53:22.885688+0000","last_undegraded":"2024-09-21T05:53:22.885688+0000","last_fullsized":"2024-09-21T05:53:22.885688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:51.975966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883168+0000","last_change":"2024-09-21T05:51:50.250290+0000","last_active":"2024-09-21T05:53:22.883168+0000","last_peered":"2024-09-21T05:53:22.883168+0000","last_clean":"2024-09-21T05:53:22.883168+0000","last_became_active":"2024-09-21T05:51:50.249867+0000","last_became_peered":"2024-09-21T05:51:50.249867+0000","last_unstale":"2024-09-21T05:53:22.883168+0000","last_undegraded":"2024-09-21T05:53:22.883168+0000","last_fullsized":"2024-09-21T05:53:22.883168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:33.852383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.881035+0000","last_change":"2024-09-21T05:51:50.244908+0000","last_active":"2024-09-21T05:53:22.881035+0000","last_peered":"2024-09-21T05:53:22.881035+0000","last_clean":"2024-09-21T05:53:22.881035+0000","last_became_active":"2024-09-21T05:51:50.244473+0000","last_became_peered":"2024-09-21T05:51:50.244473+0000","last_unstale":"2024-09-21T05:53:22.881035+0000","last_undegraded":"2024-09-21T05:53:22.881035+0000","last_fullsized":"2024-09-21T05:53:22.881035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:08.040920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.876658+0000","last_change":"2024-09-21T05:51:50.259926+0000","last_active":"2024-09-21T05:53:22.876658+0000","last_peered":"2024-09-21T05:53:22.876658+0000","last_clean":"2024-09-21T05:53:22.876658+0000","last_became_active":"2024-09-21T05:51:50.259511+0000","last_became_peered":"2024-09-21T05:51:50.259511+0000","last_unstale":"2024-09-21T05:53:22.876658+0000","last_undegraded":"2024-09-21T05:53:22.876658+0000","last_fullsized":"2024-09-21T05:53:22.876658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:46.735741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.858517+0000","last_change":"2024-09-21T05:51:50.249474+0000","last_active":"2024-09-21T05:53:22.858517+0000","last_peered":"2024-09-21T05:53:22.858517+0000","last_clean":"2024-09-21T05:53:22.858517+0000","last_became_active":"2024-09-21T05:51:50.247503+0000","last_became_peered":"2024-09-21T05:51:50.247503+0000","last_unstale":"2024-09-21T05:53:22.858517+0000","last_undegraded":"2024-09-21T05:53:22.858517+0000","last_fullsized":"2024-09-21T05:53:22.858517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:11.639218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:33.480859+0000","last_change":"2024-09-21T05:51:48.236001+0000","last_active":"2024-09-21T05:53:33.480859+0000","last_peered":"2024-09-21T05:53:33.480859+0000","last_clean":"2024-09-21T05:53:33.480859+0000","last_became_active":"2024-09-21T05:51:48.235603+0000","last_became_peered":"2024-09-21T05:51:48.235603+0000","last_unstale":"2024-09-21T05:53:33.480859+0000","last_undegraded":"2024-09-21T05:53:33.480859+0000","last_fullsized":"2024-09-21T05:53:33.480859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:33.217248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885281+0000","last_change":"2024-09-21T05:52:23.599125+0000","last_active":"2024-09-21T05:53:22.885281+0000","last_peered":"2024-09-21T05:53:22.885281+0000","last_clean":"2024-09-21T05:53:22.885281+0000","last_became_active":"2024-09-21T05:52:23.598739+0000","last_became_peered":"2024-09-21T05:52:23.598739+0000","last_unstale":"2024-09-21T05:53:22.885281+0000","last_undegraded":"2024-09-21T05:53:22.885281+0000","last_fullsized":"2024-09-21T05:53:22.885281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:20.838698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.585476+0000","last_change":"2024-09-21T05:51:48.230191+0000","last_active":"2024-09-21T05:52:23.585476+0000","last_peered":"2024-09-21T05:52:23.585476+0000","last_clean":"2024-09-21T05:52:23.585476+0000","last_became_active":"2024-09-21T05:51:48.229780+0000","last_became_peered":"2024-09-21T05:51:48.229780+0000","last_unstale":"2024-09-21T05:52:23.585476+0000","last_undegraded":"2024-09-21T05:52:23.585476+0000","last_fullsized":"2024-09-21T05:52:23.585476+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:34.950404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584118+0000","last_change":"2024-09-21T05:51:48.224115+0000","last_active":"2024-09-21T05:52:23.584118+0000","last_peered":"2024-09-21T05:52:23.584118+0000","last_clean":"2024-09-21T05:52:23.584118+0000","last_became_active":"2024-09-21T05:51:48.223714+0000","last_became_peered":"2024-09-21T05:51:48.223714+0000","last_unstale":"2024-09-21T05:52:23.584118+0000","last_undegraded":"2024-09-21T05:52:23.584118+0000","last_fullsized":"2024-09-21T05:52:23.584118+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:29.450354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.875426+0000","last_change":"2024-09-21T05:51:50.250129+0000","last_active":"2024-09-21T05:53:22.875426+0000","last_peered":"2024-09-21T05:53:22.875426+0000","last_clean":"2024-09-21T05:53:22.875426+0000","last_became_active":"2024-09-21T05:51:50.249743+0000","last_became_peered":"2024-09-21T05:51:50.249743+0000","last_unstale":"2024-09-21T05:53:22.875426+0000","last_undegraded":"2024-09-21T05:53:22.875426+0000","last_fullsized":"2024-09-21T05:53:22.875426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:37.204476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596516+0000","last_change":"2024-09-21T05:51:48.236289+0000","last_active":"2024-09-21T05:52:23.596516+0000","last_peered":"2024-09-21T05:52:23.596516+0000","last_clean":"2024-09-21T05:52:23.596516+0000","last_became_active":"2024-09-21T05:51:48.235898+0000","last_became_peered":"2024-09-21T05:51:48.235898+0000","last_unstale":"2024-09-21T05:52:23.596516+0000","last_undegraded":"2024-09-21T05:52:23.596516+0000","last_fullsized":"2024-09-21T05:52:23.596516+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:05.457237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.877338+0000","last_change":"2024-09-21T05:51:50.251905+0000","last_active":"2024-09-21T05:53:22.877338+0000","last_peered":"2024-09-21T05:53:22.877338+0000","last_clean":"2024-09-21T05:53:22.877338+0000","last_became_active":"2024-09-21T05:51:50.251537+0000","last_became_peered":"2024-09-21T05:51:50.251537+0000","last_unstale":"2024-09-21T05:53:22.877338+0000","last_undegraded":"2024-09-21T05:53:22.877338+0000","last_fullsized":"2024-09-21T05:53:22.877338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:57.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":119,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:31.477025+0000","last_change":"2024-09-21T05:51:48.232007+0000","last_active":"2024-09-21T05:53:31.477025+0000","last_peered":"2024-09-21T05:53:31.477025+0000","last_clean":"2024-09-21T05:53:31.477025+0000","last_became_active":"2024-09-21T05:51:48.231534+0000","last_became_peered":"2024-09-21T05:51:48.231534+0000","last_unstale":"2024-09-21T05:53:31.477025+0000","last_undegraded":"2024-09-21T05:53:31.477025+0000","last_fullsized":"2024-09-21T05:53:31.477025+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:05.874618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.879196+0000","last_change":"2024-09-21T05:51:50.265224+0000","last_active":"2024-09-21T05:53:22.879196+0000","last_peered":"2024-09-21T05:53:22.879196+0000","last_clean":"2024-09-21T05:53:22.879196+0000","last_became_active":"2024-09-21T05:51:50.264690+0000","last_became_peered":"2024-09-21T05:51:50.264690+0000","last_unstale":"2024-09-21T05:53:22.879196+0000","last_undegraded":"2024-09-21T05:53:22.879196+0000","last_fullsized":"2024-09-21T05:53:22.879196+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:15.835492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587907+0000","last_change":"2024-09-21T05:51:48.233092+0000","last_active":"2024-09-21T05:52:23.587907+0000","last_peered":"2024-09-21T05:52:23.587907+0000","last_clean":"2024-09-21T05:52:23.587907+0000","last_became_active":"2024-09-21T05:51:48.232684+0000","last_became_peered":"2024-09-21T05:51:48.232684+0000","last_unstale":"2024-09-21T05:52:23.587907+0000","last_undegraded":"2024-09-21T05:52:23.587907+0000","last_fullsized":"2024-09-21T05:52:23.587907+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:21.664828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885615+0000","last_change":"2024-09-21T05:51:50.248419+0000","last_active":"2024-09-21T05:53:22.885615+0000","last_peered":"2024-09-21T05:53:22.885615+0000","last_clean":"2024-09-21T05:53:22.885615+0000","last_became_active":"2024-09-21T05:51:50.247871+0000","last_became_peered":"2024-09-21T05:51:50.247871+0000","last_unstale":"2024-09-21T05:53:22.885615+0000","last_undegraded":"2024-09-21T05:53:22.885615+0000","last_fullsized":"2024-09-21T05:53:22.885615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:49.851685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596905+0000","last_change":"2024-09-21T05:51:48.338367+0000","last_active":"2024-09-21T05:52:23.596905+0000","last_peered":"2024-09-21T05:52:23.596905+0000","last_clean":"2024-09-21T05:52:23.596905+0000","last_became_active":"2024-09-21T05:51:48.337992+0000","last_became_peered":"2024-09-21T05:51:48.337992+0000","last_unstale":"2024-09-21T05:52:23.596905+0000","last_undegraded":"2024-09-21T05:52:23.596905+0000","last_fullsized":"2024-09-21T05:52:23.596905+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:52.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.889702+0000","last_change":"2024-09-21T05:51:50.267046+0000","last_active":"2024-09-21T05:53:22.889702+0000","last_peered":"2024-09-21T05:53:22.889702+0000","last_clean":"2024-09-21T05:53:22.889702+0000","last_became_active":"2024-09-21T05:51:50.266672+0000","last_became_peered":"2024-09-21T05:51:50.266672+0000","last_unstale":"2024-09-21T05:53:22.889702+0000","last_undegraded":"2024-09-21T05:53:22.889702+0000","last_fullsized":"2024-09-21T05:53:22.889702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:53.628646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'32","reported_seq":251,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:32.479617+0000","last_change":"2024-09-21T05:51:48.233804+0000","last_active":"2024-09-21T05:53:32.479617+0000","last_peered":"2024-09-21T05:53:32.479617+0000","last_clean":"2024-09-21T05:53:32.479617+0000","last_became_active":"2024-09-21T05:51:48.233386+0000","last_became_peered":"2024-09-21T05:51:48.233386+0000","last_unstale":"2024-09-21T05:53:32.479617+0000","last_undegraded":"2024-09-21T05:53:32.479617+0000","last_fullsized":"2024-09-21T05:53:32.479617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:45.644005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64459,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":160,"num_write":33,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.868907+0000","last_change":"2024-09-21T05:51:50.257673+0000","last_active":"2024-09-21T05:53:22.868907+0000","last_peered":"2024-09-21T05:53:22.868907+0000","last_clean":"2024-09-21T05:53:22.868907+0000","last_became_active":"2024-09-21T05:51:50.257319+0000","last_became_peered":"2024-09-21T05:51:50.257319+0000","last_unstale":"2024-09-21T05:53:22.868907+0000","last_undegraded":"2024-09-21T05:53:22.868907+0000","last_fullsized":"2024-09-21T05:53:22.868907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:26.008964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587400+0000","last_change":"2024-09-21T05:51:48.233264+0000","last_active":"2024-09-21T05:52:23.587400+0000","last_peered":"2024-09-21T05:52:23.587400+0000","last_clean":"2024-09-21T05:52:23.587400+0000","last_became_active":"2024-09-21T05:51:48.232808+0000","last_became_peered":"2024-09-21T05:51:48.232808+0000","last_unstale":"2024-09-21T05:52:23.587400+0000","last_undegraded":"2024-09-21T05:52:23.587400+0000","last_fullsized":"2024-09-21T05:52:23.587400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:05.105861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883211+0000","last_change":"2024-09-21T05:51:50.251727+0000","last_active":"2024-09-21T05:53:22.883211+0000","last_peered":"2024-09-21T05:53:22.883211+0000","last_clean":"2024-09-21T05:53:22.883211+0000","last_became_active":"2024-09-21T05:51:50.251382+0000","last_became_peered":"2024-09-21T05:51:50.251382+0000","last_unstale":"2024-09-21T05:53:22.883211+0000","last_undegraded":"2024-09-21T05:53:22.883211+0000","last_fullsized":"2024-09-21T05:53:22.883211+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:30.098548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596648+0000","last_change":"2024-09-21T05:51:48.235226+0000","last_active":"2024-09-21T05:52:23.596648+0000","last_peered":"2024-09-21T05:52:23.596648+0000","last_clean":"2024-09-21T05:52:23.596648+0000","last_became_active":"2024-09-21T05:51:48.234432+0000","last_became_peered":"2024-09-21T05:51:48.234432+0000","last_unstale":"2024-09-21T05:52:23.596648+0000","last_undegraded":"2024-09-21T05:52:23.596648+0000","last_fullsized":"2024-09-21T05:52:23.596648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:49.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.892298+0000","last_change":"2024-09-21T05:51:50.260276+0000","last_active":"2024-09-21T05:53:22.892298+0000","last_peered":"2024-09-21T05:53:22.892298+0000","last_clean":"2024-09-21T05:53:22.892298+0000","last_became_active":"2024-09-21T05:51:50.257448+0000","last_became_peered":"2024-09-21T05:51:50.257448+0000","last_unstale":"2024-09-21T05:53:22.892298+0000","last_undegraded":"2024-09-21T05:53:22.892298+0000","last_fullsized":"2024-09-21T05:53:22.892298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:46.052226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:32.479720+0000","last_change":"2024-09-21T05:51:48.230764+0000","last_active":"2024-09-21T05:53:32.479720+0000","last_peered":"2024-09-21T05:53:32.479720+0000","last_clean":"2024-09-21T05:53:32.479720+0000","last_became_active":"2024-09-21T05:51:48.230332+0000","last_became_peered":"2024-09-21T05:51:48.230332+0000","last_unstale":"2024-09-21T05:53:32.479720+0000","last_undegraded":"2024-09-21T05:53:32.479720+0000","last_fullsized":"2024-09-21T05:53:32.479720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:33.459588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.889695+0000","last_change":"2024-09-21T05:52:23.589989+0000","last_active":"2024-09-21T05:53:22.889695+0000","last_peered":"2024-09-21T05:53:22.889695+0000","last_clean":"2024-09-21T05:53:22.889695+0000","last_became_active":"2024-09-21T05:52:23.589358+0000","last_became_peered":"2024-09-21T05:52:23.589358+0000","last_unstale":"2024-09-21T05:53:22.889695+0000","last_undegraded":"2024-09-21T05:53:22.889695+0000","last_fullsized":"2024-09-21T05:53:22.889695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:48.706509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589658+0000","last_change":"2024-09-21T05:51:48.338309+0000","last_active":"2024-09-21T05:52:23.589658+0000","last_peered":"2024-09-21T05:52:23.589658+0000","last_clean":"2024-09-21T05:52:23.589658+0000","last_became_active":"2024-09-21T05:51:48.337903+0000","last_became_peered":"2024-09-21T05:51:48.337903+0000","last_unstale":"2024-09-21T05:52:23.589658+0000","last_undegraded":"2024-09-21T05:52:23.589658+0000","last_fullsized":"2024-09-21T05:52:23.589658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:54.634956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.881414+0000","last_change":"2024-09-21T05:51:50.259257+0000","last_active":"2024-09-21T05:53:22.881414+0000","last_peered":"2024-09-21T05:53:22.881414+0000","last_clean":"2024-09-21T05:53:22.881414+0000","last_became_active":"2024-09-21T05:51:50.258892+0000","last_became_peered":"2024-09-21T05:51:50.258892+0000","last_unstale":"2024-09-21T05:53:22.881414+0000","last_undegraded":"2024-09-21T05:53:22.881414+0000","last_fullsized":"2024-09-21T05:53:22.881414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:46.683115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591128+0000","last_change":"2024-09-21T05:51:48.226956+0000","last_active":"2024-09-21T05:52:23.591128+0000","last_peered":"2024-09-21T05:52:23.591128+0000","last_clean":"2024-09-21T05:52:23.591128+0000","last_became_active":"2024-09-21T05:51:48.226531+0000","last_became_peered":"2024-09-21T05:51:48.226531+0000","last_unstale":"2024-09-21T05:52:23.591128+0000","last_undegraded":"2024-09-21T05:52:23.591128+0000","last_fullsized":"2024-09-21T05:52:23.591128+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:14.888074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.874822+0000","last_change":"2024-09-21T05:51:50.261080+0000","last_active":"2024-09-21T05:53:22.874822+0000","last_peered":"2024-09-21T05:53:22.874822+0000","last_clean":"2024-09-21T05:53:22.874822+0000","last_became_active":"2024-09-21T05:51:50.260700+0000","last_became_peered":"2024-09-21T05:51:50.260700+0000","last_unstale":"2024-09-21T05:53:22.874822+0000","last_undegraded":"2024-09-21T05:53:22.874822+0000","last_fullsized":"2024-09-21T05:53:22.874822+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.033889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584270+0000","last_change":"2024-09-21T05:51:48.230236+0000","last_active":"2024-09-21T05:52:23.584270+0000","last_peered":"2024-09-21T05:52:23.584270+0000","last_clean":"2024-09-21T05:52:23.584270+0000","last_became_active":"2024-09-21T05:51:48.229775+0000","last_became_peered":"2024-09-21T05:51:48.229775+0000","last_unstale":"2024-09-21T05:52:23.584270+0000","last_undegraded":"2024-09-21T05:52:23.584270+0000","last_fullsized":"2024-09-21T05:52:23.584270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:25.371256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.888276+0000","last_change":"2024-09-21T05:51:50.260749+0000","last_active":"2024-09-21T05:53:22.888276+0000","last_peered":"2024-09-21T05:53:22.888276+0000","last_clean":"2024-09-21T05:53:22.888276+0000","last_became_active":"2024-09-21T05:51:50.257406+0000","last_became_peered":"2024-09-21T05:51:50.257406+0000","last_unstale":"2024-09-21T05:53:22.888276+0000","last_undegraded":"2024-09-21T05:53:22.888276+0000","last_fullsized":"2024-09-21T05:53:22.888276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:18.293144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596986+0000","last_change":"2024-09-21T05:51:48.228752+0000","last_active":"2024-09-21T05:52:23.596986+0000","last_peered":"2024-09-21T05:52:23.596986+0000","last_clean":"2024-09-21T05:52:23.596986+0000","last_became_active":"2024-09-21T05:51:48.228361+0000","last_became_peered":"2024-09-21T05:51:48.228361+0000","last_unstale":"2024-09-21T05:52:23.596986+0000","last_undegraded":"2024-09-21T05:52:23.596986+0000","last_fullsized":"2024-09-21T05:52:23.596986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:05.868153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883312+0000","last_change":"2024-09-21T05:51:50.256183+0000","last_active":"2024-09-21T05:53:22.883312+0000","last_peered":"2024-09-21T05:53:22.883312+0000","last_clean":"2024-09-21T05:53:22.883312+0000","last_became_active":"2024-09-21T05:51:50.255746+0000","last_became_peered":"2024-09-21T05:51:50.255746+0000","last_unstale":"2024-09-21T05:53:22.883312+0000","last_undegraded":"2024-09-21T05:53:22.883312+0000","last_fullsized":"2024-09-21T05:53:22.883312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:29.044470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587539+0000","last_change":"2024-09-21T05:51:48.852935+0000","last_active":"2024-09-21T05:52:23.587539+0000","last_peered":"2024-09-21T05:52:23.587539+0000","last_clean":"2024-09-21T05:52:23.587539+0000","last_became_active":"2024-09-21T05:51:48.852457+0000","last_became_peered":"2024-09-21T05:51:48.852457+0000","last_unstale":"2024-09-21T05:52:23.587539+0000","last_undegraded":"2024-09-21T05:52:23.587539+0000","last_fullsized":"2024-09-21T05:52:23.587539+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:12.109669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.891006+0000","last_change":"2024-09-21T05:51:50.261136+0000","last_active":"2024-09-21T05:53:22.891006+0000","last_peered":"2024-09-21T05:53:22.891006+0000","last_clean":"2024-09-21T05:53:22.891006+0000","last_became_active":"2024-09-21T05:51:50.260698+0000","last_became_peered":"2024-09-21T05:51:50.260698+0000","last_unstale":"2024-09-21T05:53:22.891006+0000","last_undegraded":"2024-09-21T05:53:22.891006+0000","last_fullsized":"2024-09-21T05:53:22.891006+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:34.480352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.588600+0000","last_change":"2024-09-21T05:50:40.836627+0000","last_active":"2024-09-21T05:52:23.588600+0000","last_peered":"2024-09-21T05:52:23.588600+0000","last_clean":"2024-09-21T05:52:23.588600+0000","last_became_active":"2024-09-21T05:50:40.830426+0000","last_became_peered":"2024-09-21T05:50:40.830426+0000","last_unstale":"2024-09-21T05:52:23.588600+0000","last_undegraded":"2024-09-21T05:52:23.588600+0000","last_fullsized":"2024-09-21T05:52:23.588600+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_clean_scrub_stamp":"2024-09-21T05:47:21.634945+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:33.394077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.687599+0000","last_change":"2024-09-21T05:51:48.228187+0000","last_active":"2024-09-21T05:52:23.687599+0000","last_peered":"2024-09-21T05:52:23.687599+0000","last_clean":"2024-09-21T05:52:23.687599+0000","last_became_active":"2024-09-21T05:51:48.227690+0000","last_became_peered":"2024-09-21T05:51:48.227690+0000","last_unstale":"2024-09-21T05:52:23.687599+0000","last_undegraded":"2024-09-21T05:52:23.687599+0000","last_fullsized":"2024-09-21T05:52:23.687599+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:37.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.877903+0000","last_change":"2024-09-21T05:52:23.705127+0000","last_active":"2024-09-21T05:53:22.877903+0000","last_peered":"2024-09-21T05:53:22.877903+0000","last_clean":"2024-09-21T05:53:22.877903+0000","last_became_active":"2024-09-21T05:52:23.704731+0000","last_became_peered":"2024-09-21T05:52:23.704731+0000","last_unstale":"2024-09-21T05:53:22.877903+0000","last_undegraded":"2024-09-21T05:53:22.877903+0000","last_fullsized":"2024-09-21T05:53:22.877903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:49.264072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.588183+0000","last_change":"2024-09-21T05:51:48.234444+0000","last_active":"2024-09-21T05:52:23.588183+0000","last_peered":"2024-09-21T05:52:23.588183+0000","last_clean":"2024-09-21T05:52:23.588183+0000","last_became_active":"2024-09-21T05:51:48.233997+0000","last_became_peered":"2024-09-21T05:51:48.233997+0000","last_unstale":"2024-09-21T05:52:23.588183+0000","last_undegraded":"2024-09-21T05:52:23.588183+0000","last_fullsized":"2024-09-21T05:52:23.588183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:12.931628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885618+0000","last_change":"2024-09-21T05:51:50.242267+0000","last_active":"2024-09-21T05:53:22.885618+0000","last_peered":"2024-09-21T05:53:22.885618+0000","last_clean":"2024-09-21T05:53:22.885618+0000","last_became_active":"2024-09-21T05:51:50.241927+0000","last_became_peered":"2024-09-21T05:51:50.241927+0000","last_unstale":"2024-09-21T05:53:22.885618+0000","last_undegraded":"2024-09-21T05:53:22.885618+0000","last_fullsized":"2024-09-21T05:53:22.885618+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:28.954451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":122,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:32.479109+0000","last_change":"2024-09-21T05:51:48.338372+0000","last_active":"2024-09-21T05:53:32.479109+0000","last_peered":"2024-09-21T05:53:32.479109+0000","last_clean":"2024-09-21T05:53:32.479109+0000","last_became_active":"2024-09-21T05:51:48.337966+0000","last_became_peered":"2024-09-21T05:51:48.337966+0000","last_unstale":"2024-09-21T05:53:32.479109+0000","last_undegraded":"2024-09-21T05:53:32.479109+0000","last_fullsized":"2024-09-21T05:53:32.479109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:10.301871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.880256+0000","last_change":"2024-09-21T05:51:50.253151+0000","last_active":"2024-09-21T05:53:22.880256+0000","last_peered":"2024-09-21T05:53:22.880256+0000","last_clean":"2024-09-21T05:53:22.880256+0000","last_became_active":"2024-09-21T05:51:50.252770+0000","last_became_peered":"2024-09-21T05:51:50.252770+0000","last_unstale":"2024-09-21T05:53:22.880256+0000","last_undegraded":"2024-09-21T05:53:22.880256+0000","last_fullsized":"2024-09-21T05:53:22.880256+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:48.784229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587728+0000","last_change":"2024-09-21T05:51:48.233273+0000","last_active":"2024-09-21T05:52:23.587728+0000","last_peered":"2024-09-21T05:52:23.587728+0000","last_clean":"2024-09-21T05:52:23.587728+0000","last_became_active":"2024-09-21T05:51:48.232724+0000","last_became_peered":"2024-09-21T05:51:48.232724+0000","last_unstale":"2024-09-21T05:52:23.587728+0000","last_undegraded":"2024-09-21T05:52:23.587728+0000","last_fullsized":"2024-09-21T05:52:23.587728+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:50.869396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.878794+0000","last_change":"2024-09-21T05:51:50.262521+0000","last_active":"2024-09-21T05:53:22.878794+0000","last_peered":"2024-09-21T05:53:22.878794+0000","last_clean":"2024-09-21T05:53:22.878794+0000","last_became_active":"2024-09-21T05:51:50.262135+0000","last_became_peered":"2024-09-21T05:51:50.262135+0000","last_unstale":"2024-09-21T05:53:22.878794+0000","last_undegraded":"2024-09-21T05:53:22.878794+0000","last_fullsized":"2024-09-21T05:53:22.878794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:18.347182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587326+0000","last_change":"2024-09-21T05:51:48.338532+0000","last_active":"2024-09-21T05:52:23.587326+0000","last_peered":"2024-09-21T05:52:23.587326+0000","last_clean":"2024-09-21T05:52:23.587326+0000","last_became_active":"2024-09-21T05:51:48.338099+0000","last_became_peered":"2024-09-21T05:51:48.338099+0000","last_unstale":"2024-09-21T05:52:23.587326+0000","last_undegraded":"2024-09-21T05:52:23.587326+0000","last_fullsized":"2024-09-21T05:52:23.587326+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:48.670988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.877307+0000","last_change":"2024-09-21T05:51:50.251814+0000","last_active":"2024-09-21T05:53:22.877307+0000","last_peered":"2024-09-21T05:53:22.877307+0000","last_clean":"2024-09-21T05:53:22.877307+0000","last_became_active":"2024-09-21T05:51:50.251401+0000","last_became_peered":"2024-09-21T05:51:50.251401+0000","last_unstale":"2024-09-21T05:53:22.877307+0000","last_undegraded":"2024-09-21T05:53:22.877307+0000","last_fullsized":"2024-09-21T05:53:22.877307+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:12.972300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590808+0000","last_change":"2024-09-21T05:51:48.338312+0000","last_active":"2024-09-21T05:52:23.590808+0000","last_peered":"2024-09-21T05:52:23.590808+0000","last_clean":"2024-09-21T05:52:23.590808+0000","last_became_active":"2024-09-21T05:51:48.337872+0000","last_became_peered":"2024-09-21T05:51:48.337872+0000","last_unstale":"2024-09-21T05:52:23.590808+0000","last_undegraded":"2024-09-21T05:52:23.590808+0000","last_fullsized":"2024-09-21T05:52:23.590808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:26.158650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.879034+0000","last_change":"2024-09-21T05:51:50.245129+0000","last_active":"2024-09-21T05:53:22.879034+0000","last_peered":"2024-09-21T05:53:22.879034+0000","last_clean":"2024-09-21T05:53:22.879034+0000","last_became_active":"2024-09-21T05:51:50.244439+0000","last_became_peered":"2024-09-21T05:51:50.244439+0000","last_unstale":"2024-09-21T05:53:22.879034+0000","last_undegraded":"2024-09-21T05:53:22.879034+0000","last_fullsized":"2024-09-21T05:53:22.879034+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:19.241921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'14","reported_seq":50,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:23.275479+0000","last_change":"2024-09-21T05:52:23.600272+0000","last_active":"2024-09-21T05:53:23.275479+0000","last_peered":"2024-09-21T05:53:23.275479+0000","last_clean":"2024-09-21T05:53:23.275479+0000","last_became_active":"2024-09-21T05:52:23.592946+0000","last_became_peered":"2024-09-21T05:52:23.592946+0000","last_unstale":"2024-09-21T05:53:23.275479+0000","last_undegraded":"2024-09-21T05:53:23.275479+0000","last_fullsized":"2024-09-21T05:53:23.275479+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:52.892645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.887100+0000","last_change":"2024-09-21T05:51:50.253411+0000","last_active":"2024-09-21T05:53:22.887100+0000","last_peered":"2024-09-21T05:53:22.887100+0000","last_clean":"2024-09-21T05:53:22.887100+0000","last_became_active":"2024-09-21T05:51:50.252816+0000","last_became_peered":"2024-09-21T05:51:50.252816+0000","last_unstale":"2024-09-21T05:53:22.887100+0000","last_undegraded":"2024-09-21T05:53:22.887100+0000","last_fullsized":"2024-09-21T05:53:22.887100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:33.444176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.688065+0000","last_change":"2024-09-21T05:51:48.852668+0000","last_active":"2024-09-21T05:52:23.688065+0000","last_peered":"2024-09-21T05:52:23.688065+0000","last_clean":"2024-09-21T05:52:23.688065+0000","last_became_active":"2024-09-21T05:51:48.852298+0000","last_became_peered":"2024-09-21T05:51:48.852298+0000","last_unstale":"2024-09-21T05:52:23.688065+0000","last_undegraded":"2024-09-21T05:52:23.688065+0000","last_fullsized":"2024-09-21T05:52:23.688065+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:19.529194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885939+0000","last_change":"2024-09-21T05:51:50.246720+0000","last_active":"2024-09-21T05:53:22.885939+0000","last_peered":"2024-09-21T05:53:22.885939+0000","last_clean":"2024-09-21T05:53:22.885939+0000","last_became_active":"2024-09-21T05:51:50.246318+0000","last_became_peered":"2024-09-21T05:51:50.246318+0000","last_unstale":"2024-09-21T05:53:22.885939+0000","last_undegraded":"2024-09-21T05:53:22.885939+0000","last_fullsized":"2024-09-21T05:53:22.885939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:45.737949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703802+0000","last_change":"2024-09-21T05:51:48.338346+0000","last_active":"2024-09-21T05:52:23.703802+0000","last_peered":"2024-09-21T05:52:23.703802+0000","last_clean":"2024-09-21T05:52:23.703802+0000","last_became_active":"2024-09-21T05:51:48.337968+0000","last_became_peered":"2024-09-21T05:51:48.337968+0000","last_unstale":"2024-09-21T05:52:23.703802+0000","last_undegraded":"2024-09-21T05:52:23.703802+0000","last_fullsized":"2024-09-21T05:52:23.703802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:32.450546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.840051+0000","last_change":"2024-09-21T05:51:50.255993+0000","last_active":"2024-09-21T05:53:22.840051+0000","last_peered":"2024-09-21T05:53:22.840051+0000","last_clean":"2024-09-21T05:53:22.840051+0000","last_became_active":"2024-09-21T05:51:50.255645+0000","last_became_peered":"2024-09-21T05:51:50.255645+0000","last_unstale":"2024-09-21T05:53:22.840051+0000","last_undegraded":"2024-09-21T05:53:22.840051+0000","last_fullsized":"2024-09-21T05:53:22.840051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.890940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589612+0000","last_change":"2024-09-21T05:51:48.231659+0000","last_active":"2024-09-21T05:52:23.589612+0000","last_peered":"2024-09-21T05:52:23.589612+0000","last_clean":"2024-09-21T05:52:23.589612+0000","last_became_active":"2024-09-21T05:51:48.231137+0000","last_became_peered":"2024-09-21T05:51:48.231137+0000","last_unstale":"2024-09-21T05:52:23.589612+0000","last_undegraded":"2024-09-21T05:52:23.589612+0000","last_fullsized":"2024-09-21T05:52:23.589612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:06.166268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884218+0000","last_change":"2024-09-21T05:51:50.251904+0000","last_active":"2024-09-21T05:53:22.884218+0000","last_peered":"2024-09-21T05:53:22.884218+0000","last_clean":"2024-09-21T05:53:22.884218+0000","last_became_active":"2024-09-21T05:51:50.251403+0000","last_became_peered":"2024-09-21T05:51:50.251403+0000","last_unstale":"2024-09-21T05:53:22.884218+0000","last_undegraded":"2024-09-21T05:53:22.884218+0000","last_fullsized":"2024-09-21T05:53:22.884218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:47.702083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.603022+0000","last_change":"2024-09-21T05:52:23.602925+0000","last_active":"2024-09-21T05:52:23.603022+0000","last_peered":"2024-09-21T05:52:23.603022+0000","last_clean":"2024-09-21T05:52:23.603022+0000","last_became_active":"2024-09-21T05:52:23.598086+0000","last_became_peered":"2024-09-21T05:52:23.598086+0000","last_unstale":"2024-09-21T05:52:23.603022+0000","last_undegraded":"2024-09-21T05:52:23.603022+0000","last_fullsized":"2024-09-21T05:52:23.603022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:03.260218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.871098+0000","last_change":"2024-09-21T05:51:50.256654+0000","last_active":"2024-09-21T05:53:22.871098+0000","last_peered":"2024-09-21T05:53:22.871098+0000","last_clean":"2024-09-21T05:53:22.871098+0000","last_became_active":"2024-09-21T05:51:50.255830+0000","last_became_peered":"2024-09-21T05:51:50.255830+0000","last_unstale":"2024-09-21T05:53:22.871098+0000","last_undegraded":"2024-09-21T05:53:22.871098+0000","last_fullsized":"2024-09-21T05:53:22.871098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:49.643890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591174+0000","last_change":"2024-09-21T05:51:48.233608+0000","last_active":"2024-09-21T05:52:23.591174+0000","last_peered":"2024-09-21T05:52:23.591174+0000","last_clean":"2024-09-21T05:52:23.591174+0000","last_became_active":"2024-09-21T05:51:48.233187+0000","last_became_peered":"2024-09-21T05:51:48.233187+0000","last_unstale":"2024-09-21T05:52:23.591174+0000","last_undegraded":"2024-09-21T05:52:23.591174+0000","last_fullsized":"2024-09-21T05:52:23.591174+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:57.815632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.890931+0000","last_change":"2024-09-21T05:51:50.266753+0000","last_active":"2024-09-21T05:53:22.890931+0000","last_peered":"2024-09-21T05:53:22.890931+0000","last_clean":"2024-09-21T05:53:22.890931+0000","last_became_active":"2024-09-21T05:51:50.266368+0000","last_became_peered":"2024-09-21T05:51:50.266368+0000","last_unstale":"2024-09-21T05:53:22.890931+0000","last_undegraded":"2024-09-21T05:53:22.890931+0000","last_fullsized":"2024-09-21T05:53:22.890931+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:02.011213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882162+0000","last_change":"2024-09-21T05:51:50.257731+0000","last_active":"2024-09-21T05:53:22.882162+0000","last_peered":"2024-09-21T05:53:22.882162+0000","last_clean":"2024-09-21T05:53:22.882162+0000","last_became_active":"2024-09-21T05:51:50.257396+0000","last_became_peered":"2024-09-21T05:51:50.257396+0000","last_unstale":"2024-09-21T05:53:22.882162+0000","last_undegraded":"2024-09-21T05:53:22.882162+0000","last_fullsized":"2024-09-21T05:53:22.882162+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:58.109069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590778+0000","last_change":"2024-09-21T05:51:48.234067+0000","last_active":"2024-09-21T05:52:23.590778+0000","last_peered":"2024-09-21T05:52:23.590778+0000","last_clean":"2024-09-21T05:52:23.590778+0000","last_became_active":"2024-09-21T05:51:48.233532+0000","last_became_peered":"2024-09-21T05:51:48.233532+0000","last_unstale":"2024-09-21T05:52:23.590778+0000","last_undegraded":"2024-09-21T05:52:23.590778+0000","last_fullsized":"2024-09-21T05:52:23.590778+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:40.997254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.880925+0000","last_change":"2024-09-21T05:51:50.265453+0000","last_active":"2024-09-21T05:53:22.880925+0000","last_peered":"2024-09-21T05:53:22.880925+0000","last_clean":"2024-09-21T05:53:22.880925+0000","last_became_active":"2024-09-21T05:51:50.265073+0000","last_became_peered":"2024-09-21T05:51:50.265073+0000","last_unstale":"2024-09-21T05:53:22.880925+0000","last_undegraded":"2024-09-21T05:53:22.880925+0000","last_fullsized":"2024-09-21T05:53:22.880925+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:15.295822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.694313+0000","last_change":"2024-09-21T05:52:23.694236+0000","last_active":"2024-09-21T05:52:23.694313+0000","last_peered":"2024-09-21T05:52:23.694313+0000","last_clean":"2024-09-21T05:52:23.694313+0000","last_became_active":"2024-09-21T05:52:23.688964+0000","last_became_peered":"2024-09-21T05:52:23.688964+0000","last_unstale":"2024-09-21T05:52:23.694313+0000","last_undegraded":"2024-09-21T05:52:23.694313+0000","last_fullsized":"2024-09-21T05:52:23.694313+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:25.453769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.881242+0000","last_change":"2024-09-21T05:51:50.267110+0000","last_active":"2024-09-21T05:53:22.881242+0000","last_peered":"2024-09-21T05:53:22.881242+0000","last_clean":"2024-09-21T05:53:22.881242+0000","last_became_active":"2024-09-21T05:51:50.266504+0000","last_became_peered":"2024-09-21T05:51:50.266504+0000","last_unstale":"2024-09-21T05:53:22.881242+0000","last_undegraded":"2024-09-21T05:53:22.881242+0000","last_fullsized":"2024-09-21T05:53:22.881242+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:10.618361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590428+0000","last_change":"2024-09-21T05:51:48.337971+0000","last_active":"2024-09-21T05:52:23.590428+0000","last_peered":"2024-09-21T05:52:23.590428+0000","last_clean":"2024-09-21T05:52:23.590428+0000","last_became_active":"2024-09-21T05:51:48.337487+0000","last_became_peered":"2024-09-21T05:51:48.337487+0000","last_unstale":"2024-09-21T05:52:23.590428+0000","last_undegraded":"2024-09-21T05:52:23.590428+0000","last_fullsized":"2024-09-21T05:52:23.590428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.150563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882678+0000","last_change":"2024-09-21T05:51:50.253826+0000","last_active":"2024-09-21T05:53:22.882678+0000","last_peered":"2024-09-21T05:53:22.882678+0000","last_clean":"2024-09-21T05:53:22.882678+0000","last_became_active":"2024-09-21T05:51:50.251700+0000","last_became_peered":"2024-09-21T05:51:50.251700+0000","last_unstale":"2024-09-21T05:53:22.882678+0000","last_undegraded":"2024-09-21T05:53:22.882678+0000","last_fullsized":"2024-09-21T05:53:22.882678+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:02.929651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587502+0000","last_change":"2024-09-21T05:51:48.234358+0000","last_active":"2024-09-21T05:52:23.587502+0000","last_peered":"2024-09-21T05:52:23.587502+0000","last_clean":"2024-09-21T05:52:23.587502+0000","last_became_active":"2024-09-21T05:51:48.233982+0000","last_became_peered":"2024-09-21T05:51:48.233982+0000","last_unstale":"2024-09-21T05:52:23.587502+0000","last_undegraded":"2024-09-21T05:52:23.587502+0000","last_fullsized":"2024-09-21T05:52:23.587502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:42.510872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68601,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":592,"num_read_kb":367,"num_write":174,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":205803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":406831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972390,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1519616,"data_stored":1062995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168620,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":407067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332145,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":406987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528374,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1429504,"data_stored":999058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691899,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":406456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36752,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708400,"statfs":{"total":95995035648,"available":95957401600,"internally_reserved":0,"allocated":1441792,"data_stored":998210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":407425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":406767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378704,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":472058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542228,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":470708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40328,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704824,"statfs":{"total":95995035648,"available":95953739776,"internally_reserved":0,"allocated":843776,"data_stored":407727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:53:38.497 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T05:53:38.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T05:53:38.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.647+0000 7f4973a63640 1 -- 172.21.15.7:0/878172465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f496c108c50 msgr2=0x7f496c10f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:38.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.647+0000 7f4973a63640 1 --2- 172.21.15.7:0/878172465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f496c108c50 0x7f496c10f480 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4964009ca0 tx=0x7f496402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.647+0000 7f4973a63640 1 -- 172.21.15.7:0/878172465 shutdown_connections 2024-09-21T05:53:38.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.647+0000 7f4973a63640 1 --2- 172.21.15.7:0/878172465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f496c108c50 0x7f496c10f480 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.647+0000 7f4973a63640 1 --2- 172.21.15.7:0/878172465 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f496c108300 0x7f496c108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.647+0000 7f4973a63640 1 --2- 172.21.15.7:0/878172465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f496c1029d0 0x7f496c102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.647+0000 7f4973a63640 1 -- 172.21.15.7:0/878172465 >> 172.21.15.7:0/878172465 conn(0x7f496c07a660 msgr2=0x7f496c07aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:38.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.647+0000 7f4973a63640 1 -- 172.21.15.7:0/878172465 shutdown_connections 2024-09-21T05:53:38.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.647+0000 7f4973a63640 1 -- 172.21.15.7:0/878172465 wait complete. 2024-09-21T05:53:38.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.648+0000 7f4973a63640 1 Processor -- start 2024-09-21T05:53:38.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.648+0000 7f4973a63640 1 -- start start 2024-09-21T05:53:38.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.648+0000 7f4973a63640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f496c1029d0 0x7f496c19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:38.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.648+0000 7f4973a63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f496c108300 0x7f496c19b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:38.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.648+0000 7f4973a63640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f496c108c50 0x7f496c19bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:38.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.648+0000 7f4973a63640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f496c112960 con 0x7f496c108300 2024-09-21T05:53:38.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.648+0000 7f4973a63640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f496c1127e0 con 0x7f496c1029d0 2024-09-21T05:53:38.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.648+0000 7f4973a63640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f496c112ae0 con 0x7f496c108c50 2024-09-21T05:53:38.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.648+0000 7f4970ffe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f496c108300 0x7f496c19b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:38.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.648+0000 7f4970ffe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f496c108300 0x7f496c19b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33176/0 (socket says 172.21.15.7:33176) 2024-09-21T05:53:38.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.648+0000 7f4970ffe640 1 -- 172.21.15.7:0/1820896272 learned_addr learned my addr 172.21.15.7:0/1820896272 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.648+0000 7f49717ff640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f496c1029d0 0x7f496c19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.648+0000 7f4972000640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f496c108c50 0x7f496c19bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.649+0000 7f4970ffe640 1 -- 172.21.15.7:0/1820896272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f496c108c50 msgr2=0x7f496c19bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.649+0000 7f4970ffe640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f496c108c50 0x7f496c19bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.649+0000 7f4970ffe640 1 -- 172.21.15.7:0/1820896272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f496c1029d0 msgr2=0x7f496c19b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.649+0000 7f4970ffe640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f496c1029d0 0x7f496c19b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.649+0000 7f4970ffe640 1 -- 172.21.15.7:0/1820896272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496c1a6440 con 0x7f496c108300 2024-09-21T05:53:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.649+0000 7f4970ffe640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f496c108300 0x7f496c19b6f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f496000e9f0 tx=0x7f496000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.651+0000 7f496a7fc640 1 -- 172.21.15.7:0/1820896272 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496000ccc0 con 0x7f496c108300 2024-09-21T05:53:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.651+0000 7f496a7fc640 1 -- 172.21.15.7:0/1820896272 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49600108e0 con 0x7f496c108300 2024-09-21T05:53:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.651+0000 7f496a7fc640 1 -- 172.21.15.7:0/1820896272 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4960018860 con 0x7f496c108300 2024-09-21T05:53:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.651+0000 7f4973a63640 1 -- 172.21.15.7:0/1820896272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496c1a6730 con 0x7f496c108300 2024-09-21T05:53:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.651+0000 7f4973a63640 1 -- 172.21.15.7:0/1820896272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f496c1a6c30 con 0x7f496c108300 2024-09-21T05:53:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.652+0000 7f4973a63640 1 -- 172.21.15.7:0/1820896272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f496c103c40 con 0x7f496c108300 2024-09-21T05:53:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.654+0000 7f496a7fc640 1 -- 172.21.15.7:0/1820896272 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f4960010430 con 0x7f496c108300 2024-09-21T05:53:38.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.654+0000 7f496a7fc640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f49540b65e0 0x7f49540b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:38.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.655+0000 7f49717ff640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f49540b65e0 0x7f49540b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:38.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.655+0000 7f496a7fc640 1 -- 172.21.15.7:0/1820896272 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f49600e7ac0 con 0x7f496c108300 2024-09-21T05:53:38.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.655+0000 7f49717ff640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f49540b65e0 0x7f49540b8af0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f496c06b3f0 tx=0x7f495c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:38.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.657+0000 7f496a7fc640 1 -- 172.21.15.7:0/1820896272 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f49600b2690 con 0x7f496c108300 2024-09-21T05:53:38.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:38 smithi007 ceph-mon[30983]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:38.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.842+0000 7f4973a63640 1 -- 172.21.15.7:0/1820896272 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f496c063800 con 0x7f49540b65e0 2024-09-21T05:53:38.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.846+0000 7f496a7fc640 1 -- 172.21.15.7:0/1820896272 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258816 (secure 0 0 0) 0x7f496c063800 con 0x7f49540b65e0 2024-09-21T05:53:38.851 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:38.853 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T05:53:38.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.849+0000 7f4973a63640 1 -- 172.21.15.7:0/1820896272 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f49540b65e0 msgr2=0x7f49540b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:38.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.849+0000 7f4973a63640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f49540b65e0 0x7f49540b8af0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f496c06b3f0 tx=0x7f495c005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:38.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.849+0000 7f4973a63640 1 -- 172.21.15.7:0/1820896272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f496c108300 msgr2=0x7f496c19b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:38.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.849+0000 7f4973a63640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f496c108300 0x7f496c19b6f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f496000e9f0 tx=0x7f496000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.849+0000 7f4973a63640 1 -- 172.21.15.7:0/1820896272 shutdown_connections 2024-09-21T05:53:38.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.849+0000 7f4973a63640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f49540b65e0 0x7f49540b8af0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.849+0000 7f4973a63640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f496c108300 0x7f496c19b6f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.849+0000 7f4973a63640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f496c108c50 0x7f496c19bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.849+0000 7f4973a63640 1 --2- 172.21.15.7:0/1820896272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f496c1029d0 0x7f496c19b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:38.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.849+0000 7f4973a63640 1 -- 172.21.15.7:0/1820896272 >> 172.21.15.7:0/1820896272 conn(0x7f496c07a660 msgr2=0x7f496c104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:38.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.849+0000 7f4973a63640 1 -- 172.21.15.7:0/1820896272 shutdown_connections 2024-09-21T05:53:38.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:38.849+0000 7f4973a63640 1 -- 172.21.15.7:0/1820896272 wait complete. 2024-09-21T05:53:38.863 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-21T05:53:38.509003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664646,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":690,"num_read_kb":453,"num_write":300,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2951840,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":742,"ondisk_log_size":742,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390108,"kb_used_data":11740,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551716,"statfs":{"total":1151940427776,"available":1151540957184,"internally_reserved":0,"allocated":12021760,"data_stored":6858040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5751,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":48,"num_write":4,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003192"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884672+0000","last_change":"2024-09-21T05:51:50.266316+0000","last_active":"2024-09-21T05:53:22.884672+0000","last_peered":"2024-09-21T05:53:22.884672+0000","last_clean":"2024-09-21T05:53:22.884672+0000","last_became_active":"2024-09-21T05:51:50.265970+0000","last_became_peered":"2024-09-21T05:51:50.265970+0000","last_unstale":"2024-09-21T05:53:22.884672+0000","last_undegraded":"2024-09-21T05:53:22.884672+0000","last_fullsized":"2024-09-21T05:53:22.884672+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:31.728635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882665+0000","last_change":"2024-09-21T05:51:50.254215+0000","last_active":"2024-09-21T05:53:22.882665+0000","last_peered":"2024-09-21T05:53:22.882665+0000","last_clean":"2024-09-21T05:53:22.882665+0000","last_became_active":"2024-09-21T05:51:50.253701+0000","last_became_peered":"2024-09-21T05:51:50.253701+0000","last_unstale":"2024-09-21T05:53:22.882665+0000","last_undegraded":"2024-09-21T05:53:22.882665+0000","last_fullsized":"2024-09-21T05:53:22.882665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:56.211706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884357+0000","last_change":"2024-09-21T05:51:50.258535+0000","last_active":"2024-09-21T05:53:22.884357+0000","last_peered":"2024-09-21T05:53:22.884357+0000","last_clean":"2024-09-21T05:53:22.884357+0000","last_became_active":"2024-09-21T05:51:50.258186+0000","last_became_peered":"2024-09-21T05:51:50.258186+0000","last_unstale":"2024-09-21T05:53:22.884357+0000","last_undegraded":"2024-09-21T05:53:22.884357+0000","last_fullsized":"2024-09-21T05:53:22.884357+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:15.134574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.888046+0000","last_change":"2024-09-21T05:51:50.254832+0000","last_active":"2024-09-21T05:53:22.888046+0000","last_peered":"2024-09-21T05:53:22.888046+0000","last_clean":"2024-09-21T05:53:22.888046+0000","last_became_active":"2024-09-21T05:51:50.254449+0000","last_became_peered":"2024-09-21T05:51:50.254449+0000","last_unstale":"2024-09-21T05:53:22.888046+0000","last_undegraded":"2024-09-21T05:53:22.888046+0000","last_fullsized":"2024-09-21T05:53:22.888046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:31.411808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.870896+0000","last_change":"2024-09-21T05:51:50.251144+0000","last_active":"2024-09-21T05:53:22.870896+0000","last_peered":"2024-09-21T05:53:22.870896+0000","last_clean":"2024-09-21T05:53:22.870896+0000","last_became_active":"2024-09-21T05:51:50.250782+0000","last_became_peered":"2024-09-21T05:51:50.250782+0000","last_unstale":"2024-09-21T05:53:22.870896+0000","last_undegraded":"2024-09-21T05:53:22.870896+0000","last_fullsized":"2024-09-21T05:53:22.870896+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:15.055805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882829+0000","last_change":"2024-09-21T05:51:50.259758+0000","last_active":"2024-09-21T05:53:22.882829+0000","last_peered":"2024-09-21T05:53:22.882829+0000","last_clean":"2024-09-21T05:53:22.882829+0000","last_became_active":"2024-09-21T05:51:50.259358+0000","last_became_peered":"2024-09-21T05:51:50.259358+0000","last_unstale":"2024-09-21T05:53:22.882829+0000","last_undegraded":"2024-09-21T05:53:22.882829+0000","last_fullsized":"2024-09-21T05:53:22.882829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:08.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883614+0000","last_change":"2024-09-21T05:51:50.260018+0000","last_active":"2024-09-21T05:53:22.883614+0000","last_peered":"2024-09-21T05:53:22.883614+0000","last_clean":"2024-09-21T05:53:22.883614+0000","last_became_active":"2024-09-21T05:51:50.257143+0000","last_became_peered":"2024-09-21T05:51:50.257143+0000","last_unstale":"2024-09-21T05:53:22.883614+0000","last_undegraded":"2024-09-21T05:53:22.883614+0000","last_fullsized":"2024-09-21T05:53:22.883614+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:05.579662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882872+0000","last_change":"2024-09-21T05:51:50.256867+0000","last_active":"2024-09-21T05:53:22.882872+0000","last_peered":"2024-09-21T05:53:22.882872+0000","last_clean":"2024-09-21T05:53:22.882872+0000","last_became_active":"2024-09-21T05:51:50.256392+0000","last_became_peered":"2024-09-21T05:51:50.256392+0000","last_unstale":"2024-09-21T05:53:22.882872+0000","last_undegraded":"2024-09-21T05:53:22.882872+0000","last_fullsized":"2024-09-21T05:53:22.882872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:43.169607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882375+0000","last_change":"2024-09-21T05:51:50.260430+0000","last_active":"2024-09-21T05:53:22.882375+0000","last_peered":"2024-09-21T05:53:22.882375+0000","last_clean":"2024-09-21T05:53:22.882375+0000","last_became_active":"2024-09-21T05:51:50.259993+0000","last_became_peered":"2024-09-21T05:51:50.259993+0000","last_unstale":"2024-09-21T05:53:22.882375+0000","last_undegraded":"2024-09-21T05:53:22.882375+0000","last_fullsized":"2024-09-21T05:53:22.882375+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:31.811151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885323+0000","last_change":"2024-09-21T05:51:50.263027+0000","last_active":"2024-09-21T05:53:22.885323+0000","last_peered":"2024-09-21T05:53:22.885323+0000","last_clean":"2024-09-21T05:53:22.885323+0000","last_became_active":"2024-09-21T05:51:50.261816+0000","last_became_peered":"2024-09-21T05:51:50.261816+0000","last_unstale":"2024-09-21T05:53:22.885323+0000","last_undegraded":"2024-09-21T05:53:22.885323+0000","last_fullsized":"2024-09-21T05:53:22.885323+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:39.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.890919+0000","last_change":"2024-09-21T05:51:50.263976+0000","last_active":"2024-09-21T05:53:22.890919+0000","last_peered":"2024-09-21T05:53:22.890919+0000","last_clean":"2024-09-21T05:53:22.890919+0000","last_became_active":"2024-09-21T05:51:50.263179+0000","last_became_peered":"2024-09-21T05:51:50.263179+0000","last_unstale":"2024-09-21T05:53:22.890919+0000","last_undegraded":"2024-09-21T05:53:22.890919+0000","last_fullsized":"2024-09-21T05:53:22.890919+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:08.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.888587+0000","last_change":"2024-09-21T05:51:50.259967+0000","last_active":"2024-09-21T05:53:22.888587+0000","last_peered":"2024-09-21T05:53:22.888587+0000","last_clean":"2024-09-21T05:53:22.888587+0000","last_became_active":"2024-09-21T05:51:50.259460+0000","last_became_peered":"2024-09-21T05:51:50.259460+0000","last_unstale":"2024-09-21T05:53:22.888587+0000","last_undegraded":"2024-09-21T05:53:22.888587+0000","last_fullsized":"2024-09-21T05:53:22.888587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:48.576362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.874864+0000","last_change":"2024-09-21T05:51:50.252949+0000","last_active":"2024-09-21T05:53:22.874864+0000","last_peered":"2024-09-21T05:53:22.874864+0000","last_clean":"2024-09-21T05:53:22.874864+0000","last_became_active":"2024-09-21T05:51:50.252518+0000","last_became_peered":"2024-09-21T05:51:50.252518+0000","last_unstale":"2024-09-21T05:53:22.874864+0000","last_undegraded":"2024-09-21T05:53:22.874864+0000","last_fullsized":"2024-09-21T05:53:22.874864+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:38.145947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884022+0000","last_change":"2024-09-21T05:51:50.250309+0000","last_active":"2024-09-21T05:53:22.884022+0000","last_peered":"2024-09-21T05:53:22.884022+0000","last_clean":"2024-09-21T05:53:22.884022+0000","last_became_active":"2024-09-21T05:51:50.249629+0000","last_became_peered":"2024-09-21T05:51:50.249629+0000","last_unstale":"2024-09-21T05:53:22.884022+0000","last_undegraded":"2024-09-21T05:53:22.884022+0000","last_fullsized":"2024-09-21T05:53:22.884022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:28.551654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885421+0000","last_change":"2024-09-21T05:51:50.242211+0000","last_active":"2024-09-21T05:53:22.885421+0000","last_peered":"2024-09-21T05:53:22.885421+0000","last_clean":"2024-09-21T05:53:22.885421+0000","last_became_active":"2024-09-21T05:51:50.241861+0000","last_became_peered":"2024-09-21T05:51:50.241861+0000","last_unstale":"2024-09-21T05:53:22.885421+0000","last_undegraded":"2024-09-21T05:53:22.885421+0000","last_fullsized":"2024-09-21T05:53:22.885421+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:46.045907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.887928+0000","last_change":"2024-09-21T05:51:50.268926+0000","last_active":"2024-09-21T05:53:22.887928+0000","last_peered":"2024-09-21T05:53:22.887928+0000","last_clean":"2024-09-21T05:53:22.887928+0000","last_became_active":"2024-09-21T05:51:50.268164+0000","last_became_peered":"2024-09-21T05:51:50.268164+0000","last_unstale":"2024-09-21T05:53:22.887928+0000","last_undegraded":"2024-09-21T05:53:22.887928+0000","last_fullsized":"2024-09-21T05:53:22.887928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:43.021303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884646+0000","last_change":"2024-09-21T05:51:50.266365+0000","last_active":"2024-09-21T05:53:22.884646+0000","last_peered":"2024-09-21T05:53:22.884646+0000","last_clean":"2024-09-21T05:53:22.884646+0000","last_became_active":"2024-09-21T05:51:50.265803+0000","last_became_peered":"2024-09-21T05:51:50.265803+0000","last_unstale":"2024-09-21T05:53:22.884646+0000","last_undegraded":"2024-09-21T05:53:22.884646+0000","last_fullsized":"2024-09-21T05:53:22.884646+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:45.574795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.877825+0000","last_change":"2024-09-21T05:51:50.257129+0000","last_active":"2024-09-21T05:53:22.877825+0000","last_peered":"2024-09-21T05:53:22.877825+0000","last_clean":"2024-09-21T05:53:22.877825+0000","last_became_active":"2024-09-21T05:51:50.256721+0000","last_became_peered":"2024-09-21T05:51:50.256721+0000","last_unstale":"2024-09-21T05:53:22.877825+0000","last_undegraded":"2024-09-21T05:53:22.877825+0000","last_fullsized":"2024-09-21T05:53:22.877825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:26.688743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.881613+0000","last_change":"2024-09-21T05:51:50.243460+0000","last_active":"2024-09-21T05:53:22.881613+0000","last_peered":"2024-09-21T05:53:22.881613+0000","last_clean":"2024-09-21T05:53:22.881613+0000","last_became_active":"2024-09-21T05:51:50.243094+0000","last_became_peered":"2024-09-21T05:51:50.243094+0000","last_unstale":"2024-09-21T05:53:22.881613+0000","last_undegraded":"2024-09-21T05:53:22.881613+0000","last_fullsized":"2024-09-21T05:53:22.881613+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:16.751564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.871108+0000","last_change":"2024-09-21T05:52:23.595697+0000","last_active":"2024-09-21T05:53:22.871108+0000","last_peered":"2024-09-21T05:53:22.871108+0000","last_clean":"2024-09-21T05:53:22.871108+0000","last_became_active":"2024-09-21T05:52:23.595173+0000","last_became_peered":"2024-09-21T05:52:23.595173+0000","last_unstale":"2024-09-21T05:53:22.871108+0000","last_undegraded":"2024-09-21T05:53:22.871108+0000","last_fullsized":"2024-09-21T05:53:22.871108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:18.036215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883343+0000","last_change":"2024-09-21T05:51:50.251288+0000","last_active":"2024-09-21T05:53:22.883343+0000","last_peered":"2024-09-21T05:53:22.883343+0000","last_clean":"2024-09-21T05:53:22.883343+0000","last_became_active":"2024-09-21T05:51:50.250841+0000","last_became_peered":"2024-09-21T05:51:50.250841+0000","last_unstale":"2024-09-21T05:53:22.883343+0000","last_undegraded":"2024-09-21T05:53:22.883343+0000","last_fullsized":"2024-09-21T05:53:22.883343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:44.196822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.890690+0000","last_change":"2024-09-21T05:51:50.259418+0000","last_active":"2024-09-21T05:53:22.890690+0000","last_peered":"2024-09-21T05:53:22.890690+0000","last_clean":"2024-09-21T05:53:22.890690+0000","last_became_active":"2024-09-21T05:51:50.257641+0000","last_became_peered":"2024-09-21T05:51:50.257641+0000","last_unstale":"2024-09-21T05:53:22.890690+0000","last_undegraded":"2024-09-21T05:53:22.890690+0000","last_fullsized":"2024-09-21T05:53:22.890690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:23.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.873706+0000","last_change":"2024-09-21T05:51:50.252746+0000","last_active":"2024-09-21T05:53:22.873706+0000","last_peered":"2024-09-21T05:53:22.873706+0000","last_clean":"2024-09-21T05:53:22.873706+0000","last_became_active":"2024-09-21T05:51:50.250551+0000","last_became_peered":"2024-09-21T05:51:50.250551+0000","last_unstale":"2024-09-21T05:53:22.873706+0000","last_undegraded":"2024-09-21T05:53:22.873706+0000","last_fullsized":"2024-09-21T05:53:22.873706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:05.821737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883838+0000","last_change":"2024-09-21T05:51:50.246170+0000","last_active":"2024-09-21T05:53:22.883838+0000","last_peered":"2024-09-21T05:53:22.883838+0000","last_clean":"2024-09-21T05:53:22.883838+0000","last_became_active":"2024-09-21T05:51:50.245747+0000","last_became_peered":"2024-09-21T05:51:50.245747+0000","last_unstale":"2024-09-21T05:53:22.883838+0000","last_undegraded":"2024-09-21T05:53:22.883838+0000","last_fullsized":"2024-09-21T05:53:22.883838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:05.005437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.873161+0000","last_change":"2024-09-21T05:51:50.258248+0000","last_active":"2024-09-21T05:53:22.873161+0000","last_peered":"2024-09-21T05:53:22.873161+0000","last_clean":"2024-09-21T05:53:22.873161+0000","last_became_active":"2024-09-21T05:51:50.257891+0000","last_became_peered":"2024-09-21T05:51:50.257891+0000","last_unstale":"2024-09-21T05:53:22.873161+0000","last_undegraded":"2024-09-21T05:53:22.873161+0000","last_fullsized":"2024-09-21T05:53:22.873161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:44.093064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.888481+0000","last_change":"2024-09-21T05:51:50.258497+0000","last_active":"2024-09-21T05:53:22.888481+0000","last_peered":"2024-09-21T05:53:22.888481+0000","last_clean":"2024-09-21T05:53:22.888481+0000","last_became_active":"2024-09-21T05:51:50.257633+0000","last_became_peered":"2024-09-21T05:51:50.257633+0000","last_unstale":"2024-09-21T05:53:22.888481+0000","last_undegraded":"2024-09-21T05:53:22.888481+0000","last_fullsized":"2024-09-21T05:53:22.888481+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:41.793650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.875220+0000","last_change":"2024-09-21T05:51:50.255336+0000","last_active":"2024-09-21T05:53:22.875220+0000","last_peered":"2024-09-21T05:53:22.875220+0000","last_clean":"2024-09-21T05:53:22.875220+0000","last_became_active":"2024-09-21T05:51:50.254955+0000","last_became_peered":"2024-09-21T05:51:50.254955+0000","last_unstale":"2024-09-21T05:53:22.875220+0000","last_undegraded":"2024-09-21T05:53:22.875220+0000","last_fullsized":"2024-09-21T05:53:22.875220+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:28.198455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.887359+0000","last_change":"2024-09-21T05:51:50.242391+0000","last_active":"2024-09-21T05:53:22.887359+0000","last_peered":"2024-09-21T05:53:22.887359+0000","last_clean":"2024-09-21T05:53:22.887359+0000","last_became_active":"2024-09-21T05:51:50.242055+0000","last_became_peered":"2024-09-21T05:51:50.242055+0000","last_unstale":"2024-09-21T05:53:22.887359+0000","last_undegraded":"2024-09-21T05:53:22.887359+0000","last_fullsized":"2024-09-21T05:53:22.887359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:48.937516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885688+0000","last_change":"2024-09-21T05:51:50.243343+0000","last_active":"2024-09-21T05:53:22.885688+0000","last_peered":"2024-09-21T05:53:22.885688+0000","last_clean":"2024-09-21T05:53:22.885688+0000","last_became_active":"2024-09-21T05:51:50.243005+0000","last_became_peered":"2024-09-21T05:51:50.243005+0000","last_unstale":"2024-09-21T05:53:22.885688+0000","last_undegraded":"2024-09-21T05:53:22.885688+0000","last_fullsized":"2024-09-21T05:53:22.885688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:51.975966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883168+0000","last_change":"2024-09-21T05:51:50.250290+0000","last_active":"2024-09-21T05:53:22.883168+0000","last_peered":"2024-09-21T05:53:22.883168+0000","last_clean":"2024-09-21T05:53:22.883168+0000","last_became_active":"2024-09-21T05:51:50.249867+0000","last_became_peered":"2024-09-21T05:51:50.249867+0000","last_unstale":"2024-09-21T05:53:22.883168+0000","last_undegraded":"2024-09-21T05:53:22.883168+0000","last_fullsized":"2024-09-21T05:53:22.883168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:33.852383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.881035+0000","last_change":"2024-09-21T05:51:50.244908+0000","last_active":"2024-09-21T05:53:22.881035+0000","last_peered":"2024-09-21T05:53:22.881035+0000","last_clean":"2024-09-21T05:53:22.881035+0000","last_became_active":"2024-09-21T05:51:50.244473+0000","last_became_peered":"2024-09-21T05:51:50.244473+0000","last_unstale":"2024-09-21T05:53:22.881035+0000","last_undegraded":"2024-09-21T05:53:22.881035+0000","last_fullsized":"2024-09-21T05:53:22.881035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:08.040920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.876658+0000","last_change":"2024-09-21T05:51:50.259926+0000","last_active":"2024-09-21T05:53:22.876658+0000","last_peered":"2024-09-21T05:53:22.876658+0000","last_clean":"2024-09-21T05:53:22.876658+0000","last_became_active":"2024-09-21T05:51:50.259511+0000","last_became_peered":"2024-09-21T05:51:50.259511+0000","last_unstale":"2024-09-21T05:53:22.876658+0000","last_undegraded":"2024-09-21T05:53:22.876658+0000","last_fullsized":"2024-09-21T05:53:22.876658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:46.735741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.858517+0000","last_change":"2024-09-21T05:51:50.249474+0000","last_active":"2024-09-21T05:53:22.858517+0000","last_peered":"2024-09-21T05:53:22.858517+0000","last_clean":"2024-09-21T05:53:22.858517+0000","last_became_active":"2024-09-21T05:51:50.247503+0000","last_became_peered":"2024-09-21T05:51:50.247503+0000","last_unstale":"2024-09-21T05:53:22.858517+0000","last_undegraded":"2024-09-21T05:53:22.858517+0000","last_fullsized":"2024-09-21T05:53:22.858517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:11.639218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:33.480859+0000","last_change":"2024-09-21T05:51:48.236001+0000","last_active":"2024-09-21T05:53:33.480859+0000","last_peered":"2024-09-21T05:53:33.480859+0000","last_clean":"2024-09-21T05:53:33.480859+0000","last_became_active":"2024-09-21T05:51:48.235603+0000","last_became_peered":"2024-09-21T05:51:48.235603+0000","last_unstale":"2024-09-21T05:53:33.480859+0000","last_undegraded":"2024-09-21T05:53:33.480859+0000","last_fullsized":"2024-09-21T05:53:33.480859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:33.217248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885281+0000","last_change":"2024-09-21T05:52:23.599125+0000","last_active":"2024-09-21T05:53:22.885281+0000","last_peered":"2024-09-21T05:53:22.885281+0000","last_clean":"2024-09-21T05:53:22.885281+0000","last_became_active":"2024-09-21T05:52:23.598739+0000","last_became_peered":"2024-09-21T05:52:23.598739+0000","last_unstale":"2024-09-21T05:53:22.885281+0000","last_undegraded":"2024-09-21T05:53:22.885281+0000","last_fullsized":"2024-09-21T05:53:22.885281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:20.838698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.585476+0000","last_change":"2024-09-21T05:51:48.230191+0000","last_active":"2024-09-21T05:52:23.585476+0000","last_peered":"2024-09-21T05:52:23.585476+0000","last_clean":"2024-09-21T05:52:23.585476+0000","last_became_active":"2024-09-21T05:51:48.229780+0000","last_became_peered":"2024-09-21T05:51:48.229780+0000","last_unstale":"2024-09-21T05:52:23.585476+0000","last_undegraded":"2024-09-21T05:52:23.585476+0000","last_fullsized":"2024-09-21T05:52:23.585476+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:34.950404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584118+0000","last_change":"2024-09-21T05:51:48.224115+0000","last_active":"2024-09-21T05:52:23.584118+0000","last_peered":"2024-09-21T05:52:23.584118+0000","last_clean":"2024-09-21T05:52:23.584118+0000","last_became_active":"2024-09-21T05:51:48.223714+0000","last_became_peered":"2024-09-21T05:51:48.223714+0000","last_unstale":"2024-09-21T05:52:23.584118+0000","last_undegraded":"2024-09-21T05:52:23.584118+0000","last_fullsized":"2024-09-21T05:52:23.584118+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:29.450354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.875426+0000","last_change":"2024-09-21T05:51:50.250129+0000","last_active":"2024-09-21T05:53:22.875426+0000","last_peered":"2024-09-21T05:53:22.875426+0000","last_clean":"2024-09-21T05:53:22.875426+0000","last_became_active":"2024-09-21T05:51:50.249743+0000","last_became_peered":"2024-09-21T05:51:50.249743+0000","last_unstale":"2024-09-21T05:53:22.875426+0000","last_undegraded":"2024-09-21T05:53:22.875426+0000","last_fullsized":"2024-09-21T05:53:22.875426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:37.204476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596516+0000","last_change":"2024-09-21T05:51:48.236289+0000","last_active":"2024-09-21T05:52:23.596516+0000","last_peered":"2024-09-21T05:52:23.596516+0000","last_clean":"2024-09-21T05:52:23.596516+0000","last_became_active":"2024-09-21T05:51:48.235898+0000","last_became_peered":"2024-09-21T05:51:48.235898+0000","last_unstale":"2024-09-21T05:52:23.596516+0000","last_undegraded":"2024-09-21T05:52:23.596516+0000","last_fullsized":"2024-09-21T05:52:23.596516+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:05.457237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.877338+0000","last_change":"2024-09-21T05:51:50.251905+0000","last_active":"2024-09-21T05:53:22.877338+0000","last_peered":"2024-09-21T05:53:22.877338+0000","last_clean":"2024-09-21T05:53:22.877338+0000","last_became_active":"2024-09-21T05:51:50.251537+0000","last_became_peered":"2024-09-21T05:51:50.251537+0000","last_unstale":"2024-09-21T05:53:22.877338+0000","last_undegraded":"2024-09-21T05:53:22.877338+0000","last_fullsized":"2024-09-21T05:53:22.877338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:57.590274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":124,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:36.484821+0000","last_change":"2024-09-21T05:51:48.232007+0000","last_active":"2024-09-21T05:53:36.484821+0000","last_peered":"2024-09-21T05:53:36.484821+0000","last_clean":"2024-09-21T05:53:36.484821+0000","last_became_active":"2024-09-21T05:51:48.231534+0000","last_became_peered":"2024-09-21T05:51:48.231534+0000","last_unstale":"2024-09-21T05:53:36.484821+0000","last_undegraded":"2024-09-21T05:53:36.484821+0000","last_fullsized":"2024-09-21T05:53:36.484821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:05.874618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.879196+0000","last_change":"2024-09-21T05:51:50.265224+0000","last_active":"2024-09-21T05:53:22.879196+0000","last_peered":"2024-09-21T05:53:22.879196+0000","last_clean":"2024-09-21T05:53:22.879196+0000","last_became_active":"2024-09-21T05:51:50.264690+0000","last_became_peered":"2024-09-21T05:51:50.264690+0000","last_unstale":"2024-09-21T05:53:22.879196+0000","last_undegraded":"2024-09-21T05:53:22.879196+0000","last_fullsized":"2024-09-21T05:53:22.879196+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:15.835492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587907+0000","last_change":"2024-09-21T05:51:48.233092+0000","last_active":"2024-09-21T05:52:23.587907+0000","last_peered":"2024-09-21T05:52:23.587907+0000","last_clean":"2024-09-21T05:52:23.587907+0000","last_became_active":"2024-09-21T05:51:48.232684+0000","last_became_peered":"2024-09-21T05:51:48.232684+0000","last_unstale":"2024-09-21T05:52:23.587907+0000","last_undegraded":"2024-09-21T05:52:23.587907+0000","last_fullsized":"2024-09-21T05:52:23.587907+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:21.664828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885615+0000","last_change":"2024-09-21T05:51:50.248419+0000","last_active":"2024-09-21T05:53:22.885615+0000","last_peered":"2024-09-21T05:53:22.885615+0000","last_clean":"2024-09-21T05:53:22.885615+0000","last_became_active":"2024-09-21T05:51:50.247871+0000","last_became_peered":"2024-09-21T05:51:50.247871+0000","last_unstale":"2024-09-21T05:53:22.885615+0000","last_undegraded":"2024-09-21T05:53:22.885615+0000","last_fullsized":"2024-09-21T05:53:22.885615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:49.851685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596905+0000","last_change":"2024-09-21T05:51:48.338367+0000","last_active":"2024-09-21T05:52:23.596905+0000","last_peered":"2024-09-21T05:52:23.596905+0000","last_clean":"2024-09-21T05:52:23.596905+0000","last_became_active":"2024-09-21T05:51:48.337992+0000","last_became_peered":"2024-09-21T05:51:48.337992+0000","last_unstale":"2024-09-21T05:52:23.596905+0000","last_undegraded":"2024-09-21T05:52:23.596905+0000","last_fullsized":"2024-09-21T05:52:23.596905+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:52.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.889702+0000","last_change":"2024-09-21T05:51:50.267046+0000","last_active":"2024-09-21T05:53:22.889702+0000","last_peered":"2024-09-21T05:53:22.889702+0000","last_clean":"2024-09-21T05:53:22.889702+0000","last_became_active":"2024-09-21T05:51:50.266672+0000","last_became_peered":"2024-09-21T05:51:50.266672+0000","last_unstale":"2024-09-21T05:53:22.889702+0000","last_undegraded":"2024-09-21T05:53:22.889702+0000","last_fullsized":"2024-09-21T05:53:22.889702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:53.628646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'33","reported_seq":264,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:37.487374+0000","last_change":"2024-09-21T05:51:48.233804+0000","last_active":"2024-09-21T05:53:37.487374+0000","last_peered":"2024-09-21T05:53:37.487374+0000","last_clean":"2024-09-21T05:53:37.487374+0000","last_became_active":"2024-09-21T05:51:48.233386+0000","last_became_peered":"2024-09-21T05:51:48.233386+0000","last_unstale":"2024-09-21T05:53:37.487374+0000","last_undegraded":"2024-09-21T05:53:37.487374+0000","last_fullsized":"2024-09-21T05:53:37.487374+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:45.644005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69902,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":172,"num_write":34,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.868907+0000","last_change":"2024-09-21T05:51:50.257673+0000","last_active":"2024-09-21T05:53:22.868907+0000","last_peered":"2024-09-21T05:53:22.868907+0000","last_clean":"2024-09-21T05:53:22.868907+0000","last_became_active":"2024-09-21T05:51:50.257319+0000","last_became_peered":"2024-09-21T05:51:50.257319+0000","last_unstale":"2024-09-21T05:53:22.868907+0000","last_undegraded":"2024-09-21T05:53:22.868907+0000","last_fullsized":"2024-09-21T05:53:22.868907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:26.008964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587400+0000","last_change":"2024-09-21T05:51:48.233264+0000","last_active":"2024-09-21T05:52:23.587400+0000","last_peered":"2024-09-21T05:52:23.587400+0000","last_clean":"2024-09-21T05:52:23.587400+0000","last_became_active":"2024-09-21T05:51:48.232808+0000","last_became_peered":"2024-09-21T05:51:48.232808+0000","last_unstale":"2024-09-21T05:52:23.587400+0000","last_undegraded":"2024-09-21T05:52:23.587400+0000","last_fullsized":"2024-09-21T05:52:23.587400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:05.105861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883211+0000","last_change":"2024-09-21T05:51:50.251727+0000","last_active":"2024-09-21T05:53:22.883211+0000","last_peered":"2024-09-21T05:53:22.883211+0000","last_clean":"2024-09-21T05:53:22.883211+0000","last_became_active":"2024-09-21T05:51:50.251382+0000","last_became_peered":"2024-09-21T05:51:50.251382+0000","last_unstale":"2024-09-21T05:53:22.883211+0000","last_undegraded":"2024-09-21T05:53:22.883211+0000","last_fullsized":"2024-09-21T05:53:22.883211+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:30.098548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596648+0000","last_change":"2024-09-21T05:51:48.235226+0000","last_active":"2024-09-21T05:52:23.596648+0000","last_peered":"2024-09-21T05:52:23.596648+0000","last_clean":"2024-09-21T05:52:23.596648+0000","last_became_active":"2024-09-21T05:51:48.234432+0000","last_became_peered":"2024-09-21T05:51:48.234432+0000","last_unstale":"2024-09-21T05:52:23.596648+0000","last_undegraded":"2024-09-21T05:52:23.596648+0000","last_fullsized":"2024-09-21T05:52:23.596648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:49.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.892298+0000","last_change":"2024-09-21T05:51:50.260276+0000","last_active":"2024-09-21T05:53:22.892298+0000","last_peered":"2024-09-21T05:53:22.892298+0000","last_clean":"2024-09-21T05:53:22.892298+0000","last_became_active":"2024-09-21T05:51:50.257448+0000","last_became_peered":"2024-09-21T05:51:50.257448+0000","last_unstale":"2024-09-21T05:53:22.892298+0000","last_undegraded":"2024-09-21T05:53:22.892298+0000","last_fullsized":"2024-09-21T05:53:22.892298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:46.052226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:32.479720+0000","last_change":"2024-09-21T05:51:48.230764+0000","last_active":"2024-09-21T05:53:32.479720+0000","last_peered":"2024-09-21T05:53:32.479720+0000","last_clean":"2024-09-21T05:53:32.479720+0000","last_became_active":"2024-09-21T05:51:48.230332+0000","last_became_peered":"2024-09-21T05:51:48.230332+0000","last_unstale":"2024-09-21T05:53:32.479720+0000","last_undegraded":"2024-09-21T05:53:32.479720+0000","last_fullsized":"2024-09-21T05:53:32.479720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:33.459588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.889695+0000","last_change":"2024-09-21T05:52:23.589989+0000","last_active":"2024-09-21T05:53:22.889695+0000","last_peered":"2024-09-21T05:53:22.889695+0000","last_clean":"2024-09-21T05:53:22.889695+0000","last_became_active":"2024-09-21T05:52:23.589358+0000","last_became_peered":"2024-09-21T05:52:23.589358+0000","last_unstale":"2024-09-21T05:53:22.889695+0000","last_undegraded":"2024-09-21T05:53:22.889695+0000","last_fullsized":"2024-09-21T05:53:22.889695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:48.706509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589658+0000","last_change":"2024-09-21T05:51:48.338309+0000","last_active":"2024-09-21T05:52:23.589658+0000","last_peered":"2024-09-21T05:52:23.589658+0000","last_clean":"2024-09-21T05:52:23.589658+0000","last_became_active":"2024-09-21T05:51:48.337903+0000","last_became_peered":"2024-09-21T05:51:48.337903+0000","last_unstale":"2024-09-21T05:52:23.589658+0000","last_undegraded":"2024-09-21T05:52:23.589658+0000","last_fullsized":"2024-09-21T05:52:23.589658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:54.634956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.881414+0000","last_change":"2024-09-21T05:51:50.259257+0000","last_active":"2024-09-21T05:53:22.881414+0000","last_peered":"2024-09-21T05:53:22.881414+0000","last_clean":"2024-09-21T05:53:22.881414+0000","last_became_active":"2024-09-21T05:51:50.258892+0000","last_became_peered":"2024-09-21T05:51:50.258892+0000","last_unstale":"2024-09-21T05:53:22.881414+0000","last_undegraded":"2024-09-21T05:53:22.881414+0000","last_fullsized":"2024-09-21T05:53:22.881414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:46.683115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591128+0000","last_change":"2024-09-21T05:51:48.226956+0000","last_active":"2024-09-21T05:52:23.591128+0000","last_peered":"2024-09-21T05:52:23.591128+0000","last_clean":"2024-09-21T05:52:23.591128+0000","last_became_active":"2024-09-21T05:51:48.226531+0000","last_became_peered":"2024-09-21T05:51:48.226531+0000","last_unstale":"2024-09-21T05:52:23.591128+0000","last_undegraded":"2024-09-21T05:52:23.591128+0000","last_fullsized":"2024-09-21T05:52:23.591128+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:14.888074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.874822+0000","last_change":"2024-09-21T05:51:50.261080+0000","last_active":"2024-09-21T05:53:22.874822+0000","last_peered":"2024-09-21T05:53:22.874822+0000","last_clean":"2024-09-21T05:53:22.874822+0000","last_became_active":"2024-09-21T05:51:50.260700+0000","last_became_peered":"2024-09-21T05:51:50.260700+0000","last_unstale":"2024-09-21T05:53:22.874822+0000","last_undegraded":"2024-09-21T05:53:22.874822+0000","last_fullsized":"2024-09-21T05:53:22.874822+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.033889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.584270+0000","last_change":"2024-09-21T05:51:48.230236+0000","last_active":"2024-09-21T05:52:23.584270+0000","last_peered":"2024-09-21T05:52:23.584270+0000","last_clean":"2024-09-21T05:52:23.584270+0000","last_became_active":"2024-09-21T05:51:48.229775+0000","last_became_peered":"2024-09-21T05:51:48.229775+0000","last_unstale":"2024-09-21T05:52:23.584270+0000","last_undegraded":"2024-09-21T05:52:23.584270+0000","last_fullsized":"2024-09-21T05:52:23.584270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:25.371256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.888276+0000","last_change":"2024-09-21T05:51:50.260749+0000","last_active":"2024-09-21T05:53:22.888276+0000","last_peered":"2024-09-21T05:53:22.888276+0000","last_clean":"2024-09-21T05:53:22.888276+0000","last_became_active":"2024-09-21T05:51:50.257406+0000","last_became_peered":"2024-09-21T05:51:50.257406+0000","last_unstale":"2024-09-21T05:53:22.888276+0000","last_undegraded":"2024-09-21T05:53:22.888276+0000","last_fullsized":"2024-09-21T05:53:22.888276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:18.293144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.596986+0000","last_change":"2024-09-21T05:51:48.228752+0000","last_active":"2024-09-21T05:52:23.596986+0000","last_peered":"2024-09-21T05:52:23.596986+0000","last_clean":"2024-09-21T05:52:23.596986+0000","last_became_active":"2024-09-21T05:51:48.228361+0000","last_became_peered":"2024-09-21T05:51:48.228361+0000","last_unstale":"2024-09-21T05:52:23.596986+0000","last_undegraded":"2024-09-21T05:52:23.596986+0000","last_fullsized":"2024-09-21T05:52:23.596986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:05.868153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.883312+0000","last_change":"2024-09-21T05:51:50.256183+0000","last_active":"2024-09-21T05:53:22.883312+0000","last_peered":"2024-09-21T05:53:22.883312+0000","last_clean":"2024-09-21T05:53:22.883312+0000","last_became_active":"2024-09-21T05:51:50.255746+0000","last_became_peered":"2024-09-21T05:51:50.255746+0000","last_unstale":"2024-09-21T05:53:22.883312+0000","last_undegraded":"2024-09-21T05:53:22.883312+0000","last_fullsized":"2024-09-21T05:53:22.883312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:29.044470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587539+0000","last_change":"2024-09-21T05:51:48.852935+0000","last_active":"2024-09-21T05:52:23.587539+0000","last_peered":"2024-09-21T05:52:23.587539+0000","last_clean":"2024-09-21T05:52:23.587539+0000","last_became_active":"2024-09-21T05:51:48.852457+0000","last_became_peered":"2024-09-21T05:51:48.852457+0000","last_unstale":"2024-09-21T05:52:23.587539+0000","last_undegraded":"2024-09-21T05:52:23.587539+0000","last_fullsized":"2024-09-21T05:52:23.587539+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:12.109669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.891006+0000","last_change":"2024-09-21T05:51:50.261136+0000","last_active":"2024-09-21T05:53:22.891006+0000","last_peered":"2024-09-21T05:53:22.891006+0000","last_clean":"2024-09-21T05:53:22.891006+0000","last_became_active":"2024-09-21T05:51:50.260698+0000","last_became_peered":"2024-09-21T05:51:50.260698+0000","last_unstale":"2024-09-21T05:53:22.891006+0000","last_undegraded":"2024-09-21T05:53:22.891006+0000","last_fullsized":"2024-09-21T05:53:22.891006+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:34.480352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.588600+0000","last_change":"2024-09-21T05:50:40.836627+0000","last_active":"2024-09-21T05:52:23.588600+0000","last_peered":"2024-09-21T05:52:23.588600+0000","last_clean":"2024-09-21T05:52:23.588600+0000","last_became_active":"2024-09-21T05:50:40.830426+0000","last_became_peered":"2024-09-21T05:50:40.830426+0000","last_unstale":"2024-09-21T05:52:23.588600+0000","last_undegraded":"2024-09-21T05:52:23.588600+0000","last_fullsized":"2024-09-21T05:52:23.588600+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:47:21.634945+0000","last_clean_scrub_stamp":"2024-09-21T05:47:21.634945+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:33.394077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.687599+0000","last_change":"2024-09-21T05:51:48.228187+0000","last_active":"2024-09-21T05:52:23.687599+0000","last_peered":"2024-09-21T05:52:23.687599+0000","last_clean":"2024-09-21T05:52:23.687599+0000","last_became_active":"2024-09-21T05:51:48.227690+0000","last_became_peered":"2024-09-21T05:51:48.227690+0000","last_unstale":"2024-09-21T05:52:23.687599+0000","last_undegraded":"2024-09-21T05:52:23.687599+0000","last_fullsized":"2024-09-21T05:52:23.687599+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:37.104250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.877903+0000","last_change":"2024-09-21T05:52:23.705127+0000","last_active":"2024-09-21T05:53:22.877903+0000","last_peered":"2024-09-21T05:53:22.877903+0000","last_clean":"2024-09-21T05:53:22.877903+0000","last_became_active":"2024-09-21T05:52:23.704731+0000","last_became_peered":"2024-09-21T05:52:23.704731+0000","last_unstale":"2024-09-21T05:53:22.877903+0000","last_undegraded":"2024-09-21T05:53:22.877903+0000","last_fullsized":"2024-09-21T05:53:22.877903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:49.264072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.588183+0000","last_change":"2024-09-21T05:51:48.234444+0000","last_active":"2024-09-21T05:52:23.588183+0000","last_peered":"2024-09-21T05:52:23.588183+0000","last_clean":"2024-09-21T05:52:23.588183+0000","last_became_active":"2024-09-21T05:51:48.233997+0000","last_became_peered":"2024-09-21T05:51:48.233997+0000","last_unstale":"2024-09-21T05:52:23.588183+0000","last_undegraded":"2024-09-21T05:52:23.588183+0000","last_fullsized":"2024-09-21T05:52:23.588183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:12.931628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885618+0000","last_change":"2024-09-21T05:51:50.242267+0000","last_active":"2024-09-21T05:53:22.885618+0000","last_peered":"2024-09-21T05:53:22.885618+0000","last_clean":"2024-09-21T05:53:22.885618+0000","last_became_active":"2024-09-21T05:51:50.241927+0000","last_became_peered":"2024-09-21T05:51:50.241927+0000","last_unstale":"2024-09-21T05:53:22.885618+0000","last_undegraded":"2024-09-21T05:53:22.885618+0000","last_fullsized":"2024-09-21T05:53:22.885618+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:28.954451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":122,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:32.479109+0000","last_change":"2024-09-21T05:51:48.338372+0000","last_active":"2024-09-21T05:53:32.479109+0000","last_peered":"2024-09-21T05:53:32.479109+0000","last_clean":"2024-09-21T05:53:32.479109+0000","last_became_active":"2024-09-21T05:51:48.337966+0000","last_became_peered":"2024-09-21T05:51:48.337966+0000","last_unstale":"2024-09-21T05:53:32.479109+0000","last_undegraded":"2024-09-21T05:53:32.479109+0000","last_fullsized":"2024-09-21T05:53:32.479109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:10.301871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.880256+0000","last_change":"2024-09-21T05:51:50.253151+0000","last_active":"2024-09-21T05:53:22.880256+0000","last_peered":"2024-09-21T05:53:22.880256+0000","last_clean":"2024-09-21T05:53:22.880256+0000","last_became_active":"2024-09-21T05:51:50.252770+0000","last_became_peered":"2024-09-21T05:51:50.252770+0000","last_unstale":"2024-09-21T05:53:22.880256+0000","last_undegraded":"2024-09-21T05:53:22.880256+0000","last_fullsized":"2024-09-21T05:53:22.880256+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:48.784229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587728+0000","last_change":"2024-09-21T05:51:48.233273+0000","last_active":"2024-09-21T05:52:23.587728+0000","last_peered":"2024-09-21T05:52:23.587728+0000","last_clean":"2024-09-21T05:52:23.587728+0000","last_became_active":"2024-09-21T05:51:48.232724+0000","last_became_peered":"2024-09-21T05:51:48.232724+0000","last_unstale":"2024-09-21T05:52:23.587728+0000","last_undegraded":"2024-09-21T05:52:23.587728+0000","last_fullsized":"2024-09-21T05:52:23.587728+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:50.869396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.878794+0000","last_change":"2024-09-21T05:51:50.262521+0000","last_active":"2024-09-21T05:53:22.878794+0000","last_peered":"2024-09-21T05:53:22.878794+0000","last_clean":"2024-09-21T05:53:22.878794+0000","last_became_active":"2024-09-21T05:51:50.262135+0000","last_became_peered":"2024-09-21T05:51:50.262135+0000","last_unstale":"2024-09-21T05:53:22.878794+0000","last_undegraded":"2024-09-21T05:53:22.878794+0000","last_fullsized":"2024-09-21T05:53:22.878794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:18.347182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587326+0000","last_change":"2024-09-21T05:51:48.338532+0000","last_active":"2024-09-21T05:52:23.587326+0000","last_peered":"2024-09-21T05:52:23.587326+0000","last_clean":"2024-09-21T05:52:23.587326+0000","last_became_active":"2024-09-21T05:51:48.338099+0000","last_became_peered":"2024-09-21T05:51:48.338099+0000","last_unstale":"2024-09-21T05:52:23.587326+0000","last_undegraded":"2024-09-21T05:52:23.587326+0000","last_fullsized":"2024-09-21T05:52:23.587326+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:48.670988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.877307+0000","last_change":"2024-09-21T05:51:50.251814+0000","last_active":"2024-09-21T05:53:22.877307+0000","last_peered":"2024-09-21T05:53:22.877307+0000","last_clean":"2024-09-21T05:53:22.877307+0000","last_became_active":"2024-09-21T05:51:50.251401+0000","last_became_peered":"2024-09-21T05:51:50.251401+0000","last_unstale":"2024-09-21T05:53:22.877307+0000","last_undegraded":"2024-09-21T05:53:22.877307+0000","last_fullsized":"2024-09-21T05:53:22.877307+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:12.972300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590808+0000","last_change":"2024-09-21T05:51:48.338312+0000","last_active":"2024-09-21T05:52:23.590808+0000","last_peered":"2024-09-21T05:52:23.590808+0000","last_clean":"2024-09-21T05:52:23.590808+0000","last_became_active":"2024-09-21T05:51:48.337872+0000","last_became_peered":"2024-09-21T05:51:48.337872+0000","last_unstale":"2024-09-21T05:52:23.590808+0000","last_undegraded":"2024-09-21T05:52:23.590808+0000","last_fullsized":"2024-09-21T05:52:23.590808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:26.158650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.879034+0000","last_change":"2024-09-21T05:51:50.245129+0000","last_active":"2024-09-21T05:53:22.879034+0000","last_peered":"2024-09-21T05:53:22.879034+0000","last_clean":"2024-09-21T05:53:22.879034+0000","last_became_active":"2024-09-21T05:51:50.244439+0000","last_became_peered":"2024-09-21T05:51:50.244439+0000","last_unstale":"2024-09-21T05:53:22.879034+0000","last_undegraded":"2024-09-21T05:53:22.879034+0000","last_fullsized":"2024-09-21T05:53:22.879034+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:19.241921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'14","reported_seq":50,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:23.275479+0000","last_change":"2024-09-21T05:52:23.600272+0000","last_active":"2024-09-21T05:53:23.275479+0000","last_peered":"2024-09-21T05:53:23.275479+0000","last_clean":"2024-09-21T05:53:23.275479+0000","last_became_active":"2024-09-21T05:52:23.592946+0000","last_became_peered":"2024-09-21T05:52:23.592946+0000","last_unstale":"2024-09-21T05:53:23.275479+0000","last_undegraded":"2024-09-21T05:53:23.275479+0000","last_fullsized":"2024-09-21T05:53:23.275479+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:52.892645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.887100+0000","last_change":"2024-09-21T05:51:50.253411+0000","last_active":"2024-09-21T05:53:22.887100+0000","last_peered":"2024-09-21T05:53:22.887100+0000","last_clean":"2024-09-21T05:53:22.887100+0000","last_became_active":"2024-09-21T05:51:50.252816+0000","last_became_peered":"2024-09-21T05:51:50.252816+0000","last_unstale":"2024-09-21T05:53:22.887100+0000","last_undegraded":"2024-09-21T05:53:22.887100+0000","last_fullsized":"2024-09-21T05:53:22.887100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:33.444176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.688065+0000","last_change":"2024-09-21T05:51:48.852668+0000","last_active":"2024-09-21T05:52:23.688065+0000","last_peered":"2024-09-21T05:52:23.688065+0000","last_clean":"2024-09-21T05:52:23.688065+0000","last_became_active":"2024-09-21T05:51:48.852298+0000","last_became_peered":"2024-09-21T05:51:48.852298+0000","last_unstale":"2024-09-21T05:52:23.688065+0000","last_undegraded":"2024-09-21T05:52:23.688065+0000","last_fullsized":"2024-09-21T05:52:23.688065+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:19.529194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.885939+0000","last_change":"2024-09-21T05:51:50.246720+0000","last_active":"2024-09-21T05:53:22.885939+0000","last_peered":"2024-09-21T05:53:22.885939+0000","last_clean":"2024-09-21T05:53:22.885939+0000","last_became_active":"2024-09-21T05:51:50.246318+0000","last_became_peered":"2024-09-21T05:51:50.246318+0000","last_unstale":"2024-09-21T05:53:22.885939+0000","last_undegraded":"2024-09-21T05:53:22.885939+0000","last_fullsized":"2024-09-21T05:53:22.885939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:45.737949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.703802+0000","last_change":"2024-09-21T05:51:48.338346+0000","last_active":"2024-09-21T05:52:23.703802+0000","last_peered":"2024-09-21T05:52:23.703802+0000","last_clean":"2024-09-21T05:52:23.703802+0000","last_became_active":"2024-09-21T05:51:48.337968+0000","last_became_peered":"2024-09-21T05:51:48.337968+0000","last_unstale":"2024-09-21T05:52:23.703802+0000","last_undegraded":"2024-09-21T05:52:23.703802+0000","last_fullsized":"2024-09-21T05:52:23.703802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:32.450546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.840051+0000","last_change":"2024-09-21T05:51:50.255993+0000","last_active":"2024-09-21T05:53:22.840051+0000","last_peered":"2024-09-21T05:53:22.840051+0000","last_clean":"2024-09-21T05:53:22.840051+0000","last_became_active":"2024-09-21T05:51:50.255645+0000","last_became_peered":"2024-09-21T05:51:50.255645+0000","last_unstale":"2024-09-21T05:53:22.840051+0000","last_undegraded":"2024-09-21T05:53:22.840051+0000","last_fullsized":"2024-09-21T05:53:22.840051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:10.890940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.589612+0000","last_change":"2024-09-21T05:51:48.231659+0000","last_active":"2024-09-21T05:52:23.589612+0000","last_peered":"2024-09-21T05:52:23.589612+0000","last_clean":"2024-09-21T05:52:23.589612+0000","last_became_active":"2024-09-21T05:51:48.231137+0000","last_became_peered":"2024-09-21T05:51:48.231137+0000","last_unstale":"2024-09-21T05:52:23.589612+0000","last_undegraded":"2024-09-21T05:52:23.589612+0000","last_fullsized":"2024-09-21T05:52:23.589612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:06.166268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.884218+0000","last_change":"2024-09-21T05:51:50.251904+0000","last_active":"2024-09-21T05:53:22.884218+0000","last_peered":"2024-09-21T05:53:22.884218+0000","last_clean":"2024-09-21T05:53:22.884218+0000","last_became_active":"2024-09-21T05:51:50.251403+0000","last_became_peered":"2024-09-21T05:51:50.251403+0000","last_unstale":"2024-09-21T05:53:22.884218+0000","last_undegraded":"2024-09-21T05:53:22.884218+0000","last_fullsized":"2024-09-21T05:53:22.884218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:47.702083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.603022+0000","last_change":"2024-09-21T05:52:23.602925+0000","last_active":"2024-09-21T05:52:23.603022+0000","last_peered":"2024-09-21T05:52:23.603022+0000","last_clean":"2024-09-21T05:52:23.603022+0000","last_became_active":"2024-09-21T05:52:23.598086+0000","last_became_peered":"2024-09-21T05:52:23.598086+0000","last_unstale":"2024-09-21T05:52:23.603022+0000","last_undegraded":"2024-09-21T05:52:23.603022+0000","last_fullsized":"2024-09-21T05:52:23.603022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:03.260218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.871098+0000","last_change":"2024-09-21T05:51:50.256654+0000","last_active":"2024-09-21T05:53:22.871098+0000","last_peered":"2024-09-21T05:53:22.871098+0000","last_clean":"2024-09-21T05:53:22.871098+0000","last_became_active":"2024-09-21T05:51:50.255830+0000","last_became_peered":"2024-09-21T05:51:50.255830+0000","last_unstale":"2024-09-21T05:53:22.871098+0000","last_undegraded":"2024-09-21T05:53:22.871098+0000","last_fullsized":"2024-09-21T05:53:22.871098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:49.643890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.591174+0000","last_change":"2024-09-21T05:51:48.233608+0000","last_active":"2024-09-21T05:52:23.591174+0000","last_peered":"2024-09-21T05:52:23.591174+0000","last_clean":"2024-09-21T05:52:23.591174+0000","last_became_active":"2024-09-21T05:51:48.233187+0000","last_became_peered":"2024-09-21T05:51:48.233187+0000","last_unstale":"2024-09-21T05:52:23.591174+0000","last_undegraded":"2024-09-21T05:52:23.591174+0000","last_fullsized":"2024-09-21T05:52:23.591174+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:57.815632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.890931+0000","last_change":"2024-09-21T05:51:50.266753+0000","last_active":"2024-09-21T05:53:22.890931+0000","last_peered":"2024-09-21T05:53:22.890931+0000","last_clean":"2024-09-21T05:53:22.890931+0000","last_became_active":"2024-09-21T05:51:50.266368+0000","last_became_peered":"2024-09-21T05:51:50.266368+0000","last_unstale":"2024-09-21T05:53:22.890931+0000","last_undegraded":"2024-09-21T05:53:22.890931+0000","last_fullsized":"2024-09-21T05:53:22.890931+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:02.011213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882162+0000","last_change":"2024-09-21T05:51:50.257731+0000","last_active":"2024-09-21T05:53:22.882162+0000","last_peered":"2024-09-21T05:53:22.882162+0000","last_clean":"2024-09-21T05:53:22.882162+0000","last_became_active":"2024-09-21T05:51:50.257396+0000","last_became_peered":"2024-09-21T05:51:50.257396+0000","last_unstale":"2024-09-21T05:53:22.882162+0000","last_undegraded":"2024-09-21T05:53:22.882162+0000","last_fullsized":"2024-09-21T05:53:22.882162+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:58.109069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590778+0000","last_change":"2024-09-21T05:51:48.234067+0000","last_active":"2024-09-21T05:52:23.590778+0000","last_peered":"2024-09-21T05:52:23.590778+0000","last_clean":"2024-09-21T05:52:23.590778+0000","last_became_active":"2024-09-21T05:51:48.233532+0000","last_became_peered":"2024-09-21T05:51:48.233532+0000","last_unstale":"2024-09-21T05:52:23.590778+0000","last_undegraded":"2024-09-21T05:52:23.590778+0000","last_fullsized":"2024-09-21T05:52:23.590778+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:40.997254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.880925+0000","last_change":"2024-09-21T05:51:50.265453+0000","last_active":"2024-09-21T05:53:22.880925+0000","last_peered":"2024-09-21T05:53:22.880925+0000","last_clean":"2024-09-21T05:53:22.880925+0000","last_became_active":"2024-09-21T05:51:50.265073+0000","last_became_peered":"2024-09-21T05:51:50.265073+0000","last_unstale":"2024-09-21T05:53:22.880925+0000","last_undegraded":"2024-09-21T05:53:22.880925+0000","last_fullsized":"2024-09-21T05:53:22.880925+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:15.295822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.694313+0000","last_change":"2024-09-21T05:52:23.694236+0000","last_active":"2024-09-21T05:52:23.694313+0000","last_peered":"2024-09-21T05:52:23.694313+0000","last_clean":"2024-09-21T05:52:23.694313+0000","last_became_active":"2024-09-21T05:52:23.688964+0000","last_became_peered":"2024-09-21T05:52:23.688964+0000","last_unstale":"2024-09-21T05:52:23.694313+0000","last_undegraded":"2024-09-21T05:52:23.694313+0000","last_fullsized":"2024-09-21T05:52:23.694313+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:25.453769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.881242+0000","last_change":"2024-09-21T05:51:50.267110+0000","last_active":"2024-09-21T05:53:22.881242+0000","last_peered":"2024-09-21T05:53:22.881242+0000","last_clean":"2024-09-21T05:53:22.881242+0000","last_became_active":"2024-09-21T05:51:50.266504+0000","last_became_peered":"2024-09-21T05:51:50.266504+0000","last_unstale":"2024-09-21T05:53:22.881242+0000","last_undegraded":"2024-09-21T05:53:22.881242+0000","last_fullsized":"2024-09-21T05:53:22.881242+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:10.618361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.590428+0000","last_change":"2024-09-21T05:51:48.337971+0000","last_active":"2024-09-21T05:52:23.590428+0000","last_peered":"2024-09-21T05:52:23.590428+0000","last_clean":"2024-09-21T05:52:23.590428+0000","last_became_active":"2024-09-21T05:51:48.337487+0000","last_became_peered":"2024-09-21T05:51:48.337487+0000","last_unstale":"2024-09-21T05:52:23.590428+0000","last_undegraded":"2024-09-21T05:52:23.590428+0000","last_fullsized":"2024-09-21T05:52:23.590428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.150563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:53:22.882678+0000","last_change":"2024-09-21T05:51:50.253826+0000","last_active":"2024-09-21T05:53:22.882678+0000","last_peered":"2024-09-21T05:53:22.882678+0000","last_clean":"2024-09-21T05:53:22.882678+0000","last_became_active":"2024-09-21T05:51:50.251700+0000","last_became_peered":"2024-09-21T05:51:50.251700+0000","last_unstale":"2024-09-21T05:53:22.882678+0000","last_undegraded":"2024-09-21T05:53:22.882678+0000","last_fullsized":"2024-09-21T05:53:22.882678+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:49.224330+0000","last_clean_scrub_stamp":"2024-09-21T05:51:49.224330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:02.929651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T05:52:23.587502+0000","last_change":"2024-09-21T05:51:48.234358+0000","last_active":"2024-09-21T05:52:23.587502+0000","last_peered":"2024-09-21T05:52:23.587502+0000","last_clean":"2024-09-21T05:52:23.587502+0000","last_became_active":"2024-09-21T05:51:48.233982+0000","last_became_peered":"2024-09-21T05:51:48.233982+0000","last_unstale":"2024-09-21T05:52:23.587502+0000","last_undegraded":"2024-09-21T05:52:23.587502+0000","last_fullsized":"2024-09-21T05:52:23.587502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:47.208545+0000","last_clean_scrub_stamp":"2024-09-21T05:51:47.208545+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:42.510872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74044,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":609,"num_read_kb":384,"num_write":175,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":211246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":406831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972391,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36832,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708320,"statfs":{"total":95995035648,"available":95957319680,"internally_reserved":0,"allocated":1523712,"data_stored":1068746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168621,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":407067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332145,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":406987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528374,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1429504,"data_stored":999058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691899,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":406456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36752,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708400,"statfs":{"total":95995035648,"available":95957401600,"internally_reserved":0,"allocated":1441792,"data_stored":998210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":407425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":406767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378704,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":472058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542228,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":470708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40328,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704824,"statfs":{"total":95995035648,"available":95953739776,"internally_reserved":0,"allocated":843776,"data_stored":407727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":72012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:53:38.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:38.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:38 smithi027 ceph-mon[34364]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:39.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:38 smithi119 ceph-mon[34833]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.677+0000 7f594df10640 1 -- 172.21.15.7:0/1500807537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5948105380 msgr2=0x7f594810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.677+0000 7f594df10640 1 --2- 172.21.15.7:0/1500807537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5948105380 0x7f594810d8d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f593c009900 tx=0x7f593c02a410 comp rx=0 tx=0).stop 2024-09-21T05:53:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.677+0000 7f594df10640 1 -- 172.21.15.7:0/1500807537 shutdown_connections 2024-09-21T05:53:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.677+0000 7f594df10640 1 --2- 172.21.15.7:0/1500807537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5948105380 0x7f594810d8d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.677+0000 7f594df10640 1 --2- 172.21.15.7:0/1500807537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f594810de60 0x7f5948110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.677+0000 7f594df10640 1 --2- 172.21.15.7:0/1500807537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5948104a30 0x7f5948104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.677+0000 7f594df10640 1 -- 172.21.15.7:0/1500807537 >> 172.21.15.7:0/1500807537 conn(0x7f59480797b0 msgr2=0x7f5948079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:39.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.677+0000 7f594df10640 1 -- 172.21.15.7:0/1500807537 shutdown_connections 2024-09-21T05:53:39.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.677+0000 7f594df10640 1 -- 172.21.15.7:0/1500807537 wait complete. 2024-09-21T05:53:39.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.678+0000 7f594df10640 1 Processor -- start 2024-09-21T05:53:39.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.678+0000 7f594df10640 1 -- start start 2024-09-21T05:53:39.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.678+0000 7f594df10640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5948104a30 0x7f5948102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:39.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.678+0000 7f594df10640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5948105380 0x7f5948102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:39.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.678+0000 7f594df10640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f594810de60 0x7f59481031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:39.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.678+0000 7f594df10640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5948113aa0 con 0x7f5948104a30 2024-09-21T05:53:39.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.678+0000 7f594df10640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5948113920 con 0x7f594810de60 2024-09-21T05:53:39.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.678+0000 7f594df10640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5948113c20 con 0x7f5948105380 2024-09-21T05:53:39.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.678+0000 7f59477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5948104a30 0x7f5948102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:39.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.678+0000 7f59477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5948104a30 0x7f5948102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33204/0 (socket says 172.21.15.7:33204) 2024-09-21T05:53:39.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.678+0000 7f59477fe640 1 -- 172.21.15.7:0/78186893 learned_addr learned my addr 172.21.15.7:0/78186893 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:39.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.678+0000 7f5946ffd640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5948105380 0x7f5948102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:39.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.679+0000 7f5947fff640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f594810de60 0x7f59481031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:39.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.679+0000 7f59477fe640 1 -- 172.21.15.7:0/78186893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5948105380 msgr2=0x7f5948102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:39.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.679+0000 7f59477fe640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5948105380 0x7f5948102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.679+0000 7f59477fe640 1 -- 172.21.15.7:0/78186893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f594810de60 msgr2=0x7f59481031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:39.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.679+0000 7f59477fe640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f594810de60 0x7f59481031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.679+0000 7f59477fe640 1 -- 172.21.15.7:0/78186893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59481a8750 con 0x7f5948104a30 2024-09-21T05:53:39.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.679+0000 7f59477fe640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5948104a30 0x7f5948102770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f593800d770 tx=0x7f593800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:39.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.679+0000 7f5944ff9640 1 -- 172.21.15.7:0/78186893 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5938017070 con 0x7f5948104a30 2024-09-21T05:53:39.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.679+0000 7f594df10640 1 -- 172.21.15.7:0/78186893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59481a8a40 con 0x7f5948104a30 2024-09-21T05:53:39.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.679+0000 7f5944ff9640 1 -- 172.21.15.7:0/78186893 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59380054d0 con 0x7f5948104a30 2024-09-21T05:53:39.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.679+0000 7f5944ff9640 1 -- 172.21.15.7:0/78186893 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5938004c30 con 0x7f5948104a30 2024-09-21T05:53:39.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.679+0000 7f594df10640 1 -- 172.21.15.7:0/78186893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59481a8f50 con 0x7f5948104a30 2024-09-21T05:53:39.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.680+0000 7f594df10640 1 -- 172.21.15.7:0/78186893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5948104e40 con 0x7f5948104a30 2024-09-21T05:53:39.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.682+0000 7f5944ff9640 1 -- 172.21.15.7:0/78186893 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f5938004dd0 con 0x7f5948104a30 2024-09-21T05:53:39.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.683+0000 7f5944ff9640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f59300b6560 0x7f59300b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:39.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.683+0000 7f5946ffd640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f59300b6560 0x7f59300b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:39.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.683+0000 7f5944ff9640 1 -- 172.21.15.7:0/78186893 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f59380e72f0 con 0x7f5948104a30 2024-09-21T05:53:39.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.684+0000 7f5946ffd640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f59300b6560 0x7f59300b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f593c009230 tx=0x7f593c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.687+0000 7f5944ff9640 1 -- 172.21.15.7:0/78186893 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f59380ada80 con 0x7f5948104a30 2024-09-21T05:53:39.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.911+0000 7f594df10640 1 -- 172.21.15.7:0/78186893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f594802e640 con 0x7f5948104a30 2024-09-21T05:53:39.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:39 smithi007 ceph-mon[30983]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:39.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:39 smithi007 ceph-mon[30983]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T05:53:39.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:39 smithi007 ceph-mon[30983]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:39.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.912+0000 7f5944ff9640 1 -- 172.21.15.7:0/78186893 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f59380e6090 con 0x7f5948104a30 2024-09-21T05:53:39.914 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:39.914 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:53:39.915 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:53:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.914+0000 7f594df10640 1 -- 172.21.15.7:0/78186893 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f59300b6560 msgr2=0x7f59300b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.914+0000 7f594df10640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f59300b6560 0x7f59300b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f593c009230 tx=0x7f593c031400 comp rx=0 tx=0).stop 2024-09-21T05:53:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.914+0000 7f594df10640 1 -- 172.21.15.7:0/78186893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5948104a30 msgr2=0x7f5948102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.914+0000 7f594df10640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5948104a30 0x7f5948102770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f593800d770 tx=0x7f593800dc30 comp rx=0 tx=0).stop 2024-09-21T05:53:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.914+0000 7f594df10640 1 -- 172.21.15.7:0/78186893 shutdown_connections 2024-09-21T05:53:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.914+0000 7f594df10640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f59300b6560 0x7f59300b8a70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.914+0000 7f594df10640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f594810de60 0x7f59481031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.914+0000 7f594df10640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5948105380 0x7f5948102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.914+0000 7f594df10640 1 --2- 172.21.15.7:0/78186893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5948104a30 0x7f5948102770 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.914+0000 7f594df10640 1 -- 172.21.15.7:0/78186893 >> 172.21.15.7:0/78186893 conn(0x7f59480797b0 msgr2=0x7f59481008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.914+0000 7f594df10640 1 -- 172.21.15.7:0/78186893 shutdown_connections 2024-09-21T05:53:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:39.914+0000 7f594df10640 1 -- 172.21.15.7:0/78186893 wait complete. 2024-09-21T05:53:39.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:39 smithi027 ceph-mon[34364]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:39.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:39 smithi027 ceph-mon[34364]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T05:53:39.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:39 smithi027 ceph-mon[34364]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:40.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:39 smithi119 ceph-mon[34833]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:40.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:39 smithi119 ceph-mon[34833]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T05:53:40.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:39 smithi119 ceph-mon[34833]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:40.699 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:53:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:40.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:40 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/78186893' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:41.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:40 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/78186893' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:41.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:40 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/78186893' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:41.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.453+0000 7f0f56050640 1 -- 172.21.15.7:0/4162975129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f501083a0 msgr2=0x7f0f501087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:41.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.453+0000 7f0f56050640 1 --2- 172.21.15.7:0/4162975129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f501083a0 0x7f0f501087b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009900 tx=0x7f0f4402a410 comp rx=0 tx=0).stop 2024-09-21T05:53:41.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.453+0000 7f0f56050640 1 -- 172.21.15.7:0/4162975129 shutdown_connections 2024-09-21T05:53:41.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.453+0000 7f0f56050640 1 --2- 172.21.15.7:0/4162975129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f501083a0 0x7f0f501087b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.453+0000 7f0f56050640 1 --2- 172.21.15.7:0/4162975129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f50108cf0 0x7f0f5010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.453+0000 7f0f56050640 1 --2- 172.21.15.7:0/4162975129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f50102a60 0x7f0f50102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.453+0000 7f0f56050640 1 -- 172.21.15.7:0/4162975129 >> 172.21.15.7:0/4162975129 conn(0x7f0f50079730 msgr2=0x7f0f50079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:41.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.454+0000 7f0f56050640 1 -- 172.21.15.7:0/4162975129 shutdown_connections 2024-09-21T05:53:41.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.454+0000 7f0f56050640 1 -- 172.21.15.7:0/4162975129 wait complete. 2024-09-21T05:53:41.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.454+0000 7f0f56050640 1 Processor -- start 2024-09-21T05:53:41.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.454+0000 7f0f56050640 1 -- start start 2024-09-21T05:53:41.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f56050640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f50102a60 0x7f0f5019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:41.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f56050640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f501083a0 0x7f0f5019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:41.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f56050640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f50108cf0 0x7f0f5019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:41.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f56050640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f50112960 con 0x7f0f501083a0 2024-09-21T05:53:41.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f56050640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0f501127e0 con 0x7f0f50108cf0 2024-09-21T05:53:41.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f56050640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0f50112ae0 con 0x7f0f50102a60 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f4effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f501083a0 0x7f0f5019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f4effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f501083a0 0x7f0f5019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33220/0 (socket says 172.21.15.7:33220) 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f4effd640 1 -- 172.21.15.7:0/748865686 learned_addr learned my addr 172.21.15.7:0/748865686 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f4f7fe640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f50102a60 0x7f0f5019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f4ffff640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f50108cf0 0x7f0f5019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f4effd640 1 -- 172.21.15.7:0/748865686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f50102a60 msgr2=0x7f0f5019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f4effd640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f50102a60 0x7f0f5019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f4effd640 1 -- 172.21.15.7:0/748865686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f50108cf0 msgr2=0x7f0f5019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f4effd640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f50108cf0 0x7f0f5019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f4effd640 1 -- 172.21.15.7:0/748865686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f501a0430 con 0x7f0f501083a0 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f4f7fe640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f50102a60 0x7f0f5019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f4ffff640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f50108cf0 0x7f0f5019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.455+0000 7f0f4effd640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f501083a0 0x7f0f5019aa60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0f44032fd0 tx=0x7f0f44004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.456+0000 7f0f4cff9640 1 -- 172.21.15.7:0/748865686 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4403f030 con 0x7f0f501083a0 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.456+0000 7f0f56050640 1 -- 172.21.15.7:0/748865686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f501a06c0 con 0x7f0f501083a0 2024-09-21T05:53:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.456+0000 7f0f4cff9640 1 -- 172.21.15.7:0/748865686 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f44004490 con 0x7f0f501083a0 2024-09-21T05:53:41.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.456+0000 7f0f4cff9640 1 -- 172.21.15.7:0/748865686 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44035070 con 0x7f0f501083a0 2024-09-21T05:53:41.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.456+0000 7f0f56050640 1 -- 172.21.15.7:0/748865686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f501a6e80 con 0x7f0f501083a0 2024-09-21T05:53:41.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.457+0000 7f0f56050640 1 -- 172.21.15.7:0/748865686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f50103ce0 con 0x7f0f501083a0 2024-09-21T05:53:41.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.458+0000 7f0f4cff9640 1 -- 172.21.15.7:0/748865686 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f0f44042030 con 0x7f0f501083a0 2024-09-21T05:53:41.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.460+0000 7f0f4cff9640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0f380b6560 0x7f0f380b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:41.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.460+0000 7f0f4f7fe640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0f380b6560 0x7f0f380b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:41.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.460+0000 7f0f4cff9640 1 -- 172.21.15.7:0/748865686 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f0f44107d80 con 0x7f0f501083a0 2024-09-21T05:53:41.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.460+0000 7f0f4f7fe640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0f380b6560 0x7f0f380b8a70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0f400058c0 tx=0x7f0f40005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:41.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.463+0000 7f0f4cff9640 1 -- 172.21.15.7:0/748865686 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f440ce570 con 0x7f0f501083a0 2024-09-21T05:53:41.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.652+0000 7f0f56050640 1 -- 172.21.15.7:0/748865686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f5010bad0 con 0x7f0f501083a0 2024-09-21T05:53:41.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.653+0000 7f0f4cff9640 1 -- 172.21.15.7:0/748865686 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22826 (secure 0 0 0) 0x7f0f440d2950 con 0x7f0f501083a0 2024-09-21T05:53:41.655 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:53:41.655 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:43:32.863896+0000","modified":"2024-09-21T05:52:23.580753+0000","last_up_change":"2024-09-21T05:51:02.074799+0000","last_in_change":"2024-09-21T05:50:39.016405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:47:20.844179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:51:46.238763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:51:48.832249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d7a68ba-a599-44a9-a0de-a1d6df51f437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6803","nonce":536257283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6805","nonce":536257283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6809","nonce":536257283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6807","nonce":536257283}]},"public_addr":"172.21.15.7:6803/536257283","cluster_addr":"172.21.15.7:6805/536257283","heartbeat_back_addr":"172.21.15.7:6809/536257283","heartbeat_front_addr":"172.21.15.7:6807/536257283","state":["exists","up"]},{"osd":1,"uuid":"d4600805-1cb5-432a-8ae0-a40107a6c6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6801","nonce":2299402871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6803","nonce":2299402871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6807","nonce":2299402871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6805","nonce":2299402871}]},"public_addr":"172.21.15.27:6801/2299402871","cluster_addr":"172.21.15.27:6803/2299402871","heartbeat_back_addr":"172.21.15.27:6807/2299402871","heartbeat_front_addr":"172.21.15.27:6805/2299402871","state":["exists","up"]},{"osd":2,"uuid":"aa435f82-5819-4497-9053-1d891e712b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6801","nonce":1043408043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6803","nonce":1043408043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6807","nonce":1043408043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6805","nonce":1043408043}]},"public_addr":"172.21.15.119:6801/1043408043","cluster_addr":"172.21.15.119:6803/1043408043","heartbeat_back_addr":"172.21.15.119:6807/1043408043","heartbeat_front_addr":"172.21.15.119:6805/1043408043","state":["exists","up"]},{"osd":3,"uuid":"55803f97-02e1-43c0-b8da-9b8af32fd1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6811","nonce":1261229771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6813","nonce":1261229771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6817","nonce":1261229771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6815","nonce":1261229771}]},"public_addr":"172.21.15.7:6811/1261229771","cluster_addr":"172.21.15.7:6813/1261229771","heartbeat_back_addr":"172.21.15.7:6817/1261229771","heartbeat_front_addr":"172.21.15.7:6815/1261229771","state":["exists","up"]},{"osd":4,"uuid":"987ce230-5bfc-45a7-a33e-6291545afded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6809","nonce":631467792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6811","nonce":631467792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6815","nonce":631467792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6813","nonce":631467792}]},"public_addr":"172.21.15.27:6809/631467792","cluster_addr":"172.21.15.27:6811/631467792","heartbeat_back_addr":"172.21.15.27:6815/631467792","heartbeat_front_addr":"172.21.15.27:6813/631467792","state":["exists","up"]},{"osd":5,"uuid":"e768fbfa-8983-4ff6-8dca-b7df2304cf91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6809","nonce":2530968619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6811","nonce":2530968619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6815","nonce":2530968619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6813","nonce":2530968619}]},"public_addr":"172.21.15.119:6809/2530968619","cluster_addr":"172.21.15.119:6811/2530968619","heartbeat_back_addr":"172.21.15.119:6815/2530968619","heartbeat_front_addr":"172.21.15.119:6813/2530968619","state":["exists","up"]},{"osd":6,"uuid":"22496f13-64be-479b-89ea-bf51544199c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6819","nonce":856032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6821","nonce":856032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6825","nonce":856032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6823","nonce":856032021}]},"public_addr":"172.21.15.7:6819/856032021","cluster_addr":"172.21.15.7:6821/856032021","heartbeat_back_addr":"172.21.15.7:6825/856032021","heartbeat_front_addr":"172.21.15.7:6823/856032021","state":["exists","up"]},{"osd":7,"uuid":"53fc5616-b06a-498e-a60e-d7d7d6ba2a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6817","nonce":2862843529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6819","nonce":2862843529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6823","nonce":2862843529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6821","nonce":2862843529}]},"public_addr":"172.21.15.27:6817/2862843529","cluster_addr":"172.21.15.27:6819/2862843529","heartbeat_back_addr":"172.21.15.27:6823/2862843529","heartbeat_front_addr":"172.21.15.27:6821/2862843529","state":["exists","up"]},{"osd":8,"uuid":"53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6817","nonce":3663835202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6819","nonce":3663835202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6823","nonce":3663835202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6821","nonce":3663835202}]},"public_addr":"172.21.15.119:6817/3663835202","cluster_addr":"172.21.15.119:6819/3663835202","heartbeat_back_addr":"172.21.15.119:6823/3663835202","heartbeat_front_addr":"172.21.15.119:6821/3663835202","state":["exists","up"]},{"osd":9,"uuid":"a69a747d-1e6c-4940-9d96-4315ab384588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6827","nonce":2348805959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6829","nonce":2348805959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6833","nonce":2348805959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6831","nonce":2348805959}]},"public_addr":"172.21.15.7:6827/2348805959","cluster_addr":"172.21.15.7:6829/2348805959","heartbeat_back_addr":"172.21.15.7:6833/2348805959","heartbeat_front_addr":"172.21.15.7:6831/2348805959","state":["exists","up"]},{"osd":10,"uuid":"a8f67271-99bb-4fb7-b0f5-a24730cd96cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6825","nonce":2363600090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6827","nonce":2363600090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6831","nonce":2363600090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6829","nonce":2363600090}]},"public_addr":"172.21.15.27:6825/2363600090","cluster_addr":"172.21.15.27:6827/2363600090","heartbeat_back_addr":"172.21.15.27:6831/2363600090","heartbeat_front_addr":"172.21.15.27:6829/2363600090","state":["exists","up"]},{"osd":11,"uuid":"88456735-00b1-479c-b201-588a9ee0c881","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6825","nonce":3937692826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6827","nonce":3937692826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6831","nonce":3937692826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6829","nonce":3937692826}]},"public_addr":"172.21.15.119:6825/3937692826","cluster_addr":"172.21.15.119:6827/3937692826","heartbeat_back_addr":"172.21.15.119:6831/3937692826","heartbeat_front_addr":"172.21.15.119:6829/3937692826","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:26.217550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:51.830871+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:17.201362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:41.990894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:07.357782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.114180+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:56.808155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:22.565234+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:46.981522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:10.600602+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:35.973766+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:51:00.216062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/4143746508":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/1505943829":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/1622456881":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/833696585":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/2055984288":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6801/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3995317885":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2229583478":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/468393974":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/1009303060":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2125734440":"2024-09-22T05:45:22.373420+0000","172.21.15.7:6800/3995317885":"2024-09-22T05:45:22.373420+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:53:41.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.656+0000 7f0f56050640 1 -- 172.21.15.7:0/748865686 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0f380b6560 msgr2=0x7f0f380b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:41.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.656+0000 7f0f56050640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0f380b6560 0x7f0f380b8a70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0f400058c0 tx=0x7f0f40005ec0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.656+0000 7f0f56050640 1 -- 172.21.15.7:0/748865686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f501083a0 msgr2=0x7f0f5019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:41.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.656+0000 7f0f56050640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f501083a0 0x7f0f5019aa60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0f44032fd0 tx=0x7f0f44004270 comp rx=0 tx=0).stop 2024-09-21T05:53:41.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.656+0000 7f0f56050640 1 -- 172.21.15.7:0/748865686 shutdown_connections 2024-09-21T05:53:41.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.656+0000 7f0f56050640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0f380b6560 0x7f0f380b8a70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.656+0000 7f0f56050640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f501083a0 0x7f0f5019aa60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.656+0000 7f0f56050640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f50108cf0 0x7f0f5019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.656+0000 7f0f56050640 1 --2- 172.21.15.7:0/748865686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f50102a60 0x7f0f5019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.656+0000 7f0f56050640 1 -- 172.21.15.7:0/748865686 >> 172.21.15.7:0/748865686 conn(0x7f0f50079730 msgr2=0x7f0f5006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:41.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.656+0000 7f0f56050640 1 -- 172.21.15.7:0/748865686 shutdown_connections 2024-09-21T05:53:41.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:41.656+0000 7f0f56050640 1 -- 172.21.15.7:0/748865686 wait complete. 2024-09-21T05:53:41.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:41 smithi007 ceph-mon[30983]: pgmap v312: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T05:53:41.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:41 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/748865686' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:41.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:41 smithi027 ceph-mon[34364]: pgmap v312: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T05:53:41.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:41 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/748865686' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:42.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:41 smithi119 ceph-mon[34833]: pgmap v312: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T05:53:42.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:41 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/748865686' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:42.345 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T05:53:42.345 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T05:53:42.354 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T05:53:42.354 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T05:53:42.355 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-21T05:53:42.355 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T05:53:42.355 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T05:53:42.355 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T05:53:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.476+0000 7fe8ce182640 1 -- 172.21.15.7:0/2316327750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c8109440 msgr2=0x7fe8c8109850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.476+0000 7fe8ce182640 1 --2- 172.21.15.7:0/2316327750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c8109440 0x7fe8c8109850 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009900 tx=0x7fe8bc02a410 comp rx=0 tx=0).stop 2024-09-21T05:53:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.476+0000 7fe8ce182640 1 -- 172.21.15.7:0/2316327750 shutdown_connections 2024-09-21T05:53:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.476+0000 7fe8ce182640 1 --2- 172.21.15.7:0/2316327750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c8109440 0x7fe8c8109850 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.476+0000 7fe8ce182640 1 --2- 172.21.15.7:0/2316327750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c8109d90 0x7fe8c81105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.476+0000 7fe8ce182640 1 --2- 172.21.15.7:0/2316327750 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c8103b10 0x7fe8c8103f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.476+0000 7fe8ce182640 1 -- 172.21.15.7:0/2316327750 >> 172.21.15.7:0/2316327750 conn(0x7fe8c80ff570 msgr2=0x7fe8c81019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.477+0000 7fe8ce182640 1 -- 172.21.15.7:0/2316327750 shutdown_connections 2024-09-21T05:53:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.477+0000 7fe8ce182640 1 -- 172.21.15.7:0/2316327750 wait complete. 2024-09-21T05:53:42.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.477+0000 7fe8ce182640 1 Processor -- start 2024-09-21T05:53:42.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.478+0000 7fe8ce182640 1 -- start start 2024-09-21T05:53:42.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.478+0000 7fe8ce182640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c8103b10 0x7fe8c819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:42.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.478+0000 7fe8ce182640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c8109440 0x7fe8c819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:42.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.478+0000 7fe8ce182640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c8109d90 0x7fe8c819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:42.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.478+0000 7fe8ce182640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c8113a50 con 0x7fe8c8109440 2024-09-21T05:53:42.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.478+0000 7fe8ce182640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81138d0 con 0x7fe8c8103b10 2024-09-21T05:53:42.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.478+0000 7fe8ce182640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c8113bd0 con 0x7fe8c8109d90 2024-09-21T05:53:42.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.478+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c8109440 0x7fe8c819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.478+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c8109440 0x7fe8c819aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33234/0 (socket says 172.21.15.7:33234) 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.478+0000 7fe8c6ffd640 1 -- 172.21.15.7:0/522077496 learned_addr learned my addr 172.21.15.7:0/522077496 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.478+0000 7fe8c7fff640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c8109d90 0x7fe8c819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.478+0000 7fe8c77fe640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c8103b10 0x7fe8c819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.479+0000 7fe8c6ffd640 1 -- 172.21.15.7:0/522077496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c8109d90 msgr2=0x7fe8c819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.479+0000 7fe8c6ffd640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c8109d90 0x7fe8c819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.479+0000 7fe8c6ffd640 1 -- 172.21.15.7:0/522077496 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c8103b10 msgr2=0x7fe8c819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.479+0000 7fe8c6ffd640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c8103b10 0x7fe8c819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.479+0000 7fe8c6ffd640 1 -- 172.21.15.7:0/522077496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c81a0310 con 0x7fe8c8109440 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.479+0000 7fe8c77fe640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c8103b10 0x7fe8c819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.479+0000 7fe8c6ffd640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c8109440 0x7fe8c819aa10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc02a930 tx=0x7fe8bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.479+0000 7fe8c4ff9640 1 -- 172.21.15.7:0/522077496 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc03f030 con 0x7fe8c8109440 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.479+0000 7fe8c4ff9640 1 -- 172.21.15.7:0/522077496 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8bc003aa0 con 0x7fe8c8109440 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.479+0000 7fe8ce182640 1 -- 172.21.15.7:0/522077496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c81a05a0 con 0x7fe8c8109440 2024-09-21T05:53:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.479+0000 7fe8c4ff9640 1 -- 172.21.15.7:0/522077496 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc035070 con 0x7fe8c8109440 2024-09-21T05:53:42.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.479+0000 7fe8ce182640 1 -- 172.21.15.7:0/522077496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c81a0a90 con 0x7fe8c8109440 2024-09-21T05:53:42.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.480+0000 7fe8ce182640 1 -- 172.21.15.7:0/522077496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c8103f20 con 0x7fe8c8109440 2024-09-21T05:53:42.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.482+0000 7fe8c4ff9640 1 -- 172.21.15.7:0/522077496 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7fe8bc042030 con 0x7fe8c8109440 2024-09-21T05:53:42.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.483+0000 7fe8c4ff9640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8b00b6560 0x7fe8b00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:42.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.483+0000 7fe8c77fe640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8b00b6560 0x7fe8b00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:42.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.483+0000 7fe8c4ff9640 1 -- 172.21.15.7:0/522077496 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fe8bc107f30 con 0x7fe8c8109440 2024-09-21T05:53:42.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.484+0000 7fe8c77fe640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8b00b6560 0x7fe8b00b8a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800baa0 tx=0x7fe8b8005d90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:42.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.486+0000 7fe8c4ff9640 1 -- 172.21.15.7:0/522077496 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe8bc139710 con 0x7fe8c8109440 2024-09-21T05:53:42.634 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:42.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.727+0000 7fe8ce182640 1 -- 172.21.15.7:0/522077496 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fe8c8063800 con 0x7fe8b00b6560 2024-09-21T05:53:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.892+0000 7fe8c4ff9640 1 -- 172.21.15.7:0/522077496 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe8c8063800 con 0x7fe8b00b6560 2024-09-21T05:53:42.894 INFO:teuthology.orchestra.run.smithi007.stdout:Schedule set for path / 2024-09-21T05:53:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.895+0000 7fe8ce182640 1 -- 172.21.15.7:0/522077496 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8b00b6560 msgr2=0x7fe8b00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.895+0000 7fe8ce182640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8b00b6560 0x7fe8b00b8a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800baa0 tx=0x7fe8b8005d90 comp rx=0 tx=0).stop 2024-09-21T05:53:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.895+0000 7fe8ce182640 1 -- 172.21.15.7:0/522077496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c8109440 msgr2=0x7fe8c819aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.895+0000 7fe8ce182640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c8109440 0x7fe8c819aa10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc02a930 tx=0x7fe8bc004270 comp rx=0 tx=0).stop 2024-09-21T05:53:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.895+0000 7fe8ce182640 1 -- 172.21.15.7:0/522077496 shutdown_connections 2024-09-21T05:53:42.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.895+0000 7fe8ce182640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8b00b6560 0x7fe8b00b8a70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:42.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.895+0000 7fe8ce182640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c8109440 0x7fe8c819aa10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:42.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.895+0000 7fe8ce182640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c8109d90 0x7fe8c819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:42.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.895+0000 7fe8ce182640 1 --2- 172.21.15.7:0/522077496 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c8103b10 0x7fe8c819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:42.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.895+0000 7fe8ce182640 1 -- 172.21.15.7:0/522077496 >> 172.21.15.7:0/522077496 conn(0x7fe8c80ff570 msgr2=0x7fe8c8101990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:42.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.895+0000 7fe8ce182640 1 -- 172.21.15.7:0/522077496 shutdown_connections 2024-09-21T05:53:42.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:42.895+0000 7fe8ce182640 1 -- 172.21.15.7:0/522077496 wait complete. 2024-09-21T05:53:42.910 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-21T05:53:43.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.025+0000 7ff030de6640 1 -- 172.21.15.7:0/2467747212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff02c1029c0 msgr2=0x7ff02c102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.025+0000 7ff030de6640 1 --2- 172.21.15.7:0/2467747212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff02c1029c0 0x7ff02c102dd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009900 tx=0x7ff01c02a410 comp rx=0 tx=0).stop 2024-09-21T05:53:43.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.025+0000 7ff030de6640 1 -- 172.21.15.7:0/2467747212 shutdown_connections 2024-09-21T05:53:43.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.025+0000 7ff030de6640 1 --2- 172.21.15.7:0/2467747212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff02c108c40 0x7ff02c10f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.025+0000 7ff030de6640 1 --2- 172.21.15.7:0/2467747212 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff02c1082f0 0x7ff02c108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.025+0000 7ff030de6640 1 --2- 172.21.15.7:0/2467747212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff02c1029c0 0x7ff02c102dd0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.025+0000 7ff030de6640 1 -- 172.21.15.7:0/2467747212 >> 172.21.15.7:0/2467747212 conn(0x7ff02c0fe3c0 msgr2=0x7ff02c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:43.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.026+0000 7ff030de6640 1 -- 172.21.15.7:0/2467747212 shutdown_connections 2024-09-21T05:53:43.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.026+0000 7ff030de6640 1 -- 172.21.15.7:0/2467747212 wait complete. 2024-09-21T05:53:43.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.026+0000 7ff030de6640 1 Processor -- start 2024-09-21T05:53:43.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.026+0000 7ff030de6640 1 -- start start 2024-09-21T05:53:43.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff030de6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff02c1029c0 0x7ff02c19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff030de6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff02c1082f0 0x7ff02c19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff030de6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff02c108c40 0x7ff02c19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff030de6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff02c112900 con 0x7ff02c1082f0 2024-09-21T05:53:43.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff030de6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff02c112780 con 0x7ff02c1029c0 2024-09-21T05:53:43.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff030de6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff02c112a80 con 0x7ff02c108c40 2024-09-21T05:53:43.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff029d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff02c1082f0 0x7ff02c19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff029d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff02c1082f0 0x7ff02c19b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33262/0 (socket says 172.21.15.7:33262) 2024-09-21T05:53:43.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff029d9b640 1 -- 172.21.15.7:0/4048168033 learned_addr learned my addr 172.21.15.7:0/4048168033 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff02ad9d640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff02c108c40 0x7ff02c19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff02a59c640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff02c1029c0 0x7ff02c19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff029d9b640 1 -- 172.21.15.7:0/4048168033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff02c108c40 msgr2=0x7ff02c19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff029d9b640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff02c108c40 0x7ff02c19bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff029d9b640 1 -- 172.21.15.7:0/4048168033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff02c1029c0 msgr2=0x7ff02c19b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff029d9b640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff02c1029c0 0x7ff02c19b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff029d9b640 1 -- 172.21.15.7:0/4048168033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02c1a65b0 con 0x7ff02c1082f0 2024-09-21T05:53:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff029d9b640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff02c1082f0 0x7ff02c19b830 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff01400d950 tx=0x7ff01400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff0237fe640 1 -- 172.21.15.7:0/4048168033 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff014017070 con 0x7ff02c1082f0 2024-09-21T05:53:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff0237fe640 1 -- 172.21.15.7:0/4048168033 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff014009c30 con 0x7ff02c1082f0 2024-09-21T05:53:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.027+0000 7ff030de6640 1 -- 172.21.15.7:0/4048168033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff02c1a68a0 con 0x7ff02c1082f0 2024-09-21T05:53:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.028+0000 7ff0237fe640 1 -- 172.21.15.7:0/4048168033 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0140047a0 con 0x7ff02c1082f0 2024-09-21T05:53:43.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.028+0000 7ff030de6640 1 -- 172.21.15.7:0/4048168033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff02c1a6df0 con 0x7ff02c1082f0 2024-09-21T05:53:43.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.029+0000 7ff030de6640 1 -- 172.21.15.7:0/4048168033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff02c102dd0 con 0x7ff02c1082f0 2024-09-21T05:53:43.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.030+0000 7ff0237fe640 1 -- 172.21.15.7:0/4048168033 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7ff014004020 con 0x7ff02c1082f0 2024-09-21T05:53:43.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.031+0000 7ff0237fe640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff0180b6560 0x7ff0180b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.031+0000 7ff02a59c640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff0180b6560 0x7ff0180b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.031+0000 7ff0237fe640 1 -- 172.21.15.7:0/4048168033 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7ff0140e7580 con 0x7ff02c1082f0 2024-09-21T05:53:43.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.032+0000 7ff02a59c640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff0180b6560 0x7ff0180b8a70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff01c006010 tx=0x7ff01c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.035+0000 7ff0237fe640 1 -- 172.21.15.7:0/4048168033 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff014020020 con 0x7ff02c1082f0 2024-09-21T05:53:43.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.141+0000 7f9f6b19e640 1 -- 172.21.15.7:0/3786861942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f64108b00 msgr2=0x7f9f6410f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.141+0000 7f9f6b19e640 1 --2- 172.21.15.7:0/3786861942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f64108b00 0x7f9f6410f330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009ca0 tx=0x7f9f5c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.141+0000 7f9f6b19e640 1 -- 172.21.15.7:0/3786861942 shutdown_connections 2024-09-21T05:53:43.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.141+0000 7f9f6b19e640 1 --2- 172.21.15.7:0/3786861942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f64108b00 0x7f9f6410f330 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.141+0000 7f9f6b19e640 1 --2- 172.21.15.7:0/3786861942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f641081b0 0x7f9f641085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.141+0000 7f9f6b19e640 1 --2- 172.21.15.7:0/3786861942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f64102870 0x7f9f64102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.141+0000 7f9f6b19e640 1 -- 172.21.15.7:0/3786861942 >> 172.21.15.7:0/3786861942 conn(0x7f9f640fe2c0 msgr2=0x7f9f64100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:43.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.141+0000 7f9f6b19e640 1 -- 172.21.15.7:0/3786861942 shutdown_connections 2024-09-21T05:53:43.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.141+0000 7f9f6b19e640 1 -- 172.21.15.7:0/3786861942 wait complete. 2024-09-21T05:53:43.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.142+0000 7f9f6b19e640 1 Processor -- start 2024-09-21T05:53:43.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.142+0000 7f9f6b19e640 1 -- start start 2024-09-21T05:53:43.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.142+0000 7f9f6b19e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f64102870 0x7f9f6419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.142+0000 7f9f6b19e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f641081b0 0x7f9f6419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.142+0000 7f9f6b19e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f64108b00 0x7f9f6419fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.142+0000 7f9f6b19e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f641127d0 con 0x7f9f64102870 2024-09-21T05:53:43.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.142+0000 7f9f6b19e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9f64112650 con 0x7f9f64108b00 2024-09-21T05:53:43.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.142+0000 7f9f6b19e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9f64112950 con 0x7f9f641081b0 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.142+0000 7f9f6a19c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f64102870 0x7f9f6419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.142+0000 7f9f6a19c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f64102870 0x7f9f6419a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33294/0 (socket says 172.21.15.7:33294) 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.142+0000 7f9f6a19c640 1 -- 172.21.15.7:0/3657882085 learned_addr learned my addr 172.21.15.7:0/3657882085 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.142+0000 7f9f6a99d640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f64108b00 0x7f9f6419fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.143+0000 7f9f6999b640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f641081b0 0x7f9f6419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.143+0000 7f9f6a19c640 1 -- 172.21.15.7:0/3657882085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f641081b0 msgr2=0x7f9f6419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.143+0000 7f9f6a19c640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f641081b0 0x7f9f6419a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.143+0000 7f9f6a19c640 1 -- 172.21.15.7:0/3657882085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f64108b00 msgr2=0x7f9f6419fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.143+0000 7f9f6a19c640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f64108b00 0x7f9f6419fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.143+0000 7f9f6a19c640 1 -- 172.21.15.7:0/3657882085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f641a02c0 con 0x7f9f64102870 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.143+0000 7f9f6a19c640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f64102870 0x7f9f6419a350 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000d950 tx=0x7f9f6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.143+0000 7f9f5b7fe640 1 -- 172.21.15.7:0/3657882085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60017030 con 0x7f9f64102870 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.143+0000 7f9f6b19e640 1 -- 172.21.15.7:0/3657882085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f641a05b0 con 0x7f9f64102870 2024-09-21T05:53:43.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.143+0000 7f9f5b7fe640 1 -- 172.21.15.7:0/3657882085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f60004020 con 0x7f9f64102870 2024-09-21T05:53:43.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.143+0000 7f9f5b7fe640 1 -- 172.21.15.7:0/3657882085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f600047a0 con 0x7f9f64102870 2024-09-21T05:53:43.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.143+0000 7f9f6b19e640 1 -- 172.21.15.7:0/3657882085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f640fe6d0 con 0x7f9f64102870 2024-09-21T05:53:43.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.146+0000 7f9f5b7fe640 1 -- 172.21.15.7:0/3657882085 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f9f60009a30 con 0x7f9f64102870 2024-09-21T05:53:43.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.146+0000 7f9f72974740 1 Processor -- start 2024-09-21T05:53:43.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.147+0000 7f9f72974740 1 -- start start 2024-09-21T05:53:43.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.147+0000 7f9f72974740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882ec8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.147+0000 7f9f72974740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882af8490 0x561882ec8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.147+0000 7f9f72974740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882b00670 0x561882ec9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.147+0000 7f9f72974740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561882e3ee60 con 0x561882b21350 2024-09-21T05:53:43.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.147+0000 7f9f72974740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561882e2e290 con 0x561882b00670 2024-09-21T05:53:43.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.147+0000 7f9f72974740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561882e320a0 con 0x561882af8490 2024-09-21T05:53:43.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.147+0000 7f9f5b7fe640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9f500b6560 0x7f9f500b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.147+0000 7f9f6a99d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882ec8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.147+0000 7f9f6a99d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882ec8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33306/0 (socket says 172.21.15.7:33306) 2024-09-21T05:53:43.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.147+0000 7f9f6a99d640 1 -- 172.21.15.7:0/3151136 learned_addr learned my addr 172.21.15.7:0/3151136 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:43.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.148+0000 7f9f6999b640 1 --2- 172.21.15.7:0/3151136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882b00670 0x561882ec9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.148+0000 7f9f6a99d640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9f500b6560 0x7f9f500b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.148+0000 7f9f6a99d640 1 -- 172.21.15.7:0/3151136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882af8490 msgr2=0x561882ec8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.148+0000 7f9f6a19c640 1 --2- 172.21.15.7:0/3151136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882af8490 0x561882ec8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.148+0000 7f9f5b7fe640 1 -- 172.21.15.7:0/3657882085 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9f600e6e10 con 0x7f9f64102870 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.148+0000 7f9f6a99d640 1 --2- 172.21.15.7:0/3151136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882af8490 0x561882ec8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.148+0000 7f9f6a99d640 1 -- 172.21.15.7:0/3151136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882b00670 msgr2=0x561882ec9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.148+0000 7f9f6a99d640 1 --2- 172.21.15.7:0/3151136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882b00670 0x561882ec9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.148+0000 7f9f6a99d640 1 -- 172.21.15.7:0/3151136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561882b8c930 con 0x561882b21350 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.148+0000 7f9f6999b640 1 --2- 172.21.15.7:0/3151136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882b00670 0x561882ec9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.148+0000 7f9f6a19c640 1 --2- 172.21.15.7:0/3151136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882af8490 0x561882ec8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.148+0000 7f9f6a99d640 1 --2- 172.21.15.7:0/3151136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882ec8610 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c031e40 tx=0x7f9f5c031e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb661231e6fbe8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.148+0000 7f9f58d9a640 1 -- 172.21.15.7:0/3151136 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c004d40 con 0x561882b21350 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.149+0000 7f9f58d9a640 1 -- 172.21.15.7:0/3151136 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f5c036070 con 0x561882b21350 2024-09-21T05:53:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.149+0000 7f9f58d9a640 1 -- 172.21.15.7:0/3151136 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c004690 con 0x561882b21350 2024-09-21T05:53:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.149+0000 7f9f72974740 1 -- 172.21.15.7:0/3151136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 msgr2=0x561882ec8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.149+0000 7f9f72974740 1 --2- 172.21.15.7:0/3151136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882ec8610 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c031e40 tx=0x7f9f5c031e70 comp rx=0 tx=0).stop 2024-09-21T05:53:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.149+0000 7f9f6a99d640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9f500b6560 0x7f9f500b8a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c04e000 tx=0x7f9f5c04c000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.149+0000 7f9f72974740 1 -- 172.21.15.7:0/3151136 shutdown_connections 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.149+0000 7f9f72974740 1 --2- 172.21.15.7:0/3151136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882b00670 0x561882ec9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.149+0000 7f9f72974740 1 --2- 172.21.15.7:0/3151136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882af8490 0x561882ec8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.149+0000 7f9f72974740 1 --2- 172.21.15.7:0/3151136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882ec8610 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.149+0000 7f9f72974740 1 -- 172.21.15.7:0/3151136 >> 172.21.15.7:0/3151136 conn(0x561882b15740 msgr2=0x561882ec6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.150+0000 7f9f72974740 1 -- 172.21.15.7:0/3151136 shutdown_connections 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.150+0000 7f9f72974740 1 -- 172.21.15.7:0/3151136 wait complete. 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.150+0000 7f9f72974740 1 -- start start 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.150+0000 7f9f72974740 1 Processor -- start 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.150+0000 7f9f72974740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882af8490 0x561882ed4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.150+0000 7f9f72974740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882b00670 0x561882ed4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.150+0000 7f9f72974740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882edff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f72974740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561882c8f890 con 0x561882b21350 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f72974740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561882dc8d40 con 0x561882b00670 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f72974740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561882ed6c70 con 0x561882af8490 2024-09-21T05:53:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f72974740 10 client.0 _ll_register_callbacks cb 0x561882e2cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f6a99d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882edff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f6a99d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882edff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33312/0 (socket says 172.21.15.7:33312) 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f6a19c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882af8490 0x561882ed4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f6a99d640 1 -- 172.21.15.7:0/1334338381 learned_addr learned my addr 172.21.15.7:0/1334338381 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f6999b640 1 --2- 172.21.15.7:0/1334338381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882b00670 0x561882ed4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f6a19c640 1 -- 172.21.15.7:0/1334338381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882b00670 msgr2=0x561882ed4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f6a19c640 1 --2- 172.21.15.7:0/1334338381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882b00670 0x561882ed4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f6a19c640 1 -- 172.21.15.7:0/1334338381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 msgr2=0x561882edff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f6a19c640 1 --2- 172.21.15.7:0/1334338381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882edff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f6a19c640 1 -- 172.21.15.7:0/1334338381 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561882ee05d0 con 0x561882af8490 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f6999b640 1 --2- 172.21.15.7:0/1334338381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882b00670 0x561882ed4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f6a19c640 1 --2- 172.21.15.7:0/1334338381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882af8490 0x561882ed4290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x561882ec7290 tx=0x7f9f60007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e07b032f5633b0fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.151+0000 7f9f4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f4dffb640 1 -- 172.21.15.7:0/1334338381 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f600ac9b0 con 0x561882af8490 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f72974740 1 -- 172.21.15.7:0/1334338381 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f5c036070 con 0x561882af8490 2024-09-21T05:53:43.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f4dffb640 1 -- 172.21.15.7:0/1334338381 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9f60098170 con 0x561882af8490 2024-09-21T05:53:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f4dffb640 1 -- 172.21.15.7:0/1334338381 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9f600ad5a0 con 0x561882af8490 2024-09-21T05:53:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f72974740 10 client.25177 fetch_fsmap learned FSMap version 25 2024-09-21T05:53:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f72974740 1 -- 172.21.15.7:0/1334338381 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561882ee2ea0 con 0x561882af8490 2024-09-21T05:53:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f4dffb640 1 -- 172.21.15.7:0/1334338381 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f5c036070 con 0x561882af8490 2024-09-21T05:53:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f4dffb640 1 -- 172.21.15.7:0/1334338381 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9f60018b40 con 0x561882af8490 2024-09-21T05:53:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f72974740 10 client.25177 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:53:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f72974740 10 client.25177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:53:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f72974740 20 client.25177 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f72974740 1 --2- 172.21.15.7:0/1334338381 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561882adfcd0 0x561882ee6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f72974740 4 client.25177 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:53:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.152+0000 7f9f72974740 1 -- 172.21.15.7:0/1334338381 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561882e40db0 con 0x561882adfcd0 2024-09-21T05:53:43.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.153+0000 7f9f6999b640 1 --2- 172.21.15.7:0/1334338381 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561882adfcd0 0x561882ee6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.153+0000 7f9f6999b640 1 --2- 172.21.15.7:0/1334338381 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561882adfcd0 0x561882ee6370 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38dbee567a89e620 server_cookie=2a8ea5b8cc09ffc8 in_seq=0 out_seq=0 2024-09-21T05:53:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.153+0000 7f9f4dffb640 10 client.25177 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f4dffb640 1 -- 172.21.15.7:0/1334338381 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561882e40db0 con 0x561882adfcd0 2024-09-21T05:53:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f4dffb640 10 client.25177 handle_command_reply: tid=0 2024-09-21T05:53:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f72974740 1 client.25177 shutdown 2024-09-21T05:53:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f72974740 1 -- 172.21.15.7:0/1334338381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882af8490 msgr2=0x561882ed4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f72974740 1 --2- 172.21.15.7:0/1334338381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882af8490 0x561882ed4290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x561882ec7290 tx=0x7f9f60007f90 comp rx=0 tx=0).stop 2024-09-21T05:53:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f72974740 1 -- 172.21.15.7:0/1334338381 shutdown_connections 2024-09-21T05:53:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f72974740 1 --2- 172.21.15.7:0/1334338381 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561882adfcd0 0x561882ee6370 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f72974740 1 --2- 172.21.15.7:0/1334338381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882edff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f72974740 1 --2- 172.21.15.7:0/1334338381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882b00670 0x561882ed4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f72974740 1 --2- 172.21.15.7:0/1334338381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882af8490 0x561882ed4290 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f72974740 1 -- 172.21.15.7:0/1334338381 >> 172.21.15.7:0/1334338381 conn(0x561882b15740 msgr2=0x561882ecb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f4dffb640 0 client.25177 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f72974740 1 -- 172.21.15.7:0/1334338381 shutdown_connections 2024-09-21T05:53:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f72974740 1 -- 172.21.15.7:0/1334338381 wait complete. 2024-09-21T05:53:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.154+0000 7f9f72974740 20 client.25177 trim_cache size 0 max 16384 2024-09-21T05:53:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.192+0000 7f9f72974740 1 Processor -- start 2024-09-21T05:53:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f72974740 1 -- start start 2024-09-21T05:53:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f72974740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882af8490 0x561882edfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f72974740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b00670 0x561882ecd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f72974740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882b21350 0x561882ecddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f72974740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f641b3fb0 con 0x561882b00670 2024-09-21T05:53:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f72974740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9f641b1880 con 0x561882af8490 2024-09-21T05:53:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f72974740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9f641af6f0 con 0x561882b21350 2024-09-21T05:53:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f6999b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b00670 0x561882ecd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f6999b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b00670 0x561882ecd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33328/0 (socket says 172.21.15.7:33328) 2024-09-21T05:53:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f6999b640 1 -- 172.21.15.7:0/1581945519 learned_addr learned my addr 172.21.15.7:0/1581945519 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f6a19c640 1 --2- 172.21.15.7:0/1581945519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882af8490 0x561882edfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f6a99d640 1 --2- 172.21.15.7:0/1581945519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882b21350 0x561882ecddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f6999b640 1 -- 172.21.15.7:0/1581945519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882b21350 msgr2=0x561882ecddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f6999b640 1 --2- 172.21.15.7:0/1581945519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882b21350 0x561882ecddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f6999b640 1 -- 172.21.15.7:0/1581945519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882af8490 msgr2=0x561882edfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f6999b640 1 --2- 172.21.15.7:0/1581945519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882af8490 0x561882edfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.193+0000 7f9f6999b640 1 -- 172.21.15.7:0/1581945519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561882eca900 con 0x561882b00670 2024-09-21T05:53:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.194+0000 7f9f6999b640 1 --2- 172.21.15.7:0/1581945519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b00670 0x561882ecd890 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9f6406a800 tx=0x7f9f54005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6948defab92c5826 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.194+0000 7f9f4ffff640 1 -- 172.21.15.7:0/1581945519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54020070 con 0x561882b00670 2024-09-21T05:53:43.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.194+0000 7f9f4ffff640 1 -- 172.21.15.7:0/1581945519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f54003ca0 con 0x561882b00670 2024-09-21T05:53:43.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.194+0000 7f9f4ffff640 1 -- 172.21.15.7:0/1581945519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54010720 con 0x561882b00670 2024-09-21T05:53:43.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.195+0000 7f9f72974740 1 -- 172.21.15.7:0/1581945519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b00670 msgr2=0x561882ecd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.195+0000 7f9f72974740 1 --2- 172.21.15.7:0/1581945519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b00670 0x561882ecd890 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9f6406a800 tx=0x7f9f54005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.195+0000 7f9f72974740 1 -- 172.21.15.7:0/1581945519 shutdown_connections 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.195+0000 7f9f72974740 1 --2- 172.21.15.7:0/1581945519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b00670 0x561882ecd890 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.195+0000 7f9f72974740 1 --2- 172.21.15.7:0/1581945519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882b21350 0x561882ecddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.195+0000 7f9f72974740 1 --2- 172.21.15.7:0/1581945519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882af8490 0x561882edfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.195+0000 7f9f72974740 1 -- 172.21.15.7:0/1581945519 >> 172.21.15.7:0/1581945519 conn(0x561882b15740 msgr2=0x561882ecf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.195+0000 7f9f72974740 1 -- 172.21.15.7:0/1581945519 shutdown_connections 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.195+0000 7f9f72974740 1 -- 172.21.15.7:0/1581945519 wait complete. 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.195+0000 7f9f72974740 1 -- start start 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.195+0000 7f9f72974740 1 Processor -- start 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f72974740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882af8490 0x561882edbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f72974740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882b00670 0x561882edc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f72974740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882ed6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f72974740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f641afd40 con 0x561882b21350 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f72974740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9f641b11b0 con 0x561882af8490 2024-09-21T05:53:43.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f72974740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9f641b0410 con 0x561882b00670 2024-09-21T05:53:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f72974740 10 client.0 _ll_register_callbacks cb 0x7f9f60005d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f6999b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882b00670 0x561882edc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f6999b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882b00670 0x561882edc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:60404/0 (socket says 172.21.15.7:60404) 2024-09-21T05:53:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f6999b640 1 -- 172.21.15.7:0/2480250085 learned_addr learned my addr 172.21.15.7:0/2480250085 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f6a19c640 1 --2- 172.21.15.7:0/2480250085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882af8490 0x561882edbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f6a99d640 1 --2- 172.21.15.7:0/2480250085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882ed6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f6999b640 1 -- 172.21.15.7:0/2480250085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882af8490 msgr2=0x561882edbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f6999b640 1 --2- 172.21.15.7:0/2480250085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882af8490 0x561882edbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f6999b640 1 -- 172.21.15.7:0/2480250085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 msgr2=0x561882ed6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f6999b640 1 --2- 172.21.15.7:0/2480250085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882ed6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.196+0000 7f9f6999b640 1 -- 172.21.15.7:0/2480250085 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561882edc9a0 con 0x561882b00670 2024-09-21T05:53:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f6999b640 1 --2- 172.21.15.7:0/2480250085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882b00670 0x561882edc410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f5401eeb0 tx=0x7f9f54003e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbcd3bc7eeee015a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:53:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f4dffb640 1 -- 172.21.15.7:0/2480250085 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54020050 con 0x561882b00670 2024-09-21T05:53:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f4dffb640 1 -- 172.21.15.7:0/2480250085 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9f5401e890 con 0x561882b00670 2024-09-21T05:53:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f72974740 1 -- 172.21.15.7:0/2480250085 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f54003ca0 con 0x561882b00670 2024-09-21T05:53:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f4dffb640 1 -- 172.21.15.7:0/2480250085 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9f5401ea90 con 0x561882b00670 2024-09-21T05:53:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f72974740 10 client.25183 fetch_fsmap learned FSMap version 25 2024-09-21T05:53:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f72974740 1 -- 172.21.15.7:0/2480250085 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561882f510a0 con 0x561882b00670 2024-09-21T05:53:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f4dffb640 1 -- 172.21.15.7:0/2480250085 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f54003ca0 con 0x561882b00670 2024-09-21T05:53:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f4dffb640 1 -- 172.21.15.7:0/2480250085 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9f540304a0 con 0x561882b00670 2024-09-21T05:53:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f72974740 10 client.25183 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:53:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f72974740 10 client.25183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:53:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f72974740 20 client.25183 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f72974740 1 --2- 172.21.15.7:0/2480250085 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561882ab5080 0x561882f53830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f72974740 4 client.25183 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T05:53:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.197+0000 7f9f72974740 1 -- 172.21.15.7:0/2480250085 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561882e3c860 con 0x561882ab5080 2024-09-21T05:53:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.198+0000 7f9f6a19c640 1 --2- 172.21.15.7:0/2480250085 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561882ab5080 0x561882f53830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.198+0000 7f9f4dffb640 10 client.25183 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.198+0000 7f9f6a19c640 1 --2- 172.21.15.7:0/2480250085 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561882ab5080 0x561882f53830 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb1b0a3f8c12d5ae server_cookie=1205a9f11b99c6cd in_seq=0 out_seq=0 2024-09-21T05:53:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.200+0000 7f9f4dffb640 1 -- 172.21.15.7:0/2480250085 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561882e3c860 con 0x561882ab5080 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.200+0000 7f9f4dffb640 10 client.25183 handle_command_reply: tid=0 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.200+0000 7f9f72974740 1 client.25183 shutdown 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.200+0000 7f9f72974740 1 -- 172.21.15.7:0/2480250085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882b00670 msgr2=0x561882edc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.200+0000 7f9f72974740 1 --2- 172.21.15.7:0/2480250085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882b00670 0x561882edc410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f5401eeb0 tx=0x7f9f54003e50 comp rx=0 tx=0).stop 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.200+0000 7f9f72974740 1 -- 172.21.15.7:0/2480250085 shutdown_connections 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.200+0000 7f9f72974740 1 --2- 172.21.15.7:0/2480250085 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561882ab5080 0x561882f53830 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.200+0000 7f9f4dffb640 0 client.25183 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.200+0000 7f9f72974740 1 --2- 172.21.15.7:0/2480250085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561882b21350 0x561882ed6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.200+0000 7f9f72974740 1 --2- 172.21.15.7:0/2480250085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561882b00670 0x561882edc410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.200+0000 7f9f72974740 1 --2- 172.21.15.7:0/2480250085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561882af8490 0x561882edbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.200+0000 7f9f72974740 1 -- 172.21.15.7:0/2480250085 >> 172.21.15.7:0/2480250085 conn(0x561882b15740 msgr2=0x561882ed2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.201+0000 7f9f72974740 1 -- 172.21.15.7:0/2480250085 shutdown_connections 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.201+0000 7f9f72974740 1 -- 172.21.15.7:0/2480250085 wait complete. 2024-09-21T05:53:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.201+0000 7f9f72974740 20 client.25183 trim_cache size 0 max 16384 2024-09-21T05:53:43.205 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:53:43.205 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T05:53:43.205 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "f1184167-1a52-4b53-a7c1-bf937ae62179", 2024-09-21T05:53:43.205 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T05:53:43.205 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:53:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.201+0000 7f9f6b19e640 1 -- 172.21.15.7:0/3657882085 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9f500b6560 msgr2=0x7f9f500b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.201+0000 7f9f6b19e640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9f500b6560 0x7f9f500b8a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c04e000 tx=0x7f9f5c04c000 comp rx=0 tx=0).stop 2024-09-21T05:53:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.201+0000 7f9f6b19e640 1 -- 172.21.15.7:0/3657882085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f64102870 msgr2=0x7f9f6419a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.201+0000 7f9f6b19e640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f64102870 0x7f9f6419a350 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000d950 tx=0x7f9f6000de10 comp rx=0 tx=0).stop 2024-09-21T05:53:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.202+0000 7f9f6b19e640 1 -- 172.21.15.7:0/3657882085 shutdown_connections 2024-09-21T05:53:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.202+0000 7f9f6b19e640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9f500b6560 0x7f9f500b8a70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.202+0000 7f9f6b19e640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f64108b00 0x7f9f6419fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.202+0000 7f9f6b19e640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f641081b0 0x7f9f6419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.202+0000 7f9f6b19e640 1 --2- 172.21.15.7:0/3657882085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f64102870 0x7f9f6419a350 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.202+0000 7f9f6b19e640 1 -- 172.21.15.7:0/3657882085 >> 172.21.15.7:0/3657882085 conn(0x7f9f640fe2c0 msgr2=0x7f9f6406b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.202+0000 7f9f6b19e640 1 -- 172.21.15.7:0/3657882085 shutdown_connections 2024-09-21T05:53:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.202+0000 7f9f6b19e640 1 -- 172.21.15.7:0/3657882085 wait complete. 2024-09-21T05:53:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.278+0000 7ff030de6640 1 -- 172.21.15.7:0/4048168033 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7ff02c0638a0 con 0x7ff0180b6560 2024-09-21T05:53:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.342+0000 7ff0237fe640 1 -- 172.21.15.7:0/4048168033 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7ff02c0638a0 con 0x7ff0180b6560 2024-09-21T05:53:43.344 INFO:teuthology.orchestra.run.smithi007.stdout:Retention added to path / 2024-09-21T05:53:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.344+0000 7ff030de6640 1 -- 172.21.15.7:0/4048168033 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff0180b6560 msgr2=0x7ff0180b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.344+0000 7ff030de6640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff0180b6560 0x7ff0180b8a70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff01c006010 tx=0x7ff01c000bc0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.344+0000 7ff030de6640 1 -- 172.21.15.7:0/4048168033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff02c1082f0 msgr2=0x7ff02c19b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.344+0000 7ff030de6640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff02c1082f0 0x7ff02c19b830 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff01400d950 tx=0x7ff01400de10 comp rx=0 tx=0).stop 2024-09-21T05:53:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.344+0000 7ff030de6640 1 -- 172.21.15.7:0/4048168033 shutdown_connections 2024-09-21T05:53:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.344+0000 7ff030de6640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff0180b6560 0x7ff0180b8a70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.344+0000 7ff030de6640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff02c1082f0 0x7ff02c19b830 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.344+0000 7ff030de6640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff02c108c40 0x7ff02c19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.344+0000 7ff030de6640 1 --2- 172.21.15.7:0/4048168033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff02c1029c0 0x7ff02c19b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.344+0000 7ff030de6640 1 -- 172.21.15.7:0/4048168033 >> 172.21.15.7:0/4048168033 conn(0x7ff02c0fe3c0 msgr2=0x7ff02c107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.344+0000 7ff030de6640 1 -- 172.21.15.7:0/4048168033 shutdown_connections 2024-09-21T05:53:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.344+0000 7ff030de6640 1 -- 172.21.15.7:0/4048168033 wait complete. 2024-09-21T05:53:43.358 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T05:53:43.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.474+0000 7ff692e38640 1 -- 172.21.15.7:0/3200556741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff68c109d50 msgr2=0x7ff68c110580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.474+0000 7ff692e38640 1 --2- 172.21.15.7:0/3200556741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff68c109d50 0x7ff68c110580 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff684009ca0 tx=0x7ff68402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.474+0000 7ff692e38640 1 -- 172.21.15.7:0/3200556741 shutdown_connections 2024-09-21T05:53:43.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.474+0000 7ff692e38640 1 --2- 172.21.15.7:0/3200556741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff68c109d50 0x7ff68c110580 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.474+0000 7ff692e38640 1 --2- 172.21.15.7:0/3200556741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff68c109400 0x7ff68c109810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.474+0000 7ff692e38640 1 --2- 172.21.15.7:0/3200556741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff68c103ad0 0x7ff68c103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.474+0000 7ff692e38640 1 -- 172.21.15.7:0/3200556741 >> 172.21.15.7:0/3200556741 conn(0x7ff68c0ff4d0 msgr2=0x7ff68c101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:43.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.475+0000 7ff692e38640 1 -- 172.21.15.7:0/3200556741 shutdown_connections 2024-09-21T05:53:43.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.475+0000 7ff692e38640 1 -- 172.21.15.7:0/3200556741 wait complete. 2024-09-21T05:53:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.475+0000 7ff692e38640 1 Processor -- start 2024-09-21T05:53:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.475+0000 7ff692e38640 1 -- start start 2024-09-21T05:53:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.475+0000 7ff692e38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff68c103ad0 0x7ff68c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff692e38640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff68c109400 0x7ff68c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff692e38640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff68c109d50 0x7ff68c19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff692e38640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c113a10 con 0x7ff68c103ad0 2024-09-21T05:53:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff692e38640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c113890 con 0x7ff68c109400 2024-09-21T05:53:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff692e38640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c113b90 con 0x7ff68c109d50 2024-09-21T05:53:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff690bd4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff68c103ad0 0x7ff68c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff690bd4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff68c103ad0 0x7ff68c19a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33336/0 (socket says 172.21.15.7:33336) 2024-09-21T05:53:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff690bd4640 1 -- 172.21.15.7:0/1998743125 learned_addr learned my addr 172.21.15.7:0/1998743125 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff6913d5640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff68c109d50 0x7ff68c19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff68bfff640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff68c109400 0x7ff68c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff690bd4640 1 -- 172.21.15.7:0/1998743125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff68c109d50 msgr2=0x7ff68c19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff690bd4640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff68c109d50 0x7ff68c19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff690bd4640 1 -- 172.21.15.7:0/1998743125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff68c109400 msgr2=0x7ff68c19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff690bd4640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff68c109400 0x7ff68c19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff690bd4640 1 -- 172.21.15.7:0/1998743125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68c1a0320 con 0x7ff68c103ad0 2024-09-21T05:53:43.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff68bfff640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff68c109400 0x7ff68c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:43.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff690bd4640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff68c103ad0 0x7ff68c19a3f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff68000e9f0 tx=0x7ff68000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff689ffb640 1 -- 172.21.15.7:0/1998743125 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68000cd80 con 0x7ff68c103ad0 2024-09-21T05:53:43.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff692e38640 1 -- 172.21.15.7:0/1998743125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68c1a0610 con 0x7ff68c103ad0 2024-09-21T05:53:43.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff689ffb640 1 -- 172.21.15.7:0/1998743125 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6800108e0 con 0x7ff68c103ad0 2024-09-21T05:53:43.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.476+0000 7ff689ffb640 1 -- 172.21.15.7:0/1998743125 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff680018980 con 0x7ff68c103ad0 2024-09-21T05:53:43.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.477+0000 7ff692e38640 1 -- 172.21.15.7:0/1998743125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff68c1a6da0 con 0x7ff68c103ad0 2024-09-21T05:53:43.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.478+0000 7ff692e38640 1 -- 172.21.15.7:0/1998743125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff68c104d40 con 0x7ff68c103ad0 2024-09-21T05:53:43.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.479+0000 7ff689ffb640 1 -- 172.21.15.7:0/1998743125 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7ff680010430 con 0x7ff68c103ad0 2024-09-21T05:53:43.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.480+0000 7ff689ffb640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff67c0b6560 0x7ff67c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.480+0000 7ff68bfff640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff67c0b6560 0x7ff67c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.480+0000 7ff689ffb640 1 -- 172.21.15.7:0/1998743125 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7ff6800e7cb0 con 0x7ff68c103ad0 2024-09-21T05:53:43.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.481+0000 7ff68bfff640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff67c0b6560 0x7ff67c0b8a70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff68c102cb0 tx=0x7ff678005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.483+0000 7ff689ffb640 1 -- 172.21.15.7:0/1998743125 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff6800ae440 con 0x7ff68c103ad0 2024-09-21T05:53:43.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.699+0000 7ff692e38640 1 -- 172.21.15.7:0/1998743125 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7ff68c063800 con 0x7ff67c0b6560 2024-09-21T05:53:43.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.706+0000 7ff689ffb640 1 -- 172.21.15.7:0/1998743125 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7ff68c063800 con 0x7ff67c0b6560 2024-09-21T05:53:43.708 INFO:teuthology.orchestra.run.smithi007.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T05:53:42", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-21T05:53:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.708+0000 7ff692e38640 1 -- 172.21.15.7:0/1998743125 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff67c0b6560 msgr2=0x7ff67c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.708+0000 7ff692e38640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff67c0b6560 0x7ff67c0b8a70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff68c102cb0 tx=0x7ff678005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.708+0000 7ff692e38640 1 -- 172.21.15.7:0/1998743125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff68c103ad0 msgr2=0x7ff68c19a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.708+0000 7ff692e38640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff68c103ad0 0x7ff68c19a3f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff68000e9f0 tx=0x7ff68000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.709+0000 7ff692e38640 1 -- 172.21.15.7:0/1998743125 shutdown_connections 2024-09-21T05:53:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.709+0000 7ff692e38640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff67c0b6560 0x7ff67c0b8a70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.709+0000 7ff692e38640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff68c109d50 0x7ff68c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.709+0000 7ff692e38640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff68c109400 0x7ff68c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.709+0000 7ff692e38640 1 --2- 172.21.15.7:0/1998743125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff68c103ad0 0x7ff68c19a3f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.709+0000 7ff692e38640 1 -- 172.21.15.7:0/1998743125 >> 172.21.15.7:0/1998743125 conn(0x7ff68c0ff4d0 msgr2=0x7ff68c106970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.709+0000 7ff692e38640 1 -- 172.21.15.7:0/1998743125 shutdown_connections 2024-09-21T05:53:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.709+0000 7ff692e38640 1 -- 172.21.15.7:0/1998743125 wait complete. 2024-09-21T05:53:43.722 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T05:53:43.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.837+0000 7f7f91f0b640 1 -- 172.21.15.7:0/3706189873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f8c104910 msgr2=0x7f7f8c104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.837+0000 7f7f91f0b640 1 --2- 172.21.15.7:0/3706189873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f8c104910 0x7f7f8c104d20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009900 tx=0x7f7f7c02a410 comp rx=0 tx=0).stop 2024-09-21T05:53:43.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.837+0000 7f7f91f0b640 1 -- 172.21.15.7:0/3706189873 shutdown_connections 2024-09-21T05:53:43.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.837+0000 7f7f91f0b640 1 --2- 172.21.15.7:0/3706189873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f8c10dd70 0x7f7f8c110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.837+0000 7f7f91f0b640 1 --2- 172.21.15.7:0/3706189873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f8c105260 0x7f7f8c10d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.837+0000 7f7f91f0b640 1 --2- 172.21.15.7:0/3706189873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f8c104910 0x7f7f8c104d20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.837+0000 7f7f91f0b640 1 -- 172.21.15.7:0/3706189873 >> 172.21.15.7:0/3706189873 conn(0x7f7f8c0fe3c0 msgr2=0x7f7f8c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:43.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.837+0000 7f7f91f0b640 1 -- 172.21.15.7:0/3706189873 shutdown_connections 2024-09-21T05:53:43.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.837+0000 7f7f91f0b640 1 -- 172.21.15.7:0/3706189873 wait complete. 2024-09-21T05:53:43.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.838+0000 7f7f91f0b640 1 Processor -- start 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.838+0000 7f7f91f0b640 1 -- start start 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.838+0000 7f7f91f0b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f8c104910 0x7f7f8c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.838+0000 7f7f91f0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f8c105260 0x7f7f8c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.838+0000 7f7f91f0b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f8c10dd70 0x7f7f8c19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.838+0000 7f7f91f0b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1139f0 con 0x7f7f8c105260 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.838+0000 7f7f91f0b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c113870 con 0x7f7f8c10dd70 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.838+0000 7f7f91f0b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c113b70 con 0x7f7f8c104910 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.838+0000 7f7f83fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f8c105260 0x7f7f8c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.838+0000 7f7f83fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f8c105260 0x7f7f8c19aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33350/0 (socket says 172.21.15.7:33350) 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.838+0000 7f7f83fff640 1 -- 172.21.15.7:0/220608176 learned_addr learned my addr 172.21.15.7:0/220608176 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.838+0000 7f7f8bfff640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f8c10dd70 0x7f7f8c19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.838+0000 7f7f8b7fe640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f8c104910 0x7f7f8c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.839+0000 7f7f83fff640 1 -- 172.21.15.7:0/220608176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f8c104910 msgr2=0x7f7f8c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.839+0000 7f7f83fff640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f8c104910 0x7f7f8c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.839+0000 7f7f83fff640 1 -- 172.21.15.7:0/220608176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f8c10dd70 msgr2=0x7f7f8c19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.839+0000 7f7f83fff640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f8c10dd70 0x7f7f8c19fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.839+0000 7f7f83fff640 1 -- 172.21.15.7:0/220608176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c1a03a0 con 0x7f7f8c105260 2024-09-21T05:53:43.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.839+0000 7f7f83fff640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f8c105260 0x7f7f8c19aa10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400d750 tx=0x7f7f7400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.839+0000 7f7f897fa640 1 -- 172.21.15.7:0/220608176 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74017070 con 0x7f7f8c105260 2024-09-21T05:53:43.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.839+0000 7f7f897fa640 1 -- 172.21.15.7:0/220608176 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f740054d0 con 0x7f7f8c105260 2024-09-21T05:53:43.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.839+0000 7f7f91f0b640 1 -- 172.21.15.7:0/220608176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8c1a0690 con 0x7f7f8c105260 2024-09-21T05:53:43.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.839+0000 7f7f897fa640 1 -- 172.21.15.7:0/220608176 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74004c30 con 0x7f7f8c105260 2024-09-21T05:53:43.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.839+0000 7f7f91f0b640 1 -- 172.21.15.7:0/220608176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f8c1a6e20 con 0x7f7f8c105260 2024-09-21T05:53:43.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.840+0000 7f7f91f0b640 1 -- 172.21.15.7:0/220608176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f8c104d20 con 0x7f7f8c105260 2024-09-21T05:53:43.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.841+0000 7f7f897fa640 1 -- 172.21.15.7:0/220608176 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154528+0+0 (secure 0 0 0) 0x7f7f74004dd0 con 0x7f7f8c105260 2024-09-21T05:53:43.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.843+0000 7f7f897fa640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7f780b6560 0x7f7f780b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.843+0000 7f7f8b7fe640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7f780b6560 0x7f7f780b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.843+0000 7f7f897fa640 1 -- 172.21.15.7:0/220608176 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f7f740e7140 con 0x7f7f8c105260 2024-09-21T05:53:43.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.843+0000 7f7f8b7fe640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7f780b6560 0x7f7f780b8a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c031440 tx=0x7f7f7c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:43.846+0000 7f7f897fa640 1 -- 172.21.15.7:0/220608176 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7f740b1d10 con 0x7f7f8c105260 2024-09-21T05:53:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:43 smithi007 ceph-mon[30983]: pgmap v313: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T05:53:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:43 smithi007 ceph-mon[30983]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:43 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T05:53:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:43 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:53:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:43 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T05:53:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:43 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:53:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:43 smithi007 ceph-mon[30983]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:43.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:43 smithi027 ceph-mon[34364]: pgmap v313: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T05:53:43.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:43 smithi027 ceph-mon[34364]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:43.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:43 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T05:53:43.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:43 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:53:43.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:43 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T05:53:43.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:43 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:53:43.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:43 smithi027 ceph-mon[34364]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:43.979 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:53:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.061+0000 7f7f91f0b640 1 -- 172.21.15.7:0/220608176 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f7f8c107f70 con 0x7f7f780b6560 2024-09-21T05:53:44.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.068+0000 7f7f897fa640 1 -- 172.21.15.7:0/220608176 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f7f8c107f70 con 0x7f7f780b6560 2024-09-21T05:53:44.070 INFO:teuthology.orchestra.run.smithi007.stdout:/ 1m 6m3h 2024-09-21T05:53:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.070+0000 7f7f91f0b640 1 -- 172.21.15.7:0/220608176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7f780b6560 msgr2=0x7f7f780b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.070+0000 7f7f91f0b640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7f780b6560 0x7f7f780b8a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c031440 tx=0x7f7f7c009560 comp rx=0 tx=0).stop 2024-09-21T05:53:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.070+0000 7f7f91f0b640 1 -- 172.21.15.7:0/220608176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f8c105260 msgr2=0x7f7f8c19aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.070+0000 7f7f91f0b640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f8c105260 0x7f7f8c19aa10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400d750 tx=0x7f7f7400dc10 comp rx=0 tx=0).stop 2024-09-21T05:53:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.070+0000 7f7f91f0b640 1 -- 172.21.15.7:0/220608176 shutdown_connections 2024-09-21T05:53:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.070+0000 7f7f91f0b640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7f780b6560 0x7f7f780b8a70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.070+0000 7f7f91f0b640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f8c105260 0x7f7f8c19aa10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.070+0000 7f7f91f0b640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f8c10dd70 0x7f7f8c19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.070+0000 7f7f91f0b640 1 --2- 172.21.15.7:0/220608176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f8c104910 0x7f7f8c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.070+0000 7f7f91f0b640 1 -- 172.21.15.7:0/220608176 >> 172.21.15.7:0/220608176 conn(0x7f7f8c0fe3c0 msgr2=0x7f7f8c107860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.070+0000 7f7f91f0b640 1 -- 172.21.15.7:0/220608176 shutdown_connections 2024-09-21T05:53:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.070+0000 7f7f91f0b640 1 -- 172.21.15.7:0/220608176 wait complete. 2024-09-21T05:53:44.083 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-21T05:53:44.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:43 smithi119 ceph-mon[34833]: pgmap v313: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T05:53:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:43 smithi119 ceph-mon[34833]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:43 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T05:53:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:43 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:53:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:43 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T05:53:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:43 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:53:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:43 smithi119 ceph-mon[34833]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:44.111 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-21T05:53:44.121 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T05:53:44.129 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T05:53:44.130 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T05:53:44.154 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T05:53:44.166 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:53:44.167 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T05:53:44.167 INFO:tasks.workunit:timeout=3h 2024-09-21T05:53:44.167 INFO:tasks.workunit:cleanup=True 2024-09-21T05:53:44.167 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:44.184 INFO:teuthology.orchestra.run.smithi007.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:44.184 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T05:53:44.184 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T05:53:44.185 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:53:44.185 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T05:53:44.185 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 05:52:08.942449817 +0000 2024-09-21T05:53:44.185 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 05:52:08.942449817 +0000 2024-09-21T05:53:44.185 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 05:53:33.062296244 +0000 2024-09-21T05:53:44.185 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-21 05:52:08.942449817 +0000 2024-09-21T05:53:44.185 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:44.185 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T05:53:44.243 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:44.262 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:53:44.319 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T05:53:44.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.778+0000 7f20caeca640 1 -- 172.21.15.7:0/3051141433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20c41062b0 msgr2=0x7f20c41066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:44.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.778+0000 7f20caeca640 1 --2- 172.21.15.7:0/3051141433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20c41062b0 0x7f20c41066c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009900 tx=0x7f20b002a410 comp rx=0 tx=0).stop 2024-09-21T05:53:44.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:44 smithi007 ceph-mon[30983]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:44.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:44 smithi007 ceph-mon[30983]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.778+0000 7f20caeca640 1 -- 172.21.15.7:0/3051141433 shutdown_connections 2024-09-21T05:53:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.778+0000 7f20caeca640 1 --2- 172.21.15.7:0/3051141433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20c41062b0 0x7f20c41066c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.778+0000 7f20caeca640 1 --2- 172.21.15.7:0/3051141433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20c4106c00 0x7f20c4110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.778+0000 7f20caeca640 1 --2- 172.21.15.7:0/3051141433 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20c41020c0 0x7f20c41024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.778+0000 7f20caeca640 1 -- 172.21.15.7:0/3051141433 >> 172.21.15.7:0/3051141433 conn(0x7f20c4079e40 msgr2=0x7f20c407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.778+0000 7f20caeca640 1 -- 172.21.15.7:0/3051141433 shutdown_connections 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.778+0000 7f20caeca640 1 -- 172.21.15.7:0/3051141433 wait complete. 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.779+0000 7f20caeca640 1 Processor -- start 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.779+0000 7f20caeca640 1 -- start start 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.779+0000 7f20caeca640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20c41020c0 0x7f20c419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.779+0000 7f20caeca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20c41062b0 0x7f20c419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.779+0000 7f20caeca640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20c4106c00 0x7f20c419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.779+0000 7f20caeca640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20c4113b00 con 0x7f20c41020c0 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.779+0000 7f20caeca640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f20c4113980 con 0x7f20c4106c00 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.779+0000 7f20caeca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f20c4113c80 con 0x7f20c41062b0 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.779+0000 7f20c8c66640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20c41020c0 0x7f20c419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.779+0000 7f20c8c66640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20c41020c0 0x7f20c419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33368/0 (socket says 172.21.15.7:33368) 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.779+0000 7f20c8c66640 1 -- 172.21.15.7:0/71660984 learned_addr learned my addr 172.21.15.7:0/71660984 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.779+0000 7f20c9467640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20c4106c00 0x7f20c419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.780+0000 7f20c3fff640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20c41062b0 0x7f20c419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.780+0000 7f20c8c66640 1 -- 172.21.15.7:0/71660984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20c41062b0 msgr2=0x7f20c419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.780+0000 7f20c8c66640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20c41062b0 0x7f20c419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.780+0000 7f20c8c66640 1 -- 172.21.15.7:0/71660984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20c4106c00 msgr2=0x7f20c419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.780+0000 7f20c8c66640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20c4106c00 0x7f20c419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.780+0000 7f20c8c66640 1 -- 172.21.15.7:0/71660984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c41a0420 con 0x7f20c41020c0 2024-09-21T05:53:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.780+0000 7f20c3fff640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20c41062b0 0x7f20c419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.780+0000 7f20c8c66640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20c41020c0 0x7f20c419a4b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f20b800e9f0 tx=0x7f20b800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.780+0000 7f20c1ffb640 1 -- 172.21.15.7:0/71660984 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b800cd80 con 0x7f20c41020c0 2024-09-21T05:53:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.780+0000 7f20caeca640 1 -- 172.21.15.7:0/71660984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c41a0710 con 0x7f20c41020c0 2024-09-21T05:53:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.780+0000 7f20c1ffb640 1 -- 172.21.15.7:0/71660984 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b80108e0 con 0x7f20c41020c0 2024-09-21T05:53:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.780+0000 7f20c1ffb640 1 -- 172.21.15.7:0/71660984 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8018980 con 0x7f20c41020c0 2024-09-21T05:53:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.780+0000 7f20caeca640 1 -- 172.21.15.7:0/71660984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c41a6e70 con 0x7f20c41020c0 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.783+0000 7f20d143e740 1 Processor -- start 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.783+0000 7f20d143e740 1 -- start start 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.783+0000 7f20c1ffb640 1 -- 172.21.15.7:0/71660984 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f20b8018b20 con 0x7f20c41020c0 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20d143e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9c0b070 0x55e9f9fb2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20d143e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 0x55e9f9fb2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20d143e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9bea390 0x55e9f9fb30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20d143e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e9f9f28e50 con 0x55e9f9be21b0 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20d143e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e9f9f18280 con 0x55e9f9bea390 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20d143e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e9f9f1c090 con 0x55e9f9c0b070 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20c8c66640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 0x55e9f9fb2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20c8c66640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 0x55e9f9fb2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33374/0 (socket says 172.21.15.7:33374) 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20c8c66640 1 -- 172.21.15.7:0/791442133 learned_addr learned my addr 172.21.15.7:0/791442133 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20c9467640 1 --2- 172.21.15.7:0/791442133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9c0b070 0x55e9f9fb2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20c3fff640 1 --2- 172.21.15.7:0/791442133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9bea390 0x55e9f9fb30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20c8c66640 1 -- 172.21.15.7:0/791442133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9c0b070 msgr2=0x55e9f9fb2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:44.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20c8c66640 1 --2- 172.21.15.7:0/791442133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9c0b070 0x55e9f9fb2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20c8c66640 1 -- 172.21.15.7:0/791442133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9bea390 msgr2=0x55e9f9fb30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:44.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20c8c66640 1 --2- 172.21.15.7:0/791442133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9bea390 0x55e9f9fb30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20c8c66640 1 -- 172.21.15.7:0/791442133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9f9c76650 con 0x55e9f9be21b0 2024-09-21T05:53:44.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.784+0000 7f20c1ffb640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f20b40b65f0 0x7f20b40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.785+0000 7f20c8c66640 1 --2- 172.21.15.7:0/791442133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 0x55e9f9fb2b90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f20b80e51f0 tx=0x7f20b80f0130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ba75bfe829ad9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:44.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.785+0000 7f20c9467640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f20b40b65f0 0x7f20b40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.785+0000 7f20c1ffb640 1 -- 172.21.15.7:0/71660984 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f20b80e79a0 con 0x7f20c41020c0 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.785+0000 7f20aeffd640 1 -- 172.21.15.7:0/791442133 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8026030 con 0x55e9f9be21b0 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.785+0000 7f20aeffd640 1 -- 172.21.15.7:0/791442133 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b80ad440 con 0x55e9f9be21b0 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.785+0000 7f20aeffd640 1 -- 172.21.15.7:0/791442133 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8026030 con 0x55e9f9be21b0 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.786+0000 7f20d143e740 1 -- 172.21.15.7:0/791442133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 msgr2=0x55e9f9fb2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.786+0000 7f20d143e740 1 --2- 172.21.15.7:0/791442133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 0x55e9f9fb2b90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f20b80e51f0 tx=0x7f20b80f0130 comp rx=0 tx=0).stop 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.786+0000 7f20c9467640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f20b40b65f0 0x7f20b40b8b00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f20bc005fd0 tx=0x7f20bc009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.786+0000 7f20d143e740 1 -- 172.21.15.7:0/791442133 shutdown_connections 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.786+0000 7f20d143e740 1 --2- 172.21.15.7:0/791442133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 0x55e9f9fb2b90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.786+0000 7f20d143e740 1 --2- 172.21.15.7:0/791442133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9bea390 0x55e9f9fb30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.786+0000 7f20d143e740 1 --2- 172.21.15.7:0/791442133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9c0b070 0x55e9f9fb2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.786+0000 7f20d143e740 1 -- 172.21.15.7:0/791442133 >> 172.21.15.7:0/791442133 conn(0x55e9f9bff460 msgr2=0x55e9f9fb0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.786+0000 7f20d143e740 1 -- 172.21.15.7:0/791442133 shutdown_connections 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.786+0000 7f20d143e740 1 -- 172.21.15.7:0/791442133 wait complete. 2024-09-21T05:53:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.786+0000 7f20d143e740 1 -- start start 2024-09-21T05:53:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.786+0000 7f20d143e740 1 Processor -- start 2024-09-21T05:53:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20d143e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 0x55e9f9fbdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20d143e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 0x55e9f9fbe270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20d143e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9c0b070 0x55e9f9fce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20d143e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e9f9d79700 con 0x55e9f9be21b0 2024-09-21T05:53:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20d143e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e9f9eb3110 con 0x55e9f9c0b070 2024-09-21T05:53:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20d143e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e9f9fc0dd0 con 0x55e9f9bea390 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20d143e740 10 client.0 _ll_register_callbacks cb 0x55e9f9ecc990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20c8c66640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 0x55e9f9fbdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20c8c66640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 0x55e9f9fbdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33384/0 (socket says 172.21.15.7:33384) 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20c8c66640 1 -- 172.21.15.7:0/1320599545 learned_addr learned my addr 172.21.15.7:0/1320599545 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20c9467640 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9c0b070 0x55e9f9fce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20c3fff640 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 0x55e9f9fbe270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20c8c66640 1 -- 172.21.15.7:0/1320599545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 msgr2=0x55e9f9fbe270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20c8c66640 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 0x55e9f9fbe270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20c8c66640 1 -- 172.21.15.7:0/1320599545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9c0b070 msgr2=0x55e9f9fce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20c8c66640 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9c0b070 0x55e9f9fce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20c8c66640 1 -- 172.21.15.7:0/1320599545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9f9ee0c40 con 0x55e9f9be21b0 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20c3fff640 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 0x55e9f9fbe270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.787+0000 7f20c9467640 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9c0b070 0x55e9f9fce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.788+0000 7f20c8c66640 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 0x55e9f9fbdd30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f20b80a9040 tx=0x7f20b800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14756b5e7fe2bb74 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.788+0000 7f20a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.788+0000 7f20a3fff640 1 -- 172.21.15.7:0/1320599545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b80a9f80 con 0x55e9f9be21b0 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.788+0000 7f20a3fff640 1 -- 172.21.15.7:0/1320599545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f20b80b2190 con 0x55e9f9be21b0 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.788+0000 7f20d143e740 1 -- 172.21.15.7:0/1320599545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20b80ad440 con 0x55e9f9be21b0 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.788+0000 7f20a3fff640 1 -- 172.21.15.7:0/1320599545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f20b80ad0a0 con 0x55e9f9be21b0 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.788+0000 7f20d143e740 10 client.15510 fetch_fsmap learned FSMap version 25 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.788+0000 7f20d143e740 1 -- 172.21.15.7:0/1320599545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e9f9fd0ee0 con 0x55e9f9be21b0 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.788+0000 7f20a3fff640 1 -- 172.21.15.7:0/1320599545 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b80ad440 con 0x55e9f9be21b0 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.788+0000 7f20a3fff640 1 -- 172.21.15.7:0/1320599545 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f20b80c3ae0 con 0x55e9f9be21b0 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.789+0000 7f20d143e740 10 client.15510 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.789+0000 7f20d143e740 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.789+0000 7f20d143e740 20 client.15510 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.789+0000 7f20d143e740 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e9f9bc99f0 0x55e9f9fd4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.789+0000 7f20d143e740 4 client.15510 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:53:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.789+0000 7f20d143e740 1 -- 172.21.15.7:0/1320599545 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9f9f2ada0 con 0x55e9f9bc99f0 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.789+0000 7f20c3fff640 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e9f9bc99f0 0x55e9f9fd4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.789+0000 7f20a3fff640 10 client.15510 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.789+0000 7f20c3fff640 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e9f9bc99f0 0x55e9f9fd4240 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25632cc70e95702c server_cookie=ee3beb9286e1d65a in_seq=0 out_seq=0 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20a3fff640 1 -- 172.21.15.7:0/1320599545 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e9f9f2ada0 con 0x55e9f9bc99f0 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20a3fff640 10 client.15510 handle_command_reply: tid=0 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20d143e740 1 client.15510 shutdown 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20d143e740 1 -- 172.21.15.7:0/1320599545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 msgr2=0x55e9f9fbdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20d143e740 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 0x55e9f9fbdd30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f20b80a9040 tx=0x7f20b800cf20 comp rx=0 tx=0).stop 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20d143e740 1 -- 172.21.15.7:0/1320599545 shutdown_connections 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20d143e740 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e9f9bc99f0 0x55e9f9fd4240 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20d143e740 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9c0b070 0x55e9f9fce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20d143e740 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 0x55e9f9fbe270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20d143e740 1 --2- 172.21.15.7:0/1320599545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9be21b0 0x55e9f9fbdd30 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20a3fff640 0 client.15510 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20d143e740 1 -- 172.21.15.7:0/1320599545 >> 172.21.15.7:0/1320599545 conn(0x55e9f9bff460 msgr2=0x55e9f9fb57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:44.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20d143e740 1 -- 172.21.15.7:0/1320599545 shutdown_connections 2024-09-21T05:53:44.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.790+0000 7f20d143e740 1 -- 172.21.15.7:0/1320599545 wait complete. 2024-09-21T05:53:44.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.791+0000 7f20d143e740 20 client.15510 trim_cache size 0 max 16384 2024-09-21T05:53:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.808+0000 7f20d143e740 1 Processor -- start 2024-09-21T05:53:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.808+0000 7f20d143e740 1 -- start start 2024-09-21T05:53:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.808+0000 7f20d143e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 0x55e9f9fbcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.808+0000 7f20d143e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9c0b070 0x55e9f9fbf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.808+0000 7f20d143e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9b9eda0 0x55e9f9fafb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.808+0000 7f20d143e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20c41afcd0 con 0x55e9f9b9eda0 2024-09-21T05:53:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.808+0000 7f20d143e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f20c41ad5a0 con 0x55e9f9c0b070 2024-09-21T05:53:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.808+0000 7f20d143e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f20c41ab3f0 con 0x55e9f9bea390 2024-09-21T05:53:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.808+0000 7f20c9467640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9b9eda0 0x55e9f9fafb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.809+0000 7f20c9467640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9b9eda0 0x55e9f9fafb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33392/0 (socket says 172.21.15.7:33392) 2024-09-21T05:53:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.809+0000 7f20c9467640 1 -- 172.21.15.7:0/1685023937 learned_addr learned my addr 172.21.15.7:0/1685023937 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.809+0000 7f20c3fff640 1 --2- 172.21.15.7:0/1685023937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9c0b070 0x55e9f9fbf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.809+0000 7f20c8c66640 1 --2- 172.21.15.7:0/1685023937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 0x55e9f9fbcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.809+0000 7f20c9467640 1 -- 172.21.15.7:0/1685023937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 msgr2=0x55e9f9fbcf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.809+0000 7f20c9467640 1 --2- 172.21.15.7:0/1685023937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 0x55e9f9fbcf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.809+0000 7f20c9467640 1 -- 172.21.15.7:0/1685023937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9c0b070 msgr2=0x55e9f9fbf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.809+0000 7f20c9467640 1 --2- 172.21.15.7:0/1685023937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9c0b070 0x55e9f9fbf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.809+0000 7f20c9467640 1 -- 172.21.15.7:0/1685023937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9f9fb4500 con 0x55e9f9b9eda0 2024-09-21T05:53:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.809+0000 7f20c9467640 1 --2- 172.21.15.7:0/1685023937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9b9eda0 0x55e9f9fafb70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f20bc004380 tx=0x7f20bc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad18dc0841ca710e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:44.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.809+0000 7f20ae7fc640 1 -- 172.21.15.7:0/1685023937 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc004b20 con 0x55e9f9b9eda0 2024-09-21T05:53:44.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.809+0000 7f20ae7fc640 1 -- 172.21.15.7:0/1685023937 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20bc004cc0 con 0x55e9f9b9eda0 2024-09-21T05:53:44.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.809+0000 7f20ae7fc640 1 -- 172.21.15.7:0/1685023937 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc005730 con 0x55e9f9b9eda0 2024-09-21T05:53:44.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.810+0000 7f20d143e740 1 -- 172.21.15.7:0/1685023937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9b9eda0 msgr2=0x55e9f9fafb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:44.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.810+0000 7f20d143e740 1 --2- 172.21.15.7:0/1685023937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9b9eda0 0x55e9f9fafb70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f20bc004380 tx=0x7f20bc01a000 comp rx=0 tx=0).stop 2024-09-21T05:53:44.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.810+0000 7f20d143e740 1 -- 172.21.15.7:0/1685023937 shutdown_connections 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.810+0000 7f20d143e740 1 --2- 172.21.15.7:0/1685023937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9b9eda0 0x55e9f9fafb70 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.810+0000 7f20d143e740 1 --2- 172.21.15.7:0/1685023937 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9c0b070 0x55e9f9fbf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.810+0000 7f20d143e740 1 --2- 172.21.15.7:0/1685023937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 0x55e9f9fbcf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.810+0000 7f20d143e740 1 -- 172.21.15.7:0/1685023937 >> 172.21.15.7:0/1685023937 conn(0x55e9f9bff460 msgr2=0x55e9f9fbf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.810+0000 7f20d143e740 1 -- 172.21.15.7:0/1685023937 shutdown_connections 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.810+0000 7f20d143e740 1 -- 172.21.15.7:0/1685023937 wait complete. 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.810+0000 7f20d143e740 1 -- start start 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.811+0000 7f20d143e740 1 Processor -- start 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.811+0000 7f20d143e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9b9eda0 0x55e9f9fd78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.811+0000 7f20d143e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 0x55e9f9fd4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.811+0000 7f20d143e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9c0b070 0x55e9f9fd52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.811+0000 7f20d143e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20c41aba60 con 0x55e9f9c0b070 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.811+0000 7f20d143e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f20c41aced0 con 0x55e9f9b9eda0 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.811+0000 7f20d143e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f20c41ac130 con 0x55e9f9bea390 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.811+0000 7f20d143e740 10 client.0 _ll_register_callbacks cb 0x7f20b8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.811+0000 7f20c9467640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9c0b070 0x55e9f9fd52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.811+0000 7f20c9467640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9c0b070 0x55e9f9fd52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33406/0 (socket says 172.21.15.7:33406) 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.811+0000 7f20c9467640 1 -- 172.21.15.7:0/3294220848 learned_addr learned my addr 172.21.15.7:0/3294220848 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.811+0000 7f20c3fff640 1 --2- 172.21.15.7:0/3294220848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 0x55e9f9fd4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.811+0000 7f20c8c66640 1 --2- 172.21.15.7:0/3294220848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9b9eda0 0x55e9f9fd78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20c9467640 1 -- 172.21.15.7:0/3294220848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 msgr2=0x55e9f9fd4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20c9467640 1 --2- 172.21.15.7:0/3294220848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 0x55e9f9fd4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20c9467640 1 -- 172.21.15.7:0/3294220848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9b9eda0 msgr2=0x55e9f9fd78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20c9467640 1 --2- 172.21.15.7:0/3294220848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9b9eda0 0x55e9f9fd78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20c9467640 1 -- 172.21.15.7:0/3294220848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9f9fd58b0 con 0x55e9f9c0b070 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20c9467640 1 --2- 172.21.15.7:0/3294220848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9c0b070 0x55e9f9fd52c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009f50 tx=0x7f20bc004050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fcd687d2dea707 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20a3fff640 1 -- 172.21.15.7:0/3294220848 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc00fa60 con 0x55e9f9c0b070 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20a3fff640 1 -- 172.21.15.7:0/3294220848 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f20bc017040 con 0x55e9f9c0b070 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20d143e740 1 -- 172.21.15.7:0/3294220848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20bc004cc0 con 0x55e9f9c0b070 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20a3fff640 1 -- 172.21.15.7:0/3294220848 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f20bc00fc00 con 0x55e9f9c0b070 2024-09-21T05:53:44.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20d143e740 10 client.15516 fetch_fsmap learned FSMap version 25 2024-09-21T05:53:44.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20d143e740 1 -- 172.21.15.7:0/3294220848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e9fa03e770 con 0x55e9f9c0b070 2024-09-21T05:53:44.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.812+0000 7f20a3fff640 1 -- 172.21.15.7:0/3294220848 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20bc004cc0 con 0x55e9f9c0b070 2024-09-21T05:53:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.813+0000 7f20a3fff640 1 -- 172.21.15.7:0/3294220848 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f20bc01d630 con 0x55e9f9c0b070 2024-09-21T05:53:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.813+0000 7f20d143e740 10 client.15516 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:53:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.813+0000 7f20d143e740 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:53:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.813+0000 7f20d143e740 20 client.15516 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.813+0000 7f20d143e740 1 --2- 172.21.15.7:0/3294220848 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e9fa03ee20 0x55e9fa041240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.813+0000 7f20d143e740 4 client.15516 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.813+0000 7f20d143e740 1 -- 172.21.15.7:0/3294220848 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e9f9f26850 con 0x55e9fa03ee20 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.813+0000 7f20c8c66640 1 --2- 172.21.15.7:0/3294220848 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e9fa03ee20 0x55e9fa041240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.813+0000 7f20c8c66640 1 --2- 172.21.15.7:0/3294220848 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e9fa03ee20 0x55e9fa041240 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5df9026d9671c8e server_cookie=d0bf9fe3e6394a85 in_seq=0 out_seq=0 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.813+0000 7f20a3fff640 10 client.15516 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20a3fff640 1 -- 172.21.15.7:0/3294220848 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55e9f9f26850 con 0x55e9fa03ee20 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20a3fff640 10 client.15516 handle_command_reply: tid=0 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20d143e740 1 client.15516 shutdown 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20d143e740 1 -- 172.21.15.7:0/3294220848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9c0b070 msgr2=0x55e9f9fd52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20d143e740 1 --2- 172.21.15.7:0/3294220848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9c0b070 0x55e9f9fd52c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009f50 tx=0x7f20bc004050 comp rx=0 tx=0).stop 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20d143e740 1 -- 172.21.15.7:0/3294220848 shutdown_connections 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20d143e740 1 --2- 172.21.15.7:0/3294220848 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e9fa03ee20 0x55e9fa041240 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20d143e740 1 --2- 172.21.15.7:0/3294220848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9f9c0b070 0x55e9f9fd52c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20d143e740 1 --2- 172.21.15.7:0/3294220848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e9f9bea390 0x55e9f9fd4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20d143e740 1 --2- 172.21.15.7:0/3294220848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e9f9b9eda0 0x55e9f9fd78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20d143e740 1 -- 172.21.15.7:0/3294220848 >> 172.21.15.7:0/3294220848 conn(0x55e9f9bff460 msgr2=0x55e9f9fb6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20a3fff640 0 client.15516 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20d143e740 1 -- 172.21.15.7:0/3294220848 shutdown_connections 2024-09-21T05:53:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20d143e740 1 -- 172.21.15.7:0/3294220848 wait complete. 2024-09-21T05:53:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.814+0000 7f20d143e740 20 client.15516 trim_cache size 0 max 16384 2024-09-21T05:53:44.820 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:53:44.820 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T05:53:44.820 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T05:53:44.820 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:53:44.820 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:53:44.820 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "f1184167-1a52-4b53-a7c1-bf937ae62179", 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:53:44.821 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:53:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.815+0000 7f20caeca640 1 -- 172.21.15.7:0/71660984 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f20b40b65f0 msgr2=0x7f20b40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.815+0000 7f20caeca640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f20b40b65f0 0x7f20b40b8b00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f20bc005fd0 tx=0x7f20bc009500 comp rx=0 tx=0).stop 2024-09-21T05:53:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.815+0000 7f20caeca640 1 -- 172.21.15.7:0/71660984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20c41020c0 msgr2=0x7f20c419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.815+0000 7f20caeca640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20c41020c0 0x7f20c419a4b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f20b800e9f0 tx=0x7f20b800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.815+0000 7f20caeca640 1 -- 172.21.15.7:0/71660984 shutdown_connections 2024-09-21T05:53:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.815+0000 7f20caeca640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f20b40b65f0 0x7f20b40b8b00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.815+0000 7f20caeca640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20c4106c00 0x7f20c419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.815+0000 7f20caeca640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20c41062b0 0x7f20c419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.815+0000 7f20caeca640 1 --2- 172.21.15.7:0/71660984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20c41020c0 0x7f20c419a4b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.815+0000 7f20caeca640 1 -- 172.21.15.7:0/71660984 >> 172.21.15.7:0/71660984 conn(0x7f20c4079e40 msgr2=0x7f20c4107630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.815+0000 7f20caeca640 1 -- 172.21.15.7:0/71660984 shutdown_connections 2024-09-21T05:53:44.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:53:44.815+0000 7f20caeca640 1 -- 172.21.15.7:0/71660984 wait complete. 2024-09-21T05:53:44.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:44 smithi027 ceph-mon[34364]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:44.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:44 smithi027 ceph-mon[34364]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:45.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:44 smithi119 ceph-mon[34833]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:45.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:44 smithi119 ceph-mon[34833]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:45.537 INFO:tasks.cephfs.filesystem:scrub status for tag:f1184167-1a52-4b53-a7c1-bf937ae62179 - {'path': '/', 'tag': 'f1184167-1a52-4b53-a7c1-bf937ae62179', 'options': 'recursive,force'} 2024-09-21T05:53:45.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:45 smithi007 ceph-mon[30983]: pgmap v314: 97 pgs: 97 active+clean; 1.0 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 102 KiB/s wr, 43 op/s 2024-09-21T05:53:45.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:45 smithi007 ceph-mon[30983]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T05:53:45.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:45 smithi027 ceph-mon[34364]: pgmap v314: 97 pgs: 97 active+clean; 1.0 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 102 KiB/s wr, 43 op/s 2024-09-21T05:53:45.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:45 smithi027 ceph-mon[34364]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T05:53:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:45 smithi119 ceph-mon[34833]: pgmap v314: 97 pgs: 97 active+clean; 1.0 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 102 KiB/s wr, 43 op/s 2024-09-21T05:53:46.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:45 smithi119 ceph-mon[34833]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T05:53:47.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:47 smithi027 ceph-mon[34364]: pgmap v315: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 50 op/s 2024-09-21T05:53:48.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:47 smithi007 ceph-mon[30983]: pgmap v315: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 50 op/s 2024-09-21T05:53:48.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:47 smithi119 ceph-mon[34833]: pgmap v315: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 50 op/s 2024-09-21T05:53:49.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:49 smithi027 ceph-mon[34364]: pgmap v316: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T05:53:50.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:49 smithi007 ceph-mon[30983]: pgmap v316: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T05:53:50.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:49 smithi119 ceph-mon[34833]: pgmap v316: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T05:53:51.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:51 smithi027 ceph-mon[34364]: pgmap v317: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T05:53:52.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:51 smithi007 ceph-mon[30983]: pgmap v317: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T05:53:52.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:51 smithi119 ceph-mon[34833]: pgmap v317: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T05:53:53.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:53 smithi027 ceph-mon[34364]: pgmap v318: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T05:53:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:53 smithi007 ceph-mon[30983]: pgmap v318: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T05:53:54.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:53 smithi119 ceph-mon[34833]: pgmap v318: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T05:53:55.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:55 smithi007 ceph-mon[30983]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T05:53:55.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:55 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:53:55.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:55 smithi027 ceph-mon[34364]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T05:53:55.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:55 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:53:56.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:55 smithi119 ceph-mon[34833]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T05:53:56.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:55 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:53:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.300+0000 7f711d230640 1 -- 172.21.15.7:0/3875814583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7118103ad0 msgr2=0x7f7118103ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.300+0000 7f711d230640 1 --2- 172.21.15.7:0/3875814583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7118103ad0 0x7f7118103ee0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7108009900 tx=0x7f710802a410 comp rx=0 tx=0).stop 2024-09-21T05:53:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.300+0000 7f711d230640 1 -- 172.21.15.7:0/3875814583 shutdown_connections 2024-09-21T05:53:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.300+0000 7f711d230640 1 --2- 172.21.15.7:0/3875814583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7118109d50 0x7f7118110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.300+0000 7f711d230640 1 --2- 172.21.15.7:0/3875814583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7118109400 0x7f7118109810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.300+0000 7f711d230640 1 --2- 172.21.15.7:0/3875814583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7118103ad0 0x7f7118103ee0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.300+0000 7f711d230640 1 -- 172.21.15.7:0/3875814583 >> 172.21.15.7:0/3875814583 conn(0x7f71180ff4d0 msgr2=0x7f7118101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.300+0000 7f711d230640 1 -- 172.21.15.7:0/3875814583 shutdown_connections 2024-09-21T05:53:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.300+0000 7f711d230640 1 -- 172.21.15.7:0/3875814583 wait complete. 2024-09-21T05:53:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.301+0000 7f711d230640 1 Processor -- start 2024-09-21T05:53:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.301+0000 7f711d230640 1 -- start start 2024-09-21T05:53:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.301+0000 7f711d230640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7118103ad0 0x7f711819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.301+0000 7f711d230640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7118109400 0x7f711819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.301+0000 7f711d230640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7118109d50 0x7f711819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.301+0000 7f711d230640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7118113a10 con 0x7f7118109400 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.301+0000 7f711d230640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7118113890 con 0x7f7118103ad0 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.301+0000 7f711d230640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7118113b90 con 0x7f7118109d50 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.301+0000 7f711659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7118109400 0x7f711819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.301+0000 7f711659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7118109400 0x7f711819aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42692/0 (socket says 172.21.15.7:42692) 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.301+0000 7f711659c640 1 -- 172.21.15.7:0/3239279236 learned_addr learned my addr 172.21.15.7:0/3239279236 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.301+0000 7f7116d9d640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7118103ad0 0x7f711819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.301+0000 7f711759e640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7118109d50 0x7f711819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.302+0000 7f711659c640 1 -- 172.21.15.7:0/3239279236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7118109d50 msgr2=0x7f711819fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.302+0000 7f711659c640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7118109d50 0x7f711819fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.302+0000 7f711659c640 1 -- 172.21.15.7:0/3239279236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7118103ad0 msgr2=0x7f711819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.302+0000 7f711659c640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7118103ad0 0x7f711819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.302+0000 7f711659c640 1 -- 172.21.15.7:0/3239279236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71181a0440 con 0x7f7118109400 2024-09-21T05:53:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.302+0000 7f711659c640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7118109400 0x7f711819aab0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f710c00e9c0 tx=0x7f710c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.302+0000 7f70fffff640 1 -- 172.21.15.7:0/3239279236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c00ccc0 con 0x7f7118109400 2024-09-21T05:53:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.302+0000 7f711d230640 1 -- 172.21.15.7:0/3239279236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71181a0730 con 0x7f7118109400 2024-09-21T05:53:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.302+0000 7f70fffff640 1 -- 172.21.15.7:0/3239279236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f710c0054d0 con 0x7f7118109400 2024-09-21T05:53:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.302+0000 7f711d230640 1 -- 172.21.15.7:0/3239279236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71181a6ec0 con 0x7f7118109400 2024-09-21T05:53:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.302+0000 7f70fffff640 1 -- 172.21.15.7:0/3239279236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c018430 con 0x7f7118109400 2024-09-21T05:53:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f712427b740 1 Processor -- start 2024-09-21T05:53:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f712427b740 1 -- start start 2024-09-21T05:53:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f70fffff640 1 -- 172.21.15.7:0/3239279236 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 154585+0+0 (secure 0 0 0) 0x7f710c0185d0 con 0x7f7118109400 2024-09-21T05:53:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f712427b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 0x562f0a3f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f712427b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a0242f0 0x562f0a3f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f712427b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a02c4d0 0x562f0a3f3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f712427b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f0a3676f0 con 0x562f0a0242f0 2024-09-21T05:53:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f712427b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562f0a356b20 con 0x562f0a04d1b0 2024-09-21T05:53:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f712427b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562f0a35a930 con 0x562f0a02c4d0 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f7116d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a0242f0 0x562f0a3f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f7116d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a0242f0 0x562f0a3f2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42696/0 (socket says 172.21.15.7:42696) 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f7116d9d640 1 -- 172.21.15.7:0/971220743 learned_addr learned my addr 172.21.15.7:0/971220743 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f711759e640 1 --2- 172.21.15.7:0/971220743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 0x562f0a3f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f711659c640 1 --2- 172.21.15.7:0/971220743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a02c4d0 0x562f0a3f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f7116d9d640 1 -- 172.21.15.7:0/971220743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a02c4d0 msgr2=0x562f0a3f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f7116d9d640 1 --2- 172.21.15.7:0/971220743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a02c4d0 0x562f0a3f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f7116d9d640 1 -- 172.21.15.7:0/971220743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 msgr2=0x562f0a3f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f7116d9d640 1 --2- 172.21.15.7:0/971220743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 0x562f0a3f29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f7116d9d640 1 -- 172.21.15.7:0/971220743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0a31c530 con 0x562f0a0242f0 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.305+0000 7f711659c640 1 --2- 172.21.15.7:0/971220743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a02c4d0 0x562f0a3f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.306+0000 7f7116d9d640 1 --2- 172.21.15.7:0/971220743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a0242f0 0x562f0a3f2ef0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7108009900 tx=0x7f7108032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d3db94469cd687 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.306+0000 7f70fffff640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f71000b65f0 0x7f71000b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.306+0000 7f70fd7fa640 1 -- 172.21.15.7:0/971220743 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108040070 con 0x562f0a0242f0 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.306+0000 7f70fd7fa640 1 -- 172.21.15.7:0/971220743 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7108004030 con 0x562f0a0242f0 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.306+0000 7f711759e640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f71000b65f0 0x7f71000b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.306+0000 7f70fd7fa640 1 -- 172.21.15.7:0/971220743 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108035040 con 0x562f0a0242f0 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.306+0000 7f70fffff640 1 -- 172.21.15.7:0/3239279236 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f710c0e7b10 con 0x7f7118109400 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.307+0000 7f712427b740 1 -- 172.21.15.7:0/971220743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a0242f0 msgr2=0x562f0a3f2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.307+0000 7f711759e640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f71000b65f0 0x7f71000b8b00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7110005fd0 tx=0x7f7110009740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.307+0000 7f712427b740 1 --2- 172.21.15.7:0/971220743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a0242f0 0x562f0a3f2ef0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7108009900 tx=0x7f7108032c40 comp rx=0 tx=0).stop 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.307+0000 7f712427b740 1 -- 172.21.15.7:0/971220743 shutdown_connections 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.307+0000 7f712427b740 1 --2- 172.21.15.7:0/971220743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a0242f0 0x562f0a3f2ef0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.307+0000 7f712427b740 1 --2- 172.21.15.7:0/971220743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a02c4d0 0x562f0a3f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.307+0000 7f712427b740 1 --2- 172.21.15.7:0/971220743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 0x562f0a3f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.307+0000 7f712427b740 1 -- 172.21.15.7:0/971220743 >> 172.21.15.7:0/971220743 conn(0x562f0a041300 msgr2=0x562f0a3f08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.307+0000 7f712427b740 1 -- 172.21.15.7:0/971220743 shutdown_connections 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.307+0000 7f712427b740 1 -- 172.21.15.7:0/971220743 wait complete. 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.307+0000 7f712427b740 1 -- start start 2024-09-21T05:53:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.307+0000 7f712427b740 1 Processor -- start 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f712427b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a0242f0 0x562f0a4024a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f712427b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a4029e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f712427b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a04d1b0 0x562f0a40e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f712427b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f0a28eab0 con 0x562f0a02c4d0 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f712427b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562f0a2fc730 con 0x562f0a0242f0 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f712427b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562f0a4054b0 con 0x562f0a04d1b0 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f712427b740 10 client.0 _ll_register_callbacks cb 0x562f0a3506b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f711659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a4029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f711659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a4029e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42704/0 (socket says 172.21.15.7:42704) 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f711659c640 1 -- 172.21.15.7:0/4087483080 learned_addr learned my addr 172.21.15.7:0/4087483080 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f7116d9d640 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a0242f0 0x562f0a4024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f711759e640 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a04d1b0 0x562f0a40e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f711659c640 1 -- 172.21.15.7:0/4087483080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a04d1b0 msgr2=0x562f0a40e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f711659c640 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a04d1b0 0x562f0a40e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f711659c640 1 -- 172.21.15.7:0/4087483080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a0242f0 msgr2=0x562f0a4024a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f711659c640 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a0242f0 0x562f0a4024a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f711659c640 1 -- 172.21.15.7:0/4087483080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f0a0b8790 con 0x562f0a02c4d0 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f711759e640 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a04d1b0 0x562f0a40e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f711659c640 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a4029e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f710c0aa070 tx=0x7f710c0ad210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e20388a5240f0be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.308+0000 7f70faff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f70faff5640 1 -- 172.21.15.7:0/4087483080 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c0ad5b0 con 0x562f0a02c4d0 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f70faff5640 1 -- 172.21.15.7:0/4087483080 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f710c0a93f0 con 0x562f0a02c4d0 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f712427b740 1 -- 172.21.15.7:0/4087483080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7108004030 con 0x562f0a02c4d0 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f70faff5640 1 -- 172.21.15.7:0/4087483080 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f710c005680 con 0x562f0a02c4d0 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f712427b740 10 client.15528 fetch_fsmap learned FSMap version 25 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f712427b740 1 -- 172.21.15.7:0/4087483080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562f0a131620 con 0x562f0a02c4d0 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f70faff5640 1 -- 172.21.15.7:0/4087483080 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7108004030 con 0x562f0a02c4d0 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f70faff5640 1 -- 172.21.15.7:0/4087483080 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f710c0a95f0 con 0x562f0a02c4d0 2024-09-21T05:53:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f712427b740 10 client.15528 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:53:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f712427b740 10 client.15528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:53:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f712427b740 20 client.15528 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f712427b740 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562f0a00bd80 0x562f0a4145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f712427b740 4 client.15528 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:53:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f712427b740 1 -- 172.21.15.7:0/4087483080 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f0a369640 con 0x562f0a00bd80 2024-09-21T05:53:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.309+0000 7f7116d9d640 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562f0a00bd80 0x562f0a4145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.310+0000 7f70faff5640 10 client.15528 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.310+0000 7f7116d9d640 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562f0a00bd80 0x562f0a4145c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4635b6adc802e544 server_cookie=3f295c496c2f0dd5 in_seq=0 out_seq=0 2024-09-21T05:53:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f70faff5640 1 -- 172.21.15.7:0/4087483080 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562f0a369640 con 0x562f0a00bd80 2024-09-21T05:53:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f70faff5640 10 client.15528 handle_command_reply: tid=0 2024-09-21T05:53:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f712427b740 1 client.15528 shutdown 2024-09-21T05:53:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f712427b740 1 -- 172.21.15.7:0/4087483080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 msgr2=0x562f0a4029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f712427b740 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a4029e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f710c0aa070 tx=0x7f710c0ad210 comp rx=0 tx=0).stop 2024-09-21T05:53:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f712427b740 1 -- 172.21.15.7:0/4087483080 shutdown_connections 2024-09-21T05:53:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f712427b740 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562f0a00bd80 0x562f0a4145c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f712427b740 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a4029e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f70faff5640 0 client.15528 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f712427b740 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a04d1b0 0x562f0a40e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f712427b740 1 --2- 172.21.15.7:0/4087483080 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a0242f0 0x562f0a4024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f712427b740 1 -- 172.21.15.7:0/4087483080 >> 172.21.15.7:0/4087483080 conn(0x562f0a041300 msgr2=0x562f0a3f43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f712427b740 1 -- 172.21.15.7:0/4087483080 shutdown_connections 2024-09-21T05:53:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f712427b740 1 -- 172.21.15.7:0/4087483080 wait complete. 2024-09-21T05:53:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.311+0000 7f712427b740 20 client.15528 trim_cache size 0 max 16384 2024-09-21T05:53:57.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:53:57.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:53:57.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f712427b740 1 Processor -- start 2024-09-21T05:53:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f712427b740 1 -- start start 2024-09-21T05:53:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f712427b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a0242f0 0x562f0a402980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f712427b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a40e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f712427b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 0x562f0a3ff670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f712427b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f71181afbd0 con 0x562f0a02c4d0 2024-09-21T05:53:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f712427b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f71181ad4a0 con 0x562f0a04d1b0 2024-09-21T05:53:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f712427b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f71181ab2f0 con 0x562f0a0242f0 2024-09-21T05:53:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f711659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a40e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f711659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a40e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42712/0 (socket says 172.21.15.7:42712) 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f711659c640 1 -- 172.21.15.7:0/683948284 learned_addr learned my addr 172.21.15.7:0/683948284 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f7116d9d640 1 --2- 172.21.15.7:0/683948284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a0242f0 0x562f0a402980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f711659c640 1 -- 172.21.15.7:0/683948284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a0242f0 msgr2=0x562f0a402980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f711659c640 1 --2- 172.21.15.7:0/683948284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a0242f0 0x562f0a402980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f711659c640 1 -- 172.21.15.7:0/683948284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 msgr2=0x562f0a3ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f711759e640 1 --2- 172.21.15.7:0/683948284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 0x562f0a3ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f711659c640 1 --2- 172.21.15.7:0/683948284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 0x562f0a3ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.326+0000 7f711659c640 1 -- 172.21.15.7:0/683948284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0a3f37a0 con 0x562f0a02c4d0 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.327+0000 7f711759e640 1 --2- 172.21.15.7:0/683948284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 0x562f0a3ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.327+0000 7f711659c640 1 --2- 172.21.15.7:0/683948284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a40e740 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f710c004650 tx=0x7f710c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd647f5dcc50486 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.327+0000 7f70fcff9640 1 -- 172.21.15.7:0/683948284 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c0ad5b0 con 0x562f0a02c4d0 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.327+0000 7f70fcff9640 1 -- 172.21.15.7:0/683948284 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f710c0ae1a0 con 0x562f0a02c4d0 2024-09-21T05:53:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.327+0000 7f70fcff9640 1 -- 172.21.15.7:0/683948284 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c004fa0 con 0x562f0a02c4d0 2024-09-21T05:53:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 -- 172.21.15.7:0/683948284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 msgr2=0x562f0a40e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 --2- 172.21.15.7:0/683948284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a40e740 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f710c004650 tx=0x7f710c014000 comp rx=0 tx=0).stop 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 -- 172.21.15.7:0/683948284 shutdown_connections 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 --2- 172.21.15.7:0/683948284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a40e740 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 --2- 172.21.15.7:0/683948284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 0x562f0a3ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 --2- 172.21.15.7:0/683948284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a0242f0 0x562f0a402980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 -- 172.21.15.7:0/683948284 >> 172.21.15.7:0/683948284 conn(0x562f0a041300 msgr2=0x562f0a400d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 -- 172.21.15.7:0/683948284 shutdown_connections 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 -- 172.21.15.7:0/683948284 wait complete. 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 -- start start 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 Processor -- start 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a0242f0 0x562f0a406210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a4067f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 0x562f0a476fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f71181ab960 con 0x562f0a02c4d0 2024-09-21T05:53:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f71181acdd0 con 0x562f0a04d1b0 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f71181ac030 con 0x562f0a0242f0 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f712427b740 10 client.0 _ll_register_callbacks cb 0x7f710c0096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.328+0000 7f711659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a4067f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f7116d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a0242f0 0x562f0a406210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f711659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a4067f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42716/0 (socket says 172.21.15.7:42716) 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f711659c640 1 -- 172.21.15.7:0/1971573777 learned_addr learned my addr 172.21.15.7:0/1971573777 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f711759e640 1 --2- 172.21.15.7:0/1971573777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 0x562f0a476fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f711659c640 1 -- 172.21.15.7:0/1971573777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a0242f0 msgr2=0x562f0a406210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f711659c640 1 --2- 172.21.15.7:0/1971573777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a0242f0 0x562f0a406210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f711659c640 1 -- 172.21.15.7:0/1971573777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 msgr2=0x562f0a476fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f711659c640 1 --2- 172.21.15.7:0/1971573777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 0x562f0a476fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f711659c640 1 -- 172.21.15.7:0/1971573777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f0a477660 con 0x562f0a02c4d0 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f711659c640 1 --2- 172.21.15.7:0/1971573777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a4067f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f710c0aa020 tx=0x7f710c0b23e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215466ddd309ba03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f70faff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:53:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f70faff5640 1 -- 172.21.15.7:0/1971573777 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c0ad5b0 con 0x562f0a02c4d0 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f70faff5640 1 -- 172.21.15.7:0/1971573777 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f710c004fa0 con 0x562f0a02c4d0 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f712427b740 1 -- 172.21.15.7:0/1971573777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f710c0ae1a0 con 0x562f0a02c4d0 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f70faff5640 1 -- 172.21.15.7:0/1971573777 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f710c0051a0 con 0x562f0a02c4d0 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f712427b740 10 client.15534 fetch_fsmap learned FSMap version 25 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f712427b740 1 -- 172.21.15.7:0/1971573777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562f0a477660 con 0x562f0a02c4d0 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.329+0000 7f70faff5640 1 -- 172.21.15.7:0/1971573777 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f710c0ae1a0 con 0x562f0a02c4d0 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.330+0000 7f70faff5640 1 -- 172.21.15.7:0/1971573777 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f710c0b3880 con 0x562f0a02c4d0 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.330+0000 7f712427b740 10 client.15534 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.330+0000 7f712427b740 10 client.15534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.330+0000 7f712427b740 20 client.15534 populate_metadata read hostname 'smithi007' 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.330+0000 7f712427b740 1 --2- 172.21.15.7:0/1971573777 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562f09fe11c0 0x562f0a480d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.330+0000 7f712427b740 4 client.15534 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.330+0000 7f712427b740 1 -- 172.21.15.7:0/1971573777 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562f0a3650f0 con 0x562f09fe11c0 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.330+0000 7f7116d9d640 1 --2- 172.21.15.7:0/1971573777 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562f09fe11c0 0x562f0a480d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.330+0000 7f7116d9d640 1 --2- 172.21.15.7:0/1971573777 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562f09fe11c0 0x562f0a480d80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=139097cea57ae2e9 server_cookie=ed0c70c3e350a9f2 in_seq=0 out_seq=0 2024-09-21T05:53:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.330+0000 7f70faff5640 10 client.15534 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:53:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:53:57.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f70faff5640 1 -- 172.21.15.7:0/1971573777 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562f0a3650f0 con 0x562f09fe11c0 2024-09-21T05:53:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f70faff5640 10 client.15534 handle_command_reply: tid=0 2024-09-21T05:53:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f712427b740 1 client.15534 shutdown 2024-09-21T05:53:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f712427b740 1 -- 172.21.15.7:0/1971573777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 msgr2=0x562f0a4067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f712427b740 1 --2- 172.21.15.7:0/1971573777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a4067f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f710c0aa020 tx=0x7f710c0b23e0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f712427b740 1 -- 172.21.15.7:0/1971573777 shutdown_connections 2024-09-21T05:53:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f712427b740 1 --2- 172.21.15.7:0/1971573777 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562f09fe11c0 0x562f0a480d80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f712427b740 1 --2- 172.21.15.7:0/1971573777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f0a02c4d0 0x562f0a4067f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f712427b740 1 --2- 172.21.15.7:0/1971573777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562f0a04d1b0 0x562f0a476fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f70faff5640 0 client.15534 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:53:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f712427b740 1 --2- 172.21.15.7:0/1971573777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f0a0242f0 0x562f0a406210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f712427b740 1 -- 172.21.15.7:0/1971573777 >> 172.21.15.7:0/1971573777 conn(0x562f0a041300 msgr2=0x562f0a3f39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f712427b740 1 -- 172.21.15.7:0/1971573777 shutdown_connections 2024-09-21T05:53:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f712427b740 1 -- 172.21.15.7:0/1971573777 wait complete. 2024-09-21T05:53:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.344+0000 7f712427b740 20 client.15534 trim_cache size 0 max 16384 2024-09-21T05:53:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T05:53:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T05:53:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T05:53:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T05:53:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.345+0000 7f711d230640 1 -- 172.21.15.7:0/3239279236 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f71000b65f0 msgr2=0x7f71000b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.345+0000 7f711d230640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f71000b65f0 0x7f71000b8b00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7110005fd0 tx=0x7f7110009740 comp rx=0 tx=0).stop 2024-09-21T05:53:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.345+0000 7f711d230640 1 -- 172.21.15.7:0/3239279236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7118109400 msgr2=0x7f711819aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.345+0000 7f711d230640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7118109400 0x7f711819aab0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f710c00e9c0 tx=0x7f710c00ee80 comp rx=0 tx=0).stop 2024-09-21T05:53:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.345+0000 7f711d230640 1 -- 172.21.15.7:0/3239279236 shutdown_connections 2024-09-21T05:53:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.345+0000 7f711d230640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f71000b65f0 0x7f71000b8b00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.345+0000 7f711d230640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7118109400 0x7f711819aab0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.345+0000 7f711d230640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7118109d50 0x7f711819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.345+0000 7f711d230640 1 --2- 172.21.15.7:0/3239279236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7118103ad0 0x7f711819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.345+0000 7f711d230640 1 -- 172.21.15.7:0/3239279236 >> 172.21.15.7:0/3239279236 conn(0x7f71180ff4d0 msgr2=0x7f7118108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.345+0000 7f711d230640 1 -- 172.21.15.7:0/3239279236 shutdown_connections 2024-09-21T05:53:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:53:57.345+0000 7f711d230640 1 -- 172.21.15.7:0/3239279236 wait complete. 2024-09-21T05:53:57.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:57.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:53:57.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:53:57.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:53:58.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:58 smithi027 ceph-mon[34364]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 74 KiB/s wr, 17 op/s 2024-09-21T05:53:58.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:53:58 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T05:53:58.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:58 smithi007 ceph-mon[30983]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 74 KiB/s wr, 17 op/s 2024-09-21T05:53:58.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:53:58 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T05:53:58.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:58 smithi119 ceph-mon[34833]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 74 KiB/s wr, 17 op/s 2024-09-21T05:53:58.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:53:58 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T05:54:00.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:00 smithi027 ceph-mon[34364]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T05:54:00.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:00 smithi007 ceph-mon[30983]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T05:54:00.568 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:54:00 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:54:00.354+0000 7f36d37c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:54:00.568 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:54:00 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:54:00.354+0000 7f36d37c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:54:00.568 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:54:00 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:54:00.354+0000 7f36d37c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:54:00.569 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:54:00 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:54:00.354+0000 7f36d37c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:54:00.569 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 05:54:00 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T05:54:00.354+0000 7f36d37c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:54:00.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:00 smithi119 ceph-mon[34833]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T05:54:02.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:02 smithi027 ceph-mon[34364]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T05:54:02.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:02 smithi027 ceph-mon[34364]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T05:54:02.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:02 smithi007 ceph-mon[30983]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T05:54:02.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:02 smithi007 ceph-mon[30983]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T05:54:02.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:02 smithi119 ceph-mon[34833]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T05:54:02.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:02 smithi119 ceph-mon[34833]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T05:54:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:04 smithi027 ceph-mon[34364]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-21T05:54:04.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:04 smithi007 ceph-mon[30983]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-21T05:54:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:04 smithi119 ceph-mon[34833]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-21T05:54:06.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:06 smithi027 ceph-mon[34364]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 25 op/s 2024-09-21T05:54:06.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:06 smithi007 ceph-mon[30983]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 25 op/s 2024-09-21T05:54:06.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:06 smithi119 ceph-mon[34833]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 25 op/s 2024-09-21T05:54:08.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:08 smithi027 ceph-mon[34364]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-09-21T05:54:08.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:08 smithi007 ceph-mon[30983]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-09-21T05:54:08.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:08 smithi119 ceph-mon[34833]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-09-21T05:54:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.452+0000 7f214977b640 1 -- 172.21.15.7:0/2102264927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f214410dd70 msgr2=0x7f2144110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.452+0000 7f214977b640 1 --2- 172.21.15.7:0/2102264927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f214410dd70 0x7f2144110260 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f213c009ca0 tx=0x7f213c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.452+0000 7f214977b640 1 -- 172.21.15.7:0/2102264927 shutdown_connections 2024-09-21T05:54:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.452+0000 7f214977b640 1 --2- 172.21.15.7:0/2102264927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f214410dd70 0x7f2144110260 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.452+0000 7f214977b640 1 --2- 172.21.15.7:0/2102264927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2144105260 0x7f214410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.452+0000 7f214977b640 1 --2- 172.21.15.7:0/2102264927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2144104910 0x7f2144104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.452+0000 7f214977b640 1 -- 172.21.15.7:0/2102264927 >> 172.21.15.7:0/2102264927 conn(0x7f21440fe3c0 msgr2=0x7f2144100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.452+0000 7f214977b640 1 -- 172.21.15.7:0/2102264927 shutdown_connections 2024-09-21T05:54:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.452+0000 7f214977b640 1 -- 172.21.15.7:0/2102264927 wait complete. 2024-09-21T05:54:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.452+0000 7f214977b640 1 Processor -- start 2024-09-21T05:54:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f214977b640 1 -- start start 2024-09-21T05:54:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f214977b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2144104910 0x7f214419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f214977b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2144105260 0x7f214419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f214977b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f214410dd70 0x7f214419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f214977b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21441139d0 con 0x7f2144105260 2024-09-21T05:54:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f214977b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2144113850 con 0x7f2144104910 2024-09-21T05:54:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f214977b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2144113b50 con 0x7f214410dd70 2024-09-21T05:54:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f21427fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2144105260 0x7f214419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f21427fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2144105260 0x7f214419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47032/0 (socket says 172.21.15.7:47032) 2024-09-21T05:54:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f21427fc640 1 -- 172.21.15.7:0/2514860502 learned_addr learned my addr 172.21.15.7:0/2514860502 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f2142ffd640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2144104910 0x7f214419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f21437fe640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f214410dd70 0x7f214419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f21427fc640 1 -- 172.21.15.7:0/2514860502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f214410dd70 msgr2=0x7f214419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f21427fc640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f214410dd70 0x7f214419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f21427fc640 1 -- 172.21.15.7:0/2514860502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2144104910 msgr2=0x7f214419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f21427fc640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2144104910 0x7f214419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.453+0000 7f21427fc640 1 -- 172.21.15.7:0/2514860502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21441a0340 con 0x7f2144105260 2024-09-21T05:54:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.454+0000 7f21427fc640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2144105260 0x7f214419a9b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f213800e9f0 tx=0x7f213800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.454+0000 7f212bfff640 1 -- 172.21.15.7:0/2514860502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213800ccc0 con 0x7f2144105260 2024-09-21T05:54:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.454+0000 7f214977b640 1 -- 172.21.15.7:0/2514860502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21441a0630 con 0x7f2144105260 2024-09-21T05:54:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.454+0000 7f212bfff640 1 -- 172.21.15.7:0/2514860502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21380108e0 con 0x7f2144105260 2024-09-21T05:54:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.454+0000 7f212bfff640 1 -- 172.21.15.7:0/2514860502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138018860 con 0x7f2144105260 2024-09-21T05:54:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.454+0000 7f214977b640 1 -- 172.21.15.7:0/2514860502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21441a6dc0 con 0x7f2144105260 2024-09-21T05:54:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f21507c5740 1 Processor -- start 2024-09-21T05:54:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f21507c5740 1 -- start start 2024-09-21T05:54:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f212bfff640 1 -- 172.21.15.7:0/2514860502 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f2138018a00 con 0x7f2144105260 2024-09-21T05:54:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f21507c5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc494b1b0 0x560dc4cf09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f21507c5740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc49222f0 0x560dc4cf0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f21507c5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc492a4d0 0x560dc4cf1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f21507c5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560dc4c656f0 con 0x560dc494b1b0 2024-09-21T05:54:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f21507c5740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560dc4c54b20 con 0x560dc49222f0 2024-09-21T05:54:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f21507c5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560dc4c58930 con 0x560dc492a4d0 2024-09-21T05:54:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f21437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc494b1b0 0x560dc4cf09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f21437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc494b1b0 0x560dc4cf09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47044/0 (socket says 172.21.15.7:47044) 2024-09-21T05:54:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f21437fe640 1 -- 172.21.15.7:0/3501522764 learned_addr learned my addr 172.21.15.7:0/3501522764 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f2142ffd640 1 --2- 172.21.15.7:0/3501522764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc49222f0 0x560dc4cf0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.457+0000 7f21427fc640 1 --2- 172.21.15.7:0/3501522764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc492a4d0 0x560dc4cf1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.458+0000 7f2142ffd640 1 -- 172.21.15.7:0/3501522764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc492a4d0 msgr2=0x560dc4cf1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.458+0000 7f2142ffd640 1 --2- 172.21.15.7:0/3501522764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc492a4d0 0x560dc4cf1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.458+0000 7f2142ffd640 1 -- 172.21.15.7:0/3501522764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc494b1b0 msgr2=0x560dc4cf09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.458+0000 7f2142ffd640 1 --2- 172.21.15.7:0/3501522764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc494b1b0 0x560dc4cf09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.458+0000 7f2142ffd640 1 -- 172.21.15.7:0/3501522764 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dc4c1a530 con 0x560dc49222f0 2024-09-21T05:54:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.458+0000 7f21437fe640 1 --2- 172.21.15.7:0/3501522764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc494b1b0 0x560dc4cf09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.458+0000 7f2142ffd640 1 --2- 172.21.15.7:0/3501522764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc49222f0 0x560dc4cf0ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2134009c50 tx=0x7f2134011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e71ac2d1ff7185e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.458+0000 7f212bfff640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f212c0b6680 0x7f212c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.458+0000 7f21297fa640 1 -- 172.21.15.7:0/3501522764 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134004050 con 0x560dc49222f0 2024-09-21T05:54:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.458+0000 7f21437fe640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f212c0b6680 0x7f212c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.458+0000 7f21297fa640 1 -- 172.21.15.7:0/3501522764 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21340054d0 con 0x560dc49222f0 2024-09-21T05:54:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.458+0000 7f21297fa640 1 -- 172.21.15.7:0/3501522764 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134004cb0 con 0x560dc49222f0 2024-09-21T05:54:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.458+0000 7f212bfff640 1 -- 172.21.15.7:0/2514860502 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f21380e7990 con 0x7f2144105260 2024-09-21T05:54:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.459+0000 7f21507c5740 1 -- 172.21.15.7:0/3501522764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc49222f0 msgr2=0x560dc4cf0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.459+0000 7f21507c5740 1 --2- 172.21.15.7:0/3501522764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc49222f0 0x560dc4cf0ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2134009c50 tx=0x7f2134011810 comp rx=0 tx=0).stop 2024-09-21T05:54:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.459+0000 7f21437fe640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f212c0b6680 0x7f212c0b8b90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f213c005e30 tx=0x7f213c005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.459+0000 7f21507c5740 1 -- 172.21.15.7:0/3501522764 shutdown_connections 2024-09-21T05:54:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.459+0000 7f21507c5740 1 --2- 172.21.15.7:0/3501522764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc492a4d0 0x560dc4cf1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.459+0000 7f21507c5740 1 --2- 172.21.15.7:0/3501522764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc49222f0 0x560dc4cf0ef0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.459+0000 7f21507c5740 1 --2- 172.21.15.7:0/3501522764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc494b1b0 0x560dc4cf09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.459+0000 7f21507c5740 1 -- 172.21.15.7:0/3501522764 >> 172.21.15.7:0/3501522764 conn(0x560dc493f300 msgr2=0x560dc4cee8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.459+0000 7f21507c5740 1 -- 172.21.15.7:0/3501522764 shutdown_connections 2024-09-21T05:54:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.459+0000 7f21507c5740 1 -- 172.21.15.7:0/3501522764 wait complete. 2024-09-21T05:54:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.460+0000 7f21507c5740 1 -- start start 2024-09-21T05:54:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.460+0000 7f21507c5740 1 Processor -- start 2024-09-21T05:54:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.460+0000 7f21507c5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc49222f0 0x560dc4cfc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.460+0000 7f21507c5740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc492a4d0 0x560dc4cfc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.460+0000 7f21507c5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc494b1b0 0x560dc4d08480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f21507c5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560dc4b8cab0 con 0x560dc494b1b0 2024-09-21T05:54:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f21507c5740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560dc4bfa730 con 0x560dc492a4d0 2024-09-21T05:54:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f21507c5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560dc4cff130 con 0x560dc49222f0 2024-09-21T05:54:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f21507c5740 10 client.0 _ll_register_callbacks cb 0x560dc4c4e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f21437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc494b1b0 0x560dc4d08480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f2142ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc49222f0 0x560dc4cfc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f2142ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc49222f0 0x560dc4cfc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:48670/0 (socket says 172.21.15.7:48670) 2024-09-21T05:54:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f2142ffd640 1 -- 172.21.15.7:0/2048280107 learned_addr learned my addr 172.21.15.7:0/2048280107 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f21427fc640 1 --2- 172.21.15.7:0/2048280107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc492a4d0 0x560dc4cfc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f2142ffd640 1 -- 172.21.15.7:0/2048280107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc492a4d0 msgr2=0x560dc4cfc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f2142ffd640 1 --2- 172.21.15.7:0/2048280107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc492a4d0 0x560dc4cfc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f2142ffd640 1 -- 172.21.15.7:0/2048280107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc494b1b0 msgr2=0x560dc4d08480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f2142ffd640 1 --2- 172.21.15.7:0/2048280107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc494b1b0 0x560dc4d08480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f2142ffd640 1 -- 172.21.15.7:0/2048280107 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dc49b6790 con 0x560dc49222f0 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f2142ffd640 1 --2- 172.21.15.7:0/2048280107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc49222f0 0x560dc4cfc090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21340049b0 tx=0x7f2134009660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c7af63e478d98d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.461+0000 7f2126ff5640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.462+0000 7f2126ff5640 1 -- 172.21.15.7:0/2048280107 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134027070 con 0x560dc49222f0 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.462+0000 7f21507c5740 1 -- 172.21.15.7:0/2048280107 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21340054d0 con 0x560dc49222f0 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.462+0000 7f2126ff5640 1 -- 172.21.15.7:0/2048280107 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f2134003a00 con 0x560dc49222f0 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.462+0000 7f2126ff5640 1 -- 172.21.15.7:0/2048280107 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2134033050 con 0x560dc49222f0 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.462+0000 7f21507c5740 10 client.25243 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.462+0000 7f21507c5740 1 -- 172.21.15.7:0/2048280107 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560dc4a2f620 con 0x560dc49222f0 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.462+0000 7f2126ff5640 1 -- 172.21.15.7:0/2048280107 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21340054d0 con 0x560dc49222f0 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.462+0000 7f2126ff5640 1 -- 172.21.15.7:0/2048280107 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f21340051a0 con 0x560dc49222f0 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.462+0000 7f21507c5740 10 client.25243 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.462+0000 7f21507c5740 10 client.25243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.462+0000 7f21507c5740 20 client.25243 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.462+0000 7f21507c5740 1 --2- 172.21.15.7:0/2048280107 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560dc4909d80 0x560dc4d0e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.463+0000 7f21507c5740 4 client.25243 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.463+0000 7f21507c5740 1 -- 172.21.15.7:0/2048280107 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560dc4c67640 con 0x560dc4909d80 2024-09-21T05:54:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.463+0000 7f21427fc640 1 --2- 172.21.15.7:0/2048280107 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560dc4909d80 0x560dc4d0e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.463+0000 7f2126ff5640 10 client.25243 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.463+0000 7f21427fc640 1 --2- 172.21.15.7:0/2048280107 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560dc4909d80 0x560dc4d0e110 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74ed5160bd3fe939 server_cookie=2d573f5dc0a5db55 in_seq=0 out_seq=0 2024-09-21T05:54:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f2126ff5640 1 -- 172.21.15.7:0/2048280107 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560dc4c67640 con 0x560dc4909d80 2024-09-21T05:54:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f2126ff5640 10 client.25243 handle_command_reply: tid=0 2024-09-21T05:54:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f21507c5740 1 client.25243 shutdown 2024-09-21T05:54:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f21507c5740 1 -- 172.21.15.7:0/2048280107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc49222f0 msgr2=0x560dc4cfc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f21507c5740 1 --2- 172.21.15.7:0/2048280107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc49222f0 0x560dc4cfc090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21340049b0 tx=0x7f2134009660 comp rx=0 tx=0).stop 2024-09-21T05:54:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f21507c5740 1 -- 172.21.15.7:0/2048280107 shutdown_connections 2024-09-21T05:54:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f21507c5740 1 --2- 172.21.15.7:0/2048280107 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560dc4909d80 0x560dc4d0e110 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f21507c5740 1 --2- 172.21.15.7:0/2048280107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc494b1b0 0x560dc4d08480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f21507c5740 1 --2- 172.21.15.7:0/2048280107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc492a4d0 0x560dc4cfc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f2126ff5640 0 client.25243 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f21507c5740 1 --2- 172.21.15.7:0/2048280107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc49222f0 0x560dc4cfc090 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f21507c5740 1 -- 172.21.15.7:0/2048280107 >> 172.21.15.7:0/2048280107 conn(0x560dc493f300 msgr2=0x560dc4cf19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f21507c5740 1 -- 172.21.15.7:0/2048280107 shutdown_connections 2024-09-21T05:54:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.464+0000 7f21507c5740 1 -- 172.21.15.7:0/2048280107 wait complete. 2024-09-21T05:54:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.465+0000 7f21507c5740 20 client.25243 trim_cache size 0 max 16384 2024-09-21T05:54:10.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:10 smithi027 ceph-mon[34364]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-09-21T05:54:10.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.489+0000 7f21507c5740 1 Processor -- start 2024-09-21T05:54:10.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.489+0000 7f21507c5740 1 -- start start 2024-09-21T05:54:10.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.489+0000 7f21507c5740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc49222f0 0x560dc4cf20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.489+0000 7f21507c5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc492a4d0 0x560dc4d08380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21507c5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc494b1b0 0x560dc4cf9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21507c5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21441b1f10 con 0x560dc492a4d0 2024-09-21T05:54:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21507c5740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f21441af7e0 con 0x560dc49222f0 2024-09-21T05:54:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21507c5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f21441ad630 con 0x560dc494b1b0 2024-09-21T05:54:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21427fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc492a4d0 0x560dc4d08380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21427fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc492a4d0 0x560dc4d08380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47052/0 (socket says 172.21.15.7:47052) 2024-09-21T05:54:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21427fc640 1 -- 172.21.15.7:0/2586148552 learned_addr learned my addr 172.21.15.7:0/2586148552 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f2142ffd640 1 --2- 172.21.15.7:0/2586148552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc49222f0 0x560dc4cf20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21437fe640 1 --2- 172.21.15.7:0/2586148552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc494b1b0 0x560dc4cf9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21427fc640 1 -- 172.21.15.7:0/2586148552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc494b1b0 msgr2=0x560dc4cf9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21427fc640 1 --2- 172.21.15.7:0/2586148552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc494b1b0 0x560dc4cf9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21427fc640 1 -- 172.21.15.7:0/2586148552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc49222f0 msgr2=0x560dc4cf20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21427fc640 1 --2- 172.21.15.7:0/2586148552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc49222f0 0x560dc4cf20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21427fc640 1 -- 172.21.15.7:0/2586148552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dc4cfa5a0 con 0x560dc492a4d0 2024-09-21T05:54:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21437fe640 1 --2- 172.21.15.7:0/2586148552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc494b1b0 0x560dc4cf9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f2142ffd640 1 --2- 172.21.15.7:0/2586148552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc49222f0 0x560dc4cf20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f21427fc640 1 --2- 172.21.15.7:0/2586148552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc492a4d0 0x560dc4d08380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f21380ad7f0 tx=0x7f21380eb430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a57d8427112afc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.490+0000 7f2128ff9640 1 -- 172.21.15.7:0/2586148552 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21380ad630 con 0x560dc492a4d0 2024-09-21T05:54:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.491+0000 7f2128ff9640 1 -- 172.21.15.7:0/2586148552 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21380ad370 con 0x560dc492a4d0 2024-09-21T05:54:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.491+0000 7f2128ff9640 1 -- 172.21.15.7:0/2586148552 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21380acfd0 con 0x560dc492a4d0 2024-09-21T05:54:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.491+0000 7f21507c5740 1 -- 172.21.15.7:0/2586148552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc492a4d0 msgr2=0x560dc4d08380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.491+0000 7f21507c5740 1 --2- 172.21.15.7:0/2586148552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc492a4d0 0x560dc4d08380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f21380ad7f0 tx=0x7f21380eb430 comp rx=0 tx=0).stop 2024-09-21T05:54:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.491+0000 7f21507c5740 1 -- 172.21.15.7:0/2586148552 shutdown_connections 2024-09-21T05:54:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.491+0000 7f21507c5740 1 --2- 172.21.15.7:0/2586148552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc492a4d0 0x560dc4d08380 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.491+0000 7f21507c5740 1 --2- 172.21.15.7:0/2586148552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc494b1b0 0x560dc4cf9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.491+0000 7f21507c5740 1 --2- 172.21.15.7:0/2586148552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc49222f0 0x560dc4cf20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.491+0000 7f21507c5740 1 -- 172.21.15.7:0/2586148552 >> 172.21.15.7:0/2586148552 conn(0x560dc493f300 msgr2=0x560dc4cf19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.491+0000 7f21507c5740 1 -- 172.21.15.7:0/2586148552 shutdown_connections 2024-09-21T05:54:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.491+0000 7f21507c5740 1 -- 172.21.15.7:0/2586148552 wait complete. 2024-09-21T05:54:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.492+0000 7f21507c5740 1 -- start start 2024-09-21T05:54:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.492+0000 7f21507c5740 1 Processor -- start 2024-09-21T05:54:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.492+0000 7f21507c5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc49222f0 0x560dc4d015b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.492+0000 7f21507c5740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc492a4d0 0x560dc4d01af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.492+0000 7f21507c5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc494b1b0 0x560dc4d02030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.492+0000 7f21507c5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21441adca0 con 0x560dc49222f0 2024-09-21T05:54:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.492+0000 7f21507c5740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f21441af110 con 0x560dc492a4d0 2024-09-21T05:54:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.492+0000 7f21507c5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f21441ae370 con 0x560dc494b1b0 2024-09-21T05:54:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.492+0000 7f21507c5740 10 client.0 _ll_register_callbacks cb 0x7f2134005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.492+0000 7f2142ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc49222f0 0x560dc4d015b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.492+0000 7f2142ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc49222f0 0x560dc4d015b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47062/0 (socket says 172.21.15.7:47062) 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.492+0000 7f2142ffd640 1 -- 172.21.15.7:0/2935541423 learned_addr learned my addr 172.21.15.7:0/2935541423 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.492+0000 7f21427fc640 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc492a4d0 0x560dc4d01af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f21437fe640 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc494b1b0 0x560dc4d02030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f2142ffd640 1 -- 172.21.15.7:0/2935541423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc494b1b0 msgr2=0x560dc4d02030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f2142ffd640 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc494b1b0 0x560dc4d02030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f2142ffd640 1 -- 172.21.15.7:0/2935541423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc492a4d0 msgr2=0x560dc4d01af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f2142ffd640 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc492a4d0 0x560dc4d01af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f2142ffd640 1 -- 172.21.15.7:0/2935541423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dc4d76b60 con 0x560dc49222f0 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f21427fc640 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc492a4d0 0x560dc4d01af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f2142ffd640 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc49222f0 0x560dc4d015b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2134011850 tx=0x7f2134009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6822ca09e82ead server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f2126ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f2126ff5640 1 -- 172.21.15.7:0/2935541423 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134027040 con 0x560dc49222f0 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f2126ff5640 1 -- 172.21.15.7:0/2935541423 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f2134023cf0 con 0x560dc49222f0 2024-09-21T05:54:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f21507c5740 1 -- 172.21.15.7:0/2935541423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21380ad370 con 0x560dc49222f0 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f2126ff5640 1 -- 172.21.15.7:0/2935541423 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2134045050 con 0x560dc49222f0 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f21507c5740 10 client.15558 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f21507c5740 1 -- 172.21.15.7:0/2935541423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560dc4d77df0 con 0x560dc49222f0 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.493+0000 7f2126ff5640 1 -- 172.21.15.7:0/2935541423 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21380ad370 con 0x560dc49222f0 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.494+0000 7f2126ff5640 1 -- 172.21.15.7:0/2935541423 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f213402c440 con 0x560dc49222f0 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.494+0000 7f21507c5740 10 client.15558 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.494+0000 7f21507c5740 10 client.15558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.494+0000 7f21507c5740 20 client.15558 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.494+0000 7f21507c5740 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560dc48df1c0 0x560dc4d7a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.494+0000 7f21507c5740 4 client.15558 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.494+0000 7f21507c5740 1 -- 172.21.15.7:0/2935541423 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560dc4c630f0 con 0x560dc48df1c0 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.494+0000 7f21427fc640 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560dc48df1c0 0x560dc4d7a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.494+0000 7f2126ff5640 10 client.15558 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.494+0000 7f21427fc640 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560dc48df1c0 0x560dc4d7a570 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9eda9e9bca8557d server_cookie=ac583492f4692977 in_seq=0 out_seq=0 2024-09-21T05:54:10.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.503+0000 7f2126ff5640 1 -- 172.21.15.7:0/2935541423 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560dc4c630f0 con 0x560dc48df1c0 2024-09-21T05:54:10.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.503+0000 7f2126ff5640 10 client.15558 handle_command_reply: tid=0 2024-09-21T05:54:10.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.503+0000 7f21507c5740 1 client.15558 shutdown 2024-09-21T05:54:10.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.503+0000 7f21507c5740 1 -- 172.21.15.7:0/2935541423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc49222f0 msgr2=0x560dc4d015b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:10.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.503+0000 7f21507c5740 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc49222f0 0x560dc4d015b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2134011850 tx=0x7f2134009a70 comp rx=0 tx=0).stop 2024-09-21T05:54:10.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.503+0000 7f21507c5740 1 -- 172.21.15.7:0/2935541423 shutdown_connections 2024-09-21T05:54:10.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.503+0000 7f21507c5740 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560dc48df1c0 0x560dc4d7a570 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.503+0000 7f21507c5740 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560dc494b1b0 0x560dc4d02030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.503+0000 7f21507c5740 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560dc492a4d0 0x560dc4d01af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.503+0000 7f21507c5740 1 --2- 172.21.15.7:0/2935541423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560dc49222f0 0x560dc4d015b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.503+0000 7f21507c5740 1 -- 172.21.15.7:0/2935541423 >> 172.21.15.7:0/2935541423 conn(0x560dc493f300 msgr2=0x560dc4cee880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.503+0000 7f2126ff5640 0 client.15558 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.504+0000 7f21507c5740 1 -- 172.21.15.7:0/2935541423 shutdown_connections 2024-09-21T05:54:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.504+0000 7f21507c5740 1 -- 172.21.15.7:0/2935541423 wait complete. 2024-09-21T05:54:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.504+0000 7f21507c5740 20 client.15558 trim_cache size 0 max 16384 2024-09-21T05:54:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T05:54:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T05:54:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T05:54:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T05:54:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.504+0000 7f214977b640 1 -- 172.21.15.7:0/2514860502 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f212c0b6680 msgr2=0x7f212c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.504+0000 7f214977b640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f212c0b6680 0x7f212c0b8b90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f213c005e30 tx=0x7f213c005c30 comp rx=0 tx=0).stop 2024-09-21T05:54:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.504+0000 7f214977b640 1 -- 172.21.15.7:0/2514860502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2144105260 msgr2=0x7f214419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.504+0000 7f214977b640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2144105260 0x7f214419a9b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f213800e9f0 tx=0x7f213800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.504+0000 7f214977b640 1 -- 172.21.15.7:0/2514860502 shutdown_connections 2024-09-21T05:54:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.504+0000 7f214977b640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f212c0b6680 0x7f212c0b8b90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.504+0000 7f214977b640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2144105260 0x7f214419a9b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.504+0000 7f214977b640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f214410dd70 0x7f214419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.504+0000 7f214977b640 1 --2- 172.21.15.7:0/2514860502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2144104910 0x7f214419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.504+0000 7f214977b640 1 -- 172.21.15.7:0/2514860502 >> 172.21.15.7:0/2514860502 conn(0x7f21440fe3c0 msgr2=0x7f2144107810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.505+0000 7f214977b640 1 -- 172.21.15.7:0/2514860502 shutdown_connections 2024-09-21T05:54:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:10.505+0000 7f214977b640 1 -- 172.21.15.7:0/2514860502 wait complete. 2024-09-21T05:54:10.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:10 smithi007 ceph-mon[30983]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-09-21T05:54:10.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:10 smithi119 ceph-mon[34833]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-09-21T05:54:12.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:12 smithi027 ceph-mon[34364]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T05:54:12.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:12 smithi007 ceph-mon[30983]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T05:54:12.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:12 smithi119 ceph-mon[34833]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T05:54:14.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:14 smithi027 ceph-mon[34364]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T05:54:14.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:14 smithi007 ceph-mon[30983]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T05:54:14.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:14 smithi119 ceph-mon[34833]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T05:54:15.538 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:54:15.820 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:16.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.322+0000 7fe076114640 1 -- 172.21.15.7:0/1566111793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0701083c0 msgr2=0x7fe0701087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:16.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.322+0000 7fe076114640 1 --2- 172.21.15.7:0/1566111793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0701083c0 0x7fe0701087d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe064009900 tx=0x7fe06402a410 comp rx=0 tx=0).stop 2024-09-21T05:54:16.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.322+0000 7fe076114640 1 -- 172.21.15.7:0/1566111793 shutdown_connections 2024-09-21T05:54:16.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.322+0000 7fe076114640 1 --2- 172.21.15.7:0/1566111793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0701083c0 0x7fe0701087d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.322+0000 7fe076114640 1 --2- 172.21.15.7:0/1566111793 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070108d10 0x7fe07010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.322+0000 7fe076114640 1 --2- 172.21.15.7:0/1566111793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe070102a80 0x7fe070102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.322+0000 7fe076114640 1 -- 172.21.15.7:0/1566111793 >> 172.21.15.7:0/1566111793 conn(0x7fe070079740 msgr2=0x7fe070079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:16.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.322+0000 7fe076114640 1 -- 172.21.15.7:0/1566111793 shutdown_connections 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.323+0000 7fe076114640 1 -- 172.21.15.7:0/1566111793 wait complete. 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.323+0000 7fe076114640 1 Processor -- start 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.323+0000 7fe076114640 1 -- start start 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe076114640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe070102a80 0x7fe0701a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe076114640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0701083c0 0x7fe0701a1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe076114640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070108d10 0x7fe0701a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe06effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0701083c0 0x7fe0701a1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe06effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0701083c0 0x7fe0701a1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47080/0 (socket says 172.21.15.7:47080) 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe070102a80 0x7fe0701a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe070102a80 0x7fe0701a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:48708/0 (socket says 172.21.15.7:48708) 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe06effd640 1 -- 172.21.15.7:0/3822992446 learned_addr learned my addr 172.21.15.7:0/3822992446 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe076114640 1 -- 172.21.15.7:0/3822992446 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe070112980 con 0x7fe0701083c0 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe076114640 1 -- 172.21.15.7:0/3822992446 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe070112800 con 0x7fe070108d10 2024-09-21T05:54:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe076114640 1 -- 172.21.15.7:0/3822992446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe070112b00 con 0x7fe070102a80 2024-09-21T05:54:16.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe06ffff640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070108d10 0x7fe0701a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe06f7fe640 1 -- 172.21.15.7:0/3822992446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070108d10 msgr2=0x7fe0701a63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:16.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.324+0000 7fe06f7fe640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070108d10 0x7fe0701a63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.325+0000 7fe06f7fe640 1 -- 172.21.15.7:0/3822992446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0701083c0 msgr2=0x7fe0701a1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:16.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.325+0000 7fe06f7fe640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0701083c0 0x7fe0701a1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.325+0000 7fe06f7fe640 1 -- 172.21.15.7:0/3822992446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0701a6ad0 con 0x7fe070102a80 2024-09-21T05:54:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.325+0000 7fe06effd640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0701083c0 0x7fe0701a1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.325+0000 7fe06f7fe640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe070102a80 0x7fe0701a0b60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe060005fd0 tx=0x7fe06000dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.325+0000 7fe06cff9640 1 -- 172.21.15.7:0/3822992446 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060009c30 con 0x7fe070102a80 2024-09-21T05:54:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.325+0000 7fe06cff9640 1 -- 172.21.15.7:0/3822992446 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe060009dd0 con 0x7fe070102a80 2024-09-21T05:54:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.325+0000 7fe06cff9640 1 -- 172.21.15.7:0/3822992446 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060003e20 con 0x7fe070102a80 2024-09-21T05:54:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.325+0000 7fe076114640 1 -- 172.21.15.7:0/3822992446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0701a6dc0 con 0x7fe070102a80 2024-09-21T05:54:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.325+0000 7fe076114640 1 -- 172.21.15.7:0/3822992446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0701ad520 con 0x7fe070102a80 2024-09-21T05:54:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.328+0000 7fe06cff9640 1 -- 172.21.15.7:0/3822992446 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe060004030 con 0x7fe070102a80 2024-09-21T05:54:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.328+0000 7fe07c688740 1 Processor -- start 2024-09-21T05:54:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.328+0000 7fe07c688740 1 -- start start 2024-09-21T05:54:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.328+0000 7fe07c688740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fbb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.328+0000 7fe07c688740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3beb1b0 0x5599a3fbbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.328+0000 7fe07c688740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fbc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.328+0000 7fe07c688740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5599a3f31e50 con 0x5599a3beb1b0 2024-09-21T05:54:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.328+0000 7fe07c688740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5599a3f21280 con 0x5599a3bf3390 2024-09-21T05:54:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.328+0000 7fe07c688740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5599a3f25090 con 0x5599a3c14070 2024-09-21T05:54:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.329+0000 7fe06ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fbb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.329+0000 7fe06ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fbb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:48718/0 (socket says 172.21.15.7:48718) 2024-09-21T05:54:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.329+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3beb1b0 0x5599a3fbbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.329+0000 7fe06ffff640 1 -- 172.21.15.7:0/4047428912 learned_addr learned my addr 172.21.15.7:0/4047428912 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.329+0000 7fe06effd640 1 --2- 172.21.15.7:0/4047428912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fbc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.329+0000 7fe06effd640 1 -- 172.21.15.7:0/4047428912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 msgr2=0x5599a3fbb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.329+0000 7fe06effd640 1 --2- 172.21.15.7:0/4047428912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fbb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.329+0000 7fe06effd640 1 -- 172.21.15.7:0/4047428912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3beb1b0 msgr2=0x5599a3fbbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.329+0000 7fe06effd640 1 --2- 172.21.15.7:0/4047428912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3beb1b0 0x5599a3fbbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.329+0000 7fe06effd640 1 -- 172.21.15.7:0/4047428912 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599a3c7f650 con 0x5599a3bf3390 2024-09-21T05:54:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.329+0000 7fe06ffff640 1 --2- 172.21.15.7:0/4047428912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fbb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.330+0000 7fe06cff9640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe0580b6700 0x7fe0580b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.330+0000 7fe06effd640 1 --2- 172.21.15.7:0/4047428912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fbc0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe064004770 tx=0x7fe064005ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f883f4975c520b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.330+0000 7fe06cff9640 1 -- 172.21.15.7:0/3822992446 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fe0600e7180 con 0x7fe070102a80 2024-09-21T05:54:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.330+0000 7fe06ffff640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe0580b6700 0x7fe0580b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.330+0000 7fe055ffb640 1 -- 172.21.15.7:0/4047428912 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064035040 con 0x5599a3bf3390 2024-09-21T05:54:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.330+0000 7fe055ffb640 1 -- 172.21.15.7:0/4047428912 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe064031820 con 0x5599a3bf3390 2024-09-21T05:54:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.331+0000 7fe055ffb640 1 -- 172.21.15.7:0/4047428912 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064004a00 con 0x5599a3bf3390 2024-09-21T05:54:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.331+0000 7fe07c688740 1 -- 172.21.15.7:0/4047428912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 msgr2=0x5599a3fbc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.331+0000 7fe06ffff640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe0580b6700 0x7fe0580b8c10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe0680117b0 tx=0x7fe068009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.331+0000 7fe07c688740 1 --2- 172.21.15.7:0/4047428912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fbc0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe064004770 tx=0x7fe064005ed0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.332+0000 7fe07c688740 1 -- 172.21.15.7:0/4047428912 shutdown_connections 2024-09-21T05:54:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.332+0000 7fe07c688740 1 --2- 172.21.15.7:0/4047428912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3beb1b0 0x5599a3fbbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.332+0000 7fe07c688740 1 --2- 172.21.15.7:0/4047428912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fbc0d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.332+0000 7fe07c688740 1 --2- 172.21.15.7:0/4047428912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fbb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.332+0000 7fe07c688740 1 -- 172.21.15.7:0/4047428912 >> 172.21.15.7:0/4047428912 conn(0x5599a3c08460 msgr2=0x5599a3fb9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.332+0000 7fe07c688740 1 -- 172.21.15.7:0/4047428912 shutdown_connections 2024-09-21T05:54:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.332+0000 7fe07c688740 1 -- 172.21.15.7:0/4047428912 wait complete. 2024-09-21T05:54:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.332+0000 7fe07c688740 1 -- start start 2024-09-21T05:54:16.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.332+0000 7fe07c688740 1 Processor -- start 2024-09-21T05:54:16.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.333+0000 7fe07c688740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3beb1b0 0x5599a3fc6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.333+0000 7fe07c688740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fc7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.333+0000 7fe07c688740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3c14070 0x5599a3fd3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.333+0000 7fe07c688740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5599a3d82700 con 0x5599a3c14070 2024-09-21T05:54:16.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.333+0000 7fe07c688740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5599a3ebc110 con 0x5599a3bf3390 2024-09-21T05:54:16.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.333+0000 7fe07c688740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5599a3fc9e20 con 0x5599a3beb1b0 2024-09-21T05:54:16.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.333+0000 7fe06ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3c14070 0x5599a3fd3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.333+0000 7fe07c688740 10 client.0 _ll_register_callbacks cb 0x5599a3ed5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.333+0000 7fe06effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fc7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.333+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3beb1b0 0x5599a3fc6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.333+0000 7fe06effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fc7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:42288/0 (socket says 172.21.15.7:42288) 2024-09-21T05:54:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.333+0000 7fe06effd640 1 -- 172.21.15.7:0/3868894182 learned_addr learned my addr 172.21.15.7:0/3868894182 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.334+0000 7fe06f7fe640 1 -- 172.21.15.7:0/3868894182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 msgr2=0x5599a3fc7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.334+0000 7fe06f7fe640 1 --2- 172.21.15.7:0/3868894182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fc7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.334+0000 7fe06f7fe640 1 -- 172.21.15.7:0/3868894182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3c14070 msgr2=0x5599a3fd3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.334+0000 7fe06f7fe640 1 --2- 172.21.15.7:0/3868894182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3c14070 0x5599a3fd3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.334+0000 7fe06f7fe640 1 -- 172.21.15.7:0/3868894182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599a3ee9c40 con 0x5599a3beb1b0 2024-09-21T05:54:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.334+0000 7fe06f7fe640 1 --2- 172.21.15.7:0/3868894182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3beb1b0 0x5599a3fc6d50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe0600e4950 tx=0x7fe0600e7480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bef04a86279b2f6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.334+0000 7fe04effd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.334+0000 7fe04effd640 1 -- 172.21.15.7:0/3868894182 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060020070 con 0x5599a3beb1b0 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.334+0000 7fe04effd640 1 -- 172.21.15.7:0/3868894182 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fe0600a89a0 con 0x5599a3beb1b0 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.334+0000 7fe07c688740 1 -- 172.21.15.7:0/3868894182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe064031820 con 0x5599a3beb1b0 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.334+0000 7fe04effd640 1 -- 172.21.15.7:0/3868894182 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe0600a8ef0 con 0x5599a3beb1b0 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.334+0000 7fe07c688740 10 client.25258 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.334+0000 7fe07c688740 1 -- 172.21.15.7:0/3868894182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5599a3fd5bf0 con 0x5599a3beb1b0 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.335+0000 7fe04effd640 1 -- 172.21.15.7:0/3868894182 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe064031820 con 0x5599a3beb1b0 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.335+0000 7fe04effd640 1 -- 172.21.15.7:0/3868894182 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe0600a8ba0 con 0x5599a3beb1b0 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.335+0000 7fe07c688740 10 client.25258 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.335+0000 7fe07c688740 10 client.25258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.335+0000 7fe07c688740 20 client.25258 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.335+0000 7fe07c688740 1 --2- 172.21.15.7:0/3868894182 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5599a3bd29f0 0x5599a3fd9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.335+0000 7fe07c688740 4 client.25258 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:16.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.335+0000 7fe07c688740 1 -- 172.21.15.7:0/3868894182 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599a3f33da0 con 0x5599a3bd29f0 2024-09-21T05:54:16.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.335+0000 7fe06effd640 1 --2- 172.21.15.7:0/3868894182 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5599a3bd29f0 0x5599a3fd9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.336+0000 7fe06effd640 1 --2- 172.21.15.7:0/3868894182 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5599a3bd29f0 0x5599a3fd9170 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=637cf91c359b0463 server_cookie=9b1b727361829a88 in_seq=0 out_seq=0 2024-09-21T05:54:16.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.336+0000 7fe04effd640 10 client.25258 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:16.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe04effd640 1 -- 172.21.15.7:0/3868894182 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599a3f33da0 con 0x5599a3bd29f0 2024-09-21T05:54:16.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe04effd640 10 client.25258 handle_command_reply: tid=0 2024-09-21T05:54:16.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe07c688740 1 client.25258 shutdown 2024-09-21T05:54:16.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe07c688740 1 -- 172.21.15.7:0/3868894182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3beb1b0 msgr2=0x5599a3fc6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:16.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe07c688740 1 --2- 172.21.15.7:0/3868894182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3beb1b0 0x5599a3fc6d50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe0600e4950 tx=0x7fe0600e7480 comp rx=0 tx=0).stop 2024-09-21T05:54:16.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe07c688740 1 -- 172.21.15.7:0/3868894182 shutdown_connections 2024-09-21T05:54:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe07c688740 1 --2- 172.21.15.7:0/3868894182 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5599a3bd29f0 0x5599a3fd9170 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe07c688740 1 --2- 172.21.15.7:0/3868894182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3c14070 0x5599a3fd3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe07c688740 1 --2- 172.21.15.7:0/3868894182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fc7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe07c688740 1 --2- 172.21.15.7:0/3868894182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3beb1b0 0x5599a3fc6d50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe07c688740 1 -- 172.21.15.7:0/3868894182 >> 172.21.15.7:0/3868894182 conn(0x5599a3c08460 msgr2=0x5599a3fbe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe04effd640 0 client.25258 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe07c688740 1 -- 172.21.15.7:0/3868894182 shutdown_connections 2024-09-21T05:54:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.337+0000 7fe07c688740 1 -- 172.21.15.7:0/3868894182 wait complete. 2024-09-21T05:54:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.338+0000 7fe07c688740 20 client.25258 trim_cache size 0 max 16384 2024-09-21T05:54:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.355+0000 7fe07c688740 1 Processor -- start 2024-09-21T05:54:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.355+0000 7fe07c688740 1 -- start start 2024-09-21T05:54:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.355+0000 7fe07c688740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3beb1b0 0x5599a3fbd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.355+0000 7fe07c688740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fc8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe07c688740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fb8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe07c688740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b85b0 con 0x5599a3beb1b0 2024-09-21T05:54:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe07c688740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b5e80 con 0x5599a3bf3390 2024-09-21T05:54:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe07c688740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b3cd0 con 0x5599a3c14070 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3beb1b0 0x5599a3fbd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3beb1b0 0x5599a3fbd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47122/0 (socket says 172.21.15.7:47122) 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe06f7fe640 1 -- 172.21.15.7:0/4045337241 learned_addr learned my addr 172.21.15.7:0/4045337241 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe06effd640 1 --2- 172.21.15.7:0/4045337241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fc8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe06ffff640 1 --2- 172.21.15.7:0/4045337241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fb8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe06f7fe640 1 -- 172.21.15.7:0/4045337241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 msgr2=0x5599a3fb8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe06f7fe640 1 --2- 172.21.15.7:0/4045337241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fb8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe06f7fe640 1 -- 172.21.15.7:0/4045337241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 msgr2=0x5599a3fc8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe06f7fe640 1 --2- 172.21.15.7:0/4045337241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fc8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe06f7fe640 1 -- 172.21.15.7:0/4045337241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599a3fc8010 con 0x5599a3beb1b0 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe06ffff640 1 --2- 172.21.15.7:0/4045337241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fb8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.356+0000 7fe06effd640 1 --2- 172.21.15.7:0/4045337241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fc8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.357+0000 7fe06f7fe640 1 --2- 172.21.15.7:0/4045337241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3beb1b0 0x5599a3fbd040 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe060009610 tx=0x7fe060003fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da41f71ad887af2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.357+0000 7fe0557fa640 1 -- 172.21.15.7:0/4045337241 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060020030 con 0x5599a3beb1b0 2024-09-21T05:54:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.357+0000 7fe0557fa640 1 -- 172.21.15.7:0/4045337241 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0600ad750 con 0x5599a3beb1b0 2024-09-21T05:54:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.357+0000 7fe0557fa640 1 -- 172.21.15.7:0/4045337241 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0600ac7c0 con 0x5599a3beb1b0 2024-09-21T05:54:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.358+0000 7fe07c688740 1 -- 172.21.15.7:0/4045337241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3beb1b0 msgr2=0x5599a3fbd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.358+0000 7fe07c688740 1 --2- 172.21.15.7:0/4045337241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3beb1b0 0x5599a3fbd040 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe060009610 tx=0x7fe060003fc0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.358+0000 7fe07c688740 1 -- 172.21.15.7:0/4045337241 shutdown_connections 2024-09-21T05:54:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.358+0000 7fe07c688740 1 --2- 172.21.15.7:0/4045337241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fb8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.358+0000 7fe07c688740 1 --2- 172.21.15.7:0/4045337241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3bf3390 0x5599a3fc8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.358+0000 7fe07c688740 1 --2- 172.21.15.7:0/4045337241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3beb1b0 0x5599a3fbd040 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.358+0000 7fe07c688740 1 -- 172.21.15.7:0/4045337241 >> 172.21.15.7:0/4045337241 conn(0x5599a3c08460 msgr2=0x5599a3fc8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.358+0000 7fe07c688740 1 -- 172.21.15.7:0/4045337241 shutdown_connections 2024-09-21T05:54:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.358+0000 7fe07c688740 1 -- 172.21.15.7:0/4045337241 wait complete. 2024-09-21T05:54:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.359+0000 7fe07c688740 1 -- start start 2024-09-21T05:54:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.359+0000 7fe07c688740 1 Processor -- start 2024-09-21T05:54:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.359+0000 7fe07c688740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3bf3390 0x5599a3fcf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.359+0000 7fe07c688740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fcfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.359+0000 7fe07c688740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3ba7da0 0x5599a3fcab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.359+0000 7fe07c688740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b4340 con 0x5599a3bf3390 2024-09-21T05:54:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.359+0000 7fe07c688740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b57b0 con 0x5599a3ba7da0 2024-09-21T05:54:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.359+0000 7fe07c688740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b4a10 con 0x5599a3c14070 2024-09-21T05:54:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe07c688740 10 client.0 _ll_register_callbacks cb 0x7fe060004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3bf3390 0x5599a3fcf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3bf3390 0x5599a3fcf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47134/0 (socket says 172.21.15.7:47134) 2024-09-21T05:54:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe06f7fe640 1 -- 172.21.15.7:0/705511089 learned_addr learned my addr 172.21.15.7:0/705511089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe06ffff640 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3ba7da0 0x5599a3fcab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe06effd640 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fcfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe06f7fe640 1 -- 172.21.15.7:0/705511089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 msgr2=0x5599a3fcfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe06f7fe640 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fcfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe06f7fe640 1 -- 172.21.15.7:0/705511089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3ba7da0 msgr2=0x5599a3fcab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe06f7fe640 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3ba7da0 0x5599a3fcab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe06f7fe640 1 -- 172.21.15.7:0/705511089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599a3fcb2c0 con 0x5599a3bf3390 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe06effd640 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fcfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe06f7fe640 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3bf3390 0x5599a3fcf4d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe06000dfd0 tx=0x7fe0600e4de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ee2ed43ad25720 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.360+0000 7fe04effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.361+0000 7fe04effd640 1 -- 172.21.15.7:0/705511089 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060020070 con 0x5599a3bf3390 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.361+0000 7fe04effd640 1 -- 172.21.15.7:0/705511089 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fe0600b2cc0 con 0x5599a3bf3390 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.361+0000 7fe07c688740 1 -- 172.21.15.7:0/705511089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0600ad750 con 0x5599a3bf3390 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.361+0000 7fe04effd640 1 -- 172.21.15.7:0/705511089 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe0600ac9a0 con 0x5599a3bf3390 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.361+0000 7fe07c688740 10 client.15576 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:16.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.361+0000 7fe07c688740 1 -- 172.21.15.7:0/705511089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5599a40436d0 con 0x5599a3bf3390 2024-09-21T05:54:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.361+0000 7fe04effd640 1 -- 172.21.15.7:0/705511089 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0600ad750 con 0x5599a3bf3390 2024-09-21T05:54:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.361+0000 7fe04effd640 1 -- 172.21.15.7:0/705511089 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe0600b5fb0 con 0x5599a3bf3390 2024-09-21T05:54:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.362+0000 7fe07c688740 10 client.15576 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.362+0000 7fe07c688740 10 client.15576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.362+0000 7fe07c688740 20 client.15576 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.362+0000 7fe07c688740 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5599a4043b60 0x5599a4045f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.362+0000 7fe07c688740 4 client.15576 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:54:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.362+0000 7fe07c688740 1 -- 172.21.15.7:0/705511089 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5599a3f2f850 con 0x5599a4043b60 2024-09-21T05:54:16.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.362+0000 7fe06effd640 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5599a4043b60 0x5599a4045f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:16.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.363+0000 7fe04effd640 10 client.15576 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:16.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.363+0000 7fe06effd640 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5599a4043b60 0x5599a4045f80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc49a6afdd99b153 server_cookie=d37023640089d047 in_seq=0 out_seq=0 2024-09-21T05:54:16.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.364+0000 7fe04effd640 1 -- 172.21.15.7:0/705511089 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x5599a3f2f850 con 0x5599a4043b60 2024-09-21T05:54:16.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.364+0000 7fe04effd640 10 client.15576 handle_command_reply: tid=0 2024-09-21T05:54:16.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.364+0000 7fe07c688740 1 client.15576 shutdown 2024-09-21T05:54:16.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.364+0000 7fe07c688740 1 -- 172.21.15.7:0/705511089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3bf3390 msgr2=0x5599a3fcf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:16.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.364+0000 7fe07c688740 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3bf3390 0x5599a3fcf4d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe06000dfd0 tx=0x7fe0600e4de0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.364+0000 7fe07c688740 1 -- 172.21.15.7:0/705511089 shutdown_connections 2024-09-21T05:54:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.364+0000 7fe07c688740 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5599a4043b60 0x5599a4045f80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.364+0000 7fe07c688740 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599a3ba7da0 0x5599a3fcab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.364+0000 7fe07c688740 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599a3c14070 0x5599a3fcfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.364+0000 7fe07c688740 1 --2- 172.21.15.7:0/705511089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599a3bf3390 0x5599a3fcf4d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.364+0000 7fe07c688740 1 -- 172.21.15.7:0/705511089 >> 172.21.15.7:0/705511089 conn(0x5599a3c08460 msgr2=0x5599a3fbce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.364+0000 7fe04effd640 0 client.15576 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.365+0000 7fe07c688740 1 -- 172.21.15.7:0/705511089 shutdown_connections 2024-09-21T05:54:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.365+0000 7fe07c688740 1 -- 172.21.15.7:0/705511089 wait complete. 2024-09-21T05:54:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.365+0000 7fe07c688740 20 client.15576 trim_cache size 0 max 16384 2024-09-21T05:54:16.368 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:54:16.368 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T05:54:16.368 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T05:54:16.368 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:54:16.368 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:54:16.368 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:54:16.368 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:54:16.368 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:54:16.368 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:54:16.368 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:54:16.369 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:54:16.369 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:54:16.369 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:54:16.369 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:54:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.366+0000 7fe076114640 1 -- 172.21.15.7:0/3822992446 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe0580b6700 msgr2=0x7fe0580b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.366+0000 7fe076114640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe0580b6700 0x7fe0580b8c10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe0680117b0 tx=0x7fe068009500 comp rx=0 tx=0).stop 2024-09-21T05:54:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.366+0000 7fe076114640 1 -- 172.21.15.7:0/3822992446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe070102a80 msgr2=0x7fe0701a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.366+0000 7fe076114640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe070102a80 0x7fe0701a0b60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe060005fd0 tx=0x7fe06000dde0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.366+0000 7fe076114640 1 -- 172.21.15.7:0/3822992446 shutdown_connections 2024-09-21T05:54:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.366+0000 7fe076114640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe0580b6700 0x7fe0580b8c10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.366+0000 7fe076114640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0701083c0 0x7fe0701a1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.366+0000 7fe076114640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070108d10 0x7fe0701a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.366+0000 7fe076114640 1 --2- 172.21.15.7:0/3822992446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe070102a80 0x7fe0701a0b60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.366+0000 7fe076114640 1 -- 172.21.15.7:0/3822992446 >> 172.21.15.7:0/3822992446 conn(0x7fe070079740 msgr2=0x7fe07006bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.366+0000 7fe076114640 1 -- 172.21.15.7:0/3822992446 shutdown_connections 2024-09-21T05:54:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:16.366+0000 7fe076114640 1 -- 172.21.15.7:0/3822992446 wait complete. 2024-09-21T05:54:16.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:16 smithi027 ceph-mon[34364]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T05:54:16.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:16 smithi007 ceph-mon[30983]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T05:54:16.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:16 smithi119 ceph-mon[34833]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T05:54:17.046 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T05:54:17.046 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:54:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:17.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.931+0000 7fcbe159a640 1 -- 172.21.15.7:0/2549461185 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8035020 con 0x7fcbe4105300 2024-09-21T05:54:17.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.932+0000 7fcbe8856640 1 -- 172.21.15.7:0/2549461185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe4105300 msgr2=0x7fcbe410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:17.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.932+0000 7fcbe8856640 1 --2- 172.21.15.7:0/2549461185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe4105300 0x7fcbe410d850 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009900 tx=0x7fcbd802a410 comp rx=0 tx=0).stop 2024-09-21T05:54:17.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.932+0000 7fcbe8856640 1 -- 172.21.15.7:0/2549461185 shutdown_connections 2024-09-21T05:54:17.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.932+0000 7fcbe8856640 1 --2- 172.21.15.7:0/2549461185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe4105300 0x7fcbe410d850 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:17.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.932+0000 7fcbe8856640 1 --2- 172.21.15.7:0/2549461185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe410de10 0x7fcbe4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:17.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.932+0000 7fcbe8856640 1 --2- 172.21.15.7:0/2549461185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbe41049b0 0x7fcbe4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:17.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.932+0000 7fcbe8856640 1 -- 172.21.15.7:0/2549461185 >> 172.21.15.7:0/2549461185 conn(0x7fcbe4079730 msgr2=0x7fcbe4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:17.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.932+0000 7fcbe8856640 1 -- 172.21.15.7:0/2549461185 shutdown_connections 2024-09-21T05:54:17.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.933+0000 7fcbe8856640 1 -- 172.21.15.7:0/2549461185 wait complete. 2024-09-21T05:54:17.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.934+0000 7fcbe8856640 1 Processor -- start 2024-09-21T05:54:17.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.934+0000 7fcbe8856640 1 -- start start 2024-09-21T05:54:17.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.935+0000 7fcbe8856640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe41049b0 0x7fcbe419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:17.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.935+0000 7fcbe8856640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbe4105300 0x7fcbe419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:17.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.935+0000 7fcbe8856640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe410de10 0x7fcbe419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:17.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.935+0000 7fcbe8856640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe4113a70 con 0x7fcbe410de10 2024-09-21T05:54:17.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.935+0000 7fcbe1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbe4105300 0x7fcbe419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:17.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.935+0000 7fcbe1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbe4105300 0x7fcbe419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:48756/0 (socket says 172.21.15.7:48756) 2024-09-21T05:54:17.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.935+0000 7fcbe1d9b640 1 -- 172.21.15.7:0/3970354201 learned_addr learned my addr 172.21.15.7:0/3970354201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:17.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.935+0000 7fcbe2d9d640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe410de10 0x7fcbe419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:17.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.935+0000 7fcbe8856640 1 -- 172.21.15.7:0/3970354201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41138f0 con 0x7fcbe41049b0 2024-09-21T05:54:17.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.935+0000 7fcbe8856640 1 -- 172.21.15.7:0/3970354201 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe4113bf0 con 0x7fcbe4105300 2024-09-21T05:54:17.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.935+0000 7fcbe259c640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe41049b0 0x7fcbe419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:17.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.936+0000 7fcbe1d9b640 1 -- 172.21.15.7:0/3970354201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe41049b0 msgr2=0x7fcbe419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:17.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.936+0000 7fcbe1d9b640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe41049b0 0x7fcbe419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:17.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.936+0000 7fcbe1d9b640 1 -- 172.21.15.7:0/3970354201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe410de10 msgr2=0x7fcbe419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:17.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.936+0000 7fcbe1d9b640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe410de10 0x7fcbe419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.936+0000 7fcbe1d9b640 1 -- 172.21.15.7:0/3970354201 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe41a0390 con 0x7fcbe4105300 2024-09-21T05:54:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.936+0000 7fcbe2d9d640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe410de10 0x7fcbe419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.936+0000 7fcbe1d9b640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbe4105300 0x7fcbe419a9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcbd802a930 tx=0x7fcbd80045f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.936+0000 7fcbd37fe640 1 -- 172.21.15.7:0/3970354201 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8035020 con 0x7fcbe4105300 2024-09-21T05:54:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.936+0000 7fcbe8856640 1 -- 172.21.15.7:0/3970354201 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe41a0620 con 0x7fcbe4105300 2024-09-21T05:54:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.937+0000 7fcbe8856640 1 -- 172.21.15.7:0/3970354201 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe41025d0 con 0x7fcbe4105300 2024-09-21T05:54:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.937+0000 7fcbd37fe640 1 -- 172.21.15.7:0/3970354201 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbd8042070 con 0x7fcbe4105300 2024-09-21T05:54:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.937+0000 7fcbd37fe640 1 -- 172.21.15.7:0/3970354201 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8031930 con 0x7fcbe4105300 2024-09-21T05:54:17.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.938+0000 7fcbe8856640 1 -- 172.21.15.7:0/3970354201 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc40052c0 con 0x7fcbe4105300 2024-09-21T05:54:17.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.941+0000 7fcbd37fe640 1 -- 172.21.15.7:0/3970354201 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fcbd8004b60 con 0x7fcbe4105300 2024-09-21T05:54:17.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.942+0000 7fcbd37fe640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcbcc0b6700 0x7fcbcc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:17.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.942+0000 7fcbe259c640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcbcc0b6700 0x7fcbcc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:17.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.943+0000 7fcbd37fe640 1 -- 172.21.15.7:0/3970354201 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fcbd810c210 con 0x7fcbe4105300 2024-09-21T05:54:17.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.943+0000 7fcbe259c640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcbcc0b6700 0x7fcbcc0b8c10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcbe406bc60 tx=0x7fcbd4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:17.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:17.944+0000 7fcbd37fe640 1 -- 172.21.15.7:0/3970354201 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcbd80d2780 con 0x7fcbe4105300 2024-09-21T05:54:18.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.256+0000 7fcbe8856640 1 -- 172.21.15.7:0/3970354201 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbc40055b0 con 0x7fcbe4105300 2024-09-21T05:54:18.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.257+0000 7fcbd37fe640 1 -- 172.21.15.7:0/3970354201 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7fcbd80d6b60 con 0x7fcbe4105300 2024-09-21T05:54:18.259 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:54:18.259 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:54:18.259 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:54:18.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.259+0000 7fcbe8856640 1 -- 172.21.15.7:0/3970354201 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcbcc0b6700 msgr2=0x7fcbcc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:18.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.259+0000 7fcbe8856640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcbcc0b6700 0x7fcbcc0b8c10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcbe406bc60 tx=0x7fcbd4005f90 comp rx=0 tx=0).stop 2024-09-21T05:54:18.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.259+0000 7fcbe8856640 1 -- 172.21.15.7:0/3970354201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbe4105300 msgr2=0x7fcbe419a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:18.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.259+0000 7fcbe8856640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbe4105300 0x7fcbe419a9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcbd802a930 tx=0x7fcbd80045f0 comp rx=0 tx=0).stop 2024-09-21T05:54:18.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.259+0000 7fcbe8856640 1 -- 172.21.15.7:0/3970354201 shutdown_connections 2024-09-21T05:54:18.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.259+0000 7fcbe8856640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcbcc0b6700 0x7fcbcc0b8c10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:18.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.259+0000 7fcbe8856640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe410de10 0x7fcbe419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:18.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.259+0000 7fcbe8856640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbe4105300 0x7fcbe419a9c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:18.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.259+0000 7fcbe8856640 1 --2- 172.21.15.7:0/3970354201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe41049b0 0x7fcbe419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:18.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.259+0000 7fcbe8856640 1 -- 172.21.15.7:0/3970354201 >> 172.21.15.7:0/3970354201 conn(0x7fcbe4079730 msgr2=0x7fcbe4100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:18.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.259+0000 7fcbe8856640 1 -- 172.21.15.7:0/3970354201 shutdown_connections 2024-09-21T05:54:18.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:18.260+0000 7fcbe8856640 1 -- 172.21.15.7:0/3970354201 wait complete. 2024-09-21T05:54:18.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:18 smithi027 ceph-mon[34364]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-09-21T05:54:18.539 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:18 smithi007 ceph-mon[30983]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-09-21T05:54:18.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:18 smithi119 ceph-mon[34833]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-09-21T05:54:18.844 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T05:54:19.123 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:19.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:19 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3970354201' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:19.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:19 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3970354201' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:19.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:19 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3970354201' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:19.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.639+0000 7f8809d4f640 1 -- 172.21.15.7:0/1237279047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88041086f0 msgr2=0x7f8804108b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.639+0000 7f8809d4f640 1 --2- 172.21.15.7:0/1237279047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88041086f0 0x7f8804108b00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009900 tx=0x7f87f402a410 comp rx=0 tx=0).stop 2024-09-21T05:54:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.640+0000 7f8809d4f640 1 -- 172.21.15.7:0/1237279047 shutdown_connections 2024-09-21T05:54:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.640+0000 7f8809d4f640 1 --2- 172.21.15.7:0/1237279047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8804102730 0x7f8804110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.640+0000 7f8809d4f640 1 --2- 172.21.15.7:0/1237279047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8804101de0 0x7f88041021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.640+0000 7f8809d4f640 1 --2- 172.21.15.7:0/1237279047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88041086f0 0x7f8804108b00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.640+0000 7f8809d4f640 1 -- 172.21.15.7:0/1237279047 >> 172.21.15.7:0/1237279047 conn(0x7f8804077c60 msgr2=0x7f88040780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.640+0000 7f8809d4f640 1 -- 172.21.15.7:0/1237279047 shutdown_connections 2024-09-21T05:54:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.640+0000 7f8809d4f640 1 -- 172.21.15.7:0/1237279047 wait complete. 2024-09-21T05:54:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.641+0000 7f8809d4f640 1 Processor -- start 2024-09-21T05:54:19.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.641+0000 7f8809d4f640 1 -- start start 2024-09-21T05:54:19.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.641+0000 7f8809d4f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8804101de0 0x7f880419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.641+0000 7f8809d4f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8804102730 0x7f880419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.641+0000 7f8809d4f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88041086f0 0x7f880419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.641+0000 7f8809d4f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8804113aa0 con 0x7f8804101de0 2024-09-21T05:54:19.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.641+0000 7f8809d4f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8804113920 con 0x7f88041086f0 2024-09-21T05:54:19.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.641+0000 7f8809d4f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8804113c20 con 0x7f8804102730 2024-09-21T05:54:19.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.641+0000 7f88037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8804101de0 0x7f880419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.642+0000 7f88037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8804101de0 0x7f880419a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37398/0 (socket says 172.21.15.7:37398) 2024-09-21T05:54:19.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.642+0000 7f88037fe640 1 -- 172.21.15.7:0/3574188906 learned_addr learned my addr 172.21.15.7:0/3574188906 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:19.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.642+0000 7f8803fff640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88041086f0 0x7f880419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.642+0000 7f8802ffd640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8804102730 0x7f880419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.642+0000 7f88037fe640 1 -- 172.21.15.7:0/3574188906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8804102730 msgr2=0x7f880419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:19.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.642+0000 7f88037fe640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8804102730 0x7f880419aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.642+0000 7f88037fe640 1 -- 172.21.15.7:0/3574188906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88041086f0 msgr2=0x7f880419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:19.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.642+0000 7f88037fe640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88041086f0 0x7f880419fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.642+0000 7f88037fe640 1 -- 172.21.15.7:0/3574188906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88041a04a0 con 0x7f8804101de0 2024-09-21T05:54:19.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.642+0000 7f8803fff640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88041086f0 0x7f880419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:19.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.642+0000 7f88037fe640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8804101de0 0x7f880419a530 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f87f4005940 tx=0x7f87f40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:19.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.643+0000 7f8800ff9640 1 -- 172.21.15.7:0/3574188906 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f403f030 con 0x7f8804101de0 2024-09-21T05:54:19.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.643+0000 7f8800ff9640 1 -- 172.21.15.7:0/3574188906 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87f40044c0 con 0x7f8804101de0 2024-09-21T05:54:19.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.643+0000 7f8809d4f640 1 -- 172.21.15.7:0/3574188906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88041a0730 con 0x7f8804101de0 2024-09-21T05:54:19.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.643+0000 7f8800ff9640 1 -- 172.21.15.7:0/3574188906 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4035070 con 0x7f8804101de0 2024-09-21T05:54:19.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.643+0000 7f8809d4f640 1 -- 172.21.15.7:0/3574188906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88041a6ef0 con 0x7f8804101de0 2024-09-21T05:54:19.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.646+0000 7f8800ff9640 1 -- 172.21.15.7:0/3574188906 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f87f4042030 con 0x7f8804101de0 2024-09-21T05:54:19.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.646+0000 7f88102c3740 1 Processor -- start 2024-09-21T05:54:19.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.646+0000 7f88102c3740 1 -- start start 2024-09-21T05:54:19.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.647+0000 7f88102c3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 0x56210a3b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.647+0000 7f88102c3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109fe31b0 0x56210a3b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.647+0000 7f88102c3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 0x56210a3b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.647+0000 7f88102c3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56210a329ea0 con 0x562109feb390 2024-09-21T05:54:19.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.647+0000 7f88102c3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56210a3192d0 con 0x562109fe31b0 2024-09-21T05:54:19.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.647+0000 7f88102c3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56210a31d0e0 con 0x56210a00c070 2024-09-21T05:54:19.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.647+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 0x56210a3b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.647+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 0x56210a3b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37402/0 (socket says 172.21.15.7:37402) 2024-09-21T05:54:19.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.647+0000 7f8802ffd640 1 -- 172.21.15.7:0/286042566 learned_addr learned my addr 172.21.15.7:0/286042566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:19.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.647+0000 7f8803fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 0x56210a3b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.647+0000 7f88037fe640 1 --2- 172.21.15.7:0/286042566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109fe31b0 0x56210a3b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.647+0000 7f8800ff9640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f87ec0b6700 0x7f87ec0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.648+0000 7f8803fff640 1 -- 172.21.15.7:0/286042566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109fe31b0 msgr2=0x56210a3b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.648+0000 7f8803fff640 1 --2- 172.21.15.7:0/286042566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109fe31b0 0x56210a3b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.648+0000 7f8803fff640 1 -- 172.21.15.7:0/286042566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 msgr2=0x56210a3b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.648+0000 7f8803fff640 1 --2- 172.21.15.7:0/286042566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 0x56210a3b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.648+0000 7f8803fff640 1 -- 172.21.15.7:0/286042566 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56210a077650 con 0x56210a00c070 2024-09-21T05:54:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.648+0000 7f8802ffd640 1 --2- 172.21.15.7:0/286042566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 0x56210a3b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.648+0000 7f88037fe640 1 --2- 172.21.15.7:0/286042566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109fe31b0 0x56210a3b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.648+0000 7f8800ff9640 1 -- 172.21.15.7:0/3574188906 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f87f4107a20 con 0x7f8804101de0 2024-09-21T05:54:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.648+0000 7f8803fff640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f87ec0b6700 0x7f87ec0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.648+0000 7f8803fff640 1 --2- 172.21.15.7:0/286042566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 0x56210a3b36a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87fc011760 tx=0x7f87fc011c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88492d09d7353895 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.649+0000 7f87e9ffb640 1 -- 172.21.15.7:0/286042566 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00fe20 con 0x56210a00c070 2024-09-21T05:54:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.649+0000 7f87e9ffb640 1 -- 172.21.15.7:0/286042566 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87fc0198d0 con 0x56210a00c070 2024-09-21T05:54:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.649+0000 7f87e9ffb640 1 -- 172.21.15.7:0/286042566 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00e6f0 con 0x56210a00c070 2024-09-21T05:54:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.650+0000 7f88102c3740 1 -- 172.21.15.7:0/286042566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 msgr2=0x56210a3b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.650+0000 7f8803fff640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f87ec0b6700 0x7f87ec0b8c10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f87fc020000 tx=0x7f87fc021000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.650+0000 7f88102c3740 1 --2- 172.21.15.7:0/286042566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 0x56210a3b36a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87fc011760 tx=0x7f87fc011c20 comp rx=0 tx=0).stop 2024-09-21T05:54:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.650+0000 7f88102c3740 1 -- 172.21.15.7:0/286042566 shutdown_connections 2024-09-21T05:54:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.650+0000 7f88102c3740 1 --2- 172.21.15.7:0/286042566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 0x56210a3b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.650+0000 7f88102c3740 1 --2- 172.21.15.7:0/286042566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109fe31b0 0x56210a3b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.650+0000 7f88102c3740 1 --2- 172.21.15.7:0/286042566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 0x56210a3b36a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.650+0000 7f88102c3740 1 -- 172.21.15.7:0/286042566 >> 172.21.15.7:0/286042566 conn(0x56210a000460 msgr2=0x56210a3b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:19.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.650+0000 7f88102c3740 1 -- 172.21.15.7:0/286042566 shutdown_connections 2024-09-21T05:54:19.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.650+0000 7f88102c3740 1 -- 172.21.15.7:0/286042566 wait complete. 2024-09-21T05:54:19.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.650+0000 7f88102c3740 1 -- start start 2024-09-21T05:54:19.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.651+0000 7f88102c3740 1 Processor -- start 2024-09-21T05:54:19.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.651+0000 7f88102c3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109fe31b0 0x56210a3c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.651+0000 7f88102c3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 0x56210a3c3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.651+0000 7f88102c3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 0x56210a3cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.651+0000 7f88102c3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56210a17a700 con 0x562109feb390 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.651+0000 7f88102c3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56210a2b4160 con 0x562109fe31b0 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.651+0000 7f88102c3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56210a3c61e0 con 0x56210a00c070 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.651+0000 7f88102c3740 10 client.0 _ll_register_callbacks cb 0x56210a2cd9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.651+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 0x56210a3c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.651+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 0x56210a3c3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37406/0 (socket says 172.21.15.7:37406) 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.651+0000 7f8802ffd640 1 -- 172.21.15.7:0/1573490073 learned_addr learned my addr 172.21.15.7:0/1573490073 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.651+0000 7f88037fe640 1 --2- 172.21.15.7:0/1573490073 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109fe31b0 0x56210a3c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.652+0000 7f8803fff640 1 --2- 172.21.15.7:0/1573490073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 0x56210a3cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.652+0000 7f8802ffd640 1 -- 172.21.15.7:0/1573490073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 msgr2=0x56210a3cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.652+0000 7f8802ffd640 1 --2- 172.21.15.7:0/1573490073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 0x56210a3cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.652+0000 7f8802ffd640 1 -- 172.21.15.7:0/1573490073 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109fe31b0 msgr2=0x56210a3c31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:19.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.652+0000 7f8802ffd640 1 --2- 172.21.15.7:0/1573490073 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109fe31b0 0x56210a3c31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.652+0000 7f8802ffd640 1 -- 172.21.15.7:0/1573490073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56210a2e1c90 con 0x562109feb390 2024-09-21T05:54:19.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.652+0000 7f8802ffd640 1 --2- 172.21.15.7:0/1573490073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 0x56210a3c3700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f87f80136e0 tx=0x7f87f8013ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b568dfe11af594c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:19.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.652+0000 7f87e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:54:19.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.652+0000 7f87e2ffd640 1 -- 172.21.15.7:0/1573490073 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f8011dd0 con 0x562109feb390 2024-09-21T05:54:19.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.652+0000 7f87e2ffd640 1 -- 172.21.15.7:0/1573490073 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f87f801b3e0 con 0x562109feb390 2024-09-21T05:54:19.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.652+0000 7f88102c3740 1 -- 172.21.15.7:0/1573490073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87fc0198d0 con 0x562109feb390 2024-09-21T05:54:19.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.653+0000 7f87e2ffd640 1 -- 172.21.15.7:0/1573490073 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f87f801b5e0 con 0x562109feb390 2024-09-21T05:54:19.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.653+0000 7f88102c3740 10 client.15594 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:19.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.653+0000 7f88102c3740 1 -- 172.21.15.7:0/1573490073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56210a3d1fc0 con 0x562109feb390 2024-09-21T05:54:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.653+0000 7f87e2ffd640 1 -- 172.21.15.7:0/1573490073 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87f801bc30 con 0x562109feb390 2024-09-21T05:54:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.653+0000 7f87e2ffd640 1 -- 172.21.15.7:0/1573490073 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f87f801a070 con 0x562109feb390 2024-09-21T05:54:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.653+0000 7f88102c3740 10 client.15594 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.653+0000 7f88102c3740 10 client.15594 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:54:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.653+0000 7f88102c3740 20 client.15594 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.653+0000 7f88102c3740 1 --2- 172.21.15.7:0/1573490073 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562109fca9f0 0x56210a3d5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.653+0000 7f88102c3740 4 client.15594 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.653+0000 7f88102c3740 1 -- 172.21.15.7:0/1573490073 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f87fc0198d0 con 0x562109fca9f0 2024-09-21T05:54:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.654+0000 7f88037fe640 1 --2- 172.21.15.7:0/1573490073 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562109fca9f0 0x56210a3d5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.654+0000 7f87e2ffd640 10 client.15594 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:54:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.654+0000 7f88037fe640 1 --2- 172.21.15.7:0/1573490073 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562109fca9f0 0x56210a3d5530 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=afa9f06a3d287e04 server_cookie=d8d3f6502453d3ac in_seq=0 out_seq=0 2024-09-21T05:54:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.655+0000 7f87e2ffd640 1 -- 172.21.15.7:0/1573490073 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f87fc0198d0 con 0x562109fca9f0 2024-09-21T05:54:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.655+0000 7f87e2ffd640 10 client.15594 handle_command_reply: tid=0 2024-09-21T05:54:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.655+0000 7f88102c3740 1 client.15594 shutdown 2024-09-21T05:54:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.656+0000 7f88102c3740 1 -- 172.21.15.7:0/1573490073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 msgr2=0x56210a3c3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.656+0000 7f88102c3740 1 --2- 172.21.15.7:0/1573490073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 0x56210a3c3700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f87f80136e0 tx=0x7f87f8013ba0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.656+0000 7f88102c3740 1 -- 172.21.15.7:0/1573490073 shutdown_connections 2024-09-21T05:54:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.656+0000 7f88102c3740 1 --2- 172.21.15.7:0/1573490073 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562109fca9f0 0x56210a3d5530 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.656+0000 7f88102c3740 1 --2- 172.21.15.7:0/1573490073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109feb390 0x56210a3c3700 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.656+0000 7f88102c3740 1 --2- 172.21.15.7:0/1573490073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 0x56210a3cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.656+0000 7f88102c3740 1 --2- 172.21.15.7:0/1573490073 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109fe31b0 0x56210a3c31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.656+0000 7f88102c3740 1 -- 172.21.15.7:0/1573490073 >> 172.21.15.7:0/1573490073 conn(0x56210a000460 msgr2=0x56210a3b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.656+0000 7f87e2ffd640 0 client.15594 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:54:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.656+0000 7f88102c3740 1 -- 172.21.15.7:0/1573490073 shutdown_connections 2024-09-21T05:54:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.656+0000 7f88102c3740 1 -- 172.21.15.7:0/1573490073 wait complete. 2024-09-21T05:54:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.656+0000 7f88102c3740 20 client.15594 trim_cache size 0 max 16384 2024-09-21T05:54:19.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.670+0000 7f88102c3740 1 Processor -- start 2024-09-21T05:54:19.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.670+0000 7f88102c3740 1 -- start start 2024-09-21T05:54:19.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.670+0000 7f88102c3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562109fe31b0 0x56210a3b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.670+0000 7f88102c3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109feb390 0x56210a3c03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.670+0000 7f88102c3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56210a00c070 0x56210a3c08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.670+0000 7f88102c3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f88041afc30 con 0x56210a00c070 2024-09-21T05:54:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.670+0000 7f88102c3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f88041ad500 con 0x562109feb390 2024-09-21T05:54:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.670+0000 7f88102c3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f88041ab350 con 0x562109fe31b0 2024-09-21T05:54:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.670+0000 7f8803fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56210a00c070 0x56210a3c08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.671+0000 7f8803fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56210a00c070 0x56210a3c08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37420/0 (socket says 172.21.15.7:37420) 2024-09-21T05:54:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.671+0000 7f8803fff640 1 -- 172.21.15.7:0/2294888457 learned_addr learned my addr 172.21.15.7:0/2294888457 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.671+0000 7f88037fe640 1 --2- 172.21.15.7:0/2294888457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562109fe31b0 0x56210a3b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.671+0000 7f8802ffd640 1 --2- 172.21.15.7:0/2294888457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109feb390 0x56210a3c03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.671+0000 7f8803fff640 1 -- 172.21.15.7:0/2294888457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562109fe31b0 msgr2=0x56210a3b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.671+0000 7f8803fff640 1 --2- 172.21.15.7:0/2294888457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562109fe31b0 0x56210a3b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.671+0000 7f8803fff640 1 -- 172.21.15.7:0/2294888457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109feb390 msgr2=0x56210a3c03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.671+0000 7f8803fff640 1 --2- 172.21.15.7:0/2294888457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109feb390 0x56210a3c03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.671+0000 7f8803fff640 1 -- 172.21.15.7:0/2294888457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56210a3ab840 con 0x56210a00c070 2024-09-21T05:54:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.671+0000 7f8803fff640 1 --2- 172.21.15.7:0/2294888457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56210a00c070 0x56210a3c08f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f87fc005fd0 tx=0x7f87fc027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ad925d8e14da8f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.672+0000 7f87e97fa640 1 -- 172.21.15.7:0/2294888457 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc033030 con 0x56210a00c070 2024-09-21T05:54:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.672+0000 7f87e97fa640 1 -- 172.21.15.7:0/2294888457 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87fc011040 con 0x56210a00c070 2024-09-21T05:54:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.672+0000 7f87e97fa640 1 -- 172.21.15.7:0/2294888457 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc029040 con 0x56210a00c070 2024-09-21T05:54:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.672+0000 7f88102c3740 1 -- 172.21.15.7:0/2294888457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56210a00c070 msgr2=0x56210a3c08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.672+0000 7f88102c3740 1 --2- 172.21.15.7:0/2294888457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56210a00c070 0x56210a3c08f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f87fc005fd0 tx=0x7f87fc027000 comp rx=0 tx=0).stop 2024-09-21T05:54:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.673+0000 7f88102c3740 1 -- 172.21.15.7:0/2294888457 shutdown_connections 2024-09-21T05:54:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.673+0000 7f88102c3740 1 --2- 172.21.15.7:0/2294888457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56210a00c070 0x56210a3c08f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.673+0000 7f88102c3740 1 --2- 172.21.15.7:0/2294888457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109feb390 0x56210a3c03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.673+0000 7f88102c3740 1 --2- 172.21.15.7:0/2294888457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562109fe31b0 0x56210a3b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.673+0000 7f88102c3740 1 -- 172.21.15.7:0/2294888457 >> 172.21.15.7:0/2294888457 conn(0x56210a000460 msgr2=0x56210a3b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.673+0000 7f88102c3740 1 -- 172.21.15.7:0/2294888457 shutdown_connections 2024-09-21T05:54:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.673+0000 7f88102c3740 1 -- 172.21.15.7:0/2294888457 wait complete. 2024-09-21T05:54:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.673+0000 7f88102c3740 1 -- start start 2024-09-21T05:54:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.674+0000 7f88102c3740 1 Processor -- start 2024-09-21T05:54:19.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.674+0000 7f88102c3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109fe31b0 0x56210a3cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.674+0000 7f88102c3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109feb390 0x56210a3c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.674+0000 7f88102c3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 0x56210a3c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.674+0000 7f88102c3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f88041ab9c0 con 0x562109fe31b0 2024-09-21T05:54:19.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.674+0000 7f88102c3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f88041ace30 con 0x562109feb390 2024-09-21T05:54:19.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.674+0000 7f88102c3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f88041ac090 con 0x56210a00c070 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.674+0000 7f88102c3740 10 client.0 _ll_register_callbacks cb 0x7f87f8005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.674+0000 7f88037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109fe31b0 0x56210a3cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.674+0000 7f88037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109fe31b0 0x56210a3cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37426/0 (socket says 172.21.15.7:37426) 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.674+0000 7f88037fe640 1 -- 172.21.15.7:0/1377587392 learned_addr learned my addr 172.21.15.7:0/1377587392 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.674+0000 7f8803fff640 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 0x56210a3c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.674+0000 7f8802ffd640 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109feb390 0x56210a3c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.675+0000 7f88037fe640 1 -- 172.21.15.7:0/1377587392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 msgr2=0x56210a3c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.675+0000 7f88037fe640 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 0x56210a3c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.675+0000 7f88037fe640 1 -- 172.21.15.7:0/1377587392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109feb390 msgr2=0x56210a3c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.675+0000 7f88037fe640 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109feb390 0x56210a3c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.675+0000 7f88037fe640 1 -- 172.21.15.7:0/1377587392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56210a3c99b0 con 0x562109fe31b0 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.675+0000 7f8802ffd640 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109feb390 0x56210a3c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.675+0000 7f88037fe640 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109fe31b0 0x56210a3cba30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f87f41057f0 tx=0x7f87f402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105c09ced3a01545 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:19.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.675+0000 7f87e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.675+0000 7f87e2ffd640 1 -- 172.21.15.7:0/1377587392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4049040 con 0x562109fe31b0 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.675+0000 7f88102c3740 1 -- 172.21.15.7:0/1377587392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87fc011040 con 0x562109fe31b0 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.675+0000 7f87e2ffd640 1 -- 172.21.15.7:0/1377587392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f87f40d6e80 con 0x562109fe31b0 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.676+0000 7f87e2ffd640 1 -- 172.21.15.7:0/1377587392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f87f40cd400 con 0x562109fe31b0 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.676+0000 7f88102c3740 10 client.15600 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.676+0000 7f88102c3740 1 -- 172.21.15.7:0/1377587392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56210a43fbf0 con 0x562109fe31b0 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.676+0000 7f87e2ffd640 1 -- 172.21.15.7:0/1377587392 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87fc011040 con 0x562109fe31b0 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.676+0000 7f87e2ffd640 1 -- 172.21.15.7:0/1377587392 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f87f40f3070 con 0x562109fe31b0 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.676+0000 7f88102c3740 10 client.15600 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.676+0000 7f88102c3740 10 client.15600 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.676+0000 7f88102c3740 20 client.15600 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.676+0000 7f88102c3740 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562109f9fda0 0x56210a442360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.676+0000 7f88102c3740 4 client.15600 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:54:19.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.676+0000 7f88102c3740 1 -- 172.21.15.7:0/1377587392 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56210a32bdf0 con 0x562109f9fda0 2024-09-21T05:54:19.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.677+0000 7f8802ffd640 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562109f9fda0 0x56210a442360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.677+0000 7f87e2ffd640 10 client.15600 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:54:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.677+0000 7f8802ffd640 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562109f9fda0 0x56210a442360 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3098bf0bb5ead0f8 server_cookie=21dd115de9dbb3 in_seq=0 out_seq=0 2024-09-21T05:54:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f87e2ffd640 1 -- 172.21.15.7:0/1377587392 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56210a32bdf0 con 0x562109f9fda0 2024-09-21T05:54:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f87e2ffd640 10 client.15600 handle_command_reply: tid=0 2024-09-21T05:54:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f88102c3740 1 client.15600 shutdown 2024-09-21T05:54:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f88102c3740 1 -- 172.21.15.7:0/1377587392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109fe31b0 msgr2=0x56210a3cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f88102c3740 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109fe31b0 0x56210a3cba30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f87f41057f0 tx=0x7f87f402a410 comp rx=0 tx=0).stop 2024-09-21T05:54:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f88102c3740 1 -- 172.21.15.7:0/1377587392 shutdown_connections 2024-09-21T05:54:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f88102c3740 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562109f9fda0 0x56210a442360 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f88102c3740 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56210a00c070 0x56210a3c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f88102c3740 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562109feb390 0x56210a3c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f88102c3740 1 --2- 172.21.15.7:0/1377587392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562109fe31b0 0x56210a3cba30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f88102c3740 1 -- 172.21.15.7:0/1377587392 >> 172.21.15.7:0/1377587392 conn(0x56210a000460 msgr2=0x56210a3b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:19.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f87e2ffd640 0 client.15600 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:54:19.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f88102c3740 1 -- 172.21.15.7:0/1377587392 shutdown_connections 2024-09-21T05:54:19.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.678+0000 7f88102c3740 1 -- 172.21.15.7:0/1377587392 wait complete. 2024-09-21T05:54:19.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.679+0000 7f88102c3740 20 client.15600 trim_cache size 0 max 16384 2024-09-21T05:54:19.683 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:54:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.679+0000 7f8809d4f640 1 -- 172.21.15.7:0/3574188906 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f87ec0b6700 msgr2=0x7f87ec0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.679+0000 7f8809d4f640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f87ec0b6700 0x7f87ec0b8c10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f87fc020000 tx=0x7f87fc021000 comp rx=0 tx=0).stop 2024-09-21T05:54:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.679+0000 7f8809d4f640 1 -- 172.21.15.7:0/3574188906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8804101de0 msgr2=0x7f880419a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.679+0000 7f8809d4f640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8804101de0 0x7f880419a530 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f87f4005940 tx=0x7f87f40040c0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.679+0000 7f8809d4f640 1 -- 172.21.15.7:0/3574188906 shutdown_connections 2024-09-21T05:54:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.679+0000 7f8809d4f640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f87ec0b6700 0x7f87ec0b8c10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.679+0000 7f8809d4f640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88041086f0 0x7f880419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.679+0000 7f8809d4f640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8804102730 0x7f880419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.679+0000 7f8809d4f640 1 --2- 172.21.15.7:0/3574188906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8804101de0 0x7f880419a530 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.679+0000 7f8809d4f640 1 -- 172.21.15.7:0/3574188906 >> 172.21.15.7:0/3574188906 conn(0x7f8804077c60 msgr2=0x7f8804107570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.680+0000 7f8809d4f640 1 -- 172.21.15.7:0/3574188906 shutdown_connections 2024-09-21T05:54:19.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:19.680+0000 7f8809d4f640 1 -- 172.21.15.7:0/3574188906 wait complete. 2024-09-21T05:54:20.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T05:54:20.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:20 smithi027 ceph-mon[34364]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-21T05:54:20.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:20 smithi007 ceph-mon[30983]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-21T05:54:20.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:20 smithi119 ceph-mon[34833]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-21T05:54:20.629 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:21.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.186+0000 7f402461a640 1 -- 172.21.15.7:0/1769398657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c1083a0 msgr2=0x7f401c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:21.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.186+0000 7f402461a640 1 --2- 172.21.15.7:0/1769398657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c1083a0 0x7f401c1087b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f400c009900 tx=0x7f400c02a410 comp rx=0 tx=0).stop 2024-09-21T05:54:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.186+0000 7f402461a640 1 -- 172.21.15.7:0/1769398657 shutdown_connections 2024-09-21T05:54:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.186+0000 7f402461a640 1 --2- 172.21.15.7:0/1769398657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c1083a0 0x7f401c1087b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.187+0000 7f402461a640 1 --2- 172.21.15.7:0/1769398657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f401c108cf0 0x7f401c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.187+0000 7f402461a640 1 --2- 172.21.15.7:0/1769398657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f401c102a60 0x7f401c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.187+0000 7f402461a640 1 -- 172.21.15.7:0/1769398657 >> 172.21.15.7:0/1769398657 conn(0x7f401c079730 msgr2=0x7f401c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.187+0000 7f402461a640 1 -- 172.21.15.7:0/1769398657 shutdown_connections 2024-09-21T05:54:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.187+0000 7f402461a640 1 -- 172.21.15.7:0/1769398657 wait complete. 2024-09-21T05:54:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.188+0000 7f402461a640 1 Processor -- start 2024-09-21T05:54:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.188+0000 7f402461a640 1 -- start start 2024-09-21T05:54:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.189+0000 7f402461a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c102a60 0x7f401c19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.189+0000 7f40223b6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c102a60 0x7f401c19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.189+0000 7f40223b6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c102a60 0x7f401c19c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37450/0 (socket says 172.21.15.7:37450) 2024-09-21T05:54:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.189+0000 7f40223b6640 1 -- 172.21.15.7:0/4908169 learned_addr learned my addr 172.21.15.7:0/4908169 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.189+0000 7f402461a640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f401c1083a0 0x7f401c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.189+0000 7f402461a640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f401c108cf0 0x7f401c1a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.189+0000 7f402461a640 1 -- 172.21.15.7:0/4908169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f401c111860 con 0x7f401c102a60 2024-09-21T05:54:21.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.189+0000 7f402461a640 1 -- 172.21.15.7:0/4908169 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1116e0 con 0x7f401c1083a0 2024-09-21T05:54:21.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.189+0000 7f402461a640 1 -- 172.21.15.7:0/4908169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1119e0 con 0x7f401c108cf0 2024-09-21T05:54:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.190+0000 7f4022bb7640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f401c108cf0 0x7f401c1a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.190+0000 7f4021bb5640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f401c1083a0 0x7f401c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.190+0000 7f4022bb7640 1 -- 172.21.15.7:0/4908169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f401c1083a0 msgr2=0x7f401c19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.190+0000 7f4022bb7640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f401c1083a0 0x7f401c19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.190+0000 7f4022bb7640 1 -- 172.21.15.7:0/4908169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c102a60 msgr2=0x7f401c19c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.190+0000 7f4022bb7640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c102a60 0x7f401c19c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.190+0000 7f4022bb7640 1 -- 172.21.15.7:0/4908169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401c1a25d0 con 0x7f401c108cf0 2024-09-21T05:54:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.190+0000 7f40223b6640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c102a60 0x7f401c19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.190+0000 7f4022bb7640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f401c108cf0 0x7f401c1a1ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f401400e940 tx=0x7f401400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.191+0000 7f40137fe640 1 -- 172.21.15.7:0/4908169 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014004d20 con 0x7f401c108cf0 2024-09-21T05:54:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.191+0000 7f40137fe640 1 -- 172.21.15.7:0/4908169 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4014005020 con 0x7f401c108cf0 2024-09-21T05:54:21.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.191+0000 7f40137fe640 1 -- 172.21.15.7:0/4908169 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40140116d0 con 0x7f401c108cf0 2024-09-21T05:54:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.191+0000 7f402461a640 1 -- 172.21.15.7:0/4908169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401c1a28c0 con 0x7f401c108cf0 2024-09-21T05:54:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.191+0000 7f402461a640 1 -- 172.21.15.7:0/4908169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f401c1a9020 con 0x7f401c108cf0 2024-09-21T05:54:21.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.194+0000 7f402ab8e740 1 Processor -- start 2024-09-21T05:54:21.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.195+0000 7f40137fe640 1 -- 172.21.15.7:0/4908169 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f4014005460 con 0x7f401c108cf0 2024-09-21T05:54:21.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.195+0000 7f402ab8e740 1 -- start start 2024-09-21T05:54:21.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.196+0000 7f402ab8e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072dc92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.196+0000 7f402ab8e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dc9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.196+0000 7f402ab8e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a01390 0x559072dc9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.196+0000 7f402ab8e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559072d3fea0 con 0x559072a22070 2024-09-21T05:54:21.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.196+0000 7f402ab8e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559072d2f2d0 con 0x559072a01390 2024-09-21T05:54:21.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.196+0000 7f402ab8e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559072d330e0 con 0x5590729f91b0 2024-09-21T05:54:21.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.196+0000 7f4021bb5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072dc92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.196+0000 7f4021bb5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072dc92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37454/0 (socket says 172.21.15.7:37454) 2024-09-21T05:54:21.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.196+0000 7f4021bb5640 1 -- 172.21.15.7:0/4192340764 learned_addr learned my addr 172.21.15.7:0/4192340764 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:21.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.196+0000 7f40223b6640 1 --2- 172.21.15.7:0/4192340764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dc9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.197+0000 7f4021bb5640 1 -- 172.21.15.7:0/4192340764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 msgr2=0x559072dc9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:21.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.197+0000 7f4021bb5640 1 --2- 172.21.15.7:0/4192340764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dc9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.197+0000 7f4021bb5640 1 -- 172.21.15.7:0/4192340764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a01390 msgr2=0x559072dc9d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T05:54:21.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.197+0000 7f4021bb5640 1 --2- 172.21.15.7:0/4192340764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a01390 0x559072dc9d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.197+0000 7f4021bb5640 1 -- 172.21.15.7:0/4192340764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559072a8d650 con 0x559072a22070 2024-09-21T05:54:21.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.197+0000 7f4021bb5640 1 --2- 172.21.15.7:0/4192340764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072dc92c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f400c009900 tx=0x7f400c032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dddec456a0e0ba39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:21.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.197+0000 7f40137fe640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f40080b6670 0x7f40080b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.198+0000 7f40137fe640 1 -- 172.21.15.7:0/4908169 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f40140e77d0 con 0x7f401c108cf0 2024-09-21T05:54:21.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.197+0000 7f40223b6640 1 --2- 172.21.15.7:0/4192340764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dc9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:21.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.198+0000 7f4010ff9640 1 -- 172.21.15.7:0/4192340764 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c03f070 con 0x559072a22070 2024-09-21T05:54:21.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.198+0000 7f4010ff9640 1 -- 172.21.15.7:0/4192340764 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f400c004030 con 0x559072a22070 2024-09-21T05:54:21.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.198+0000 7f4010ff9640 1 -- 172.21.15.7:0/4192340764 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c035070 con 0x559072a22070 2024-09-21T05:54:21.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.198+0000 7f40223b6640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f40080b6670 0x7f40080b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.199+0000 7f402ab8e740 1 -- 172.21.15.7:0/4192340764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 msgr2=0x559072dc92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:21.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.199+0000 7f40223b6640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f40080b6670 0x7f40080b8b80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x559072dc7f40 tx=0x7f401800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:21.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.199+0000 7f402ab8e740 1 --2- 172.21.15.7:0/4192340764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072dc92c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f400c009900 tx=0x7f400c032bd0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.199+0000 7f402ab8e740 1 -- 172.21.15.7:0/4192340764 shutdown_connections 2024-09-21T05:54:21.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.199+0000 7f402ab8e740 1 --2- 172.21.15.7:0/4192340764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a01390 0x559072dc9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.199+0000 7f402ab8e740 1 --2- 172.21.15.7:0/4192340764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dc9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.199+0000 7f402ab8e740 1 --2- 172.21.15.7:0/4192340764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072dc92c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.199+0000 7f402ab8e740 1 -- 172.21.15.7:0/4192340764 >> 172.21.15.7:0/4192340764 conn(0x559072a16460 msgr2=0x559072dc71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:21.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.199+0000 7f402ab8e740 1 -- 172.21.15.7:0/4192340764 shutdown_connections 2024-09-21T05:54:21.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.199+0000 7f402ab8e740 1 -- 172.21.15.7:0/4192340764 wait complete. 2024-09-21T05:54:21.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.200+0000 7f402ab8e740 1 -- start start 2024-09-21T05:54:21.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.200+0000 7f402ab8e740 1 Processor -- start 2024-09-21T05:54:21.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f402ab8e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5590729f91b0 0x559072dd49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f402ab8e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559072a01390 0x559072dd4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f402ab8e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072de0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f402ab8e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559072b90700 con 0x559072a22070 2024-09-21T05:54:21.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f402ab8e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559072cca160 con 0x5590729f91b0 2024-09-21T05:54:21.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f402ab8e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559072dd7a40 con 0x559072a01390 2024-09-21T05:54:21.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f402ab8e740 10 client.0 _ll_register_callbacks cb 0x559072ce39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:21.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f40223b6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5590729f91b0 0x559072dd49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f40223b6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5590729f91b0 0x559072dd49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:53248/0 (socket says 172.21.15.7:53248) 2024-09-21T05:54:21.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f40223b6640 1 -- 172.21.15.7:0/3578411897 learned_addr learned my addr 172.21.15.7:0/3578411897 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:21.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f4022bb7640 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072de0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f4021bb5640 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559072a01390 0x559072dd4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f40223b6640 1 -- 172.21.15.7:0/3578411897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559072a01390 msgr2=0x559072dd4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f40223b6640 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559072a01390 0x559072dd4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.201+0000 7f40223b6640 1 -- 172.21.15.7:0/3578411897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 msgr2=0x559072de0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.202+0000 7f40223b6640 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072de0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.202+0000 7f40223b6640 1 -- 172.21.15.7:0/3578411897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559072cf7c90 con 0x5590729f91b0 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.202+0000 7f4022bb7640 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072de0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.202+0000 7f40223b6640 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5590729f91b0 0x559072dd49a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f401800bfb0 tx=0x7f4018004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=663370575d5caf39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.202+0000 7f4005ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.202+0000 7f4005ffb640 1 -- 172.21.15.7:0/3578411897 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401802c060 con 0x5590729f91b0 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.202+0000 7f402ab8e740 1 -- 172.21.15.7:0/3578411897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f400c004030 con 0x5590729f91b0 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.202+0000 7f4005ffb640 1 -- 172.21.15.7:0/3578411897 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4018017030 con 0x5590729f91b0 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.202+0000 7f4005ffb640 1 -- 172.21.15.7:0/3578411897 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f401801fb40 con 0x5590729f91b0 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.202+0000 7f402ab8e740 10 client.25313 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.202+0000 7f402ab8e740 1 -- 172.21.15.7:0/3578411897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559072de3830 con 0x5590729f91b0 2024-09-21T05:54:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.203+0000 7f4005ffb640 1 -- 172.21.15.7:0/3578411897 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f400c004030 con 0x5590729f91b0 2024-09-21T05:54:21.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.203+0000 7f4005ffb640 1 -- 172.21.15.7:0/3578411897 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4018027410 con 0x5590729f91b0 2024-09-21T05:54:21.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.203+0000 7f402ab8e740 10 client.25313 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:21.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.203+0000 7f402ab8e740 10 client.25313 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:54:21.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.203+0000 7f402ab8e740 20 client.25313 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:21.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.203+0000 7f402ab8e740 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5590729e09f0 0x559072de70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.203+0000 7f402ab8e740 4 client.25313 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:21.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.203+0000 7f402ab8e740 1 -- 172.21.15.7:0/3578411897 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559072d41df0 con 0x5590729e09f0 2024-09-21T05:54:21.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.204+0000 7f4021bb5640 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5590729e09f0 0x559072de70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.204+0000 7f4021bb5640 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5590729e09f0 0x559072de70f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=432bb558486fbeef server_cookie=ae07e2b6d74ded9a in_seq=0 out_seq=0 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.204+0000 7f4005ffb640 10 client.25313 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.205+0000 7f4005ffb640 1 -- 172.21.15.7:0/3578411897 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559072d41df0 con 0x5590729e09f0 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.205+0000 7f4005ffb640 10 client.25313 handle_command_reply: tid=0 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.205+0000 7f402ab8e740 1 client.25313 shutdown 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.206+0000 7f402ab8e740 1 -- 172.21.15.7:0/3578411897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5590729f91b0 msgr2=0x559072dd49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.206+0000 7f402ab8e740 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5590729f91b0 0x559072dd49a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f401800bfb0 tx=0x7f4018004730 comp rx=0 tx=0).stop 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.206+0000 7f402ab8e740 1 -- 172.21.15.7:0/3578411897 shutdown_connections 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.206+0000 7f402ab8e740 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5590729e09f0 0x559072de70f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.206+0000 7f402ab8e740 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072de0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.206+0000 7f402ab8e740 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559072a01390 0x559072dd4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.206+0000 7f402ab8e740 1 --2- 172.21.15.7:0/3578411897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5590729f91b0 0x559072dd49a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.206+0000 7f402ab8e740 1 -- 172.21.15.7:0/3578411897 >> 172.21.15.7:0/3578411897 conn(0x559072a16460 msgr2=0x559072dcc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.206+0000 7f4005ffb640 0 client.25313 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.206+0000 7f402ab8e740 1 -- 172.21.15.7:0/3578411897 shutdown_connections 2024-09-21T05:54:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.206+0000 7f402ab8e740 1 -- 172.21.15.7:0/3578411897 wait complete. 2024-09-21T05:54:21.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.206+0000 7f402ab8e740 20 client.25313 trim_cache size 0 max 16384 2024-09-21T05:54:21.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.232+0000 7f402ab8e740 1 Processor -- start 2024-09-21T05:54:21.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.233+0000 7f402ab8e740 1 -- start start 2024-09-21T05:54:21.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.233+0000 7f402ab8e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dd4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.233+0000 7f402ab8e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a01390 0x559072de0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.233+0000 7f402ab8e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a22070 0x559072dc6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.233+0000 7f402ab8e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1b3ff0 con 0x559072a01390 2024-09-21T05:54:21.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.233+0000 7f402ab8e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1b18c0 con 0x559072a22070 2024-09-21T05:54:21.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.233+0000 7f402ab8e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1af730 con 0x5590729f91b0 2024-09-21T05:54:21.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.233+0000 7f4021bb5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a01390 0x559072de0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.233+0000 7f4021bb5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a01390 0x559072de0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37474/0 (socket says 172.21.15.7:37474) 2024-09-21T05:54:21.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.233+0000 7f4021bb5640 1 -- 172.21.15.7:0/4011530405 learned_addr learned my addr 172.21.15.7:0/4011530405 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:21.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.233+0000 7f4022bb7640 1 --2- 172.21.15.7:0/4011530405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a22070 0x559072dc6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.233+0000 7f40223b6640 1 --2- 172.21.15.7:0/4011530405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dd4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.234+0000 7f4021bb5640 1 -- 172.21.15.7:0/4011530405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 msgr2=0x559072dd4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:21.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.234+0000 7f4021bb5640 1 --2- 172.21.15.7:0/4011530405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dd4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.234+0000 7f4021bb5640 1 -- 172.21.15.7:0/4011530405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a22070 msgr2=0x559072dc6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:21.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.234+0000 7f4021bb5640 1 --2- 172.21.15.7:0/4011530405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a22070 0x559072dc6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.234+0000 7f4021bb5640 1 -- 172.21.15.7:0/4011530405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559072dc7b20 con 0x559072a01390 2024-09-21T05:54:21.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.234+0000 7f4022bb7640 1 --2- 172.21.15.7:0/4011530405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a22070 0x559072dc6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:21.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.234+0000 7f40223b6640 1 --2- 172.21.15.7:0/4011530405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dd4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:54:21.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.234+0000 7f4021bb5640 1 --2- 172.21.15.7:0/4011530405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a01390 0x559072de0c30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f400c006010 tx=0x7f400c032e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99657ad2c531e2e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:21.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.234+0000 7f4007fff640 1 -- 172.21.15.7:0/4011530405 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c050040 con 0x559072a01390 2024-09-21T05:54:21.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.235+0000 7f4007fff640 1 -- 172.21.15.7:0/4011530405 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f400c032030 con 0x559072a01390 2024-09-21T05:54:21.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.235+0000 7f4007fff640 1 -- 172.21.15.7:0/4011530405 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c035040 con 0x559072a01390 2024-09-21T05:54:21.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.236+0000 7f402ab8e740 1 -- 172.21.15.7:0/4011530405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a01390 msgr2=0x559072de0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:21.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.236+0000 7f402ab8e740 1 --2- 172.21.15.7:0/4011530405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a01390 0x559072de0c30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f400c006010 tx=0x7f400c032e50 comp rx=0 tx=0).stop 2024-09-21T05:54:21.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.236+0000 7f402ab8e740 1 -- 172.21.15.7:0/4011530405 shutdown_connections 2024-09-21T05:54:21.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.236+0000 7f402ab8e740 1 --2- 172.21.15.7:0/4011530405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a01390 0x559072de0c30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.236+0000 7f402ab8e740 1 --2- 172.21.15.7:0/4011530405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a22070 0x559072dc6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.236+0000 7f402ab8e740 1 --2- 172.21.15.7:0/4011530405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dd4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.236+0000 7f402ab8e740 1 -- 172.21.15.7:0/4011530405 >> 172.21.15.7:0/4011530405 conn(0x559072a16460 msgr2=0x559072dd4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:21.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.236+0000 7f402ab8e740 1 -- 172.21.15.7:0/4011530405 shutdown_connections 2024-09-21T05:54:21.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.236+0000 7f402ab8e740 1 -- 172.21.15.7:0/4011530405 wait complete. 2024-09-21T05:54:21.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.237+0000 7f402ab8e740 1 -- start start 2024-09-21T05:54:21.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.237+0000 7f402ab8e740 1 Processor -- start 2024-09-21T05:54:21.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.237+0000 7f402ab8e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dd8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.237+0000 7f402ab8e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a01390 0x559072dd85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.237+0000 7f402ab8e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072e4fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.237+0000 7f402ab8e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1afd80 con 0x559072a22070 2024-09-21T05:54:21.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.237+0000 7f402ab8e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1b11f0 con 0x559072a01390 2024-09-21T05:54:21.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.237+0000 7f402ab8e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1b0450 con 0x5590729f91b0 2024-09-21T05:54:21.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.237+0000 7f402ab8e740 10 client.0 _ll_register_callbacks cb 0x7f4018011e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:21.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.237+0000 7f40223b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dd8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.238+0000 7f40223b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dd8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:49940/0 (socket says 172.21.15.7:49940) 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.238+0000 7f40223b6640 1 -- 172.21.15.7:0/1881109511 learned_addr learned my addr 172.21.15.7:0/1881109511 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.238+0000 7f4021bb5640 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a01390 0x559072dd85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.238+0000 7f4022bb7640 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072e4fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.238+0000 7f40223b6640 1 -- 172.21.15.7:0/1881109511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a01390 msgr2=0x559072dd85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.238+0000 7f40223b6640 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a01390 0x559072dd85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.238+0000 7f40223b6640 1 -- 172.21.15.7:0/1881109511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 msgr2=0x559072e4fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.238+0000 7f40223b6640 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072e4fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.238+0000 7f40223b6640 1 -- 172.21.15.7:0/1881109511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559072e50020 con 0x5590729f91b0 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.238+0000 7f4021bb5640 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a01390 0x559072dd85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.238+0000 7f4022bb7640 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072e4fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.238+0000 7f40223b6640 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dd8080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4018010800 tx=0x7f4018027dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e855b6910536b95e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.238+0000 7f4005ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:54:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.239+0000 7f4005ffb640 1 -- 172.21.15.7:0/1881109511 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401803a680 con 0x5590729f91b0 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.239+0000 7f402ab8e740 1 -- 172.21.15.7:0/1881109511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f400c032030 con 0x5590729f91b0 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.239+0000 7f4005ffb640 1 -- 172.21.15.7:0/1881109511 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4018031430 con 0x5590729f91b0 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.239+0000 7f4005ffb640 1 -- 172.21.15.7:0/1881109511 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f401802c030 con 0x5590729f91b0 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.239+0000 7f402ab8e740 10 client.25297 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.239+0000 7f402ab8e740 1 -- 172.21.15.7:0/1881109511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559072e51080 con 0x5590729f91b0 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.240+0000 7f4005ffb640 1 -- 172.21.15.7:0/1881109511 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f400c032030 con 0x5590729f91b0 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.240+0000 7f4005ffb640 1 -- 172.21.15.7:0/1881109511 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f40180317f0 con 0x5590729f91b0 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.240+0000 7f402ab8e740 10 client.25297 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.240+0000 7f402ab8e740 10 client.25297 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.240+0000 7f402ab8e740 20 client.25297 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.240+0000 7f402ab8e740 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5590729b5da0 0x559072e53820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.240+0000 7f402ab8e740 4 client.25297 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.240+0000 7f402ab8e740 1 -- 172.21.15.7:0/1881109511 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559072d3d8a0 con 0x5590729b5da0 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.240+0000 7f4021bb5640 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5590729b5da0 0x559072e53820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f4005ffb640 10 client.25297 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f4021bb5640 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5590729b5da0 0x559072e53820 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd04955c3bc4f570 server_cookie=c83178d1af237ee5 in_seq=0 out_seq=0 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f4005ffb640 1 -- 172.21.15.7:0/1881109511 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559072d3d8a0 con 0x5590729b5da0 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f4005ffb640 10 client.25297 handle_command_reply: tid=0 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f402ab8e740 1 client.25297 shutdown 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f402ab8e740 1 -- 172.21.15.7:0/1881109511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 msgr2=0x559072dd8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f402ab8e740 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dd8080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4018010800 tx=0x7f4018027dd0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f402ab8e740 1 -- 172.21.15.7:0/1881109511 shutdown_connections 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f402ab8e740 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5590729b5da0 0x559072e53820 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f4005ffb640 0 client.25297 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f402ab8e740 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559072a22070 0x559072e4fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f402ab8e740 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559072a01390 0x559072dd85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f402ab8e740 1 --2- 172.21.15.7:0/1881109511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5590729f91b0 0x559072dd8080 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.241+0000 7f402ab8e740 1 -- 172.21.15.7:0/1881109511 >> 172.21.15.7:0/1881109511 conn(0x559072a16460 msgr2=0x559072dcc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.242+0000 7f402ab8e740 1 -- 172.21.15.7:0/1881109511 shutdown_connections 2024-09-21T05:54:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.242+0000 7f402ab8e740 1 -- 172.21.15.7:0/1881109511 wait complete. 2024-09-21T05:54:21.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.242+0000 7f402ab8e740 20 client.25297 trim_cache size 0 max 16384 2024-09-21T05:54:21.247 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:54:21.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.242+0000 7f402461a640 1 -- 172.21.15.7:0/4908169 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f40080b6670 msgr2=0x7f40080b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:21.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.242+0000 7f402461a640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f40080b6670 0x7f40080b8b80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x559072dc7f40 tx=0x7f401800b410 comp rx=0 tx=0).stop 2024-09-21T05:54:21.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.242+0000 7f402461a640 1 -- 172.21.15.7:0/4908169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f401c108cf0 msgr2=0x7f401c1a1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.242+0000 7f402461a640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f401c108cf0 0x7f401c1a1ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f401400e940 tx=0x7f401400ee00 comp rx=0 tx=0).stop 2024-09-21T05:54:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.243+0000 7f402461a640 1 -- 172.21.15.7:0/4908169 shutdown_connections 2024-09-21T05:54:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.243+0000 7f402461a640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f40080b6670 0x7f40080b8b80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.243+0000 7f402461a640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f401c108cf0 0x7f401c1a1ea0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.243+0000 7f402461a640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f401c1083a0 0x7f401c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.243+0000 7f402461a640 1 --2- 172.21.15.7:0/4908169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f401c102a60 0x7f401c19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.243+0000 7f402461a640 1 -- 172.21.15.7:0/4908169 >> 172.21.15.7:0/4908169 conn(0x7f401c079730 msgr2=0x7f401c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.243+0000 7f402461a640 1 -- 172.21.15.7:0/4908169 shutdown_connections 2024-09-21T05:54:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:21.243+0000 7f402461a640 1 -- 172.21.15.7:0/4908169 wait complete. 2024-09-21T05:54:22.043 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T05:54:22.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:22 smithi007 ceph-mon[30983]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-21T05:54:22.431 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:22.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:22 smithi027 ceph-mon[34364]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-21T05:54:22.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:22 smithi119 ceph-mon[34833]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-21T05:54:22.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.968+0000 7f200a9d6640 1 -- 172.21.15.7:0/4113971062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20041083c0 msgr2=0x7f20041087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:22.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.968+0000 7f200a9d6640 1 --2- 172.21.15.7:0/4113971062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20041083c0 0x7f20041087d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009900 tx=0x7f1ff802a410 comp rx=0 tx=0).stop 2024-09-21T05:54:22.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.969+0000 7f200a9d6640 1 -- 172.21.15.7:0/4113971062 shutdown_connections 2024-09-21T05:54:22.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.969+0000 7f200a9d6640 1 --2- 172.21.15.7:0/4113971062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20041083c0 0x7f20041087d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.969+0000 7f200a9d6640 1 --2- 172.21.15.7:0/4113971062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004108d10 0x7f200410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.969+0000 7f200a9d6640 1 --2- 172.21.15.7:0/4113971062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2004102a80 0x7f2004102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.969+0000 7f200a9d6640 1 -- 172.21.15.7:0/4113971062 >> 172.21.15.7:0/4113971062 conn(0x7f2004079740 msgr2=0x7f2004079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:22.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.969+0000 7f200a9d6640 1 -- 172.21.15.7:0/4113971062 shutdown_connections 2024-09-21T05:54:22.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.969+0000 7f200a9d6640 1 -- 172.21.15.7:0/4113971062 wait complete. 2024-09-21T05:54:22.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.970+0000 7f200a9d6640 1 Processor -- start 2024-09-21T05:54:22.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.970+0000 7f200a9d6640 1 -- start start 2024-09-21T05:54:22.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.971+0000 7f200a9d6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004102a80 0x7f20041983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:22.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.971+0000 7f200a9d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2004108d10 0x7f2004198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:22.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.971+0000 7f200a9d6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f200419db70 0x7f200419df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:22.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.971+0000 7f200a9d6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2004111880 con 0x7f200419db70 2024-09-21T05:54:22.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.971+0000 7f200a9d6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2004111700 con 0x7f2004102a80 2024-09-21T05:54:22.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.971+0000 7f200a9d6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2004111a00 con 0x7f2004108d10 2024-09-21T05:54:22.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.971+0000 7f2003fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004102a80 0x7f20041983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:22.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.971+0000 7f2003fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004102a80 0x7f20041983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:53288/0 (socket says 172.21.15.7:53288) 2024-09-21T05:54:22.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.971+0000 7f2003fff640 1 -- 172.21.15.7:0/3155669639 learned_addr learned my addr 172.21.15.7:0/3155669639 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:22.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.971+0000 7f2008f73640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f200419db70 0x7f200419df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:22.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.972+0000 7f20037fe640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2004108d10 0x7f2004198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:22.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.972+0000 7f2003fff640 1 -- 172.21.15.7:0/3155669639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2004108d10 msgr2=0x7f2004198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:22.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.972+0000 7f2003fff640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2004108d10 0x7f2004198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.972+0000 7f2003fff640 1 -- 172.21.15.7:0/3155669639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f200419db70 msgr2=0x7f200419df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:22.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.972+0000 7f2003fff640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f200419db70 0x7f200419df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.972+0000 7f2003fff640 1 -- 172.21.15.7:0/3155669639 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200419e750 con 0x7f2004102a80 2024-09-21T05:54:22.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.972+0000 7f2008f73640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f200419db70 0x7f200419df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:22.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.972+0000 7f2003fff640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004102a80 0x7f20041983f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4004650 tx=0x7f1ff4003da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:22.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.973+0000 7f20017fa640 1 -- 172.21.15.7:0/3155669639 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4009b60 con 0x7f2004102a80 2024-09-21T05:54:22.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.973+0000 7f20017fa640 1 -- 172.21.15.7:0/3155669639 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ff4009d00 con 0x7f2004102a80 2024-09-21T05:54:22.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.973+0000 7f200a9d6640 1 -- 172.21.15.7:0/3155669639 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20041a4cf0 con 0x7f2004102a80 2024-09-21T05:54:22.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.973+0000 7f20017fa640 1 -- 172.21.15.7:0/3155669639 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4004d60 con 0x7f2004102a80 2024-09-21T05:54:22.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.974+0000 7f200a9d6640 1 -- 172.21.15.7:0/3155669639 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20041a50e0 con 0x7f2004102a80 2024-09-21T05:54:22.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.977+0000 7f2010f4a740 1 Processor -- start 2024-09-21T05:54:22.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.977+0000 7f2010f4a740 1 -- start start 2024-09-21T05:54:22.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.978+0000 7f2010f4a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a914947070 0x55a914cf6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:22.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.978+0000 7f2010f4a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a91491e1b0 0x55a914cf73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:22.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.978+0000 7f2010f4a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a914926390 0x55a914cf7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:22.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.978+0000 7f2010f4a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a914c64ea0 con 0x55a914947070 2024-09-21T05:54:22.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.978+0000 7f2010f4a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a914c542d0 con 0x55a914926390 2024-09-21T05:54:22.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.978+0000 7f2010f4a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a914c580e0 con 0x55a91491e1b0 2024-09-21T05:54:22.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.978+0000 7f2008f73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a914947070 0x55a914cf6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:22.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.978+0000 7f20017fa640 1 -- 172.21.15.7:0/3155669639 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f1ff401f020 con 0x7f2004102a80 2024-09-21T05:54:22.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.978+0000 7f2008f73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a914947070 0x55a914cf6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37522/0 (socket says 172.21.15.7:37522) 2024-09-21T05:54:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.978+0000 7f2008f73640 1 -- 172.21.15.7:0/3313016345 learned_addr learned my addr 172.21.15.7:0/3313016345 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.978+0000 7f2003fff640 1 --2- 172.21.15.7:0/3313016345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a91491e1b0 0x55a914cf73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.978+0000 7f20037fe640 1 --2- 172.21.15.7:0/3313016345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a914926390 0x55a914cf7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.979+0000 7f2008f73640 1 -- 172.21.15.7:0/3313016345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a91491e1b0 msgr2=0x55a914cf73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:22.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.979+0000 7f2008f73640 1 --2- 172.21.15.7:0/3313016345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a91491e1b0 0x55a914cf73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.979+0000 7f2008f73640 1 -- 172.21.15.7:0/3313016345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a914926390 msgr2=0x55a914cf7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:22.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.979+0000 7f2008f73640 1 --2- 172.21.15.7:0/3313016345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a914926390 0x55a914cf7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.979+0000 7f2008f73640 1 -- 172.21.15.7:0/3313016345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9149b2650 con 0x55a914947070 2024-09-21T05:54:22.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.979+0000 7f2003fff640 1 --2- 172.21.15.7:0/3313016345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a91491e1b0 0x55a914cf73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:54:22.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.979+0000 7f2008f73640 1 --2- 172.21.15.7:0/3313016345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a914947070 0x55a914cf6eb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00d7c0 tx=0x7f1ffc009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4600b5c899b64a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:22.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.979+0000 7f1fea7fc640 1 -- 172.21.15.7:0/3313016345 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00de60 con 0x55a914947070 2024-09-21T05:54:22.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.980+0000 7f1fea7fc640 1 -- 172.21.15.7:0/3313016345 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ffc003970 con 0x55a914947070 2024-09-21T05:54:22.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.980+0000 7f1fea7fc640 1 -- 172.21.15.7:0/3313016345 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00ce20 con 0x55a914947070 2024-09-21T05:54:22.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.980+0000 7f20017fa640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1fec0b6780 0x7f1fec0b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:22.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.980+0000 7f2003fff640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1fec0b6780 0x7f1fec0b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:22.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.980+0000 7f20017fa640 1 -- 172.21.15.7:0/3155669639 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f1ff40e6be0 con 0x7f2004102a80 2024-09-21T05:54:22.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.981+0000 7f2010f4a740 1 -- 172.21.15.7:0/3313016345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a914947070 msgr2=0x55a914cf6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:22.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.981+0000 7f2003fff640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1fec0b6780 0x7f1fec0b8c90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55a914cf5b30 tx=0x7f1ff405c4e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:22.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.981+0000 7f2010f4a740 1 --2- 172.21.15.7:0/3313016345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a914947070 0x55a914cf6eb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00d7c0 tx=0x7f1ffc009500 comp rx=0 tx=0).stop 2024-09-21T05:54:22.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.981+0000 7f2010f4a740 1 -- 172.21.15.7:0/3313016345 shutdown_connections 2024-09-21T05:54:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.981+0000 7f2010f4a740 1 --2- 172.21.15.7:0/3313016345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a914926390 0x55a914cf7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.981+0000 7f2010f4a740 1 --2- 172.21.15.7:0/3313016345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a91491e1b0 0x55a914cf73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.981+0000 7f2010f4a740 1 --2- 172.21.15.7:0/3313016345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a914947070 0x55a914cf6eb0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.981+0000 7f2010f4a740 1 -- 172.21.15.7:0/3313016345 >> 172.21.15.7:0/3313016345 conn(0x55a91493b460 msgr2=0x55a914cf4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.981+0000 7f2010f4a740 1 -- 172.21.15.7:0/3313016345 shutdown_connections 2024-09-21T05:54:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.981+0000 7f2010f4a740 1 -- 172.21.15.7:0/3313016345 wait complete. 2024-09-21T05:54:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.982+0000 7f2010f4a740 1 -- start start 2024-09-21T05:54:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.982+0000 7f2010f4a740 1 Processor -- start 2024-09-21T05:54:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.983+0000 7f2010f4a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91491e1b0 0x55a914d02550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:22.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.983+0000 7f2008f73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91491e1b0 0x55a914d02550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:22.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.983+0000 7f2008f73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91491e1b0 0x55a914d02550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37538/0 (socket says 172.21.15.7:37538) 2024-09-21T05:54:22.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.983+0000 7f2008f73640 1 -- 172.21.15.7:0/1147444312 learned_addr learned my addr 172.21.15.7:0/1147444312 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:22.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.984+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a914926390 0x55a914d02a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:22.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.984+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a914947070 0x55a914d03010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:22.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.984+0000 7f2010f4a740 1 -- 172.21.15.7:0/1147444312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a914ab5700 con 0x55a91491e1b0 2024-09-21T05:54:22.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.984+0000 7f2010f4a740 1 -- 172.21.15.7:0/1147444312 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a914bef160 con 0x55a914926390 2024-09-21T05:54:22.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.984+0000 7f2010f4a740 1 -- 172.21.15.7:0/1147444312 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a914d05690 con 0x55a914947070 2024-09-21T05:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.984+0000 7f20037fe640 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a914926390 0x55a914d02a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.984+0000 7f2008f73640 1 -- 172.21.15.7:0/1147444312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a914947070 msgr2=0x55a914d03010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T05:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.984+0000 7f2008f73640 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a914947070 0x55a914d03010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.984+0000 7f2008f73640 1 -- 172.21.15.7:0/1147444312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a914926390 msgr2=0x55a914d02a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.984+0000 7f2008f73640 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a914926390 0x55a914d02a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.984+0000 7f2008f73640 1 -- 172.21.15.7:0/1147444312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a914c1cc90 con 0x55a91491e1b0 2024-09-21T05:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.985+0000 7f2010f4a740 10 client.0 _ll_register_callbacks cb 0x55a914c089e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.985+0000 7f2008f73640 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91491e1b0 0x55a914d02550 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00cd90 tx=0x7f1ffc00cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfbd90936de60ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.985+0000 7f1fe37fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.985+0000 7f2010f4a740 1 -- 172.21.15.7:0/1147444312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ffc003970 con 0x55a91491e1b0 2024-09-21T05:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.985+0000 7f1fe37fe640 1 -- 172.21.15.7:0/1147444312 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc030050 con 0x55a91491e1b0 2024-09-21T05:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.985+0000 7f1fe37fe640 1 -- 172.21.15.7:0/1147444312 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f1ffc004a40 con 0x55a91491e1b0 2024-09-21T05:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.986+0000 7f1fe37fe640 1 -- 172.21.15.7:0/1147444312 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1ffc026070 con 0x55a91491e1b0 2024-09-21T05:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.986+0000 7f2010f4a740 10 client.15630 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.986+0000 7f2010f4a740 1 -- 172.21.15.7:0/1147444312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55a914d11130 con 0x55a91491e1b0 2024-09-21T05:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.986+0000 7f1fe37fe640 1 -- 172.21.15.7:0/1147444312 <== mon.0 v2:172.21.15.7:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1ffc033020 con 0x55a91491e1b0 2024-09-21T05:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.986+0000 7f2010f4a740 10 client.15630 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.986+0000 7f2010f4a740 10 client.15630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.986+0000 7f2010f4a740 20 client.15630 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.986+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a9149059f0 0x55a914d144f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.986+0000 7f2010f4a740 4 client.15630 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.986+0000 7f2010f4a740 1 -- 172.21.15.7:0/1147444312 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a914c66df0 con 0x55a9149059f0 2024-09-21T05:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.987+0000 7f20037fe640 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a9149059f0 0x55a914d144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:22.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.987+0000 7f20037fe640 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a9149059f0 0x55a914d144f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c14270375ca3eb9f server_cookie=a400bd2c4906e822 in_seq=0 out_seq=0 2024-09-21T05:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.987+0000 7f1fe37fe640 10 client.15630 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.988+0000 7f1fe37fe640 1 -- 172.21.15.7:0/1147444312 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a914c66df0 con 0x55a9149059f0 2024-09-21T05:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.988+0000 7f1fe37fe640 10 client.15630 handle_command_reply: tid=0 2024-09-21T05:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.988+0000 7f2010f4a740 1 client.15630 shutdown 2024-09-21T05:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.988+0000 7f2010f4a740 1 -- 172.21.15.7:0/1147444312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91491e1b0 msgr2=0x55a914d02550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.988+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91491e1b0 0x55a914d02550 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00cd90 tx=0x7f1ffc00cdc0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.988+0000 7f2010f4a740 1 -- 172.21.15.7:0/1147444312 shutdown_connections 2024-09-21T05:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.988+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a9149059f0 0x55a914d144f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.988+0000 7f1fe37fe640 0 client.15630 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.988+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a914947070 0x55a914d03010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.988+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a914926390 0x55a914d02a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.988+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1147444312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91491e1b0 0x55a914d02550 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.989+0000 7f2010f4a740 1 -- 172.21.15.7:0/1147444312 >> 172.21.15.7:0/1147444312 conn(0x55a91493b460 msgr2=0x55a914cfa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.989+0000 7f2010f4a740 1 -- 172.21.15.7:0/1147444312 shutdown_connections 2024-09-21T05:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.989+0000 7f2010f4a740 1 -- 172.21.15.7:0/1147444312 wait complete. 2024-09-21T05:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:22.989+0000 7f2010f4a740 20 client.15630 trim_cache size 0 max 16384 2024-09-21T05:54:23.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.007+0000 7f2010f4a740 1 Processor -- start 2024-09-21T05:54:23.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.007+0000 7f2010f4a740 1 -- start start 2024-09-21T05:54:23.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.007+0000 7f2010f4a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9149059f0 0x55a914d02a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.007+0000 7f2010f4a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a91491e1b0 0x55a914cff740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2010f4a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a914926390 0x55a914cffc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2010f4a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20041b0200 con 0x55a914926390 2024-09-21T05:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2010f4a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f20041adad0 con 0x55a91491e1b0 2024-09-21T05:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2010f4a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f20041ab920 con 0x55a9149059f0 2024-09-21T05:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2008f73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a914926390 0x55a914cffc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2008f73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a914926390 0x55a914cffc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37550/0 (socket says 172.21.15.7:37550) 2024-09-21T05:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2008f73640 1 -- 172.21.15.7:0/3298505472 learned_addr learned my addr 172.21.15.7:0/3298505472 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2008f73640 1 --2- 172.21.15.7:0/3298505472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9149059f0 0x55a914d02a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f20037fe640 1 --2- 172.21.15.7:0/3298505472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a91491e1b0 0x55a914cff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2008f73640 1 -- 172.21.15.7:0/3298505472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a91491e1b0 msgr2=0x55a914cff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2008f73640 1 --2- 172.21.15.7:0/3298505472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a91491e1b0 0x55a914cff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2008f73640 1 -- 172.21.15.7:0/3298505472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a914926390 msgr2=0x55a914cffc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2008f73640 1 --2- 172.21.15.7:0/3298505472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a914926390 0x55a914cffc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2008f73640 1 -- 172.21.15.7:0/3298505472 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a914d03810 con 0x55a9149059f0 2024-09-21T05:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.008+0000 7f2008f73640 1 --2- 172.21.15.7:0/3298505472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9149059f0 0x55a914d02a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00c990 tx=0x7f1ffc023000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48fc4b4c3376f96e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.009+0000 7f1fe9ffb640 1 -- 172.21.15.7:0/3298505472 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc030040 con 0x55a9149059f0 2024-09-21T05:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.009+0000 7f1fe9ffb640 1 -- 172.21.15.7:0/3298505472 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ffc003970 con 0x55a9149059f0 2024-09-21T05:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.009+0000 7f1fe9ffb640 1 -- 172.21.15.7:0/3298505472 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc0175d0 con 0x55a9149059f0 2024-09-21T05:54:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.010+0000 7f2010f4a740 1 -- 172.21.15.7:0/3298505472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9149059f0 msgr2=0x55a914d02a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.010+0000 7f2010f4a740 1 --2- 172.21.15.7:0/3298505472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9149059f0 0x55a914d02a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00c990 tx=0x7f1ffc023000 comp rx=0 tx=0).stop 2024-09-21T05:54:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.010+0000 7f2010f4a740 1 -- 172.21.15.7:0/3298505472 shutdown_connections 2024-09-21T05:54:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.010+0000 7f2010f4a740 1 --2- 172.21.15.7:0/3298505472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a914926390 0x55a914cffc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.010+0000 7f2010f4a740 1 --2- 172.21.15.7:0/3298505472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a91491e1b0 0x55a914cff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.010+0000 7f2010f4a740 1 --2- 172.21.15.7:0/3298505472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9149059f0 0x55a914d02a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.010+0000 7f2010f4a740 1 -- 172.21.15.7:0/3298505472 >> 172.21.15.7:0/3298505472 conn(0x55a91493b460 msgr2=0x55a914d02300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:23.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.011+0000 7f2010f4a740 1 -- 172.21.15.7:0/3298505472 shutdown_connections 2024-09-21T05:54:23.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.011+0000 7f2010f4a740 1 -- 172.21.15.7:0/3298505472 wait complete. 2024-09-21T05:54:23.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.011+0000 7f2010f4a740 1 -- start start 2024-09-21T05:54:23.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.011+0000 7f2010f4a740 1 Processor -- start 2024-09-21T05:54:23.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.012+0000 7f2010f4a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9149059f0 0x55a914d07040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.012+0000 7f2010f4a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a91491e1b0 0x55a914d07580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.012+0000 7f2010f4a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a914926390 0x55a914d7dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.012+0000 7f2010f4a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20041abf90 con 0x55a9149059f0 2024-09-21T05:54:23.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.012+0000 7f2010f4a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f20041ad400 con 0x55a91491e1b0 2024-09-21T05:54:23.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.012+0000 7f2010f4a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f20041ac660 con 0x55a914926390 2024-09-21T05:54:23.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.012+0000 7f2010f4a740 10 client.0 _ll_register_callbacks cb 0x7f1ffc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.012+0000 7f2008f73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9149059f0 0x55a914d07040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.012+0000 7f2008f73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9149059f0 0x55a914d07040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37556/0 (socket says 172.21.15.7:37556) 2024-09-21T05:54:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.012+0000 7f2008f73640 1 -- 172.21.15.7:0/1285398506 learned_addr learned my addr 172.21.15.7:0/1285398506 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.012+0000 7f20037fe640 1 --2- 172.21.15.7:0/1285398506 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a91491e1b0 0x55a914d07580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.013+0000 7f20037fe640 1 -- 172.21.15.7:0/1285398506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a914926390 msgr2=0x55a914d7dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.013+0000 7f20037fe640 1 --2- 172.21.15.7:0/1285398506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a914926390 0x55a914d7dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.013+0000 7f20037fe640 1 -- 172.21.15.7:0/1285398506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9149059f0 msgr2=0x55a914d07040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.013+0000 7f20037fe640 1 --2- 172.21.15.7:0/1285398506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9149059f0 0x55a914d07040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.013+0000 7f20037fe640 1 -- 172.21.15.7:0/1285398506 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a914d7e260 con 0x55a91491e1b0 2024-09-21T05:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.013+0000 7f20037fe640 1 --2- 172.21.15.7:0/1285398506 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a91491e1b0 0x55a914d07580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2004103a80 tx=0x7f1ff8000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd5bd060782f10f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.013+0000 7f1fe37fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.013+0000 7f1fe37fe640 1 -- 172.21.15.7:0/1285398506 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8035040 con 0x55a91491e1b0 2024-09-21T05:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.014+0000 7f1fe37fe640 1 -- 172.21.15.7:0/1285398506 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f1ff80318b0 con 0x55a91491e1b0 2024-09-21T05:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.014+0000 7f2010f4a740 1 -- 172.21.15.7:0/1285398506 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ffc003970 con 0x55a91491e1b0 2024-09-21T05:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.014+0000 7f1fe37fe640 1 -- 172.21.15.7:0/1285398506 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1ff8004040 con 0x55a91491e1b0 2024-09-21T05:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.014+0000 7f2010f4a740 10 client.25337 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.014+0000 7f2010f4a740 1 -- 172.21.15.7:0/1285398506 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a914d7f4e0 con 0x55a91491e1b0 2024-09-21T05:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.014+0000 7f1fe37fe640 1 -- 172.21.15.7:0/1285398506 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ff80054f0 con 0x55a91491e1b0 2024-09-21T05:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.014+0000 7f1fe37fe640 1 -- 172.21.15.7:0/1285398506 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1ff80048c0 con 0x55a91491e1b0 2024-09-21T05:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.014+0000 7f2010f4a740 10 client.25337 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.014+0000 7f2010f4a740 10 client.25337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.014+0000 7f2010f4a740 20 client.25337 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.015+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1285398506 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a914947070 0x55a914d81c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.015+0000 7f2010f4a740 4 client.25337 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.015+0000 7f2010f4a740 1 -- 172.21.15.7:0/1285398506 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f1ffc003970 con 0x55a914947070 2024-09-21T05:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.015+0000 7f2008f73640 1 --2- 172.21.15.7:0/1285398506 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a914947070 0x55a914d81c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.015+0000 7f1fe37fe640 10 client.25337 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.015+0000 7f2008f73640 1 --2- 172.21.15.7:0/1285398506 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a914947070 0x55a914d81c90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b4a910b6bc823a7 server_cookie=3cf88218ca692811 in_seq=0 out_seq=0 2024-09-21T05:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f1fe37fe640 1 -- 172.21.15.7:0/1285398506 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f1ffc003970 con 0x55a914947070 2024-09-21T05:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f1fe37fe640 10 client.25337 handle_command_reply: tid=0 2024-09-21T05:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f2010f4a740 1 client.25337 shutdown 2024-09-21T05:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f2010f4a740 1 -- 172.21.15.7:0/1285398506 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a91491e1b0 msgr2=0x55a914d07580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1285398506 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a91491e1b0 0x55a914d07580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2004103a80 tx=0x7f1ff8000bc0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f2010f4a740 1 -- 172.21.15.7:0/1285398506 shutdown_connections 2024-09-21T05:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1285398506 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a914947070 0x55a914d81c90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1285398506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a914926390 0x55a914d7dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1285398506 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a91491e1b0 0x55a914d07580 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f1fe37fe640 0 client.25337 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f2010f4a740 1 --2- 172.21.15.7:0/1285398506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9149059f0 0x55a914d07040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f2010f4a740 1 -- 172.21.15.7:0/1285398506 >> 172.21.15.7:0/1285398506 conn(0x55a91493b460 msgr2=0x55a914d039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f2010f4a740 1 -- 172.21.15.7:0/1285398506 shutdown_connections 2024-09-21T05:54:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f2010f4a740 1 -- 172.21.15.7:0/1285398506 wait complete. 2024-09-21T05:54:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.016+0000 7f2010f4a740 20 client.25337 trim_cache size 0 max 16384 2024-09-21T05:54:23.020 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.017+0000 7f200a9d6640 1 -- 172.21.15.7:0/3155669639 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1fec0b6780 msgr2=0x7f1fec0b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.017+0000 7f200a9d6640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1fec0b6780 0x7f1fec0b8c90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55a914cf5b30 tx=0x7f1ff405c4e0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.017+0000 7f200a9d6640 1 -- 172.21.15.7:0/3155669639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004102a80 msgr2=0x7f20041983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.017+0000 7f200a9d6640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004102a80 0x7f20041983f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4004650 tx=0x7f1ff4003da0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.017+0000 7f200a9d6640 1 -- 172.21.15.7:0/3155669639 shutdown_connections 2024-09-21T05:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.017+0000 7f200a9d6640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1fec0b6780 0x7f1fec0b8c90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.017+0000 7f200a9d6640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f200419db70 0x7f200419df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.017+0000 7f200a9d6640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2004108d10 0x7f2004198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.017+0000 7f200a9d6640 1 --2- 172.21.15.7:0/3155669639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2004102a80 0x7f20041983f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.017+0000 7f200a9d6640 1 -- 172.21.15.7:0/3155669639 >> 172.21.15.7:0/3155669639 conn(0x7f2004079740 msgr2=0x7f2004106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.017+0000 7f200a9d6640 1 -- 172.21.15.7:0/3155669639 shutdown_connections 2024-09-21T05:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:23.017+0000 7f200a9d6640 1 -- 172.21.15.7:0/3155669639 wait complete. 2024-09-21T05:54:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.642+0000 7faa84720640 1 -- 172.21.15.7:0/1489592800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa7c10dd70 msgr2=0x7faa7c110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.642+0000 7faa84720640 1 --2- 172.21.15.7:0/1489592800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa7c10dd70 0x7faa7c110260 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7faa74009ca0 tx=0x7faa7402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.643+0000 7faa84720640 1 -- 172.21.15.7:0/1489592800 shutdown_connections 2024-09-21T05:54:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.643+0000 7faa84720640 1 --2- 172.21.15.7:0/1489592800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa7c10dd70 0x7faa7c110260 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.643+0000 7faa84720640 1 --2- 172.21.15.7:0/1489592800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7c105260 0x7faa7c10d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.643+0000 7faa84720640 1 --2- 172.21.15.7:0/1489592800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa7c104910 0x7faa7c104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.643+0000 7faa84720640 1 -- 172.21.15.7:0/1489592800 >> 172.21.15.7:0/1489592800 conn(0x7faa7c0fe3c0 msgr2=0x7faa7c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.643+0000 7faa84720640 1 -- 172.21.15.7:0/1489592800 shutdown_connections 2024-09-21T05:54:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.643+0000 7faa84720640 1 -- 172.21.15.7:0/1489592800 wait complete. 2024-09-21T05:54:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa84720640 1 Processor -- start 2024-09-21T05:54:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa84720640 1 -- start start 2024-09-21T05:54:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa84720640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7c104910 0x7faa7c102640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa84720640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa7c105260 0x7faa7c102b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa84720640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa7c10dd70 0x7faa7c1030c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa84720640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c1139d0 con 0x7faa7c105260 2024-09-21T05:54:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa84720640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c113850 con 0x7faa7c10dd70 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa84720640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c113b50 con 0x7faa7c104910 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa81cbb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa7c105260 0x7faa7c102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa81cbb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa7c105260 0x7faa7c102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37572/0 (socket says 172.21.15.7:37572) 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa81cbb640 1 -- 172.21.15.7:0/631713324 learned_addr learned my addr 172.21.15.7:0/631713324 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa82cbd640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa7c10dd70 0x7faa7c1030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa824bc640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7c104910 0x7faa7c102640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa81cbb640 1 -- 172.21.15.7:0/631713324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7c104910 msgr2=0x7faa7c102640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.644+0000 7faa81cbb640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7c104910 0x7faa7c102640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.645+0000 7faa81cbb640 1 -- 172.21.15.7:0/631713324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa7c10dd70 msgr2=0x7faa7c1030c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.645+0000 7faa81cbb640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa7c10dd70 0x7faa7c1030c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.645+0000 7faa81cbb640 1 -- 172.21.15.7:0/631713324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7c1a86c0 con 0x7faa7c105260 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.645+0000 7faa81cbb640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa7c105260 0x7faa7c102b80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00e9f0 tx=0x7faa6c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.645+0000 7faa737fe640 1 -- 172.21.15.7:0/631713324 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00ccc0 con 0x7faa7c105260 2024-09-21T05:54:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.645+0000 7faa84720640 1 -- 172.21.15.7:0/631713324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa7c1a89b0 con 0x7faa7c105260 2024-09-21T05:54:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.645+0000 7faa84720640 1 -- 172.21.15.7:0/631713324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa7c1a8f50 con 0x7faa7c105260 2024-09-21T05:54:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.645+0000 7faa737fe640 1 -- 172.21.15.7:0/631713324 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa6c0108e0 con 0x7faa7c105260 2024-09-21T05:54:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.645+0000 7faa737fe640 1 -- 172.21.15.7:0/631713324 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c018860 con 0x7faa7c105260 2024-09-21T05:54:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.649+0000 7faa8b68c740 1 Processor -- start 2024-09-21T05:54:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.649+0000 7faa8b68c740 1 -- start start 2024-09-21T05:54:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.650+0000 7faa8b68c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50432c1b0 0x55a5046da1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.650+0000 7faa8b68c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5043032f0 0x55a5046da700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.650+0000 7faa8b68c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a50430b4d0 0x55a5046dac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.650+0000 7faa8b68c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a5046466f0 con 0x55a5043032f0 2024-09-21T05:54:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.650+0000 7faa8b68c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a504635b20 con 0x55a50430b4d0 2024-09-21T05:54:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.650+0000 7faa8b68c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a504639930 con 0x55a50432c1b0 2024-09-21T05:54:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.650+0000 7faa737fe640 1 -- 172.21.15.7:0/631713324 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7faa6c010430 con 0x7faa7c105260 2024-09-21T05:54:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.650+0000 7faa824bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5043032f0 0x55a5046da700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.650+0000 7faa824bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5043032f0 0x55a5046da700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37584/0 (socket says 172.21.15.7:37584) 2024-09-21T05:54:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.650+0000 7faa81cbb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a50430b4d0 0x55a5046dac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.650+0000 7faa824bc640 1 -- 172.21.15.7:0/3407848399 learned_addr learned my addr 172.21.15.7:0/3407848399 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.651+0000 7faa82cbd640 1 --2- 172.21.15.7:0/3407848399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50432c1b0 0x55a5046da1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.651+0000 7faa81cbb640 1 -- 172.21.15.7:0/3407848399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50432c1b0 msgr2=0x55a5046da1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.651+0000 7faa81cbb640 1 --2- 172.21.15.7:0/3407848399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50432c1b0 0x55a5046da1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.651+0000 7faa81cbb640 1 -- 172.21.15.7:0/3407848399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5043032f0 msgr2=0x55a5046da700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.651+0000 7faa81cbb640 1 --2- 172.21.15.7:0/3407848399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5043032f0 0x55a5046da700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.651+0000 7faa81cbb640 1 -- 172.21.15.7:0/3407848399 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5045fb530 con 0x55a50430b4d0 2024-09-21T05:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.651+0000 7faa81cbb640 1 --2- 172.21.15.7:0/3407848399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a50430b4d0 0x55a5046dac40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faa6c0e4f50 tx=0x7faa6c0ef670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbad492a8c8b4732 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.652+0000 7faa70ff9640 1 -- 172.21.15.7:0/3407848399 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0f6070 con 0x55a50430b4d0 2024-09-21T05:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.652+0000 7faa70ff9640 1 -- 172.21.15.7:0/3407848399 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa6c0e9780 con 0x55a50430b4d0 2024-09-21T05:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.652+0000 7faa70ff9640 1 -- 172.21.15.7:0/3407848399 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0f28e0 con 0x55a50430b4d0 2024-09-21T05:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.652+0000 7faa737fe640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7faa680b67b0 0x7faa680b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.652+0000 7faa737fe640 1 -- 172.21.15.7:0/631713324 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7faa6c0e7810 con 0x7faa7c105260 2024-09-21T05:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.652+0000 7faa82cbd640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7faa680b67b0 0x7faa680b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.653+0000 7faa8b68c740 1 -- 172.21.15.7:0/3407848399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a50430b4d0 msgr2=0x55a5046dac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.653+0000 7faa8b68c740 1 --2- 172.21.15.7:0/3407848399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a50430b4d0 0x55a5046dac40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faa6c0e4f50 tx=0x7faa6c0ef670 comp rx=0 tx=0).stop 2024-09-21T05:54:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.653+0000 7faa82cbd640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7faa680b67b0 0x7faa680b8cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faa7402f500 tx=0x7faa7402f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.653+0000 7faa8b68c740 1 -- 172.21.15.7:0/3407848399 shutdown_connections 2024-09-21T05:54:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.653+0000 7faa8b68c740 1 --2- 172.21.15.7:0/3407848399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5043032f0 0x55a5046da700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.653+0000 7faa8b68c740 1 --2- 172.21.15.7:0/3407848399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a50430b4d0 0x55a5046dac40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.653+0000 7faa8b68c740 1 --2- 172.21.15.7:0/3407848399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50432c1b0 0x55a5046da1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.653+0000 7faa8b68c740 1 -- 172.21.15.7:0/3407848399 >> 172.21.15.7:0/3407848399 conn(0x55a504320300 msgr2=0x55a5046d80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.653+0000 7faa8b68c740 1 -- 172.21.15.7:0/3407848399 shutdown_connections 2024-09-21T05:54:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.653+0000 7faa8b68c740 1 -- 172.21.15.7:0/3407848399 wait complete. 2024-09-21T05:54:23.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.654+0000 7faa8b68c740 1 -- start start 2024-09-21T05:54:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.654+0000 7faa8b68c740 1 Processor -- start 2024-09-21T05:54:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.654+0000 7faa8b68c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a5043032f0 0x55a5046e5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa8b68c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a50430b4d0 0x55a5046e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa8b68c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50432c1b0 0x55a5046f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa8b68c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a50456dab0 con 0x55a50430b4d0 2024-09-21T05:54:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa8b68c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a5045db730 con 0x55a5043032f0 2024-09-21T05:54:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa8b68c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a5046e8940 con 0x55a50432c1b0 2024-09-21T05:54:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa8b68c740 10 client.0 _ll_register_callbacks cb 0x55a50462f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa81cbb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a50430b4d0 0x55a5046e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa81cbb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a50430b4d0 0x55a5046e5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37592/0 (socket says 172.21.15.7:37592) 2024-09-21T05:54:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa81cbb640 1 -- 172.21.15.7:0/3212210041 learned_addr learned my addr 172.21.15.7:0/3212210041 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa824bc640 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a5043032f0 0x55a5046e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa82cbd640 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50432c1b0 0x55a5046f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa81cbb640 1 -- 172.21.15.7:0/3212210041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50432c1b0 msgr2=0x55a5046f1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa81cbb640 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50432c1b0 0x55a5046f1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa81cbb640 1 -- 172.21.15.7:0/3212210041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a5043032f0 msgr2=0x55a5046e5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa81cbb640 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a5043032f0 0x55a5046e5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa81cbb640 1 -- 172.21.15.7:0/3212210041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a504397790 con 0x55a50430b4d0 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.655+0000 7faa824bc640 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a5043032f0 0x55a5046e5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.656+0000 7faa81cbb640 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a50430b4d0 0x55a5046e5da0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7faa6c0ad380 tx=0x7faa6c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8569705b04fb5fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.656+0000 7faa65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.656+0000 7faa65ffb640 1 -- 172.21.15.7:0/3212210041 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0f6070 con 0x55a50430b4d0 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.656+0000 7faa65ffb640 1 -- 172.21.15.7:0/3212210041 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7faa6c0b6c10 con 0x55a50430b4d0 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.656+0000 7faa8b68c740 1 -- 172.21.15.7:0/3212210041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa6c0e9780 con 0x55a50430b4d0 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.656+0000 7faa65ffb640 1 -- 172.21.15.7:0/3212210041 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faa6c0a9cd0 con 0x55a50430b4d0 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.656+0000 7faa8b68c740 10 client.15648 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.656+0000 7faa8b68c740 1 -- 172.21.15.7:0/3212210041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a504410620 con 0x55a50430b4d0 2024-09-21T05:54:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.656+0000 7faa65ffb640 1 -- 172.21.15.7:0/3212210041 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa6c0e9780 con 0x55a50430b4d0 2024-09-21T05:54:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.656+0000 7faa65ffb640 1 -- 172.21.15.7:0/3212210041 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faa6c0a8fd0 con 0x55a50430b4d0 2024-09-21T05:54:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.657+0000 7faa8b68c740 10 client.15648 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.657+0000 7faa8b68c740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.657+0000 7faa8b68c740 20 client.15648 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.657+0000 7faa8b68c740 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a5042ead80 0x55a5046f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.657+0000 7faa8b68c740 4 client.15648 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.657+0000 7faa8b68c740 1 -- 172.21.15.7:0/3212210041 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a504648640 con 0x55a5042ead80 2024-09-21T05:54:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.657+0000 7faa824bc640 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a5042ead80 0x55a5046f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.657+0000 7faa65ffb640 10 client.15648 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.657+0000 7faa824bc640 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a5042ead80 0x55a5046f78c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c86a566d58fa2092 server_cookie=94b79f38739053ec in_seq=0 out_seq=0 2024-09-21T05:54:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.658+0000 7faa65ffb640 1 -- 172.21.15.7:0/3212210041 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a504648640 con 0x55a5042ead80 2024-09-21T05:54:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.658+0000 7faa65ffb640 10 client.15648 handle_command_reply: tid=0 2024-09-21T05:54:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.658+0000 7faa8b68c740 1 client.15648 shutdown 2024-09-21T05:54:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.658+0000 7faa8b68c740 1 -- 172.21.15.7:0/3212210041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a50430b4d0 msgr2=0x55a5046e5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.658+0000 7faa8b68c740 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a50430b4d0 0x55a5046e5da0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7faa6c0ad380 tx=0x7faa6c00cf90 comp rx=0 tx=0).stop 2024-09-21T05:54:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.658+0000 7faa8b68c740 1 -- 172.21.15.7:0/3212210041 shutdown_connections 2024-09-21T05:54:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.658+0000 7faa8b68c740 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a5042ead80 0x55a5046f78c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.658+0000 7faa8b68c740 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a50430b4d0 0x55a5046e5da0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.658+0000 7faa65ffb640 0 client.15648 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.658+0000 7faa8b68c740 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50432c1b0 0x55a5046f1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.659+0000 7faa8b68c740 1 --2- 172.21.15.7:0/3212210041 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a5043032f0 0x55a5046e5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.659+0000 7faa8b68c740 1 -- 172.21.15.7:0/3212210041 >> 172.21.15.7:0/3212210041 conn(0x55a504320300 msgr2=0x55a5046cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.659+0000 7faa8b68c740 1 -- 172.21.15.7:0/3212210041 shutdown_connections 2024-09-21T05:54:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.659+0000 7faa8b68c740 1 -- 172.21.15.7:0/3212210041 wait complete. 2024-09-21T05:54:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.659+0000 7faa8b68c740 20 client.15648 trim_cache size 0 max 16384 2024-09-21T05:54:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.674+0000 7faa8b68c740 1 Processor -- start 2024-09-21T05:54:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.674+0000 7faa8b68c740 1 -- start start 2024-09-21T05:54:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.674+0000 7faa8b68c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 0x55a5046e5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.674+0000 7faa8b68c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5043032f0 0x55a5046df990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.674+0000 7faa8b68c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a50430b4d0 0x55a5046f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.674+0000 7faa8b68c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faa60010ef0 con 0x55a5042ead80 2024-09-21T05:54:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.674+0000 7faa8b68c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faa6000e7c0 con 0x55a50430b4d0 2024-09-21T05:54:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.674+0000 7faa8b68c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faa6000c610 con 0x55a5043032f0 2024-09-21T05:54:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.674+0000 7faa824bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 0x55a5046e5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.674+0000 7faa824bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 0x55a5046e5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37606/0 (socket says 172.21.15.7:37606) 2024-09-21T05:54:23.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.674+0000 7faa824bc640 1 -- 172.21.15.7:0/1500422437 learned_addr learned my addr 172.21.15.7:0/1500422437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:23.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.674+0000 7faa81cbb640 1 --2- 172.21.15.7:0/1500422437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5043032f0 0x55a5046df990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.674+0000 7faa82cbd640 1 --2- 172.21.15.7:0/1500422437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a50430b4d0 0x55a5046f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.675+0000 7faa824bc640 1 -- 172.21.15.7:0/1500422437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5043032f0 msgr2=0x55a5046df990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.675+0000 7faa824bc640 1 --2- 172.21.15.7:0/1500422437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5043032f0 0x55a5046df990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.675+0000 7faa824bc640 1 -- 172.21.15.7:0/1500422437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a50430b4d0 msgr2=0x55a5046f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.675+0000 7faa824bc640 1 --2- 172.21.15.7:0/1500422437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a50430b4d0 0x55a5046f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.675+0000 7faa824bc640 1 -- 172.21.15.7:0/1500422437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5046e6b20 con 0x55a5042ead80 2024-09-21T05:54:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.675+0000 7faa824bc640 1 --2- 172.21.15.7:0/1500422437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 0x55a5046e5d40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7faa78000c00 tx=0x7faa78014a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e9b8349ad4a0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.675+0000 7faa67fff640 1 -- 172.21.15.7:0/1500422437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78014190 con 0x55a5042ead80 2024-09-21T05:54:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.675+0000 7faa67fff640 1 -- 172.21.15.7:0/1500422437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa780054d0 con 0x55a5042ead80 2024-09-21T05:54:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.675+0000 7faa67fff640 1 -- 172.21.15.7:0/1500422437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa780115c0 con 0x55a5042ead80 2024-09-21T05:54:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.676+0000 7faa8b68c740 1 -- 172.21.15.7:0/1500422437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 msgr2=0x55a5046e5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.676+0000 7faa8b68c740 1 --2- 172.21.15.7:0/1500422437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 0x55a5046e5d40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7faa78000c00 tx=0x7faa78014a00 comp rx=0 tx=0).stop 2024-09-21T05:54:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.676+0000 7faa8b68c740 1 -- 172.21.15.7:0/1500422437 shutdown_connections 2024-09-21T05:54:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.676+0000 7faa8b68c740 1 --2- 172.21.15.7:0/1500422437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a50430b4d0 0x55a5046f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.676+0000 7faa8b68c740 1 --2- 172.21.15.7:0/1500422437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a5043032f0 0x55a5046df990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.676+0000 7faa8b68c740 1 --2- 172.21.15.7:0/1500422437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 0x55a5046e5d40 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.676+0000 7faa8b68c740 1 -- 172.21.15.7:0/1500422437 >> 172.21.15.7:0/1500422437 conn(0x55a504320300 msgr2=0x55a5046df280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.677+0000 7faa8b68c740 1 -- 172.21.15.7:0/1500422437 shutdown_connections 2024-09-21T05:54:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.677+0000 7faa8b68c740 1 -- 172.21.15.7:0/1500422437 wait complete. 2024-09-21T05:54:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.677+0000 7faa8b68c740 1 -- start start 2024-09-21T05:54:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.677+0000 7faa8b68c740 1 Processor -- start 2024-09-21T05:54:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.677+0000 7faa8b68c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 0x55a5046f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.677+0000 7faa8b68c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a5043032f0 0x55a5046f8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.677+0000 7faa8b68c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50430b4d0 0x55a504760030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.677+0000 7faa8b68c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faa6000cc80 con 0x55a5042ead80 2024-09-21T05:54:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.677+0000 7faa8b68c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faa6000e0f0 con 0x55a5043032f0 2024-09-21T05:54:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.677+0000 7faa8b68c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faa6000d350 con 0x55a50430b4d0 2024-09-21T05:54:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.677+0000 7faa8b68c740 10 client.0 _ll_register_callbacks cb 0x7faa74009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.678+0000 7faa824bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 0x55a5046f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.678+0000 7faa82cbd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50430b4d0 0x55a504760030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.678+0000 7faa824bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 0x55a5046f7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37620/0 (socket says 172.21.15.7:37620) 2024-09-21T05:54:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.678+0000 7faa824bc640 1 -- 172.21.15.7:0/772165193 learned_addr learned my addr 172.21.15.7:0/772165193 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.678+0000 7faa81cbb640 1 --2- 172.21.15.7:0/772165193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a5043032f0 0x55a5046f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.678+0000 7faa82cbd640 1 -- 172.21.15.7:0/772165193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a5043032f0 msgr2=0x55a5046f8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.678+0000 7faa82cbd640 1 --2- 172.21.15.7:0/772165193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a5043032f0 0x55a5046f8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.678+0000 7faa82cbd640 1 -- 172.21.15.7:0/772165193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 msgr2=0x55a5046f7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.678+0000 7faa82cbd640 1 --2- 172.21.15.7:0/772165193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 0x55a5046f7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.678+0000 7faa82cbd640 1 -- 172.21.15.7:0/772165193 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a504760570 con 0x55a50430b4d0 2024-09-21T05:54:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.678+0000 7faa824bc640 1 --2- 172.21.15.7:0/772165193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 0x55a5046f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.678+0000 7faa82cbd640 1 --2- 172.21.15.7:0/772165193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50430b4d0 0x55a504760030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faa74006010 tx=0x7faa740095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94ff4cbe36140ef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:23.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.678+0000 7faa65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa65ffb640 1 -- 172.21.15.7:0/772165193 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74058060 con 0x55a50430b4d0 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa65ffb640 1 -- 172.21.15.7:0/772165193 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7faa74004250 con 0x55a50430b4d0 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa8b68c740 1 -- 172.21.15.7:0/772165193 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa780054d0 con 0x55a50430b4d0 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa65ffb640 1 -- 172.21.15.7:0/772165193 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faa74004450 con 0x55a50430b4d0 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa8b68c740 10 client.25324 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa8b68c740 1 -- 172.21.15.7:0/772165193 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a504761790 con 0x55a50430b4d0 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa65ffb640 1 -- 172.21.15.7:0/772165193 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa74036050 con 0x55a50430b4d0 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa65ffb640 1 -- 172.21.15.7:0/772165193 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faa740305c0 con 0x55a50430b4d0 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa8b68c740 10 client.25324 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa8b68c740 10 client.25324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa8b68c740 20 client.25324 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa8b68c740 1 --2- 172.21.15.7:0/772165193 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a50432c1b0 0x55a504763f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa8b68c740 4 client.25324 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T05:54:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.679+0000 7faa8b68c740 1 -- 172.21.15.7:0/772165193 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7faa780054d0 con 0x55a50432c1b0 2024-09-21T05:54:23.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.680+0000 7faa824bc640 1 --2- 172.21.15.7:0/772165193 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a50432c1b0 0x55a504763f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:23.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.680+0000 7faa65ffb640 10 client.25324 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:23.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.680+0000 7faa824bc640 1 --2- 172.21.15.7:0/772165193 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a50432c1b0 0x55a504763f80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cd99b54d1651d78 server_cookie=32e568a11adb590b in_seq=0 out_seq=0 2024-09-21T05:54:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa65ffb640 1 -- 172.21.15.7:0/772165193 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7faa780054d0 con 0x55a50432c1b0 2024-09-21T05:54:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa65ffb640 10 client.25324 handle_command_reply: tid=0 2024-09-21T05:54:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa8b68c740 1 client.25324 shutdown 2024-09-21T05:54:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa8b68c740 1 -- 172.21.15.7:0/772165193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50430b4d0 msgr2=0x55a504760030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa8b68c740 1 --2- 172.21.15.7:0/772165193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50430b4d0 0x55a504760030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faa74006010 tx=0x7faa740095c0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa8b68c740 1 -- 172.21.15.7:0/772165193 shutdown_connections 2024-09-21T05:54:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa8b68c740 1 --2- 172.21.15.7:0/772165193 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a50432c1b0 0x55a504763f80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa8b68c740 1 --2- 172.21.15.7:0/772165193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a50430b4d0 0x55a504760030 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa8b68c740 1 --2- 172.21.15.7:0/772165193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a5043032f0 0x55a5046f8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa65ffb640 0 client.25324 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa8b68c740 1 --2- 172.21.15.7:0/772165193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5042ead80 0x55a5046f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa8b68c740 1 -- 172.21.15.7:0/772165193 >> 172.21.15.7:0/772165193 conn(0x55a504320300 msgr2=0x55a5046d7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa8b68c740 1 -- 172.21.15.7:0/772165193 shutdown_connections 2024-09-21T05:54:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.688+0000 7faa8b68c740 1 -- 172.21.15.7:0/772165193 wait complete. 2024-09-21T05:54:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.689+0000 7faa8b68c740 20 client.25324 trim_cache size 0 max 16384 2024-09-21T05:54:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T05:54:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T05:54:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T05:54:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T05:54:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.689+0000 7faa84720640 1 -- 172.21.15.7:0/631713324 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7faa680b67b0 msgr2=0x7faa680b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.689+0000 7faa84720640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7faa680b67b0 0x7faa680b8cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faa7402f500 tx=0x7faa7402f310 comp rx=0 tx=0).stop 2024-09-21T05:54:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.689+0000 7faa84720640 1 -- 172.21.15.7:0/631713324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa7c105260 msgr2=0x7faa7c102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.689+0000 7faa84720640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa7c105260 0x7faa7c102b80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00e9f0 tx=0x7faa6c00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.689+0000 7faa84720640 1 -- 172.21.15.7:0/631713324 shutdown_connections 2024-09-21T05:54:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.689+0000 7faa84720640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7faa680b67b0 0x7faa680b8cc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.689+0000 7faa84720640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa7c105260 0x7faa7c102b80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.689+0000 7faa84720640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa7c10dd70 0x7faa7c1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.689+0000 7faa84720640 1 --2- 172.21.15.7:0/631713324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa7c104910 0x7faa7c102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.689+0000 7faa84720640 1 -- 172.21.15.7:0/631713324 >> 172.21.15.7:0/631713324 conn(0x7faa7c0fe3c0 msgr2=0x7faa7c0ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.689+0000 7faa84720640 1 -- 172.21.15.7:0/631713324 shutdown_connections 2024-09-21T05:54:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:23.689+0000 7faa84720640 1 -- 172.21.15.7:0/631713324 wait complete. 2024-09-21T05:54:24.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:24 smithi007 ceph-mon[30983]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.6 KiB/s wr, 7 op/s 2024-09-21T05:54:24.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:24 smithi119 ceph-mon[34833]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.6 KiB/s wr, 7 op/s 2024-09-21T05:54:24.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:24 smithi027 ceph-mon[34364]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.6 KiB/s wr, 7 op/s 2024-09-21T05:54:24.798 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T05:54:24.798 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T05:54:25.116 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.588+0000 7f4af4109640 1 -- 172.21.15.7:0/2832656137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4aec108cf0 msgr2=0x7f4aec10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.588+0000 7f4af4109640 1 --2- 172.21.15.7:0/2832656137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4aec108cf0 0x7f4aec10f520 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009ca0 tx=0x7f4ae402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.588+0000 7f4af4109640 1 -- 172.21.15.7:0/2832656137 shutdown_connections 2024-09-21T05:54:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.588+0000 7f4af4109640 1 --2- 172.21.15.7:0/2832656137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4aec108cf0 0x7f4aec10f520 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.588+0000 7f4af4109640 1 --2- 172.21.15.7:0/2832656137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aec1083a0 0x7f4aec1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.588+0000 7f4af4109640 1 --2- 172.21.15.7:0/2832656137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4aec102a60 0x7f4aec102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.588+0000 7f4af4109640 1 -- 172.21.15.7:0/2832656137 >> 172.21.15.7:0/2832656137 conn(0x7f4aec079730 msgr2=0x7f4aec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:25.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.589+0000 7f4af4109640 1 -- 172.21.15.7:0/2832656137 shutdown_connections 2024-09-21T05:54:25.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.589+0000 7f4af4109640 1 -- 172.21.15.7:0/2832656137 wait complete. 2024-09-21T05:54:25.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.590+0000 7f4af4109640 1 Processor -- start 2024-09-21T05:54:25.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.590+0000 7f4af4109640 1 -- start start 2024-09-21T05:54:25.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.590+0000 7f4af4109640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aec102a60 0x7f4aec19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.590+0000 7f4af4109640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4aec1083a0 0x7f4aec19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.590+0000 7f4af4109640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4aec108cf0 0x7f4aec19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.590+0000 7f4af4109640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec113a80 con 0x7f4aec1083a0 2024-09-21T05:54:25.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.590+0000 7f4af4109640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec113900 con 0x7f4aec108cf0 2024-09-21T05:54:25.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.590+0000 7f4af4109640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec113c00 con 0x7f4aec102a60 2024-09-21T05:54:25.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.590+0000 7f4af16a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4aec1083a0 0x7f4aec19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.591+0000 7f4af1ea5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aec102a60 0x7f4aec19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.591+0000 7f4af1ea5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aec102a60 0x7f4aec19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:50042/0 (socket says 172.21.15.7:50042) 2024-09-21T05:54:25.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.591+0000 7f4af1ea5640 1 -- 172.21.15.7:0/2420438677 learned_addr learned my addr 172.21.15.7:0/2420438677 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:25.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.591+0000 7f4af26a6640 1 --2- 172.21.15.7:0/2420438677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4aec108cf0 0x7f4aec19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.591+0000 7f4af16a4640 1 -- 172.21.15.7:0/2420438677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aec102a60 msgr2=0x7f4aec19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:25.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.591+0000 7f4af16a4640 1 --2- 172.21.15.7:0/2420438677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aec102a60 0x7f4aec19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.591+0000 7f4af16a4640 1 -- 172.21.15.7:0/2420438677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4aec108cf0 msgr2=0x7f4aec19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:25.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.591+0000 7f4af16a4640 1 --2- 172.21.15.7:0/2420438677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4aec108cf0 0x7f4aec19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.591+0000 7f4af16a4640 1 -- 172.21.15.7:0/2420438677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec1a0460 con 0x7f4aec1083a0 2024-09-21T05:54:25.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.591+0000 7f4af16a4640 1 --2- 172.21.15.7:0/2420438677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4aec1083a0 0x7f4aec19aa90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00d6a0 tx=0x7f4adc00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:25.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.592+0000 7f4ae2ffd640 1 -- 172.21.15.7:0/2420438677 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc017070 con 0x7f4aec1083a0 2024-09-21T05:54:25.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.592+0000 7f4ae2ffd640 1 -- 172.21.15.7:0/2420438677 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4adc009820 con 0x7f4aec1083a0 2024-09-21T05:54:25.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.592+0000 7f4ae2ffd640 1 -- 172.21.15.7:0/2420438677 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc004c40 con 0x7f4aec1083a0 2024-09-21T05:54:25.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.592+0000 7f4af4109640 1 -- 172.21.15.7:0/2420438677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec1a0750 con 0x7f4aec1083a0 2024-09-21T05:54:25.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.593+0000 7f4af4109640 1 -- 172.21.15.7:0/2420438677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec10fe90 con 0x7f4aec1083a0 2024-09-21T05:54:25.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.596+0000 7f4ae2ffd640 1 -- 172.21.15.7:0/2420438677 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f4adc005220 con 0x7f4aec1083a0 2024-09-21T05:54:25.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.596+0000 7f4afa67d740 1 Processor -- start 2024-09-21T05:54:25.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.597+0000 7f4afa67d740 1 -- start start 2024-09-21T05:54:25.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.597+0000 7f4afa67d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c3a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.597+0000 7f4afa67d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c3a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.597+0000 7f4ae2ffd640 1 --2- 172.21.15.7:0/2420438677 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4ad80b6700 0x7f4ad80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.597+0000 7f4afa67d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c3aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.597+0000 7f4afa67d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5591d8bb0e60 con 0x5591d8893350 2024-09-21T05:54:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.597+0000 7f4afa67d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5591d8ba0290 con 0x5591d8872670 2024-09-21T05:54:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.597+0000 7f4afa67d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5591d8ba40a0 con 0x5591d886a490 2024-09-21T05:54:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.597+0000 7f4af26a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c3a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.597+0000 7f4af26a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c3a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37646/0 (socket says 172.21.15.7:37646) 2024-09-21T05:54:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.597+0000 7f4af26a6640 1 -- 172.21.15.7:0/1537694803 learned_addr learned my addr 172.21.15.7:0/1537694803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.598+0000 7f4af16a4640 1 --2- 172.21.15.7:0/2420438677 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4ad80b6700 0x7f4ad80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.598+0000 7f4af1ea5640 1 --2- 172.21.15.7:0/1537694803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c3a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.598+0000 7f4af26a6640 1 --2- 172.21.15.7:0/1537694803 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c3aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.598+0000 7f4af1ea5640 1 -- 172.21.15.7:0/1537694803 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 msgr2=0x5591d8c3aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:25.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.598+0000 7f4af1ea5640 1 --2- 172.21.15.7:0/1537694803 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c3aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.598+0000 7f4af1ea5640 1 -- 172.21.15.7:0/1537694803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 msgr2=0x5591d8c3a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:25.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.598+0000 7f4af1ea5640 1 --2- 172.21.15.7:0/1537694803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c3a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.598+0000 7f4af1ea5640 1 -- 172.21.15.7:0/1537694803 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591d88fe930 con 0x5591d886a490 2024-09-21T05:54:25.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.598+0000 7f4ae2ffd640 1 -- 172.21.15.7:0/2420438677 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4adc0e7190 con 0x7f4aec1083a0 2024-09-21T05:54:25.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.598+0000 7f4af1ea5640 1 --2- 172.21.15.7:0/1537694803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c3a970 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80058c0 tx=0x7f4ae80107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41010575d017fdbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:25.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.598+0000 7f4af26a6640 1 --2- 172.21.15.7:0/1537694803 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c3aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:54:25.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.599+0000 7f4ad7fff640 1 -- 172.21.15.7:0/1537694803 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8004230 con 0x5591d886a490 2024-09-21T05:54:25.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.599+0000 7f4ad7fff640 1 -- 172.21.15.7:0/1537694803 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae800be90 con 0x5591d886a490 2024-09-21T05:54:25.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.599+0000 7f4ad7fff640 1 -- 172.21.15.7:0/1537694803 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8022630 con 0x5591d886a490 2024-09-21T05:54:25.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.599+0000 7f4af16a4640 1 --2- 172.21.15.7:0/2420438677 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4ad80b6700 0x7f4ad80b8c10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0046e0 tx=0x7f4adc0057f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:25.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.600+0000 7f4afa67d740 1 -- 172.21.15.7:0/1537694803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 msgr2=0x5591d8c3a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:25.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.600+0000 7f4afa67d740 1 --2- 172.21.15.7:0/1537694803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c3a970 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80058c0 tx=0x7f4ae80107a0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.600+0000 7f4afa67d740 1 -- 172.21.15.7:0/1537694803 shutdown_connections 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.600+0000 7f4afa67d740 1 --2- 172.21.15.7:0/1537694803 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c3aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.600+0000 7f4afa67d740 1 --2- 172.21.15.7:0/1537694803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c3a970 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.600+0000 7f4afa67d740 1 --2- 172.21.15.7:0/1537694803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c3a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.600+0000 7f4afa67d740 1 -- 172.21.15.7:0/1537694803 >> 172.21.15.7:0/1537694803 conn(0x5591d8887740 msgr2=0x5591d8c38320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.600+0000 7f4afa67d740 1 -- 172.21.15.7:0/1537694803 shutdown_connections 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.600+0000 7f4afa67d740 1 -- 172.21.15.7:0/1537694803 wait complete. 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.601+0000 7f4afa67d740 1 -- start start 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.601+0000 7f4afa67d740 1 Processor -- start 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.601+0000 7f4afa67d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c45f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4afa67d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c464d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4afa67d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c51f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4afa67d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5591d8a01890 con 0x5591d8893350 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4afa67d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5591d8b3ad40 con 0x5591d8872670 2024-09-21T05:54:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4afa67d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5591d8c48c10 con 0x5591d886a490 2024-09-21T05:54:25.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4afa67d740 10 client.0 _ll_register_callbacks cb 0x5591d8b9ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:25.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4af26a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c45f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4af1ea5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4af26a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c45f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:50050/0 (socket says 172.21.15.7:50050) 2024-09-21T05:54:25.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4af1ea5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c464d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:53424/0 (socket says 172.21.15.7:53424) 2024-09-21T05:54:25.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4af26a6640 1 -- 172.21.15.7:0/962049318 learned_addr learned my addr 172.21.15.7:0/962049318 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:25.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4af1ea5640 1 -- 172.21.15.7:0/962049318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 msgr2=0x5591d8c45f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:25.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4af1ea5640 1 --2- 172.21.15.7:0/962049318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c45f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4af1ea5640 1 -- 172.21.15.7:0/962049318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 msgr2=0x5591d8c51f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:25.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4af1ea5640 1 --2- 172.21.15.7:0/962049318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c51f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4af1ea5640 1 -- 172.21.15.7:0/962049318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591d8c52470 con 0x5591d8872670 2024-09-21T05:54:25.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4af1ea5640 1 --2- 172.21.15.7:0/962049318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c464d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8011010 tx=0x7f4ae8003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d3b20a0f4cb9a3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:25.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.602+0000 7f4ad57fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:54:25.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.603+0000 7f4ad57fa640 1 -- 172.21.15.7:0/962049318 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8003f90 con 0x5591d8872670 2024-09-21T05:54:25.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.603+0000 7f4afa67d740 1 -- 172.21.15.7:0/962049318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae800be90 con 0x5591d8872670 2024-09-21T05:54:25.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.603+0000 7f4ad57fa640 1 -- 172.21.15.7:0/962049318 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4ae8004130 con 0x5591d8872670 2024-09-21T05:54:25.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.603+0000 7f4ad57fa640 1 -- 172.21.15.7:0/962049318 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4ae8004330 con 0x5591d8872670 2024-09-21T05:54:25.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.603+0000 7f4afa67d740 10 client.25364 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:25.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.603+0000 7f4afa67d740 1 -- 172.21.15.7:0/962049318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5591d8c54cf0 con 0x5591d8872670 2024-09-21T05:54:25.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.604+0000 7f4ad57fa640 1 -- 172.21.15.7:0/962049318 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae800be90 con 0x5591d8872670 2024-09-21T05:54:25.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.604+0000 7f4ad57fa640 1 -- 172.21.15.7:0/962049318 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4ae80047e0 con 0x5591d8872670 2024-09-21T05:54:25.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.604+0000 7f4afa67d740 10 client.25364 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:25.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.604+0000 7f4afa67d740 10 client.25364 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:25.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.604+0000 7f4afa67d740 20 client.25364 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:25.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.604+0000 7f4afa67d740 1 --2- 172.21.15.7:0/962049318 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5591d8851cd0 0x5591d8c58050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.604+0000 7f4afa67d740 4 client.25364 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:25.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.604+0000 7f4afa67d740 1 -- 172.21.15.7:0/962049318 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591d8bb2db0 con 0x5591d8851cd0 2024-09-21T05:54:25.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.604+0000 7f4af26a6640 1 --2- 172.21.15.7:0/962049318 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5591d8851cd0 0x5591d8c58050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.605+0000 7f4ad57fa640 10 client.25364 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.605+0000 7f4af26a6640 1 --2- 172.21.15.7:0/962049318 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5591d8851cd0 0x5591d8c58050 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=673d0ef3164e5d62 server_cookie=3905a0805cc2e46f in_seq=0 out_seq=0 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4ad57fa640 1 -- 172.21.15.7:0/962049318 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5591d8bb2db0 con 0x5591d8851cd0 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4ad57fa640 10 client.25364 handle_command_reply: tid=0 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4afa67d740 1 client.25364 shutdown 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4afa67d740 1 -- 172.21.15.7:0/962049318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 msgr2=0x5591d8c464d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4afa67d740 1 --2- 172.21.15.7:0/962049318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c464d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8011010 tx=0x7f4ae8003820 comp rx=0 tx=0).stop 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4afa67d740 1 -- 172.21.15.7:0/962049318 shutdown_connections 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4afa67d740 1 --2- 172.21.15.7:0/962049318 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5591d8851cd0 0x5591d8c58050 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4afa67d740 1 --2- 172.21.15.7:0/962049318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c51f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4afa67d740 1 --2- 172.21.15.7:0/962049318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c464d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4afa67d740 1 --2- 172.21.15.7:0/962049318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c45f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4ad57fa640 0 client.25364 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4afa67d740 1 -- 172.21.15.7:0/962049318 >> 172.21.15.7:0/962049318 conn(0x5591d8887740 msgr2=0x5591d8c3d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:25.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4afa67d740 1 -- 172.21.15.7:0/962049318 shutdown_connections 2024-09-21T05:54:25.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4afa67d740 1 -- 172.21.15.7:0/962049318 wait complete. 2024-09-21T05:54:25.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.606+0000 7f4afa67d740 20 client.25364 trim_cache size 0 max 16384 2024-09-21T05:54:25.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.624+0000 7f4afa67d740 1 Processor -- start 2024-09-21T05:54:25.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.624+0000 7f4afa67d740 1 -- start start 2024-09-21T05:54:25.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4afa67d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d886a490 0x5591d8c51e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4afa67d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c38350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4afa67d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d8893350 0x5591d8c45620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4afa67d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1afce0 con 0x5591d886a490 2024-09-21T05:54:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4afa67d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1ad5b0 con 0x5591d8872670 2024-09-21T05:54:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4afa67d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1ab420 con 0x5591d8893350 2024-09-21T05:54:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4af26a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d886a490 0x5591d8c51e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4af26a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d886a490 0x5591d8c51e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37664/0 (socket says 172.21.15.7:37664) 2024-09-21T05:54:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4af26a6640 1 -- 172.21.15.7:0/679522827 learned_addr learned my addr 172.21.15.7:0/679522827 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4af1ea5640 1 --2- 172.21.15.7:0/679522827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c38350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4af26a6640 1 -- 172.21.15.7:0/679522827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d8893350 msgr2=0x5591d8c45620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4af26a6640 1 --2- 172.21.15.7:0/679522827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d8893350 0x5591d8c45620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4af26a6640 1 -- 172.21.15.7:0/679522827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 msgr2=0x5591d8c38350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4af26a6640 1 --2- 172.21.15.7:0/679522827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c38350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.625+0000 7f4af26a6640 1 -- 172.21.15.7:0/679522827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591d8c47050 con 0x5591d886a490 2024-09-21T05:54:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.626+0000 7f4af26a6640 1 --2- 172.21.15.7:0/679522827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d886a490 0x5591d8c51e00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4002230 tx=0x7f4ae4031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0cca15e51bcc35c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.626+0000 7f4ad77fe640 1 -- 172.21.15.7:0/679522827 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4031650 con 0x5591d886a490 2024-09-21T05:54:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.626+0000 7f4ad77fe640 1 -- 172.21.15.7:0/679522827 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae4036040 con 0x5591d886a490 2024-09-21T05:54:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.626+0000 7f4ad77fe640 1 -- 172.21.15.7:0/679522827 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4004660 con 0x5591d886a490 2024-09-21T05:54:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.627+0000 7f4afa67d740 1 -- 172.21.15.7:0/679522827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d886a490 msgr2=0x5591d8c51e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.627+0000 7f4afa67d740 1 --2- 172.21.15.7:0/679522827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d886a490 0x5591d8c51e00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4002230 tx=0x7f4ae4031af0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.627+0000 7f4afa67d740 1 -- 172.21.15.7:0/679522827 shutdown_connections 2024-09-21T05:54:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.627+0000 7f4afa67d740 1 --2- 172.21.15.7:0/679522827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d8893350 0x5591d8c45620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.627+0000 7f4afa67d740 1 --2- 172.21.15.7:0/679522827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c38350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.627+0000 7f4afa67d740 1 --2- 172.21.15.7:0/679522827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d886a490 0x5591d8c51e00 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.627+0000 7f4afa67d740 1 -- 172.21.15.7:0/679522827 >> 172.21.15.7:0/679522827 conn(0x5591d8887740 msgr2=0x5591d8c37c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.627+0000 7f4afa67d740 1 -- 172.21.15.7:0/679522827 shutdown_connections 2024-09-21T05:54:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.627+0000 7f4afa67d740 1 -- 172.21.15.7:0/679522827 wait complete. 2024-09-21T05:54:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.628+0000 7f4afa67d740 1 -- start start 2024-09-21T05:54:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.628+0000 7f4afa67d740 1 Processor -- start 2024-09-21T05:54:25.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.628+0000 7f4afa67d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c4e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.628+0000 7f4afa67d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c5d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.628+0000 7f4afa67d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c5dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.628+0000 7f4afa67d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1aba70 con 0x5591d8893350 2024-09-21T05:54:25.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.628+0000 7f4afa67d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1acee0 con 0x5591d8872670 2024-09-21T05:54:25.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.628+0000 7f4afa67d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1ac140 con 0x5591d886a490 2024-09-21T05:54:25.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.628+0000 7f4afa67d740 10 client.0 _ll_register_callbacks cb 0x7f4ae4009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:25.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.628+0000 7f4af26a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c5dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.629+0000 7f4af1ea5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c5d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.629+0000 7f4af26a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c5dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37678/0 (socket says 172.21.15.7:37678) 2024-09-21T05:54:25.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.629+0000 7f4af26a6640 1 -- 172.21.15.7:0/801705705 learned_addr learned my addr 172.21.15.7:0/801705705 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:25.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.629+0000 7f4af26a6640 1 --2- 172.21.15.7:0/801705705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c4e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.629+0000 7f4af26a6640 1 -- 172.21.15.7:0/801705705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 msgr2=0x5591d8c4e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:25.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.629+0000 7f4af26a6640 1 --2- 172.21.15.7:0/801705705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c4e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.629+0000 7f4af26a6640 1 -- 172.21.15.7:0/801705705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 msgr2=0x5591d8c5d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:25.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.629+0000 7f4af26a6640 1 --2- 172.21.15.7:0/801705705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c5d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.629+0000 7f4af26a6640 1 -- 172.21.15.7:0/801705705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591d8c4a2f0 con 0x5591d8893350 2024-09-21T05:54:25.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.629+0000 7f4af26a6640 1 --2- 172.21.15.7:0/801705705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c5dd90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4031970 tx=0x7f4ae40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f616da2d54442837 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:25.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.629+0000 7f4ad57fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:54:25.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.629+0000 7f4ad57fa640 1 -- 172.21.15.7:0/801705705 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4003b80 con 0x5591d8893350 2024-09-21T05:54:25.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.630+0000 7f4afa67d740 1 -- 172.21.15.7:0/801705705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae4036040 con 0x5591d8893350 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.630+0000 7f4ad57fa640 1 -- 172.21.15.7:0/801705705 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4ae4003d20 con 0x5591d8893350 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.630+0000 7f4ad57fa640 1 -- 172.21.15.7:0/801705705 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4ae4004040 con 0x5591d8893350 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.630+0000 7f4afa67d740 10 client.15669 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.630+0000 7f4afa67d740 1 -- 172.21.15.7:0/801705705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5591d8cc2b60 con 0x5591d8893350 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.630+0000 7f4ad57fa640 1 -- 172.21.15.7:0/801705705 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae4036040 con 0x5591d8893350 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.630+0000 7f4ad57fa640 1 -- 172.21.15.7:0/801705705 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4ae402fa10 con 0x5591d8893350 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.630+0000 7f4afa67d740 10 client.15669 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.630+0000 7f4afa67d740 10 client.15669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.630+0000 7f4afa67d740 20 client.15669 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.630+0000 7f4afa67d740 1 --2- 172.21.15.7:0/801705705 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5591d8827080 0x5591d8cc52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.630+0000 7f4afa67d740 4 client.15669 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.630+0000 7f4afa67d740 1 -- 172.21.15.7:0/801705705 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5591d8bae860 con 0x5591d8827080 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.631+0000 7f4af1ea5640 1 --2- 172.21.15.7:0/801705705 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5591d8827080 0x5591d8cc52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.631+0000 7f4ad57fa640 10 client.15669 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:25.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.632+0000 7f4af1ea5640 1 --2- 172.21.15.7:0/801705705 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5591d8827080 0x5591d8cc52a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=313d5eb0a3326653 server_cookie=15449b31c13fc9ec in_seq=0 out_seq=0 2024-09-21T05:54:25.636 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:54:25.636 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T05:54:25.636 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "9891a47c-baed-4663-96d7-95a281bed3f4", 2024-09-21T05:54:25.636 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T05:54:25.636 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:54:25.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.633+0000 7f4ad57fa640 1 -- 172.21.15.7:0/801705705 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5591d8bae860 con 0x5591d8827080 2024-09-21T05:54:25.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.633+0000 7f4ad57fa640 10 client.15669 handle_command_reply: tid=0 2024-09-21T05:54:25.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.633+0000 7f4afa67d740 1 client.15669 shutdown 2024-09-21T05:54:25.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.633+0000 7f4afa67d740 1 -- 172.21.15.7:0/801705705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 msgr2=0x5591d8c5dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:25.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.633+0000 7f4afa67d740 1 --2- 172.21.15.7:0/801705705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c5dd90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4031970 tx=0x7f4ae40095c0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.634+0000 7f4afa67d740 1 -- 172.21.15.7:0/801705705 shutdown_connections 2024-09-21T05:54:25.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.634+0000 7f4afa67d740 1 --2- 172.21.15.7:0/801705705 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5591d8827080 0x5591d8cc52a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.634+0000 7f4afa67d740 1 --2- 172.21.15.7:0/801705705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591d8893350 0x5591d8c5dd90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.634+0000 7f4afa67d740 1 --2- 172.21.15.7:0/801705705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5591d8872670 0x5591d8c5d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.634+0000 7f4afa67d740 1 --2- 172.21.15.7:0/801705705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5591d886a490 0x5591d8c4e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.634+0000 7f4afa67d740 1 -- 172.21.15.7:0/801705705 >> 172.21.15.7:0/801705705 conn(0x5591d8887740 msgr2=0x5591d8c47220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:25.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.634+0000 7f4ad57fa640 0 client.15669 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:25.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.634+0000 7f4afa67d740 1 -- 172.21.15.7:0/801705705 shutdown_connections 2024-09-21T05:54:25.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.634+0000 7f4afa67d740 1 -- 172.21.15.7:0/801705705 wait complete. 2024-09-21T05:54:25.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.634+0000 7f4afa67d740 20 client.15669 trim_cache size 0 max 16384 2024-09-21T05:54:25.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.635+0000 7f4af4109640 1 -- 172.21.15.7:0/2420438677 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4ad80b6700 msgr2=0x7f4ad80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:25.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.635+0000 7f4af4109640 1 --2- 172.21.15.7:0/2420438677 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4ad80b6700 0x7f4ad80b8c10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0046e0 tx=0x7f4adc0057f0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.635+0000 7f4af4109640 1 -- 172.21.15.7:0/2420438677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4aec1083a0 msgr2=0x7f4aec19aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:25.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.635+0000 7f4af4109640 1 --2- 172.21.15.7:0/2420438677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4aec1083a0 0x7f4aec19aa90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00d6a0 tx=0x7f4adc00db60 comp rx=0 tx=0).stop 2024-09-21T05:54:25.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.635+0000 7f4af4109640 1 -- 172.21.15.7:0/2420438677 shutdown_connections 2024-09-21T05:54:25.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.635+0000 7f4af4109640 1 --2- 172.21.15.7:0/2420438677 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4ad80b6700 0x7f4ad80b8c10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.635+0000 7f4af4109640 1 --2- 172.21.15.7:0/2420438677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4aec1083a0 0x7f4aec19aa90 secure :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00d6a0 tx=0x7f4adc00db60 comp rx=0 tx=0).stop 2024-09-21T05:54:25.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.635+0000 7f4af4109640 1 --2- 172.21.15.7:0/2420438677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4aec108cf0 0x7f4aec19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.635+0000 7f4af4109640 1 --2- 172.21.15.7:0/2420438677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4aec102a60 0x7f4aec19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.635+0000 7f4af4109640 1 -- 172.21.15.7:0/2420438677 >> 172.21.15.7:0/2420438677 conn(0x7f4aec079730 msgr2=0x7f4aec105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:25.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.635+0000 7f4af4109640 1 -- 172.21.15.7:0/2420438677 shutdown_connections 2024-09-21T05:54:25.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:25.635+0000 7f4af4109640 1 -- 172.21.15.7:0/2420438677 wait complete. 2024-09-21T05:54:26.335 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:54:26.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:26 smithi007 ceph-mon[30983]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-21T05:54:26.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:26 smithi119 ceph-mon[34833]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-21T05:54:26.621 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:26.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:26 smithi027 ceph-mon[34364]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-21T05:54:27.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.129+0000 7f22c3823640 1 -- 172.21.15.7:0/477714040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22bc102a60 msgr2=0x7f22bc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.129+0000 7f22c3823640 1 --2- 172.21.15.7:0/477714040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22bc102a60 0x7f22bc102e70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009900 tx=0x7f22b802a410 comp rx=0 tx=0).stop 2024-09-21T05:54:27.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.129+0000 7f22c3823640 1 -- 172.21.15.7:0/477714040 shutdown_connections 2024-09-21T05:54:27.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.129+0000 7f22c3823640 1 --2- 172.21.15.7:0/477714040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22bc108cf0 0x7f22bc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.129+0000 7f22c3823640 1 --2- 172.21.15.7:0/477714040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22bc1083a0 0x7f22bc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.129+0000 7f22c3823640 1 --2- 172.21.15.7:0/477714040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22bc102a60 0x7f22bc102e70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.129+0000 7f22c3823640 1 -- 172.21.15.7:0/477714040 >> 172.21.15.7:0/477714040 conn(0x7f22bc079730 msgr2=0x7f22bc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:27.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.129+0000 7f22c3823640 1 -- 172.21.15.7:0/477714040 shutdown_connections 2024-09-21T05:54:27.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.130+0000 7f22c3823640 1 -- 172.21.15.7:0/477714040 wait complete. 2024-09-21T05:54:27.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.130+0000 7f22c3823640 1 Processor -- start 2024-09-21T05:54:27.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.130+0000 7f22c3823640 1 -- start start 2024-09-21T05:54:27.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.131+0000 7f22c3823640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22bc102a60 0x7f22bc19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.131+0000 7f22c3823640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22bc1083a0 0x7f22bc19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.131+0000 7f22c3823640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22bc108cf0 0x7f22bc19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.131+0000 7f22c3823640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc112960 con 0x7f22bc102a60 2024-09-21T05:54:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.131+0000 7f22c3823640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1127e0 con 0x7f22bc108cf0 2024-09-21T05:54:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.131+0000 7f22c3823640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc112ae0 con 0x7f22bc1083a0 2024-09-21T05:54:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.131+0000 7f22c0dbe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22bc1083a0 0x7f22bc19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.131+0000 7f22c0dbe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22bc1083a0 0x7f22bc19aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:50076/0 (socket says 172.21.15.7:50076) 2024-09-21T05:54:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.131+0000 7f22c0dbe640 1 -- 172.21.15.7:0/1717197605 learned_addr learned my addr 172.21.15.7:0/1717197605 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.131+0000 7f22c1dc0640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22bc108cf0 0x7f22bc19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.131+0000 7f22c15bf640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22bc102a60 0x7f22bc19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.132+0000 7f22c0dbe640 1 -- 172.21.15.7:0/1717197605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22bc108cf0 msgr2=0x7f22bc19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.132+0000 7f22c0dbe640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22bc108cf0 0x7f22bc19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.132+0000 7f22c0dbe640 1 -- 172.21.15.7:0/1717197605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22bc102a60 msgr2=0x7f22bc19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.132+0000 7f22c0dbe640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22bc102a60 0x7f22bc19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.132+0000 7f22c0dbe640 1 -- 172.21.15.7:0/1717197605 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc1a0430 con 0x7f22bc1083a0 2024-09-21T05:54:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.132+0000 7f22c1dc0640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22bc108cf0 0x7f22bc19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:54:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.132+0000 7f22c15bf640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22bc102a60 0x7f22bc19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.132+0000 7f22c0dbe640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22bc1083a0 0x7f22bc19aa60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00e9c0 tx=0x7f22ac00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.132+0000 7f22b27fc640 1 -- 172.21.15.7:0/1717197605 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00cd80 con 0x7f22bc1083a0 2024-09-21T05:54:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.132+0000 7f22c3823640 1 -- 172.21.15.7:0/1717197605 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc1a0720 con 0x7f22bc1083a0 2024-09-21T05:54:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.132+0000 7f22b27fc640 1 -- 172.21.15.7:0/1717197605 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22ac0054d0 con 0x7f22bc1083a0 2024-09-21T05:54:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.132+0000 7f22b27fc640 1 -- 172.21.15.7:0/1717197605 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac010430 con 0x7f22bc1083a0 2024-09-21T05:54:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.132+0000 7f22c3823640 1 -- 172.21.15.7:0/1717197605 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc113100 con 0x7f22bc1083a0 2024-09-21T05:54:27.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.135+0000 7f22c9d97740 1 Processor -- start 2024-09-21T05:54:27.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.135+0000 7f22c9d97740 1 -- start start 2024-09-21T05:54:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.136+0000 7f22c9d97740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26d81270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.136+0000 7f22c9d97740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b11b0 0x55cc26d817b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.136+0000 7f22c9d97740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b9390 0x55cc26d81cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.136+0000 7f22c9d97740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cc26cf7e50 con 0x55cc269da070 2024-09-21T05:54:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.136+0000 7f22c9d97740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55cc26ce7280 con 0x55cc269b9390 2024-09-21T05:54:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.136+0000 7f22c9d97740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55cc26ceb090 con 0x55cc269b11b0 2024-09-21T05:54:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.136+0000 7f22c1dc0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26d81270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.136+0000 7f22c1dc0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26d81270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37694/0 (socket says 172.21.15.7:37694) 2024-09-21T05:54:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.136+0000 7f22c1dc0640 1 -- 172.21.15.7:0/390958473 learned_addr learned my addr 172.21.15.7:0/390958473 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.136+0000 7f22c15bf640 1 --2- 172.21.15.7:0/390958473 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b11b0 0x55cc26d817b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.137+0000 7f22c1dc0640 1 -- 172.21.15.7:0/390958473 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b11b0 msgr2=0x55cc26d817b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.137+0000 7f22c1dc0640 1 --2- 172.21.15.7:0/390958473 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b11b0 0x55cc26d817b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.137+0000 7f22c1dc0640 1 -- 172.21.15.7:0/390958473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b9390 msgr2=0x55cc26d81cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T05:54:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.137+0000 7f22c1dc0640 1 --2- 172.21.15.7:0/390958473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b9390 0x55cc26d81cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.137+0000 7f22c1dc0640 1 -- 172.21.15.7:0/390958473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc26a45650 con 0x55cc269da070 2024-09-21T05:54:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.137+0000 7f22c15bf640 1 --2- 172.21.15.7:0/390958473 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b11b0 0x55cc26d817b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:54:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.137+0000 7f22c1dc0640 1 --2- 172.21.15.7:0/390958473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26d81270 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009f10 tx=0x7f22b400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37baef2fc46f7057 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.137+0000 7f22a77fe640 1 -- 172.21.15.7:0/390958473 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4003b70 con 0x55cc269da070 2024-09-21T05:54:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.137+0000 7f22a77fe640 1 -- 172.21.15.7:0/390958473 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22b4003d10 con 0x55cc269da070 2024-09-21T05:54:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.137+0000 7f22a77fe640 1 -- 172.21.15.7:0/390958473 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b40119a0 con 0x55cc269da070 2024-09-21T05:54:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.138+0000 7f22b27fc640 1 -- 172.21.15.7:0/1717197605 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f22ac005020 con 0x7f22bc1083a0 2024-09-21T05:54:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.138+0000 7f22c9d97740 1 -- 172.21.15.7:0/390958473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 msgr2=0x55cc26d81270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.138+0000 7f22c9d97740 1 --2- 172.21.15.7:0/390958473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26d81270 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009f10 tx=0x7f22b400f730 comp rx=0 tx=0).stop 2024-09-21T05:54:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.138+0000 7f22c9d97740 1 -- 172.21.15.7:0/390958473 shutdown_connections 2024-09-21T05:54:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.138+0000 7f22c9d97740 1 --2- 172.21.15.7:0/390958473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b9390 0x55cc26d81cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.138+0000 7f22c9d97740 1 --2- 172.21.15.7:0/390958473 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b11b0 0x55cc26d817b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.138+0000 7f22c9d97740 1 --2- 172.21.15.7:0/390958473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26d81270 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.138+0000 7f22c9d97740 1 -- 172.21.15.7:0/390958473 >> 172.21.15.7:0/390958473 conn(0x55cc269ce460 msgr2=0x55cc26d7f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.139+0000 7f22c9d97740 1 -- 172.21.15.7:0/390958473 shutdown_connections 2024-09-21T05:54:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.139+0000 7f22c9d97740 1 -- 172.21.15.7:0/390958473 wait complete. 2024-09-21T05:54:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.139+0000 7f22c9d97740 1 -- start start 2024-09-21T05:54:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.139+0000 7f22b27fc640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22a80b6610 0x7f22a80b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.139+0000 7f22c9d97740 1 Processor -- start 2024-09-21T05:54:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.140+0000 7f22b27fc640 1 -- 172.21.15.7:0/1717197605 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f22ac0e7be0 con 0x7f22bc1083a0 2024-09-21T05:54:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.140+0000 7f22c1dc0640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22a80b6610 0x7f22a80b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.140+0000 7f22c9d97740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269b11b0 0x55cc26d95a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.140+0000 7f22c9d97740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b9390 0x55cc26d96050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.140+0000 7f22c9d97740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269da070 0x55cc26d9b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.140+0000 7f22c15bf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269b11b0 0x55cc26d95a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.140+0000 7f22c9d97740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cc26b48700 con 0x55cc269b11b0 2024-09-21T05:54:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.140+0000 7f22c15bf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269b11b0 0x55cc26d95a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37696/0 (socket says 172.21.15.7:37696) 2024-09-21T05:54:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.140+0000 7f22c15bf640 1 -- 172.21.15.7:0/3483139808 learned_addr learned my addr 172.21.15.7:0/3483139808 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.140+0000 7f22c9d97740 1 -- 172.21.15.7:0/3483139808 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55cc26c82110 con 0x55cc269da070 2024-09-21T05:54:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.140+0000 7f22c9d97740 1 -- 172.21.15.7:0/3483139808 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55cc26d8fa50 con 0x55cc269b9390 2024-09-21T05:54:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.140+0000 7f22c1dc0640 1 --2- 172.21.15.7:0/3483139808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269da070 0x55cc26d9b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.140+0000 7f22c9d97740 10 client.0 _ll_register_callbacks cb 0x55cc26c9b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.141+0000 7f22c0dbe640 1 --2- 172.21.15.7:0/3483139808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b9390 0x55cc26d96050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.141+0000 7f22c1dc0640 1 -- 172.21.15.7:0/3483139808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b9390 msgr2=0x55cc26d96050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.141+0000 7f22c1dc0640 1 --2- 172.21.15.7:0/3483139808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b9390 0x55cc26d96050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.141+0000 7f22c1dc0640 1 -- 172.21.15.7:0/3483139808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269b11b0 msgr2=0x55cc26d95a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.141+0000 7f22c1dc0640 1 --2- 172.21.15.7:0/3483139808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269b11b0 0x55cc26d95a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.141+0000 7f22c1dc0640 1 -- 172.21.15.7:0/3483139808 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc26cafc40 con 0x55cc269da070 2024-09-21T05:54:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.141+0000 7f22c1dc0640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22a80b6610 0x7f22a80b8b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f22b4011680 tx=0x7f22b4005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.141+0000 7f22c1dc0640 1 --2- 172.21.15.7:0/3483139808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269da070 0x55cc26d9b070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009f10 tx=0x7f22b4011580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d14789ba1a479a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.141+0000 7f22a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:54:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.141+0000 7f22a4ff9640 1 -- 172.21.15.7:0/3483139808 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4012c00 con 0x55cc269da070 2024-09-21T05:54:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.142+0000 7f22c9d97740 1 -- 172.21.15.7:0/3483139808 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22b4003d10 con 0x55cc269da070 2024-09-21T05:54:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.142+0000 7f22a4ff9640 1 -- 172.21.15.7:0/3483139808 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f22b4012da0 con 0x55cc269da070 2024-09-21T05:54:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.142+0000 7f22a4ff9640 1 -- 172.21.15.7:0/3483139808 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f22b4003ec0 con 0x55cc269da070 2024-09-21T05:54:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.142+0000 7f22c9d97740 10 client.25376 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.142+0000 7f22c9d97740 1 -- 172.21.15.7:0/3483139808 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc26d87290 con 0x55cc269da070 2024-09-21T05:54:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.142+0000 7f22a4ff9640 1 -- 172.21.15.7:0/3483139808 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22b4003d10 con 0x55cc269da070 2024-09-21T05:54:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.143+0000 7f22a4ff9640 1 -- 172.21.15.7:0/3483139808 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f22b4005500 con 0x55cc269da070 2024-09-21T05:54:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.143+0000 7f22c9d97740 10 client.25376 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.143+0000 7f22c9d97740 10 client.25376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.143+0000 7f22c9d97740 20 client.25376 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.143+0000 7f22c9d97740 1 --2- 172.21.15.7:0/3483139808 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55cc269989f0 0x55cc26d8a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.143+0000 7f22c9d97740 4 client.25376 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.143+0000 7f22c9d97740 1 -- 172.21.15.7:0/3483139808 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc26cf9da0 con 0x55cc269989f0 2024-09-21T05:54:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.143+0000 7f22c15bf640 1 --2- 172.21.15.7:0/3483139808 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55cc269989f0 0x55cc26d8a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.144+0000 7f22c15bf640 1 --2- 172.21.15.7:0/3483139808 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55cc269989f0 0x55cc26d8a6b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbbf50b72b9e0951 server_cookie=c1c71e52e816529a in_seq=0 out_seq=0 2024-09-21T05:54:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.144+0000 7f22a4ff9640 10 client.25376 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.144+0000 7f22a4ff9640 1 -- 172.21.15.7:0/3483139808 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc26cf9da0 con 0x55cc269989f0 2024-09-21T05:54:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.144+0000 7f22a4ff9640 10 client.25376 handle_command_reply: tid=0 2024-09-21T05:54:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.144+0000 7f22c9d97740 1 client.25376 shutdown 2024-09-21T05:54:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.145+0000 7f22c9d97740 1 -- 172.21.15.7:0/3483139808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269da070 msgr2=0x55cc26d9b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.145+0000 7f22c9d97740 1 --2- 172.21.15.7:0/3483139808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269da070 0x55cc26d9b070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009f10 tx=0x7f22b4011580 comp rx=0 tx=0).stop 2024-09-21T05:54:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.145+0000 7f22c9d97740 1 -- 172.21.15.7:0/3483139808 shutdown_connections 2024-09-21T05:54:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.145+0000 7f22c9d97740 1 --2- 172.21.15.7:0/3483139808 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55cc269989f0 0x55cc26d8a6b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.145+0000 7f22c9d97740 1 --2- 172.21.15.7:0/3483139808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269da070 0x55cc26d9b070 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.145+0000 7f22c9d97740 1 --2- 172.21.15.7:0/3483139808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b9390 0x55cc26d96050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.145+0000 7f22c9d97740 1 --2- 172.21.15.7:0/3483139808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269b11b0 0x55cc26d95a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.145+0000 7f22c9d97740 1 -- 172.21.15.7:0/3483139808 >> 172.21.15.7:0/3483139808 conn(0x55cc269ce460 msgr2=0x55cc26d84450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:27.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.145+0000 7f22a4ff9640 0 client.25376 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:27.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.145+0000 7f22c9d97740 1 -- 172.21.15.7:0/3483139808 shutdown_connections 2024-09-21T05:54:27.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.145+0000 7f22c9d97740 1 -- 172.21.15.7:0/3483139808 wait complete. 2024-09-21T05:54:27.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.145+0000 7f22c9d97740 20 client.25376 trim_cache size 0 max 16384 2024-09-21T05:54:27.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.163+0000 7f22c9d97740 1 Processor -- start 2024-09-21T05:54:27.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.163+0000 7f22c9d97740 1 -- start start 2024-09-21T05:54:27.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.163+0000 7f22c9d97740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b11b0 0x55cc26d9a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.163+0000 7f22c9d97740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b9390 0x55cc26d92c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.163+0000 7f22c9d97740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26d931c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.163+0000 7f22c9d97740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1afd40 con 0x55cc269da070 2024-09-21T05:54:27.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.163+0000 7f22c9d97740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1ad610 con 0x55cc269b9390 2024-09-21T05:54:27.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.163+0000 7f22c9d97740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1ab460 con 0x55cc269b11b0 2024-09-21T05:54:27.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22c1dc0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26d931c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22c1dc0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26d931c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37712/0 (socket says 172.21.15.7:37712) 2024-09-21T05:54:27.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22c1dc0640 1 -- 172.21.15.7:0/1829151164 learned_addr learned my addr 172.21.15.7:0/1829151164 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:27.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22c0dbe640 1 --2- 172.21.15.7:0/1829151164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b9390 0x55cc26d92c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22c0dbe640 1 -- 172.21.15.7:0/1829151164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b11b0 msgr2=0x55cc26d9a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:27.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22c0dbe640 1 --2- 172.21.15.7:0/1829151164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b11b0 0x55cc26d9a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22c0dbe640 1 -- 172.21.15.7:0/1829151164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 msgr2=0x55cc26d931c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:27.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22c0dbe640 1 --2- 172.21.15.7:0/1829151164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26d931c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22c0dbe640 1 -- 172.21.15.7:0/1829151164 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc26d96b30 con 0x55cc269b9390 2024-09-21T05:54:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22c1dc0640 1 --2- 172.21.15.7:0/1829151164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26d931c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22c0dbe640 1 --2- 172.21.15.7:0/1829151164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b9390 0x55cc26d92c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0e53b0 tx=0x7f22ac0a9a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96a912ee9191ea86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22a6ffd640 1 -- 172.21.15.7:0/1829151164 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0a9220 con 0x55cc269b9390 2024-09-21T05:54:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22a6ffd640 1 -- 172.21.15.7:0/1829151164 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22ac0b2030 con 0x55cc269b9390 2024-09-21T05:54:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.164+0000 7f22a6ffd640 1 -- 172.21.15.7:0/1829151164 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0b2590 con 0x55cc269b9390 2024-09-21T05:54:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.165+0000 7f22c9d97740 1 -- 172.21.15.7:0/1829151164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b9390 msgr2=0x55cc26d92c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.165+0000 7f22c9d97740 1 --2- 172.21.15.7:0/1829151164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b9390 0x55cc26d92c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0e53b0 tx=0x7f22ac0a9a10 comp rx=0 tx=0).stop 2024-09-21T05:54:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.165+0000 7f22c9d97740 1 -- 172.21.15.7:0/1829151164 shutdown_connections 2024-09-21T05:54:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.165+0000 7f22c9d97740 1 --2- 172.21.15.7:0/1829151164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26d931c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.165+0000 7f22c9d97740 1 --2- 172.21.15.7:0/1829151164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b9390 0x55cc26d92c80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.165+0000 7f22c9d97740 1 --2- 172.21.15.7:0/1829151164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b11b0 0x55cc26d9a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.165+0000 7f22c9d97740 1 -- 172.21.15.7:0/1829151164 >> 172.21.15.7:0/1829151164 conn(0x55cc269ce460 msgr2=0x55cc26d99ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:27.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.165+0000 7f22c9d97740 1 -- 172.21.15.7:0/1829151164 shutdown_connections 2024-09-21T05:54:27.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.166+0000 7f22c9d97740 1 -- 172.21.15.7:0/1829151164 wait complete. 2024-09-21T05:54:27.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.166+0000 7f22c9d97740 1 -- start start 2024-09-21T05:54:27.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.166+0000 7f22c9d97740 1 Processor -- start 2024-09-21T05:54:27.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.166+0000 7f22c9d97740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b11b0 0x55cc26d9dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c9d97740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b9390 0x55cc26d9e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c9d97740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26e01580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c9d97740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1abad0 con 0x55cc269da070 2024-09-21T05:54:27.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c9d97740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1acf40 con 0x55cc269b11b0 2024-09-21T05:54:27.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c9d97740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1ac1a0 con 0x55cc269b9390 2024-09-21T05:54:27.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c9d97740 10 client.0 _ll_register_callbacks cb 0x7f22b4015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:27.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c15bf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b11b0 0x55cc26d9dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c15bf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b11b0 0x55cc26d9dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:53482/0 (socket says 172.21.15.7:53482) 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c15bf640 1 -- 172.21.15.7:0/753389010 learned_addr learned my addr 172.21.15.7:0/753389010 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c0dbe640 1 --2- 172.21.15.7:0/753389010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b9390 0x55cc26d9e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c15bf640 1 -- 172.21.15.7:0/753389010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b9390 msgr2=0x55cc26d9e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c15bf640 1 --2- 172.21.15.7:0/753389010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b9390 0x55cc26d9e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c15bf640 1 -- 172.21.15.7:0/753389010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 msgr2=0x55cc26e01580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c15bf640 1 --2- 172.21.15.7:0/753389010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26e01580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c15bf640 1 -- 172.21.15.7:0/753389010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc26e01bf0 con 0x55cc269b11b0 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22c15bf640 1 --2- 172.21.15.7:0/753389010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b11b0 0x55cc26d9dc20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22b8005ab0 tx=0x7f22b8032cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35d6aeb4eb75d9d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.167+0000 7f22a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.168+0000 7f22a4ff9640 1 -- 172.21.15.7:0/753389010 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8035040 con 0x55cc269b11b0 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.168+0000 7f22c9d97740 1 -- 172.21.15.7:0/753389010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22ac0b2030 con 0x55cc269b11b0 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.168+0000 7f22a4ff9640 1 -- 172.21.15.7:0/753389010 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f22b8042070 con 0x55cc269b11b0 2024-09-21T05:54:27.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.168+0000 7f22a4ff9640 1 -- 172.21.15.7:0/753389010 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f22b8005250 con 0x55cc269b11b0 2024-09-21T05:54:27.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.168+0000 7f22c9d97740 10 client.25382 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:27.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.168+0000 7f22c9d97740 1 -- 172.21.15.7:0/753389010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc26e09020 con 0x55cc269b11b0 2024-09-21T05:54:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.168+0000 7f22a4ff9640 1 -- 172.21.15.7:0/753389010 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22b80053f0 con 0x55cc269b11b0 2024-09-21T05:54:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.169+0000 7f22a4ff9640 1 -- 172.21.15.7:0/753389010 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f22b80035f0 con 0x55cc269b11b0 2024-09-21T05:54:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.169+0000 7f22c9d97740 10 client.25382 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.169+0000 7f22c9d97740 10 client.25382 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.169+0000 7f22c9d97740 20 client.25382 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.169+0000 7f22c9d97740 1 --2- 172.21.15.7:0/753389010 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55cc2696dda0 0x55cc26e0b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.169+0000 7f22c9d97740 4 client.25382 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:54:27.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.169+0000 7f22c9d97740 1 -- 172.21.15.7:0/753389010 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f22ac0b2030 con 0x55cc2696dda0 2024-09-21T05:54:27.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.169+0000 7f22c0dbe640 1 --2- 172.21.15.7:0/753389010 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55cc2696dda0 0x55cc26e0b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:27.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22c0dbe640 1 --2- 172.21.15.7:0/753389010 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55cc2696dda0 0x55cc26e0b860 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cae0a67d9a25b95e server_cookie=a0a962421e40df11 in_seq=0 out_seq=0 2024-09-21T05:54:27.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22a4ff9640 10 client.25382 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:27.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22a4ff9640 1 -- 172.21.15.7:0/753389010 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x7f22ac0b2030 con 0x55cc2696dda0 2024-09-21T05:54:27.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22a4ff9640 10 client.25382 handle_command_reply: tid=0 2024-09-21T05:54:27.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22c9d97740 1 client.25382 shutdown 2024-09-21T05:54:27.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22c9d97740 1 -- 172.21.15.7:0/753389010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b11b0 msgr2=0x55cc26d9dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22c9d97740 1 --2- 172.21.15.7:0/753389010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b11b0 0x55cc26d9dc20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22b8005ab0 tx=0x7f22b8032cb0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22c9d97740 1 -- 172.21.15.7:0/753389010 shutdown_connections 2024-09-21T05:54:27.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22c9d97740 1 --2- 172.21.15.7:0/753389010 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55cc2696dda0 0x55cc26e0b860 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22c9d97740 1 --2- 172.21.15.7:0/753389010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc269da070 0x55cc26e01580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22c9d97740 1 --2- 172.21.15.7:0/753389010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc269b9390 0x55cc26d9e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22c9d97740 1 --2- 172.21.15.7:0/753389010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc269b11b0 0x55cc26d9dc20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22c9d97740 1 -- 172.21.15.7:0/753389010 >> 172.21.15.7:0/753389010 conn(0x55cc269ce460 msgr2=0x55cc26d82ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:27.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.170+0000 7f22a4ff9640 0 client.25382 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:27.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.171+0000 7f22c9d97740 1 -- 172.21.15.7:0/753389010 shutdown_connections 2024-09-21T05:54:27.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.171+0000 7f22c9d97740 1 -- 172.21.15.7:0/753389010 wait complete. 2024-09-21T05:54:27.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.171+0000 7f22c9d97740 20 client.25382 trim_cache size 0 max 16384 2024-09-21T05:54:27.175 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:54:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T05:54:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T05:54:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:54:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "9891a47c-baed-4663-96d7-95a281bed3f4", 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:54:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:54:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:54:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:54:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:54:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:54:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:54:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:54:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:54:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:54:27.177 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:54:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.171+0000 7f22c3823640 1 -- 172.21.15.7:0/1717197605 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22a80b6610 msgr2=0x7f22a80b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.171+0000 7f22c3823640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22a80b6610 0x7f22a80b8b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f22b4011680 tx=0x7f22b4005fd0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.171+0000 7f22c3823640 1 -- 172.21.15.7:0/1717197605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22bc1083a0 msgr2=0x7f22bc19aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.171+0000 7f22c3823640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22bc1083a0 0x7f22bc19aa60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00e9c0 tx=0x7f22ac00ee80 comp rx=0 tx=0).stop 2024-09-21T05:54:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.173+0000 7f22c3823640 1 -- 172.21.15.7:0/1717197605 shutdown_connections 2024-09-21T05:54:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.173+0000 7f22c3823640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22a80b6610 0x7f22a80b8b20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.173+0000 7f22c3823640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22bc108cf0 0x7f22bc19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.173+0000 7f22c3823640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22bc1083a0 0x7f22bc19aa60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.173+0000 7f22c3823640 1 --2- 172.21.15.7:0/1717197605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22bc102a60 0x7f22bc19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.173+0000 7f22c3823640 1 -- 172.21.15.7:0/1717197605 >> 172.21.15.7:0/1717197605 conn(0x7f22bc079730 msgr2=0x7f22bc100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.173+0000 7f22c3823640 1 -- 172.21.15.7:0/1717197605 shutdown_connections 2024-09-21T05:54:27.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:27.173+0000 7f22c3823640 1 -- 172.21.15.7:0/1717197605 wait complete. 2024-09-21T05:54:27.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:27 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T05:54:27.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:27 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:54:27.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:27 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T05:54:27.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:27 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:54:27.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:27 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T05:54:27.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:27 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:54:27.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:27 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T05:54:27.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:27 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:54:27.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:27 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T05:54:27.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:27 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:54:27.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:27 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T05:54:27.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:27 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:54:27.787 INFO:tasks.cephfs.filesystem:scrub status for tag:9891a47c-baed-4663-96d7-95a281bed3f4 - {'path': '/', 'tag': '9891a47c-baed-4663-96d7-95a281bed3f4', 'options': 'recursive,force'} 2024-09-21T05:54:28.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:28 smithi007 ceph-mon[30983]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-21T05:54:28.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:28 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T05:54:28.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:28 smithi119 ceph-mon[34833]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-21T05:54:28.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:28 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T05:54:28.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:28 smithi027 ceph-mon[34364]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-21T05:54:28.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:28 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T05:54:30.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:30 smithi007 ceph-mon[30983]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-21T05:54:30.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:30 smithi119 ceph-mon[34833]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-21T05:54:30.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:30 smithi027 ceph-mon[34364]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-21T05:54:32.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:32 smithi007 ceph-mon[30983]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T05:54:32.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:32 smithi119 ceph-mon[34833]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T05:54:32.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:32 smithi027 ceph-mon[34364]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T05:54:34.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:34 smithi007 ceph-mon[30983]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T05:54:34.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:34 smithi119 ceph-mon[34833]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T05:54:34.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:34 smithi027 ceph-mon[34364]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T05:54:36.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:36 smithi007 ceph-mon[30983]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T05:54:36.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:36 smithi119 ceph-mon[34833]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T05:54:36.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:36 smithi027 ceph-mon[34364]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T05:54:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.816+0000 7f973c32b640 1 -- 172.21.15.7:0/564853735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9734109410 msgr2=0x7f9734109820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.816+0000 7f973c32b640 1 --2- 172.21.15.7:0/564853735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9734109410 0x7f9734109820 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9724009900 tx=0x7f972402a410 comp rx=0 tx=0).stop 2024-09-21T05:54:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.816+0000 7f973c32b640 1 -- 172.21.15.7:0/564853735 shutdown_connections 2024-09-21T05:54:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.816+0000 7f973c32b640 1 --2- 172.21.15.7:0/564853735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9734109410 0x7f9734109820 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.816+0000 7f973c32b640 1 --2- 172.21.15.7:0/564853735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9734109d60 0x7f9734110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.816+0000 7f973c32b640 1 --2- 172.21.15.7:0/564853735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9734103ae0 0x7f9734103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.816+0000 7f973c32b640 1 -- 172.21.15.7:0/564853735 >> 172.21.15.7:0/564853735 conn(0x7f97340ff540 msgr2=0x7f9734101990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.816+0000 7f973c32b640 1 -- 172.21.15.7:0/564853735 shutdown_connections 2024-09-21T05:54:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.816+0000 7f973c32b640 1 -- 172.21.15.7:0/564853735 wait complete. 2024-09-21T05:54:36.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.817+0000 7f973c32b640 1 Processor -- start 2024-09-21T05:54:36.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.817+0000 7f973c32b640 1 -- start start 2024-09-21T05:54:36.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.817+0000 7f973c32b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9734103ae0 0x7f973419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.817+0000 7f973c32b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9734109410 0x7f973419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.817+0000 7f973c32b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9734109d60 0x7f97341a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.817+0000 7f973c32b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9734113a20 con 0x7f9734109d60 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.817+0000 7f973c32b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f97341138a0 con 0x7f9734109410 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.817+0000 7f973c32b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9734113ba0 con 0x7f9734103ae0 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.817+0000 7f973a8c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9734109d60 0x7f97341a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.817+0000 7f973a8c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9734109d60 0x7f97341a1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33446/0 (socket says 172.21.15.7:33446) 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.817+0000 7f973a8c8640 1 -- 172.21.15.7:0/1443404507 learned_addr learned my addr 172.21.15.7:0/1443404507 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.817+0000 7f97398c6640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9734109410 0x7f973419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.818+0000 7f973a0c7640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9734103ae0 0x7f973419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.818+0000 7f97398c6640 1 -- 172.21.15.7:0/1443404507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9734103ae0 msgr2=0x7f973419c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.818+0000 7f97398c6640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9734103ae0 0x7f973419c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.818+0000 7f97398c6640 1 -- 172.21.15.7:0/1443404507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9734109d60 msgr2=0x7f97341a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.818+0000 7f97398c6640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9734109d60 0x7f97341a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.818+0000 7f97398c6640 1 -- 172.21.15.7:0/1443404507 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97341a25b0 con 0x7f9734109410 2024-09-21T05:54:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.818+0000 7f973a8c8640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9734109d60 0x7f97341a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.818+0000 7f97398c6640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9734109410 0x7f973419cc20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f972402a930 tx=0x7f9724004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.818+0000 7f972b7fe640 1 -- 172.21.15.7:0/1443404507 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972403f070 con 0x7f9734109410 2024-09-21T05:54:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.818+0000 7f972b7fe640 1 -- 172.21.15.7:0/1443404507 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9724003ca0 con 0x7f9734109410 2024-09-21T05:54:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.818+0000 7f973c32b640 1 -- 172.21.15.7:0/1443404507 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97341a2840 con 0x7f9734109410 2024-09-21T05:54:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.819+0000 7f972b7fe640 1 -- 172.21.15.7:0/1443404507 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724035070 con 0x7f9734109410 2024-09-21T05:54:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.819+0000 7f973c32b640 1 -- 172.21.15.7:0/1443404507 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97341a2c90 con 0x7f9734109410 2024-09-21T05:54:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.822+0000 7f972b7fe640 1 -- 172.21.15.7:0/1443404507 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f972403b460 con 0x7f9734109410 2024-09-21T05:54:36.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.822+0000 7f9743298740 1 Processor -- start 2024-09-21T05:54:36.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.823+0000 7f9743298740 1 -- start start 2024-09-21T05:54:36.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.823+0000 7f9743298740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560311b0 0x55d1563d69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.823+0000 7f9743298740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1560082f0 0x55d1563d6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.823+0000 7f9743298740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560104d0 0x55d1563d7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.823+0000 7f9743298740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d15634b6f0 con 0x55d1560082f0 2024-09-21T05:54:36.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.823+0000 7f9743298740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d15633ab20 con 0x55d1560311b0 2024-09-21T05:54:36.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.823+0000 7f9743298740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d15633e930 con 0x55d1560104d0 2024-09-21T05:54:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.823+0000 7f973a8c8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560311b0 0x55d1563d69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.823+0000 7f973a8c8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560311b0 0x55d1563d69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:38530/0 (socket says 172.21.15.7:38530) 2024-09-21T05:54:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.823+0000 7f973a8c8640 1 -- 172.21.15.7:0/3030154536 learned_addr learned my addr 172.21.15.7:0/3030154536 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.823+0000 7f973a0c7640 1 --2- 172.21.15.7:0/3030154536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1560082f0 0x55d1563d6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.823+0000 7f97398c6640 1 --2- 172.21.15.7:0/3030154536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560104d0 0x55d1563d7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.824+0000 7f973a8c8640 1 -- 172.21.15.7:0/3030154536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560104d0 msgr2=0x55d1563d7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.824+0000 7f973a8c8640 1 --2- 172.21.15.7:0/3030154536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560104d0 0x55d1563d7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.824+0000 7f973a8c8640 1 -- 172.21.15.7:0/3030154536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1560082f0 msgr2=0x55d1563d6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.824+0000 7f973a8c8640 1 --2- 172.21.15.7:0/3030154536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1560082f0 0x55d1563d6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.824+0000 7f973a8c8640 1 -- 172.21.15.7:0/3030154536 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d156300530 con 0x55d1560311b0 2024-09-21T05:54:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.824+0000 7f973a8c8640 1 --2- 172.21.15.7:0/3030154536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560311b0 0x55d1563d69b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f972c011880 tx=0x7f972c011d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da7427f7960aa49c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.824+0000 7f9728bfe640 1 -- 172.21.15.7:0/3030154536 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c011310 con 0x55d1560311b0 2024-09-21T05:54:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.824+0000 7f9728bfe640 1 -- 172.21.15.7:0/3030154536 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f972c00fe50 con 0x55d1560311b0 2024-09-21T05:54:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.824+0000 7f9728bfe640 1 -- 172.21.15.7:0/3030154536 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c0193e0 con 0x55d1560311b0 2024-09-21T05:54:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.825+0000 7f972b7fe640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f97200b6700 0x7f97200b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.825+0000 7f973a0c7640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f97200b6700 0x7f97200b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.825+0000 7f972b7fe640 1 -- 172.21.15.7:0/1443404507 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9724107ac0 con 0x7f9734109410 2024-09-21T05:54:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.825+0000 7f973a0c7640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f97200b6700 0x7f97200b8c10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55d1563d5630 tx=0x7f973000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.825+0000 7f9743298740 1 -- 172.21.15.7:0/3030154536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560311b0 msgr2=0x55d1563d69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.825+0000 7f9743298740 1 --2- 172.21.15.7:0/3030154536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560311b0 0x55d1563d69b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f972c011880 tx=0x7f972c011d40 comp rx=0 tx=0).stop 2024-09-21T05:54:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.825+0000 7f9743298740 1 -- 172.21.15.7:0/3030154536 shutdown_connections 2024-09-21T05:54:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.825+0000 7f9743298740 1 --2- 172.21.15.7:0/3030154536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1560082f0 0x55d1563d6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.825+0000 7f9743298740 1 --2- 172.21.15.7:0/3030154536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560104d0 0x55d1563d7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.825+0000 7f9743298740 1 --2- 172.21.15.7:0/3030154536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560311b0 0x55d1563d69b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.825+0000 7f9743298740 1 -- 172.21.15.7:0/3030154536 >> 172.21.15.7:0/3030154536 conn(0x55d156025300 msgr2=0x55d1563d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:36.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.826+0000 7f9743298740 1 -- 172.21.15.7:0/3030154536 shutdown_connections 2024-09-21T05:54:36.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.826+0000 7f9743298740 1 -- 172.21.15.7:0/3030154536 wait complete. 2024-09-21T05:54:36.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.826+0000 7f9743298740 1 -- start start 2024-09-21T05:54:36.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.826+0000 7f9743298740 1 Processor -- start 2024-09-21T05:54:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.827+0000 7f9743298740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 0x55d1563e2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.827+0000 7f9743298740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563e2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.827+0000 7f9743298740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1560311b0 0x55d1563ee450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.827+0000 7f9743298740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d156272ab0 con 0x55d1560311b0 2024-09-21T05:54:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.827+0000 7f9743298740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d1562e0730 con 0x55d1560104d0 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.827+0000 7f9743298740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d1563e5130 con 0x55d1560082f0 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.827+0000 7f973a8c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1560311b0 0x55d1563ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.827+0000 7f9743298740 10 client.0 _ll_register_callbacks cb 0x55d1563346b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.827+0000 7f973a8c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1560311b0 0x55d1563ee450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33462/0 (socket says 172.21.15.7:33462) 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.827+0000 7f973a8c8640 1 -- 172.21.15.7:0/2546452087 learned_addr learned my addr 172.21.15.7:0/2546452087 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.827+0000 7f97398c6640 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563e2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.827+0000 7f973a0c7640 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 0x55d1563e2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.828+0000 7f97398c6640 1 -- 172.21.15.7:0/2546452087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 msgr2=0x55d1563e2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.828+0000 7f97398c6640 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 0x55d1563e2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.828+0000 7f97398c6640 1 -- 172.21.15.7:0/2546452087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1560311b0 msgr2=0x55d1563ee450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.828+0000 7f97398c6640 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1560311b0 0x55d1563ee450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.828+0000 7f97398c6640 1 -- 172.21.15.7:0/2546452087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d15609c790 con 0x55d1560104d0 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.828+0000 7f973a8c8640 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1560311b0 0x55d1563ee450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.828+0000 7f97398c6640 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563e2550 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9724105290 tx=0x7f97240045b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ffc0e45ba2c61e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.828+0000 7f971dffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:54:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.828+0000 7f971dffb640 1 -- 172.21.15.7:0/2546452087 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724048040 con 0x55d1560104d0 2024-09-21T05:54:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.828+0000 7f971dffb640 1 -- 172.21.15.7:0/2546452087 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f97240037f0 con 0x55d1560104d0 2024-09-21T05:54:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.828+0000 7f9743298740 1 -- 172.21.15.7:0/2546452087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f972c00fe50 con 0x55d1560104d0 2024-09-21T05:54:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.829+0000 7f971dffb640 1 -- 172.21.15.7:0/2546452087 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f97240ca090 con 0x55d1560104d0 2024-09-21T05:54:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.829+0000 7f9743298740 10 client.25394 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.829+0000 7f9743298740 1 -- 172.21.15.7:0/2546452087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d156115620 con 0x55d1560104d0 2024-09-21T05:54:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.829+0000 7f971dffb640 1 -- 172.21.15.7:0/2546452087 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f972410d020 con 0x55d1560104d0 2024-09-21T05:54:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.829+0000 7f971dffb640 1 -- 172.21.15.7:0/2546452087 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f972404b060 con 0x55d1560104d0 2024-09-21T05:54:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.829+0000 7f9743298740 10 client.25394 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.829+0000 7f9743298740 10 client.25394 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.829+0000 7f9743298740 20 client.25394 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.829+0000 7f9743298740 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d155fefd80 0x55d1563f4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.829+0000 7f9743298740 4 client.25394 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.830+0000 7f9743298740 1 -- 172.21.15.7:0/2546452087 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f972c00fe50 con 0x55d155fefd80 2024-09-21T05:54:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.830+0000 7f973a0c7640 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d155fefd80 0x55d1563f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.830+0000 7f973a0c7640 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d155fefd80 0x55d1563f4180 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce54aae8f7f2067c server_cookie=e84254e794a2c1cb in_seq=0 out_seq=0 2024-09-21T05:54:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.830+0000 7f971dffb640 10 client.25394 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f971dffb640 1 -- 172.21.15.7:0/2546452087 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f972c00fe50 con 0x55d155fefd80 2024-09-21T05:54:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f971dffb640 10 client.25394 handle_command_reply: tid=0 2024-09-21T05:54:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f9743298740 1 client.25394 shutdown 2024-09-21T05:54:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f9743298740 1 -- 172.21.15.7:0/2546452087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 msgr2=0x55d1563e2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f9743298740 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563e2550 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9724105290 tx=0x7f97240045b0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f9743298740 1 -- 172.21.15.7:0/2546452087 shutdown_connections 2024-09-21T05:54:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f9743298740 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d155fefd80 0x55d1563f4180 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f9743298740 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1560311b0 0x55d1563ee450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f971dffb640 0 client.25394 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f9743298740 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563e2550 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f9743298740 1 --2- 172.21.15.7:0/2546452087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 0x55d1563e2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f9743298740 1 -- 172.21.15.7:0/2546452087 >> 172.21.15.7:0/2546452087 conn(0x55d156025300 msgr2=0x55d1563d79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f9743298740 1 -- 172.21.15.7:0/2546452087 shutdown_connections 2024-09-21T05:54:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.831+0000 7f9743298740 1 -- 172.21.15.7:0/2546452087 wait complete. 2024-09-21T05:54:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.832+0000 7f9743298740 20 client.25394 trim_cache size 0 max 16384 2024-09-21T05:54:36.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.861+0000 7f9743298740 1 Processor -- start 2024-09-21T05:54:36.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.861+0000 7f9743298740 1 -- start start 2024-09-21T05:54:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.861+0000 7f9743298740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 0x55d1563d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.861+0000 7f9743298740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 0x55d1563df1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.861+0000 7f9743298740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563df720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.861+0000 7f9743298740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97341afb80 con 0x55d155fefd80 2024-09-21T05:54:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.861+0000 7f9743298740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f97341ad450 con 0x55d1560104d0 2024-09-21T05:54:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.861+0000 7f9743298740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f97341ab2c0 con 0x55d1560082f0 2024-09-21T05:54:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.861+0000 7f973a0c7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 0x55d1563d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.861+0000 7f973a0c7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 0x55d1563d3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33478/0 (socket says 172.21.15.7:33478) 2024-09-21T05:54:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.861+0000 7f973a0c7640 1 -- 172.21.15.7:0/2401354551 learned_addr learned my addr 172.21.15.7:0/2401354551 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.861+0000 7f973a8c8640 1 --2- 172.21.15.7:0/2401354551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563df720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.861+0000 7f97398c6640 1 --2- 172.21.15.7:0/2401354551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 0x55d1563df1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.862+0000 7f973a8c8640 1 -- 172.21.15.7:0/2401354551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 msgr2=0x55d1563df1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.862+0000 7f973a8c8640 1 --2- 172.21.15.7:0/2401354551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 0x55d1563df1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.862+0000 7f973a8c8640 1 -- 172.21.15.7:0/2401354551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 msgr2=0x55d1563d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.862+0000 7f973a8c8640 1 --2- 172.21.15.7:0/2401354551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 0x55d1563d3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.862+0000 7f973a8c8640 1 -- 172.21.15.7:0/2401354551 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1563dfc60 con 0x55d1560104d0 2024-09-21T05:54:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.862+0000 7f973a0c7640 1 --2- 172.21.15.7:0/2401354551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 0x55d1563d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.862+0000 7f97398c6640 1 --2- 172.21.15.7:0/2401354551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 0x55d1563df1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:54:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.862+0000 7f973a8c8640 1 --2- 172.21.15.7:0/2401354551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563df720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f972c009aa0 tx=0x7f972c005a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bd066a02ec22a14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.862+0000 7f971ffff640 1 -- 172.21.15.7:0/2401354551 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c028020 con 0x55d1560104d0 2024-09-21T05:54:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.862+0000 7f971ffff640 1 -- 172.21.15.7:0/2401354551 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f972c00f9a0 con 0x55d1560104d0 2024-09-21T05:54:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.862+0000 7f971ffff640 1 -- 172.21.15.7:0/2401354551 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c024470 con 0x55d1560104d0 2024-09-21T05:54:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.864+0000 7f9743298740 1 -- 172.21.15.7:0/2401354551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 msgr2=0x55d1563df720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.864+0000 7f9743298740 1 --2- 172.21.15.7:0/2401354551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563df720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f972c009aa0 tx=0x7f972c005a10 comp rx=0 tx=0).stop 2024-09-21T05:54:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.864+0000 7f9743298740 1 -- 172.21.15.7:0/2401354551 shutdown_connections 2024-09-21T05:54:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.864+0000 7f9743298740 1 --2- 172.21.15.7:0/2401354551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563df720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.864+0000 7f9743298740 1 --2- 172.21.15.7:0/2401354551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 0x55d1563df1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.864+0000 7f9743298740 1 --2- 172.21.15.7:0/2401354551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 0x55d1563d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.864+0000 7f9743298740 1 -- 172.21.15.7:0/2401354551 >> 172.21.15.7:0/2401354551 conn(0x55d156025300 msgr2=0x55d1563d4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.865+0000 7f9743298740 1 -- 172.21.15.7:0/2401354551 shutdown_connections 2024-09-21T05:54:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.865+0000 7f9743298740 1 -- 172.21.15.7:0/2401354551 wait complete. 2024-09-21T05:54:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.865+0000 7f9743298740 1 -- start start 2024-09-21T05:54:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.865+0000 7f9743298740 1 Processor -- start 2024-09-21T05:54:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f9743298740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 0x55d1563eac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f973a0c7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 0x55d1563eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f973a0c7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 0x55d1563eac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33480/0 (socket says 172.21.15.7:33480) 2024-09-21T05:54:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f9743298740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 0x55d1563e8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f973a0c7640 1 -- 172.21.15.7:0/3606124169 learned_addr learned my addr 172.21.15.7:0/3606124169 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f9743298740 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563e8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f9743298740 1 -- 172.21.15.7:0/3606124169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97341ab910 con 0x55d155fefd80 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f9743298740 1 -- 172.21.15.7:0/3606124169 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f97341acd80 con 0x55d1560104d0 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f9743298740 1 -- 172.21.15.7:0/3606124169 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f97341abfe0 con 0x55d1560082f0 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f97398c6640 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 0x55d1563e8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f973a8c8640 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563e8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f973a0c7640 1 -- 172.21.15.7:0/3606124169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 msgr2=0x55d1563e8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f973a0c7640 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 0x55d1563e8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f973a0c7640 1 -- 172.21.15.7:0/3606124169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 msgr2=0x55d1563e8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f973a0c7640 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563e8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.866+0000 7f973a0c7640 1 -- 172.21.15.7:0/3606124169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1563e8eb0 con 0x55d155fefd80 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.867+0000 7f973a8c8640 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563e8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.867+0000 7f9743298740 10 client.0 _ll_register_callbacks cb 0x7f97240c9ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.867+0000 7f9743298740 1 -- 172.21.15.7:0/3606124169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f972c00f9a0 con 0x55d155fefd80 2024-09-21T05:54:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.867+0000 7f973a0c7640 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 0x55d1563eac60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f97300246c0 tx=0x7f97300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9d520bdc772fa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.867+0000 7f971dffb640 10 client.15702 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.867+0000 7f971dffb640 1 -- 172.21.15.7:0/3606124169 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730017bd0 con 0x55d155fefd80 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.867+0000 7f971dffb640 1 -- 172.21.15.7:0/3606124169 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9730017d70 con 0x55d155fefd80 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.867+0000 7f971dffb640 1 -- 172.21.15.7:0/3606124169 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f97300314f0 con 0x55d155fefd80 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.867+0000 7f9743298740 10 client.15702 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.867+0000 7f9743298740 1 -- 172.21.15.7:0/3606124169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55d15645e8a0 con 0x55d155fefd80 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.868+0000 7f971dffb640 1 -- 172.21.15.7:0/3606124169 <== mon.0 v2:172.21.15.7:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9730035070 con 0x55d155fefd80 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.868+0000 7f9743298740 10 client.15702 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.868+0000 7f9743298740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.868+0000 7f9743298740 20 client.15702 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.868+0000 7f9743298740 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d1560311b0 0x55d156461160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.868+0000 7f9743298740 4 client.15702 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.868+0000 7f9743298740 1 -- 172.21.15.7:0/3606124169 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d15634d640 con 0x55d1560311b0 2024-09-21T05:54:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.868+0000 7f97398c6640 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d1560311b0 0x55d156461160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.869+0000 7f97398c6640 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d1560311b0 0x55d156461160 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75ae9b685e0126aa server_cookie=b633410ae51c3643 in_seq=0 out_seq=0 2024-09-21T05:54:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.869+0000 7f971dffb640 10 client.15702 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f971dffb640 1 -- 172.21.15.7:0/3606124169 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d15634d640 con 0x55d1560311b0 2024-09-21T05:54:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f971dffb640 10 client.15702 handle_command_reply: tid=0 2024-09-21T05:54:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f9743298740 1 client.15702 shutdown 2024-09-21T05:54:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f9743298740 1 -- 172.21.15.7:0/3606124169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 msgr2=0x55d1563eac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f9743298740 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 0x55d1563eac60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f97300246c0 tx=0x7f97300046c0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f9743298740 1 -- 172.21.15.7:0/3606124169 shutdown_connections 2024-09-21T05:54:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f9743298740 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d1560311b0 0x55d156461160 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f9743298740 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d1560104d0 0x55d1563e8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f9743298740 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d1560082f0 0x55d1563e8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f971dffb640 0 client.15702 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f9743298740 1 --2- 172.21.15.7:0/3606124169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d155fefd80 0x55d1563eac60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f9743298740 1 -- 172.21.15.7:0/3606124169 >> 172.21.15.7:0/3606124169 conn(0x55d156025300 msgr2=0x55d1563e3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f9743298740 1 -- 172.21.15.7:0/3606124169 shutdown_connections 2024-09-21T05:54:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f9743298740 1 -- 172.21.15.7:0/3606124169 wait complete. 2024-09-21T05:54:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.875+0000 7f9743298740 20 client.15702 trim_cache size 0 max 16384 2024-09-21T05:54:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T05:54:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T05:54:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T05:54:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T05:54:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.876+0000 7f973c32b640 1 -- 172.21.15.7:0/1443404507 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f97200b6700 msgr2=0x7f97200b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.876+0000 7f973c32b640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f97200b6700 0x7f97200b8c10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55d1563d5630 tx=0x7f973000b410 comp rx=0 tx=0).stop 2024-09-21T05:54:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.876+0000 7f973c32b640 1 -- 172.21.15.7:0/1443404507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9734109410 msgr2=0x7f973419cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.876+0000 7f973c32b640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9734109410 0x7f973419cc20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f972402a930 tx=0x7f9724004060 comp rx=0 tx=0).stop 2024-09-21T05:54:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.876+0000 7f973c32b640 1 -- 172.21.15.7:0/1443404507 shutdown_connections 2024-09-21T05:54:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.876+0000 7f973c32b640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f97200b6700 0x7f97200b8c10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.876+0000 7f973c32b640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9734109d60 0x7f97341a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.876+0000 7f973c32b640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9734109410 0x7f973419cc20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.876+0000 7f973c32b640 1 --2- 172.21.15.7:0/1443404507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9734103ae0 0x7f973419c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.876+0000 7f973c32b640 1 -- 172.21.15.7:0/1443404507 >> 172.21.15.7:0/1443404507 conn(0x7f97340ff540 msgr2=0x7f9734108ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.876+0000 7f973c32b640 1 -- 172.21.15.7:0/1443404507 shutdown_connections 2024-09-21T05:54:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:36.876+0000 7f973c32b640 1 -- 172.21.15.7:0/1443404507 wait complete. 2024-09-21T05:54:38.528 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:38 smithi027 ceph-mon[34364]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T05:54:38.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:38 smithi007 ceph-mon[30983]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T05:54:38.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:38 smithi119 ceph-mon[34833]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T05:54:40.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:40 smithi007 ceph-mon[30983]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T05:54:40.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:40 smithi119 ceph-mon[34833]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T05:54:40.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:40 smithi027 ceph-mon[34364]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T05:54:42.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:42 smithi007 ceph-mon[30983]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T05:54:42.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:42 smithi119 ceph-mon[34833]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T05:54:42.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:42 smithi027 ceph-mon[34364]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T05:54:44.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:44 smithi007 ceph-mon[30983]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T05:54:44.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:44 smithi119 ceph-mon[34833]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T05:54:44.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:44 smithi027 ceph-mon[34364]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T05:54:46.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:46 smithi007 ceph-mon[30983]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T05:54:46.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:46 smithi119 ceph-mon[34833]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T05:54:46.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:46 smithi027 ceph-mon[34364]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T05:54:47.040 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 90% (11513/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T05:54:47.401 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T05:54:47.401 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T05:54:47.401 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T05:54:47.401 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T05:54:47.401 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T05:54:47.401 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T05:54:47.401 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T05:54:47.401 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T05:54:47.401 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T05:54:47.401 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-09-21T05:54:47.401 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T05:54:47.401 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-09-21T05:54:47.402 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T05:54:47.402 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-09-21T05:54:47.402 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T05:54:47.402 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T05:54:47.402 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T05:54:47.402 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:54:47.406 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T05:54:47.434 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T05:54:47.437 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T05:54:47.437 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T05:54:48.155 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T05:54:48.223 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T05:54:48.264 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T05:54:48.266 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T05:54:48.266 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T05:54:48.306 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T05:54:48.310 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T05:54:48.310 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T05:54:48.366 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-09-21T05:54:48.367 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-09-21T05:54:48.368 DEBUG:teuthology.orchestra.run.smithi007:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-21T05:54:48.428 INFO:tasks.workunit.client.0.smithi007.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-09-21T05:54:48.451 INFO:tasks.workunit.client.0.smithi007.stderr:--2024-09-21 05:54:48-- http://download.ceph.com/qa/fsync-tester.c 2024-09-21T05:54:48.461 INFO:tasks.workunit.client.0.smithi007.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-21T05:54:48.482 INFO:tasks.workunit.client.0.smithi007.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-21T05:54:48.503 INFO:tasks.workunit.client.0.smithi007.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-21T05:54:48.503 INFO:tasks.workunit.client.0.smithi007.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-09-21T05:54:48.504 INFO:tasks.workunit.client.0.smithi007.stderr:Saving to: ‘fsync-tester.c’ 2024-09-21T05:54:48.508 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T05:54:48.508 INFO:tasks.workunit.client.0.smithi007.stderr: 0K .. 100% 466M=0s 2024-09-21T05:54:48.508 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T05:54:48.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-21 05:54:48 (466 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-09-21T05:54:48.508 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T05:54:48.508 INFO:tasks.workunit.client.0.smithi007.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-09-21T05:54:48.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:48 smithi007 ceph-mon[30983]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T05:54:48.589 INFO:tasks.workunit.client.0.smithi007.stderr:+ ./fsync-tester 2024-09-21T05:54:48.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:48 smithi119 ceph-mon[34833]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T05:54:48.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:48 smithi027 ceph-mon[34364]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T05:54:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.980+0000 7fd422fc3640 1 -- 172.21.15.7:0/3555729508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41c108c40 msgr2=0x7fd41c10f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.980+0000 7fd422fc3640 1 --2- 172.21.15.7:0/3555729508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41c108c40 0x7fd41c10f470 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd414009ca0 tx=0x7fd41402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.980+0000 7fd422fc3640 1 -- 172.21.15.7:0/3555729508 shutdown_connections 2024-09-21T05:54:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.980+0000 7fd422fc3640 1 --2- 172.21.15.7:0/3555729508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41c108c40 0x7fd41c10f470 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.980+0000 7fd422fc3640 1 --2- 172.21.15.7:0/3555729508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c1082f0 0x7fd41c108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.980+0000 7fd422fc3640 1 --2- 172.21.15.7:0/3555729508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd41c1029c0 0x7fd41c102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.980+0000 7fd422fc3640 1 -- 172.21.15.7:0/3555729508 >> 172.21.15.7:0/3555729508 conn(0x7fd41c0fe3c0 msgr2=0x7fd41c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.980+0000 7fd422fc3640 1 -- 172.21.15.7:0/3555729508 shutdown_connections 2024-09-21T05:54:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.980+0000 7fd422fc3640 1 -- 172.21.15.7:0/3555729508 wait complete. 2024-09-21T05:54:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.981+0000 7fd422fc3640 1 Processor -- start 2024-09-21T05:54:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.981+0000 7fd422fc3640 1 -- start start 2024-09-21T05:54:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.981+0000 7fd422fc3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c1029c0 0x7fd41c19a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.981+0000 7fd422fc3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd41c1082f0 0x7fd41c19a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.981+0000 7fd422fc3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41c108c40 0x7fd41c19fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.981+0000 7fd422fc3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c112900 con 0x7fd41c108c40 2024-09-21T05:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.981+0000 7fd422fc3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c112780 con 0x7fd41c1082f0 2024-09-21T05:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.981+0000 7fd422fc3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c112a80 con 0x7fd41c1029c0 2024-09-21T05:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.982+0000 7fd421560640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41c108c40 0x7fd41c19fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.982+0000 7fd421560640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41c108c40 0x7fd41c19fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40044/0 (socket says 172.21.15.7:40044) 2024-09-21T05:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.982+0000 7fd413fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd41c1082f0 0x7fd41c19a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.982+0000 7fd421560640 1 -- 172.21.15.7:0/518595230 learned_addr learned my addr 172.21.15.7:0/518595230 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.982+0000 7fd420d5f640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c1029c0 0x7fd41c19a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.982+0000 7fd413fff640 1 -- 172.21.15.7:0/518595230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c1029c0 msgr2=0x7fd41c19a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.982+0000 7fd413fff640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c1029c0 0x7fd41c19a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.982+0000 7fd413fff640 1 -- 172.21.15.7:0/518595230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41c108c40 msgr2=0x7fd41c19fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.982+0000 7fd413fff640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41c108c40 0x7fd41c19fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.982+0000 7fd413fff640 1 -- 172.21.15.7:0/518595230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c1a02c0 con 0x7fd41c1082f0 2024-09-21T05:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.982+0000 7fd421560640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41c108c40 0x7fd41c19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.982+0000 7fd413fff640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd41c1082f0 0x7fd41c19a930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd40c005fd0 tx=0x7fd40c00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.983+0000 7fd411ffb640 1 -- 172.21.15.7:0/518595230 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c009c00 con 0x7fd41c1082f0 2024-09-21T05:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.983+0000 7fd422fc3640 1 -- 172.21.15.7:0/518595230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41c1a05b0 con 0x7fd41c1082f0 2024-09-21T05:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.983+0000 7fd411ffb640 1 -- 172.21.15.7:0/518595230 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd40c009da0 con 0x7fd41c1082f0 2024-09-21T05:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.983+0000 7fd411ffb640 1 -- 172.21.15.7:0/518595230 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c003db0 con 0x7fd41c1082f0 2024-09-21T05:54:49.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.983+0000 7fd422fc3640 1 -- 172.21.15.7:0/518595230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41c1a6d40 con 0x7fd41c1082f0 2024-09-21T05:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd42a009740 1 Processor -- start 2024-09-21T05:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd42a009740 1 -- start start 2024-09-21T05:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd42a009740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 0x55c584e089b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd42a009740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a3a2f0 0x55c584e08ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd42a009740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a424d0 0x55c584e09430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd42a009740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c584d7d6f0 con 0x55c584a631b0 2024-09-21T05:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd42a009740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c584d6cb20 con 0x55c584a424d0 2024-09-21T05:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd42a009740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c584d70930 con 0x55c584a3a2f0 2024-09-21T05:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd421560640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 0x55c584e089b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd421560640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 0x55c584e089b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40046/0 (socket says 172.21.15.7:40046) 2024-09-21T05:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd421560640 1 -- 172.21.15.7:0/2002937983 learned_addr learned my addr 172.21.15.7:0/2002937983 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd420d5f640 1 --2- 172.21.15.7:0/2002937983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a3a2f0 0x55c584e08ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd421560640 1 -- 172.21.15.7:0/2002937983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a3a2f0 msgr2=0x55c584e08ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd421560640 1 --2- 172.21.15.7:0/2002937983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a3a2f0 0x55c584e08ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd421560640 1 -- 172.21.15.7:0/2002937983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a424d0 msgr2=0x55c584e09430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T05:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd421560640 1 --2- 172.21.15.7:0/2002937983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a424d0 0x55c584e09430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.986+0000 7fd421560640 1 -- 172.21.15.7:0/2002937983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c584d32530 con 0x55c584a631b0 2024-09-21T05:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.987+0000 7fd421560640 1 --2- 172.21.15.7:0/2002937983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 0x55c584e089b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd4140094e0 tx=0x7fd41402f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454762d50e36de3b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.987+0000 7fd402ffd640 1 -- 172.21.15.7:0/2002937983 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd414031650 con 0x55c584a631b0 2024-09-21T05:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.987+0000 7fd402ffd640 1 -- 172.21.15.7:0/2002937983 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd414036040 con 0x55c584a631b0 2024-09-21T05:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.987+0000 7fd402ffd640 1 -- 172.21.15.7:0/2002937983 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd414004500 con 0x55c584a631b0 2024-09-21T05:54:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.987+0000 7fd411ffb640 1 -- 172.21.15.7:0/518595230 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd40c003f50 con 0x7fd41c1082f0 2024-09-21T05:54:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd411ffb640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4040b6680 0x7fd4040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd42a009740 1 -- 172.21.15.7:0/2002937983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 msgr2=0x55c584e089b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd42a009740 1 --2- 172.21.15.7:0/2002937983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 0x55c584e089b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd4140094e0 tx=0x7fd41402f390 comp rx=0 tx=0).stop 2024-09-21T05:54:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd42a009740 1 -- 172.21.15.7:0/2002937983 shutdown_connections 2024-09-21T05:54:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd42a009740 1 --2- 172.21.15.7:0/2002937983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a424d0 0x55c584e09430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd420d5f640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4040b6680 0x7fd4040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd42a009740 1 --2- 172.21.15.7:0/2002937983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a3a2f0 0x55c584e08ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd42a009740 1 --2- 172.21.15.7:0/2002937983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 0x55c584e089b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd411ffb640 1 -- 172.21.15.7:0/518595230 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fd40c0e7070 con 0x7fd41c1082f0 2024-09-21T05:54:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd42a009740 1 -- 172.21.15.7:0/2002937983 >> 172.21.15.7:0/2002937983 conn(0x55c584a57300 msgr2=0x55c584e068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd42a009740 1 -- 172.21.15.7:0/2002937983 shutdown_connections 2024-09-21T05:54:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd42a009740 1 -- 172.21.15.7:0/2002937983 wait complete. 2024-09-21T05:54:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd420d5f640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4040b6680 0x7fd4040b8b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55c584e07630 tx=0x7fd418005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.988+0000 7fd42a009740 1 -- start start 2024-09-21T05:54:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.989+0000 7fd42a009740 1 Processor -- start 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.989+0000 7fd42a009740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a3a2f0 0x55c584e140e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.989+0000 7fd42a009740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a424d0 0x55c584e14620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.989+0000 7fd42a009740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 0x55c584e20240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.989+0000 7fd42a009740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c584ca4ab0 con 0x55c584a631b0 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.989+0000 7fd42a009740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c584d12730 con 0x55c584a3a2f0 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.989+0000 7fd42a009740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c584e16f50 con 0x55c584a424d0 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.989+0000 7fd42a009740 10 client.0 _ll_register_callbacks cb 0x55c584d666b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.989+0000 7fd421560640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 0x55c584e20240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.989+0000 7fd421560640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 0x55c584e20240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40058/0 (socket says 172.21.15.7:40058) 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.989+0000 7fd421560640 1 -- 172.21.15.7:0/1390077230 learned_addr learned my addr 172.21.15.7:0/1390077230 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.989+0000 7fd420d5f640 1 --2- 172.21.15.7:0/1390077230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a3a2f0 0x55c584e140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd413fff640 1 --2- 172.21.15.7:0/1390077230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a424d0 0x55c584e14620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd421560640 1 -- 172.21.15.7:0/1390077230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a424d0 msgr2=0x55c584e14620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd421560640 1 --2- 172.21.15.7:0/1390077230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a424d0 0x55c584e14620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd421560640 1 -- 172.21.15.7:0/1390077230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a3a2f0 msgr2=0x55c584e140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd421560640 1 --2- 172.21.15.7:0/1390077230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a3a2f0 0x55c584e140e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd421560640 1 -- 172.21.15.7:0/1390077230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c584ace790 con 0x55c584a631b0 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd421560640 1 --2- 172.21.15.7:0/1390077230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 0x55c584e20240 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd414009570 tx=0x7fd414003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a88dd9a54fa229 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd3fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd3fbfff640 1 -- 172.21.15.7:0/1390077230 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd414052020 con 0x55c584a631b0 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd3fbfff640 1 -- 172.21.15.7:0/1390077230 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fd414004280 con 0x55c584a631b0 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd42a009740 1 -- 172.21.15.7:0/1390077230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd414036040 con 0x55c584a631b0 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd3fbfff640 1 -- 172.21.15.7:0/1390077230 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd4140098a0 con 0x55c584a631b0 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd42a009740 10 client.15714 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.990+0000 7fd42a009740 1 -- 172.21.15.7:0/1390077230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c584b47620 con 0x55c584a631b0 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.991+0000 7fd3fbfff640 1 -- 172.21.15.7:0/1390077230 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd414036040 con 0x55c584a631b0 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.991+0000 7fd3fbfff640 1 -- 172.21.15.7:0/1390077230 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd414044070 con 0x55c584a631b0 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.991+0000 7fd42a009740 10 client.15714 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.991+0000 7fd42a009740 10 client.15714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.991+0000 7fd42a009740 20 client.15714 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.991+0000 7fd42a009740 1 --2- 172.21.15.7:0/1390077230 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c584a21d80 0x55c584e25e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.991+0000 7fd42a009740 4 client.15714 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.991+0000 7fd42a009740 1 -- 172.21.15.7:0/1390077230 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c584d7f640 con 0x55c584a21d80 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.991+0000 7fd420d5f640 1 --2- 172.21.15.7:0/1390077230 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c584a21d80 0x55c584e25e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.992+0000 7fd3fbfff640 10 client.15714 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.992+0000 7fd420d5f640 1 --2- 172.21.15.7:0/1390077230 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c584a21d80 0x55c584e25e70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63e393a654584eb0 server_cookie=4c8d1dd1570e282e in_seq=0 out_seq=0 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.992+0000 7fd3fbfff640 1 -- 172.21.15.7:0/1390077230 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c584d7f640 con 0x55c584a21d80 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.992+0000 7fd3fbfff640 10 client.15714 handle_command_reply: tid=0 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.992+0000 7fd42a009740 1 client.15714 shutdown 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.993+0000 7fd42a009740 1 -- 172.21.15.7:0/1390077230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 msgr2=0x55c584e20240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.993+0000 7fd42a009740 1 --2- 172.21.15.7:0/1390077230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 0x55c584e20240 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd414009570 tx=0x7fd414003c80 comp rx=0 tx=0).stop 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.993+0000 7fd42a009740 1 -- 172.21.15.7:0/1390077230 shutdown_connections 2024-09-21T05:54:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.993+0000 7fd42a009740 1 --2- 172.21.15.7:0/1390077230 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c584a21d80 0x55c584e25e70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.993+0000 7fd42a009740 1 --2- 172.21.15.7:0/1390077230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a631b0 0x55c584e20240 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.993+0000 7fd42a009740 1 --2- 172.21.15.7:0/1390077230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a424d0 0x55c584e14620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.993+0000 7fd3fbfff640 0 client.15714 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.993+0000 7fd42a009740 1 --2- 172.21.15.7:0/1390077230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a3a2f0 0x55c584e140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.993+0000 7fd42a009740 1 -- 172.21.15.7:0/1390077230 >> 172.21.15.7:0/1390077230 conn(0x55c584a57300 msgr2=0x55c584e099e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.993+0000 7fd42a009740 1 -- 172.21.15.7:0/1390077230 shutdown_connections 2024-09-21T05:54:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.993+0000 7fd42a009740 1 -- 172.21.15.7:0/1390077230 wait complete. 2024-09-21T05:54:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:49.993+0000 7fd42a009740 20 client.15714 trim_cache size 0 max 16384 2024-09-21T05:54:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.008+0000 7fd42a009740 1 Processor -- start 2024-09-21T05:54:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.008+0000 7fd42a009740 1 -- start start 2024-09-21T05:54:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.008+0000 7fd42a009740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a3a2f0 0x55c584e160d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.008+0000 7fd42a009740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a424d0 0x55c584e0f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.008+0000 7fd42a009740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a631b0 0x55c584e20140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.008+0000 7fd42a009740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c1b1cc0 con 0x55c584a424d0 2024-09-21T05:54:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.008+0000 7fd42a009740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c1af590 con 0x55c584a631b0 2024-09-21T05:54:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.008+0000 7fd42a009740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c1ad3e0 con 0x55c584a3a2f0 2024-09-21T05:54:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.008+0000 7fd413fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a424d0 0x55c584e0f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.008+0000 7fd413fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a424d0 0x55c584e0f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40070/0 (socket says 172.21.15.7:40070) 2024-09-21T05:54:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.008+0000 7fd413fff640 1 -- 172.21.15.7:0/3734299406 learned_addr learned my addr 172.21.15.7:0/3734299406 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.008+0000 7fd421560640 1 --2- 172.21.15.7:0/3734299406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a631b0 0x55c584e20140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.009+0000 7fd420d5f640 1 --2- 172.21.15.7:0/3734299406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a3a2f0 0x55c584e160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.009+0000 7fd413fff640 1 -- 172.21.15.7:0/3734299406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a3a2f0 msgr2=0x55c584e160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.009+0000 7fd413fff640 1 --2- 172.21.15.7:0/3734299406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a3a2f0 0x55c584e160d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.009+0000 7fd413fff640 1 -- 172.21.15.7:0/3734299406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a631b0 msgr2=0x55c584e20140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.009+0000 7fd413fff640 1 --2- 172.21.15.7:0/3734299406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a631b0 0x55c584e20140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.009+0000 7fd413fff640 1 -- 172.21.15.7:0/3734299406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c584e15600 con 0x55c584a424d0 2024-09-21T05:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.009+0000 7fd420d5f640 1 --2- 172.21.15.7:0/3734299406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a3a2f0 0x55c584e160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.009+0000 7fd413fff640 1 --2- 172.21.15.7:0/3734299406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a424d0 0x55c584e0f810 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0acd90 tx=0x7fd40c0ac800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdcb37b45a5cf30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.009+0000 7fd4027fc640 1 -- 172.21.15.7:0/3734299406 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c020040 con 0x55c584a424d0 2024-09-21T05:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.009+0000 7fd4027fc640 1 -- 172.21.15.7:0/3734299406 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd40c0b1ac0 con 0x55c584a424d0 2024-09-21T05:54:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.009+0000 7fd4027fc640 1 -- 172.21.15.7:0/3734299406 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c092e60 con 0x55c584a424d0 2024-09-21T05:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.010+0000 7fd42a009740 1 -- 172.21.15.7:0/3734299406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a424d0 msgr2=0x55c584e0f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.010+0000 7fd42a009740 1 --2- 172.21.15.7:0/3734299406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a424d0 0x55c584e0f810 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0acd90 tx=0x7fd40c0ac800 comp rx=0 tx=0).stop 2024-09-21T05:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.010+0000 7fd42a009740 1 -- 172.21.15.7:0/3734299406 shutdown_connections 2024-09-21T05:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.010+0000 7fd42a009740 1 --2- 172.21.15.7:0/3734299406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a424d0 0x55c584e0f810 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.010+0000 7fd42a009740 1 --2- 172.21.15.7:0/3734299406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a631b0 0x55c584e20140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.010+0000 7fd42a009740 1 --2- 172.21.15.7:0/3734299406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a3a2f0 0x55c584e160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.010+0000 7fd42a009740 1 -- 172.21.15.7:0/3734299406 >> 172.21.15.7:0/3734299406 conn(0x55c584a57300 msgr2=0x55c584e0a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.011+0000 7fd42a009740 1 -- 172.21.15.7:0/3734299406 shutdown_connections 2024-09-21T05:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.011+0000 7fd42a009740 1 -- 172.21.15.7:0/3734299406 wait complete. 2024-09-21T05:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.011+0000 7fd42a009740 1 -- start start 2024-09-21T05:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.011+0000 7fd42a009740 1 Processor -- start 2024-09-21T05:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd42a009740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a3a2f0 0x55c584e1c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd42a009740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a424d0 0x55c584e1c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd42a009740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a631b0 0x55c584e0e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd42a009740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c1ada50 con 0x55c584a3a2f0 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd42a009740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c1aeec0 con 0x55c584a631b0 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd42a009740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c1ae120 con 0x55c584a424d0 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd42a009740 10 client.0 _ll_register_callbacks cb 0x7fd414009430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd420d5f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a3a2f0 0x55c584e1c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd420d5f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a3a2f0 0x55c584e1c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40080/0 (socket says 172.21.15.7:40080) 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd420d5f640 1 -- 172.21.15.7:0/3814118511 learned_addr learned my addr 172.21.15.7:0/3814118511 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd421560640 1 --2- 172.21.15.7:0/3814118511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a631b0 0x55c584e0e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd413fff640 1 --2- 172.21.15.7:0/3814118511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a424d0 0x55c584e1c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd420d5f640 1 -- 172.21.15.7:0/3814118511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a424d0 msgr2=0x55c584e1c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd420d5f640 1 --2- 172.21.15.7:0/3814118511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a424d0 0x55c584e1c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd420d5f640 1 -- 172.21.15.7:0/3814118511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a631b0 msgr2=0x55c584e0e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd420d5f640 1 --2- 172.21.15.7:0/3814118511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a631b0 0x55c584e0e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.012+0000 7fd420d5f640 1 -- 172.21.15.7:0/3814118511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c584e0ec10 con 0x55c584a3a2f0 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd420d5f640 1 --2- 172.21.15.7:0/3814118511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a3a2f0 0x55c584e1c3e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd4180058c0 tx=0x7fd4180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5afa52fe673395 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd3fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd3fbfff640 1 -- 172.21.15.7:0/3814118511 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418011570 con 0x55c584a3a2f0 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd3fbfff640 1 -- 172.21.15.7:0/3814118511 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fd418011710 con 0x55c584a3a2f0 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd42a009740 1 -- 172.21.15.7:0/3814118511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd40c0b1ac0 con 0x55c584a3a2f0 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd3fbfff640 1 -- 172.21.15.7:0/3814118511 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd418011910 con 0x55c584a3a2f0 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd42a009740 10 client.15720 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd42a009740 1 -- 172.21.15.7:0/3814118511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c584e1bb70 con 0x55c584a3a2f0 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd3fbfff640 1 -- 172.21.15.7:0/3814118511 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd40c0b1ac0 con 0x55c584a3a2f0 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd3fbfff640 1 -- 172.21.15.7:0/3814118511 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd41801a040 con 0x55c584a3a2f0 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd42a009740 10 client.15720 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd42a009740 10 client.15720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd42a009740 20 client.15720 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd42a009740 1 --2- 172.21.15.7:0/3814118511 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c5849f71c0 0x55c584e92850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd42a009740 4 client.15720 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T05:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.013+0000 7fd42a009740 1 -- 172.21.15.7:0/3814118511 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c584d7b0f0 con 0x55c5849f71c0 2024-09-21T05:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.014+0000 7fd413fff640 1 --2- 172.21.15.7:0/3814118511 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c5849f71c0 0x55c584e92850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.014+0000 7fd413fff640 1 --2- 172.21.15.7:0/3814118511 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c5849f71c0 0x55c584e92850 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e44d9023af3c565 server_cookie=4c3f89820dbc9a63 in_seq=0 out_seq=0 2024-09-21T05:54:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.014+0000 7fd3fbfff640 10 client.15720 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.024+0000 7fd3fbfff640 1 -- 172.21.15.7:0/3814118511 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c584d7b0f0 con 0x55c5849f71c0 2024-09-21T05:54:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.024+0000 7fd3fbfff640 10 client.15720 handle_command_reply: tid=0 2024-09-21T05:54:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.024+0000 7fd42a009740 1 client.15720 shutdown 2024-09-21T05:54:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.025+0000 7fd42a009740 1 -- 172.21.15.7:0/3814118511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a3a2f0 msgr2=0x55c584e1c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.025+0000 7fd42a009740 1 --2- 172.21.15.7:0/3814118511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a3a2f0 0x55c584e1c3e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd4180058c0 tx=0x7fd4180046c0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.025+0000 7fd42a009740 1 -- 172.21.15.7:0/3814118511 shutdown_connections 2024-09-21T05:54:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.025+0000 7fd42a009740 1 --2- 172.21.15.7:0/3814118511 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c5849f71c0 0x55c584e92850 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.025+0000 7fd42a009740 1 --2- 172.21.15.7:0/3814118511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c584a631b0 0x55c584e0e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.025+0000 7fd42a009740 1 --2- 172.21.15.7:0/3814118511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c584a424d0 0x55c584e1c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.025+0000 7fd42a009740 1 --2- 172.21.15.7:0/3814118511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c584a3a2f0 0x55c584e1c3e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.025+0000 7fd3fbfff640 0 client.15720 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.025+0000 7fd42a009740 1 -- 172.21.15.7:0/3814118511 >> 172.21.15.7:0/3814118511 conn(0x55c584a57300 msgr2=0x55c584e0a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.025+0000 7fd42a009740 1 -- 172.21.15.7:0/3814118511 shutdown_connections 2024-09-21T05:54:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.025+0000 7fd42a009740 1 -- 172.21.15.7:0/3814118511 wait complete. 2024-09-21T05:54:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.025+0000 7fd42a009740 20 client.15720 trim_cache size 0 max 16384 2024-09-21T05:54:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T05:54:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T05:54:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T05:54:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T05:54:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.026+0000 7fd422fc3640 1 -- 172.21.15.7:0/518595230 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4040b6680 msgr2=0x7fd4040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.026+0000 7fd422fc3640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4040b6680 0x7fd4040b8b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55c584e07630 tx=0x7fd418005f90 comp rx=0 tx=0).stop 2024-09-21T05:54:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.026+0000 7fd422fc3640 1 -- 172.21.15.7:0/518595230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd41c1082f0 msgr2=0x7fd41c19a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.026+0000 7fd422fc3640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd41c1082f0 0x7fd41c19a930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd40c005fd0 tx=0x7fd40c00dde0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.026+0000 7fd422fc3640 1 -- 172.21.15.7:0/518595230 shutdown_connections 2024-09-21T05:54:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.026+0000 7fd422fc3640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4040b6680 0x7fd4040b8b90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.026+0000 7fd422fc3640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd41c108c40 0x7fd41c19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.026+0000 7fd422fc3640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd41c1082f0 0x7fd41c19a930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.026+0000 7fd422fc3640 1 --2- 172.21.15.7:0/518595230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd41c1029c0 0x7fd41c19a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:50.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.026+0000 7fd422fc3640 1 -- 172.21.15.7:0/518595230 >> 172.21.15.7:0/518595230 conn(0x7fd41c0fe3c0 msgr2=0x7fd41c06ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:50.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.026+0000 7fd422fc3640 1 -- 172.21.15.7:0/518595230 shutdown_connections 2024-09-21T05:54:50.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:54:50.026+0000 7fd422fc3640 1 -- 172.21.15.7:0/518595230 wait complete. 2024-09-21T05:54:50.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:50 smithi007 ceph-mon[30983]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T05:54:50.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:50 smithi119 ceph-mon[34833]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T05:54:50.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:50 smithi027 ceph-mon[34364]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T05:54:52.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:52 smithi007 ceph-mon[30983]: pgmap v347: 97 pgs: 97 active+clean; 2.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 KiB/s wr, 6 op/s 2024-09-21T05:54:52.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:52 smithi119 ceph-mon[34833]: pgmap v347: 97 pgs: 97 active+clean; 2.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 KiB/s wr, 6 op/s 2024-09-21T05:54:52.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:52 smithi027 ceph-mon[34364]: pgmap v347: 97 pgs: 97 active+clean; 2.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 KiB/s wr, 6 op/s 2024-09-21T05:54:54.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:54 smithi007 ceph-mon[30983]: pgmap v348: 97 pgs: 97 active+clean; 2.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 86 KiB/s wr, 5 op/s 2024-09-21T05:54:54.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:54 smithi119 ceph-mon[34833]: pgmap v348: 97 pgs: 97 active+clean; 2.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 86 KiB/s wr, 5 op/s 2024-09-21T05:54:54.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:54 smithi027 ceph-mon[34364]: pgmap v348: 97 pgs: 97 active+clean; 2.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 86 KiB/s wr, 5 op/s 2024-09-21T05:54:56.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:56 smithi007 ceph-mon[30983]: pgmap v349: 97 pgs: 97 active+clean; 2.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 521 KiB/s wr, 11 op/s 2024-09-21T05:54:56.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:56 smithi119 ceph-mon[34833]: pgmap v349: 97 pgs: 97 active+clean; 2.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 521 KiB/s wr, 11 op/s 2024-09-21T05:54:56.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:56 smithi027 ceph-mon[34364]: pgmap v349: 97 pgs: 97 active+clean; 2.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 521 KiB/s wr, 11 op/s 2024-09-21T05:54:57.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:54:57.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:54:57.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:54:57.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:57.788 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:54:58.065 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:58.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:58 smithi007 ceph-mon[30983]: pgmap v350: 97 pgs: 97 active+clean; 2.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 521 KiB/s wr, 10 op/s 2024-09-21T05:54:58.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:54:58.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:54:58.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:54:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:58.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.516+0000 7f099ee82640 1 -- 172.21.15.7:0/99712720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09981049d0 msgr2=0x7f0998104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.516+0000 7f099ee82640 1 --2- 172.21.15.7:0/99712720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09981049d0 0x7f0998104de0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0988009900 tx=0x7f098802a410 comp rx=0 tx=0).stop 2024-09-21T05:54:58.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.517+0000 7f099ee82640 1 -- 172.21.15.7:0/99712720 shutdown_connections 2024-09-21T05:54:58.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.517+0000 7f099ee82640 1 --2- 172.21.15.7:0/99712720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f099810de30 0x7f0998110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.517+0000 7f099ee82640 1 --2- 172.21.15.7:0/99712720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0998105320 0x7f099810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.517+0000 7f099ee82640 1 --2- 172.21.15.7:0/99712720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09981049d0 0x7f0998104de0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.517+0000 7f099ee82640 1 -- 172.21.15.7:0/99712720 >> 172.21.15.7:0/99712720 conn(0x7f0998079740 msgr2=0x7f0998079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:58.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.517+0000 7f099ee82640 1 -- 172.21.15.7:0/99712720 shutdown_connections 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.517+0000 7f099ee82640 1 -- 172.21.15.7:0/99712720 wait complete. 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.517+0000 7f099ee82640 1 Processor -- start 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f099ee82640 1 -- start start 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f099ee82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09981049d0 0x7f09981a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f099ee82640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0998105320 0x7f09981a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f099ee82640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f099810de30 0x7f09981ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f099ee82640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0998113a90 con 0x7f099810de30 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f099ee82640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0998113910 con 0x7f0998105320 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f099ee82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0998113c10 con 0x7f09981049d0 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f099d41f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f099810de30 0x7f09981ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f099d41f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f099810de30 0x7f09981ac7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52510/0 (socket says 172.21.15.7:52510) 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f099d41f640 1 -- 172.21.15.7:0/835180452 learned_addr learned my addr 172.21.15.7:0/835180452 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f099cc1e640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09981049d0 0x7f09981a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f0997fff640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0998105320 0x7f09981a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f099d41f640 1 -- 172.21.15.7:0/835180452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09981049d0 msgr2=0x7f09981a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.518+0000 7f099d41f640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09981049d0 0x7f09981a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.519+0000 7f099d41f640 1 -- 172.21.15.7:0/835180452 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0998105320 msgr2=0x7f09981a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.519+0000 7f099d41f640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0998105320 0x7f09981a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.519+0000 7f099d41f640 1 -- 172.21.15.7:0/835180452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09981acd30 con 0x7f099810de30 2024-09-21T05:54:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.519+0000 7f099d41f640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f099810de30 0x7f09981ac7f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f099000eb10 tx=0x7f099000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.519+0000 7f0995ffb640 1 -- 172.21.15.7:0/835180452 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990004b20 con 0x7f099810de30 2024-09-21T05:54:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.519+0000 7f099ee82640 1 -- 172.21.15.7:0/835180452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09981acf00 con 0x7f099810de30 2024-09-21T05:54:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.519+0000 7f0995ffb640 1 -- 172.21.15.7:0/835180452 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0990004cc0 con 0x7f099810de30 2024-09-21T05:54:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.519+0000 7f0995ffb640 1 -- 172.21.15.7:0/835180452 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990010670 con 0x7f099810de30 2024-09-21T05:54:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.519+0000 7f099ee82640 1 -- 172.21.15.7:0/835180452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09981ad350 con 0x7f099810de30 2024-09-21T05:54:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.522+0000 7f09a53f6740 1 Processor -- start 2024-09-21T05:54:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.523+0000 7f0995ffb640 1 -- 172.21.15.7:0/835180452 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0990005020 con 0x7f099810de30 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.523+0000 7f09a53f6740 1 -- start start 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.523+0000 7f09a53f6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbee070 0x559a6df95650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.523+0000 7f09a53f6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6df95b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.523+0000 7f09a53f6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 0x559a6df960d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.523+0000 7f09a53f6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559a6df0be50 con 0x559a6dbcd390 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.523+0000 7f09a53f6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559a6defb280 con 0x559a6dbee070 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.523+0000 7f09a53f6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559a6deff090 con 0x559a6dbc51b0 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f0997fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 0x559a6df960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f099cc1e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6df95b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f099cc1e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6df95b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:51120/0 (socket says 172.21.15.7:51120) 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f099cc1e640 1 -- 172.21.15.7:0/2733679214 learned_addr learned my addr 172.21.15.7:0/2733679214 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f0997fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 0x559a6df960d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52524/0 (socket says 172.21.15.7:52524) 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f0997fff640 1 --2- 172.21.15.7:0/2733679214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbee070 0x559a6df95650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f099cc1e640 1 -- 172.21.15.7:0/2733679214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbee070 msgr2=0x559a6df95650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f099cc1e640 1 --2- 172.21.15.7:0/2733679214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbee070 0x559a6df95650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f099cc1e640 1 -- 172.21.15.7:0/2733679214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 msgr2=0x559a6df960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f099cc1e640 1 --2- 172.21.15.7:0/2733679214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 0x559a6df960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f099cc1e640 1 -- 172.21.15.7:0/2733679214 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a6dc59650 con 0x559a6dbc51b0 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f0997fff640 1 --2- 172.21.15.7:0/2733679214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 0x559a6df960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f0995ffb640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f09800b6680 0x7f09800b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.524+0000 7f0997fff640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f09800b6680 0x7f09800b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.525+0000 7f0995ffb640 1 -- 172.21.15.7:0/835180452 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f09900e7c10 con 0x7f099810de30 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.525+0000 7f099cc1e640 1 --2- 172.21.15.7:0/2733679214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6df95b90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f099806c620 tx=0x7f0988000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8863fd12979c397 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.525+0000 7f097effd640 1 -- 172.21.15.7:0/2733679214 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988040070 con 0x559a6dbc51b0 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.525+0000 7f0997fff640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f09800b6680 0x7f09800b8b90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f098c009fd0 tx=0x7f098c0096c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.525+0000 7f097effd640 1 -- 172.21.15.7:0/2733679214 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0988032da0 con 0x559a6dbc51b0 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.525+0000 7f097effd640 1 -- 172.21.15.7:0/2733679214 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988035040 con 0x559a6dbc51b0 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.526+0000 7f09a53f6740 1 -- 172.21.15.7:0/2733679214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 msgr2=0x559a6df95b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.526+0000 7f09a53f6740 1 --2- 172.21.15.7:0/2733679214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6df95b90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f099806c620 tx=0x7f0988000bc0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.526+0000 7f09a53f6740 1 -- 172.21.15.7:0/2733679214 shutdown_connections 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.526+0000 7f09a53f6740 1 --2- 172.21.15.7:0/2733679214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 0x559a6df960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.526+0000 7f09a53f6740 1 --2- 172.21.15.7:0/2733679214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6df95b90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.526+0000 7f09a53f6740 1 --2- 172.21.15.7:0/2733679214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbee070 0x559a6df95650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.526+0000 7f09a53f6740 1 -- 172.21.15.7:0/2733679214 >> 172.21.15.7:0/2733679214 conn(0x559a6dbe2460 msgr2=0x559a6df93540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.526+0000 7f09a53f6740 1 -- 172.21.15.7:0/2733679214 shutdown_connections 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.526+0000 7f09a53f6740 1 -- 172.21.15.7:0/2733679214 wait complete. 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.526+0000 7f09a53f6740 1 -- start start 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.526+0000 7f09a53f6740 1 Processor -- start 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.527+0000 7f09a53f6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6dfa0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.527+0000 7f09a53f6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbcd390 0x559a6dfa1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.527+0000 7f09a53f6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 0x559a6dfad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.527+0000 7f09a53f6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559a6dd5c700 con 0x559a6dbee070 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.527+0000 7f09a53f6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559a6de96110 con 0x559a6dbcd390 2024-09-21T05:54:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.527+0000 7f09a53f6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559a6dfa3dd0 con 0x559a6dbc51b0 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.527+0000 7f09a53f6740 10 client.0 _ll_register_callbacks cb 0x559a6deaf990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.527+0000 7f099d41f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 0x559a6dfad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.527+0000 7f099d41f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 0x559a6dfad0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52526/0 (socket says 172.21.15.7:52526) 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.527+0000 7f099d41f640 1 -- 172.21.15.7:0/4258670382 learned_addr learned my addr 172.21.15.7:0/4258670382 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.527+0000 7f099cc1e640 1 --2- 172.21.15.7:0/4258670382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6dfa0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.527+0000 7f0997fff640 1 --2- 172.21.15.7:0/4258670382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbcd390 0x559a6dfa1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.528+0000 7f099d41f640 1 -- 172.21.15.7:0/4258670382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 msgr2=0x559a6dfa0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.528+0000 7f099d41f640 1 --2- 172.21.15.7:0/4258670382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6dfa0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.528+0000 7f099d41f640 1 -- 172.21.15.7:0/4258670382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbcd390 msgr2=0x559a6dfa1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.528+0000 7f099d41f640 1 --2- 172.21.15.7:0/4258670382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbcd390 0x559a6dfa1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.528+0000 7f099d41f640 1 -- 172.21.15.7:0/4258670382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a6dec3c40 con 0x559a6dbee070 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.528+0000 7f099d41f640 1 --2- 172.21.15.7:0/4258670382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 0x559a6dfad0f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f09900ad7e0 tx=0x7f09900aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596f0105a79dc02 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.528+0000 7f0977fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.528+0000 7f0977fff640 1 -- 172.21.15.7:0/4258670382 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09900b2020 con 0x559a6dbee070 2024-09-21T05:54:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.528+0000 7f09a53f6740 1 -- 172.21.15.7:0/4258670382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0988032da0 con 0x559a6dbee070 2024-09-21T05:54:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.528+0000 7f0977fff640 1 -- 172.21.15.7:0/4258670382 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f09900b7070 con 0x559a6dbee070 2024-09-21T05:54:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.528+0000 7f0977fff640 1 -- 172.21.15.7:0/4258670382 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f09900b23c0 con 0x559a6dbee070 2024-09-21T05:54:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.528+0000 7f09a53f6740 10 client.15732 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.528+0000 7f09a53f6740 1 -- 172.21.15.7:0/4258670382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559a6dfafb20 con 0x559a6dbee070 2024-09-21T05:54:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.529+0000 7f0977fff640 1 -- 172.21.15.7:0/4258670382 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0988032da0 con 0x559a6dbee070 2024-09-21T05:54:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.529+0000 7f0977fff640 1 -- 172.21.15.7:0/4258670382 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f09900acd40 con 0x559a6dbee070 2024-09-21T05:54:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.529+0000 7f09a53f6740 10 client.15732 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.529+0000 7f09a53f6740 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.529+0000 7f09a53f6740 20 client.15732 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.529+0000 7f09a53f6740 1 --2- 172.21.15.7:0/4258670382 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559a6dbac9f0 0x559a6dfb3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.529+0000 7f09a53f6740 4 client.15732 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.529+0000 7f09a53f6740 1 -- 172.21.15.7:0/4258670382 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a6df0dda0 con 0x559a6dbac9f0 2024-09-21T05:54:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.529+0000 7f099cc1e640 1 --2- 172.21.15.7:0/4258670382 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559a6dbac9f0 0x559a6dfb3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.530+0000 7f0977fff640 10 client.15732 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.530+0000 7f099cc1e640 1 --2- 172.21.15.7:0/4258670382 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559a6dbac9f0 0x559a6dfb3000 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2a362fb1ee4869 server_cookie=d93951cd9f717edb in_seq=0 out_seq=0 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.530+0000 7f0977fff640 1 -- 172.21.15.7:0/4258670382 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a6df0dda0 con 0x559a6dbac9f0 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.530+0000 7f0977fff640 10 client.15732 handle_command_reply: tid=0 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.530+0000 7f09a53f6740 1 client.15732 shutdown 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.530+0000 7f09a53f6740 1 -- 172.21.15.7:0/4258670382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 msgr2=0x559a6dfad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.531+0000 7f09a53f6740 1 --2- 172.21.15.7:0/4258670382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 0x559a6dfad0f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f09900ad7e0 tx=0x7f09900aa000 comp rx=0 tx=0).stop 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.531+0000 7f09a53f6740 1 -- 172.21.15.7:0/4258670382 shutdown_connections 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.531+0000 7f09a53f6740 1 --2- 172.21.15.7:0/4258670382 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559a6dbac9f0 0x559a6dfb3000 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.531+0000 7f0977fff640 0 client.15732 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.531+0000 7f09a53f6740 1 --2- 172.21.15.7:0/4258670382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 0x559a6dfad0f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.531+0000 7f09a53f6740 1 --2- 172.21.15.7:0/4258670382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbcd390 0x559a6dfa1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.531+0000 7f09a53f6740 1 --2- 172.21.15.7:0/4258670382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6dfa0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.531+0000 7f09a53f6740 1 -- 172.21.15.7:0/4258670382 >> 172.21.15.7:0/4258670382 conn(0x559a6dbe2460 msgr2=0x559a6df987e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.531+0000 7f09a53f6740 1 -- 172.21.15.7:0/4258670382 shutdown_connections 2024-09-21T05:54:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.531+0000 7f09a53f6740 1 -- 172.21.15.7:0/4258670382 wait complete. 2024-09-21T05:54:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.531+0000 7f09a53f6740 20 client.15732 trim_cache size 0 max 16384 2024-09-21T05:54:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.549+0000 7f09a53f6740 1 Processor -- start 2024-09-21T05:54:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.549+0000 7f09a53f6740 1 -- start start 2024-09-21T05:54:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f09a53f6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6dfa2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f09a53f6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 0x559a6df96d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f09a53f6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbee070 0x559a6dfacff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f09a53f6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09981b8400 con 0x559a6dbcd390 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f09a53f6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f09981b5cd0 con 0x559a6dbee070 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f09a53f6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f09981b3b20 con 0x559a6dbc51b0 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f0997fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 0x559a6df96d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f0997fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 0x559a6df96d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52528/0 (socket says 172.21.15.7:52528) 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f0997fff640 1 -- 172.21.15.7:0/1818358736 learned_addr learned my addr 172.21.15.7:0/1818358736 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f099cc1e640 1 --2- 172.21.15.7:0/1818358736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6dfa2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f099d41f640 1 --2- 172.21.15.7:0/1818358736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbee070 0x559a6dfacff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f0997fff640 1 -- 172.21.15.7:0/1818358736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 msgr2=0x559a6dfa2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f0997fff640 1 --2- 172.21.15.7:0/1818358736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6dfa2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f0997fff640 1 -- 172.21.15.7:0/1818358736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbee070 msgr2=0x559a6dfacff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f0997fff640 1 --2- 172.21.15.7:0/1818358736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbee070 0x559a6dfacff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f0997fff640 1 -- 172.21.15.7:0/1818358736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a6dfb33a0 con 0x559a6dbcd390 2024-09-21T05:54:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.550+0000 7f099d41f640 1 --2- 172.21.15.7:0/1818358736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbee070 0x559a6dfacff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.551+0000 7f0997fff640 1 --2- 172.21.15.7:0/1818358736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 0x559a6df96d90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f098c011680 tx=0x7f098c013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb74dd02fce3bcb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.551+0000 7f097e7fc640 1 -- 172.21.15.7:0/1818358736 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c011db0 con 0x559a6dbcd390 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.551+0000 7f097e7fc640 1 -- 172.21.15.7:0/1818358736 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f098c0054d0 con 0x559a6dbcd390 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.551+0000 7f097e7fc640 1 -- 172.21.15.7:0/1818358736 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c01e430 con 0x559a6dbcd390 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.552+0000 7f09a53f6740 1 -- 172.21.15.7:0/1818358736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 msgr2=0x559a6df96d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.552+0000 7f09a53f6740 1 --2- 172.21.15.7:0/1818358736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 0x559a6df96d90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f098c011680 tx=0x7f098c013040 comp rx=0 tx=0).stop 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.552+0000 7f09a53f6740 1 -- 172.21.15.7:0/1818358736 shutdown_connections 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.552+0000 7f09a53f6740 1 --2- 172.21.15.7:0/1818358736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbcd390 0x559a6df96d90 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.552+0000 7f09a53f6740 1 --2- 172.21.15.7:0/1818358736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbee070 0x559a6dfacff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.552+0000 7f09a53f6740 1 --2- 172.21.15.7:0/1818358736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbc51b0 0x559a6dfa2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.552+0000 7f09a53f6740 1 -- 172.21.15.7:0/1818358736 >> 172.21.15.7:0/1818358736 conn(0x559a6dbe2460 msgr2=0x559a6df96680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.553+0000 7f09a53f6740 1 -- 172.21.15.7:0/1818358736 shutdown_connections 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.553+0000 7f09a53f6740 1 -- 172.21.15.7:0/1818358736 wait complete. 2024-09-21T05:54:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.553+0000 7f09a53f6740 1 -- start start 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.553+0000 7f09a53f6740 1 Processor -- start 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.554+0000 7f09a53f6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbc51b0 0x559a6dfa5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.554+0000 7f09a53f6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbcd390 0x559a6dfa5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.554+0000 7f09a53f6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 0x559a6dfa5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.554+0000 7f09a53f6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09981b4190 con 0x559a6dbee070 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.554+0000 7f09a53f6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f09981b5600 con 0x559a6dbc51b0 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.554+0000 7f09a53f6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f09981b4860 con 0x559a6dbcd390 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.554+0000 7f09a53f6740 10 client.0 _ll_register_callbacks cb 0x7f09900d1260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.554+0000 7f099d41f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 0x559a6dfa5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.554+0000 7f0997fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbcd390 0x559a6dfa5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.554+0000 7f099d41f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 0x559a6dfa5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52534/0 (socket says 172.21.15.7:52534) 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.554+0000 7f099d41f640 1 -- 172.21.15.7:0/2201987102 learned_addr learned my addr 172.21.15.7:0/2201987102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.554+0000 7f0997fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbcd390 0x559a6dfa5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:51142/0 (socket says 172.21.15.7:51142) 2024-09-21T05:54:58.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.554+0000 7f099cc1e640 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbc51b0 0x559a6dfa5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.555+0000 7f099d41f640 1 -- 172.21.15.7:0/2201987102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbcd390 msgr2=0x559a6dfa5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.555+0000 7f099d41f640 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbcd390 0x559a6dfa5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.555+0000 7f099d41f640 1 -- 172.21.15.7:0/2201987102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbc51b0 msgr2=0x559a6dfa5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.555+0000 7f099d41f640 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbc51b0 0x559a6dfa5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.555+0000 7f099d41f640 1 -- 172.21.15.7:0/2201987102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a6e01ca10 con 0x559a6dbee070 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.555+0000 7f099cc1e640 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbc51b0 0x559a6dfa5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.555+0000 7f0997fff640 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbcd390 0x559a6dfa5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.555+0000 7f099d41f640 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 0x559a6dfa5a90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f09900049d0 tx=0x7f0990009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f5eb05b05b6082 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.555+0000 7f0977fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.555+0000 7f0977fff640 1 -- 172.21.15.7:0/2201987102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09900b2040 con 0x559a6dbee070 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.555+0000 7f0977fff640 1 -- 172.21.15.7:0/2201987102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f09900b7280 con 0x559a6dbee070 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.555+0000 7f09a53f6740 1 -- 172.21.15.7:0/2201987102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f098c0054d0 con 0x559a6dbee070 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.556+0000 7f0977fff640 1 -- 172.21.15.7:0/2201987102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f09900ad5f0 con 0x559a6dbee070 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.556+0000 7f09a53f6740 10 client.15738 fetch_fsmap learned FSMap version 25 2024-09-21T05:54:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.556+0000 7f09a53f6740 1 -- 172.21.15.7:0/2201987102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559a6e01dbf0 con 0x559a6dbee070 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.556+0000 7f0977fff640 1 -- 172.21.15.7:0/2201987102 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f098c0054d0 con 0x559a6dbee070 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.556+0000 7f0977fff640 1 -- 172.21.15.7:0/2201987102 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f09900cfaf0 con 0x559a6dbee070 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.556+0000 7f09a53f6740 10 client.15738 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.556+0000 7f09a53f6740 10 client.15738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.556+0000 7f09a53f6740 20 client.15738 populate_metadata read hostname 'smithi007' 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.556+0000 7f09a53f6740 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559a6db81da0 0x559a6e0201d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.556+0000 7f09a53f6740 4 client.15738 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.556+0000 7f09a53f6740 1 -- 172.21.15.7:0/2201987102 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559a6df09850 con 0x559a6db81da0 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.556+0000 7f099cc1e640 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559a6db81da0 0x559a6e0201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f0977fff640 10 client.15738 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f099cc1e640 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559a6db81da0 0x559a6e0201d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c5728a4eaffe612 server_cookie=e687d27ba3fbc8cd in_seq=0 out_seq=0 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f0977fff640 1 -- 172.21.15.7:0/2201987102 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x559a6df09850 con 0x559a6db81da0 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f0977fff640 10 client.15738 handle_command_reply: tid=0 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f09a53f6740 1 client.15738 shutdown 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f09a53f6740 1 -- 172.21.15.7:0/2201987102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 msgr2=0x559a6dfa5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f09a53f6740 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 0x559a6dfa5a90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f09900049d0 tx=0x7f0990009200 comp rx=0 tx=0).stop 2024-09-21T05:54:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f09a53f6740 1 -- 172.21.15.7:0/2201987102 shutdown_connections 2024-09-21T05:54:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f09a53f6740 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559a6db81da0 0x559a6e0201d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f09a53f6740 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a6dbee070 0x559a6dfa5a90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f09a53f6740 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559a6dbcd390 0x559a6dfa5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f09a53f6740 1 --2- 172.21.15.7:0/2201987102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559a6dbc51b0 0x559a6dfa5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f0977fff640 0 client.15738 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:54:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.557+0000 7f09a53f6740 1 -- 172.21.15.7:0/2201987102 >> 172.21.15.7:0/2201987102 conn(0x559a6dbe2460 msgr2=0x559a6dfa2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.558+0000 7f09a53f6740 1 -- 172.21.15.7:0/2201987102 shutdown_connections 2024-09-21T05:54:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.558+0000 7f09a53f6740 1 -- 172.21.15.7:0/2201987102 wait complete. 2024-09-21T05:54:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.558+0000 7f09a53f6740 20 client.15738 trim_cache size 0 max 16384 2024-09-21T05:54:58.567 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:54:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T05:54:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T05:54:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:54:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:54:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:54:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:54:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:54:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:54:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:54:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:54:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:54:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:54:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:54:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:54:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:54:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:54:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:54:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:54:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:54:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:54:58.568 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:54:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.559+0000 7f099ee82640 1 -- 172.21.15.7:0/835180452 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f09800b6680 msgr2=0x7f09800b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.559+0000 7f099ee82640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f09800b6680 0x7f09800b8b90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f098c009fd0 tx=0x7f098c0096c0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.559+0000 7f099ee82640 1 -- 172.21.15.7:0/835180452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f099810de30 msgr2=0x7f09981ac7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.559+0000 7f099ee82640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f099810de30 0x7f09981ac7f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f099000eb10 tx=0x7f099000c2d0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.559+0000 7f099ee82640 1 -- 172.21.15.7:0/835180452 shutdown_connections 2024-09-21T05:54:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.559+0000 7f099ee82640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f09800b6680 0x7f09800b8b90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.559+0000 7f099ee82640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f099810de30 0x7f09981ac7f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.559+0000 7f099ee82640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0998105320 0x7f09981a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.559+0000 7f099ee82640 1 --2- 172.21.15.7:0/835180452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09981049d0 0x7f09981a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.559+0000 7f099ee82640 1 -- 172.21.15.7:0/835180452 >> 172.21.15.7:0/835180452 conn(0x7f0998079740 msgr2=0x7f09981005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.559+0000 7f099ee82640 1 -- 172.21.15.7:0/835180452 shutdown_connections 2024-09-21T05:54:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:54:58.559+0000 7f099ee82640 1 -- 172.21.15.7:0/835180452 wait complete. 2024-09-21T05:54:58.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:58 smithi119 ceph-mon[34833]: pgmap v350: 97 pgs: 97 active+clean; 2.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 521 KiB/s wr, 10 op/s 2024-09-21T05:54:58.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:54:58.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:54:58.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:54:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:58.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:58 smithi027 ceph-mon[34364]: pgmap v350: 97 pgs: 97 active+clean; 2.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 521 KiB/s wr, 10 op/s 2024-09-21T05:54:58.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:54:58.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:54:58.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:54:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:54:59.298 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T05:54:59.299 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:54:59.579 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.078+0000 7fb99d8b4640 1 -- 172.21.15.7:0/837288440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9981049d0 msgr2=0x7fb998104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.078+0000 7fb99d8b4640 1 --2- 172.21.15.7:0/837288440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9981049d0 0x7fb998104de0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb988009900 tx=0x7fb98802a410 comp rx=0 tx=0).stop 2024-09-21T05:55:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.078+0000 7fb99d8b4640 1 -- 172.21.15.7:0/837288440 shutdown_connections 2024-09-21T05:55:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.078+0000 7fb99d8b4640 1 --2- 172.21.15.7:0/837288440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb99810de30 0x7fb998110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.078+0000 7fb99d8b4640 1 --2- 172.21.15.7:0/837288440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb998105320 0x7fb99810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.078+0000 7fb99d8b4640 1 --2- 172.21.15.7:0/837288440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9981049d0 0x7fb998104de0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.078+0000 7fb99d8b4640 1 -- 172.21.15.7:0/837288440 >> 172.21.15.7:0/837288440 conn(0x7fb998079740 msgr2=0x7fb998079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.078+0000 7fb99d8b4640 1 -- 172.21.15.7:0/837288440 shutdown_connections 2024-09-21T05:55:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.078+0000 7fb99d8b4640 1 -- 172.21.15.7:0/837288440 wait complete. 2024-09-21T05:55:00.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.079+0000 7fb99d8b4640 1 Processor -- start 2024-09-21T05:55:00.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb99d8b4640 1 -- start start 2024-09-21T05:55:00.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb99d8b4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9981049d0 0x7fb998102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb99d8b4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb998105320 0x7fb998102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb99d8b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb99810de30 0x7fb998103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb99d8b4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb998113ae0 con 0x7fb998105320 2024-09-21T05:55:00.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb99d8b4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb998113960 con 0x7fb9981049d0 2024-09-21T05:55:00.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb99d8b4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb998113c60 con 0x7fb99810de30 2024-09-21T05:55:00.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb9967fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb998105320 0x7fb998102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb9967fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb998105320 0x7fb998102c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52550/0 (socket says 172.21.15.7:52550) 2024-09-21T05:55:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb996ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9981049d0 0x7fb998102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb9967fc640 1 -- 172.21.15.7:0/4220162071 learned_addr learned my addr 172.21.15.7:0/4220162071 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb9977fe640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb99810de30 0x7fb998103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb9967fc640 1 -- 172.21.15.7:0/4220162071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb99810de30 msgr2=0x7fb998103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb9967fc640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb99810de30 0x7fb998103190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb9967fc640 1 -- 172.21.15.7:0/4220162071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9981049d0 msgr2=0x7fb998102710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb9967fc640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9981049d0 0x7fb998102710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb9967fc640 1 -- 172.21.15.7:0/4220162071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9981a8850 con 0x7fb998105320 2024-09-21T05:55:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.080+0000 7fb996ffd640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9981049d0 0x7fb998102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.081+0000 7fb9967fc640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb998105320 0x7fb998102c50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb98000d950 tx=0x7fb98000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.081+0000 7fb99c8b2640 1 -- 172.21.15.7:0/4220162071 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980017070 con 0x7fb998105320 2024-09-21T05:55:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.081+0000 7fb99d8b4640 1 -- 172.21.15.7:0/4220162071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9981a8b40 con 0x7fb998105320 2024-09-21T05:55:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.081+0000 7fb99c8b2640 1 -- 172.21.15.7:0/4220162071 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb980009c30 con 0x7fb998105320 2024-09-21T05:55:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.081+0000 7fb99c8b2640 1 -- 172.21.15.7:0/4220162071 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9800047a0 con 0x7fb998105320 2024-09-21T05:55:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.081+0000 7fb99d8b4640 1 -- 172.21.15.7:0/4220162071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9981a9050 con 0x7fb998105320 2024-09-21T05:55:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.082+0000 7fb99d8b4640 1 -- 172.21.15.7:0/4220162071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb998104de0 con 0x7fb998105320 2024-09-21T05:55:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.084+0000 7fb99c8b2640 1 -- 172.21.15.7:0/4220162071 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb980004020 con 0x7fb998105320 2024-09-21T05:55:00.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.085+0000 7fb99c8b2640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9840b6680 0x7fb9840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.085+0000 7fb996ffd640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9840b6680 0x7fb9840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.085+0000 7fb99c8b2640 1 -- 172.21.15.7:0/4220162071 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb9800e77e0 con 0x7fb998105320 2024-09-21T05:55:00.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.085+0000 7fb996ffd640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9840b6680 0x7fb9840b8b90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb988031440 tx=0x7fb988005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:00.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.088+0000 7fb99c8b2640 1 -- 172.21.15.7:0/4220162071 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb980020020 con 0x7fb998105320 2024-09-21T05:55:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.319+0000 7fb99d8b4640 1 -- 172.21.15.7:0/4220162071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb998103a10 con 0x7fb998105320 2024-09-21T05:55:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.320+0000 7fb99c8b2640 1 -- 172.21.15.7:0/4220162071 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7fb998103a10 con 0x7fb998105320 2024-09-21T05:55:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:55:00.324 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:55:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:55:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.322+0000 7fb99d8b4640 1 -- 172.21.15.7:0/4220162071 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9840b6680 msgr2=0x7fb9840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.322+0000 7fb99d8b4640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9840b6680 0x7fb9840b8b90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb988031440 tx=0x7fb988005a20 comp rx=0 tx=0).stop 2024-09-21T05:55:00.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.322+0000 7fb99d8b4640 1 -- 172.21.15.7:0/4220162071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb998105320 msgr2=0x7fb998102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.322+0000 7fb99d8b4640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb998105320 0x7fb998102c50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb98000d950 tx=0x7fb98000de10 comp rx=0 tx=0).stop 2024-09-21T05:55:00.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.322+0000 7fb99d8b4640 1 -- 172.21.15.7:0/4220162071 shutdown_connections 2024-09-21T05:55:00.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.322+0000 7fb99d8b4640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9840b6680 0x7fb9840b8b90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.322+0000 7fb99d8b4640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb998105320 0x7fb998102c50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.322+0000 7fb99d8b4640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb99810de30 0x7fb998103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.323+0000 7fb99d8b4640 1 --2- 172.21.15.7:0/4220162071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9981049d0 0x7fb998102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.323+0000 7fb99d8b4640 1 -- 172.21.15.7:0/4220162071 >> 172.21.15.7:0/4220162071 conn(0x7fb998079740 msgr2=0x7fb9981068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:00.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.323+0000 7fb99d8b4640 1 -- 172.21.15.7:0/4220162071 shutdown_connections 2024-09-21T05:55:00.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:00.323+0000 7fb99d8b4640 1 -- 172.21.15.7:0/4220162071 wait complete. 2024-09-21T05:55:00.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:00 smithi007 ceph-mon[30983]: pgmap v351: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 526 KiB/s wr, 12 op/s 2024-09-21T05:55:00.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:00 smithi119 ceph-mon[34833]: pgmap v351: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 526 KiB/s wr, 12 op/s 2024-09-21T05:55:00.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:00 smithi027 ceph-mon[34364]: pgmap v351: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 526 KiB/s wr, 12 op/s 2024-09-21T05:55:01.073 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T05:55:01.365 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:01.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:01 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4220162071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:55:01.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:01 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/4220162071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:55:01.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:01 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/4220162071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:55:01.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.923+0000 7fed6e3e8640 1 -- 172.21.15.7:0/1880923190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed68109e10 msgr2=0x7fed68110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:01.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.923+0000 7fed6e3e8640 1 --2- 172.21.15.7:0/1880923190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed68109e10 0x7fed68110640 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fed60009ca0 tx=0x7fed6002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.923+0000 7fed6e3e8640 1 -- 172.21.15.7:0/1880923190 shutdown_connections 2024-09-21T05:55:01.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.923+0000 7fed6e3e8640 1 --2- 172.21.15.7:0/1880923190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed68109e10 0x7fed68110640 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.923+0000 7fed6e3e8640 1 --2- 172.21.15.7:0/1880923190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed681094c0 0x7fed681098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.923+0000 7fed6e3e8640 1 --2- 172.21.15.7:0/1880923190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed68103b80 0x7fed68103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.923+0000 7fed6e3e8640 1 -- 172.21.15.7:0/1880923190 >> 172.21.15.7:0/1880923190 conn(0x7fed680ff610 msgr2=0x7fed68101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:01.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.923+0000 7fed6e3e8640 1 -- 172.21.15.7:0/1880923190 shutdown_connections 2024-09-21T05:55:01.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.923+0000 7fed6e3e8640 1 -- 172.21.15.7:0/1880923190 wait complete. 2024-09-21T05:55:01.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.923+0000 7fed6e3e8640 1 Processor -- start 2024-09-21T05:55:01.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.924+0000 7fed6e3e8640 1 -- start start 2024-09-21T05:55:01.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.924+0000 7fed6e3e8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed68103b80 0x7fed68075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.924+0000 7fed6e3e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed681094c0 0x7fed68075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.924+0000 7fed6e3e8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed68109e10 0x7fed68076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.924+0000 7fed6e3e8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fed68113ad0 con 0x7fed681094c0 2024-09-21T05:55:01.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.924+0000 7fed6e3e8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fed68113950 con 0x7fed68103b80 2024-09-21T05:55:01.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.924+0000 7fed6e3e8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fed68113c50 con 0x7fed68109e10 2024-09-21T05:55:01.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.924+0000 7fed677fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed681094c0 0x7fed68075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.924+0000 7fed677fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed681094c0 0x7fed68075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52574/0 (socket says 172.21.15.7:52574) 2024-09-21T05:55:01.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.924+0000 7fed677fe640 1 -- 172.21.15.7:0/1486920165 learned_addr learned my addr 172.21.15.7:0/1486920165 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:01.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.924+0000 7fed6c985640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed68109e10 0x7fed68076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.924+0000 7fed67fff640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed68103b80 0x7fed68075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.925+0000 7fed677fe640 1 -- 172.21.15.7:0/1486920165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed68109e10 msgr2=0x7fed68076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:01.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.925+0000 7fed677fe640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed68109e10 0x7fed68076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.925+0000 7fed677fe640 1 -- 172.21.15.7:0/1486920165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed68103b80 msgr2=0x7fed68075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:01.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.925+0000 7fed677fe640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed68103b80 0x7fed68075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.925+0000 7fed677fe640 1 -- 172.21.15.7:0/1486920165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed681a8700 con 0x7fed681094c0 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.925+0000 7fed6c985640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed68109e10 0x7fed68076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.925+0000 7fed67fff640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed68103b80 0x7fed68075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.925+0000 7fed677fe640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed681094c0 0x7fed68075c50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00e970 tx=0x7fed5c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.925+0000 7fed657fa640 1 -- 172.21.15.7:0/1486920165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c00cd80 con 0x7fed681094c0 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.925+0000 7fed6e3e8640 1 -- 172.21.15.7:0/1486920165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed681a89f0 con 0x7fed681094c0 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.925+0000 7fed657fa640 1 -- 172.21.15.7:0/1486920165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed5c0035f0 con 0x7fed681094c0 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.925+0000 7fed657fa640 1 -- 172.21.15.7:0/1486920165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c010690 con 0x7fed681094c0 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.925+0000 7fed6e3e8640 1 -- 172.21.15.7:0/1486920165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed681a8f80 con 0x7fed681094c0 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.928+0000 7fed7495c740 1 Processor -- start 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.928+0000 7fed7495c740 1 -- start start 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed7495c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7ed7070 0x562aa827e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed7495c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eae1b0 0x562aa827e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed7495c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7eb6390 0x562aa827ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed7495c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562aa81f4ea0 con 0x562aa7ed7070 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed7495c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562aa81e42d0 con 0x562aa7eae1b0 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed7495c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562aa81e80e0 con 0x562aa7eb6390 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed6c985640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7ed7070 0x562aa827e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed67fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eae1b0 0x562aa827e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed6c985640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7ed7070 0x562aa827e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52588/0 (socket says 172.21.15.7:52588) 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed6c985640 1 -- 172.21.15.7:0/3085125575 learned_addr learned my addr 172.21.15.7:0/3085125575 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed657fa640 1 -- 172.21.15.7:0/1486920165 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fed5c0108f0 con 0x7fed681094c0 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed67fff640 1 -- 172.21.15.7:0/3085125575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7eb6390 msgr2=0x562aa827ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed67fff640 1 --2- 172.21.15.7:0/3085125575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7eb6390 0x562aa827ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed67fff640 1 -- 172.21.15.7:0/3085125575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7ed7070 msgr2=0x562aa827e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed67fff640 1 --2- 172.21.15.7:0/3085125575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7ed7070 0x562aa827e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed67fff640 1 -- 172.21.15.7:0/3085125575 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aa7f42650 con 0x562aa7eae1b0 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.929+0000 7fed6c985640 1 --2- 172.21.15.7:0/3085125575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7ed7070 0x562aa827e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.930+0000 7fed67fff640 1 --2- 172.21.15.7:0/3085125575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eae1b0 0x562aa827e800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed58009fa0 tx=0x7fed5800f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3ae95aca712450b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.930+0000 7fed4e7fc640 1 -- 172.21.15.7:0/3085125575 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58004030 con 0x562aa7eae1b0 2024-09-21T05:55:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.930+0000 7fed4e7fc640 1 -- 172.21.15.7:0/3085125575 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed580054d0 con 0x562aa7eae1b0 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.930+0000 7fed4e7fc640 1 -- 172.21.15.7:0/3085125575 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58004bc0 con 0x562aa7eae1b0 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.931+0000 7fed657fa640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fed500b6680 0x7fed500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.931+0000 7fed6c985640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fed500b6680 0x7fed500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.931+0000 7fed657fa640 1 -- 172.21.15.7:0/1486920165 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fed5c0e7950 con 0x7fed681094c0 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.931+0000 7fed7495c740 1 -- 172.21.15.7:0/3085125575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eae1b0 msgr2=0x562aa827e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.931+0000 7fed7495c740 1 --2- 172.21.15.7:0/3085125575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eae1b0 0x562aa827e800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed58009fa0 tx=0x7fed5800f850 comp rx=0 tx=0).stop 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.931+0000 7fed6c985640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fed500b6680 0x7fed500b8b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fed6002f500 tx=0x7fed6002f350 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.931+0000 7fed7495c740 1 -- 172.21.15.7:0/3085125575 shutdown_connections 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.931+0000 7fed7495c740 1 --2- 172.21.15.7:0/3085125575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7eb6390 0x562aa827ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.931+0000 7fed7495c740 1 --2- 172.21.15.7:0/3085125575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eae1b0 0x562aa827e800 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.931+0000 7fed7495c740 1 --2- 172.21.15.7:0/3085125575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7ed7070 0x562aa827e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.931+0000 7fed7495c740 1 -- 172.21.15.7:0/3085125575 >> 172.21.15.7:0/3085125575 conn(0x562aa7ecb460 msgr2=0x562aa827c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.932+0000 7fed7495c740 1 -- 172.21.15.7:0/3085125575 shutdown_connections 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.932+0000 7fed7495c740 1 -- 172.21.15.7:0/3085125575 wait complete. 2024-09-21T05:55:01.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.932+0000 7fed7495c740 1 -- start start 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.932+0000 7fed7495c740 1 Processor -- start 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.933+0000 7fed7495c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eae1b0 0x562aa82899f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.933+0000 7fed7495c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eb6390 0x562aa8289f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.933+0000 7fed7495c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7ed7070 0x562aa8295dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.933+0000 7fed7495c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562aa8045700 con 0x562aa7eae1b0 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.933+0000 7fed7495c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562aa817f160 con 0x562aa7eb6390 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.933+0000 7fed7495c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562aa828caa0 con 0x562aa7ed7070 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.933+0000 7fed67fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eae1b0 0x562aa82899f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.933+0000 7fed677fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eb6390 0x562aa8289f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.933+0000 7fed677fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eb6390 0x562aa8289f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:47998/0 (socket says 172.21.15.7:47998) 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.933+0000 7fed677fe640 1 -- 172.21.15.7:0/1237767089 learned_addr learned my addr 172.21.15.7:0/1237767089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.933+0000 7fed6c985640 1 --2- 172.21.15.7:0/1237767089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7ed7070 0x562aa8295dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.934+0000 7fed677fe640 1 -- 172.21.15.7:0/1237767089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7ed7070 msgr2=0x562aa8295dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.934+0000 7fed677fe640 1 --2- 172.21.15.7:0/1237767089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7ed7070 0x562aa8295dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.934+0000 7fed677fe640 1 -- 172.21.15.7:0/1237767089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eae1b0 msgr2=0x562aa82899f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:01.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.934+0000 7fed677fe640 1 --2- 172.21.15.7:0/1237767089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eae1b0 0x562aa82899f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.934+0000 7fed677fe640 1 -- 172.21.15.7:0/1237767089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aa81acc90 con 0x562aa7eb6390 2024-09-21T05:55:01.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.934+0000 7fed7495c740 10 client.0 _ll_register_callbacks cb 0x562aa81989e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:01.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.934+0000 7fed7495c740 1 -- 172.21.15.7:0/1237767089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed580054d0 con 0x562aa7eb6390 2024-09-21T05:55:01.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.934+0000 7fed677fe640 1 --2- 172.21.15.7:0/1237767089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eb6390 0x562aa8289f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00c6a0 tx=0x7fed5c0ad230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fee17a750ef5863 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:01.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.934+0000 7fed477fe640 10 client.25448 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:55:01.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.934+0000 7fed477fe640 1 -- 172.21.15.7:0/1237767089 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0e55b0 con 0x562aa7eb6390 2024-09-21T05:55:01.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.934+0000 7fed477fe640 1 -- 172.21.15.7:0/1237767089 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fed5c0b6fb0 con 0x562aa7eb6390 2024-09-21T05:55:01.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.935+0000 7fed477fe640 1 -- 172.21.15.7:0/1237767089 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fed5c0adf20 con 0x562aa7eb6390 2024-09-21T05:55:01.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.935+0000 7fed7495c740 10 client.25448 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:01.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.935+0000 7fed7495c740 1 -- 172.21.15.7:0/1237767089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({fsmap=25}) -- 0x562aa8298670 con 0x562aa7eb6390 2024-09-21T05:55:01.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.935+0000 7fed477fe640 1 -- 172.21.15.7:0/1237767089 <== mon.2 v2:172.21.15.27:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fed5c0aeb50 con 0x562aa7eb6390 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.935+0000 7fed7495c740 10 client.25448 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.935+0000 7fed7495c740 10 client.25448 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.935+0000 7fed7495c740 20 client.25448 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.935+0000 7fed7495c740 1 --2- 172.21.15.7:0/1237767089 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562aa7e959f0 0x562aa829ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.935+0000 7fed7495c740 4 client.25448 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.935+0000 7fed7495c740 1 -- 172.21.15.7:0/1237767089 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aa81f6df0 con 0x562aa7e959f0 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.935+0000 7fed67fff640 1 --2- 172.21.15.7:0/1237767089 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562aa7e959f0 0x562aa829ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.936+0000 7fed67fff640 1 --2- 172.21.15.7:0/1237767089 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562aa7e959f0 0x562aa829ba10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=77e4e923cb7a93a2 server_cookie=f4d83c32ed534d07 in_seq=0 out_seq=0 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.936+0000 7fed477fe640 10 client.25448 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed477fe640 1 -- 172.21.15.7:0/1237767089 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562aa81f6df0 con 0x562aa7e959f0 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed477fe640 10 client.25448 handle_command_reply: tid=0 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed7495c740 1 client.25448 shutdown 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed7495c740 1 -- 172.21.15.7:0/1237767089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eb6390 msgr2=0x562aa8289f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:01.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed7495c740 1 --2- 172.21.15.7:0/1237767089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eb6390 0x562aa8289f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00c6a0 tx=0x7fed5c0ad230 comp rx=0 tx=0).stop 2024-09-21T05:55:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed7495c740 1 -- 172.21.15.7:0/1237767089 shutdown_connections 2024-09-21T05:55:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed7495c740 1 --2- 172.21.15.7:0/1237767089 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562aa7e959f0 0x562aa829ba10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed7495c740 1 --2- 172.21.15.7:0/1237767089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7ed7070 0x562aa8295dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed7495c740 1 --2- 172.21.15.7:0/1237767089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eb6390 0x562aa8289f30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed7495c740 1 --2- 172.21.15.7:0/1237767089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eae1b0 0x562aa82899f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed7495c740 1 -- 172.21.15.7:0/1237767089 >> 172.21.15.7:0/1237767089 conn(0x562aa7ecb460 msgr2=0x562aa82814a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed477fe640 0 client.25448 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:55:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed7495c740 1 -- 172.21.15.7:0/1237767089 shutdown_connections 2024-09-21T05:55:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed7495c740 1 -- 172.21.15.7:0/1237767089 wait complete. 2024-09-21T05:55:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.937+0000 7fed7495c740 20 client.25448 trim_cache size 0 max 16384 2024-09-21T05:55:01.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.953+0000 7fed7495c740 1 Processor -- start 2024-09-21T05:55:01.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.953+0000 7fed7495c740 1 -- start start 2024-09-21T05:55:01.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.953+0000 7fed7495c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eae1b0 0x562aa82888e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.953+0000 7fed7495c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eb6390 0x562aa827fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.953+0000 7fed7495c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7ed7070 0x562aa827b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed67fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eae1b0 0x562aa82888e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed7495c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fed681afcd0 con 0x562aa7eb6390 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed7495c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fed681ad5a0 con 0x562aa7eae1b0 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed7495c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fed681ab410 con 0x562aa7ed7070 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed67fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eae1b0 0x562aa82888e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:48000/0 (socket says 172.21.15.7:48000) 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed67fff640 1 -- 172.21.15.7:0/2809395578 learned_addr learned my addr 172.21.15.7:0/2809395578 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed677fe640 1 --2- 172.21.15.7:0/2809395578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eb6390 0x562aa827fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed6c985640 1 --2- 172.21.15.7:0/2809395578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7ed7070 0x562aa827b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed67fff640 1 -- 172.21.15.7:0/2809395578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7ed7070 msgr2=0x562aa827b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed67fff640 1 --2- 172.21.15.7:0/2809395578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7ed7070 0x562aa827b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed67fff640 1 -- 172.21.15.7:0/2809395578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eb6390 msgr2=0x562aa827fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed67fff640 1 --2- 172.21.15.7:0/2809395578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eb6390 0x562aa827fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed67fff640 1 -- 172.21.15.7:0/2809395578 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aa7e95c20 con 0x562aa7eae1b0 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed67fff640 1 --2- 172.21.15.7:0/2809395578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eae1b0 0x562aa82888e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fed580058c0 tx=0x7fed58005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0886db7b7974f66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.954+0000 7fed4dffb640 1 -- 172.21.15.7:0/2809395578 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58038020 con 0x562aa7eae1b0 2024-09-21T05:55:01.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.955+0000 7fed4dffb640 1 -- 172.21.15.7:0/2809395578 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed5800eb80 con 0x562aa7eae1b0 2024-09-21T05:55:01.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.955+0000 7fed4dffb640 1 -- 172.21.15.7:0/2809395578 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58021900 con 0x562aa7eae1b0 2024-09-21T05:55:01.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.955+0000 7fed7495c740 1 -- 172.21.15.7:0/2809395578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eae1b0 msgr2=0x562aa82888e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:01.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.955+0000 7fed7495c740 1 --2- 172.21.15.7:0/2809395578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eae1b0 0x562aa82888e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fed580058c0 tx=0x7fed58005f90 comp rx=0 tx=0).stop 2024-09-21T05:55:01.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.956+0000 7fed7495c740 1 -- 172.21.15.7:0/2809395578 shutdown_connections 2024-09-21T05:55:01.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.956+0000 7fed7495c740 1 --2- 172.21.15.7:0/2809395578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eb6390 0x562aa827fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.956+0000 7fed7495c740 1 --2- 172.21.15.7:0/2809395578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7ed7070 0x562aa827b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.956+0000 7fed7495c740 1 --2- 172.21.15.7:0/2809395578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7eae1b0 0x562aa82888e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.956+0000 7fed7495c740 1 -- 172.21.15.7:0/2809395578 >> 172.21.15.7:0/2809395578 conn(0x562aa7ecb460 msgr2=0x562aa827f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:01.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.956+0000 7fed7495c740 1 -- 172.21.15.7:0/2809395578 shutdown_connections 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.956+0000 7fed7495c740 1 -- 172.21.15.7:0/2809395578 wait complete. 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.956+0000 7fed7495c740 1 -- start start 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.956+0000 7fed7495c740 1 Processor -- start 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed7495c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7eae1b0 0x562aa8292570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed7495c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eb6390 0x562aa828da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed7495c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7ed7070 0x562aa828dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed7495c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fed681aba60 con 0x562aa7eb6390 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed7495c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fed681aced0 con 0x562aa7ed7070 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed7495c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fed681ac130 con 0x562aa7eae1b0 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed7495c740 10 client.0 _ll_register_callbacks cb 0x7fed5c00cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed677fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eb6390 0x562aa828da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed6c985640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7ed7070 0x562aa828dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed6c985640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7ed7070 0x562aa828dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:48016/0 (socket says 172.21.15.7:48016) 2024-09-21T05:55:01.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed677fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eb6390 0x562aa828da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52618/0 (socket says 172.21.15.7:52618) 2024-09-21T05:55:01.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed6c985640 1 -- 172.21.15.7:0/2208868958 learned_addr learned my addr 172.21.15.7:0/2208868958 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:01.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed67fff640 1 --2- 172.21.15.7:0/2208868958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7eae1b0 0x562aa8292570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed6c985640 1 -- 172.21.15.7:0/2208868958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7eae1b0 msgr2=0x562aa8292570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:01.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed6c985640 1 --2- 172.21.15.7:0/2208868958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7eae1b0 0x562aa8292570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed6c985640 1 -- 172.21.15.7:0/2208868958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eb6390 msgr2=0x562aa828da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:01.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed6c985640 1 --2- 172.21.15.7:0/2208868958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eb6390 0x562aa828da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed6c985640 1 -- 172.21.15.7:0/2208868958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aa828e750 con 0x562aa7ed7070 2024-09-21T05:55:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.957+0000 7fed677fe640 1 --2- 172.21.15.7:0/2208868958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eb6390 0x562aa828da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.958+0000 7fed6c985640 1 --2- 172.21.15.7:0/2208868958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7ed7070 0x562aa828dfc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed600094e0 tx=0x7fed600095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aff7dd8cb412b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.958+0000 7fed477fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:55:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.958+0000 7fed477fe640 1 -- 172.21.15.7:0/2208868958 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed60059060 con 0x562aa7ed7070 2024-09-21T05:55:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.958+0000 7fed477fe640 1 -- 172.21.15.7:0/2208868958 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fed600043d0 con 0x562aa7ed7070 2024-09-21T05:55:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.958+0000 7fed7495c740 1 -- 172.21.15.7:0/2208868958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed5800eb80 con 0x562aa7ed7070 2024-09-21T05:55:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.958+0000 7fed477fe640 1 -- 172.21.15.7:0/2208868958 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fed600045d0 con 0x562aa7ed7070 2024-09-21T05:55:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.958+0000 7fed7495c740 10 client.25454 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.958+0000 7fed7495c740 1 -- 172.21.15.7:0/2208868958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562aa8306380 con 0x562aa7ed7070 2024-09-21T05:55:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.959+0000 7fed477fe640 1 -- 172.21.15.7:0/2208868958 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed5800eb80 con 0x562aa7ed7070 2024-09-21T05:55:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.959+0000 7fed477fe640 1 -- 172.21.15.7:0/2208868958 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fed600305c0 con 0x562aa7ed7070 2024-09-21T05:55:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.959+0000 7fed7495c740 10 client.25454 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:01.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.959+0000 7fed7495c740 10 client.25454 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.959+0000 7fed7495c740 20 client.25454 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.959+0000 7fed7495c740 1 --2- 172.21.15.7:0/2208868958 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562aa7e6ada0 0x562aa8308ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.959+0000 7fed7495c740 4 client.25454 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.959+0000 7fed7495c740 1 -- 172.21.15.7:0/2208868958 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562aa81f28a0 con 0x562aa7e6ada0 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.959+0000 7fed67fff640 1 --2- 172.21.15.7:0/2208868958 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562aa7e6ada0 0x562aa8308ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.959+0000 7fed477fe640 10 client.25454 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed67fff640 1 --2- 172.21.15.7:0/2208868958 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562aa7e6ada0 0x562aa8308ba0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf92d63f2417909e server_cookie=b41d71f7a1d75dfc in_seq=0 out_seq=0 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed477fe640 1 -- 172.21.15.7:0/2208868958 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562aa81f28a0 con 0x562aa7e6ada0 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed477fe640 10 client.25454 handle_command_reply: tid=0 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed7495c740 1 client.25454 shutdown 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed7495c740 1 -- 172.21.15.7:0/2208868958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7ed7070 msgr2=0x562aa828dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed7495c740 1 --2- 172.21.15.7:0/2208868958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7ed7070 0x562aa828dfc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed600094e0 tx=0x7fed600095c0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed7495c740 1 -- 172.21.15.7:0/2208868958 shutdown_connections 2024-09-21T05:55:01.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed7495c740 1 --2- 172.21.15.7:0/2208868958 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x562aa7e6ada0 0x562aa8308ba0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed7495c740 1 --2- 172.21.15.7:0/2208868958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562aa7eb6390 0x562aa828da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed7495c740 1 --2- 172.21.15.7:0/2208868958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562aa7ed7070 0x562aa828dfc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed477fe640 0 client.25454 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:55:01.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed7495c740 1 --2- 172.21.15.7:0/2208868958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562aa7eae1b0 0x562aa8292570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed7495c740 1 -- 172.21.15.7:0/2208868958 >> 172.21.15.7:0/2208868958 conn(0x562aa7ecb460 msgr2=0x562aa828ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:01.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed7495c740 1 -- 172.21.15.7:0/2208868958 shutdown_connections 2024-09-21T05:55:01.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed7495c740 1 -- 172.21.15.7:0/2208868958 wait complete. 2024-09-21T05:55:01.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.960+0000 7fed7495c740 20 client.25454 trim_cache size 0 max 16384 2024-09-21T05:55:01.967 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:55:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.961+0000 7fed6e3e8640 1 -- 172.21.15.7:0/1486920165 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fed500b6680 msgr2=0x7fed500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.961+0000 7fed6e3e8640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fed500b6680 0x7fed500b8b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fed6002f500 tx=0x7fed6002f350 comp rx=0 tx=0).stop 2024-09-21T05:55:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.961+0000 7fed6e3e8640 1 -- 172.21.15.7:0/1486920165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed681094c0 msgr2=0x7fed68075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.961+0000 7fed6e3e8640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed681094c0 0x7fed68075c50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00e970 tx=0x7fed5c00ee30 comp rx=0 tx=0).stop 2024-09-21T05:55:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.961+0000 7fed6e3e8640 1 -- 172.21.15.7:0/1486920165 shutdown_connections 2024-09-21T05:55:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.961+0000 7fed6e3e8640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fed500b6680 0x7fed500b8b90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.961+0000 7fed6e3e8640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed681094c0 0x7fed68075c50 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.961+0000 7fed6e3e8640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed68109e10 0x7fed68076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.961+0000 7fed6e3e8640 1 --2- 172.21.15.7:0/1486920165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fed68103b80 0x7fed68075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.961+0000 7fed6e3e8640 1 -- 172.21.15.7:0/1486920165 >> 172.21.15.7:0/1486920165 conn(0x7fed680ff610 msgr2=0x7fed68106ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.961+0000 7fed6e3e8640 1 -- 172.21.15.7:0/1486920165 shutdown_connections 2024-09-21T05:55:01.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:01.961+0000 7fed6e3e8640 1 -- 172.21.15.7:0/1486920165 wait complete. 2024-09-21T05:55:02.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:02 smithi007 ceph-mon[30983]: pgmap v352: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 952 KiB/s wr, 13 op/s 2024-09-21T05:55:02.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:02 smithi119 ceph-mon[34833]: pgmap v352: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 952 KiB/s wr, 13 op/s 2024-09-21T05:55:02.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T05:55:02.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:02 smithi027 ceph-mon[34364]: pgmap v352: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 952 KiB/s wr, 13 op/s 2024-09-21T05:55:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.136+0000 7f8216950640 1 -- 172.21.15.7:0/4098393552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82101082f0 msgr2=0x7f8210108700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.136+0000 7f8216950640 1 --2- 172.21.15.7:0/4098393552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82101082f0 0x7f8210108700 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8204009900 tx=0x7f820402a410 comp rx=0 tx=0).stop 2024-09-21T05:55:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.136+0000 7f8216950640 1 -- 172.21.15.7:0/4098393552 shutdown_connections 2024-09-21T05:55:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.136+0000 7f8216950640 1 --2- 172.21.15.7:0/4098393552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82101082f0 0x7f8210108700 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.136+0000 7f8216950640 1 --2- 172.21.15.7:0/4098393552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8210108c40 0x7f821010f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.136+0000 7f8216950640 1 --2- 172.21.15.7:0/4098393552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82101029c0 0x7f8210102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.136+0000 7f8216950640 1 -- 172.21.15.7:0/4098393552 >> 172.21.15.7:0/4098393552 conn(0x7f82100fe3c0 msgr2=0x7f8210100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.136+0000 7f8216950640 1 -- 172.21.15.7:0/4098393552 shutdown_connections 2024-09-21T05:55:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.136+0000 7f8216950640 1 -- 172.21.15.7:0/4098393552 wait complete. 2024-09-21T05:55:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.136+0000 7f8216950640 1 Processor -- start 2024-09-21T05:55:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.137+0000 7f8216950640 1 -- start start 2024-09-21T05:55:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.137+0000 7f8216950640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82101029c0 0x7f821019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.137+0000 7f8216950640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82101082f0 0x7f821019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.137+0000 7f8216950640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8210108c40 0x7f821019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.137+0000 7f8216950640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8210113a20 con 0x7f82101029c0 2024-09-21T05:55:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.137+0000 7f8216950640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f82101138a0 con 0x7f82101082f0 2024-09-21T05:55:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.137+0000 7f8216950640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8210113ba0 con 0x7f8210108c40 2024-09-21T05:55:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.137+0000 7f820ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82101029c0 0x7f821019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.137+0000 7f820ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82101029c0 0x7f821019a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52628/0 (socket says 172.21.15.7:52628) 2024-09-21T05:55:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.137+0000 7f820ffff640 1 -- 172.21.15.7:0/287077022 learned_addr learned my addr 172.21.15.7:0/287077022 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.137+0000 7f820f7fe640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82101082f0 0x7f821019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.137+0000 7f8214eed640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8210108c40 0x7f821019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.138+0000 7f820ffff640 1 -- 172.21.15.7:0/287077022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8210108c40 msgr2=0x7f821019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.138+0000 7f820ffff640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8210108c40 0x7f821019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.138+0000 7f820ffff640 1 -- 172.21.15.7:0/287077022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82101082f0 msgr2=0x7f821019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.138+0000 7f820ffff640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82101082f0 0x7f821019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.138+0000 7f820ffff640 1 -- 172.21.15.7:0/287077022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82101a0390 con 0x7f82101029c0 2024-09-21T05:55:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.138+0000 7f820f7fe640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82101082f0 0x7f821019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.138+0000 7f820ffff640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82101029c0 0x7f821019a460 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f820000e9f0 tx=0x7f820000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.138+0000 7f820d7fa640 1 -- 172.21.15.7:0/287077022 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820000ccc0 con 0x7f82101029c0 2024-09-21T05:55:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.138+0000 7f8216950640 1 -- 172.21.15.7:0/287077022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82101a0680 con 0x7f82101029c0 2024-09-21T05:55:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.138+0000 7f820d7fa640 1 -- 172.21.15.7:0/287077022 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82000108e0 con 0x7f82101029c0 2024-09-21T05:55:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.138+0000 7f820d7fa640 1 -- 172.21.15.7:0/287077022 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200018880 con 0x7f82101029c0 2024-09-21T05:55:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.138+0000 7f8216950640 1 -- 172.21.15.7:0/287077022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f821010fe30 con 0x7f82101029c0 2024-09-21T05:55:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.141+0000 7f821d8ba740 1 Processor -- start 2024-09-21T05:55:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.141+0000 7f821d8ba740 1 -- start start 2024-09-21T05:55:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.141+0000 7f820d7fa640 1 -- 172.21.15.7:0/287077022 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8200018a20 con 0x7f82101029c0 2024-09-21T05:55:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.141+0000 7f821d8ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1c31b0 0x5585ef5689b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.141+0000 7f821d8ba740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef19a2f0 0x5585ef568ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.141+0000 7f821d8ba740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef1a24d0 0x5585ef569430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.141+0000 7f821d8ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5585ef4dd6f0 con 0x5585ef1c31b0 2024-09-21T05:55:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.141+0000 7f821d8ba740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5585ef4ccb20 con 0x5585ef1a24d0 2024-09-21T05:55:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.141+0000 7f821d8ba740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5585ef4d0930 con 0x5585ef19a2f0 2024-09-21T05:55:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.142+0000 7f8214eed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1c31b0 0x5585ef5689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.142+0000 7f820ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef19a2f0 0x5585ef568ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.142+0000 7f8214eed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1c31b0 0x5585ef5689b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52638/0 (socket says 172.21.15.7:52638) 2024-09-21T05:55:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.142+0000 7f8214eed640 1 -- 172.21.15.7:0/131420366 learned_addr learned my addr 172.21.15.7:0/131420366 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.142+0000 7f820f7fe640 1 --2- 172.21.15.7:0/131420366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef1a24d0 0x5585ef569430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.142+0000 7f820ffff640 1 -- 172.21.15.7:0/131420366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef1a24d0 msgr2=0x5585ef569430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.142+0000 7f820ffff640 1 --2- 172.21.15.7:0/131420366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef1a24d0 0x5585ef569430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.142+0000 7f820ffff640 1 -- 172.21.15.7:0/131420366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1c31b0 msgr2=0x5585ef5689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.142+0000 7f820ffff640 1 --2- 172.21.15.7:0/131420366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1c31b0 0x5585ef5689b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.142+0000 7f820ffff640 1 -- 172.21.15.7:0/131420366 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585ef492530 con 0x5585ef19a2f0 2024-09-21T05:55:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.142+0000 7f820ffff640 1 --2- 172.21.15.7:0/131420366 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef19a2f0 0x5585ef568ef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82000e5250 tx=0x7f82000f05f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8a41a3a18deb179 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.142+0000 7f820d7fa640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f81f80b6680 0x7f81f80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.143+0000 7f81f67fc640 1 -- 172.21.15.7:0/131420366 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82000a9fd0 con 0x5585ef19a2f0 2024-09-21T05:55:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.143+0000 7f8214eed640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f81f80b6680 0x7f81f80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.143+0000 7f820d7fa640 1 -- 172.21.15.7:0/287077022 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f82000e7ab0 con 0x7f82101029c0 2024-09-21T05:55:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.143+0000 7f81f67fc640 1 -- 172.21.15.7:0/131420366 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82000f9070 con 0x5585ef19a2f0 2024-09-21T05:55:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.143+0000 7f81f67fc640 1 -- 172.21.15.7:0/131420366 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82000ad0f0 con 0x5585ef19a2f0 2024-09-21T05:55:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.144+0000 7f821d8ba740 1 -- 172.21.15.7:0/131420366 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef19a2f0 msgr2=0x5585ef568ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.144+0000 7f8214eed640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f81f80b6680 0x7f81f80b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8208012680 tx=0x7f8208009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.144+0000 7f821d8ba740 1 --2- 172.21.15.7:0/131420366 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef19a2f0 0x5585ef568ef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82000e5250 tx=0x7f82000f05f0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.144+0000 7f821d8ba740 1 -- 172.21.15.7:0/131420366 shutdown_connections 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.144+0000 7f821d8ba740 1 --2- 172.21.15.7:0/131420366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef1a24d0 0x5585ef569430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.144+0000 7f821d8ba740 1 --2- 172.21.15.7:0/131420366 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef19a2f0 0x5585ef568ef0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.144+0000 7f821d8ba740 1 --2- 172.21.15.7:0/131420366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1c31b0 0x5585ef5689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.144+0000 7f821d8ba740 1 -- 172.21.15.7:0/131420366 >> 172.21.15.7:0/131420366 conn(0x5585ef1b7300 msgr2=0x5585ef5668a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.144+0000 7f821d8ba740 1 -- 172.21.15.7:0/131420366 shutdown_connections 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.144+0000 7f821d8ba740 1 -- 172.21.15.7:0/131420366 wait complete. 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.144+0000 7f821d8ba740 1 -- start start 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.145+0000 7f821d8ba740 1 Processor -- start 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.145+0000 7f821d8ba740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef19a2f0 0x5585ef574010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.145+0000 7f821d8ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1a24d0 0x5585ef574550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.145+0000 7f821d8ba740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1c31b0 0x5585ef5803c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.145+0000 7f821d8ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5585ef404ab0 con 0x5585ef1a24d0 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.145+0000 7f821d8ba740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5585ef472730 con 0x5585ef19a2f0 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.145+0000 7f821d8ba740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5585ef5770d0 con 0x5585ef1c31b0 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.145+0000 7f821d8ba740 10 client.0 _ll_register_callbacks cb 0x5585ef4c66b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.145+0000 7f8214eed640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1c31b0 0x5585ef5803c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.145+0000 7f820f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1a24d0 0x5585ef574550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.145+0000 7f8214eed640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1c31b0 0x5585ef5803c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:51240/0 (socket says 172.21.15.7:51240) 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.145+0000 7f8214eed640 1 -- 172.21.15.7:0/3137016752 learned_addr learned my addr 172.21.15.7:0/3137016752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.145+0000 7f820ffff640 1 --2- 172.21.15.7:0/3137016752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef19a2f0 0x5585ef574010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.146+0000 7f8214eed640 1 -- 172.21.15.7:0/3137016752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef19a2f0 msgr2=0x5585ef574010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.146+0000 7f8214eed640 1 --2- 172.21.15.7:0/3137016752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef19a2f0 0x5585ef574010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.146+0000 7f8214eed640 1 -- 172.21.15.7:0/3137016752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1a24d0 msgr2=0x5585ef574550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.146+0000 7f8214eed640 1 --2- 172.21.15.7:0/3137016752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1a24d0 0x5585ef574550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.146+0000 7f8214eed640 1 -- 172.21.15.7:0/3137016752 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585ef22e790 con 0x5585ef1c31b0 2024-09-21T05:55:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.146+0000 7f820f7fe640 1 --2- 172.21.15.7:0/3137016752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1a24d0 0x5585ef574550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.146+0000 7f8214eed640 1 --2- 172.21.15.7:0/3137016752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1c31b0 0x5585ef5803c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f820800faf0 tx=0x7f8208004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b47d633a562f1db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.146+0000 7f81ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:55:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.146+0000 7f81ef7fe640 1 -- 172.21.15.7:0/3137016752 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820802d060 con 0x5585ef1c31b0 2024-09-21T05:55:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.147+0000 7f81ef7fe640 1 -- 172.21.15.7:0/3137016752 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f8208018030 con 0x5585ef1c31b0 2024-09-21T05:55:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.147+0000 7f821d8ba740 1 -- 172.21.15.7:0/3137016752 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82000f9070 con 0x5585ef1c31b0 2024-09-21T05:55:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.147+0000 7f81ef7fe640 1 -- 172.21.15.7:0/3137016752 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8208003c40 con 0x5585ef1c31b0 2024-09-21T05:55:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.147+0000 7f821d8ba740 10 client.25426 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.147+0000 7f821d8ba740 1 -- 172.21.15.7:0/3137016752 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5585ef2a7620 con 0x5585ef1c31b0 2024-09-21T05:55:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.147+0000 7f81ef7fe640 1 -- 172.21.15.7:0/3137016752 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82000f9070 con 0x5585ef1c31b0 2024-09-21T05:55:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.147+0000 7f81ef7fe640 1 -- 172.21.15.7:0/3137016752 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f820801e7d0 con 0x5585ef1c31b0 2024-09-21T05:55:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.148+0000 7f821d8ba740 10 client.25426 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.148+0000 7f821d8ba740 10 client.25426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.148+0000 7f821d8ba740 20 client.25426 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.148+0000 7f821d8ba740 1 --2- 172.21.15.7:0/3137016752 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5585ef181d80 0x5585ef586100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.148+0000 7f821d8ba740 4 client.25426 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.148+0000 7f821d8ba740 1 -- 172.21.15.7:0/3137016752 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585ef4df640 con 0x5585ef181d80 2024-09-21T05:55:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.148+0000 7f820ffff640 1 --2- 172.21.15.7:0/3137016752 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5585ef181d80 0x5585ef586100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.148+0000 7f820ffff640 1 --2- 172.21.15.7:0/3137016752 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5585ef181d80 0x5585ef586100 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f77a6eff303c55d server_cookie=f2f7c6b0064f4a3c in_seq=0 out_seq=0 2024-09-21T05:55:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.148+0000 7f81ef7fe640 10 client.25426 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.149+0000 7f81ef7fe640 1 -- 172.21.15.7:0/3137016752 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5585ef4df640 con 0x5585ef181d80 2024-09-21T05:55:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.149+0000 7f81ef7fe640 10 client.25426 handle_command_reply: tid=0 2024-09-21T05:55:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.149+0000 7f821d8ba740 1 client.25426 shutdown 2024-09-21T05:55:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.150+0000 7f821d8ba740 1 -- 172.21.15.7:0/3137016752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1c31b0 msgr2=0x5585ef5803c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.150+0000 7f821d8ba740 1 --2- 172.21.15.7:0/3137016752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1c31b0 0x5585ef5803c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f820800faf0 tx=0x7f8208004ab0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.150+0000 7f821d8ba740 1 -- 172.21.15.7:0/3137016752 shutdown_connections 2024-09-21T05:55:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.150+0000 7f821d8ba740 1 --2- 172.21.15.7:0/3137016752 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5585ef181d80 0x5585ef586100 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.150+0000 7f821d8ba740 1 --2- 172.21.15.7:0/3137016752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1a24d0 0x5585ef574550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.150+0000 7f821d8ba740 1 --2- 172.21.15.7:0/3137016752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1c31b0 0x5585ef5803c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.150+0000 7f821d8ba740 1 --2- 172.21.15.7:0/3137016752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef19a2f0 0x5585ef574010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.150+0000 7f81ef7fe640 0 client.25426 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.150+0000 7f821d8ba740 1 -- 172.21.15.7:0/3137016752 >> 172.21.15.7:0/3137016752 conn(0x5585ef1b7300 msgr2=0x5585ef5699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.150+0000 7f821d8ba740 1 -- 172.21.15.7:0/3137016752 shutdown_connections 2024-09-21T05:55:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.150+0000 7f821d8ba740 1 -- 172.21.15.7:0/3137016752 wait complete. 2024-09-21T05:55:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.150+0000 7f821d8ba740 20 client.25426 trim_cache size 0 max 16384 2024-09-21T05:55:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.168+0000 7f821d8ba740 1 Processor -- start 2024-09-21T05:55:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.168+0000 7f821d8ba740 1 -- start start 2024-09-21T05:55:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.168+0000 7f821d8ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef19a2f0 0x5585ef575c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.168+0000 7f821d8ba740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef1a24d0 0x5585ef5802c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.168+0000 7f821d8ba740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1c31b0 0x5585ef5711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.168+0000 7f821d8ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82101afc70 con 0x5585ef19a2f0 2024-09-21T05:55:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.168+0000 7f821d8ba740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f82101ad540 con 0x5585ef1a24d0 2024-09-21T05:55:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.168+0000 7f821d8ba740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f82101ab3b0 con 0x5585ef1c31b0 2024-09-21T05:55:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.169+0000 7f820ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef19a2f0 0x5585ef575c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.169+0000 7f820f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef1a24d0 0x5585ef5802c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.169+0000 7f820f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef1a24d0 0x5585ef5802c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:48062/0 (socket says 172.21.15.7:48062) 2024-09-21T05:55:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.169+0000 7f820f7fe640 1 -- 172.21.15.7:0/2346221904 learned_addr learned my addr 172.21.15.7:0/2346221904 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.169+0000 7f820ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef19a2f0 0x5585ef575c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52650/0 (socket says 172.21.15.7:52650) 2024-09-21T05:55:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.169+0000 7f8214eed640 1 --2- 172.21.15.7:0/2346221904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1c31b0 0x5585ef5711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.169+0000 7f820f7fe640 1 -- 172.21.15.7:0/2346221904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1c31b0 msgr2=0x5585ef5711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.169+0000 7f820f7fe640 1 --2- 172.21.15.7:0/2346221904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1c31b0 0x5585ef5711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.169+0000 7f820f7fe640 1 -- 172.21.15.7:0/2346221904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef19a2f0 msgr2=0x5585ef575c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.169+0000 7f820f7fe640 1 --2- 172.21.15.7:0/2346221904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef19a2f0 0x5585ef575c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.169+0000 7f820f7fe640 1 -- 172.21.15.7:0/2346221904 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585ef586660 con 0x5585ef1a24d0 2024-09-21T05:55:03.174 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.169+0000 7f820f7fe640 1 --2- 172.21.15.7:0/2346221904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef1a24d0 0x5585ef5802c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8204031440 tx=0x7f82040319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10d4c2d93d35f24a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:03.174 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.170+0000 7f81f5ffb640 1 -- 172.21.15.7:0/2346221904 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820404a020 con 0x5585ef1a24d0 2024-09-21T05:55:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.170+0000 7f81f5ffb640 1 -- 172.21.15.7:0/2346221904 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82040054f0 con 0x5585ef1a24d0 2024-09-21T05:55:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.170+0000 7f81f5ffb640 1 -- 172.21.15.7:0/2346221904 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204035040 con 0x5585ef1a24d0 2024-09-21T05:55:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.171+0000 7f821d8ba740 1 -- 172.21.15.7:0/2346221904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef1a24d0 msgr2=0x5585ef5802c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.171+0000 7f821d8ba740 1 --2- 172.21.15.7:0/2346221904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef1a24d0 0x5585ef5802c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8204031440 tx=0x7f82040319f0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.171+0000 7f821d8ba740 1 -- 172.21.15.7:0/2346221904 shutdown_connections 2024-09-21T05:55:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.171+0000 7f821d8ba740 1 --2- 172.21.15.7:0/2346221904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1c31b0 0x5585ef5711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.171+0000 7f821d8ba740 1 --2- 172.21.15.7:0/2346221904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef1a24d0 0x5585ef5802c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.171+0000 7f821d8ba740 1 --2- 172.21.15.7:0/2346221904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef19a2f0 0x5585ef575c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.171+0000 7f821d8ba740 1 -- 172.21.15.7:0/2346221904 >> 172.21.15.7:0/2346221904 conn(0x5585ef1b7300 msgr2=0x5585ef575530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.171+0000 7f821d8ba740 1 -- 172.21.15.7:0/2346221904 shutdown_connections 2024-09-21T05:55:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.171+0000 7f821d8ba740 1 -- 172.21.15.7:0/2346221904 wait complete. 2024-09-21T05:55:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.171+0000 7f821d8ba740 1 -- start start 2024-09-21T05:55:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.172+0000 7f821d8ba740 1 Processor -- start 2024-09-21T05:55:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.172+0000 7f821d8ba740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef19a2f0 0x5585ef579c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.172+0000 7f821d8ba740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1a24d0 0x5585ef57a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.172+0000 7f821d8ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1c31b0 0x5585ef5e8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.172+0000 7f821d8ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82101aba00 con 0x5585ef1c31b0 2024-09-21T05:55:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.172+0000 7f821d8ba740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f82101ace70 con 0x5585ef19a2f0 2024-09-21T05:55:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.172+0000 7f821d8ba740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f82101ac0d0 con 0x5585ef1a24d0 2024-09-21T05:55:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.172+0000 7f821d8ba740 10 client.0 _ll_register_callbacks cb 0x7f8208009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.172+0000 7f820ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef19a2f0 0x5585ef579c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.172+0000 7f820f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1a24d0 0x5585ef57a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.172+0000 7f820ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef19a2f0 0x5585ef579c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:48078/0 (socket says 172.21.15.7:48078) 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.172+0000 7f8214eed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1c31b0 0x5585ef5e8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.172+0000 7f820ffff640 1 -- 172.21.15.7:0/433262724 learned_addr learned my addr 172.21.15.7:0/433262724 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f820ffff640 1 -- 172.21.15.7:0/433262724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1a24d0 msgr2=0x5585ef57a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f820ffff640 1 --2- 172.21.15.7:0/433262724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1a24d0 0x5585ef57a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f820ffff640 1 -- 172.21.15.7:0/433262724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1c31b0 msgr2=0x5585ef5e8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f820ffff640 1 --2- 172.21.15.7:0/433262724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1c31b0 0x5585ef5e8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f820ffff640 1 -- 172.21.15.7:0/433262724 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585ef5e9190 con 0x5585ef19a2f0 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f820ffff640 1 --2- 172.21.15.7:0/433262724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef19a2f0 0x5585ef579c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f820000e9c0 tx=0x7f820000ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6146627322bc429 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f81ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f81ef7fe640 1 -- 172.21.15.7:0/433262724 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82000ad2d0 con 0x5585ef19a2f0 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f81ef7fe640 1 -- 172.21.15.7:0/433262724 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f82000b2190 con 0x5585ef19a2f0 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f821d8ba740 1 -- 172.21.15.7:0/433262724 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82040054f0 con 0x5585ef19a2f0 2024-09-21T05:55:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f81ef7fe640 1 -- 172.21.15.7:0/433262724 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f82000ad4c0 con 0x5585ef19a2f0 2024-09-21T05:55:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f821d8ba740 10 client.25472 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f821d8ba740 1 -- 172.21.15.7:0/433262724 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5585ef5f04c0 con 0x5585ef19a2f0 2024-09-21T05:55:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.173+0000 7f81ef7fe640 1 -- 172.21.15.7:0/433262724 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82040054f0 con 0x5585ef19a2f0 2024-09-21T05:55:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.174+0000 7f81ef7fe640 1 -- 172.21.15.7:0/433262724 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f82000e5500 con 0x5585ef19a2f0 2024-09-21T05:55:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.174+0000 7f821d8ba740 10 client.25472 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.174+0000 7f821d8ba740 10 client.25472 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.174+0000 7f821d8ba740 20 client.25472 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.174+0000 7f821d8ba740 1 --2- 172.21.15.7:0/433262724 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5585ef1571c0 0x5585ef5f2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.174+0000 7f821d8ba740 4 client.25472 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T05:55:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.174+0000 7f821d8ba740 1 -- 172.21.15.7:0/433262724 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5585ef4db0f0 con 0x5585ef1571c0 2024-09-21T05:55:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.174+0000 7f820f7fe640 1 --2- 172.21.15.7:0/433262724 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5585ef1571c0 0x5585ef5f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.174+0000 7f81ef7fe640 10 client.25472 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:03.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.174+0000 7f820f7fe640 1 --2- 172.21.15.7:0/433262724 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5585ef1571c0 0x5585ef5f2890 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80f14fa94186d1a8 server_cookie=c0de5d3389fba1b6 in_seq=0 out_seq=0 2024-09-21T05:55:03.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f81ef7fe640 1 -- 172.21.15.7:0/433262724 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5585ef4db0f0 con 0x5585ef1571c0 2024-09-21T05:55:03.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f81ef7fe640 10 client.25472 handle_command_reply: tid=0 2024-09-21T05:55:03.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f821d8ba740 1 client.25472 shutdown 2024-09-21T05:55:03.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f821d8ba740 1 -- 172.21.15.7:0/433262724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef19a2f0 msgr2=0x5585ef579c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f821d8ba740 1 --2- 172.21.15.7:0/433262724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef19a2f0 0x5585ef579c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f820000e9c0 tx=0x7f820000ce60 comp rx=0 tx=0).stop 2024-09-21T05:55:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f821d8ba740 1 -- 172.21.15.7:0/433262724 shutdown_connections 2024-09-21T05:55:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f821d8ba740 1 --2- 172.21.15.7:0/433262724 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5585ef1571c0 0x5585ef5f2890 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f821d8ba740 1 --2- 172.21.15.7:0/433262724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5585ef1c31b0 0x5585ef5e8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f81ef7fe640 0 client.25472 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f821d8ba740 1 --2- 172.21.15.7:0/433262724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5585ef1a24d0 0x5585ef57a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f821d8ba740 1 --2- 172.21.15.7:0/433262724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5585ef19a2f0 0x5585ef579c40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f821d8ba740 1 -- 172.21.15.7:0/433262724 >> 172.21.15.7:0/433262724 conn(0x5585ef1b7300 msgr2=0x5585ef5699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f821d8ba740 1 -- 172.21.15.7:0/433262724 shutdown_connections 2024-09-21T05:55:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f821d8ba740 1 -- 172.21.15.7:0/433262724 wait complete. 2024-09-21T05:55:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.184+0000 7f821d8ba740 20 client.25472 trim_cache size 0 max 16384 2024-09-21T05:55:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T05:55:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T05:55:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T05:55:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T05:55:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.185+0000 7f8216950640 1 -- 172.21.15.7:0/287077022 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f81f80b6680 msgr2=0x7f81f80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.185+0000 7f8216950640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f81f80b6680 0x7f81f80b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8208012680 tx=0x7f8208009500 comp rx=0 tx=0).stop 2024-09-21T05:55:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.185+0000 7f8216950640 1 -- 172.21.15.7:0/287077022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82101029c0 msgr2=0x7f821019a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.185+0000 7f8216950640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82101029c0 0x7f821019a460 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f820000e9f0 tx=0x7f820000edf0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.185+0000 7f8216950640 1 -- 172.21.15.7:0/287077022 shutdown_connections 2024-09-21T05:55:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.185+0000 7f8216950640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f81f80b6680 0x7f81f80b8b90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.185+0000 7f8216950640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8210108c40 0x7f821019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.185+0000 7f8216950640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82101082f0 0x7f821019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.185+0000 7f8216950640 1 --2- 172.21.15.7:0/287077022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82101029c0 0x7f821019a460 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.185+0000 7f8216950640 1 -- 172.21.15.7:0/287077022 >> 172.21.15.7:0/287077022 conn(0x7f82100fe3c0 msgr2=0x7f8210105950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.185+0000 7f8216950640 1 -- 172.21.15.7:0/287077022 shutdown_connections 2024-09-21T05:55:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:03.185+0000 7f8216950640 1 -- 172.21.15.7:0/287077022 wait complete. 2024-09-21T05:55:03.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:03 smithi007 ceph-mon[30983]: pgmap v353: 97 pgs: 97 active+clean; 19 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 880 KiB/s wr, 15 op/s 2024-09-21T05:55:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.559+0000 7fc795ab5640 1 -- 172.21.15.7:0/44439023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc790103bc0 msgr2=0x7fc790103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.559+0000 7fc795ab5640 1 --2- 172.21.15.7:0/44439023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc790103bc0 0x7fc790103fd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc780009900 tx=0x7fc78002a410 comp rx=0 tx=0).stop 2024-09-21T05:55:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.559+0000 7fc795ab5640 1 -- 172.21.15.7:0/44439023 shutdown_connections 2024-09-21T05:55:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.559+0000 7fc795ab5640 1 --2- 172.21.15.7:0/44439023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc790109e00 0x7fc790110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.559+0000 7fc795ab5640 1 --2- 172.21.15.7:0/44439023 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7901094b0 0x7fc7901098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.559+0000 7fc795ab5640 1 --2- 172.21.15.7:0/44439023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc790103bc0 0x7fc790103fd0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.559+0000 7fc795ab5640 1 -- 172.21.15.7:0/44439023 >> 172.21.15.7:0/44439023 conn(0x7fc79007b910 msgr2=0x7fc79007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.560+0000 7fc795ab5640 1 -- 172.21.15.7:0/44439023 shutdown_connections 2024-09-21T05:55:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.560+0000 7fc795ab5640 1 -- 172.21.15.7:0/44439023 wait complete. 2024-09-21T05:55:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.560+0000 7fc795ab5640 1 Processor -- start 2024-09-21T05:55:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc795ab5640 1 -- start start 2024-09-21T05:55:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc795ab5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc790103bc0 0x7fc790075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc795ab5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7901094b0 0x7fc790075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc795ab5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc790109e00 0x7fc790076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc795ab5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc790113ac0 con 0x7fc7901094b0 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc795ab5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc790113940 con 0x7fc790109e00 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc795ab5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc790113c40 con 0x7fc790103bc0 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc78f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc790103bc0 0x7fc790075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc78effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7901094b0 0x7fc790075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc78f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc790103bc0 0x7fc790075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:51280/0 (socket says 172.21.15.7:51280) 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc78f7fe640 1 -- 172.21.15.7:0/3251120350 learned_addr learned my addr 172.21.15.7:0/3251120350 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc78ffff640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc790109e00 0x7fc790076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc78f7fe640 1 -- 172.21.15.7:0/3251120350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc790109e00 msgr2=0x7fc790076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc790109e00 0x7fc790076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc78f7fe640 1 -- 172.21.15.7:0/3251120350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7901094b0 msgr2=0x7fc790075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7901094b0 0x7fc790075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.561+0000 7fc78f7fe640 1 -- 172.21.15.7:0/3251120350 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7901a87b0 con 0x7fc790103bc0 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.562+0000 7fc78effd640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7901094b0 0x7fc790075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.562+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc790103bc0 0x7fc790075710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc780005940 tx=0x7fc7800040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.562+0000 7fc78cff9640 1 -- 172.21.15.7:0/3251120350 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78003f030 con 0x7fc790103bc0 2024-09-21T05:55:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.562+0000 7fc795ab5640 1 -- 172.21.15.7:0/3251120350 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7901a8a40 con 0x7fc790103bc0 2024-09-21T05:55:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.562+0000 7fc78cff9640 1 -- 172.21.15.7:0/3251120350 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7800044c0 con 0x7fc790103bc0 2024-09-21T05:55:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.562+0000 7fc78cff9640 1 -- 172.21.15.7:0/3251120350 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780035070 con 0x7fc790103bc0 2024-09-21T05:55:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.562+0000 7fc795ab5640 1 -- 172.21.15.7:0/3251120350 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7901a8f70 con 0x7fc790103bc0 2024-09-21T05:55:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.565+0000 7fc79c029740 1 Processor -- start 2024-09-21T05:55:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.565+0000 7fc79c029740 1 -- start start 2024-09-21T05:55:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.565+0000 7fc78cff9640 1 -- 172.21.15.7:0/3251120350 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fc780042030 con 0x7fc790103bc0 2024-09-21T05:55:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc79c029740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a32070 0x561634dd92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc79c029740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 0x561634dd9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc79c029740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 0x561634dd9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc79c029740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561634d4fea0 con 0x561634a32070 2024-09-21T05:55:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc79c029740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561634d3f2d0 con 0x561634a11390 2024-09-21T05:55:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc79c029740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561634d430e0 con 0x561634a091b0 2024-09-21T05:55:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc78f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 0x561634dd9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc78ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a32070 0x561634dd92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc78f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 0x561634dd9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:51292/0 (socket says 172.21.15.7:51292) 2024-09-21T05:55:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc78f7fe640 1 -- 172.21.15.7:0/1965701157 learned_addr learned my addr 172.21.15.7:0/1965701157 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:03.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc78effd640 1 --2- 172.21.15.7:0/1965701157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 0x561634dd9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc78f7fe640 1 -- 172.21.15.7:0/1965701157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 msgr2=0x561634dd9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/1965701157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 0x561634dd9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc78f7fe640 1 -- 172.21.15.7:0/1965701157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a32070 msgr2=0x561634dd92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/1965701157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a32070 0x561634dd92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.566+0000 7fc78f7fe640 1 -- 172.21.15.7:0/1965701157 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561634a9d650 con 0x561634a091b0 2024-09-21T05:55:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.567+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/1965701157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 0x561634dd9800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc7801051b0 tx=0x7fc78010bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ffcd71121268f36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:03.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.567+0000 7fc775ffb640 1 -- 172.21.15.7:0/1965701157 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78011b070 con 0x561634a091b0 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.567+0000 7fc775ffb640 1 -- 172.21.15.7:0/1965701157 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc780114870 con 0x561634a091b0 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.567+0000 7fc775ffb640 1 -- 172.21.15.7:0/1965701157 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780113880 con 0x561634a091b0 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.567+0000 7fc78cff9640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7780b6680 0x7fc7780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.567+0000 7fc78ffff640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7780b6680 0x7fc7780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.567+0000 7fc78cff9640 1 -- 172.21.15.7:0/3251120350 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fc780107a70 con 0x7fc790103bc0 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.568+0000 7fc79c029740 1 -- 172.21.15.7:0/1965701157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 msgr2=0x561634dd9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.568+0000 7fc78ffff640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7780b6680 0x7fc7780b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc788005fd0 tx=0x7fc788009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.568+0000 7fc79c029740 1 --2- 172.21.15.7:0/1965701157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 0x561634dd9800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc7801051b0 tx=0x7fc78010bbb0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.568+0000 7fc79c029740 1 -- 172.21.15.7:0/1965701157 shutdown_connections 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.568+0000 7fc79c029740 1 --2- 172.21.15.7:0/1965701157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 0x561634dd9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.568+0000 7fc79c029740 1 --2- 172.21.15.7:0/1965701157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 0x561634dd9800 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.568+0000 7fc79c029740 1 --2- 172.21.15.7:0/1965701157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a32070 0x561634dd92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.568+0000 7fc79c029740 1 -- 172.21.15.7:0/1965701157 >> 172.21.15.7:0/1965701157 conn(0x561634a26460 msgr2=0x561634dd71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.568+0000 7fc79c029740 1 -- 172.21.15.7:0/1965701157 shutdown_connections 2024-09-21T05:55:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.568+0000 7fc79c029740 1 -- 172.21.15.7:0/1965701157 wait complete. 2024-09-21T05:55:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.568+0000 7fc79c029740 1 -- start start 2024-09-21T05:55:03.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.569+0000 7fc79c029740 1 Processor -- start 2024-09-21T05:55:03.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.569+0000 7fc79c029740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 0x561634de48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.569+0000 7fc79c029740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 0x561634de4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.569+0000 7fc79c029740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a32070 0x561634de53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.569+0000 7fc79c029740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561634ba0700 con 0x561634a32070 2024-09-21T05:55:03.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.569+0000 7fc79c029740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561634cda160 con 0x561634a11390 2024-09-21T05:55:03.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.569+0000 7fc79c029740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561634de7860 con 0x561634a091b0 2024-09-21T05:55:03.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.569+0000 7fc79c029740 10 client.0 _ll_register_callbacks cb 0x561634cf39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.569+0000 7fc78f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 0x561634de48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.569+0000 7fc78effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 0x561634de4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.569+0000 7fc78f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 0x561634de48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:51308/0 (socket says 172.21.15.7:51308) 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.569+0000 7fc78f7fe640 1 -- 172.21.15.7:0/1685554210 learned_addr learned my addr 172.21.15.7:0/1685554210 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.569+0000 7fc78ffff640 1 --2- 172.21.15.7:0/1685554210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a32070 0x561634de53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.570+0000 7fc78f7fe640 1 -- 172.21.15.7:0/1685554210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 msgr2=0x561634de4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.570+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/1685554210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 0x561634de4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.570+0000 7fc78f7fe640 1 -- 172.21.15.7:0/1685554210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a32070 msgr2=0x561634de53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.570+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/1685554210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a32070 0x561634de53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.570+0000 7fc78f7fe640 1 -- 172.21.15.7:0/1685554210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561634d07c90 con 0x561634a091b0 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.570+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/1685554210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 0x561634de48f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7800c9fc0 tx=0x7fc780113360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4635cac1524ead67 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.570+0000 7fc76effd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.570+0000 7fc76effd640 1 -- 172.21.15.7:0/1685554210 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780049070 con 0x561634a091b0 2024-09-21T05:55:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.570+0000 7fc76effd640 1 -- 172.21.15.7:0/1685554210 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fc7800c9c60 con 0x561634a091b0 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.570+0000 7fc79c029740 1 -- 172.21.15.7:0/1685554210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc780114870 con 0x561634a091b0 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.570+0000 7fc76effd640 1 -- 172.21.15.7:0/1685554210 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc7800ca040 con 0x561634a091b0 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.570+0000 7fc79c029740 10 client.25444 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.570+0000 7fc79c029740 1 -- 172.21.15.7:0/1685554210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561634df3470 con 0x561634a091b0 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.571+0000 7fc76effd640 1 -- 172.21.15.7:0/1685554210 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc780114870 con 0x561634a091b0 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.571+0000 7fc76effd640 1 -- 172.21.15.7:0/1685554210 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc7800d2080 con 0x561634a091b0 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.571+0000 7fc79c029740 10 client.25444 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.571+0000 7fc79c029740 10 client.25444 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.571+0000 7fc79c029740 20 client.25444 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.571+0000 7fc79c029740 1 --2- 172.21.15.7:0/1685554210 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5616349f09f0 0x561634df67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.571+0000 7fc79c029740 4 client.25444 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.571+0000 7fc79c029740 1 -- 172.21.15.7:0/1685554210 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561634d51df0 con 0x5616349f09f0 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.571+0000 7fc78effd640 1 --2- 172.21.15.7:0/1685554210 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5616349f09f0 0x561634df67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.572+0000 7fc76effd640 10 client.25444 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:55:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.572+0000 7fc78effd640 1 --2- 172.21.15.7:0/1685554210 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5616349f09f0 0x561634df67d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19e8ce4e1ede2a6c server_cookie=d7b96b7e3d9e3bd6 in_seq=0 out_seq=0 2024-09-21T05:55:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc76effd640 1 -- 172.21.15.7:0/1685554210 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561634d51df0 con 0x5616349f09f0 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc76effd640 10 client.25444 handle_command_reply: tid=0 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc79c029740 1 client.25444 shutdown 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc79c029740 1 -- 172.21.15.7:0/1685554210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 msgr2=0x561634de48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc79c029740 1 --2- 172.21.15.7:0/1685554210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 0x561634de48f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7800c9fc0 tx=0x7fc780113360 comp rx=0 tx=0).stop 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc79c029740 1 -- 172.21.15.7:0/1685554210 shutdown_connections 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc79c029740 1 --2- 172.21.15.7:0/1685554210 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5616349f09f0 0x561634df67d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc79c029740 1 --2- 172.21.15.7:0/1685554210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a32070 0x561634de53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc76effd640 0 client.25444 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc79c029740 1 --2- 172.21.15.7:0/1685554210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 0x561634de4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc79c029740 1 --2- 172.21.15.7:0/1685554210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a091b0 0x561634de48f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc79c029740 1 -- 172.21.15.7:0/1685554210 >> 172.21.15.7:0/1685554210 conn(0x561634a26460 msgr2=0x561634ddc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc79c029740 1 -- 172.21.15.7:0/1685554210 shutdown_connections 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc79c029740 1 -- 172.21.15.7:0/1685554210 wait complete. 2024-09-21T05:55:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.573+0000 7fc79c029740 20 client.25444 trim_cache size 0 max 16384 2024-09-21T05:55:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.588+0000 7fc79c029740 1 Processor -- start 2024-09-21T05:55:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.588+0000 7fc79c029740 1 -- start start 2024-09-21T05:55:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.588+0000 7fc79c029740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 0x561634de6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.588+0000 7fc79c029740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a11390 0x561634dd6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.588+0000 7fc79c029740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a32070 0x561634dd6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc79c029740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc7901afca0 con 0x561634a091b0 2024-09-21T05:55:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc79c029740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc7901ad570 con 0x561634a32070 2024-09-21T05:55:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc79c029740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc7901ab3c0 con 0x561634a11390 2024-09-21T05:55:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc78f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 0x561634de6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc78f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 0x561634de6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52706/0 (socket says 172.21.15.7:52706) 2024-09-21T05:55:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc78ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a32070 0x561634dd6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc78f7fe640 1 -- 172.21.15.7:0/790685179 learned_addr learned my addr 172.21.15.7:0/790685179 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc78effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a11390 0x561634dd6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc78f7fe640 1 -- 172.21.15.7:0/790685179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a11390 msgr2=0x561634dd6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/790685179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a11390 0x561634dd6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc78f7fe640 1 -- 172.21.15.7:0/790685179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a32070 msgr2=0x561634dd6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/790685179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a32070 0x561634dd6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc78f7fe640 1 -- 172.21.15.7:0/790685179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561634ddb5b0 con 0x561634a091b0 2024-09-21T05:55:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc78effd640 1 --2- 172.21.15.7:0/790685179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a11390 0x561634dd6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc78ffff640 1 --2- 172.21.15.7:0/790685179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a32070 0x561634dd6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.589+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/790685179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 0x561634de6520 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc780006010 tx=0x7fc78010bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca1fd350b67ac1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.590+0000 7fc7757fa640 1 -- 172.21.15.7:0/790685179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780049020 con 0x561634a091b0 2024-09-21T05:55:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.590+0000 7fc7757fa640 1 -- 172.21.15.7:0/790685179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7800d20b0 con 0x561634a091b0 2024-09-21T05:55:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.590+0000 7fc7757fa640 1 -- 172.21.15.7:0/790685179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7800c9160 con 0x561634a091b0 2024-09-21T05:55:03.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.591+0000 7fc79c029740 1 -- 172.21.15.7:0/790685179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 msgr2=0x561634de6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.591+0000 7fc79c029740 1 --2- 172.21.15.7:0/790685179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 0x561634de6520 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc780006010 tx=0x7fc78010bbb0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.591+0000 7fc79c029740 1 -- 172.21.15.7:0/790685179 shutdown_connections 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.591+0000 7fc79c029740 1 --2- 172.21.15.7:0/790685179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a32070 0x561634dd6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.591+0000 7fc79c029740 1 --2- 172.21.15.7:0/790685179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a11390 0x561634dd6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.591+0000 7fc79c029740 1 --2- 172.21.15.7:0/790685179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 0x561634de6520 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.591+0000 7fc79c029740 1 -- 172.21.15.7:0/790685179 >> 172.21.15.7:0/790685179 conn(0x561634a26460 msgr2=0x561634de5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.591+0000 7fc79c029740 1 -- 172.21.15.7:0/790685179 shutdown_connections 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.591+0000 7fc79c029740 1 -- 172.21.15.7:0/790685179 wait complete. 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.591+0000 7fc79c029740 1 -- start start 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.591+0000 7fc79c029740 1 Processor -- start 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc79c029740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 0x561634de8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc79c029740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 0x561634de90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc79c029740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a32070 0x561634de95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc79c029740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc7901aba30 con 0x561634a091b0 2024-09-21T05:55:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc79c029740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc7901acea0 con 0x561634a11390 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc79c029740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc7901ac100 con 0x561634a32070 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc79c029740 10 client.0 _ll_register_callbacks cb 0x7fc780119070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc78f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 0x561634de8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc78f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 0x561634de8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52712/0 (socket says 172.21.15.7:52712) 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc78f7fe640 1 -- 172.21.15.7:0/2456496386 learned_addr learned my addr 172.21.15.7:0/2456496386 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc78effd640 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 0x561634de90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc78ffff640 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a32070 0x561634de95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc78f7fe640 1 -- 172.21.15.7:0/2456496386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a32070 msgr2=0x561634de95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a32070 0x561634de95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc78f7fe640 1 -- 172.21.15.7:0/2456496386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 msgr2=0x561634de90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 0x561634de90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc78f7fe640 1 -- 172.21.15.7:0/2456496386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561634e601b0 con 0x561634a091b0 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc78ffff640 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a32070 0x561634de95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.592+0000 7fc78effd640 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 0x561634de90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc78f7fe640 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 0x561634de8b70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc780032af0 tx=0x7fc78003b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a33578238b7fda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc76effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc76effd640 1 -- 172.21.15.7:0/2456496386 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780049050 con 0x561634a091b0 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc76effd640 1 -- 172.21.15.7:0/2456496386 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fc7800d70e0 con 0x561634a091b0 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc79c029740 1 -- 172.21.15.7:0/2456496386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7800d20b0 con 0x561634a091b0 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc76effd640 1 -- 172.21.15.7:0/2456496386 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc7800cd160 con 0x561634a091b0 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc79c029740 10 client.15798 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc79c029740 1 -- 172.21.15.7:0/2456496386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561634e601b0 con 0x561634a091b0 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc76effd640 1 -- 172.21.15.7:0/2456496386 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7800d20b0 con 0x561634a091b0 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc76effd640 1 -- 172.21.15.7:0/2456496386 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc7800c9340 con 0x561634a091b0 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc79c029740 10 client.15798 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc79c029740 10 client.15798 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc79c029740 20 client.15798 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc79c029740 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5616349c5da0 0x561634e637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc79c029740 4 client.15798 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.593+0000 7fc79c029740 1 -- 172.21.15.7:0/2456496386 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561634d4d8a0 con 0x5616349c5da0 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.594+0000 7fc78effd640 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5616349c5da0 0x561634e637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.594+0000 7fc76effd640 10 client.15798 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.594+0000 7fc78effd640 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5616349c5da0 0x561634e637c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=366523d17a914a27 server_cookie=3e699b80151a77f7 in_seq=0 out_seq=0 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.594+0000 7fc76effd640 1 -- 172.21.15.7:0/2456496386 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561634d4d8a0 con 0x5616349c5da0 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.594+0000 7fc76effd640 10 client.15798 handle_command_reply: tid=0 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.594+0000 7fc79c029740 1 client.15798 shutdown 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.595+0000 7fc79c029740 1 -- 172.21.15.7:0/2456496386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 msgr2=0x561634de8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.595+0000 7fc79c029740 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 0x561634de8b70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc780032af0 tx=0x7fc78003b460 comp rx=0 tx=0).stop 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.595+0000 7fc79c029740 1 -- 172.21.15.7:0/2456496386 shutdown_connections 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.595+0000 7fc79c029740 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5616349c5da0 0x561634e637c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.595+0000 7fc76effd640 0 client.15798 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.595+0000 7fc79c029740 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561634a32070 0x561634de95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.595+0000 7fc79c029740 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561634a11390 0x561634de90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.595+0000 7fc79c029740 1 --2- 172.21.15.7:0/2456496386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561634a091b0 0x561634de8b70 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.595+0000 7fc79c029740 1 -- 172.21.15.7:0/2456496386 >> 172.21.15.7:0/2456496386 conn(0x561634a26460 msgr2=0x561634de5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:03.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.595+0000 7fc79c029740 1 -- 172.21.15.7:0/2456496386 shutdown_connections 2024-09-21T05:55:03.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.595+0000 7fc79c029740 1 -- 172.21.15.7:0/2456496386 wait complete. 2024-09-21T05:55:03.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.596+0000 7fc79c029740 20 client.15798 trim_cache size 0 max 16384 2024-09-21T05:55:03.603 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:55:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.596+0000 7fc795ab5640 1 -- 172.21.15.7:0/3251120350 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7780b6680 msgr2=0x7fc7780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.596+0000 7fc795ab5640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7780b6680 0x7fc7780b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc788005fd0 tx=0x7fc788009500 comp rx=0 tx=0).stop 2024-09-21T05:55:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.596+0000 7fc795ab5640 1 -- 172.21.15.7:0/3251120350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc790103bc0 msgr2=0x7fc790075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.596+0000 7fc795ab5640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc790103bc0 0x7fc790075710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc780005940 tx=0x7fc7800040c0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.597+0000 7fc795ab5640 1 -- 172.21.15.7:0/3251120350 shutdown_connections 2024-09-21T05:55:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.597+0000 7fc795ab5640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc7780b6680 0x7fc7780b8b90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.597+0000 7fc795ab5640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7901094b0 0x7fc790075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.597+0000 7fc795ab5640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc790109e00 0x7fc790076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.597+0000 7fc795ab5640 1 --2- 172.21.15.7:0/3251120350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc790103bc0 0x7fc790075710 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.597+0000 7fc795ab5640 1 -- 172.21.15.7:0/3251120350 >> 172.21.15.7:0/3251120350 conn(0x7fc79007b910 msgr2=0x7fc7901075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.597+0000 7fc795ab5640 1 -- 172.21.15.7:0/3251120350 shutdown_connections 2024-09-21T05:55:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:03.597+0000 7fc795ab5640 1 -- 172.21.15.7:0/3251120350 wait complete. 2024-09-21T05:55:03.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:03 smithi027 ceph-mon[34364]: pgmap v353: 97 pgs: 97 active+clean; 19 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 880 KiB/s wr, 15 op/s 2024-09-21T05:55:03.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:03 smithi119 ceph-mon[34833]: pgmap v353: 97 pgs: 97 active+clean; 19 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 880 KiB/s wr, 15 op/s 2024-09-21T05:55:04.380 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T05:55:04.672 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.183+0000 7fc221d7e640 1 -- 172.21.15.7:0/2510920528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc21c105300 msgr2=0x7fc21c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.183+0000 7fc221d7e640 1 --2- 172.21.15.7:0/2510920528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc21c105300 0x7fc21c10d850 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc210009900 tx=0x7fc21002a410 comp rx=0 tx=0).stop 2024-09-21T05:55:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.183+0000 7fc221d7e640 1 -- 172.21.15.7:0/2510920528 shutdown_connections 2024-09-21T05:55:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.184+0000 7fc221d7e640 1 --2- 172.21.15.7:0/2510920528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc21c105300 0x7fc21c10d850 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.184+0000 7fc221d7e640 1 --2- 172.21.15.7:0/2510920528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc21c10de10 0x7fc21c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.184+0000 7fc221d7e640 1 --2- 172.21.15.7:0/2510920528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc21c1049b0 0x7fc21c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.184+0000 7fc221d7e640 1 -- 172.21.15.7:0/2510920528 >> 172.21.15.7:0/2510920528 conn(0x7fc21c079730 msgr2=0x7fc21c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.184+0000 7fc221d7e640 1 -- 172.21.15.7:0/2510920528 shutdown_connections 2024-09-21T05:55:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.184+0000 7fc221d7e640 1 -- 172.21.15.7:0/2510920528 wait complete. 2024-09-21T05:55:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.184+0000 7fc221d7e640 1 Processor -- start 2024-09-21T05:55:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.184+0000 7fc221d7e640 1 -- start start 2024-09-21T05:55:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc221d7e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc21c1049b0 0x7fc21c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc221d7e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc21c105300 0x7fc21c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc221d7e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc21c10de10 0x7fc21c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc221d7e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c113a70 con 0x7fc21c10de10 2024-09-21T05:55:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc221d7e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1138f0 con 0x7fc21c1049b0 2024-09-21T05:55:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc221d7e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c113bf0 con 0x7fc21c105300 2024-09-21T05:55:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc21bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc21c10de10 0x7fc21c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc21c1049b0 0x7fc21c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc21bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc21c10de10 0x7fc21c19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52726/0 (socket says 172.21.15.7:52726) 2024-09-21T05:55:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc21affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc21c105300 0x7fc21c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc21bfff640 1 -- 172.21.15.7:0/2644589861 learned_addr learned my addr 172.21.15.7:0/2644589861 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc21b7fe640 1 -- 172.21.15.7:0/2644589861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc21c105300 msgr2=0x7fc21c19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc21b7fe640 1 --2- 172.21.15.7:0/2644589861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc21c105300 0x7fc21c19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc21b7fe640 1 -- 172.21.15.7:0/2644589861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc21c10de10 msgr2=0x7fc21c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc21b7fe640 1 --2- 172.21.15.7:0/2644589861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc21c10de10 0x7fc21c19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc21b7fe640 1 -- 172.21.15.7:0/2644589861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c1a0470 con 0x7fc21c1049b0 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.185+0000 7fc21affd640 1 --2- 172.21.15.7:0/2644589861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc21c105300 0x7fc21c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.186+0000 7fc21b7fe640 1 --2- 172.21.15.7:0/2644589861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc21c1049b0 0x7fc21c19a500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00e9c0 tx=0x7fc20c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.186+0000 7fc218ff9640 1 -- 172.21.15.7:0/2644589861 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00ccc0 con 0x7fc21c1049b0 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.186+0000 7fc221d7e640 1 -- 172.21.15.7:0/2644589861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21c1a0760 con 0x7fc21c1049b0 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.186+0000 7fc218ff9640 1 -- 172.21.15.7:0/2644589861 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc20c0035f0 con 0x7fc21c1049b0 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.186+0000 7fc218ff9640 1 -- 172.21.15.7:0/2644589861 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00ce60 con 0x7fc21c1049b0 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.186+0000 7fc221d7e640 1 -- 172.21.15.7:0/2644589861 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21c1025d0 con 0x7fc21c1049b0 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.188+0000 7fc2282f2740 1 Processor -- start 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.188+0000 7fc2282f2740 1 -- start start 2024-09-21T05:55:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.188+0000 7fc218ff9640 1 -- 172.21.15.7:0/2644589861 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fc20c004000 con 0x7fc21c1049b0 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc2282f2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd76f070 0x555dddb162c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc2282f2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd7461b0 0x555dddb16800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc2282f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 0x555dddb16d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc2282f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555ddda8cea0 con 0x555ddd74e390 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc2282f2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555ddda7c2d0 con 0x555ddd76f070 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc2282f2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555ddda800e0 con 0x555ddd7461b0 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc21affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 0x555dddb16d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc21bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd76f070 0x555dddb162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc21affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 0x555dddb16d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52734/0 (socket says 172.21.15.7:52734) 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc21bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd76f070 0x555dddb162c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:48180/0 (socket says 172.21.15.7:48180) 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc21affd640 1 -- 172.21.15.7:0/1956639681 learned_addr learned my addr 172.21.15.7:0/1956639681 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc21b7fe640 1 --2- 172.21.15.7:0/1956639681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd7461b0 0x555dddb16800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc21affd640 1 -- 172.21.15.7:0/1956639681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd7461b0 msgr2=0x555dddb16800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc21affd640 1 --2- 172.21.15.7:0/1956639681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd7461b0 0x555dddb16800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc21affd640 1 -- 172.21.15.7:0/1956639681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd76f070 msgr2=0x555dddb162c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc21affd640 1 --2- 172.21.15.7:0/1956639681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd76f070 0x555dddb162c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc21affd640 1 -- 172.21.15.7:0/1956639681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ddd7da650 con 0x555ddd74e390 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc21bfff640 1 --2- 172.21.15.7:0/1956639681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd76f070 0x555dddb162c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.189+0000 7fc21affd640 1 --2- 172.21.15.7:0/1956639681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 0x555dddb16d40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc21c06ad30 tx=0x7fc210005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e2a64af69edc12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.190+0000 7fc201ffb640 1 -- 172.21.15.7:0/1956639681 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210035050 con 0x555ddd74e390 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.190+0000 7fc218ff9640 1 --2- 172.21.15.7:0/2644589861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc2040b6680 0x7fc2040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.190+0000 7fc201ffb640 1 -- 172.21.15.7:0/1956639681 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2100316a0 con 0x555ddd74e390 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.190+0000 7fc201ffb640 1 -- 172.21.15.7:0/1956639681 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210004770 con 0x555ddd74e390 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.190+0000 7fc21bfff640 1 --2- 172.21.15.7:0/2644589861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc2040b6680 0x7fc2040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.190+0000 7fc218ff9640 1 -- 172.21.15.7:0/2644589861 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fc20c0e7b10 con 0x7fc21c1049b0 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.191+0000 7fc2282f2740 1 -- 172.21.15.7:0/1956639681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 msgr2=0x555dddb16d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.191+0000 7fc21bfff640 1 --2- 172.21.15.7:0/2644589861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc2040b6680 0x7fc2040b8b90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc2140049d0 tx=0x7fc214009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.191+0000 7fc2282f2740 1 --2- 172.21.15.7:0/1956639681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 0x555dddb16d40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc21c06ad30 tx=0x7fc210005d90 comp rx=0 tx=0).stop 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.191+0000 7fc2282f2740 1 -- 172.21.15.7:0/1956639681 shutdown_connections 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.191+0000 7fc2282f2740 1 --2- 172.21.15.7:0/1956639681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 0x555dddb16d40 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.191+0000 7fc2282f2740 1 --2- 172.21.15.7:0/1956639681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd7461b0 0x555dddb16800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.191+0000 7fc2282f2740 1 --2- 172.21.15.7:0/1956639681 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd76f070 0x555dddb162c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.191+0000 7fc2282f2740 1 -- 172.21.15.7:0/1956639681 >> 172.21.15.7:0/1956639681 conn(0x555ddd763460 msgr2=0x555dddb141b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.191+0000 7fc2282f2740 1 -- 172.21.15.7:0/1956639681 shutdown_connections 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.191+0000 7fc2282f2740 1 -- 172.21.15.7:0/1956639681 wait complete. 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.191+0000 7fc2282f2740 1 -- start start 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.191+0000 7fc2282f2740 1 Processor -- start 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc2282f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd7461b0 0x555dddb21950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc2282f2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd74e390 0x555dddb21e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc2282f2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd76f070 0x555dddb2dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc2282f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555ddd8dd700 con 0x555ddd7461b0 2024-09-21T05:55:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc2282f2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555ddda17160 con 0x555ddd74e390 2024-09-21T05:55:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc2282f2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555dddb24a40 con 0x555ddd76f070 2024-09-21T05:55:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc2282f2740 10 client.0 _ll_register_callbacks cb 0x555ddda309e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd7461b0 0x555dddb21950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd7461b0 0x555dddb21950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52740/0 (socket says 172.21.15.7:52740) 2024-09-21T05:55:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc21b7fe640 1 -- 172.21.15.7:0/54844190 learned_addr learned my addr 172.21.15.7:0/54844190 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc21affd640 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd74e390 0x555dddb21e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc21bfff640 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd76f070 0x555dddb2dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc21b7fe640 1 -- 172.21.15.7:0/54844190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd76f070 msgr2=0x555dddb2dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc21b7fe640 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd76f070 0x555dddb2dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc21b7fe640 1 -- 172.21.15.7:0/54844190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd74e390 msgr2=0x555dddb21e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc21b7fe640 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd74e390 0x555dddb21e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc21b7fe640 1 -- 172.21.15.7:0/54844190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ddda44c90 con 0x555ddd7461b0 2024-09-21T05:55:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc21bfff640 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd76f070 0x555dddb2dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc21b7fe640 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd7461b0 0x555dddb21950 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc20c003fd0 tx=0x7fc20c0ad830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7fdd98cb5dd5b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.192+0000 7fc1faffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc1faffd640 1 -- 172.21.15.7:0/54844190 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0ec040 con 0x555ddd7461b0 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc1faffd640 1 -- 172.21.15.7:0/54844190 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fc20c0b2190 con 0x555ddd7461b0 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc2282f2740 1 -- 172.21.15.7:0/54844190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2100316a0 con 0x555ddd7461b0 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc1faffd640 1 -- 172.21.15.7:0/54844190 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc20c0ad150 con 0x555ddd7461b0 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc2282f2740 10 client.15810 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc2282f2740 1 -- 172.21.15.7:0/54844190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555dddb30780 con 0x555ddd7461b0 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc1faffd640 1 -- 172.21.15.7:0/54844190 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2100316a0 con 0x555ddd7461b0 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc1faffd640 1 -- 172.21.15.7:0/54844190 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc20c0ac6b0 con 0x555ddd7461b0 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc2282f2740 10 client.15810 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc2282f2740 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc2282f2740 20 client.15810 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc2282f2740 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555ddd72d9f0 0x555dddb33c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc2282f2740 4 client.15810 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.193+0000 7fc2282f2740 1 -- 172.21.15.7:0/54844190 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ddda8edf0 con 0x555ddd72d9f0 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.194+0000 7fc21affd640 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555ddd72d9f0 0x555dddb33c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.194+0000 7fc1faffd640 10 client.15810 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.194+0000 7fc21affd640 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555ddd72d9f0 0x555dddb33c90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f269e799c4248b4f server_cookie=83e032a9d8bf3e4 in_seq=0 out_seq=0 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc1faffd640 1 -- 172.21.15.7:0/54844190 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555ddda8edf0 con 0x555ddd72d9f0 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc1faffd640 10 client.15810 handle_command_reply: tid=0 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc2282f2740 1 client.15810 shutdown 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc2282f2740 1 -- 172.21.15.7:0/54844190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd7461b0 msgr2=0x555dddb21950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc2282f2740 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd7461b0 0x555dddb21950 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc20c003fd0 tx=0x7fc20c0ad830 comp rx=0 tx=0).stop 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc2282f2740 1 -- 172.21.15.7:0/54844190 shutdown_connections 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc2282f2740 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555ddd72d9f0 0x555dddb33c90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc1faffd640 0 client.15810 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:05.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc2282f2740 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd76f070 0x555dddb2dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc2282f2740 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd74e390 0x555dddb21e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc2282f2740 1 --2- 172.21.15.7:0/54844190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd7461b0 0x555dddb21950 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc2282f2740 1 -- 172.21.15.7:0/54844190 >> 172.21.15.7:0/54844190 conn(0x555ddd763460 msgr2=0x555dddb194a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc2282f2740 1 -- 172.21.15.7:0/54844190 shutdown_connections 2024-09-21T05:55:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc2282f2740 1 -- 172.21.15.7:0/54844190 wait complete. 2024-09-21T05:55:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.195+0000 7fc2282f2740 20 client.15810 trim_cache size 0 max 16384 2024-09-21T05:55:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.208+0000 7fc2282f2740 1 Processor -- start 2024-09-21T05:55:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.208+0000 7fc2282f2740 1 -- start start 2024-09-21T05:55:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc2282f2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd72d9f0 0x555dddb21e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc2282f2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd7461b0 0x555dddb2dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc2282f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 0x555dddb1eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc2282f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1afbe0 con 0x555ddd74e390 2024-09-21T05:55:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc2282f2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1ad4b0 con 0x555ddd7461b0 2024-09-21T05:55:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc2282f2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1ab320 con 0x555ddd72d9f0 2024-09-21T05:55:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc21bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 0x555dddb1eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc21bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 0x555dddb1eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52752/0 (socket says 172.21.15.7:52752) 2024-09-21T05:55:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc21bfff640 1 -- 172.21.15.7:0/2790488357 learned_addr learned my addr 172.21.15.7:0/2790488357 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc21b7fe640 1 --2- 172.21.15.7:0/2790488357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd72d9f0 0x555dddb21e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc21affd640 1 --2- 172.21.15.7:0/2790488357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd7461b0 0x555dddb2dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc21bfff640 1 -- 172.21.15.7:0/2790488357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd72d9f0 msgr2=0x555dddb21e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc21bfff640 1 --2- 172.21.15.7:0/2790488357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd72d9f0 0x555dddb21e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc21bfff640 1 -- 172.21.15.7:0/2790488357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd7461b0 msgr2=0x555dddb2dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc21bfff640 1 --2- 172.21.15.7:0/2790488357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd7461b0 0x555dddb2dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc21bfff640 1 -- 172.21.15.7:0/2790488357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dddb0e440 con 0x555ddd74e390 2024-09-21T05:55:05.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc21affd640 1 --2- 172.21.15.7:0/2790488357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd7461b0 0x555dddb2dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.209+0000 7fc21bfff640 1 --2- 172.21.15.7:0/2790488357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 0x555dddb1eb40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc21400fa70 tx=0x7fc21401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bcc39e82ae0ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.210+0000 7fc2017fa640 1 -- 172.21.15.7:0/2790488357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214011a80 con 0x555ddd74e390 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.210+0000 7fc2017fa640 1 -- 172.21.15.7:0/2790488357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc214011c20 con 0x555ddd74e390 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.210+0000 7fc2017fa640 1 -- 172.21.15.7:0/2790488357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21401d650 con 0x555ddd74e390 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.210+0000 7fc2282f2740 1 -- 172.21.15.7:0/2790488357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 msgr2=0x555dddb1eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.210+0000 7fc2282f2740 1 --2- 172.21.15.7:0/2790488357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 0x555dddb1eb40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc21400fa70 tx=0x7fc21401a000 comp rx=0 tx=0).stop 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.210+0000 7fc2282f2740 1 -- 172.21.15.7:0/2790488357 shutdown_connections 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.210+0000 7fc2282f2740 1 --2- 172.21.15.7:0/2790488357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd74e390 0x555dddb1eb40 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.210+0000 7fc2282f2740 1 --2- 172.21.15.7:0/2790488357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd7461b0 0x555dddb2dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.210+0000 7fc2282f2740 1 --2- 172.21.15.7:0/2790488357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd72d9f0 0x555dddb21e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.210+0000 7fc2282f2740 1 -- 172.21.15.7:0/2790488357 >> 172.21.15.7:0/2790488357 conn(0x555ddd763460 msgr2=0x555dddb21700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.210+0000 7fc2282f2740 1 -- 172.21.15.7:0/2790488357 shutdown_connections 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.210+0000 7fc2282f2740 1 -- 172.21.15.7:0/2790488357 wait complete. 2024-09-21T05:55:05.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.211+0000 7fc2282f2740 1 -- start start 2024-09-21T05:55:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.211+0000 7fc2282f2740 1 Processor -- start 2024-09-21T05:55:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.211+0000 7fc2282f2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd72d9f0 0x555dddb2a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.211+0000 7fc2282f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd7461b0 0x555dddb25b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.211+0000 7fc2282f2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd74e390 0x555dddb26210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.211+0000 7fc2282f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1ab970 con 0x555ddd7461b0 2024-09-21T05:55:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.211+0000 7fc2282f2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1acde0 con 0x555ddd72d9f0 2024-09-21T05:55:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.211+0000 7fc2282f2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1ac040 con 0x555ddd74e390 2024-09-21T05:55:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.211+0000 7fc2282f2740 10 client.0 _ll_register_callbacks cb 0x7fc20c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.211+0000 7fc21affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd7461b0 0x555dddb25b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd72d9f0 0x555dddb2a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc21affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd7461b0 0x555dddb25b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52768/0 (socket says 172.21.15.7:52768) 2024-09-21T05:55:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd72d9f0 0x555dddb2a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:48214/0 (socket says 172.21.15.7:48214) 2024-09-21T05:55:05.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc21affd640 1 -- 172.21.15.7:0/59337830 learned_addr learned my addr 172.21.15.7:0/59337830 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:05.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc21bfff640 1 --2- 172.21.15.7:0/59337830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd74e390 0x555dddb26210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc21b7fe640 1 -- 172.21.15.7:0/59337830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd74e390 msgr2=0x555dddb26210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:05.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc21b7fe640 1 --2- 172.21.15.7:0/59337830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd74e390 0x555dddb26210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc21b7fe640 1 -- 172.21.15.7:0/59337830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd7461b0 msgr2=0x555dddb25b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:05.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc21b7fe640 1 --2- 172.21.15.7:0/59337830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd7461b0 0x555dddb25b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc21b7fe640 1 -- 172.21.15.7:0/59337830 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dddb9d620 con 0x555ddd72d9f0 2024-09-21T05:55:05.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc21bfff640 1 --2- 172.21.15.7:0/59337830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd74e390 0x555dddb26210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:05.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc21b7fe640 1 --2- 172.21.15.7:0/59337830 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd72d9f0 0x555dddb2a620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0a9fb0 tx=0x7fc20c0ad010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31b40400fc166192 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:05.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc1faffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:55:05.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc1faffd640 1 -- 172.21.15.7:0/59337830 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0a9150 con 0x555ddd72d9f0 2024-09-21T05:55:05.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc1faffd640 1 -- 172.21.15.7:0/59337830 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fc20c0c3b90 con 0x555ddd72d9f0 2024-09-21T05:55:05.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc2282f2740 1 -- 172.21.15.7:0/59337830 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc214011c20 con 0x555ddd72d9f0 2024-09-21T05:55:05.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc1faffd640 1 -- 172.21.15.7:0/59337830 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc20c0ad4f0 con 0x555ddd72d9f0 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc2282f2740 10 client.25508 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.212+0000 7fc2282f2740 1 -- 172.21.15.7:0/59337830 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555dddb9e710 con 0x555ddd72d9f0 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.213+0000 7fc1faffd640 1 -- 172.21.15.7:0/59337830 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc214011c20 con 0x555ddd72d9f0 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.213+0000 7fc1faffd640 1 -- 172.21.15.7:0/59337830 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc20c0b3650 con 0x555ddd72d9f0 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.213+0000 7fc2282f2740 10 client.25508 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.213+0000 7fc2282f2740 10 client.25508 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.213+0000 7fc2282f2740 20 client.25508 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.213+0000 7fc2282f2740 1 --2- 172.21.15.7:0/59337830 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555ddd76f070 0x555dddba0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.213+0000 7fc2282f2740 4 client.25508 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.213+0000 7fc2282f2740 1 -- 172.21.15.7:0/59337830 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555ddda8a8a0 con 0x555ddd76f070 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.213+0000 7fc21affd640 1 --2- 172.21.15.7:0/59337830 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555ddd76f070 0x555dddba0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc21affd640 1 --2- 172.21.15.7:0/59337830 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555ddd76f070 0x555dddba0c50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26cbed94118613e0 server_cookie=90a8e998405eef83 in_seq=0 out_seq=0 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc1faffd640 10 client.25508 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:05.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc1faffd640 1 -- 172.21.15.7:0/59337830 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555ddda8a8a0 con 0x555ddd76f070 2024-09-21T05:55:05.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc1faffd640 10 client.25508 handle_command_reply: tid=0 2024-09-21T05:55:05.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc2282f2740 1 client.25508 shutdown 2024-09-21T05:55:05.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc2282f2740 1 -- 172.21.15.7:0/59337830 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd72d9f0 msgr2=0x555dddb2a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:05.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc2282f2740 1 --2- 172.21.15.7:0/59337830 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd72d9f0 0x555dddb2a620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0a9fb0 tx=0x7fc20c0ad010 comp rx=0 tx=0).stop 2024-09-21T05:55:05.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc2282f2740 1 -- 172.21.15.7:0/59337830 shutdown_connections 2024-09-21T05:55:05.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc2282f2740 1 --2- 172.21.15.7:0/59337830 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555ddd76f070 0x555dddba0c50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc2282f2740 1 --2- 172.21.15.7:0/59337830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555ddd7461b0 0x555dddb25b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.280 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:55:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc2282f2740 1 --2- 172.21.15.7:0/59337830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555ddd74e390 0x555dddb26210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc2282f2740 1 --2- 172.21.15.7:0/59337830 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555ddd72d9f0 0x555dddb2a620 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc2282f2740 1 -- 172.21.15.7:0/59337830 >> 172.21.15.7:0/59337830 conn(0x555ddd763460 msgr2=0x555dddb172f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc1faffd640 0 client.25508 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc2282f2740 1 -- 172.21.15.7:0/59337830 shutdown_connections 2024-09-21T05:55:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc2282f2740 1 -- 172.21.15.7:0/59337830 wait complete. 2024-09-21T05:55:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.214+0000 7fc2282f2740 20 client.25508 trim_cache size 0 max 16384 2024-09-21T05:55:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.215+0000 7fc221d7e640 1 -- 172.21.15.7:0/2644589861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc2040b6680 msgr2=0x7fc2040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.215+0000 7fc221d7e640 1 --2- 172.21.15.7:0/2644589861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc2040b6680 0x7fc2040b8b90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc2140049d0 tx=0x7fc214009500 comp rx=0 tx=0).stop 2024-09-21T05:55:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.215+0000 7fc221d7e640 1 -- 172.21.15.7:0/2644589861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc21c1049b0 msgr2=0x7fc21c19a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.215+0000 7fc221d7e640 1 --2- 172.21.15.7:0/2644589861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc21c1049b0 0x7fc21c19a500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00e9c0 tx=0x7fc20c00ee80 comp rx=0 tx=0).stop 2024-09-21T05:55:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.215+0000 7fc221d7e640 1 -- 172.21.15.7:0/2644589861 shutdown_connections 2024-09-21T05:55:05.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.215+0000 7fc221d7e640 1 --2- 172.21.15.7:0/2644589861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc2040b6680 0x7fc2040b8b90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.215+0000 7fc221d7e640 1 --2- 172.21.15.7:0/2644589861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc21c10de10 0x7fc21c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.215+0000 7fc221d7e640 1 --2- 172.21.15.7:0/2644589861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc21c105300 0x7fc21c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.215+0000 7fc221d7e640 1 --2- 172.21.15.7:0/2644589861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc21c1049b0 0x7fc21c19a500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:05.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.215+0000 7fc221d7e640 1 -- 172.21.15.7:0/2644589861 >> 172.21.15.7:0/2644589861 conn(0x7fc21c079730 msgr2=0x7fc21c0ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:05.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.215+0000 7fc221d7e640 1 -- 172.21.15.7:0/2644589861 shutdown_connections 2024-09-21T05:55:05.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:05.215+0000 7fc221d7e640 1 -- 172.21.15.7:0/2644589861 wait complete. 2024-09-21T05:55:05.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:05 smithi119 ceph-mon[34833]: pgmap v354: 97 pgs: 97 active+clean; 161 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-09-21T05:55:05.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:05 smithi027 ceph-mon[34364]: pgmap v354: 97 pgs: 97 active+clean; 161 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-09-21T05:55:06.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:05 smithi007 ceph-mon[30983]: pgmap v354: 97 pgs: 97 active+clean; 161 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-09-21T05:55:07.139 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T05:55:07.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T05:55:07.428 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:07.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:07 smithi007 ceph-mon[30983]: pgmap v355: 97 pgs: 97 active+clean; 253 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.8 MiB/s wr, 257 op/s 2024-09-21T05:55:07.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:07 smithi119 ceph-mon[34833]: pgmap v355: 97 pgs: 97 active+clean; 253 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.8 MiB/s wr, 257 op/s 2024-09-21T05:55:07.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:07 smithi027 ceph-mon[34364]: pgmap v355: 97 pgs: 97 active+clean; 253 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.8 MiB/s wr, 257 op/s 2024-09-21T05:55:07.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.976+0000 7f6cdf7b1640 1 -- 172.21.15.7:0/3035815787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd8103b60 msgr2=0x7f6cd8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:07.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.976+0000 7f6cdf7b1640 1 --2- 172.21.15.7:0/3035815787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd8103b60 0x7f6cd8103f70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009900 tx=0x7f6cd402a410 comp rx=0 tx=0).stop 2024-09-21T05:55:07.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.976+0000 7f6cdf7b1640 1 -- 172.21.15.7:0/3035815787 shutdown_connections 2024-09-21T05:55:07.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.976+0000 7f6cdf7b1640 1 --2- 172.21.15.7:0/3035815787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cd8109df0 0x7f6cd8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.976+0000 7f6cdf7b1640 1 --2- 172.21.15.7:0/3035815787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cd81094a0 0x7f6cd81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.976+0000 7f6cdf7b1640 1 --2- 172.21.15.7:0/3035815787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd8103b60 0x7f6cd8103f70 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.976+0000 7f6cdf7b1640 1 -- 172.21.15.7:0/3035815787 >> 172.21.15.7:0/3035815787 conn(0x7f6cd807b850 msgr2=0x7f6cd807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:07.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.976+0000 7f6cdf7b1640 1 -- 172.21.15.7:0/3035815787 shutdown_connections 2024-09-21T05:55:07.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.976+0000 7f6cdf7b1640 1 -- 172.21.15.7:0/3035815787 wait complete. 2024-09-21T05:55:07.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.977+0000 7f6cdf7b1640 1 Processor -- start 2024-09-21T05:55:07.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.977+0000 7f6cdf7b1640 1 -- start start 2024-09-21T05:55:07.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdf7b1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cd8103b60 0x7f6cd819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:07.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdf7b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd81094a0 0x7f6cd819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:07.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdf7b1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cd8109df0 0x7f6cd819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:07.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdd54d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cd8103b60 0x7f6cd819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:07.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdcd4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd81094a0 0x7f6cd819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:07.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdf7b1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8113ab0 con 0x7f6cd81094a0 2024-09-21T05:55:07.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdf7b1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8113930 con 0x7f6cd8103b60 2024-09-21T05:55:07.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdf7b1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8113c30 con 0x7f6cd8109df0 2024-09-21T05:55:07.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdcd4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd81094a0 0x7f6cd819aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52788/0 (socket says 172.21.15.7:52788) 2024-09-21T05:55:07.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdd54d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cd8103b60 0x7f6cd819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:48222/0 (socket says 172.21.15.7:48222) 2024-09-21T05:55:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdcd4c640 1 -- 172.21.15.7:0/3375127281 learned_addr learned my addr 172.21.15.7:0/3375127281 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cddd4e640 1 --2- 172.21.15.7:0/3375127281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cd8109df0 0x7f6cd819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdcd4c640 1 -- 172.21.15.7:0/3375127281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cd8109df0 msgr2=0x7f6cd819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdcd4c640 1 --2- 172.21.15.7:0/3375127281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cd8109df0 0x7f6cd819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdcd4c640 1 -- 172.21.15.7:0/3375127281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cd8103b60 msgr2=0x7f6cd819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdcd4c640 1 --2- 172.21.15.7:0/3375127281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cd8103b60 0x7f6cd819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.978+0000 7f6cdcd4c640 1 -- 172.21.15.7:0/3375127281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd81a03d0 con 0x7f6cd81094a0 2024-09-21T05:55:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.979+0000 7f6cdcd4c640 1 --2- 172.21.15.7:0/3375127281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd81094a0 0x7f6cd819aa00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009ec0 tx=0x7f6cc800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.979+0000 7f6cce7fc640 1 -- 172.21.15.7:0/3375127281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8020070 con 0x7f6cd81094a0 2024-09-21T05:55:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.979+0000 7f6cdf7b1640 1 -- 172.21.15.7:0/3375127281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd81a06c0 con 0x7f6cd81094a0 2024-09-21T05:55:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.979+0000 7f6cce7fc640 1 -- 172.21.15.7:0/3375127281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cc800cd80 con 0x7f6cd81094a0 2024-09-21T05:55:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.979+0000 7f6cce7fc640 1 -- 172.21.15.7:0/3375127281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc801ba80 con 0x7f6cd81094a0 2024-09-21T05:55:07.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.979+0000 7f6cdf7b1640 1 -- 172.21.15.7:0/3375127281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd80755f0 con 0x7f6cd81094a0 2024-09-21T05:55:07.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.982+0000 7f6ce5d25740 1 Processor -- start 2024-09-21T05:55:07.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.982+0000 7f6ce5d25740 1 -- start start 2024-09-21T05:55:07.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.982+0000 7f6ce5d25740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 0x561e6c8dbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:07.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.982+0000 7f6ce5d25740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c503490 0x561e6c8dc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:07.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6ce5d25740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c50b670 0x561e6c8dc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:07.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6ce5d25740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561e6c849e60 con 0x561e6c52c350 2024-09-21T05:55:07.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6ce5d25740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561e6c839290 con 0x561e6c503490 2024-09-21T05:55:07.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6ce5d25740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561e6c83d0a0 con 0x561e6c50b670 2024-09-21T05:55:07.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6cce7fc640 1 -- 172.21.15.7:0/3375127281 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6cc8023070 con 0x7f6cd81094a0 2024-09-21T05:55:07.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6cddd4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 0x561e6c8dbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:07.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6cddd4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 0x561e6c8dbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52802/0 (socket says 172.21.15.7:52802) 2024-09-21T05:55:07.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6cddd4e640 1 -- 172.21.15.7:0/164075117 learned_addr learned my addr 172.21.15.7:0/164075117 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:07.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6cdd54d640 1 --2- 172.21.15.7:0/164075117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c503490 0x561e6c8dc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:07.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6cdcd4c640 1 --2- 172.21.15.7:0/164075117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c50b670 0x561e6c8dc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:07.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6cddd4e640 1 -- 172.21.15.7:0/164075117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c50b670 msgr2=0x561e6c8dc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:07.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6cddd4e640 1 --2- 172.21.15.7:0/164075117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c50b670 0x561e6c8dc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6cddd4e640 1 -- 172.21.15.7:0/164075117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c503490 msgr2=0x561e6c8dc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:07.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6cddd4e640 1 --2- 172.21.15.7:0/164075117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c503490 0x561e6c8dc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6cddd4e640 1 -- 172.21.15.7:0/164075117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e6c597930 con 0x561e6c52c350 2024-09-21T05:55:07.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6cdcd4c640 1 --2- 172.21.15.7:0/164075117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c50b670 0x561e6c8dc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:55:07.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.983+0000 7f6cddd4e640 1 --2- 172.21.15.7:0/164075117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 0x561e6c8dbc40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009fc0 tx=0x7f6cd0010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9504bf160129e2c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:07.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.984+0000 7f6cc37fe640 1 -- 172.21.15.7:0/164075117 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0003b70 con 0x561e6c52c350 2024-09-21T05:55:07.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.984+0000 7f6cc37fe640 1 -- 172.21.15.7:0/164075117 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cd0003d10 con 0x561e6c52c350 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.984+0000 7f6cc37fe640 1 -- 172.21.15.7:0/164075117 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0011a20 con 0x561e6c52c350 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.984+0000 7f6cce7fc640 1 --2- 172.21.15.7:0/3375127281 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6cc40b6680 0x7f6cc40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.984+0000 7f6cdd54d640 1 --2- 172.21.15.7:0/3375127281 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6cc40b6680 0x7f6cc40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.984+0000 7f6cce7fc640 1 -- 172.21.15.7:0/3375127281 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f6cc80e7330 con 0x7f6cd81094a0 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.985+0000 7f6ce5d25740 1 -- 172.21.15.7:0/164075117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 msgr2=0x561e6c8dbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.985+0000 7f6cdd54d640 1 --2- 172.21.15.7:0/3375127281 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6cc40b6680 0x7f6cc40b8b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4031440 tx=0x7f6cd4009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.985+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/164075117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 0x561e6c8dbc40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009fc0 tx=0x7f6cd0010860 comp rx=0 tx=0).stop 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.985+0000 7f6ce5d25740 1 -- 172.21.15.7:0/164075117 shutdown_connections 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.985+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/164075117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c50b670 0x561e6c8dc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.985+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/164075117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c503490 0x561e6c8dc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.985+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/164075117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 0x561e6c8dbc40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.985+0000 7f6ce5d25740 1 -- 172.21.15.7:0/164075117 >> 172.21.15.7:0/164075117 conn(0x561e6c520740 msgr2=0x561e6c8d9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.985+0000 7f6ce5d25740 1 -- 172.21.15.7:0/164075117 shutdown_connections 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.985+0000 7f6ce5d25740 1 -- 172.21.15.7:0/164075117 wait complete. 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.985+0000 7f6ce5d25740 1 -- start start 2024-09-21T05:55:07.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.986+0000 7f6ce5d25740 1 Processor -- start 2024-09-21T05:55:07.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.986+0000 7f6ce5d25740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c503490 0x561e6c8e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:07.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.986+0000 7f6ce5d25740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c50b670 0x561e6c8e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.986+0000 7f6ce5d25740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c52c350 0x561e6c8f3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.986+0000 7f6ce5d25740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561e6c69a890 con 0x561e6c503490 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.986+0000 7f6ce5d25740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561e6c7d3d40 con 0x561e6c50b670 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.986+0000 7f6ce5d25740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561e6c8ea420 con 0x561e6c52c350 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.986+0000 7f6ce5d25740 10 client.0 _ll_register_callbacks cb 0x561e6c837c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.986+0000 7f6cdcd4c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c50b670 0x561e6c8e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.986+0000 7f6cddd4e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c52c350 0x561e6c8f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.986+0000 7f6cdcd4c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c50b670 0x561e6c8e7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:48236/0 (socket says 172.21.15.7:48236) 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.986+0000 7f6cdcd4c640 1 -- 172.21.15.7:0/600009528 learned_addr learned my addr 172.21.15.7:0/600009528 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.986+0000 7f6cdd54d640 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c503490 0x561e6c8e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.987+0000 7f6cddd4e640 1 -- 172.21.15.7:0/600009528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c50b670 msgr2=0x561e6c8e7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.987+0000 7f6cddd4e640 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c50b670 0x561e6c8e7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.987+0000 7f6cddd4e640 1 -- 172.21.15.7:0/600009528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c503490 msgr2=0x561e6c8e77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.987+0000 7f6cddd4e640 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c503490 0x561e6c8e77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.987+0000 7f6cddd4e640 1 -- 172.21.15.7:0/600009528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e6c8f3c80 con 0x561e6c52c350 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.987+0000 7f6cdcd4c640 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c50b670 0x561e6c8e7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.987+0000 7f6cdd54d640 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c503490 0x561e6c8e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.987+0000 7f6cddd4e640 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c52c350 0x561e6c8f3710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009f90 tx=0x7f6cd0003ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=481e82d4f5c62125 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.987+0000 7f6cc0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.987+0000 7f6cc0ff9640 1 -- 172.21.15.7:0/600009528 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0004e10 con 0x561e6c52c350 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.987+0000 7f6ce5d25740 1 -- 172.21.15.7:0/600009528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cd0003d10 con 0x561e6c52c350 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.987+0000 7f6cc0ff9640 1 -- 172.21.15.7:0/600009528 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f6cd0011740 con 0x561e6c52c350 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.988+0000 7f6cc0ff9640 1 -- 172.21.15.7:0/600009528 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6cd0011940 con 0x561e6c52c350 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.988+0000 7f6ce5d25740 10 client.25477 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.988+0000 7f6ce5d25740 1 -- 172.21.15.7:0/600009528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e6c8f6570 con 0x561e6c52c350 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.988+0000 7f6cc0ff9640 1 -- 172.21.15.7:0/600009528 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cd0003d10 con 0x561e6c52c350 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.988+0000 7f6cc0ff9640 1 -- 172.21.15.7:0/600009528 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6cd0005040 con 0x561e6c52c350 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.988+0000 7f6ce5d25740 10 client.25477 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.988+0000 7f6ce5d25740 10 client.25477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.988+0000 7f6ce5d25740 20 client.25477 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.988+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561e6c4eacd0 0x561e6c8f98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.988+0000 7f6ce5d25740 4 client.25477 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.988+0000 7f6ce5d25740 1 -- 172.21.15.7:0/600009528 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e6c84bdb0 con 0x561e6c4eacd0 2024-09-21T05:55:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.988+0000 7f6cdd54d640 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561e6c4eacd0 0x561e6c8f98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.989+0000 7f6cc0ff9640 10 client.25477 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.989+0000 7f6cdd54d640 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561e6c4eacd0 0x561e6c8f98d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56f7aede6215c79f server_cookie=47f51945b8c92eff in_seq=0 out_seq=0 2024-09-21T05:55:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.989+0000 7f6cc0ff9640 1 -- 172.21.15.7:0/600009528 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e6c84bdb0 con 0x561e6c4eacd0 2024-09-21T05:55:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.989+0000 7f6cc0ff9640 10 client.25477 handle_command_reply: tid=0 2024-09-21T05:55:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.990+0000 7f6ce5d25740 1 client.25477 shutdown 2024-09-21T05:55:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.990+0000 7f6ce5d25740 1 -- 172.21.15.7:0/600009528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c52c350 msgr2=0x561e6c8f3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.990+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c52c350 0x561e6c8f3710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009f90 tx=0x7f6cd0003ca0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.990+0000 7f6ce5d25740 1 -- 172.21.15.7:0/600009528 shutdown_connections 2024-09-21T05:55:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.990+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561e6c4eacd0 0x561e6c8f98d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.990+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c52c350 0x561e6c8f3710 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.990+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c50b670 0x561e6c8e7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.990+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/600009528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c503490 0x561e6c8e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:07.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.990+0000 7f6cc0ff9640 0 client.25477 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:07.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.990+0000 7f6ce5d25740 1 -- 172.21.15.7:0/600009528 >> 172.21.15.7:0/600009528 conn(0x561e6c520740 msgr2=0x561e6c8dee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:07.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.990+0000 7f6ce5d25740 1 -- 172.21.15.7:0/600009528 shutdown_connections 2024-09-21T05:55:07.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.990+0000 7f6ce5d25740 1 -- 172.21.15.7:0/600009528 wait complete. 2024-09-21T05:55:07.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:07.990+0000 7f6ce5d25740 20 client.25477 trim_cache size 0 max 16384 2024-09-21T05:55:08.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.010+0000 7f6ce5d25740 1 Processor -- start 2024-09-21T05:55:08.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6ce5d25740 1 -- start start 2024-09-21T05:55:08.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6ce5d25740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c503490 0x561e6c8d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:08.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6ce5d25740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c50b670 0x561e6c8e7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:08.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6ce5d25740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 0x561e6c8f3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:08.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6ce5d25740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd81afc60 con 0x561e6c52c350 2024-09-21T05:55:08.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6ce5d25740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd81ad530 con 0x561e6c50b670 2024-09-21T05:55:08.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6ce5d25740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd81ab3a0 con 0x561e6c503490 2024-09-21T05:55:08.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6cddd4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 0x561e6c8f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:08.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6cddd4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 0x561e6c8f3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52818/0 (socket says 172.21.15.7:52818) 2024-09-21T05:55:08.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6cddd4e640 1 -- 172.21.15.7:0/2509284380 learned_addr learned my addr 172.21.15.7:0/2509284380 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:08.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6cdcd4c640 1 --2- 172.21.15.7:0/2509284380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c50b670 0x561e6c8e7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:08.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6cdd54d640 1 --2- 172.21.15.7:0/2509284380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c503490 0x561e6c8d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:08.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6cddd4e640 1 -- 172.21.15.7:0/2509284380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c503490 msgr2=0x561e6c8d9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:08.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6cddd4e640 1 --2- 172.21.15.7:0/2509284380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c503490 0x561e6c8d9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6cddd4e640 1 -- 172.21.15.7:0/2509284380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c50b670 msgr2=0x561e6c8e7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:08.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.011+0000 7f6cddd4e640 1 --2- 172.21.15.7:0/2509284380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c50b670 0x561e6c8e7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.012+0000 7f6cddd4e640 1 -- 172.21.15.7:0/2509284380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e6c8ddf30 con 0x561e6c52c350 2024-09-21T05:55:08.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.012+0000 7f6cdd54d640 1 --2- 172.21.15.7:0/2509284380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c503490 0x561e6c8d9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:08.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.012+0000 7f6cdcd4c640 1 --2- 172.21.15.7:0/2509284380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c50b670 0x561e6c8e7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:08.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.012+0000 7f6cddd4e640 1 --2- 172.21.15.7:0/2509284380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 0x561e6c8f3680 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0002230 tx=0x7f6cd0009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9627ec6d5588c5b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:08.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.012+0000 7f6cc2ffd640 1 -- 172.21.15.7:0/2509284380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00045b0 con 0x561e6c52c350 2024-09-21T05:55:08.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.012+0000 7f6cc2ffd640 1 -- 172.21.15.7:0/2509284380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cd0004750 con 0x561e6c52c350 2024-09-21T05:55:08.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.012+0000 7f6cc2ffd640 1 -- 172.21.15.7:0/2509284380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0005070 con 0x561e6c52c350 2024-09-21T05:55:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.013+0000 7f6ce5d25740 1 -- 172.21.15.7:0/2509284380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 msgr2=0x561e6c8f3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.013+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/2509284380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 0x561e6c8f3680 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0002230 tx=0x7f6cd0009300 comp rx=0 tx=0).stop 2024-09-21T05:55:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.013+0000 7f6ce5d25740 1 -- 172.21.15.7:0/2509284380 shutdown_connections 2024-09-21T05:55:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.013+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/2509284380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c52c350 0x561e6c8f3680 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.013+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/2509284380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c50b670 0x561e6c8e7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.013+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/2509284380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c503490 0x561e6c8d9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.013+0000 7f6ce5d25740 1 -- 172.21.15.7:0/2509284380 >> 172.21.15.7:0/2509284380 conn(0x561e6c520740 msgr2=0x561e6c8e77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.013+0000 7f6ce5d25740 1 -- 172.21.15.7:0/2509284380 shutdown_connections 2024-09-21T05:55:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.013+0000 7f6ce5d25740 1 -- 172.21.15.7:0/2509284380 wait complete. 2024-09-21T05:55:08.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.014+0000 7f6ce5d25740 1 -- start start 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.014+0000 7f6ce5d25740 1 Processor -- start 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.014+0000 7f6ce5d25740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c503490 0x561e6c8fab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.014+0000 7f6ce5d25740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c50b670 0x561e6c8fb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.014+0000 7f6ce5d25740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c52c350 0x561e6c963050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.014+0000 7f6ce5d25740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd81ab9f0 con 0x561e6c50b670 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.014+0000 7f6ce5d25740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd81ace60 con 0x561e6c52c350 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.014+0000 7f6ce5d25740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd81ac0c0 con 0x561e6c503490 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cdd54d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c503490 0x561e6c8fab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6ce5d25740 10 client.0 _ll_register_callbacks cb 0x7f6cc8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cdd54d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c503490 0x561e6c8fab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:51440/0 (socket says 172.21.15.7:51440) 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cdd54d640 1 -- 172.21.15.7:0/1826197938 learned_addr learned my addr 172.21.15.7:0/1826197938 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cddd4e640 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c52c350 0x561e6c963050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cdcd4c640 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c50b670 0x561e6c8fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cdd54d640 1 -- 172.21.15.7:0/1826197938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c52c350 msgr2=0x561e6c963050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cdd54d640 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c52c350 0x561e6c963050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cdd54d640 1 -- 172.21.15.7:0/1826197938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c50b670 msgr2=0x561e6c8fb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cdd54d640 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c50b670 0x561e6c8fb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cdd54d640 1 -- 172.21.15.7:0/1826197938 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e6c8fb880 con 0x561e6c503490 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cdcd4c640 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c50b670 0x561e6c8fb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cdd54d640 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c503490 0x561e6c8fab50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40316d0 tx=0x7f6cd403f070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe92451fefab3283 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cc0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cc0ff9640 1 -- 172.21.15.7:0/1826197938 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4035040 con 0x561e6c503490 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6cc0ff9640 1 -- 172.21.15.7:0/1826197938 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f6cd4005040 con 0x561e6c503490 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.015+0000 7f6ce5d25740 1 -- 172.21.15.7:0/1826197938 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561e6c847860 con 0x561e6c503490 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.016+0000 7f6cc0ff9640 1 -- 172.21.15.7:0/1826197938 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6cd4005240 con 0x561e6c503490 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.016+0000 7f6ce5d25740 10 client.25483 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.016+0000 7f6ce5d25740 1 -- 172.21.15.7:0/1826197938 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e6c9645e0 con 0x561e6c503490 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.016+0000 7f6cc0ff9640 1 -- 172.21.15.7:0/1826197938 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561e6c847860 con 0x561e6c503490 2024-09-21T05:55:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.016+0000 7f6cc0ff9640 1 -- 172.21.15.7:0/1826197938 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6cd4003680 con 0x561e6c503490 2024-09-21T05:55:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.016+0000 7f6ce5d25740 10 client.25483 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.016+0000 7f6ce5d25740 10 client.25483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.016+0000 7f6ce5d25740 20 client.25483 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.016+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561e6c4c0080 0x561e6c966d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.016+0000 7f6ce5d25740 4 client.25483 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T05:55:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.016+0000 7f6ce5d25740 1 -- 172.21.15.7:0/1826197938 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561e6c844c90 con 0x561e6c4c0080 2024-09-21T05:55:08.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.016+0000 7f6cdcd4c640 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561e6c4c0080 0x561e6c966d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:08.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.017+0000 7f6cc0ff9640 10 client.25483 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:08.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.017+0000 7f6cdcd4c640 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561e6c4c0080 0x561e6c966d80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d45485a0a0d32c2e server_cookie=c43a0c20ecff7ca9 in_seq=0 out_seq=0 2024-09-21T05:55:08.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6cc0ff9640 1 -- 172.21.15.7:0/1826197938 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561e6c844c90 con 0x561e6c4c0080 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6cc0ff9640 10 client.25483 handle_command_reply: tid=0 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6ce5d25740 1 client.25483 shutdown 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6ce5d25740 1 -- 172.21.15.7:0/1826197938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c503490 msgr2=0x561e6c8fab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c503490 0x561e6c8fab50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40316d0 tx=0x7f6cd403f070 comp rx=0 tx=0).stop 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6ce5d25740 1 -- 172.21.15.7:0/1826197938 shutdown_connections 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561e6c4c0080 0x561e6c966d80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561e6c50b670 0x561e6c8fb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561e6c52c350 0x561e6c963050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6ce5d25740 1 --2- 172.21.15.7:0/1826197938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561e6c503490 0x561e6c8fab50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6cc0ff9640 0 client.25483 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6ce5d25740 1 -- 172.21.15.7:0/1826197938 >> 172.21.15.7:0/1826197938 conn(0x561e6c520740 msgr2=0x561e6c8dcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6ce5d25740 1 -- 172.21.15.7:0/1826197938 shutdown_connections 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.019+0000 7f6ce5d25740 1 -- 172.21.15.7:0/1826197938 wait complete. 2024-09-21T05:55:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.020+0000 7f6ce5d25740 20 client.25483 trim_cache size 0 max 16384 2024-09-21T05:55:08.025 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:55:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T05:55:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a", 2024-09-21T05:55:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T05:55:08.025 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:55:08.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.020+0000 7f6cdf7b1640 1 -- 172.21.15.7:0/3375127281 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6cc40b6680 msgr2=0x7f6cc40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:08.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.020+0000 7f6cdf7b1640 1 --2- 172.21.15.7:0/3375127281 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6cc40b6680 0x7f6cc40b8b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4031440 tx=0x7f6cd4009560 comp rx=0 tx=0).stop 2024-09-21T05:55:08.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.020+0000 7f6cdf7b1640 1 -- 172.21.15.7:0/3375127281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd81094a0 msgr2=0x7f6cd819aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:08.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.020+0000 7f6cdf7b1640 1 --2- 172.21.15.7:0/3375127281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd81094a0 0x7f6cd819aa00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009ec0 tx=0x7f6cc800edc0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.020+0000 7f6cdf7b1640 1 -- 172.21.15.7:0/3375127281 shutdown_connections 2024-09-21T05:55:08.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.020+0000 7f6cdf7b1640 1 --2- 172.21.15.7:0/3375127281 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6cc40b6680 0x7f6cc40b8b90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.020+0000 7f6cdf7b1640 1 --2- 172.21.15.7:0/3375127281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd81094a0 0x7f6cd819aa00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.020+0000 7f6cdf7b1640 1 --2- 172.21.15.7:0/3375127281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cd8109df0 0x7f6cd819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.020+0000 7f6cdf7b1640 1 --2- 172.21.15.7:0/3375127281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cd8103b60 0x7f6cd819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:08.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.020+0000 7f6cdf7b1640 1 -- 172.21.15.7:0/3375127281 >> 172.21.15.7:0/3375127281 conn(0x7f6cd807b850 msgr2=0x7f6cd8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:08.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.020+0000 7f6cdf7b1640 1 -- 172.21.15.7:0/3375127281 shutdown_connections 2024-09-21T05:55:08.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:08.020+0000 7f6cdf7b1640 1 -- 172.21.15.7:0/3375127281 wait complete. 2024-09-21T05:55:08.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:08 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T05:55:08.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:08 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:55:08.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:08 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T05:55:08.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:08 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:55:08.876 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:08 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T05:55:08.877 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:08 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:55:08.877 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:08 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T05:55:08.877 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:08 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:55:08.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:55:09.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:08 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T05:55:09.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:08 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:55:09.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:08 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T05:55:09.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:08 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:55:09.166 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:09.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.694+0000 7f9db5f54640 1 -- 172.21.15.7:0/3846441226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9db01094b0 msgr2=0x7f9db01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:09.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.694+0000 7f9db5f54640 1 --2- 172.21.15.7:0/3846441226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9db01094b0 0x7f9db01098c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009900 tx=0x7f9da402a410 comp rx=0 tx=0).stop 2024-09-21T05:55:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.694+0000 7f9db5f54640 1 -- 172.21.15.7:0/3846441226 shutdown_connections 2024-09-21T05:55:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.694+0000 7f9db5f54640 1 --2- 172.21.15.7:0/3846441226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9db01094b0 0x7f9db01098c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.694+0000 7f9db5f54640 1 --2- 172.21.15.7:0/3846441226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db0109e00 0x7f9db0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.694+0000 7f9db5f54640 1 --2- 172.21.15.7:0/3846441226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9db0101f70 0x7f9db0102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.694+0000 7f9db5f54640 1 -- 172.21.15.7:0/3846441226 >> 172.21.15.7:0/3846441226 conn(0x7f9db0077c60 msgr2=0x7f9db00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.694+0000 7f9db5f54640 1 -- 172.21.15.7:0/3846441226 shutdown_connections 2024-09-21T05:55:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.694+0000 7f9db5f54640 1 -- 172.21.15.7:0/3846441226 wait complete. 2024-09-21T05:55:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.695+0000 7f9db5f54640 1 Processor -- start 2024-09-21T05:55:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.695+0000 7f9db5f54640 1 -- start start 2024-09-21T05:55:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.695+0000 7f9db5f54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9db0101f70 0x7f9db019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.695+0000 7f9db5f54640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9db01094b0 0x7f9db019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.695+0000 7f9db5f54640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db0109e00 0x7f9db01a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.695+0000 7f9db5f54640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9db0113ac0 con 0x7f9db01094b0 2024-09-21T05:55:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.695+0000 7f9db5f54640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9db0113940 con 0x7f9db0101f70 2024-09-21T05:55:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.695+0000 7f9db5f54640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9db0113c40 con 0x7f9db0109e00 2024-09-21T05:55:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.695+0000 7f9daf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9db0101f70 0x7f9db019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.695+0000 7f9daeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9db01094b0 0x7f9db019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.695+0000 7f9daf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9db0101f70 0x7f9db019c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:37916/0 (socket says 172.21.15.7:37916) 2024-09-21T05:55:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.696+0000 7f9daf7fe640 1 -- 172.21.15.7:0/246802961 learned_addr learned my addr 172.21.15.7:0/246802961 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.696+0000 7f9daffff640 1 --2- 172.21.15.7:0/246802961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db0109e00 0x7f9db01a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.696+0000 7f9daf7fe640 1 -- 172.21.15.7:0/246802961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db0109e00 msgr2=0x7f9db01a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.696+0000 7f9daf7fe640 1 --2- 172.21.15.7:0/246802961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db0109e00 0x7f9db01a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.696+0000 7f9daf7fe640 1 -- 172.21.15.7:0/246802961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9db01094b0 msgr2=0x7f9db019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.696+0000 7f9daf7fe640 1 --2- 172.21.15.7:0/246802961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9db01094b0 0x7f9db019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.696+0000 7f9daf7fe640 1 -- 172.21.15.7:0/246802961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db01a2640 con 0x7f9db0101f70 2024-09-21T05:55:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.696+0000 7f9daf7fe640 1 --2- 172.21.15.7:0/246802961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9db0101f70 0x7f9db019c6d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9da000e9f0 tx=0x7f9da000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.696+0000 7f9dacff9640 1 -- 172.21.15.7:0/246802961 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da000cd80 con 0x7f9db0101f70 2024-09-21T05:55:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.696+0000 7f9db5f54640 1 -- 172.21.15.7:0/246802961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db01a2930 con 0x7f9db0101f70 2024-09-21T05:55:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.697+0000 7f9dacff9640 1 -- 172.21.15.7:0/246802961 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da00108e0 con 0x7f9db0101f70 2024-09-21T05:55:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.697+0000 7f9dacff9640 1 -- 172.21.15.7:0/246802961 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0018980 con 0x7f9db0101f70 2024-09-21T05:55:09.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.697+0000 7f9db5f54640 1 -- 172.21.15.7:0/246802961 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db01a9090 con 0x7f9db0101f70 2024-09-21T05:55:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.699+0000 7f9dbc4c8740 1 Processor -- start 2024-09-21T05:55:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.699+0000 7f9dacff9640 1 -- 172.21.15.7:0/246802961 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9da0018b20 con 0x7f9db0101f70 2024-09-21T05:55:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9dbc4c8740 1 -- start start 2024-09-21T05:55:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9dbc4c8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 0x5642fe378270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9dbc4c8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfa81b0 0x5642fe3787b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9dbc4c8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfb0390 0x5642fe378cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9dbc4c8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5642fe2eee50 con 0x5642fdfa81b0 2024-09-21T05:55:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9dbc4c8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5642fe2de280 con 0x5642fdfb0390 2024-09-21T05:55:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9dbc4c8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5642fe2e2090 con 0x5642fdfd1070 2024-09-21T05:55:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9daf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfa81b0 0x5642fe3787b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9daeffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfb0390 0x5642fe378cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9daffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 0x5642fe378270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9daeffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfb0390 0x5642fe378cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:37922/0 (socket says 172.21.15.7:37922) 2024-09-21T05:55:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9daffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 0x5642fe378270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:35066/0 (socket says 172.21.15.7:35066) 2024-09-21T05:55:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9daeffd640 1 -- 172.21.15.7:0/3689896410 learned_addr learned my addr 172.21.15.7:0/3689896410 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9daeffd640 1 -- 172.21.15.7:0/3689896410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 msgr2=0x5642fe378270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9daeffd640 1 --2- 172.21.15.7:0/3689896410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 0x5642fe378270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9daeffd640 1 -- 172.21.15.7:0/3689896410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfa81b0 msgr2=0x5642fe3787b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.700+0000 7f9daeffd640 1 --2- 172.21.15.7:0/3689896410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfa81b0 0x5642fe3787b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.701+0000 7f9daeffd640 1 -- 172.21.15.7:0/3689896410 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642fe03c650 con 0x5642fdfb0390 2024-09-21T05:55:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.701+0000 7f9dacff9640 1 --2- 172.21.15.7:0/246802961 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9d980b6700 0x7f9d980b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.701+0000 7f9daeffd640 1 --2- 172.21.15.7:0/3689896410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfb0390 0x5642fe378cf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009900 tx=0x7f9da4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16a83f0c24e5b65c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.701+0000 7f9dacff9640 1 -- 172.21.15.7:0/246802961 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9da00e7900 con 0x7f9db0101f70 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.701+0000 7f9daffff640 1 --2- 172.21.15.7:0/246802961 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9d980b6700 0x7f9d980b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.701+0000 7f9d95ffb640 1 -- 172.21.15.7:0/3689896410 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4040070 con 0x5642fdfb0390 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.701+0000 7f9d95ffb640 1 -- 172.21.15.7:0/3689896410 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da4004030 con 0x5642fdfb0390 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.701+0000 7f9d95ffb640 1 -- 172.21.15.7:0/3689896410 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4035040 con 0x5642fdfb0390 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.702+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3689896410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfb0390 msgr2=0x5642fe378cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.702+0000 7f9daffff640 1 --2- 172.21.15.7:0/246802961 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9d980b6700 0x7f9d980b8c10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9da8005fd0 tx=0x7f9da8009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.702+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3689896410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfb0390 0x5642fe378cf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009900 tx=0x7f9da4000bc0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.703+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3689896410 shutdown_connections 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.703+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3689896410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfa81b0 0x5642fe3787b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.703+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3689896410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfb0390 0x5642fe378cf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.703+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3689896410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 0x5642fe378270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.703+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3689896410 >> 172.21.15.7:0/3689896410 conn(0x5642fdfc5460 msgr2=0x5642fe376160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.703+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3689896410 shutdown_connections 2024-09-21T05:55:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.703+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3689896410 wait complete. 2024-09-21T05:55:09.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.703+0000 7f9dbc4c8740 1 -- start start 2024-09-21T05:55:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9dbc4c8740 1 Processor -- start 2024-09-21T05:55:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9dbc4c8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfa81b0 0x5642fe3839a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9dbc4c8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfb0390 0x5642fe383ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9dbc4c8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 0x5642fe38fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9dbc4c8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5642fe13f700 con 0x5642fdfa81b0 2024-09-21T05:55:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9dbc4c8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5642fe279110 con 0x5642fdfb0390 2024-09-21T05:55:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9dbc4c8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5642fe3869f0 con 0x5642fdfd1070 2024-09-21T05:55:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9daf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfa81b0 0x5642fe3839a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9daf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfa81b0 0x5642fe3839a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39224/0 (socket says 172.21.15.7:39224) 2024-09-21T05:55:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9daf7fe640 1 -- 172.21.15.7:0/3124823161 learned_addr learned my addr 172.21.15.7:0/3124823161 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9daffff640 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 0x5642fe38fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9daeffd640 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfb0390 0x5642fe383ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9dbc4c8740 10 client.0 _ll_register_callbacks cb 0x5642fe292990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9daf7fe640 1 -- 172.21.15.7:0/3124823161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 msgr2=0x5642fe38fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9daf7fe640 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 0x5642fe38fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9daf7fe640 1 -- 172.21.15.7:0/3124823161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfb0390 msgr2=0x5642fe383ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.704+0000 7f9daf7fe640 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfb0390 0x5642fe383ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.705+0000 7f9daf7fe640 1 -- 172.21.15.7:0/3124823161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642fe2a6c40 con 0x5642fdfa81b0 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.705+0000 7f9daeffd640 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfb0390 0x5642fe383ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.705+0000 7f9daf7fe640 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfa81b0 0x5642fe3839a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9da000e9c0 tx=0x7f9da00eb080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb3599cf0b5adbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.705+0000 7f9d8effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.705+0000 7f9d8effd640 1 -- 172.21.15.7:0/3124823161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da00a9720 con 0x5642fdfa81b0 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.705+0000 7f9d8effd640 1 -- 172.21.15.7:0/3124823161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9da00a91d0 con 0x5642fdfa81b0 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.705+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3124823161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9da4004030 con 0x5642fdfa81b0 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.705+0000 7f9d8effd640 1 -- 172.21.15.7:0/3124823161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9da00acff0 con 0x5642fdfa81b0 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.705+0000 7f9dbc4c8740 10 client.15846 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.705+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3124823161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5642fe392760 con 0x5642fdfa81b0 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.706+0000 7f9d8effd640 1 -- 172.21.15.7:0/3124823161 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da4004030 con 0x5642fdfa81b0 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.706+0000 7f9d8effd640 1 -- 172.21.15.7:0/3124823161 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9da00a93d0 con 0x5642fdfa81b0 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.706+0000 7f9dbc4c8740 10 client.15846 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.706+0000 7f9dbc4c8740 10 client.15846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.706+0000 7f9dbc4c8740 20 client.15846 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.706+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5642fdf8f9f0 0x5642fe395cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.706+0000 7f9dbc4c8740 4 client.15846 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.706+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3124823161 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642fe2f0da0 con 0x5642fdf8f9f0 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.706+0000 7f9daeffd640 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5642fdf8f9f0 0x5642fe395cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.707+0000 7f9d8effd640 10 client.15846 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.707+0000 7f9daeffd640 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5642fdf8f9f0 0x5642fe395cb0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d20809fdd373455a server_cookie=95e18785bb8d2405 in_seq=0 out_seq=0 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9d8effd640 1 -- 172.21.15.7:0/3124823161 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5642fe2f0da0 con 0x5642fdf8f9f0 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9d8effd640 10 client.15846 handle_command_reply: tid=0 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9dbc4c8740 1 client.15846 shutdown 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3124823161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfa81b0 msgr2=0x5642fe3839a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfa81b0 0x5642fe3839a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9da000e9c0 tx=0x7f9da00eb080 comp rx=0 tx=0).stop 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3124823161 shutdown_connections 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5642fdf8f9f0 0x5642fe395cb0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 0x5642fe38fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfb0390 0x5642fe383ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3124823161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfa81b0 0x5642fe3839a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3124823161 >> 172.21.15.7:0/3124823161 conn(0x5642fdfc5460 msgr2=0x5642fe37b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9d8effd640 0 client.15846 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3124823161 shutdown_connections 2024-09-21T05:55:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.708+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3124823161 wait complete. 2024-09-21T05:55:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.709+0000 7f9dbc4c8740 20 client.15846 trim_cache size 0 max 16384 2024-09-21T05:55:09.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.731+0000 7f9dbc4c8740 1 Processor -- start 2024-09-21T05:55:09.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.731+0000 7f9dbc4c8740 1 -- start start 2024-09-21T05:55:09.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.731+0000 7f9dbc4c8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfa81b0 0x5642fe38fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.731+0000 7f9dbc4c8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfb0390 0x5642fe380b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.731+0000 7f9dbc4c8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 0x5642fe3810d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.731+0000 7f9dbc4c8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9db01b40b0 con 0x5642fdfb0390 2024-09-21T05:55:09.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.731+0000 7f9dbc4c8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9db01b1980 con 0x5642fdfa81b0 2024-09-21T05:55:09.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.731+0000 7f9dbc4c8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9db01af7d0 con 0x5642fdfd1070 2024-09-21T05:55:09.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.731+0000 7f9daeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfb0390 0x5642fe380b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.731+0000 7f9daf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfa81b0 0x5642fe38fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.732+0000 7f9daf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfa81b0 0x5642fe38fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:37946/0 (socket says 172.21.15.7:37946) 2024-09-21T05:55:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.732+0000 7f9daeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfb0390 0x5642fe380b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39228/0 (socket says 172.21.15.7:39228) 2024-09-21T05:55:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.732+0000 7f9daf7fe640 1 -- 172.21.15.7:0/76938659 learned_addr learned my addr 172.21.15.7:0/76938659 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.732+0000 7f9daffff640 1 --2- 172.21.15.7:0/76938659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 0x5642fe3810d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.732+0000 7f9daf7fe640 1 -- 172.21.15.7:0/76938659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 msgr2=0x5642fe3810d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.732+0000 7f9daf7fe640 1 --2- 172.21.15.7:0/76938659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 0x5642fe3810d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.732+0000 7f9daf7fe640 1 -- 172.21.15.7:0/76938659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfb0390 msgr2=0x5642fe380b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.732+0000 7f9daf7fe640 1 --2- 172.21.15.7:0/76938659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfb0390 0x5642fe380b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.732+0000 7f9daf7fe640 1 -- 172.21.15.7:0/76938659 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642fdf8fc10 con 0x5642fdfa81b0 2024-09-21T05:55:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.732+0000 7f9daf7fe640 1 --2- 172.21.15.7:0/76938659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfa81b0 0x5642fe38fbe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9da000c6a0 tx=0x7f9da0009330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c92b7b57e6b30e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.732+0000 7f9d957fa640 1 -- 172.21.15.7:0/76938659 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0098020 con 0x5642fdfa81b0 2024-09-21T05:55:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.732+0000 7f9d957fa640 1 -- 172.21.15.7:0/76938659 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da00ad390 con 0x5642fdfa81b0 2024-09-21T05:55:09.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.732+0000 7f9d957fa640 1 -- 172.21.15.7:0/76938659 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da00ad1d0 con 0x5642fdfa81b0 2024-09-21T05:55:09.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.733+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/76938659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfa81b0 msgr2=0x5642fe38fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:09.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.733+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/76938659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfa81b0 0x5642fe38fbe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9da000c6a0 tx=0x7f9da0009330 comp rx=0 tx=0).stop 2024-09-21T05:55:09.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.733+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/76938659 shutdown_connections 2024-09-21T05:55:09.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.733+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/76938659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfb0390 0x5642fe380b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.733+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/76938659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfd1070 0x5642fe3810d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.733+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/76938659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfa81b0 0x5642fe38fbe0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.733+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/76938659 >> 172.21.15.7:0/76938659 conn(0x5642fdfc5460 msgr2=0x5642fe382220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.733+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/76938659 shutdown_connections 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.733+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/76938659 wait complete. 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.734+0000 7f9dbc4c8740 1 -- start start 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.734+0000 7f9dbc4c8740 1 Processor -- start 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.734+0000 7f9dbc4c8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfa81b0 0x5642fe387b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.734+0000 7f9dbc4c8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfb0390 0x5642fe388080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.734+0000 7f9dbc4c8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfd1070 0x5642fe3885c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.734+0000 7f9dbc4c8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9db01afe40 con 0x5642fdfd1070 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.734+0000 7f9dbc4c8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9db01b12b0 con 0x5642fdfa81b0 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.734+0000 7f9dbc4c8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9db01b0510 con 0x5642fdfb0390 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.734+0000 7f9dbc4c8740 10 client.0 _ll_register_callbacks cb 0x7f9da00ed240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.734+0000 7f9daeffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfb0390 0x5642fe388080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.735+0000 7f9daf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfa81b0 0x5642fe387b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.735+0000 7f9daeffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfb0390 0x5642fe388080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:35100/0 (socket says 172.21.15.7:35100) 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.735+0000 7f9daffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfd1070 0x5642fe3885c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.735+0000 7f9daeffd640 1 -- 172.21.15.7:0/3151096115 learned_addr learned my addr 172.21.15.7:0/3151096115 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.735+0000 7f9daf7fe640 1 -- 172.21.15.7:0/3151096115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfb0390 msgr2=0x5642fe388080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.735+0000 7f9daf7fe640 1 --2- 172.21.15.7:0/3151096115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfb0390 0x5642fe388080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.735+0000 7f9daf7fe640 1 -- 172.21.15.7:0/3151096115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfd1070 msgr2=0x5642fe3885c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.735+0000 7f9daf7fe640 1 --2- 172.21.15.7:0/3151096115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfd1070 0x5642fe3885c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.735+0000 7f9daf7fe640 1 -- 172.21.15.7:0/3151096115 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642fe3ff670 con 0x5642fdfa81b0 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.735+0000 7f9daf7fe640 1 --2- 172.21.15.7:0/3151096115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfa81b0 0x5642fe387b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9da00b3550 tx=0x7f9da00eb000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e9dc22233f236f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.735+0000 7f9d8effd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.735+0000 7f9d8effd640 1 -- 172.21.15.7:0/3151096115 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0098070 con 0x5642fdfa81b0 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.735+0000 7f9d8effd640 1 -- 172.21.15.7:0/3151096115 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9da00aeb00 con 0x5642fdfa81b0 2024-09-21T05:55:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.736+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3151096115 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9da00ad390 con 0x5642fdfa81b0 2024-09-21T05:55:09.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.736+0000 7f9d8effd640 1 -- 172.21.15.7:0/3151096115 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9da00ad650 con 0x5642fdfa81b0 2024-09-21T05:55:09.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.736+0000 7f9dbc4c8740 10 client.25544 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:09.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.736+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3151096115 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5642fe3ff670 con 0x5642fdfa81b0 2024-09-21T05:55:09.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.736+0000 7f9d8effd640 1 -- 172.21.15.7:0/3151096115 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da00ad390 con 0x5642fdfa81b0 2024-09-21T05:55:09.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.736+0000 7f9d8effd640 1 -- 172.21.15.7:0/3151096115 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9da00ac550 con 0x5642fdfa81b0 2024-09-21T05:55:09.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.736+0000 7f9dbc4c8740 10 client.25544 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:09.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.736+0000 7f9dbc4c8740 10 client.25544 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:09.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.736+0000 7f9dbc4c8740 20 client.25544 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:09.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.736+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3151096115 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5642fdf64da0 0x5642fe402ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:09.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.736+0000 7f9dbc4c8740 4 client.25544 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:55:09.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.736+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3151096115 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5642fe2ec850 con 0x5642fdf64da0 2024-09-21T05:55:09.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.737+0000 7f9daeffd640 1 --2- 172.21.15.7:0/3151096115 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5642fdf64da0 0x5642fe402ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:09.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.737+0000 7f9d8effd640 10 client.25544 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.737+0000 7f9daeffd640 1 --2- 172.21.15.7:0/3151096115 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5642fdf64da0 0x5642fe402ae0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcb8102e3d804e4e server_cookie=f7c6fe02f384c629 in_seq=0 out_seq=0 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.737+0000 7f9d8effd640 1 -- 172.21.15.7:0/3151096115 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x5642fe2ec850 con 0x5642fdf64da0 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.737+0000 7f9d8effd640 10 client.25544 handle_command_reply: tid=0 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.737+0000 7f9dbc4c8740 1 client.25544 shutdown 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.738+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3151096115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfa81b0 msgr2=0x5642fe387b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.738+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3151096115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfa81b0 0x5642fe387b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9da00b3550 tx=0x7f9da00eb000 comp rx=0 tx=0).stop 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.738+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3151096115 shutdown_connections 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.738+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3151096115 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5642fdf64da0 0x5642fe402ae0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.738+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3151096115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642fdfd1070 0x5642fe3885c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.738+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3151096115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5642fdfb0390 0x5642fe388080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.738+0000 7f9d8effd640 0 client.25544 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.738+0000 7f9dbc4c8740 1 --2- 172.21.15.7:0/3151096115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5642fdfa81b0 0x5642fe387b40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.738+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3151096115 >> 172.21.15.7:0/3151096115 conn(0x5642fdfc5460 msgr2=0x5642fe384e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:09.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.738+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3151096115 shutdown_connections 2024-09-21T05:55:09.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.738+0000 7f9dbc4c8740 1 -- 172.21.15.7:0/3151096115 wait complete. 2024-09-21T05:55:09.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.738+0000 7f9dbc4c8740 20 client.25544 trim_cache size 0 max 16384 2024-09-21T05:55:09.745 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:55:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T05:55:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T05:55:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:55:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:55:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a", 2024-09-21T05:55:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T05:55:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:55:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:55:09.747 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:55:09.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.739+0000 7f9db5f54640 1 -- 172.21.15.7:0/246802961 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9d980b6700 msgr2=0x7f9d980b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:09.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.739+0000 7f9db5f54640 1 --2- 172.21.15.7:0/246802961 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9d980b6700 0x7f9d980b8c10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9da8005fd0 tx=0x7f9da8009500 comp rx=0 tx=0).stop 2024-09-21T05:55:09.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.739+0000 7f9db5f54640 1 -- 172.21.15.7:0/246802961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9db0101f70 msgr2=0x7f9db019c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:09.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.739+0000 7f9db5f54640 1 --2- 172.21.15.7:0/246802961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9db0101f70 0x7f9db019c6d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9da000e9f0 tx=0x7f9da000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.739+0000 7f9db5f54640 1 -- 172.21.15.7:0/246802961 shutdown_connections 2024-09-21T05:55:09.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.739+0000 7f9db5f54640 1 --2- 172.21.15.7:0/246802961 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9d980b6700 0x7f9d980b8c10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.739+0000 7f9db5f54640 1 --2- 172.21.15.7:0/246802961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9db01094b0 0x7f9db019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.739+0000 7f9db5f54640 1 --2- 172.21.15.7:0/246802961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9db0109e00 0x7f9db01a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.739+0000 7f9db5f54640 1 --2- 172.21.15.7:0/246802961 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9db0101f70 0x7f9db019c6d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:09.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.739+0000 7f9db5f54640 1 -- 172.21.15.7:0/246802961 >> 172.21.15.7:0/246802961 conn(0x7f9db0077c60 msgr2=0x7f9db01072c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:09.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.739+0000 7f9db5f54640 1 -- 172.21.15.7:0/246802961 shutdown_connections 2024-09-21T05:55:09.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:09.739+0000 7f9db5f54640 1 -- 172.21.15.7:0/246802961 wait complete. 2024-09-21T05:55:09.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:09 smithi027 ceph-mon[34364]: pgmap v356: 97 pgs: 97 active+clean; 255 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.1 MiB/s wr, 334 op/s 2024-09-21T05:55:10.062 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:09 smithi007 ceph-mon[30983]: pgmap v356: 97 pgs: 97 active+clean; 255 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.1 MiB/s wr, 334 op/s 2024-09-21T05:55:10.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:09 smithi119 ceph-mon[34833]: pgmap v356: 97 pgs: 97 active+clean; 255 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.1 MiB/s wr, 334 op/s 2024-09-21T05:55:10.581 INFO:tasks.cephfs.filesystem:scrub status for tag:3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a - {'path': '/', 'tag': '3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a', 'options': 'recursive,force'} 2024-09-21T05:55:11.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:11 smithi027 ceph-mon[34364]: pgmap v357: 97 pgs: 97 active+clean; 257 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.3 MiB/s wr, 532 op/s 2024-09-21T05:55:12.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:11 smithi007 ceph-mon[30983]: pgmap v357: 97 pgs: 97 active+clean; 257 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.3 MiB/s wr, 532 op/s 2024-09-21T05:55:12.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:11 smithi119 ceph-mon[34833]: pgmap v357: 97 pgs: 97 active+clean; 257 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.3 MiB/s wr, 532 op/s 2024-09-21T05:55:12.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:12 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T05:55:13.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:12 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T05:55:13.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:12 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T05:55:13.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:13 smithi027 ceph-mon[34364]: pgmap v358: 97 pgs: 97 active+clean; 257 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.9 MiB/s wr, 554 op/s 2024-09-21T05:55:14.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:13 smithi007 ceph-mon[30983]: pgmap v358: 97 pgs: 97 active+clean; 257 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.9 MiB/s wr, 554 op/s 2024-09-21T05:55:14.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:13 smithi119 ceph-mon[34833]: pgmap v358: 97 pgs: 97 active+clean; 257 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.9 MiB/s wr, 554 op/s 2024-09-21T05:55:15.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:15 smithi027 ceph-mon[34364]: pgmap v359: 97 pgs: 97 active+clean; 258 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.0 MiB/s wr, 723 op/s 2024-09-21T05:55:16.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:15 smithi007 ceph-mon[30983]: pgmap v359: 97 pgs: 97 active+clean; 258 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.0 MiB/s wr, 723 op/s 2024-09-21T05:55:16.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:15 smithi119 ceph-mon[34833]: pgmap v359: 97 pgs: 97 active+clean; 258 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.0 MiB/s wr, 723 op/s 2024-09-21T05:55:16.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.298+0000 7f744357b640 1 -- 172.21.15.7:0/481195544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c10dd90 msgr2=0x7f743c110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.298+0000 7f744357b640 1 --2- 172.21.15.7:0/481195544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c10dd90 0x7f743c110270 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7434009ca0 tx=0x7f743402e990 comp rx=0 tx=0).stop 2024-09-21T05:55:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.298+0000 7f744357b640 1 -- 172.21.15.7:0/481195544 shutdown_connections 2024-09-21T05:55:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.298+0000 7f744357b640 1 --2- 172.21.15.7:0/481195544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c10dd90 0x7f743c110270 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.298+0000 7f744357b640 1 --2- 172.21.15.7:0/481195544 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f743c1052c0 0x7f743c10d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.298+0000 7f744357b640 1 --2- 172.21.15.7:0/481195544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743c104970 0x7f743c104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.298+0000 7f744357b640 1 -- 172.21.15.7:0/481195544 >> 172.21.15.7:0/481195544 conn(0x7f743c0fe3c0 msgr2=0x7f743c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.298+0000 7f744357b640 1 -- 172.21.15.7:0/481195544 shutdown_connections 2024-09-21T05:55:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.298+0000 7f744357b640 1 -- 172.21.15.7:0/481195544 wait complete. 2024-09-21T05:55:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.299+0000 7f744357b640 1 Processor -- start 2024-09-21T05:55:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.299+0000 7f744357b640 1 -- start start 2024-09-21T05:55:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.299+0000 7f744357b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743c104970 0x7f743c198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f744357b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c1052c0 0x7f743c198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f744357b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f743c10dd90 0x7f743c19d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f744357b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1117f0 con 0x7f743c1052c0 2024-09-21T05:55:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f744357b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f743c111670 con 0x7f743c10dd90 2024-09-21T05:55:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f744357b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f743c111970 con 0x7f743c104970 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f7440b16640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c1052c0 0x7f743c198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f7441317640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743c104970 0x7f743c198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f7441317640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743c104970 0x7f743c198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:35126/0 (socket says 172.21.15.7:35126) 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f7440b16640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c1052c0 0x7f743c198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39264/0 (socket says 172.21.15.7:39264) 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f7441317640 1 -- 172.21.15.7:0/1040369455 learned_addr learned my addr 172.21.15.7:0/1040369455 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f7441b18640 1 --2- 172.21.15.7:0/1040369455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f743c10dd90 0x7f743c19d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f7441317640 1 -- 172.21.15.7:0/1040369455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f743c10dd90 msgr2=0x7f743c19d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f7441317640 1 --2- 172.21.15.7:0/1040369455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f743c10dd90 0x7f743c19d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f7441317640 1 -- 172.21.15.7:0/1040369455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c1052c0 msgr2=0x7f743c198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f7441317640 1 --2- 172.21.15.7:0/1040369455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c1052c0 0x7f743c198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f7441317640 1 -- 172.21.15.7:0/1040369455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743c19e0a0 con 0x7f743c104970 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.300+0000 7f7441317640 1 --2- 172.21.15.7:0/1040369455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743c104970 0x7f743c198170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f743800ea60 tx=0x7f743800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.301+0000 7f74327fc640 1 -- 172.21.15.7:0/1040369455 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743800cde0 con 0x7f743c104970 2024-09-21T05:55:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.301+0000 7f744357b640 1 -- 172.21.15.7:0/1040369455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743c19e390 con 0x7f743c104970 2024-09-21T05:55:16.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.301+0000 7f74327fc640 1 -- 172.21.15.7:0/1040369455 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74380035f0 con 0x7f743c104970 2024-09-21T05:55:16.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.301+0000 7f74327fc640 1 -- 172.21.15.7:0/1040369455 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7438010690 con 0x7f743c104970 2024-09-21T05:55:16.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.301+0000 7f744357b640 1 -- 172.21.15.7:0/1040369455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f743c1a4b20 con 0x7f743c104970 2024-09-21T05:55:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.303+0000 7f744a5c7740 1 Processor -- start 2024-09-21T05:55:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.303+0000 7f744a5c7740 1 -- start start 2024-09-21T05:55:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f744a5c7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89cb1b0 0x557cd8d709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f744a5c7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89a22f0 0x557cd8d70ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f744a5c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89aa4d0 0x557cd8d71430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f744a5c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557cd8ce56f0 con 0x557cd89aa4d0 2024-09-21T05:55:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f744a5c7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x557cd8cd4b20 con 0x557cd89a22f0 2024-09-21T05:55:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f744a5c7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557cd8cd8930 con 0x557cd89cb1b0 2024-09-21T05:55:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f7440b16640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89aa4d0 0x557cd8d71430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f74327fc640 1 -- 172.21.15.7:0/1040369455 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f74380037a0 con 0x7f743c104970 2024-09-21T05:55:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f7440b16640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89aa4d0 0x557cd8d71430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39268/0 (socket says 172.21.15.7:39268) 2024-09-21T05:55:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f7440b16640 1 -- 172.21.15.7:0/3880052813 learned_addr learned my addr 172.21.15.7:0/3880052813 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f7441b18640 1 --2- 172.21.15.7:0/3880052813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89cb1b0 0x557cd8d709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f7441317640 1 --2- 172.21.15.7:0/3880052813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89a22f0 0x557cd8d70ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f7440b16640 1 -- 172.21.15.7:0/3880052813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89cb1b0 msgr2=0x557cd8d709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f7440b16640 1 --2- 172.21.15.7:0/3880052813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89cb1b0 0x557cd8d709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f7440b16640 1 -- 172.21.15.7:0/3880052813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89a22f0 msgr2=0x557cd8d70ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f7440b16640 1 --2- 172.21.15.7:0/3880052813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89a22f0 0x557cd8d70ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.304+0000 7f7440b16640 1 -- 172.21.15.7:0/3880052813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cd8c9a530 con 0x557cd89aa4d0 2024-09-21T05:55:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.305+0000 7f7440b16640 1 --2- 172.21.15.7:0/3880052813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89aa4d0 0x557cd8d71430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f742c009c20 tx=0x7f742c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c7e9564c332e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.305+0000 7f74277fe640 1 -- 172.21.15.7:0/3880052813 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c004230 con 0x557cd89aa4d0 2024-09-21T05:55:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.305+0000 7f74277fe640 1 -- 172.21.15.7:0/3880052813 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f742c0043d0 con 0x557cd89aa4d0 2024-09-21T05:55:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.305+0000 7f74277fe640 1 -- 172.21.15.7:0/3880052813 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c004d40 con 0x557cd89aa4d0 2024-09-21T05:55:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.305+0000 7f74327fc640 1 --2- 172.21.15.7:0/1040369455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f74280b6680 0x7f74280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.305+0000 7f7441b18640 1 --2- 172.21.15.7:0/1040369455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f74280b6680 0x7f74280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.305+0000 7f74327fc640 1 -- 172.21.15.7:0/1040369455 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f74380e7990 con 0x7f743c104970 2024-09-21T05:55:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.306+0000 7f744a5c7740 1 -- 172.21.15.7:0/3880052813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89aa4d0 msgr2=0x557cd8d71430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.306+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3880052813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89aa4d0 0x557cd8d71430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f742c009c20 tx=0x7f742c011810 comp rx=0 tx=0).stop 2024-09-21T05:55:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.306+0000 7f7441b18640 1 --2- 172.21.15.7:0/1040369455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f74280b6680 0x7f74280b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f74340094e0 tx=0x7f7434040040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.306+0000 7f744a5c7740 1 -- 172.21.15.7:0/3880052813 shutdown_connections 2024-09-21T05:55:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.306+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3880052813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89aa4d0 0x557cd8d71430 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.306+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3880052813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89a22f0 0x557cd8d70ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.306+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3880052813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89cb1b0 0x557cd8d709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.306+0000 7f744a5c7740 1 -- 172.21.15.7:0/3880052813 >> 172.21.15.7:0/3880052813 conn(0x557cd89bf300 msgr2=0x557cd8d6e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.306+0000 7f744a5c7740 1 -- 172.21.15.7:0/3880052813 shutdown_connections 2024-09-21T05:55:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.306+0000 7f744a5c7740 1 -- 172.21.15.7:0/3880052813 wait complete. 2024-09-21T05:55:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f744a5c7740 1 -- start start 2024-09-21T05:55:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f744a5c7740 1 Processor -- start 2024-09-21T05:55:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f744a5c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d7c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f744a5c7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 0x557cd8d7c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f744a5c7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 0x557cd8d88420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f744a5c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557cd8c0cab0 con 0x557cd89a22f0 2024-09-21T05:55:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f744a5c7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x557cd8c7a730 con 0x557cd89cb1b0 2024-09-21T05:55:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f744a5c7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557cd8d7f130 con 0x557cd89aa4d0 2024-09-21T05:55:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f7441317640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d7c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f744a5c7740 10 client.0 _ll_register_callbacks cb 0x557cd8cce6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f7441317640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d7c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39282/0 (socket says 172.21.15.7:39282) 2024-09-21T05:55:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f7441317640 1 -- 172.21.15.7:0/3888931522 learned_addr learned my addr 172.21.15.7:0/3888931522 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f7440b16640 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 0x557cd8d7c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.307+0000 7f7441b18640 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 0x557cd8d88420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.308+0000 7f7440b16640 1 -- 172.21.15.7:0/3888931522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 msgr2=0x557cd8d88420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.308+0000 7f7440b16640 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 0x557cd8d88420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.308+0000 7f7440b16640 1 -- 172.21.15.7:0/3888931522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 msgr2=0x557cd8d7c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.308+0000 7f7440b16640 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d7c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.308+0000 7f7440b16640 1 -- 172.21.15.7:0/3888931522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cd8a36790 con 0x557cd89aa4d0 2024-09-21T05:55:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.308+0000 7f7441317640 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d7c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.308+0000 7f7440b16640 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 0x557cd8d7c550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f742c011d10 tx=0x7f742c019b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bda981369049d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.308+0000 7f7424ff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:55:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.308+0000 7f7424ff9640 1 -- 172.21.15.7:0/3888931522 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c028020 con 0x557cd89aa4d0 2024-09-21T05:55:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.308+0000 7f7424ff9640 1 -- 172.21.15.7:0/3888931522 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f742c024620 con 0x557cd89aa4d0 2024-09-21T05:55:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.308+0000 7f744a5c7740 1 -- 172.21.15.7:0/3888931522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f742c0043d0 con 0x557cd89aa4d0 2024-09-21T05:55:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.308+0000 7f7424ff9640 1 -- 172.21.15.7:0/3888931522 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f742c033050 con 0x557cd89aa4d0 2024-09-21T05:55:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.308+0000 7f744a5c7740 10 client.25513 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.309+0000 7f744a5c7740 1 -- 172.21.15.7:0/3888931522 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557cd8aaf620 con 0x557cd89aa4d0 2024-09-21T05:55:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.309+0000 7f7424ff9640 1 -- 172.21.15.7:0/3888931522 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f742c0043d0 con 0x557cd89aa4d0 2024-09-21T05:55:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.309+0000 7f7424ff9640 1 -- 172.21.15.7:0/3888931522 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f742c018070 con 0x557cd89aa4d0 2024-09-21T05:55:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.309+0000 7f744a5c7740 10 client.25513 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.309+0000 7f744a5c7740 10 client.25513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.309+0000 7f744a5c7740 20 client.25513 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.309+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557cd8989d80 0x557cd8d8e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.309+0000 7f744a5c7740 4 client.25513 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.309+0000 7f744a5c7740 1 -- 172.21.15.7:0/3888931522 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cd8ce7640 con 0x557cd8989d80 2024-09-21T05:55:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.310+0000 7f7441317640 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557cd8989d80 0x557cd8d8e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.310+0000 7f7424ff9640 10 client.25513 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.310+0000 7f7441317640 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557cd8989d80 0x557cd8d8e040 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d450121a588d4a2 server_cookie=bda756cd73cd0fa1 in_seq=0 out_seq=0 2024-09-21T05:55:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f7424ff9640 1 -- 172.21.15.7:0/3888931522 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557cd8ce7640 con 0x557cd8989d80 2024-09-21T05:55:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f7424ff9640 10 client.25513 handle_command_reply: tid=0 2024-09-21T05:55:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f744a5c7740 1 client.25513 shutdown 2024-09-21T05:55:16.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f744a5c7740 1 -- 172.21.15.7:0/3888931522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 msgr2=0x557cd8d7c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 0x557cd8d7c550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f742c011d10 tx=0x7f742c019b80 comp rx=0 tx=0).stop 2024-09-21T05:55:16.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f744a5c7740 1 -- 172.21.15.7:0/3888931522 shutdown_connections 2024-09-21T05:55:16.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557cd8989d80 0x557cd8d8e040 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 0x557cd8d88420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 0x557cd8d7c550 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f7424ff9640 0 client.25513 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:16.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3888931522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d7c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f744a5c7740 1 -- 172.21.15.7:0/3888931522 >> 172.21.15.7:0/3888931522 conn(0x557cd89bf300 msgr2=0x557cd8d719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:16.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f744a5c7740 1 -- 172.21.15.7:0/3888931522 shutdown_connections 2024-09-21T05:55:16.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f744a5c7740 1 -- 172.21.15.7:0/3888931522 wait complete. 2024-09-21T05:55:16.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.311+0000 7f744a5c7740 20 client.25513 trim_cache size 0 max 16384 2024-09-21T05:55:16.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.328+0000 7f744a5c7740 1 Processor -- start 2024-09-21T05:55:16.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.328+0000 7f744a5c7740 1 -- start start 2024-09-21T05:55:16.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.328+0000 7f744a5c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.328+0000 7f744a5c7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 0x557cd8d791e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.328+0000 7f744a5c7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 0x557cd8d79720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.328+0000 7f744a5c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1afba0 con 0x557cd89a22f0 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.328+0000 7f744a5c7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1ad470 con 0x557cd89cb1b0 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.328+0000 7f744a5c7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1ab2c0 con 0x557cd89aa4d0 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.328+0000 7f7441317640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.328+0000 7f7441317640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39288/0 (socket says 172.21.15.7:39288) 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.328+0000 7f7441317640 1 -- 172.21.15.7:0/1008316650 learned_addr learned my addr 172.21.15.7:0/1008316650 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.328+0000 7f7441b18640 1 --2- 172.21.15.7:0/1008316650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 0x557cd8d79720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.329+0000 7f7440b16640 1 --2- 172.21.15.7:0/1008316650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 0x557cd8d791e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.329+0000 7f7441317640 1 -- 172.21.15.7:0/1008316650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 msgr2=0x557cd8d791e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.329+0000 7f7441317640 1 --2- 172.21.15.7:0/1008316650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 0x557cd8d791e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.329+0000 7f7441317640 1 -- 172.21.15.7:0/1008316650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 msgr2=0x557cd8d79720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.329+0000 7f7441317640 1 --2- 172.21.15.7:0/1008316650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 0x557cd8d79720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.329+0000 7f7441317640 1 -- 172.21.15.7:0/1008316650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cd8d7c880 con 0x557cd89a22f0 2024-09-21T05:55:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.329+0000 7f7441317640 1 --2- 172.21.15.7:0/1008316650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d720f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f74380ad560 tx=0x7f743800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8194f162af5f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.329+0000 7f7426ffd640 1 -- 172.21.15.7:0/1008316650 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74380b2070 con 0x557cd89a22f0 2024-09-21T05:55:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.329+0000 7f7426ffd640 1 -- 172.21.15.7:0/1008316650 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74380ad370 con 0x557cd89a22f0 2024-09-21T05:55:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.329+0000 7f7426ffd640 1 -- 172.21.15.7:0/1008316650 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74380b2340 con 0x557cd89a22f0 2024-09-21T05:55:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.330+0000 7f744a5c7740 1 -- 172.21.15.7:0/1008316650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 msgr2=0x557cd8d720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.330+0000 7f744a5c7740 1 --2- 172.21.15.7:0/1008316650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d720f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f74380ad560 tx=0x7f743800ef90 comp rx=0 tx=0).stop 2024-09-21T05:55:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.330+0000 7f744a5c7740 1 -- 172.21.15.7:0/1008316650 shutdown_connections 2024-09-21T05:55:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.330+0000 7f744a5c7740 1 --2- 172.21.15.7:0/1008316650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 0x557cd8d79720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.330+0000 7f744a5c7740 1 --2- 172.21.15.7:0/1008316650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 0x557cd8d791e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.330+0000 7f744a5c7740 1 --2- 172.21.15.7:0/1008316650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d720f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.330+0000 7f744a5c7740 1 -- 172.21.15.7:0/1008316650 >> 172.21.15.7:0/1008316650 conn(0x557cd89bf300 msgr2=0x557cd8d719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.330+0000 7f744a5c7740 1 -- 172.21.15.7:0/1008316650 shutdown_connections 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.330+0000 7f744a5c7740 1 -- 172.21.15.7:0/1008316650 wait complete. 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f744a5c7740 1 -- start start 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f744a5c7740 1 Processor -- start 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f744a5c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d81320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f744a5c7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 0x557cd8d81860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f744a5c7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 0x557cd8d81da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f744a5c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1ab930 con 0x557cd89a22f0 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f744a5c7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1acda0 con 0x557cd89cb1b0 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f744a5c7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1ac000 con 0x557cd89aa4d0 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f744a5c7740 10 client.0 _ll_register_callbacks cb 0x7f7438005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f7441317640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d81320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f7441317640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d81320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39300/0 (socket says 172.21.15.7:39300) 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f7441317640 1 -- 172.21.15.7:0/3049083059 learned_addr learned my addr 172.21.15.7:0/3049083059 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f7440b16640 1 --2- 172.21.15.7:0/3049083059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 0x557cd8d81860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.331+0000 7f7441b18640 1 --2- 172.21.15.7:0/3049083059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 0x557cd8d81da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f7441317640 1 -- 172.21.15.7:0/3049083059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 msgr2=0x557cd8d81860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f7441317640 1 --2- 172.21.15.7:0/3049083059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 0x557cd8d81860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f7441317640 1 -- 172.21.15.7:0/3049083059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 msgr2=0x557cd8d81da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f7441317640 1 --2- 172.21.15.7:0/3049083059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 0x557cd8d81da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f7441317640 1 -- 172.21.15.7:0/3049083059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cd8df68f0 con 0x557cd89a22f0 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f7441317640 1 --2- 172.21.15.7:0/3049083059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d81320 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f74380a9e30 tx=0x7f74380ad6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5363f696c215e8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f7424ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f7424ff9640 1 -- 172.21.15.7:0/3049083059 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74380adf60 con 0x557cd89a22f0 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f7424ff9640 1 -- 172.21.15.7:0/3049083059 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f74380aeb90 con 0x557cd89a22f0 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f744a5c7740 1 -- 172.21.15.7:0/3049083059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74380ad370 con 0x557cd89a22f0 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f7424ff9640 1 -- 172.21.15.7:0/3049083059 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f74380b7280 con 0x557cd89a22f0 2024-09-21T05:55:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f744a5c7740 10 client.15870 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f744a5c7740 1 -- 172.21.15.7:0/3049083059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557cd8df7b50 con 0x557cd89a22f0 2024-09-21T05:55:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.332+0000 7f7424ff9640 1 -- 172.21.15.7:0/3049083059 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74380ad370 con 0x557cd89a22f0 2024-09-21T05:55:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.333+0000 7f7424ff9640 1 -- 172.21.15.7:0/3049083059 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f74380a91b0 con 0x557cd89a22f0 2024-09-21T05:55:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.333+0000 7f744a5c7740 10 client.15870 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.333+0000 7f744a5c7740 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.333+0000 7f744a5c7740 20 client.15870 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.333+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3049083059 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557cd895f1c0 0x557cd8dfa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.333+0000 7f744a5c7740 4 client.15870 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T05:55:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.333+0000 7f744a5c7740 1 -- 172.21.15.7:0/3049083059 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557cd8ce30f0 con 0x557cd895f1c0 2024-09-21T05:55:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.333+0000 7f7440b16640 1 --2- 172.21.15.7:0/3049083059 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557cd895f1c0 0x557cd8dfa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.333+0000 7f7424ff9640 10 client.15870 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.333+0000 7f7440b16640 1 --2- 172.21.15.7:0/3049083059 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557cd895f1c0 0x557cd8dfa340 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d94f97488b77ba4 server_cookie=972de8f3317c5781 in_seq=0 out_seq=0 2024-09-21T05:55:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f7424ff9640 1 -- 172.21.15.7:0/3049083059 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557cd8ce30f0 con 0x557cd895f1c0 2024-09-21T05:55:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f7424ff9640 10 client.15870 handle_command_reply: tid=0 2024-09-21T05:55:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f744a5c7740 1 client.15870 shutdown 2024-09-21T05:55:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f744a5c7740 1 -- 172.21.15.7:0/3049083059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 msgr2=0x557cd8d81320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3049083059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d81320 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f74380a9e30 tx=0x7f74380ad6a0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f744a5c7740 1 -- 172.21.15.7:0/3049083059 shutdown_connections 2024-09-21T05:55:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3049083059 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557cd895f1c0 0x557cd8dfa340 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3049083059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557cd89cb1b0 0x557cd8d81da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3049083059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557cd89aa4d0 0x557cd8d81860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f744a5c7740 1 --2- 172.21.15.7:0/3049083059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557cd89a22f0 0x557cd8d81320 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f744a5c7740 1 -- 172.21.15.7:0/3049083059 >> 172.21.15.7:0/3049083059 conn(0x557cd89bf300 msgr2=0x557cd8d6e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f7424ff9640 0 client.15870 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f744a5c7740 1 -- 172.21.15.7:0/3049083059 shutdown_connections 2024-09-21T05:55:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f744a5c7740 1 -- 172.21.15.7:0/3049083059 wait complete. 2024-09-21T05:55:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.344+0000 7f744a5c7740 20 client.15870 trim_cache size 0 max 16384 2024-09-21T05:55:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T05:55:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T05:55:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T05:55:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T05:55:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.345+0000 7f744357b640 1 -- 172.21.15.7:0/1040369455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f74280b6680 msgr2=0x7f74280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.345+0000 7f744357b640 1 --2- 172.21.15.7:0/1040369455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f74280b6680 0x7f74280b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f74340094e0 tx=0x7f7434040040 comp rx=0 tx=0).stop 2024-09-21T05:55:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.345+0000 7f744357b640 1 -- 172.21.15.7:0/1040369455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743c104970 msgr2=0x7f743c198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.345+0000 7f744357b640 1 --2- 172.21.15.7:0/1040369455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743c104970 0x7f743c198170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f743800ea60 tx=0x7f743800ef20 comp rx=0 tx=0).stop 2024-09-21T05:55:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.345+0000 7f744357b640 1 -- 172.21.15.7:0/1040369455 shutdown_connections 2024-09-21T05:55:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.345+0000 7f744357b640 1 --2- 172.21.15.7:0/1040369455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f74280b6680 0x7f74280b8b90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.345+0000 7f744357b640 1 --2- 172.21.15.7:0/1040369455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c1052c0 0x7f743c198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.345+0000 7f744357b640 1 --2- 172.21.15.7:0/1040369455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f743c10dd90 0x7f743c19d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.345+0000 7f744357b640 1 --2- 172.21.15.7:0/1040369455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f743c104970 0x7f743c198170 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.345+0000 7f744357b640 1 -- 172.21.15.7:0/1040369455 >> 172.21.15.7:0/1040369455 conn(0x7f743c0fe3c0 msgr2=0x7f743c107850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.345+0000 7f744357b640 1 -- 172.21.15.7:0/1040369455 shutdown_connections 2024-09-21T05:55:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:16.345+0000 7f744357b640 1 -- 172.21.15.7:0/1040369455 wait complete. 2024-09-21T05:55:17.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:17 smithi027 ceph-mon[34364]: pgmap v360: 97 pgs: 97 active+clean; 258 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.6 MiB/s wr, 725 op/s 2024-09-21T05:55:18.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:17 smithi007 ceph-mon[30983]: pgmap v360: 97 pgs: 97 active+clean; 258 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.6 MiB/s wr, 725 op/s 2024-09-21T05:55:18.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:17 smithi119 ceph-mon[34833]: pgmap v360: 97 pgs: 97 active+clean; 258 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.6 MiB/s wr, 725 op/s 2024-09-21T05:55:19.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:19 smithi027 ceph-mon[34364]: pgmap v361: 97 pgs: 97 active+clean; 259 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.4 MiB/s wr, 676 op/s 2024-09-21T05:55:20.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:19 smithi007 ceph-mon[30983]: pgmap v361: 97 pgs: 97 active+clean; 259 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.4 MiB/s wr, 676 op/s 2024-09-21T05:55:20.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:19 smithi119 ceph-mon[34833]: pgmap v361: 97 pgs: 97 active+clean; 259 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.4 MiB/s wr, 676 op/s 2024-09-21T05:55:21.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:21 smithi027 ceph-mon[34364]: pgmap v362: 97 pgs: 97 active+clean; 259 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.0 MiB/s wr, 1.04k op/s 2024-09-21T05:55:22.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:21 smithi007 ceph-mon[30983]: pgmap v362: 97 pgs: 97 active+clean; 259 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.0 MiB/s wr, 1.04k op/s 2024-09-21T05:55:22.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:21 smithi119 ceph-mon[34833]: pgmap v362: 97 pgs: 97 active+clean; 259 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.0 MiB/s wr, 1.04k op/s 2024-09-21T05:55:23.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:23 smithi027 ceph-mon[34364]: pgmap v363: 97 pgs: 97 active+clean; 259 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.2 MiB/s wr, 931 op/s 2024-09-21T05:55:24.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:23 smithi007 ceph-mon[30983]: pgmap v363: 97 pgs: 97 active+clean; 259 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.2 MiB/s wr, 931 op/s 2024-09-21T05:55:24.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:23 smithi119 ceph-mon[34833]: pgmap v363: 97 pgs: 97 active+clean; 259 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.2 MiB/s wr, 931 op/s 2024-09-21T05:55:25.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:25 smithi027 ceph-mon[34364]: pgmap v364: 97 pgs: 97 active+clean; 319 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 2.30k op/s 2024-09-21T05:55:26.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:25 smithi007 ceph-mon[30983]: pgmap v364: 97 pgs: 97 active+clean; 319 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 2.30k op/s 2024-09-21T05:55:26.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:25 smithi119 ceph-mon[34833]: pgmap v364: 97 pgs: 97 active+clean; 319 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 2.30k op/s 2024-09-21T05:55:27.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:27 smithi027 ceph-mon[34364]: pgmap v365: 97 pgs: 97 active+clean; 394 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 2.85k op/s 2024-09-21T05:55:28.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:27 smithi007 ceph-mon[30983]: pgmap v365: 97 pgs: 97 active+clean; 394 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 2.85k op/s 2024-09-21T05:55:28.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:27 smithi119 ceph-mon[34833]: pgmap v365: 97 pgs: 97 active+clean; 394 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 2.85k op/s 2024-09-21T05:55:29.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.451+0000 7f5e00c15640 1 -- 172.21.15.7:0/3411421891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dfc105260 msgr2=0x7f5dfc10d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:29.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.451+0000 7f5e00c15640 1 --2- 172.21.15.7:0/3411421891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dfc105260 0x7f5dfc10d7a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009900 tx=0x7f5df002a410 comp rx=0 tx=0).stop 2024-09-21T05:55:29.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.451+0000 7f5e00c15640 1 -- 172.21.15.7:0/3411421891 shutdown_connections 2024-09-21T05:55:29.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.451+0000 7f5e00c15640 1 --2- 172.21.15.7:0/3411421891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dfc105260 0x7f5dfc10d7a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.451+0000 7f5e00c15640 1 --2- 172.21.15.7:0/3411421891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dfc10dd70 0x7f5dfc110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.451+0000 7f5e00c15640 1 --2- 172.21.15.7:0/3411421891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dfc104910 0x7f5dfc104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.451+0000 7f5e00c15640 1 -- 172.21.15.7:0/3411421891 >> 172.21.15.7:0/3411421891 conn(0x7f5dfc0fe3c0 msgr2=0x7f5dfc100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:29.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.451+0000 7f5e00c15640 1 -- 172.21.15.7:0/3411421891 shutdown_connections 2024-09-21T05:55:29.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.451+0000 7f5e00c15640 1 -- 172.21.15.7:0/3411421891 wait complete. 2024-09-21T05:55:29.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.452+0000 7f5e00c15640 1 Processor -- start 2024-09-21T05:55:29.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.452+0000 7f5e00c15640 1 -- start start 2024-09-21T05:55:29.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.452+0000 7f5e00c15640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dfc104910 0x7f5dfc19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.452+0000 7f5e00c15640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dfc105260 0x7f5dfc19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.452+0000 7f5e00c15640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dfc10dd70 0x7f5dfc19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.452+0000 7f5e00c15640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1139d0 con 0x7f5dfc105260 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.452+0000 7f5e00c15640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc113850 con 0x7f5dfc10dd70 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.452+0000 7f5e00c15640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc113b50 con 0x7f5dfc104910 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5df9d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dfc105260 0x7f5dfc19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5dfa59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dfc104910 0x7f5dfc19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5dfa59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dfc104910 0x7f5dfc19a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:46990/0 (socket says 172.21.15.7:46990) 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5df9d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dfc105260 0x7f5dfc19a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46112/0 (socket says 172.21.15.7:46112) 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5dfa59c640 1 -- 172.21.15.7:0/53645565 learned_addr learned my addr 172.21.15.7:0/53645565 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dfc10dd70 0x7f5dfc19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5dfa59c640 1 -- 172.21.15.7:0/53645565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dfc10dd70 msgr2=0x7f5dfc19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5dfa59c640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dfc10dd70 0x7f5dfc19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5dfa59c640 1 -- 172.21.15.7:0/53645565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dfc105260 msgr2=0x7f5dfc19a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5dfa59c640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dfc105260 0x7f5dfc19a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5dfa59c640 1 -- 172.21.15.7:0/53645565 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc1a0340 con 0x7f5dfc104910 2024-09-21T05:55:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dfc10dd70 0x7f5dfc19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5df9d9b640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dfc105260 0x7f5dfc19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.453+0000 7f5dfa59c640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dfc104910 0x7f5dfc19a410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00d950 tx=0x7f5dec00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.454+0000 7f5deb7fe640 1 -- 172.21.15.7:0/53645565 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec017030 con 0x7f5dfc104910 2024-09-21T05:55:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.454+0000 7f5deb7fe640 1 -- 172.21.15.7:0/53645565 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dec004020 con 0x7f5dfc104910 2024-09-21T05:55:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.454+0000 7f5e00c15640 1 -- 172.21.15.7:0/53645565 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dfc1a0630 con 0x7f5dfc104910 2024-09-21T05:55:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.454+0000 7f5deb7fe640 1 -- 172.21.15.7:0/53645565 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec0047a0 con 0x7f5dfc104910 2024-09-21T05:55:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.454+0000 7f5e00c15640 1 -- 172.21.15.7:0/53645565 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dfc1a6dc0 con 0x7f5dfc104910 2024-09-21T05:55:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.456+0000 7f5e07c61740 1 Processor -- start 2024-09-21T05:55:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.457+0000 7f5e07c61740 1 -- start start 2024-09-21T05:55:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.457+0000 7f5e07c61740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.457+0000 7f5e07c61740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fd82f0 0x5631253a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.457+0000 7f5e07c61740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fe04d0 0x5631253a7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.457+0000 7f5deb7fe640 1 -- 172.21.15.7:0/53645565 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f5dec004940 con 0x7f5dfc104910 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.457+0000 7f5e07c61740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56312531b6f0 con 0x5631250011b0 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.457+0000 7f5e07c61740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56312530ab20 con 0x563124fd82f0 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.457+0000 7f5e07c61740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56312530e930 con 0x563124fe04d0 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.457+0000 7f5df9d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fe04d0 0x5631253a7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.457+0000 7f5dfad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.457+0000 7f5df9d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fe04d0 0x5631253a7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:47006/0 (socket says 172.21.15.7:47006) 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.457+0000 7f5df9d9b640 1 -- 172.21.15.7:0/2373950821 learned_addr learned my addr 172.21.15.7:0/2373950821 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.457+0000 7f5dfa59c640 1 --2- 172.21.15.7:0/2373950821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fd82f0 0x5631253a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.458+0000 7f5df9d9b640 1 -- 172.21.15.7:0/2373950821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fd82f0 msgr2=0x5631253a6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.458+0000 7f5df9d9b640 1 --2- 172.21.15.7:0/2373950821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fd82f0 0x5631253a6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.458+0000 7f5df9d9b640 1 -- 172.21.15.7:0/2373950821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 msgr2=0x5631253a69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.458+0000 7f5df9d9b640 1 --2- 172.21.15.7:0/2373950821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253a69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.458+0000 7f5df9d9b640 1 -- 172.21.15.7:0/2373950821 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631252d0530 con 0x563124fe04d0 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.458+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/2373950821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253a69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.458+0000 7f5dfa59c640 1 --2- 172.21.15.7:0/2373950821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fd82f0 0x5631253a6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.458+0000 7f5df9d9b640 1 --2- 172.21.15.7:0/2373950821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fe04d0 0x5631253a7430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009900 tx=0x7f5df0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58d9f628b7f98497 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.458+0000 7f5deb7fe640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5de40b6680 0x7f5de40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.458+0000 7f5de8ff9640 1 -- 172.21.15.7:0/2373950821 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0035040 con 0x563124fe04d0 2024-09-21T05:55:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.458+0000 7f5de8ff9640 1 -- 172.21.15.7:0/2373950821 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df00317a0 con 0x563124fe04d0 2024-09-21T05:55:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.458+0000 7f5de8ff9640 1 -- 172.21.15.7:0/2373950821 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0004990 con 0x563124fe04d0 2024-09-21T05:55:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.459+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5de40b6680 0x7f5de40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.459+0000 7f5deb7fe640 1 -- 172.21.15.7:0/53645565 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f5dec0e7040 con 0x7f5dfc104910 2024-09-21T05:55:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.460+0000 7f5e07c61740 1 -- 172.21.15.7:0/2373950821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fe04d0 msgr2=0x5631253a7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.460+0000 7f5e07c61740 1 --2- 172.21.15.7:0/2373950821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fe04d0 0x5631253a7430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009900 tx=0x7f5df0000bc0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.460+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5de40b6680 0x7f5de40b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009fd0 tx=0x7f5df4009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.460+0000 7f5e07c61740 1 -- 172.21.15.7:0/2373950821 shutdown_connections 2024-09-21T05:55:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.460+0000 7f5e07c61740 1 --2- 172.21.15.7:0/2373950821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fe04d0 0x5631253a7430 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.460+0000 7f5e07c61740 1 --2- 172.21.15.7:0/2373950821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fd82f0 0x5631253a6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.460+0000 7f5e07c61740 1 --2- 172.21.15.7:0/2373950821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253a69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.460+0000 7f5e07c61740 1 -- 172.21.15.7:0/2373950821 >> 172.21.15.7:0/2373950821 conn(0x563124ff5300 msgr2=0x5631253a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.460+0000 7f5e07c61740 1 -- 172.21.15.7:0/2373950821 shutdown_connections 2024-09-21T05:55:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.460+0000 7f5e07c61740 1 -- 172.21.15.7:0/2373950821 wait complete. 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.461+0000 7f5e07c61740 1 -- start start 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.461+0000 7f5e07c61740 1 Processor -- start 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.461+0000 7f5e07c61740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.461+0000 7f5e07c61740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 0x5631253b6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.461+0000 7f5e07c61740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.461+0000 7f5e07c61740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563125242ab0 con 0x5631250011b0 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.461+0000 7f5e07c61740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5631252b0730 con 0x563124fe04d0 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.461+0000 7f5e07c61740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5631253b94b0 con 0x563124fd82f0 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.461+0000 7f5e07c61740 10 client.0 _ll_register_callbacks cb 0x5631253046b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5dfad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5dfa59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5dfad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253c27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46128/0 (socket says 172.21.15.7:46128) 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5dfad9d640 1 -- 172.21.15.7:0/3624160829 learned_addr learned my addr 172.21.15.7:0/3624160829 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5df9d9b640 1 --2- 172.21.15.7:0/3624160829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 0x5631253b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5dfad9d640 1 -- 172.21.15.7:0/3624160829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 msgr2=0x5631253b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/3624160829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5dfad9d640 1 -- 172.21.15.7:0/3624160829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 msgr2=0x5631253b6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/3624160829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 0x5631253b6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5dfad9d640 1 -- 172.21.15.7:0/3624160829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56312506c790 con 0x5631250011b0 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5dfa59c640 1 --2- 172.21.15.7:0/3624160829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/3624160829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253c27e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5df4012910 tx=0x7f5df4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5d59d4c1f76a20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5de1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5de1ffb640 1 -- 172.21.15.7:0/3624160829 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4011c90 con 0x5631250011b0 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5de1ffb640 1 -- 172.21.15.7:0/3624160829 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f5df401f420 con 0x5631250011b0 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.462+0000 7f5e07c61740 1 -- 172.21.15.7:0/3624160829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5df00317a0 con 0x5631250011b0 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.463+0000 7f5de1ffb640 1 -- 172.21.15.7:0/3624160829 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5df4011e30 con 0x5631250011b0 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.463+0000 7f5e07c61740 10 client.15882 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.463+0000 7f5e07c61740 1 -- 172.21.15.7:0/3624160829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5631250e5620 con 0x5631250011b0 2024-09-21T05:55:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.463+0000 7f5de1ffb640 1 -- 172.21.15.7:0/3624160829 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df00317a0 con 0x5631250011b0 2024-09-21T05:55:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.463+0000 7f5de1ffb640 1 -- 172.21.15.7:0/3624160829 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5df4027070 con 0x5631250011b0 2024-09-21T05:55:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.463+0000 7f5e07c61740 10 client.15882 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.463+0000 7f5e07c61740 10 client.15882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.463+0000 7f5e07c61740 20 client.15882 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.463+0000 7f5e07c61740 1 --2- 172.21.15.7:0/3624160829 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563124fbfd80 0x5631253c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.463+0000 7f5e07c61740 4 client.15882 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.463+0000 7f5e07c61740 1 -- 172.21.15.7:0/3624160829 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56312531d640 con 0x563124fbfd80 2024-09-21T05:55:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.464+0000 7f5dfa59c640 1 --2- 172.21.15.7:0/3624160829 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563124fbfd80 0x5631253c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.464+0000 7f5dfa59c640 1 --2- 172.21.15.7:0/3624160829 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563124fbfd80 0x5631253c85e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d6c08b389b02748 server_cookie=daaafa7b339d0afd in_seq=0 out_seq=0 2024-09-21T05:55:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.464+0000 7f5de1ffb640 10 client.15882 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5de1ffb640 1 -- 172.21.15.7:0/3624160829 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56312531d640 con 0x563124fbfd80 2024-09-21T05:55:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5de1ffb640 10 client.15882 handle_command_reply: tid=0 2024-09-21T05:55:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5e07c61740 1 client.15882 shutdown 2024-09-21T05:55:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5e07c61740 1 -- 172.21.15.7:0/3624160829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 msgr2=0x5631253c27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5e07c61740 1 --2- 172.21.15.7:0/3624160829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253c27e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5df4012910 tx=0x7f5df4004ab0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5e07c61740 1 -- 172.21.15.7:0/3624160829 shutdown_connections 2024-09-21T05:55:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5e07c61740 1 --2- 172.21.15.7:0/3624160829 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563124fbfd80 0x5631253c85e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5e07c61740 1 --2- 172.21.15.7:0/3624160829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253c27e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5e07c61740 1 --2- 172.21.15.7:0/3624160829 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 0x5631253b6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5e07c61740 1 --2- 172.21.15.7:0/3624160829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5de1ffb640 0 client.15882 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5e07c61740 1 -- 172.21.15.7:0/3624160829 >> 172.21.15.7:0/3624160829 conn(0x563124ff5300 msgr2=0x5631253a9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5e07c61740 1 -- 172.21.15.7:0/3624160829 shutdown_connections 2024-09-21T05:55:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5e07c61740 1 -- 172.21.15.7:0/3624160829 wait complete. 2024-09-21T05:55:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.465+0000 7f5e07c61740 20 client.15882 trim_cache size 0 max 16384 2024-09-21T05:55:29.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.480+0000 7f5e07c61740 1 Processor -- start 2024-09-21T05:55:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.480+0000 7f5e07c61740 1 -- start start 2024-09-21T05:55:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5e07c61740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5e07c61740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 0x5631253c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5e07c61740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5e07c61740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1afbc0 con 0x5631250011b0 2024-09-21T05:55:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5e07c61740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1ad490 con 0x563124fe04d0 2024-09-21T05:55:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5e07c61740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1ab2e0 con 0x563124fd82f0 2024-09-21T05:55:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5dfad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5dfad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46142/0 (socket says 172.21.15.7:46142) 2024-09-21T05:55:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5dfad9d640 1 -- 172.21.15.7:0/1323596733 learned_addr learned my addr 172.21.15.7:0/1323596733 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5dfa59c640 1 --2- 172.21.15.7:0/1323596733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5df9d9b640 1 --2- 172.21.15.7:0/1323596733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 0x5631253c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5dfad9d640 1 -- 172.21.15.7:0/1323596733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 msgr2=0x5631253b8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/1323596733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5dfad9d640 1 -- 172.21.15.7:0/1323596733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 msgr2=0x5631253c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/1323596733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 0x5631253c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5dfad9d640 1 -- 172.21.15.7:0/1323596733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631253b48e0 con 0x5631250011b0 2024-09-21T05:55:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.481+0000 7f5df9d9b640 1 --2- 172.21.15.7:0/1323596733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 0x5631253c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.482+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/1323596733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253b35d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5df4012040 tx=0x7f5df4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0bdf1fcc9fb700 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.482+0000 7f5de3fff640 1 -- 172.21.15.7:0/1323596733 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4036070 con 0x5631250011b0 2024-09-21T05:55:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.482+0000 7f5de3fff640 1 -- 172.21.15.7:0/1323596733 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df4029640 con 0x5631250011b0 2024-09-21T05:55:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.482+0000 7f5de3fff640 1 -- 172.21.15.7:0/1323596733 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df401fdd0 con 0x5631250011b0 2024-09-21T05:55:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.483+0000 7f5e07c61740 1 -- 172.21.15.7:0/1323596733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 msgr2=0x5631253b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.483+0000 7f5e07c61740 1 --2- 172.21.15.7:0/1323596733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253b35d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5df4012040 tx=0x7f5df4005f90 comp rx=0 tx=0).stop 2024-09-21T05:55:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.483+0000 7f5e07c61740 1 -- 172.21.15.7:0/1323596733 shutdown_connections 2024-09-21T05:55:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.483+0000 7f5e07c61740 1 --2- 172.21.15.7:0/1323596733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x5631253b35d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.483+0000 7f5e07c61740 1 --2- 172.21.15.7:0/1323596733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 0x5631253c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.483+0000 7f5e07c61740 1 --2- 172.21.15.7:0/1323596733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.483+0000 7f5e07c61740 1 -- 172.21.15.7:0/1323596733 >> 172.21.15.7:0/1323596733 conn(0x563124ff5300 msgr2=0x5631253b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.483+0000 7f5e07c61740 1 -- 172.21.15.7:0/1323596733 shutdown_connections 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.483+0000 7f5e07c61740 1 -- 172.21.15.7:0/1323596733 wait complete. 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.483+0000 7f5e07c61740 1 -- start start 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.483+0000 7f5e07c61740 1 Processor -- start 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5e07c61740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5e07c61740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 0x5631253ba5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5e07c61740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x56312542afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5e07c61740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1ab950 con 0x5631250011b0 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5e07c61740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1acdc0 con 0x563124fe04d0 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5e07c61740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1ac020 con 0x563124fd82f0 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5e07c61740 10 client.0 _ll_register_callbacks cb 0x7f5df4012840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5dfad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x56312542afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5dfad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x56312542afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46144/0 (socket says 172.21.15.7:46144) 2024-09-21T05:55:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5dfad9d640 1 -- 172.21.15.7:0/3399680987 learned_addr learned my addr 172.21.15.7:0/3399680987 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5dfa59c640 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5df9d9b640 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 0x5631253ba5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5dfad9d640 1 -- 172.21.15.7:0/3399680987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 msgr2=0x5631253b9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5dfad9d640 1 -- 172.21.15.7:0/3399680987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 msgr2=0x5631253ba5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 0x5631253ba5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5dfad9d640 1 -- 172.21.15.7:0/3399680987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56312542b610 con 0x5631250011b0 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.484+0000 7f5dfa59c640 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.485+0000 7f5dfad9d640 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x56312542afa0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5df401fd80 tx=0x7f5df401fdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4f91c69c9a5cc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.485+0000 7f5de1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.485+0000 7f5de1ffb640 1 -- 172.21.15.7:0/3399680987 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4036040 con 0x5631250011b0 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.485+0000 7f5e07c61740 1 -- 172.21.15.7:0/3399680987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5df4029640 con 0x5631250011b0 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.485+0000 7f5de1ffb640 1 -- 172.21.15.7:0/3399680987 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f5df401f630 con 0x5631250011b0 2024-09-21T05:55:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.485+0000 7f5de1ffb640 1 -- 172.21.15.7:0/3399680987 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5df400fe30 con 0x5631250011b0 2024-09-21T05:55:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.485+0000 7f5e07c61740 10 client.15888 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.485+0000 7f5e07c61740 1 -- 172.21.15.7:0/3399680987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563125432940 con 0x5631250011b0 2024-09-21T05:55:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.485+0000 7f5de1ffb640 1 -- 172.21.15.7:0/3399680987 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df4029640 con 0x5631250011b0 2024-09-21T05:55:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.485+0000 7f5de1ffb640 1 -- 172.21.15.7:0/3399680987 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5df4027070 con 0x5631250011b0 2024-09-21T05:55:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.486+0000 7f5e07c61740 10 client.15888 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.486+0000 7f5e07c61740 10 client.15888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.486+0000 7f5e07c61740 20 client.15888 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.486+0000 7f5e07c61740 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563124f951c0 0x563125434f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.486+0000 7f5e07c61740 4 client.15888 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T05:55:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.486+0000 7f5e07c61740 1 -- 172.21.15.7:0/3399680987 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5631253190f0 con 0x563124f951c0 2024-09-21T05:55:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.486+0000 7f5dfa59c640 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563124f951c0 0x563125434f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.486+0000 7f5de1ffb640 10 client.15888 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.486+0000 7f5dfa59c640 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563124f951c0 0x563125434f10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26d490e37f96f764 server_cookie=a25230837a980434 in_seq=0 out_seq=0 2024-09-21T05:55:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5de1ffb640 1 -- 172.21.15.7:0/3399680987 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5631253190f0 con 0x563124f951c0 2024-09-21T05:55:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5de1ffb640 10 client.15888 handle_command_reply: tid=0 2024-09-21T05:55:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5e07c61740 1 client.15888 shutdown 2024-09-21T05:55:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5e07c61740 1 -- 172.21.15.7:0/3399680987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 msgr2=0x56312542afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5e07c61740 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x56312542afa0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5df401fd80 tx=0x7f5df401fdb0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5e07c61740 1 -- 172.21.15.7:0/3399680987 shutdown_connections 2024-09-21T05:55:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5e07c61740 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563124f951c0 0x563125434f10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5e07c61740 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631250011b0 0x56312542afa0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5e07c61740 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563124fe04d0 0x5631253ba5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5e07c61740 1 --2- 172.21.15.7:0/3399680987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563124fd82f0 0x5631253b9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5de1ffb640 0 client.15888 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5e07c61740 1 -- 172.21.15.7:0/3399680987 >> 172.21.15.7:0/3399680987 conn(0x563124ff5300 msgr2=0x5631253a4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5e07c61740 1 -- 172.21.15.7:0/3399680987 shutdown_connections 2024-09-21T05:55:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5e07c61740 1 -- 172.21.15.7:0/3399680987 wait complete. 2024-09-21T05:55:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.499+0000 7f5e07c61740 20 client.15888 trim_cache size 0 max 16384 2024-09-21T05:55:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T05:55:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T05:55:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T05:55:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T05:55:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.500+0000 7f5e00c15640 1 -- 172.21.15.7:0/53645565 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5de40b6680 msgr2=0x7f5de40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.500+0000 7f5e00c15640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5de40b6680 0x7f5de40b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009fd0 tx=0x7f5df4009500 comp rx=0 tx=0).stop 2024-09-21T05:55:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.500+0000 7f5e00c15640 1 -- 172.21.15.7:0/53645565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dfc104910 msgr2=0x7f5dfc19a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.500+0000 7f5e00c15640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dfc104910 0x7f5dfc19a410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00d950 tx=0x7f5dec00de10 comp rx=0 tx=0).stop 2024-09-21T05:55:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.500+0000 7f5e00c15640 1 -- 172.21.15.7:0/53645565 shutdown_connections 2024-09-21T05:55:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.500+0000 7f5e00c15640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5de40b6680 0x7f5de40b8b90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.500+0000 7f5e00c15640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5dfc105260 0x7f5dfc19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.500+0000 7f5e00c15640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dfc10dd70 0x7f5dfc19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.500+0000 7f5e00c15640 1 --2- 172.21.15.7:0/53645565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dfc104910 0x7f5dfc19a410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.500+0000 7f5e00c15640 1 -- 172.21.15.7:0/53645565 >> 172.21.15.7:0/53645565 conn(0x7f5dfc0fe3c0 msgr2=0x7f5dfc107860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.500+0000 7f5e00c15640 1 -- 172.21.15.7:0/53645565 shutdown_connections 2024-09-21T05:55:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:29.500+0000 7f5e00c15640 1 -- 172.21.15.7:0/53645565 wait complete. 2024-09-21T05:55:29.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:29 smithi027 ceph-mon[34364]: pgmap v366: 97 pgs: 97 active+clean; 417 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 35 MiB/s wr, 2.72k op/s 2024-09-21T05:55:30.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:29 smithi007 ceph-mon[30983]: pgmap v366: 97 pgs: 97 active+clean; 417 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 35 MiB/s wr, 2.72k op/s 2024-09-21T05:55:30.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:29 smithi119 ceph-mon[34833]: pgmap v366: 97 pgs: 97 active+clean; 417 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 35 MiB/s wr, 2.72k op/s 2024-09-21T05:55:31.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:31 smithi027 ceph-mon[34364]: pgmap v367: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 43 MiB/s wr, 2.65k op/s 2024-09-21T05:55:32.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:31 smithi007 ceph-mon[30983]: pgmap v367: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 43 MiB/s wr, 2.65k op/s 2024-09-21T05:55:32.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:31 smithi119 ceph-mon[34833]: pgmap v367: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 43 MiB/s wr, 2.65k op/s 2024-09-21T05:55:33.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:33 smithi027 ceph-mon[34364]: pgmap v368: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 2.21k op/s 2024-09-21T05:55:34.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:33 smithi007 ceph-mon[30983]: pgmap v368: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 2.21k op/s 2024-09-21T05:55:34.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:33 smithi119 ceph-mon[34833]: pgmap v368: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 2.21k op/s 2024-09-21T05:55:35.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:35 smithi027 ceph-mon[34364]: pgmap v369: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 36 MiB/s wr, 2.12k op/s 2024-09-21T05:55:36.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:35 smithi007 ceph-mon[30983]: pgmap v369: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 36 MiB/s wr, 2.12k op/s 2024-09-21T05:55:36.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:35 smithi119 ceph-mon[34833]: pgmap v369: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 36 MiB/s wr, 2.12k op/s 2024-09-21T05:55:37.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:37 smithi027 ceph-mon[34364]: pgmap v370: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 732 op/s 2024-09-21T05:55:38.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:37 smithi007 ceph-mon[30983]: pgmap v370: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 732 op/s 2024-09-21T05:55:38.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:37 smithi119 ceph-mon[34833]: pgmap v370: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 732 op/s 2024-09-21T05:55:39.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:39 smithi027 ceph-mon[34364]: pgmap v371: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 15 op/s 2024-09-21T05:55:40.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:39 smithi007 ceph-mon[30983]: pgmap v371: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 15 op/s 2024-09-21T05:55:40.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:39 smithi119 ceph-mon[34833]: pgmap v371: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 15 op/s 2024-09-21T05:55:40.583 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:55:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:41.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.329+0000 7fa0a8f04640 1 -- 172.21.15.7:0/3788347459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a4104840 msgr2=0x7fa0a4104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.329+0000 7fa0a8f04640 1 --2- 172.21.15.7:0/3788347459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a4104840 0x7fa0a4104c50 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa094009900 tx=0x7fa09402a410 comp rx=0 tx=0).stop 2024-09-21T05:55:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.329+0000 7fa0a8f04640 1 -- 172.21.15.7:0/3788347459 shutdown_connections 2024-09-21T05:55:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.329+0000 7fa0a8f04640 1 --2- 172.21.15.7:0/3788347459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0a410ddf0 0x7fa0a4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.329+0000 7fa0a8f04640 1 --2- 172.21.15.7:0/3788347459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0a4105270 0x7fa0a410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.329+0000 7fa0a8f04640 1 --2- 172.21.15.7:0/3788347459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a4104840 0x7fa0a4104c50 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.329+0000 7fa0a8f04640 1 -- 172.21.15.7:0/3788347459 >> 172.21.15.7:0/3788347459 conn(0x7fa0a4079730 msgr2=0x7fa0a4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.329+0000 7fa0a8f04640 1 -- 172.21.15.7:0/3788347459 shutdown_connections 2024-09-21T05:55:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.329+0000 7fa0a8f04640 1 -- 172.21.15.7:0/3788347459 wait complete. 2024-09-21T05:55:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.331+0000 7fa0a8f04640 1 Processor -- start 2024-09-21T05:55:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.331+0000 7fa0a8f04640 1 -- start start 2024-09-21T05:55:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.331+0000 7fa0a8f04640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0a4104840 0x7fa0a419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.331+0000 7fa0a8f04640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0a4105270 0x7fa0a419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.331+0000 7fa0a8f04640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a410ddf0 0x7fa0a419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.331+0000 7fa0a8f04640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a4113a70 con 0x7fa0a410ddf0 2024-09-21T05:55:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.331+0000 7fa0a8f04640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a41138f0 con 0x7fa0a4105270 2024-09-21T05:55:41.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.331+0000 7fa0a8f04640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a4113bf0 con 0x7fa0a4104840 2024-09-21T05:55:41.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.331+0000 7fa0a2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a410ddf0 0x7fa0a419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.332+0000 7fa0a2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a410ddf0 0x7fa0a419fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52360/0 (socket says 172.21.15.7:52360) 2024-09-21T05:55:41.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.332+0000 7fa0a259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0a4104840 0x7fa0a419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.332+0000 7fa0a2d9d640 1 -- 172.21.15.7:0/2266010098 learned_addr learned my addr 172.21.15.7:0/2266010098 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:41.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.332+0000 7fa0a1d9b640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0a4105270 0x7fa0a419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.332+0000 7fa0a259c640 1 -- 172.21.15.7:0/2266010098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0a4105270 msgr2=0x7fa0a419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:41.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.332+0000 7fa0a259c640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0a4105270 0x7fa0a419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.332+0000 7fa0a259c640 1 -- 172.21.15.7:0/2266010098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a410ddf0 msgr2=0x7fa0a419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:41.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.332+0000 7fa0a259c640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a410ddf0 0x7fa0a419fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.332+0000 7fa0a259c640 1 -- 172.21.15.7:0/2266010098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a41a0490 con 0x7fa0a4104840 2024-09-21T05:55:41.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.332+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a410ddf0 0x7fa0a419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:41.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.332+0000 7fa0a259c640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0a4104840 0x7fa0a419a520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa09402a930 tx=0x7fa094004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:41.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.333+0000 7fa0937fe640 1 -- 172.21.15.7:0/2266010098 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09403f070 con 0x7fa0a4104840 2024-09-21T05:55:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.333+0000 7fa0a8f04640 1 -- 172.21.15.7:0/2266010098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a41a0720 con 0x7fa0a4104840 2024-09-21T05:55:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.333+0000 7fa0937fe640 1 -- 172.21.15.7:0/2266010098 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa094003ca0 con 0x7fa0a4104840 2024-09-21T05:55:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.333+0000 7fa0937fe640 1 -- 172.21.15.7:0/2266010098 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa094035070 con 0x7fa0a4104840 2024-09-21T05:55:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.333+0000 7fa0a8f04640 1 -- 172.21.15.7:0/2266010098 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a41a6ee0 con 0x7fa0a4104840 2024-09-21T05:55:41.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.336+0000 7fa0af478740 1 Processor -- start 2024-09-21T05:55:41.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.336+0000 7fa0af478740 1 -- start start 2024-09-21T05:55:41.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.336+0000 7fa0af478740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772862070 0x55d772c09650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.336+0000 7fa0af478740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c09b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.336+0000 7fa0af478740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772841390 0x55d772c0a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.336+0000 7fa0af478740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d772b7fe50 con 0x55d7728391b0 2024-09-21T05:55:41.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.336+0000 7fa0af478740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d772b6f280 con 0x55d772862070 2024-09-21T05:55:41.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.336+0000 7fa0af478740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d772b73090 con 0x55d772841390 2024-09-21T05:55:41.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.337+0000 7fa0a2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772862070 0x55d772c09650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.337+0000 7fa0a2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772862070 0x55d772c09650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:59676/0 (socket says 172.21.15.7:59676) 2024-09-21T05:55:41.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.337+0000 7fa0a2d9d640 1 -- 172.21.15.7:0/2356813347 learned_addr learned my addr 172.21.15.7:0/2356813347 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:41.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.337+0000 7fa0a1d9b640 1 --2- 172.21.15.7:0/2356813347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772841390 0x55d772c0a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.337+0000 7fa0937fe640 1 -- 172.21.15.7:0/2266010098 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa0940037f0 con 0x7fa0a4104840 2024-09-21T05:55:41.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.337+0000 7fa0a2d9d640 1 -- 172.21.15.7:0/2356813347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772841390 msgr2=0x55d772c0a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:41.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.337+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/2356813347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772841390 0x55d772c0a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.337+0000 7fa0a2d9d640 1 -- 172.21.15.7:0/2356813347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 msgr2=0x55d772c09b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T05:55:41.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.337+0000 7fa0a259c640 1 --2- 172.21.15.7:0/2356813347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c09b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.337+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/2356813347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c09b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.337+0000 7fa0a2d9d640 1 -- 172.21.15.7:0/2356813347 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7728cd650 con 0x55d772862070 2024-09-21T05:55:41.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.337+0000 7fa0a259c640 1 --2- 172.21.15.7:0/2356813347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c09b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:55:41.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.338+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/2356813347 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772862070 0x55d772c09650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa09c010810 tx=0x7fa09c010cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d22a50e067c3c5c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:41.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.338+0000 7fa090ff9640 1 -- 172.21.15.7:0/2356813347 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00eb30 con 0x55d772862070 2024-09-21T05:55:41.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.338+0000 7fa090ff9640 1 -- 172.21.15.7:0/2356813347 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa09c015070 con 0x55d772862070 2024-09-21T05:55:41.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.338+0000 7fa090ff9640 1 -- 172.21.15.7:0/2356813347 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09c011480 con 0x55d772862070 2024-09-21T05:55:41.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.338+0000 7fa0937fe640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa08c0b6680 0x7fa08c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.338+0000 7fa0a259c640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa08c0b6680 0x7fa08c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.338+0000 7fa0937fe640 1 -- 172.21.15.7:0/2266010098 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa094107750 con 0x7fa0a4104840 2024-09-21T05:55:41.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.339+0000 7fa0a259c640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa08c0b6680 0x7fa08c0b8b90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa094104fd0 tx=0x7fa09402a410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:41.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.339+0000 7fa0af478740 1 -- 172.21.15.7:0/2356813347 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772862070 msgr2=0x55d772c09650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:41.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.339+0000 7fa0af478740 1 --2- 172.21.15.7:0/2356813347 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772862070 0x55d772c09650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa09c010810 tx=0x7fa09c010cd0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.339+0000 7fa0af478740 1 -- 172.21.15.7:0/2356813347 shutdown_connections 2024-09-21T05:55:41.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.339+0000 7fa0af478740 1 --2- 172.21.15.7:0/2356813347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c09b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.339+0000 7fa0af478740 1 --2- 172.21.15.7:0/2356813347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772841390 0x55d772c0a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.339+0000 7fa0af478740 1 --2- 172.21.15.7:0/2356813347 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772862070 0x55d772c09650 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.339+0000 7fa0af478740 1 -- 172.21.15.7:0/2356813347 >> 172.21.15.7:0/2356813347 conn(0x55d772856460 msgr2=0x55d772c07540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:41.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.340+0000 7fa0af478740 1 -- 172.21.15.7:0/2356813347 shutdown_connections 2024-09-21T05:55:41.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.340+0000 7fa0af478740 1 -- 172.21.15.7:0/2356813347 wait complete. 2024-09-21T05:55:41.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.340+0000 7fa0af478740 1 -- start start 2024-09-21T05:55:41.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.340+0000 7fa0af478740 1 Processor -- start 2024-09-21T05:55:41.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0af478740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c19090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0af478740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772841390 0x55d772c195d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0af478740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772862070 0x55d772c19b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0af478740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d7729d0700 con 0x55d7728391b0 2024-09-21T05:55:41.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0af478740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d772b0a110 con 0x55d772841390 2024-09-21T05:55:41.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0af478740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d772c1c160 con 0x55d772862070 2024-09-21T05:55:41.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0af478740 10 client.0 _ll_register_callbacks cb 0x55d772b23990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:41.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0a2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c19090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0a2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c19090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52388/0 (socket says 172.21.15.7:52388) 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0a2d9d640 1 -- 172.21.15.7:0/1889480059 learned_addr learned my addr 172.21.15.7:0/1889480059 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/1889480059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772862070 0x55d772c19b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0a1d9b640 1 --2- 172.21.15.7:0/1889480059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772841390 0x55d772c195d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0a2d9d640 1 -- 172.21.15.7:0/1889480059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772862070 msgr2=0x55d772c19b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/1889480059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772862070 0x55d772c19b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0a2d9d640 1 -- 172.21.15.7:0/1889480059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772841390 msgr2=0x55d772c195d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/1889480059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772841390 0x55d772c195d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.341+0000 7fa0a2d9d640 1 -- 172.21.15.7:0/1889480059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d772b37c40 con 0x55d7728391b0 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.342+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/1889480059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c19090 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa09c005cc0 tx=0x7fa09c013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf9c1fd247999c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.342+0000 7fa089ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.342+0000 7fa089ffb640 1 -- 172.21.15.7:0/1889480059 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00e930 con 0x55d7728391b0 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.342+0000 7fa089ffb640 1 -- 172.21.15.7:0/1889480059 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa09c021070 con 0x55d7728391b0 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.342+0000 7fa0af478740 1 -- 172.21.15.7:0/1889480059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa09c015070 con 0x55d7728391b0 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.342+0000 7fa089ffb640 1 -- 172.21.15.7:0/1889480059 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa09c00ead0 con 0x55d7728391b0 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.342+0000 7fa0af478740 10 client.15897 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.342+0000 7fa0af478740 1 -- 172.21.15.7:0/1889480059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d772c27de0 con 0x55d7728391b0 2024-09-21T05:55:41.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.342+0000 7fa089ffb640 1 -- 172.21.15.7:0/1889480059 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa09c00ec70 con 0x55d7728391b0 2024-09-21T05:55:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.343+0000 7fa089ffb640 1 -- 172.21.15.7:0/1889480059 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa09c011440 con 0x55d7728391b0 2024-09-21T05:55:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.343+0000 7fa0af478740 10 client.15897 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.343+0000 7fa0af478740 10 client.15897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.343+0000 7fa0af478740 20 client.15897 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.343+0000 7fa0af478740 1 --2- 172.21.15.7:0/1889480059 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d7728209f0 0x55d772c2b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.343+0000 7fa0af478740 4 client.15897 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.343+0000 7fa0af478740 1 -- 172.21.15.7:0/1889480059 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa09c015070 con 0x55d7728209f0 2024-09-21T05:55:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.343+0000 7fa0a1d9b640 1 --2- 172.21.15.7:0/1889480059 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d7728209f0 0x55d772c2b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.344+0000 7fa089ffb640 10 client.15897 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.344+0000 7fa0a1d9b640 1 --2- 172.21.15.7:0/1889480059 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d7728209f0 0x55d772c2b140 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8502ae58d200030f server_cookie=4bc93df262e053ef in_seq=0 out_seq=0 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.344+0000 7fa089ffb640 1 -- 172.21.15.7:0/1889480059 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa09c015070 con 0x55d7728209f0 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.344+0000 7fa089ffb640 10 client.15897 handle_command_reply: tid=0 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.345+0000 7fa0af478740 1 client.15897 shutdown 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.345+0000 7fa0af478740 1 -- 172.21.15.7:0/1889480059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 msgr2=0x55d772c19090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.345+0000 7fa0af478740 1 --2- 172.21.15.7:0/1889480059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c19090 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa09c005cc0 tx=0x7fa09c013040 comp rx=0 tx=0).stop 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.345+0000 7fa0af478740 1 -- 172.21.15.7:0/1889480059 shutdown_connections 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.345+0000 7fa0af478740 1 --2- 172.21.15.7:0/1889480059 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d7728209f0 0x55d772c2b140 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.345+0000 7fa0af478740 1 --2- 172.21.15.7:0/1889480059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772862070 0x55d772c19b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.345+0000 7fa089ffb640 0 client.15897 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.345+0000 7fa0af478740 1 --2- 172.21.15.7:0/1889480059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772841390 0x55d772c195d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.345+0000 7fa0af478740 1 --2- 172.21.15.7:0/1889480059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c19090 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.345+0000 7fa0af478740 1 -- 172.21.15.7:0/1889480059 >> 172.21.15.7:0/1889480059 conn(0x55d772856460 msgr2=0x55d772c0c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.345+0000 7fa0af478740 1 -- 172.21.15.7:0/1889480059 shutdown_connections 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.345+0000 7fa0af478740 1 -- 172.21.15.7:0/1889480059 wait complete. 2024-09-21T05:55:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.345+0000 7fa0af478740 20 client.15897 trim_cache size 0 max 16384 2024-09-21T05:55:41.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.379+0000 7fa0af478740 1 Processor -- start 2024-09-21T05:55:41.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.379+0000 7fa0af478740 1 -- start start 2024-09-21T05:55:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.379+0000 7fa0af478740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7728209f0 0x55d772c1af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.379+0000 7fa0af478740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c24ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.379+0000 7fa0af478740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772841390 0x55d772c06b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.379+0000 7fa0af478740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a41afc30 con 0x55d7728391b0 2024-09-21T05:55:41.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.379+0000 7fa0af478740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a41ad500 con 0x55d772841390 2024-09-21T05:55:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.379+0000 7fa0af478740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a41ab370 con 0x55d7728209f0 2024-09-21T05:55:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.379+0000 7fa0a1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c24ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.379+0000 7fa0a1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c24ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52396/0 (socket says 172.21.15.7:52396) 2024-09-21T05:55:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.379+0000 7fa0a1d9b640 1 -- 172.21.15.7:0/3162273046 learned_addr learned my addr 172.21.15.7:0/3162273046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.379+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/3162273046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7728209f0 0x55d772c1af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.380+0000 7fa0a1d9b640 1 -- 172.21.15.7:0/3162273046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7728209f0 msgr2=0x55d772c1af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.380+0000 7fa0a1d9b640 1 --2- 172.21.15.7:0/3162273046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7728209f0 0x55d772c1af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.380+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/3162273046 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772841390 0x55d772c06b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.380+0000 7fa0a1d9b640 1 -- 172.21.15.7:0/3162273046 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772841390 msgr2=0x55d772c06b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.380+0000 7fa0a1d9b640 1 --2- 172.21.15.7:0/3162273046 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772841390 0x55d772c06b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.380+0000 7fa0a1d9b640 1 -- 172.21.15.7:0/3162273046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d772c018a0 con 0x55d7728391b0 2024-09-21T05:55:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.380+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/3162273046 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772841390 0x55d772c06b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:55:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.380+0000 7fa0a1d9b640 1 --2- 172.21.15.7:0/3162273046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c24ac0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa0a406ad30 tx=0x7fa09800b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35da457b42a702bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.380+0000 7fa08bfff640 1 -- 172.21.15.7:0/3162273046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa098005220 con 0x55d7728391b0 2024-09-21T05:55:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.380+0000 7fa08bfff640 1 -- 172.21.15.7:0/3162273046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa098004c50 con 0x55d7728391b0 2024-09-21T05:55:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.380+0000 7fa08bfff640 1 -- 172.21.15.7:0/3162273046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09801dab0 con 0x55d7728391b0 2024-09-21T05:55:41.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.381+0000 7fa0af478740 1 -- 172.21.15.7:0/3162273046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 msgr2=0x55d772c24ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:41.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.381+0000 7fa0af478740 1 --2- 172.21.15.7:0/3162273046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c24ac0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa0a406ad30 tx=0x7fa09800b410 comp rx=0 tx=0).stop 2024-09-21T05:55:41.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.381+0000 7fa0af478740 1 -- 172.21.15.7:0/3162273046 shutdown_connections 2024-09-21T05:55:41.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.381+0000 7fa0af478740 1 --2- 172.21.15.7:0/3162273046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c24ac0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.381+0000 7fa0af478740 1 --2- 172.21.15.7:0/3162273046 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d772841390 0x55d772c06b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.381+0000 7fa0af478740 1 --2- 172.21.15.7:0/3162273046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d7728209f0 0x55d772c1af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.381+0000 7fa0af478740 1 -- 172.21.15.7:0/3162273046 >> 172.21.15.7:0/3162273046 conn(0x55d772856460 msgr2=0x55d772c243b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.381+0000 7fa0af478740 1 -- 172.21.15.7:0/3162273046 shutdown_connections 2024-09-21T05:55:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.381+0000 7fa0af478740 1 -- 172.21.15.7:0/3162273046 wait complete. 2024-09-21T05:55:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.381+0000 7fa0af478740 1 -- start start 2024-09-21T05:55:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0af478740 1 Processor -- start 2024-09-21T05:55:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0af478740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d7728209f0 0x55d772c1dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0af478740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c1e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0af478740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772841390 0x55d772c949a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0af478740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a41ab9c0 con 0x55d7728391b0 2024-09-21T05:55:41.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0af478740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a41ace30 con 0x55d7728209f0 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0af478740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a41ac090 con 0x55d772841390 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0af478740 10 client.0 _ll_register_callbacks cb 0x7fa09800b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0a1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c1e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0a1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c1e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52408/0 (socket says 172.21.15.7:52408) 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0a1d9b640 1 -- 172.21.15.7:0/1136698686 learned_addr learned my addr 172.21.15.7:0/1136698686 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/1136698686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d7728209f0 0x55d772c1dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/1136698686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772841390 0x55d772c949a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0a1d9b640 1 -- 172.21.15.7:0/1136698686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772841390 msgr2=0x55d772c949a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0a1d9b640 1 --2- 172.21.15.7:0/1136698686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772841390 0x55d772c949a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0a1d9b640 1 -- 172.21.15.7:0/1136698686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d7728209f0 msgr2=0x55d772c1dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.382+0000 7fa0a1d9b640 1 --2- 172.21.15.7:0/1136698686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d7728209f0 0x55d772c1dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.383+0000 7fa0a1d9b640 1 -- 172.21.15.7:0/1136698686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d772c94ee0 con 0x55d7728391b0 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.383+0000 7fa0a1d9b640 1 --2- 172.21.15.7:0/1136698686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c1e010 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa098025040 tx=0x7fa098004e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc67efb8a5b9c4ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:41.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.383+0000 7fa089ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.383+0000 7fa089ffb640 1 -- 172.21.15.7:0/1136698686 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa098030020 con 0x55d7728391b0 2024-09-21T05:55:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.383+0000 7fa089ffb640 1 -- 172.21.15.7:0/1136698686 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa09801d830 con 0x55d7728391b0 2024-09-21T05:55:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.383+0000 7fa0af478740 1 -- 172.21.15.7:0/1136698686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa098004c50 con 0x55d7728391b0 2024-09-21T05:55:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.383+0000 7fa089ffb640 1 -- 172.21.15.7:0/1136698686 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa09803b050 con 0x55d7728391b0 2024-09-21T05:55:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.383+0000 7fa0af478740 10 client.15903 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.383+0000 7fa0af478740 1 -- 172.21.15.7:0/1136698686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d772c96070 con 0x55d7728391b0 2024-09-21T05:55:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.383+0000 7fa089ffb640 1 -- 172.21.15.7:0/1136698686 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa098004c50 con 0x55d7728391b0 2024-09-21T05:55:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.384+0000 7fa089ffb640 1 -- 172.21.15.7:0/1136698686 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa09802c4b0 con 0x55d7728391b0 2024-09-21T05:55:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.384+0000 7fa0af478740 10 client.15903 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.384+0000 7fa0af478740 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.384+0000 7fa0af478740 20 client.15903 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.384+0000 7fa0af478740 1 --2- 172.21.15.7:0/1136698686 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d772862070 0x55d772c98860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.384+0000 7fa0af478740 4 client.15903 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:55:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.384+0000 7fa0af478740 1 -- 172.21.15.7:0/1136698686 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d772b81da0 con 0x55d772862070 2024-09-21T05:55:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.384+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/1136698686 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d772862070 0x55d772c98860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.384+0000 7fa089ffb640 10 client.15903 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.384+0000 7fa0a2d9d640 1 --2- 172.21.15.7:0/1136698686 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d772862070 0x55d772c98860 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0c2ff1160e67210 server_cookie=6640f8c2ce1520da in_seq=0 out_seq=0 2024-09-21T05:55:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa089ffb640 1 -- 172.21.15.7:0/1136698686 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x55d772b81da0 con 0x55d772862070 2024-09-21T05:55:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa089ffb640 10 client.15903 handle_command_reply: tid=0 2024-09-21T05:55:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa0af478740 1 client.15903 shutdown 2024-09-21T05:55:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa0af478740 1 -- 172.21.15.7:0/1136698686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 msgr2=0x55d772c1e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa0af478740 1 --2- 172.21.15.7:0/1136698686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c1e010 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa098025040 tx=0x7fa098004e90 comp rx=0 tx=0).stop 2024-09-21T05:55:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa0af478740 1 -- 172.21.15.7:0/1136698686 shutdown_connections 2024-09-21T05:55:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa0af478740 1 --2- 172.21.15.7:0/1136698686 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d772862070 0x55d772c98860 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa0af478740 1 --2- 172.21.15.7:0/1136698686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7728391b0 0x55d772c1e010 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa0af478740 1 --2- 172.21.15.7:0/1136698686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d772841390 0x55d772c949a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa0af478740 1 --2- 172.21.15.7:0/1136698686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d7728209f0 0x55d772c1dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa0af478740 1 -- 172.21.15.7:0/1136698686 >> 172.21.15.7:0/1136698686 conn(0x55d772856460 msgr2=0x55d772c1a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:41.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa089ffb640 0 client.15903 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:41.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa0af478740 1 -- 172.21.15.7:0/1136698686 shutdown_connections 2024-09-21T05:55:41.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa0af478740 1 -- 172.21.15.7:0/1136698686 wait complete. 2024-09-21T05:55:41.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.385+0000 7fa0af478740 20 client.15903 trim_cache size 0 max 16384 2024-09-21T05:55:41.392 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:55:41.392 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T05:55:41.392 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:55:41.393 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:55:41.394 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:55:41.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:55:41.394 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:55:41.394 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:55:41.394 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:55:41.394 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:55:41.394 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:55:41.394 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:55:41.394 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:55:41.394 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:55:41.394 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:55:41.394 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:55:41.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.386+0000 7fa0a8f04640 1 -- 172.21.15.7:0/2266010098 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa08c0b6680 msgr2=0x7fa08c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:41.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.386+0000 7fa0a8f04640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa08c0b6680 0x7fa08c0b8b90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa094104fd0 tx=0x7fa09402a410 comp rx=0 tx=0).stop 2024-09-21T05:55:41.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.386+0000 7fa0a8f04640 1 -- 172.21.15.7:0/2266010098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0a4104840 msgr2=0x7fa0a419a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:41.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.386+0000 7fa0a8f04640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0a4104840 0x7fa0a419a520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa09402a930 tx=0x7fa094004270 comp rx=0 tx=0).stop 2024-09-21T05:55:41.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.386+0000 7fa0a8f04640 1 -- 172.21.15.7:0/2266010098 shutdown_connections 2024-09-21T05:55:41.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.386+0000 7fa0a8f04640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa08c0b6680 0x7fa08c0b8b90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.386+0000 7fa0a8f04640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a410ddf0 0x7fa0a419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.386+0000 7fa0a8f04640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0a4105270 0x7fa0a419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.386+0000 7fa0a8f04640 1 --2- 172.21.15.7:0/2266010098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0a4104840 0x7fa0a419a520 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:41.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.386+0000 7fa0a8f04640 1 -- 172.21.15.7:0/2266010098 >> 172.21.15.7:0/2266010098 conn(0x7fa0a4079730 msgr2=0x7fa0a40ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:41.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.386+0000 7fa0a8f04640 1 -- 172.21.15.7:0/2266010098 shutdown_connections 2024-09-21T05:55:41.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:41.386+0000 7fa0a8f04640 1 -- 172.21.15.7:0/2266010098 wait complete. 2024-09-21T05:55:41.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:41 smithi007 ceph-mon[30983]: pgmap v372: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.3 MiB/s wr, 13 op/s 2024-09-21T05:55:41.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:41 smithi027 ceph-mon[34364]: pgmap v372: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.3 MiB/s wr, 13 op/s 2024-09-21T05:55:42.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:41 smithi119 ceph-mon[34833]: pgmap v372: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.3 MiB/s wr, 13 op/s 2024-09-21T05:55:42.120 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T05:55:42.121 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:55:42.414 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:42.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.605+0000 7f2e61894640 1 -- 172.21.15.7:0/148120319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c1047b0 msgr2=0x7f2e5c104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:42.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.605+0000 7f2e61894640 1 --2- 172.21.15.7:0/148120319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c1047b0 0x7f2e5c104bc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009900 tx=0x7f2e4c02a410 comp rx=0 tx=0).stop 2024-09-21T05:55:42.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.605+0000 7f2e61894640 1 -- 172.21.15.7:0/148120319 shutdown_connections 2024-09-21T05:55:42.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.605+0000 7f2e61894640 1 --2- 172.21.15.7:0/148120319 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e5c10dd60 0x7f2e5c110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.605+0000 7f2e61894640 1 --2- 172.21.15.7:0/148120319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e5c1051e0 0x7f2e5c10d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.605+0000 7f2e61894640 1 --2- 172.21.15.7:0/148120319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c1047b0 0x7f2e5c104bc0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.605+0000 7f2e61894640 1 -- 172.21.15.7:0/148120319 >> 172.21.15.7:0/148120319 conn(0x7f2e5c0fe3c0 msgr2=0x7f2e5c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:42.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.605+0000 7f2e61894640 1 -- 172.21.15.7:0/148120319 shutdown_connections 2024-09-21T05:55:42.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.605+0000 7f2e61894640 1 -- 172.21.15.7:0/148120319 wait complete. 2024-09-21T05:55:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.606+0000 7f2e61894640 1 Processor -- start 2024-09-21T05:55:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.606+0000 7f2e61894640 1 -- start start 2024-09-21T05:55:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.606+0000 7f2e61894640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e5c1047b0 0x7f2e5c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.606+0000 7f2e61894640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e5c1051e0 0x7f2e5c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.606+0000 7f2e61894640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c10dd60 0x7f2e5c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.606+0000 7f2e61894640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c1139e0 con 0x7f2e5c10dd60 2024-09-21T05:55:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.606+0000 7f2e61894640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c113860 con 0x7f2e5c1047b0 2024-09-21T05:55:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.606+0000 7f2e61894640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c113b60 con 0x7f2e5c1051e0 2024-09-21T05:55:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.607+0000 7f2e5b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c10dd60 0x7f2e5c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.607+0000 7f2e5affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e5c1047b0 0x7f2e5c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.607+0000 7f2e5b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c10dd60 0x7f2e5c19fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52428/0 (socket says 172.21.15.7:52428) 2024-09-21T05:55:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.607+0000 7f2e5b7fe640 1 -- 172.21.15.7:0/3304455311 learned_addr learned my addr 172.21.15.7:0/3304455311 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.607+0000 7f2e5a7fc640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e5c1051e0 0x7f2e5c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.607+0000 7f2e5affd640 1 -- 172.21.15.7:0/3304455311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e5c1051e0 msgr2=0x7f2e5c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.607+0000 7f2e5affd640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e5c1051e0 0x7f2e5c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.607+0000 7f2e5affd640 1 -- 172.21.15.7:0/3304455311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c10dd60 msgr2=0x7f2e5c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.607+0000 7f2e5affd640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c10dd60 0x7f2e5c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.607+0000 7f2e5affd640 1 -- 172.21.15.7:0/3304455311 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c1a0390 con 0x7f2e5c1047b0 2024-09-21T05:55:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.607+0000 7f2e5b7fe640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c10dd60 0x7f2e5c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.607+0000 7f2e5affd640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e5c1047b0 0x7f2e5c19a460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c006010 tx=0x7f2e4c004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.608+0000 7f2e60892640 1 -- 172.21.15.7:0/3304455311 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c03f070 con 0x7f2e5c1047b0 2024-09-21T05:55:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.608+0000 7f2e61894640 1 -- 172.21.15.7:0/3304455311 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5c1a0620 con 0x7f2e5c1047b0 2024-09-21T05:55:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.608+0000 7f2e60892640 1 -- 172.21.15.7:0/3304455311 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e4c003ca0 con 0x7f2e5c1047b0 2024-09-21T05:55:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.608+0000 7f2e61894640 1 -- 172.21.15.7:0/3304455311 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e5c1a6e10 con 0x7f2e5c1047b0 2024-09-21T05:55:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.608+0000 7f2e60892640 1 -- 172.21.15.7:0/3304455311 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c035070 con 0x7f2e5c1047b0 2024-09-21T05:55:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.611+0000 7f2e68801740 1 Processor -- start 2024-09-21T05:55:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.611+0000 7f2e68801740 1 -- start start 2024-09-21T05:55:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.611+0000 7f2e68801740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 0x55d06785b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.611+0000 7f2e68801740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d06748d2f0 0x55d06785bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.611+0000 7f2e68801740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d0674954d0 0x55d06785c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.611+0000 7f2e68801740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d0677d06f0 con 0x55d0674b61b0 2024-09-21T05:55:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.611+0000 7f2e68801740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d0677bfb20 con 0x55d0674954d0 2024-09-21T05:55:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.611+0000 7f2e68801740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d0677c3930 con 0x55d06748d2f0 2024-09-21T05:55:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.611+0000 7f2e5b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 0x55d06785b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.611+0000 7f2e5b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 0x55d06785b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52438/0 (socket says 172.21.15.7:52438) 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.611+0000 7f2e5b7fe640 1 -- 172.21.15.7:0/1582824987 learned_addr learned my addr 172.21.15.7:0/1582824987 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.611+0000 7f2e5a7fc640 1 --2- 172.21.15.7:0/1582824987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d0674954d0 0x55d06785c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.612+0000 7f2e5a7fc640 1 -- 172.21.15.7:0/1582824987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d06748d2f0 msgr2=0x55d06785bef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.612+0000 7f2e5a7fc640 1 --2- 172.21.15.7:0/1582824987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d06748d2f0 0x55d06785bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.612+0000 7f2e5a7fc640 1 -- 172.21.15.7:0/1582824987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 msgr2=0x55d06785b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.612+0000 7f2e5a7fc640 1 --2- 172.21.15.7:0/1582824987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 0x55d06785b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.612+0000 7f2e5a7fc640 1 -- 172.21.15.7:0/1582824987 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d067785530 con 0x55d0674954d0 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.612+0000 7f2e5b7fe640 1 --2- 172.21.15.7:0/1582824987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 0x55d06785b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.612+0000 7f2e5a7fc640 1 --2- 172.21.15.7:0/1582824987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d0674954d0 0x55d06785c430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e50005d00 tx=0x7f2e500107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfddf7970bdeea4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.612+0000 7f2e60892640 1 -- 172.21.15.7:0/3304455311 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f2e4c0037f0 con 0x7f2e5c1047b0 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.612+0000 7f2e41ffb640 1 -- 172.21.15.7:0/1582824987 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50004020 con 0x55d0674954d0 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.612+0000 7f2e41ffb640 1 -- 172.21.15.7:0/1582824987 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e500041c0 con 0x55d0674954d0 2024-09-21T05:55:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.612+0000 7f2e41ffb640 1 -- 172.21.15.7:0/1582824987 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e500116a0 con 0x55d0674954d0 2024-09-21T05:55:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.613+0000 7f2e60892640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2e440b6680 0x7f2e440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.613+0000 7f2e5b7fe640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2e440b6680 0x7f2e440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.613+0000 7f2e60892640 1 -- 172.21.15.7:0/3304455311 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f2e4c107b00 con 0x7f2e5c1047b0 2024-09-21T05:55:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.613+0000 7f2e68801740 1 -- 172.21.15.7:0/1582824987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d0674954d0 msgr2=0x55d06785c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.613+0000 7f2e68801740 1 --2- 172.21.15.7:0/1582824987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d0674954d0 0x55d06785c430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e50005d00 tx=0x7f2e500107a0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.614+0000 7f2e68801740 1 -- 172.21.15.7:0/1582824987 shutdown_connections 2024-09-21T05:55:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.614+0000 7f2e68801740 1 --2- 172.21.15.7:0/1582824987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d0674954d0 0x55d06785c430 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.614+0000 7f2e68801740 1 --2- 172.21.15.7:0/1582824987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d06748d2f0 0x55d06785bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.614+0000 7f2e68801740 1 --2- 172.21.15.7:0/1582824987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 0x55d06785b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.614+0000 7f2e68801740 1 -- 172.21.15.7:0/1582824987 >> 172.21.15.7:0/1582824987 conn(0x55d0674aa300 msgr2=0x55d0678598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.614+0000 7f2e68801740 1 -- 172.21.15.7:0/1582824987 shutdown_connections 2024-09-21T05:55:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.614+0000 7f2e5b7fe640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2e440b6680 0x7f2e440b8b90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2e54011880 tx=0x7f2e54009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.614+0000 7f2e68801740 1 -- 172.21.15.7:0/1582824987 wait complete. 2024-09-21T05:55:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.614+0000 7f2e68801740 1 -- start start 2024-09-21T05:55:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.614+0000 7f2e68801740 1 Processor -- start 2024-09-21T05:55:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e68801740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d06748d2f0 0x55d06786b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e68801740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674954d0 0x55d06786ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e68801740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 0x55d0678778a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e68801740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d0676f7ab0 con 0x55d0674b61b0 2024-09-21T05:55:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e68801740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d067765730 con 0x55d06748d2f0 2024-09-21T05:55:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e68801740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d06786e510 con 0x55d0674954d0 2024-09-21T05:55:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e68801740 10 client.0 _ll_register_callbacks cb 0x55d0677b96b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e5b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 0x55d0678778a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e5b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 0x55d0678778a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52448/0 (socket says 172.21.15.7:52448) 2024-09-21T05:55:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e5b7fe640 1 -- 172.21.15.7:0/2080537425 learned_addr learned my addr 172.21.15.7:0/2080537425 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e5affd640 1 --2- 172.21.15.7:0/2080537425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d06748d2f0 0x55d06786b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e5a7fc640 1 --2- 172.21.15.7:0/2080537425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674954d0 0x55d06786ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e5b7fe640 1 -- 172.21.15.7:0/2080537425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674954d0 msgr2=0x55d06786ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e5b7fe640 1 --2- 172.21.15.7:0/2080537425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674954d0 0x55d06786ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e5b7fe640 1 -- 172.21.15.7:0/2080537425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d06748d2f0 msgr2=0x55d06786b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e5b7fe640 1 --2- 172.21.15.7:0/2080537425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d06748d2f0 0x55d06786b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.615+0000 7f2e5b7fe640 1 -- 172.21.15.7:0/2080537425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d067521790 con 0x55d0674b61b0 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.616+0000 7f2e5b7fe640 1 --2- 172.21.15.7:0/2080537425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 0x55d0678778a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2e540049d0 tx=0x7f2e54004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb13cdf83622806b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.616+0000 7f2e3affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.616+0000 7f2e3affd640 1 -- 172.21.15.7:0/2080537425 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5402d060 con 0x55d0674b61b0 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.616+0000 7f2e3affd640 1 -- 172.21.15.7:0/2080537425 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f2e54017030 con 0x55d0674b61b0 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.616+0000 7f2e68801740 1 -- 172.21.15.7:0/2080537425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e500041c0 con 0x55d0674b61b0 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.616+0000 7f2e3affd640 1 -- 172.21.15.7:0/2080537425 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2e54011e00 con 0x55d0674b61b0 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.616+0000 7f2e68801740 10 client.15915 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.616+0000 7f2e68801740 1 -- 172.21.15.7:0/2080537425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d06759a620 con 0x55d0674b61b0 2024-09-21T05:55:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.616+0000 7f2e3affd640 1 -- 172.21.15.7:0/2080537425 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e500041c0 con 0x55d0674b61b0 2024-09-21T05:55:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.617+0000 7f2e3affd640 1 -- 172.21.15.7:0/2080537425 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2e54032a90 con 0x55d0674b61b0 2024-09-21T05:55:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.617+0000 7f2e68801740 10 client.15915 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.617+0000 7f2e68801740 10 client.15915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.617+0000 7f2e68801740 20 client.15915 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.617+0000 7f2e68801740 1 --2- 172.21.15.7:0/2080537425 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d067474d80 0x55d06787d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.617+0000 7f2e68801740 4 client.15915 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.617+0000 7f2e68801740 1 -- 172.21.15.7:0/2080537425 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0677d2640 con 0x55d067474d80 2024-09-21T05:55:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.617+0000 7f2e5affd640 1 --2- 172.21.15.7:0/2080537425 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d067474d80 0x55d06787d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.617+0000 7f2e5affd640 1 --2- 172.21.15.7:0/2080537425 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d067474d80 0x55d06787d690 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efb50ebef0e5c83a server_cookie=564db086b3cb7b26 in_seq=0 out_seq=0 2024-09-21T05:55:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.617+0000 7f2e3affd640 10 client.15915 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.618+0000 7f2e3affd640 1 -- 172.21.15.7:0/2080537425 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0677d2640 con 0x55d067474d80 2024-09-21T05:55:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.618+0000 7f2e3affd640 10 client.15915 handle_command_reply: tid=0 2024-09-21T05:55:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.618+0000 7f2e68801740 1 client.15915 shutdown 2024-09-21T05:55:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.618+0000 7f2e68801740 1 -- 172.21.15.7:0/2080537425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 msgr2=0x55d0678778a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.618+0000 7f2e68801740 1 --2- 172.21.15.7:0/2080537425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 0x55d0678778a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2e540049d0 tx=0x7f2e54004ab0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.619+0000 7f2e68801740 1 -- 172.21.15.7:0/2080537425 shutdown_connections 2024-09-21T05:55:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.619+0000 7f2e68801740 1 --2- 172.21.15.7:0/2080537425 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d067474d80 0x55d06787d690 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.619+0000 7f2e68801740 1 --2- 172.21.15.7:0/2080537425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674b61b0 0x55d0678778a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.619+0000 7f2e68801740 1 --2- 172.21.15.7:0/2080537425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674954d0 0x55d06786ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.619+0000 7f2e68801740 1 --2- 172.21.15.7:0/2080537425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d06748d2f0 0x55d06786b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.619+0000 7f2e68801740 1 -- 172.21.15.7:0/2080537425 >> 172.21.15.7:0/2080537425 conn(0x55d0674aa300 msgr2=0x55d067857ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.619+0000 7f2e3affd640 0 client.15915 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.619+0000 7f2e68801740 1 -- 172.21.15.7:0/2080537425 shutdown_connections 2024-09-21T05:55:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.619+0000 7f2e68801740 1 -- 172.21.15.7:0/2080537425 wait complete. 2024-09-21T05:55:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.619+0000 7f2e68801740 20 client.15915 trim_cache size 0 max 16384 2024-09-21T05:55:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.634+0000 7f2e68801740 1 Processor -- start 2024-09-21T05:55:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.634+0000 7f2e68801740 1 -- start start 2024-09-21T05:55:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e68801740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d06748d2f0 0x55d06786ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e68801740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d0674954d0 0x55d06785d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e68801740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674b61b0 0x55d0678777a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e68801740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c1afbd0 con 0x55d06748d2f0 2024-09-21T05:55:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e68801740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c1ad4a0 con 0x55d0674954d0 2024-09-21T05:55:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e68801740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c1ab2f0 con 0x55d0674b61b0 2024-09-21T05:55:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e5affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d06748d2f0 0x55d06786ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e5affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d06748d2f0 0x55d06786ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52452/0 (socket says 172.21.15.7:52452) 2024-09-21T05:55:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e5affd640 1 -- 172.21.15.7:0/2543358815 learned_addr learned my addr 172.21.15.7:0/2543358815 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e5a7fc640 1 --2- 172.21.15.7:0/2543358815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d0674954d0 0x55d06785d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e5b7fe640 1 --2- 172.21.15.7:0/2543358815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674b61b0 0x55d0678777a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e5affd640 1 -- 172.21.15.7:0/2543358815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674b61b0 msgr2=0x55d0678777a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e5affd640 1 --2- 172.21.15.7:0/2543358815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674b61b0 0x55d0678777a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e5affd640 1 -- 172.21.15.7:0/2543358815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d0674954d0 msgr2=0x55d06785d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e5affd640 1 --2- 172.21.15.7:0/2543358815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d0674954d0 0x55d06785d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e5affd640 1 -- 172.21.15.7:0/2543358815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06785a1a0 con 0x55d06748d2f0 2024-09-21T05:55:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.635+0000 7f2e5b7fe640 1 --2- 172.21.15.7:0/2543358815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674b61b0 0x55d0678777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.636+0000 7f2e5affd640 1 --2- 172.21.15.7:0/2543358815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d06748d2f0 0x55d06786ba00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c105380 tx=0x7f2e4c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1e4feb41ac7466 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.636+0000 7f2e417fa640 1 -- 172.21.15.7:0/2543358815 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c048040 con 0x55d06748d2f0 2024-09-21T05:55:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.636+0000 7f2e417fa640 1 -- 172.21.15.7:0/2543358815 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e4c0c9040 con 0x55d06748d2f0 2024-09-21T05:55:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.636+0000 7f2e417fa640 1 -- 172.21.15.7:0/2543358815 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0d2110 con 0x55d06748d2f0 2024-09-21T05:55:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.637+0000 7f2e68801740 1 -- 172.21.15.7:0/2543358815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d06748d2f0 msgr2=0x55d06786ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.637+0000 7f2e68801740 1 --2- 172.21.15.7:0/2543358815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d06748d2f0 0x55d06786ba00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c105380 tx=0x7f2e4c000bc0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.637+0000 7f2e68801740 1 -- 172.21.15.7:0/2543358815 shutdown_connections 2024-09-21T05:55:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.637+0000 7f2e68801740 1 --2- 172.21.15.7:0/2543358815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674b61b0 0x55d0678777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.637+0000 7f2e68801740 1 --2- 172.21.15.7:0/2543358815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d0674954d0 0x55d06785d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.637+0000 7f2e68801740 1 --2- 172.21.15.7:0/2543358815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d06748d2f0 0x55d06786ba00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.637+0000 7f2e68801740 1 -- 172.21.15.7:0/2543358815 >> 172.21.15.7:0/2543358815 conn(0x55d0674aa300 msgr2=0x55d06785c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.637+0000 7f2e68801740 1 -- 172.21.15.7:0/2543358815 shutdown_connections 2024-09-21T05:55:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.637+0000 7f2e68801740 1 -- 172.21.15.7:0/2543358815 wait complete. 2024-09-21T05:55:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.638+0000 7f2e68801740 1 -- start start 2024-09-21T05:55:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.638+0000 7f2e68801740 1 Processor -- start 2024-09-21T05:55:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.639+0000 7f2e68801740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d06748d2f0 0x55d067873ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.639+0000 7f2e68801740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674954d0 0x55d06786f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.639+0000 7f2e5a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674954d0 0x55d06786f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.639+0000 7f2e5affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d06748d2f0 0x55d067873ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.639+0000 7f2e5affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d06748d2f0 0x55d067873ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:59754/0 (socket says 172.21.15.7:59754) 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.639+0000 7f2e5a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674954d0 0x55d06786f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52454/0 (socket says 172.21.15.7:52454) 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.639+0000 7f2e68801740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674b61b0 0x55d06786f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.639+0000 7f2e68801740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c1ab960 con 0x55d0674954d0 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.639+0000 7f2e68801740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c1acdd0 con 0x55d06748d2f0 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.639+0000 7f2e68801740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c1ac030 con 0x55d0674b61b0 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.639+0000 7f2e68801740 10 client.0 _ll_register_callbacks cb 0x7f2e540112e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.639+0000 7f2e5affd640 1 -- 172.21.15.7:0/2184284365 learned_addr learned my addr 172.21.15.7:0/2184284365 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.640+0000 7f2e5b7fe640 1 --2- 172.21.15.7:0/2184284365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674b61b0 0x55d06786f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.640+0000 7f2e5a7fc640 1 -- 172.21.15.7:0/2184284365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674b61b0 msgr2=0x55d06786f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.640+0000 7f2e5a7fc640 1 --2- 172.21.15.7:0/2184284365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674b61b0 0x55d06786f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.640+0000 7f2e5a7fc640 1 -- 172.21.15.7:0/2184284365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d06748d2f0 msgr2=0x55d067873ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.640+0000 7f2e5a7fc640 1 --2- 172.21.15.7:0/2184284365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d06748d2f0 0x55d067873ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.640+0000 7f2e5a7fc640 1 -- 172.21.15.7:0/2184284365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d06786ff10 con 0x55d0674954d0 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.640+0000 7f2e5affd640 1 --2- 172.21.15.7:0/2184284365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d06748d2f0 0x55d067873ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.640+0000 7f2e5a7fc640 1 --2- 172.21.15.7:0/2184284365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674954d0 0x55d06786f360 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000bbf0 tx=0x7f2e50004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86696092c6e33743 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.640+0000 7f2e3affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.640+0000 7f2e3affd640 1 -- 172.21.15.7:0/2184284365 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5002a030 con 0x55d0674954d0 2024-09-21T05:55:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.640+0000 7f2e3affd640 1 -- 172.21.15.7:0/2184284365 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f2e50005040 con 0x55d0674954d0 2024-09-21T05:55:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.640+0000 7f2e68801740 1 -- 172.21.15.7:0/2184284365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e4c0c9040 con 0x55d0674954d0 2024-09-21T05:55:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.641+0000 7f2e3affd640 1 -- 172.21.15.7:0/2184284365 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2e50005280 con 0x55d0674954d0 2024-09-21T05:55:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.641+0000 7f2e68801740 10 client.15921 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.641+0000 7f2e68801740 1 -- 172.21.15.7:0/2184284365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d0678e7ed0 con 0x55d0674954d0 2024-09-21T05:55:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.641+0000 7f2e3affd640 1 -- 172.21.15.7:0/2184284365 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e4c0c9040 con 0x55d0674954d0 2024-09-21T05:55:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.641+0000 7f2e3affd640 1 -- 172.21.15.7:0/2184284365 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2e50004660 con 0x55d0674954d0 2024-09-21T05:55:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.641+0000 7f2e68801740 10 client.15921 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.641+0000 7f2e68801740 10 client.15921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.641+0000 7f2e68801740 20 client.15921 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.641+0000 7f2e68801740 1 --2- 172.21.15.7:0/2184284365 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d06744a1c0 0x55d0678ea270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.641+0000 7f2e68801740 4 client.15921 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T05:55:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.641+0000 7f2e68801740 1 -- 172.21.15.7:0/2184284365 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d067859b10 con 0x55d06744a1c0 2024-09-21T05:55:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.642+0000 7f2e5affd640 1 --2- 172.21.15.7:0/2184284365 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d06744a1c0 0x55d0678ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.642+0000 7f2e3affd640 10 client.15921 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.642+0000 7f2e5affd640 1 --2- 172.21.15.7:0/2184284365 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d06744a1c0 0x55d0678ea270 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5343f93c5a315cff server_cookie=2d9bcc23e880207d in_seq=0 out_seq=0 2024-09-21T05:55:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.653+0000 7f2e3affd640 1 -- 172.21.15.7:0/2184284365 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d067859b10 con 0x55d06744a1c0 2024-09-21T05:55:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.653+0000 7f2e3affd640 10 client.15921 handle_command_reply: tid=0 2024-09-21T05:55:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.653+0000 7f2e68801740 1 client.15921 shutdown 2024-09-21T05:55:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e68801740 1 -- 172.21.15.7:0/2184284365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674954d0 msgr2=0x55d06786f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e68801740 1 --2- 172.21.15.7:0/2184284365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674954d0 0x55d06786f360 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000bbf0 tx=0x7f2e50004180 comp rx=0 tx=0).stop 2024-09-21T05:55:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e68801740 1 -- 172.21.15.7:0/2184284365 shutdown_connections 2024-09-21T05:55:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e68801740 1 --2- 172.21.15.7:0/2184284365 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d06744a1c0 0x55d0678ea270 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e68801740 1 --2- 172.21.15.7:0/2184284365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0674954d0 0x55d06786f360 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e3affd640 0 client.15921 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e68801740 1 --2- 172.21.15.7:0/2184284365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d0674b61b0 0x55d06786f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e68801740 1 --2- 172.21.15.7:0/2184284365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d06748d2f0 0x55d067873ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e68801740 1 -- 172.21.15.7:0/2184284365 >> 172.21.15.7:0/2184284365 conn(0x55d0674aa300 msgr2=0x55d06785c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e68801740 1 -- 172.21.15.7:0/2184284365 shutdown_connections 2024-09-21T05:55:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e68801740 1 -- 172.21.15.7:0/2184284365 wait complete. 2024-09-21T05:55:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e68801740 20 client.15921 trim_cache size 0 max 16384 2024-09-21T05:55:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T05:55:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T05:55:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T05:55:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T05:55:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e61894640 1 -- 172.21.15.7:0/3304455311 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2e440b6680 msgr2=0x7f2e440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e61894640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2e440b6680 0x7f2e440b8b90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2e54011880 tx=0x7f2e54009500 comp rx=0 tx=0).stop 2024-09-21T05:55:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e61894640 1 -- 172.21.15.7:0/3304455311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e5c1047b0 msgr2=0x7f2e5c19a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.654+0000 7f2e61894640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e5c1047b0 0x7f2e5c19a460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c006010 tx=0x7f2e4c004060 comp rx=0 tx=0).stop 2024-09-21T05:55:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.655+0000 7f2e61894640 1 -- 172.21.15.7:0/3304455311 shutdown_connections 2024-09-21T05:55:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.655+0000 7f2e61894640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2e440b6680 0x7f2e440b8b90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.655+0000 7f2e61894640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c10dd60 0x7f2e5c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.655+0000 7f2e61894640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e5c1051e0 0x7f2e5c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.655+0000 7f2e61894640 1 --2- 172.21.15.7:0/3304455311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e5c1047b0 0x7f2e5c19a460 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.655+0000 7f2e61894640 1 -- 172.21.15.7:0/3304455311 >> 172.21.15.7:0/3304455311 conn(0x7f2e5c0fe3c0 msgr2=0x7f2e5c107900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.655+0000 7f2e61894640 1 -- 172.21.15.7:0/3304455311 shutdown_connections 2024-09-21T05:55:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T05:55:42.655+0000 7f2e61894640 1 -- 172.21.15.7:0/3304455311 wait complete. 2024-09-21T05:55:42.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.887+0000 7f921b142640 1 -- 172.21.15.7:0/3237382554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9214101f70 msgr2=0x7f9214102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.887+0000 7f921b142640 1 --2- 172.21.15.7:0/3237382554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9214101f70 0x7f9214102380 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9210009900 tx=0x7f921002a410 comp rx=0 tx=0).stop 2024-09-21T05:55:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.887+0000 7f921b142640 1 -- 172.21.15.7:0/3237382554 shutdown_connections 2024-09-21T05:55:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.887+0000 7f921b142640 1 --2- 172.21.15.7:0/3237382554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9214109e00 0x7f9214110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.887+0000 7f921b142640 1 --2- 172.21.15.7:0/3237382554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92141094b0 0x7f92141098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.887+0000 7f921b142640 1 --2- 172.21.15.7:0/3237382554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9214101f70 0x7f9214102380 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.887+0000 7f921b142640 1 -- 172.21.15.7:0/3237382554 >> 172.21.15.7:0/3237382554 conn(0x7f9214077c60 msgr2=0x7f92140780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.887+0000 7f921b142640 1 -- 172.21.15.7:0/3237382554 shutdown_connections 2024-09-21T05:55:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.887+0000 7f921b142640 1 -- 172.21.15.7:0/3237382554 wait complete. 2024-09-21T05:55:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.888+0000 7f921b142640 1 Processor -- start 2024-09-21T05:55:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.888+0000 7f921b142640 1 -- start start 2024-09-21T05:55:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.888+0000 7f921b142640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9214101f70 0x7f9214102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.888+0000 7f921b142640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92141094b0 0x7f9214103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.888+0000 7f921b142640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9214109e00 0x7f9214103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.888+0000 7f921b142640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9214113ac0 con 0x7f9214109e00 2024-09-21T05:55:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.888+0000 7f921b142640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9214113940 con 0x7f92141094b0 2024-09-21T05:55:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.888+0000 7f921b142640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9214113c40 con 0x7f9214101f70 2024-09-21T05:55:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.888+0000 7f92196df640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9214109e00 0x7f9214103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.888+0000 7f9218ede640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9214101f70 0x7f9214102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.888+0000 7f92196df640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9214109e00 0x7f9214103990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52484/0 (socket says 172.21.15.7:52484) 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.888+0000 7f92196df640 1 -- 172.21.15.7:0/585272856 learned_addr learned my addr 172.21.15.7:0/585272856 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.888+0000 7f920bfff640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92141094b0 0x7f9214103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.889+0000 7f9218ede640 1 -- 172.21.15.7:0/585272856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92141094b0 msgr2=0x7f9214103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.889+0000 7f9218ede640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92141094b0 0x7f9214103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.889+0000 7f9218ede640 1 -- 172.21.15.7:0/585272856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9214109e00 msgr2=0x7f9214103990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.889+0000 7f9218ede640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9214109e00 0x7f9214103990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.889+0000 7f9218ede640 1 -- 172.21.15.7:0/585272856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92141a87b0 con 0x7f9214101f70 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.889+0000 7f920bfff640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92141094b0 0x7f9214103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.889+0000 7f9218ede640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9214101f70 0x7f9214102f10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f921002a930 tx=0x7f9210004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.889+0000 7f9209ffb640 1 -- 172.21.15.7:0/585272856 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921003f030 con 0x7f9214101f70 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.889+0000 7f921b142640 1 -- 172.21.15.7:0/585272856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92141a8a40 con 0x7f9214101f70 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.890+0000 7f921b142640 1 -- 172.21.15.7:0/585272856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92141a8f70 con 0x7f9214101f70 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.890+0000 7f9209ffb640 1 -- 172.21.15.7:0/585272856 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9210003aa0 con 0x7f9214101f70 2024-09-21T05:55:42.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.890+0000 7f9209ffb640 1 -- 172.21.15.7:0/585272856 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210049060 con 0x7f9214101f70 2024-09-21T05:55:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.891+0000 7f921b142640 1 -- 172.21.15.7:0/585272856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9214102380 con 0x7f9214101f70 2024-09-21T05:55:42.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.893+0000 7f9209ffb640 1 -- 172.21.15.7:0/585272856 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9210042030 con 0x7f9214101f70 2024-09-21T05:55:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.893+0000 7f9209ffb640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f91fc0b6680 0x7f91fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.894+0000 7f920bfff640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f91fc0b6680 0x7f91fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.894+0000 7f9209ffb640 1 -- 172.21.15.7:0/585272856 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9210107bc0 con 0x7f9214101f70 2024-09-21T05:55:42.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.894+0000 7f920bfff640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f91fc0b6680 0x7f91fc0b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9214109cf0 tx=0x7f920400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:42.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:42.897+0000 7f9209ffb640 1 -- 172.21.15.7:0/585272856 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92100d2510 con 0x7f9214101f70 2024-09-21T05:55:43.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.127+0000 7f921b142640 1 -- 172.21.15.7:0/585272856 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f921402e640 con 0x7f9214101f70 2024-09-21T05:55:43.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.128+0000 7f9209ffb640 1 -- 172.21.15.7:0/585272856 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f92100d7450 con 0x7f9214101f70 2024-09-21T05:55:43.130 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:55:43.130 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:55:43.130 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:55:43.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.130+0000 7f921b142640 1 -- 172.21.15.7:0/585272856 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f91fc0b6680 msgr2=0x7f91fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:43.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.130+0000 7f921b142640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f91fc0b6680 0x7f91fc0b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9214109cf0 tx=0x7f920400b390 comp rx=0 tx=0).stop 2024-09-21T05:55:43.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.130+0000 7f921b142640 1 -- 172.21.15.7:0/585272856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9214101f70 msgr2=0x7f9214102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.130+0000 7f921b142640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9214101f70 0x7f9214102f10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f921002a930 tx=0x7f9210004270 comp rx=0 tx=0).stop 2024-09-21T05:55:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.130+0000 7f921b142640 1 -- 172.21.15.7:0/585272856 shutdown_connections 2024-09-21T05:55:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.130+0000 7f921b142640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f91fc0b6680 0x7f91fc0b8b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.130+0000 7f921b142640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9214109e00 0x7f9214103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.130+0000 7f921b142640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f92141094b0 0x7f9214103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.130+0000 7f921b142640 1 --2- 172.21.15.7:0/585272856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9214101f70 0x7f9214102f10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.130+0000 7f921b142640 1 -- 172.21.15.7:0/585272856 >> 172.21.15.7:0/585272856 conn(0x7f9214077c60 msgr2=0x7f92141075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.130+0000 7f921b142640 1 -- 172.21.15.7:0/585272856 shutdown_connections 2024-09-21T05:55:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:43.130+0000 7f921b142640 1 -- 172.21.15.7:0/585272856 wait complete. 2024-09-21T05:55:43.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:43 smithi007 ceph-mon[30983]: pgmap v373: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 868 KiB/s wr, 9 op/s 2024-09-21T05:55:43.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:43 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/585272856' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:55:43.875 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T05:55:43.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:43 smithi027 ceph-mon[34364]: pgmap v373: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 868 KiB/s wr, 9 op/s 2024-09-21T05:55:43.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:43 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/585272856' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:55:44.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:43 smithi119 ceph-mon[34833]: pgmap v373: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 868 KiB/s wr, 9 op/s 2024-09-21T05:55:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:43 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/585272856' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:55:44.152 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.636+0000 7f4b1ccdd640 1 -- 172.21.15.7:0/1439760019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b18110200 msgr2=0x7f4b18112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.636+0000 7f4b1ccdd640 1 --2- 172.21.15.7:0/1439760019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b18110200 0x7f4b18112620 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009ca0 tx=0x7f4b1002a950 comp rx=0 tx=0).stop 2024-09-21T05:55:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.636+0000 7f4b1ccdd640 1 -- 172.21.15.7:0/1439760019 shutdown_connections 2024-09-21T05:55:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.636+0000 7f4b1ccdd640 1 --2- 172.21.15.7:0/1439760019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b18110200 0x7f4b18112620 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.636+0000 7f4b1ccdd640 1 --2- 172.21.15.7:0/1439760019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18102fa0 0x7f4b1810fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.636+0000 7f4b1ccdd640 1 --2- 172.21.15.7:0/1439760019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b18102650 0x7f4b18102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.636+0000 7f4b1ccdd640 1 -- 172.21.15.7:0/1439760019 >> 172.21.15.7:0/1439760019 conn(0x7f4b180797b0 msgr2=0x7f4b18079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.636+0000 7f4b1ccdd640 1 -- 172.21.15.7:0/1439760019 shutdown_connections 2024-09-21T05:55:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.636+0000 7f4b1ccdd640 1 -- 172.21.15.7:0/1439760019 wait complete. 2024-09-21T05:55:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.637+0000 7f4b1ccdd640 1 Processor -- start 2024-09-21T05:55:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.637+0000 7f4b1ccdd640 1 -- start start 2024-09-21T05:55:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.637+0000 7f4b1ccdd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18102650 0x7f4b1819c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.637+0000 7f4b1ccdd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b18102fa0 0x7f4b1819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.637+0000 7f4b1ccdd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b18110200 0x7f4b181a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.637+0000 7f4b1ccdd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b18115ca0 con 0x7f4b18102fa0 2024-09-21T05:55:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.637+0000 7f4b1ccdd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4b18115b20 con 0x7f4b18110200 2024-09-21T05:55:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.637+0000 7f4b1ccdd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b18115e20 con 0x7f4b18102650 2024-09-21T05:55:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.638+0000 7f4b15d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b18102fa0 0x7f4b1819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.638+0000 7f4b15d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b18102fa0 0x7f4b1819cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52490/0 (socket says 172.21.15.7:52490) 2024-09-21T05:55:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.638+0000 7f4b15d9b640 1 -- 172.21.15.7:0/3807931307 learned_addr learned my addr 172.21.15.7:0/3807931307 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.638+0000 7f4b1659c640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18102650 0x7f4b1819c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.638+0000 7f4b16d9d640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b18110200 0x7f4b181a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.638+0000 7f4b15d9b640 1 -- 172.21.15.7:0/3807931307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18102650 msgr2=0x7f4b1819c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.638+0000 7f4b15d9b640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18102650 0x7f4b1819c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.638+0000 7f4b15d9b640 1 -- 172.21.15.7:0/3807931307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b18110200 msgr2=0x7f4b181a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.638+0000 7f4b15d9b640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b18110200 0x7f4b181a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.638+0000 7f4b15d9b640 1 -- 172.21.15.7:0/3807931307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b181a2560 con 0x7f4b18102fa0 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.638+0000 7f4b1659c640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18102650 0x7f4b1819c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.638+0000 7f4b15d9b640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b18102fa0 0x7f4b1819cb90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00d770 tx=0x7f4b0c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.638+0000 7f4b077fe640 1 -- 172.21.15.7:0/3807931307 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c017070 con 0x7f4b18102fa0 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.639+0000 7f4b1ccdd640 1 -- 172.21.15.7:0/3807931307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b181a2850 con 0x7f4b18102fa0 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.639+0000 7f4b077fe640 1 -- 172.21.15.7:0/3807931307 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b0c0054d0 con 0x7f4b18102fa0 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.639+0000 7f4b1ccdd640 1 -- 172.21.15.7:0/3807931307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b181a8fb0 con 0x7f4b18102fa0 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.639+0000 7f4b077fe640 1 -- 172.21.15.7:0/3807931307 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c004c30 con 0x7f4b18102fa0 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.641+0000 7f4b23251740 1 Processor -- start 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b23251740 1 -- start start 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b23251740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffccc070 0x55e2000732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b23251740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 0x55e200073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b23251740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e200073d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b23251740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e1fffe9ea0 con 0x55e1ffca31b0 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b23251740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e1fffd92d0 con 0x55e1ffcab390 2024-09-21T05:55:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b23251740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e1fffdd0e0 con 0x55e1ffccc070 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b1659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 0x55e200073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b1659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 0x55e200073800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52494/0 (socket says 172.21.15.7:52494) 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b1659c640 1 -- 172.21.15.7:0/1435194743 learned_addr learned my addr 172.21.15.7:0/1435194743 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b077fe640 1 -- 172.21.15.7:0/3807931307 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f4b0c004eb0 con 0x7f4b18102fa0 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b16d9d640 1 --2- 172.21.15.7:0/1435194743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffccc070 0x55e2000732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b1659c640 1 -- 172.21.15.7:0/1435194743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffccc070 msgr2=0x55e2000732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b1659c640 1 --2- 172.21.15.7:0/1435194743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffccc070 0x55e2000732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b1659c640 1 -- 172.21.15.7:0/1435194743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 msgr2=0x55e200073d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b1659c640 1 --2- 172.21.15.7:0/1435194743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e200073d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.642+0000 7f4b1659c640 1 -- 172.21.15.7:0/1435194743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1ffd37650 con 0x55e1ffca31b0 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.643+0000 7f4b1659c640 1 --2- 172.21.15.7:0/1435194743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 0x55e200073800 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4b080104d0 tx=0x7f4b08010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ee37fb8984f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.643+0000 7f4b04ff9640 1 -- 172.21.15.7:0/1435194743 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08004220 con 0x55e1ffca31b0 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.643+0000 7f4b04ff9640 1 -- 172.21.15.7:0/1435194743 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b080043c0 con 0x55e1ffca31b0 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.643+0000 7f4b04ff9640 1 -- 172.21.15.7:0/1435194743 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08011aa0 con 0x55e1ffca31b0 2024-09-21T05:55:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.643+0000 7f4b077fe640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b000b6680 0x7f4b000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.643+0000 7f4b16d9d640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b000b6680 0x7f4b000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.643+0000 7f4b077fe640 1 -- 172.21.15.7:0/3807931307 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4b0c0e7050 con 0x7f4b18102fa0 2024-09-21T05:55:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.644+0000 7f4b23251740 1 -- 172.21.15.7:0/1435194743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 msgr2=0x55e200073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.644+0000 7f4b16d9d640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b000b6680 0x7f4b000b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4b10005e30 tx=0x7f4b10005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.644+0000 7f4b23251740 1 --2- 172.21.15.7:0/1435194743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 0x55e200073800 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4b080104d0 tx=0x7f4b08010990 comp rx=0 tx=0).stop 2024-09-21T05:55:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.644+0000 7f4b23251740 1 -- 172.21.15.7:0/1435194743 shutdown_connections 2024-09-21T05:55:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.644+0000 7f4b23251740 1 --2- 172.21.15.7:0/1435194743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 0x55e200073800 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.644+0000 7f4b23251740 1 --2- 172.21.15.7:0/1435194743 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e200073d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.644+0000 7f4b23251740 1 --2- 172.21.15.7:0/1435194743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffccc070 0x55e2000732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.644+0000 7f4b23251740 1 -- 172.21.15.7:0/1435194743 >> 172.21.15.7:0/1435194743 conn(0x55e1ffcc0460 msgr2=0x55e2000711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.644+0000 7f4b23251740 1 -- 172.21.15.7:0/1435194743 shutdown_connections 2024-09-21T05:55:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.644+0000 7f4b23251740 1 -- 172.21.15.7:0/1435194743 wait complete. 2024-09-21T05:55:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b23251740 1 -- start start 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b23251740 1 Processor -- start 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b23251740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffca31b0 0x55e20007e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b23251740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e20007ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b23251740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffccc070 0x55e20008adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b23251740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e1ffe3a700 con 0x55e1ffccc070 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b23251740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e1fff74160 con 0x55e1ffcab390 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b23251740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e200081aa0 con 0x55e1ffca31b0 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b23251740 10 client.0 _ll_register_callbacks cb 0x55e1fff8d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b16d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffccc070 0x55e20008adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b16d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffccc070 0x55e20008adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52508/0 (socket says 172.21.15.7:52508) 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b16d9d640 1 -- 172.21.15.7:0/1376708156 learned_addr learned my addr 172.21.15.7:0/1376708156 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b1659c640 1 --2- 172.21.15.7:0/1376708156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffca31b0 0x55e20007e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.645+0000 7f4b15d9b640 1 --2- 172.21.15.7:0/1376708156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e20007ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.646+0000 7f4b16d9d640 1 -- 172.21.15.7:0/1376708156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffca31b0 msgr2=0x55e20007e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.646+0000 7f4b16d9d640 1 --2- 172.21.15.7:0/1376708156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffca31b0 0x55e20007e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.646+0000 7f4b16d9d640 1 -- 172.21.15.7:0/1376708156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 msgr2=0x55e20007ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.646+0000 7f4b16d9d640 1 --2- 172.21.15.7:0/1376708156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e20007ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.646+0000 7f4b16d9d640 1 -- 172.21.15.7:0/1376708156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1fffa1c90 con 0x55e1ffccc070 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.646+0000 7f4b16d9d640 1 --2- 172.21.15.7:0/1376708156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffccc070 0x55e20008adc0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4b100094e0 tx=0x7f4b100095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb6270b98a486ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.646+0000 7f4afdffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.646+0000 7f4afdffb640 1 -- 172.21.15.7:0/1376708156 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b10055060 con 0x55e1ffccc070 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.646+0000 7f4afdffb640 1 -- 172.21.15.7:0/1376708156 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4b10004250 con 0x55e1ffccc070 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.646+0000 7f4b23251740 1 -- 172.21.15.7:0/1376708156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b080043c0 con 0x55e1ffccc070 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.646+0000 7f4afdffb640 1 -- 172.21.15.7:0/1376708156 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b10034040 con 0x55e1ffccc070 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.646+0000 7f4b23251740 10 client.15939 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.646+0000 7f4b23251740 1 -- 172.21.15.7:0/1376708156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e20008d7e0 con 0x55e1ffccc070 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.647+0000 7f4afdffb640 1 -- 172.21.15.7:0/1376708156 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b080043c0 con 0x55e1ffccc070 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.647+0000 7f4afdffb640 1 -- 172.21.15.7:0/1376708156 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4b10030980 con 0x55e1ffccc070 2024-09-21T05:55:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.647+0000 7f4b23251740 10 client.15939 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.647+0000 7f4b23251740 10 client.15939 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:55:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.647+0000 7f4b23251740 20 client.15939 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.647+0000 7f4b23251740 1 --2- 172.21.15.7:0/1376708156 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1ffc8a9f0 0x55e200090d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.647+0000 7f4b23251740 4 client.15939 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.647+0000 7f4b23251740 1 -- 172.21.15.7:0/1376708156 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1fffebdf0 con 0x55e1ffc8a9f0 2024-09-21T05:55:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.647+0000 7f4b1659c640 1 --2- 172.21.15.7:0/1376708156 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1ffc8a9f0 0x55e200090d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.648+0000 7f4afdffb640 10 client.15939 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:55:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.648+0000 7f4b1659c640 1 --2- 172.21.15.7:0/1376708156 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1ffc8a9f0 0x55e200090d00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e635634add41914e server_cookie=486ba2fc8385a35f in_seq=0 out_seq=0 2024-09-21T05:55:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4afdffb640 1 -- 172.21.15.7:0/1376708156 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e1fffebdf0 con 0x55e1ffc8a9f0 2024-09-21T05:55:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4afdffb640 10 client.15939 handle_command_reply: tid=0 2024-09-21T05:55:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4b23251740 1 client.15939 shutdown 2024-09-21T05:55:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4b23251740 1 -- 172.21.15.7:0/1376708156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffccc070 msgr2=0x55e20008adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4b23251740 1 --2- 172.21.15.7:0/1376708156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffccc070 0x55e20008adc0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4b100094e0 tx=0x7f4b100095c0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4b23251740 1 -- 172.21.15.7:0/1376708156 shutdown_connections 2024-09-21T05:55:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4b23251740 1 --2- 172.21.15.7:0/1376708156 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1ffc8a9f0 0x55e200090d00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4b23251740 1 --2- 172.21.15.7:0/1376708156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffccc070 0x55e20008adc0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4b23251740 1 --2- 172.21.15.7:0/1376708156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e20007ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4afdffb640 0 client.15939 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:55:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4b23251740 1 --2- 172.21.15.7:0/1376708156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffca31b0 0x55e20007e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4b23251740 1 -- 172.21.15.7:0/1376708156 >> 172.21.15.7:0/1376708156 conn(0x55e1ffcc0460 msgr2=0x55e200076450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4b23251740 1 -- 172.21.15.7:0/1376708156 shutdown_connections 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4b23251740 1 -- 172.21.15.7:0/1376708156 wait complete. 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.649+0000 7f4b23251740 20 client.15939 trim_cache size 0 max 16384 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.665+0000 7f4b23251740 1 Processor -- start 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.665+0000 7f4b23251740 1 -- start start 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.665+0000 7f4b23251740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffc8a9f0 0x55e20007d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.665+0000 7f4b23251740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 0x55e200076ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.665+0000 7f4b23251740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e20008acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.665+0000 7f4b23251740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b181b4030 con 0x55e1ffca31b0 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.665+0000 7f4b23251740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4b181b1900 con 0x55e1ffcab390 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.665+0000 7f4b23251740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b181af750 con 0x55e1ffc8a9f0 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.665+0000 7f4b15d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 0x55e200076ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.665+0000 7f4b15d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 0x55e200076ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52524/0 (socket says 172.21.15.7:52524) 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.665+0000 7f4b15d9b640 1 -- 172.21.15.7:0/2061672093 learned_addr learned my addr 172.21.15.7:0/2061672093 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:44.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.666+0000 7f4b16d9d640 1 --2- 172.21.15.7:0/2061672093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e20008acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.666+0000 7f4b1659c640 1 --2- 172.21.15.7:0/2061672093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffc8a9f0 0x55e20007d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.666+0000 7f4b15d9b640 1 -- 172.21.15.7:0/2061672093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffc8a9f0 msgr2=0x55e20007d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:44.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.666+0000 7f4b15d9b640 1 --2- 172.21.15.7:0/2061672093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffc8a9f0 0x55e20007d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.666+0000 7f4b15d9b640 1 -- 172.21.15.7:0/2061672093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 msgr2=0x55e20008acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:44.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.666+0000 7f4b15d9b640 1 --2- 172.21.15.7:0/2061672093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e20008acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.666+0000 7f4b15d9b640 1 -- 172.21.15.7:0/2061672093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e20007fc90 con 0x55e1ffca31b0 2024-09-21T05:55:44.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.666+0000 7f4b16d9d640 1 --2- 172.21.15.7:0/2061672093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e20008acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:44.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.666+0000 7f4b15d9b640 1 --2- 172.21.15.7:0/2061672093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 0x55e200076ad0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0a9640 tx=0x7f4b0c0ac7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1d7df957fdc72c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:44.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.666+0000 7f4afffff640 1 -- 172.21.15.7:0/2061672093 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c020040 con 0x55e1ffca31b0 2024-09-21T05:55:44.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.666+0000 7f4afffff640 1 -- 172.21.15.7:0/2061672093 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b0c0b1aa0 con 0x55e1ffca31b0 2024-09-21T05:55:44.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.666+0000 7f4afffff640 1 -- 172.21.15.7:0/2061672093 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0981c0 con 0x55e1ffca31b0 2024-09-21T05:55:44.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.667+0000 7f4b23251740 1 -- 172.21.15.7:0/2061672093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 msgr2=0x55e200076ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.667+0000 7f4b23251740 1 --2- 172.21.15.7:0/2061672093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 0x55e200076ad0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0a9640 tx=0x7f4b0c0ac7e0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.667+0000 7f4b23251740 1 -- 172.21.15.7:0/2061672093 shutdown_connections 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.667+0000 7f4b23251740 1 --2- 172.21.15.7:0/2061672093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffca31b0 0x55e200076ad0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.667+0000 7f4b23251740 1 --2- 172.21.15.7:0/2061672093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e20008acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.667+0000 7f4b23251740 1 --2- 172.21.15.7:0/2061672093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffc8a9f0 0x55e20007d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.667+0000 7f4b23251740 1 -- 172.21.15.7:0/2061672093 >> 172.21.15.7:0/2061672093 conn(0x55e1ffcc0460 msgr2=0x55e2000763c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.667+0000 7f4b23251740 1 -- 172.21.15.7:0/2061672093 shutdown_connections 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.667+0000 7f4b23251740 1 -- 172.21.15.7:0/2061672093 wait complete. 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b23251740 1 -- start start 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b23251740 1 Processor -- start 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b23251740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffc8a9f0 0x55e200087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b23251740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffca31b0 0x55e200082920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b23251740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e200082e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b23251740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b181afdc0 con 0x55e1ffc8a9f0 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b23251740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4b181b1230 con 0x55e1ffcab390 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b23251740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b181b0490 con 0x55e1ffca31b0 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b23251740 10 client.0 _ll_register_callbacks cb 0x7f4b10009410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b1659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffc8a9f0 0x55e200087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b1659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffc8a9f0 0x55e200087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52532/0 (socket says 172.21.15.7:52532) 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b1659c640 1 -- 172.21.15.7:0/3870917140 learned_addr learned my addr 172.21.15.7:0/3870917140 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b15d9b640 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffca31b0 0x55e200082920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b16d9d640 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e200082e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b1659c640 1 -- 172.21.15.7:0/3870917140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffca31b0 msgr2=0x55e200082920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.668+0000 7f4b1659c640 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffca31b0 0x55e200082920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.669+0000 7f4b1659c640 1 -- 172.21.15.7:0/3870917140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 msgr2=0x55e200082e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.669+0000 7f4b1659c640 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e200082e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.669+0000 7f4b1659c640 1 -- 172.21.15.7:0/3870917140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e200083550 con 0x55e1ffc8a9f0 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.669+0000 7f4b16d9d640 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e200082e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:44.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.669+0000 7f4b1659c640 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffc8a9f0 0x55e200087470 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x55e200071f40 tx=0x7f4b08005100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a08bd85bf842028 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:44.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.669+0000 7f4afdffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:44.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.669+0000 7f4afdffb640 1 -- 172.21.15.7:0/3870917140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08032060 con 0x55e1ffc8a9f0 2024-09-21T05:55:44.702 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:55:44.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.669+0000 7f4afdffb640 1 -- 172.21.15.7:0/3870917140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4b08004660 con 0x55e1ffc8a9f0 2024-09-21T05:55:44.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.669+0000 7f4b23251740 1 -- 172.21.15.7:0/3870917140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b0c0b1aa0 con 0x55e1ffc8a9f0 2024-09-21T05:55:44.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.669+0000 7f4afdffb640 1 -- 172.21.15.7:0/3870917140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b08004860 con 0x55e1ffc8a9f0 2024-09-21T05:55:44.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.669+0000 7f4b23251740 10 client.15945 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:44.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.669+0000 7f4b23251740 1 -- 172.21.15.7:0/3870917140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e2000fb550 con 0x55e1ffc8a9f0 2024-09-21T05:55:44.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.669+0000 7f4afdffb640 1 -- 172.21.15.7:0/3870917140 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b0c0b1aa0 con 0x55e1ffc8a9f0 2024-09-21T05:55:44.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.670+0000 7f4afdffb640 1 -- 172.21.15.7:0/3870917140 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4b0802c070 con 0x55e1ffc8a9f0 2024-09-21T05:55:44.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.670+0000 7f4b23251740 10 client.15945 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:44.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.670+0000 7f4b23251740 10 client.15945 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:55:44.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.670+0000 7f4b23251740 20 client.15945 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:44.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.670+0000 7f4b23251740 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1ffccc070 0x55e2000fda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:44.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.670+0000 7f4b23251740 4 client.15945 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:55:44.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.670+0000 7f4b23251740 1 -- 172.21.15.7:0/3870917140 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e1fffe78a0 con 0x55e1ffccc070 2024-09-21T05:55:44.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.670+0000 7f4b15d9b640 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1ffccc070 0x55e2000fda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:44.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.670+0000 7f4afdffb640 10 client.15945 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:55:44.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.670+0000 7f4b15d9b640 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1ffccc070 0x55e2000fda00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c4b80dde0c4ff672 server_cookie=1f664da76d4f8ac7 in_seq=0 out_seq=0 2024-09-21T05:55:44.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4afdffb640 1 -- 172.21.15.7:0/3870917140 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e1fffe78a0 con 0x55e1ffccc070 2024-09-21T05:55:44.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4afdffb640 10 client.15945 handle_command_reply: tid=0 2024-09-21T05:55:44.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4b23251740 1 client.15945 shutdown 2024-09-21T05:55:44.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4b23251740 1 -- 172.21.15.7:0/3870917140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffc8a9f0 msgr2=0x55e200087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:44.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4b23251740 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffc8a9f0 0x55e200087470 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x55e200071f40 tx=0x7f4b08005100 comp rx=0 tx=0).stop 2024-09-21T05:55:44.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4b23251740 1 -- 172.21.15.7:0/3870917140 shutdown_connections 2024-09-21T05:55:44.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4b23251740 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1ffccc070 0x55e2000fda00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4afdffb640 0 client.15945 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4b23251740 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1ffcab390 0x55e200082e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4b23251740 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1ffca31b0 0x55e200082920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4b23251740 1 --2- 172.21.15.7:0/3870917140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1ffc8a9f0 0x55e200087470 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4b23251740 1 -- 172.21.15.7:0/3870917140 >> 172.21.15.7:0/3870917140 conn(0x55e1ffcc0460 msgr2=0x55e200070ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4b23251740 1 -- 172.21.15.7:0/3870917140 shutdown_connections 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4b23251740 1 -- 172.21.15.7:0/3870917140 wait complete. 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.671+0000 7f4b23251740 20 client.15945 trim_cache size 0 max 16384 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.672+0000 7f4b1ccdd640 1 -- 172.21.15.7:0/3807931307 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b000b6680 msgr2=0x7f4b000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.672+0000 7f4b1ccdd640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b000b6680 0x7f4b000b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4b10005e30 tx=0x7f4b10005c50 comp rx=0 tx=0).stop 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.672+0000 7f4b1ccdd640 1 -- 172.21.15.7:0/3807931307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b18102fa0 msgr2=0x7f4b1819cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.672+0000 7f4b1ccdd640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b18102fa0 0x7f4b1819cb90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00d770 tx=0x7f4b0c00dc30 comp rx=0 tx=0).stop 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.672+0000 7f4b1ccdd640 1 -- 172.21.15.7:0/3807931307 shutdown_connections 2024-09-21T05:55:44.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.672+0000 7f4b1ccdd640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b000b6680 0x7f4b000b8b90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.672+0000 7f4b1ccdd640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b18102fa0 0x7f4b1819cb90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.672+0000 7f4b1ccdd640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b18110200 0x7f4b181a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.672+0000 7f4b1ccdd640 1 --2- 172.21.15.7:0/3807931307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18102650 0x7f4b1819c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:44.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.672+0000 7f4b1ccdd640 1 -- 172.21.15.7:0/3807931307 >> 172.21.15.7:0/3807931307 conn(0x7f4b180797b0 msgr2=0x7f4b18111540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:44.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.672+0000 7f4b1ccdd640 1 -- 172.21.15.7:0/3807931307 shutdown_connections 2024-09-21T05:55:44.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:44.672+0000 7f4b1ccdd640 1 -- 172.21.15.7:0/3807931307 wait complete. 2024-09-21T05:55:45.326 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T05:55:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:45.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:45 smithi027 ceph-mon[34364]: pgmap v374: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-09-21T05:55:45.995 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:45 smithi007 ceph-mon[30983]: pgmap v374: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-09-21T05:55:46.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:45 smithi119 ceph-mon[34833]: pgmap v374: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-09-21T05:55:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.093+0000 7f123f6f5640 1 -- 172.21.15.7:0/4054049922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1238109e10 msgr2=0x7f1238110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.093+0000 7f123f6f5640 1 --2- 172.21.15.7:0/4054049922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1238109e10 0x7f1238110640 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1230009ca0 tx=0x7f123002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.093+0000 7f123f6f5640 1 -- 172.21.15.7:0/4054049922 shutdown_connections 2024-09-21T05:55:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.093+0000 7f123f6f5640 1 --2- 172.21.15.7:0/4054049922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1238109e10 0x7f1238110640 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.093+0000 7f123f6f5640 1 --2- 172.21.15.7:0/4054049922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12381094c0 0x7f12381098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.093+0000 7f123f6f5640 1 --2- 172.21.15.7:0/4054049922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1238103b80 0x7f1238103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.093+0000 7f123f6f5640 1 -- 172.21.15.7:0/4054049922 >> 172.21.15.7:0/4054049922 conn(0x7f12380ff610 msgr2=0x7f1238101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:46.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.093+0000 7f123f6f5640 1 -- 172.21.15.7:0/4054049922 shutdown_connections 2024-09-21T05:55:46.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.093+0000 7f123f6f5640 1 -- 172.21.15.7:0/4054049922 wait complete. 2024-09-21T05:55:46.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.094+0000 7f123f6f5640 1 Processor -- start 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.094+0000 7f123f6f5640 1 -- start start 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.094+0000 7f123f6f5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1238103b80 0x7f1238075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.094+0000 7f123f6f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12381094c0 0x7f1238075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.094+0000 7f123f6f5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1238109e10 0x7f1238076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.094+0000 7f123f6f5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1238113b20 con 0x7f12381094c0 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.094+0000 7f123f6f5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f12381139a0 con 0x7f1238109e10 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.094+0000 7f123f6f5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1238113ca0 con 0x7f1238103b80 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f123cc90640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12381094c0 0x7f1238075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f123cc90640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12381094c0 0x7f1238075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52554/0 (socket says 172.21.15.7:52554) 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f123cc90640 1 -- 172.21.15.7:0/1612082286 learned_addr learned my addr 172.21.15.7:0/1612082286 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f123dc92640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1238109e10 0x7f1238076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f123d491640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1238103b80 0x7f1238075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f123cc90640 1 -- 172.21.15.7:0/1612082286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1238103b80 msgr2=0x7f1238075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:46.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f123cc90640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1238103b80 0x7f1238075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f123cc90640 1 -- 172.21.15.7:0/1612082286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1238109e10 msgr2=0x7f1238076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:46.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f123cc90640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1238109e10 0x7f1238076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f123cc90640 1 -- 172.21.15.7:0/1612082286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12381a86f0 con 0x7f12381094c0 2024-09-21T05:55:46.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f123cc90640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12381094c0 0x7f1238075c50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f122800d740 tx=0x7f122800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:46.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f122e7fc640 1 -- 172.21.15.7:0/1612082286 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228017070 con 0x7f12381094c0 2024-09-21T05:55:46.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f122e7fc640 1 -- 172.21.15.7:0/1612082286 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f122800de50 con 0x7f12381094c0 2024-09-21T05:55:46.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.095+0000 7f122e7fc640 1 -- 172.21.15.7:0/1612082286 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122800f620 con 0x7f12381094c0 2024-09-21T05:55:46.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.096+0000 7f123f6f5640 1 -- 172.21.15.7:0/1612082286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12381a89e0 con 0x7f12381094c0 2024-09-21T05:55:46.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.096+0000 7f123f6f5640 1 -- 172.21.15.7:0/1612082286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12381a8f20 con 0x7f12381094c0 2024-09-21T05:55:46.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.099+0000 7f1245c69740 1 Processor -- start 2024-09-21T05:55:46.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.099+0000 7f1245c69740 1 -- start start 2024-09-21T05:55:46.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.099+0000 7f1245c69740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa194070 0x5596fa53b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.099+0000 7f1245c69740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa16b1b0 0x5596fa53b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.099+0000 7f1245c69740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa173390 0x5596fa53bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.099+0000 7f1245c69740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5596fa4b1ea0 con 0x5596fa173390 2024-09-21T05:55:46.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.099+0000 7f1245c69740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5596fa4a12d0 con 0x5596fa16b1b0 2024-09-21T05:55:46.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.099+0000 7f1245c69740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5596fa4a50e0 con 0x5596fa194070 2024-09-21T05:55:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.099+0000 7f123d491640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa16b1b0 0x5596fa53b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.099+0000 7f123d491640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa16b1b0 0x5596fa53b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:59860/0 (socket says 172.21.15.7:59860) 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.099+0000 7f123dc92640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa194070 0x5596fa53b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.099+0000 7f123d491640 1 -- 172.21.15.7:0/783739133 learned_addr learned my addr 172.21.15.7:0/783739133 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.100+0000 7f123d491640 1 -- 172.21.15.7:0/783739133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa194070 msgr2=0x5596fa53b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.100+0000 7f123d491640 1 --2- 172.21.15.7:0/783739133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa194070 0x5596fa53b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.100+0000 7f123d491640 1 -- 172.21.15.7:0/783739133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa173390 msgr2=0x5596fa53bd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.100+0000 7f123d491640 1 --2- 172.21.15.7:0/783739133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa173390 0x5596fa53bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.100+0000 7f123d491640 1 -- 172.21.15.7:0/783739133 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596fa1ff650 con 0x5596fa16b1b0 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.100+0000 7f123dc92640 1 --2- 172.21.15.7:0/783739133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa194070 0x5596fa53b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.100+0000 7f122e7fc640 1 -- 172.21.15.7:0/1612082286 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f122801a070 con 0x7f12381094c0 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.100+0000 7f123d491640 1 --2- 172.21.15.7:0/783739133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa16b1b0 0x5596fa53b800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1234009c90 tx=0x7f1234011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43fafb5d952ecddb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.100+0000 7f12237fe640 1 -- 172.21.15.7:0/783739133 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234005220 con 0x5596fa16b1b0 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.100+0000 7f12237fe640 1 -- 172.21.15.7:0/783739133 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1234004c50 con 0x5596fa16b1b0 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.100+0000 7f12237fe640 1 -- 172.21.15.7:0/783739133 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234019690 con 0x5596fa16b1b0 2024-09-21T05:55:46.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.101+0000 7f122e7fc640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f12240b6680 0x7f12240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.101+0000 7f123dc92640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f12240b6680 0x7f12240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.101+0000 7f122e7fc640 1 -- 172.21.15.7:0/1612082286 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f12280e7030 con 0x7f12381094c0 2024-09-21T05:55:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.101+0000 7f1245c69740 1 -- 172.21.15.7:0/783739133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa16b1b0 msgr2=0x5596fa53b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.101+0000 7f1245c69740 1 --2- 172.21.15.7:0/783739133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa16b1b0 0x5596fa53b800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1234009c90 tx=0x7f1234011810 comp rx=0 tx=0).stop 2024-09-21T05:55:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.101+0000 7f1245c69740 1 -- 172.21.15.7:0/783739133 shutdown_connections 2024-09-21T05:55:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.102+0000 7f123dc92640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f12240b6680 0x7f12240b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1230006010 tx=0x7f1230005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.101+0000 7f1245c69740 1 --2- 172.21.15.7:0/783739133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa173390 0x5596fa53bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.102+0000 7f1245c69740 1 --2- 172.21.15.7:0/783739133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa16b1b0 0x5596fa53b800 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.102+0000 7f1245c69740 1 --2- 172.21.15.7:0/783739133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa194070 0x5596fa53b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.102+0000 7f1245c69740 1 -- 172.21.15.7:0/783739133 >> 172.21.15.7:0/783739133 conn(0x5596fa188460 msgr2=0x5596fa5391b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.102+0000 7f1245c69740 1 -- 172.21.15.7:0/783739133 shutdown_connections 2024-09-21T05:55:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.102+0000 7f1245c69740 1 -- 172.21.15.7:0/783739133 wait complete. 2024-09-21T05:55:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.102+0000 7f1245c69740 1 -- start start 2024-09-21T05:55:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.102+0000 7f1245c69740 1 Processor -- start 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f1245c69740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa16b1b0 0x5596fa5468e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f1245c69740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa173390 0x5596fa546e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f1245c69740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 0x5596fa547380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f1245c69740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5596fa302700 con 0x5596fa194070 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f1245c69740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5596fa43c160 con 0x5596fa173390 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f1245c69740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5596fa549aa0 con 0x5596fa16b1b0 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f1245c69740 10 client.0 _ll_register_callbacks cb 0x5596fa4559e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f123dc92640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 0x5596fa547380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f123dc92640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 0x5596fa547380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52560/0 (socket says 172.21.15.7:52560) 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f123dc92640 1 -- 172.21.15.7:0/1231987891 learned_addr learned my addr 172.21.15.7:0/1231987891 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f123d491640 1 --2- 172.21.15.7:0/1231987891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa16b1b0 0x5596fa5468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f123cc90640 1 --2- 172.21.15.7:0/1231987891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa173390 0x5596fa546e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f123dc92640 1 -- 172.21.15.7:0/1231987891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa16b1b0 msgr2=0x5596fa5468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f123dc92640 1 --2- 172.21.15.7:0/1231987891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa16b1b0 0x5596fa5468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f123dc92640 1 -- 172.21.15.7:0/1231987891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa173390 msgr2=0x5596fa546e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f123dc92640 1 --2- 172.21.15.7:0/1231987891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa173390 0x5596fa546e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.103+0000 7f123dc92640 1 -- 172.21.15.7:0/1231987891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596fa469c90 con 0x5596fa194070 2024-09-21T05:55:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.104+0000 7f123dc92640 1 --2- 172.21.15.7:0/1231987891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 0x5596fa547380 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1230035000 tx=0x7f123002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c06c3af5043351 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.104+0000 7f1220ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.104+0000 7f1220ff9640 1 -- 172.21.15.7:0/1231987891 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123002f610 con 0x5596fa194070 2024-09-21T05:55:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.104+0000 7f1245c69740 1 -- 172.21.15.7:0/1231987891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1234004c50 con 0x5596fa194070 2024-09-21T05:55:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.104+0000 7f1220ff9640 1 -- 172.21.15.7:0/1231987891 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f123002f7b0 con 0x5596fa194070 2024-09-21T05:55:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.104+0000 7f1220ff9640 1 -- 172.21.15.7:0/1231987891 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f123002f9b0 con 0x5596fa194070 2024-09-21T05:55:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.104+0000 7f1245c69740 10 client.15954 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.104+0000 7f1245c69740 1 -- 172.21.15.7:0/1231987891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5596fa555750 con 0x5596fa194070 2024-09-21T05:55:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.104+0000 7f1220ff9640 1 -- 172.21.15.7:0/1231987891 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1234004c50 con 0x5596fa194070 2024-09-21T05:55:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.105+0000 7f1220ff9640 1 -- 172.21.15.7:0/1231987891 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1230051070 con 0x5596fa194070 2024-09-21T05:55:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.105+0000 7f1245c69740 10 client.15954 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.105+0000 7f1245c69740 10 client.15954 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:55:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.105+0000 7f1245c69740 20 client.15954 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.105+0000 7f1245c69740 1 --2- 172.21.15.7:0/1231987891 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5596fa1529f0 0x5596fa558c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.105+0000 7f1245c69740 4 client.15954 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.105+0000 7f1245c69740 1 -- 172.21.15.7:0/1231987891 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596fa4b3df0 con 0x5596fa1529f0 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.105+0000 7f123d491640 1 --2- 172.21.15.7:0/1231987891 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5596fa1529f0 0x5596fa558c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.106+0000 7f1220ff9640 10 client.15954 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.106+0000 7f123d491640 1 --2- 172.21.15.7:0/1231987891 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5596fa1529f0 0x5596fa558c30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a9d13d7c28f4f539 server_cookie=44bb16a89aae134e in_seq=0 out_seq=0 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.106+0000 7f1220ff9640 1 -- 172.21.15.7:0/1231987891 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596fa4b3df0 con 0x5596fa1529f0 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.106+0000 7f1220ff9640 10 client.15954 handle_command_reply: tid=0 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.106+0000 7f1245c69740 1 client.15954 shutdown 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.107+0000 7f1245c69740 1 -- 172.21.15.7:0/1231987891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 msgr2=0x5596fa547380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.107+0000 7f1245c69740 1 --2- 172.21.15.7:0/1231987891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 0x5596fa547380 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1230035000 tx=0x7f123002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.107+0000 7f1245c69740 1 -- 172.21.15.7:0/1231987891 shutdown_connections 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.107+0000 7f1245c69740 1 --2- 172.21.15.7:0/1231987891 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5596fa1529f0 0x5596fa558c30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.107+0000 7f1245c69740 1 --2- 172.21.15.7:0/1231987891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 0x5596fa547380 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.107+0000 7f1245c69740 1 --2- 172.21.15.7:0/1231987891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa173390 0x5596fa546e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.107+0000 7f1220ff9640 0 client.15954 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:55:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.107+0000 7f1245c69740 1 --2- 172.21.15.7:0/1231987891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa16b1b0 0x5596fa5468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.107+0000 7f1245c69740 1 -- 172.21.15.7:0/1231987891 >> 172.21.15.7:0/1231987891 conn(0x5596fa188460 msgr2=0x5596fa53e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:46.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.107+0000 7f1245c69740 1 -- 172.21.15.7:0/1231987891 shutdown_connections 2024-09-21T05:55:46.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.107+0000 7f1245c69740 1 -- 172.21.15.7:0/1231987891 wait complete. 2024-09-21T05:55:46.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.107+0000 7f1245c69740 20 client.15954 trim_cache size 0 max 16384 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.120+0000 7f1245c69740 1 Processor -- start 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f1245c69740 1 -- start start 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f1245c69740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa16b1b0 0x5596fa5488d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f1245c69740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa173390 0x5596fa538760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f1245c69740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa194070 0x5596fa538ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f1245c69740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f12381b4050 con 0x5596fa16b1b0 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f1245c69740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f12381b1920 con 0x5596fa173390 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f1245c69740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f12381af770 con 0x5596fa194070 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f123d491640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa16b1b0 0x5596fa5488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f123d491640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa16b1b0 0x5596fa5488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52576/0 (socket says 172.21.15.7:52576) 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f123d491640 1 -- 172.21.15.7:0/1162664544 learned_addr learned my addr 172.21.15.7:0/1162664544 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f123cc90640 1 --2- 172.21.15.7:0/1162664544 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa173390 0x5596fa538760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f123dc92640 1 --2- 172.21.15.7:0/1162664544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa194070 0x5596fa538ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f123d491640 1 -- 172.21.15.7:0/1162664544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa194070 msgr2=0x5596fa538ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:46.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f123d491640 1 --2- 172.21.15.7:0/1162664544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa194070 0x5596fa538ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f123d491640 1 -- 172.21.15.7:0/1162664544 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa173390 msgr2=0x5596fa538760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:46.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f123d491640 1 --2- 172.21.15.7:0/1162664544 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa173390 0x5596fa538760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f123d491640 1 -- 172.21.15.7:0/1162664544 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596fa5345d0 con 0x5596fa16b1b0 2024-09-21T05:55:46.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f123dc92640 1 --2- 172.21.15.7:0/1162664544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa194070 0x5596fa538ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:46.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.121+0000 7f123cc90640 1 --2- 172.21.15.7:0/1162664544 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa173390 0x5596fa538760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:46.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.122+0000 7f123d491640 1 --2- 172.21.15.7:0/1162664544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa16b1b0 0x5596fa5488d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1234005620 tx=0x7f1234011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f005e97d68347f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:46.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.122+0000 7f1222ffd640 1 -- 172.21.15.7:0/1162664544 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12340097a0 con 0x5596fa16b1b0 2024-09-21T05:55:46.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.122+0000 7f1222ffd640 1 -- 172.21.15.7:0/1162664544 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12340035f0 con 0x5596fa16b1b0 2024-09-21T05:55:46.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.122+0000 7f1222ffd640 1 -- 172.21.15.7:0/1162664544 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123402d670 con 0x5596fa16b1b0 2024-09-21T05:55:46.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.123+0000 7f1245c69740 1 -- 172.21.15.7:0/1162664544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa16b1b0 msgr2=0x5596fa5488d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:46.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.123+0000 7f1245c69740 1 --2- 172.21.15.7:0/1162664544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa16b1b0 0x5596fa5488d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1234005620 tx=0x7f1234011810 comp rx=0 tx=0).stop 2024-09-21T05:55:46.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.123+0000 7f1245c69740 1 -- 172.21.15.7:0/1162664544 shutdown_connections 2024-09-21T05:55:46.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.123+0000 7f1245c69740 1 --2- 172.21.15.7:0/1162664544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa194070 0x5596fa538ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.123+0000 7f1245c69740 1 --2- 172.21.15.7:0/1162664544 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa173390 0x5596fa538760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.123+0000 7f1245c69740 1 --2- 172.21.15.7:0/1162664544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa16b1b0 0x5596fa5488d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.123+0000 7f1245c69740 1 -- 172.21.15.7:0/1162664544 >> 172.21.15.7:0/1162664544 conn(0x5596fa188460 msgr2=0x5596fa53caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.123+0000 7f1245c69740 1 -- 172.21.15.7:0/1162664544 shutdown_connections 2024-09-21T05:55:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.123+0000 7f1245c69740 1 -- 172.21.15.7:0/1162664544 wait complete. 2024-09-21T05:55:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.123+0000 7f1245c69740 1 -- start start 2024-09-21T05:55:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.123+0000 7f1245c69740 1 Processor -- start 2024-09-21T05:55:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.124+0000 7f1245c69740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa16b1b0 0x5596fa54f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.124+0000 7f1245c69740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa173390 0x5596fa54aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.124+0000 7f1245c69740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 0x5596fa54af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.124+0000 7f1245c69740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f12381afde0 con 0x5596fa194070 2024-09-21T05:55:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.124+0000 7f1245c69740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f12381b1250 con 0x5596fa16b1b0 2024-09-21T05:55:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.124+0000 7f1245c69740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f12381b04b0 con 0x5596fa173390 2024-09-21T05:55:46.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.124+0000 7f1245c69740 10 client.0 _ll_register_callbacks cb 0x7f1230009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.124+0000 7f123dc92640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 0x5596fa54af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.124+0000 7f123dc92640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 0x5596fa54af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52578/0 (socket says 172.21.15.7:52578) 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.124+0000 7f123dc92640 1 -- 172.21.15.7:0/181728942 learned_addr learned my addr 172.21.15.7:0/181728942 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.124+0000 7f123d491640 1 --2- 172.21.15.7:0/181728942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa16b1b0 0x5596fa54f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.124+0000 7f123cc90640 1 --2- 172.21.15.7:0/181728942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa173390 0x5596fa54aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.125+0000 7f123dc92640 1 -- 172.21.15.7:0/181728942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa173390 msgr2=0x5596fa54aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.125+0000 7f123dc92640 1 --2- 172.21.15.7:0/181728942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa173390 0x5596fa54aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.125+0000 7f123dc92640 1 -- 172.21.15.7:0/181728942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa16b1b0 msgr2=0x5596fa54f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.125+0000 7f123dc92640 1 --2- 172.21.15.7:0/181728942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa16b1b0 0x5596fa54f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.125+0000 7f123dc92640 1 -- 172.21.15.7:0/181728942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596fa54b710 con 0x5596fa194070 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.125+0000 7f123dc92640 1 --2- 172.21.15.7:0/181728942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 0x5596fa54af80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1230030eb0 tx=0x7f123002f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb74aa3582dff57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.125+0000 7f1220ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.125+0000 7f1220ff9640 1 -- 172.21.15.7:0/181728942 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230060020 con 0x5596fa194070 2024-09-21T05:55:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.125+0000 7f1220ff9640 1 -- 172.21.15.7:0/181728942 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f123002fd50 con 0x5596fa194070 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.125+0000 7f1245c69740 1 -- 172.21.15.7:0/181728942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12340035f0 con 0x5596fa194070 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.125+0000 7f1220ff9640 1 -- 172.21.15.7:0/181728942 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f123006b050 con 0x5596fa194070 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.125+0000 7f1245c69740 10 client.15960 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.125+0000 7f1245c69740 1 -- 172.21.15.7:0/181728942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5596fa5c3590 con 0x5596fa194070 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.126+0000 7f1220ff9640 1 -- 172.21.15.7:0/181728942 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12340035f0 con 0x5596fa194070 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.126+0000 7f1220ff9640 1 -- 172.21.15.7:0/181728942 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1230051070 con 0x5596fa194070 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.126+0000 7f1245c69740 10 client.15960 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.126+0000 7f1245c69740 10 client.15960 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.126+0000 7f1245c69740 20 client.15960 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.126+0000 7f1245c69740 1 --2- 172.21.15.7:0/181728942 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5596fa127da0 0x5596fa5c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.126+0000 7f1245c69740 4 client.15960 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.126+0000 7f1245c69740 1 -- 172.21.15.7:0/181728942 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5596fa4af8a0 con 0x5596fa127da0 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.126+0000 7f123d491640 1 --2- 172.21.15.7:0/181728942 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5596fa127da0 0x5596fa5c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f123d491640 1 --2- 172.21.15.7:0/181728942 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5596fa127da0 0x5596fa5c5d40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f1821f0b65a3f57 server_cookie=6975fa445b2d19b9 in_seq=0 out_seq=0 2024-09-21T05:55:46.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1220ff9640 10 client.15960 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:55:46.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1220ff9640 1 -- 172.21.15.7:0/181728942 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5596fa4af8a0 con 0x5596fa127da0 2024-09-21T05:55:46.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1220ff9640 10 client.15960 handle_command_reply: tid=0 2024-09-21T05:55:46.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1245c69740 1 client.15960 shutdown 2024-09-21T05:55:46.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1245c69740 1 -- 172.21.15.7:0/181728942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 msgr2=0x5596fa54af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:46.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1245c69740 1 --2- 172.21.15.7:0/181728942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 0x5596fa54af80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1230030eb0 tx=0x7f123002f8c0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1245c69740 1 -- 172.21.15.7:0/181728942 shutdown_connections 2024-09-21T05:55:46.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1245c69740 1 --2- 172.21.15.7:0/181728942 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5596fa127da0 0x5596fa5c5d40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1245c69740 1 --2- 172.21.15.7:0/181728942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fa194070 0x5596fa54af80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1245c69740 1 --2- 172.21.15.7:0/181728942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596fa173390 0x5596fa54aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1245c69740 1 --2- 172.21.15.7:0/181728942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5596fa16b1b0 0x5596fa54f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1245c69740 1 -- 172.21.15.7:0/181728942 >> 172.21.15.7:0/181728942 conn(0x5596fa188460 msgr2=0x5596fa5403d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:46.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1220ff9640 0 client.15960 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:55:46.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1245c69740 1 -- 172.21.15.7:0/181728942 shutdown_connections 2024-09-21T05:55:46.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1245c69740 1 -- 172.21.15.7:0/181728942 wait complete. 2024-09-21T05:55:46.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.127+0000 7f1245c69740 20 client.15960 trim_cache size 0 max 16384 2024-09-21T05:55:46.134 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:55:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.128+0000 7f123f6f5640 1 -- 172.21.15.7:0/1612082286 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f12240b6680 msgr2=0x7f12240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.128+0000 7f123f6f5640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f12240b6680 0x7f12240b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1230006010 tx=0x7f1230005d80 comp rx=0 tx=0).stop 2024-09-21T05:55:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.128+0000 7f123f6f5640 1 -- 172.21.15.7:0/1612082286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12381094c0 msgr2=0x7f1238075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.128+0000 7f123f6f5640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12381094c0 0x7f1238075c50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f122800d740 tx=0x7f122800dc00 comp rx=0 tx=0).stop 2024-09-21T05:55:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.128+0000 7f123f6f5640 1 -- 172.21.15.7:0/1612082286 shutdown_connections 2024-09-21T05:55:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.128+0000 7f123f6f5640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f12240b6680 0x7f12240b8b90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.128+0000 7f123f6f5640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12381094c0 0x7f1238075c50 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.128+0000 7f123f6f5640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1238109e10 0x7f1238076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.128+0000 7f123f6f5640 1 --2- 172.21.15.7:0/1612082286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1238103b80 0x7f1238075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.128+0000 7f123f6f5640 1 -- 172.21.15.7:0/1612082286 >> 172.21.15.7:0/1612082286 conn(0x7f12380ff610 msgr2=0x7f1238106a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.128+0000 7f123f6f5640 1 -- 172.21.15.7:0/1612082286 shutdown_connections 2024-09-21T05:55:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:46.128+0000 7f123f6f5640 1 -- 172.21.15.7:0/1612082286 wait complete. 2024-09-21T05:55:46.899 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T05:55:47.170 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.694+0000 7fb826413640 1 -- 172.21.15.7:0/3647310404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb82010de70 msgr2=0x7fb820110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.694+0000 7fb826413640 1 --2- 172.21.15.7:0/3647310404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb82010de70 0x7fb820110340 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb818009ca0 tx=0x7fb81802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.695+0000 7fb826413640 1 -- 172.21.15.7:0/3647310404 shutdown_connections 2024-09-21T05:55:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.695+0000 7fb826413640 1 --2- 172.21.15.7:0/3647310404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb82010de70 0x7fb820110340 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.695+0000 7fb826413640 1 --2- 172.21.15.7:0/3647310404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8201052a0 0x7fb82010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.695+0000 7fb826413640 1 --2- 172.21.15.7:0/3647310404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8201048c0 0x7fb820104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.695+0000 7fb826413640 1 -- 172.21.15.7:0/3647310404 >> 172.21.15.7:0/3647310404 conn(0x7fb8200797b0 msgr2=0x7fb820079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.695+0000 7fb826413640 1 -- 172.21.15.7:0/3647310404 shutdown_connections 2024-09-21T05:55:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.695+0000 7fb826413640 1 -- 172.21.15.7:0/3647310404 wait complete. 2024-09-21T05:55:47.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.695+0000 7fb826413640 1 Processor -- start 2024-09-21T05:55:47.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.696+0000 7fb826413640 1 -- start start 2024-09-21T05:55:47.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.696+0000 7fb826413640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8201048c0 0x7fb82019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.696+0000 7fb826413640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8201052a0 0x7fb82019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.696+0000 7fb826413640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb82010de70 0x7fb82019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.696+0000 7fb826413640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb820113ab0 con 0x7fb8201048c0 2024-09-21T05:55:47.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.696+0000 7fb826413640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb820113930 con 0x7fb8201052a0 2024-09-21T05:55:47.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.696+0000 7fb826413640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb820113c30 con 0x7fb82010de70 2024-09-21T05:55:47.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.696+0000 7fb81ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8201048c0 0x7fb82019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.696+0000 7fb81ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8201048c0 0x7fb82019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52600/0 (socket says 172.21.15.7:52600) 2024-09-21T05:55:47.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.696+0000 7fb81ffff640 1 -- 172.21.15.7:0/4160310448 learned_addr learned my addr 172.21.15.7:0/4160310448 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:47.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.696+0000 7fb81f7fe640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8201052a0 0x7fb82019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.696+0000 7fb8249b0640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb82010de70 0x7fb82019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.697+0000 7fb81ffff640 1 -- 172.21.15.7:0/4160310448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb82010de70 msgr2=0x7fb82019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:47.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.697+0000 7fb81ffff640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb82010de70 0x7fb82019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.697+0000 7fb81ffff640 1 -- 172.21.15.7:0/4160310448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8201052a0 msgr2=0x7fb82019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:47.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.697+0000 7fb81ffff640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8201052a0 0x7fb82019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.697+0000 7fb81ffff640 1 -- 172.21.15.7:0/4160310448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8201a0370 con 0x7fb8201048c0 2024-09-21T05:55:47.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.697+0000 7fb81ffff640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8201048c0 0x7fb82019a4c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb81000c920 tx=0x7fb81000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.697+0000 7fb81d7fa640 1 -- 172.21.15.7:0/4160310448 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810007c70 con 0x7fb8201048c0 2024-09-21T05:55:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.697+0000 7fb826413640 1 -- 172.21.15.7:0/4160310448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8201a0660 con 0x7fb8201048c0 2024-09-21T05:55:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.697+0000 7fb826413640 1 -- 172.21.15.7:0/4160310448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8201a6e80 con 0x7fb8201048c0 2024-09-21T05:55:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.697+0000 7fb81d7fa640 1 -- 172.21.15.7:0/4160310448 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb810007e10 con 0x7fb8201048c0 2024-09-21T05:55:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.697+0000 7fb81d7fa640 1 -- 172.21.15.7:0/4160310448 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810018820 con 0x7fb8201048c0 2024-09-21T05:55:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.700+0000 7fb82c987740 1 Processor -- start 2024-09-21T05:55:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.700+0000 7fb82c987740 1 -- start start 2024-09-21T05:55:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.700+0000 7fb82c987740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3f1070 0x560e2c7986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.700+0000 7fb82c987740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3c81b0 0x560e2c798be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.700+0000 7fb82c987740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3d0390 0x560e2c799120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.700+0000 7fb82c987740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560e2c70eea0 con 0x560e2c3d0390 2024-09-21T05:55:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.700+0000 7fb82c987740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560e2c6fe2d0 con 0x560e2c3f1070 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.700+0000 7fb82c987740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560e2c7020e0 con 0x560e2c3c81b0 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.701+0000 7fb8249b0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3f1070 0x560e2c7986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.701+0000 7fb81f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3d0390 0x560e2c799120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.701+0000 7fb8249b0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3f1070 0x560e2c7986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:59908/0 (socket says 172.21.15.7:59908) 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.701+0000 7fb8249b0640 1 -- 172.21.15.7:0/3218275578 learned_addr learned my addr 172.21.15.7:0/3218275578 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.701+0000 7fb81d7fa640 1 -- 172.21.15.7:0/4160310448 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb81000f450 con 0x7fb8201048c0 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.701+0000 7fb8249b0640 1 -- 172.21.15.7:0/3218275578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3c81b0 msgr2=0x560e2c798be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.701+0000 7fb8249b0640 1 --2- 172.21.15.7:0/3218275578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3c81b0 0x560e2c798be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.701+0000 7fb8249b0640 1 -- 172.21.15.7:0/3218275578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3d0390 msgr2=0x560e2c799120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.701+0000 7fb8249b0640 1 --2- 172.21.15.7:0/3218275578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3d0390 0x560e2c799120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.701+0000 7fb8249b0640 1 -- 172.21.15.7:0/3218275578 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e2c45c650 con 0x560e2c3f1070 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.701+0000 7fb8249b0640 1 --2- 172.21.15.7:0/3218275578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3f1070 0x560e2c7986a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb818009920 tx=0x7fb818009950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bca6cd91e382820 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.701+0000 7fb8067fc640 1 -- 172.21.15.7:0/3218275578 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818031e30 con 0x560e2c3f1070 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.702+0000 7fb8067fc640 1 -- 172.21.15.7:0/3218275578 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb818036030 con 0x560e2c3f1070 2024-09-21T05:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.702+0000 7fb8067fc640 1 -- 172.21.15.7:0/3218275578 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818004330 con 0x560e2c3f1070 2024-09-21T05:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.702+0000 7fb81d7fa640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8080b66b0 0x7fb8080b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.702+0000 7fb81ffff640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8080b66b0 0x7fb8080b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.702+0000 7fb81d7fa640 1 -- 172.21.15.7:0/4160310448 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb8100e7710 con 0x7fb8201048c0 2024-09-21T05:55:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.703+0000 7fb82c987740 1 -- 172.21.15.7:0/3218275578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3f1070 msgr2=0x560e2c7986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.703+0000 7fb81ffff640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8080b66b0 0x7fb8080b8bc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb810007590 tx=0x7fb810076100 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.703+0000 7fb82c987740 1 --2- 172.21.15.7:0/3218275578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3f1070 0x560e2c7986a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb818009920 tx=0x7fb818009950 comp rx=0 tx=0).stop 2024-09-21T05:55:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.703+0000 7fb82c987740 1 -- 172.21.15.7:0/3218275578 shutdown_connections 2024-09-21T05:55:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.703+0000 7fb82c987740 1 --2- 172.21.15.7:0/3218275578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3d0390 0x560e2c799120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.703+0000 7fb82c987740 1 --2- 172.21.15.7:0/3218275578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3c81b0 0x560e2c798be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.703+0000 7fb82c987740 1 --2- 172.21.15.7:0/3218275578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3f1070 0x560e2c7986a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.703+0000 7fb82c987740 1 -- 172.21.15.7:0/3218275578 >> 172.21.15.7:0/3218275578 conn(0x560e2c3e5460 msgr2=0x560e2c796590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.703+0000 7fb82c987740 1 -- 172.21.15.7:0/3218275578 shutdown_connections 2024-09-21T05:55:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.703+0000 7fb82c987740 1 -- 172.21.15.7:0/3218275578 wait complete. 2024-09-21T05:55:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.703+0000 7fb82c987740 1 -- start start 2024-09-21T05:55:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.704+0000 7fb82c987740 1 Processor -- start 2024-09-21T05:55:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.704+0000 7fb82c987740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3c81b0 0x560e2c7a80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.704+0000 7fb82c987740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3d0390 0x560e2c7a8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.704+0000 7fb82c987740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 0x560e2c7a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.704+0000 7fb82c987740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560e2c55f700 con 0x560e2c3f1070 2024-09-21T05:55:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.704+0000 7fb82c987740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560e2c699160 con 0x560e2c3c81b0 2024-09-21T05:55:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.704+0000 7fb82c987740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560e2c7aafd0 con 0x560e2c3d0390 2024-09-21T05:55:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.704+0000 7fb82c987740 10 client.0 _ll_register_callbacks cb 0x560e2c6b29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.704+0000 7fb8249b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 0x560e2c7a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.704+0000 7fb8249b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 0x560e2c7a8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52630/0 (socket says 172.21.15.7:52630) 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.704+0000 7fb8249b0640 1 -- 172.21.15.7:0/1536391943 learned_addr learned my addr 172.21.15.7:0/1536391943 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.704+0000 7fb81f7fe640 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3d0390 0x560e2c7a8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.704+0000 7fb8249b0640 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3c81b0 0x560e2c7a80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.705+0000 7fb8249b0640 1 -- 172.21.15.7:0/1536391943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3d0390 msgr2=0x560e2c7a8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.705+0000 7fb8249b0640 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3d0390 0x560e2c7a8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.705+0000 7fb8249b0640 1 -- 172.21.15.7:0/1536391943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3c81b0 msgr2=0x560e2c7a80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.705+0000 7fb8249b0640 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3c81b0 0x560e2c7a80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.705+0000 7fb8249b0640 1 -- 172.21.15.7:0/1536391943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e2c6c6c90 con 0x560e2c3f1070 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.705+0000 7fb81f7fe640 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3d0390 0x560e2c7a8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.705+0000 7fb8249b0640 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 0x560e2c7a8b60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb818009620 tx=0x7fb818003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fabaf43c2513a44 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.705+0000 7fb7ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.705+0000 7fb7ff7fe640 1 -- 172.21.15.7:0/1536391943 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818059060 con 0x560e2c3f1070 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.705+0000 7fb82c987740 1 -- 172.21.15.7:0/1536391943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb818036030 con 0x560e2c3f1070 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.705+0000 7fb7ff7fe640 1 -- 172.21.15.7:0/1536391943 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb818031450 con 0x560e2c3f1070 2024-09-21T05:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.705+0000 7fb7ff7fe640 1 -- 172.21.15.7:0/1536391943 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb818031650 con 0x560e2c3f1070 2024-09-21T05:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.706+0000 7fb82c987740 10 client.15972 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.706+0000 7fb82c987740 1 -- 172.21.15.7:0/1536391943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560e2c7b6cc0 con 0x560e2c3f1070 2024-09-21T05:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.706+0000 7fb7ff7fe640 1 -- 172.21.15.7:0/1536391943 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb818036030 con 0x560e2c3f1070 2024-09-21T05:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.706+0000 7fb7ff7fe640 1 -- 172.21.15.7:0/1536391943 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb818043070 con 0x560e2c3f1070 2024-09-21T05:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.706+0000 7fb82c987740 10 client.15972 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.706+0000 7fb82c987740 10 client.15972 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.706+0000 7fb82c987740 20 client.15972 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.706+0000 7fb82c987740 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560e2c3af9f0 0x560e2c7ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.706+0000 7fb82c987740 4 client.15972 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.706+0000 7fb82c987740 1 -- 172.21.15.7:0/1536391943 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e2c710df0 con 0x560e2c3af9f0 2024-09-21T05:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.706+0000 7fb81f7fe640 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560e2c3af9f0 0x560e2c7ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.707+0000 7fb7ff7fe640 10 client.15972 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.707+0000 7fb81f7fe640 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560e2c3af9f0 0x560e2c7ba020 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22f813508d986df0 server_cookie=476d9942bb1ca496 in_seq=0 out_seq=0 2024-09-21T05:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb7ff7fe640 1 -- 172.21.15.7:0/1536391943 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560e2c710df0 con 0x560e2c3af9f0 2024-09-21T05:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb7ff7fe640 10 client.15972 handle_command_reply: tid=0 2024-09-21T05:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb82c987740 1 client.15972 shutdown 2024-09-21T05:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb82c987740 1 -- 172.21.15.7:0/1536391943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 msgr2=0x560e2c7a8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb82c987740 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 0x560e2c7a8b60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb818009620 tx=0x7fb818003e80 comp rx=0 tx=0).stop 2024-09-21T05:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb82c987740 1 -- 172.21.15.7:0/1536391943 shutdown_connections 2024-09-21T05:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb82c987740 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560e2c3af9f0 0x560e2c7ba020 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb82c987740 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 0x560e2c7a8b60 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb82c987740 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3d0390 0x560e2c7a8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb7ff7fe640 0 client.15972 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb82c987740 1 --2- 172.21.15.7:0/1536391943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3c81b0 0x560e2c7a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb82c987740 1 -- 172.21.15.7:0/1536391943 >> 172.21.15.7:0/1536391943 conn(0x560e2c3e5460 msgr2=0x560e2c79b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb82c987740 1 -- 172.21.15.7:0/1536391943 shutdown_connections 2024-09-21T05:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb82c987740 1 -- 172.21.15.7:0/1536391943 wait complete. 2024-09-21T05:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.708+0000 7fb82c987740 20 client.15972 trim_cache size 0 max 16384 2024-09-21T05:55:47.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.722+0000 7fb82c987740 1 Processor -- start 2024-09-21T05:55:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.722+0000 7fb82c987740 1 -- start start 2024-09-21T05:55:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.722+0000 7fb82c987740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3c81b0 0x560e2c79a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.722+0000 7fb82c987740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3d0390 0x560e2c7b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.722+0000 7fb82c987740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 0x560e2c795bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.722+0000 7fb82c987740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb8201afb90 con 0x560e2c3f1070 2024-09-21T05:55:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.722+0000 7fb82c987740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb8201ad460 con 0x560e2c3c81b0 2024-09-21T05:55:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.722+0000 7fb82c987740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb8201ab2b0 con 0x560e2c3d0390 2024-09-21T05:55:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.722+0000 7fb8249b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 0x560e2c795bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.722+0000 7fb8249b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 0x560e2c795bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52632/0 (socket says 172.21.15.7:52632) 2024-09-21T05:55:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.722+0000 7fb8249b0640 1 -- 172.21.15.7:0/1137937885 learned_addr learned my addr 172.21.15.7:0/1137937885 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.722+0000 7fb81f7fe640 1 --2- 172.21.15.7:0/1137937885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3d0390 0x560e2c7b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.722+0000 7fb8249b0640 1 --2- 172.21.15.7:0/1137937885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3c81b0 0x560e2c79a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.723+0000 7fb81f7fe640 1 -- 172.21.15.7:0/1137937885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3c81b0 msgr2=0x560e2c79a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.723+0000 7fb81f7fe640 1 --2- 172.21.15.7:0/1137937885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3c81b0 0x560e2c79a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.723+0000 7fb81f7fe640 1 -- 172.21.15.7:0/1137937885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 msgr2=0x560e2c795bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.723+0000 7fb81f7fe640 1 --2- 172.21.15.7:0/1137937885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 0x560e2c795bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.723+0000 7fb81f7fe640 1 -- 172.21.15.7:0/1137937885 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e2c79b4a0 con 0x560e2c3d0390 2024-09-21T05:55:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.723+0000 7fb8249b0640 1 --2- 172.21.15.7:0/1137937885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 0x560e2c795bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.723+0000 7fb81f7fe640 1 --2- 172.21.15.7:0/1137937885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3d0390 0x560e2c7b39a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x560e2c70efd0 tx=0x7fb81400b410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37d3a24a6f39c599 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.723+0000 7fb805ffb640 1 -- 172.21.15.7:0/1137937885 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814004220 con 0x560e2c3d0390 2024-09-21T05:55:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.723+0000 7fb805ffb640 1 -- 172.21.15.7:0/1137937885 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb814010e10 con 0x560e2c3d0390 2024-09-21T05:55:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.723+0000 7fb805ffb640 1 -- 172.21.15.7:0/1137937885 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814004a00 con 0x560e2c3d0390 2024-09-21T05:55:47.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.724+0000 7fb82c987740 1 -- 172.21.15.7:0/1137937885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3d0390 msgr2=0x560e2c7b39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:47.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.724+0000 7fb82c987740 1 --2- 172.21.15.7:0/1137937885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3d0390 0x560e2c7b39a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x560e2c70efd0 tx=0x7fb81400b410 comp rx=0 tx=0).stop 2024-09-21T05:55:47.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.724+0000 7fb82c987740 1 -- 172.21.15.7:0/1137937885 shutdown_connections 2024-09-21T05:55:47.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.724+0000 7fb82c987740 1 --2- 172.21.15.7:0/1137937885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3f1070 0x560e2c795bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.724+0000 7fb82c987740 1 --2- 172.21.15.7:0/1137937885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3d0390 0x560e2c7b39a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.724+0000 7fb82c987740 1 --2- 172.21.15.7:0/1137937885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3c81b0 0x560e2c79a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.724+0000 7fb82c987740 1 -- 172.21.15.7:0/1137937885 >> 172.21.15.7:0/1137937885 conn(0x560e2c3e5460 msgr2=0x560e2c7b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:47.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.724+0000 7fb82c987740 1 -- 172.21.15.7:0/1137937885 shutdown_connections 2024-09-21T05:55:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.724+0000 7fb82c987740 1 -- 172.21.15.7:0/1137937885 wait complete. 2024-09-21T05:55:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.725+0000 7fb82c987740 1 -- start start 2024-09-21T05:55:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.725+0000 7fb82c987740 1 Processor -- start 2024-09-21T05:55:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.725+0000 7fb82c987740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3c81b0 0x560e2c7bd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.725+0000 7fb82c987740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3d0390 0x560e2c7bad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.725+0000 7fb82c987740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3f1070 0x560e2c7bb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.725+0000 7fb82c987740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb8201ab920 con 0x560e2c3c81b0 2024-09-21T05:55:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.725+0000 7fb82c987740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb8201acd90 con 0x560e2c3d0390 2024-09-21T05:55:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.725+0000 7fb82c987740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb8201abff0 con 0x560e2c3f1070 2024-09-21T05:55:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.725+0000 7fb82c987740 10 client.0 _ll_register_callbacks cb 0x7fb81400b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb8249b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3c81b0 0x560e2c7bd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb8249b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3c81b0 0x560e2c7bd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52648/0 (socket says 172.21.15.7:52648) 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb8249b0640 1 -- 172.21.15.7:0/3553838816 learned_addr learned my addr 172.21.15.7:0/3553838816 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb81f7fe640 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3d0390 0x560e2c7bad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb8249b0640 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3f1070 0x560e2c7bb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb8249b0640 1 -- 172.21.15.7:0/3553838816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3f1070 msgr2=0x560e2c7bb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb8249b0640 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3f1070 0x560e2c7bb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb8249b0640 1 -- 172.21.15.7:0/3553838816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3d0390 msgr2=0x560e2c7bad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb8249b0640 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3d0390 0x560e2c7bad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb8249b0640 1 -- 172.21.15.7:0/3553838816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e2c7bba20 con 0x560e2c3c81b0 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb81f7fe640 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3d0390 0x560e2c7bad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb8249b0640 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3c81b0 0x560e2c7bd860 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb81802fe50 tx=0x7fb818003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868b199f92545c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb7ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb7ff7fe640 1 -- 172.21.15.7:0/3553838816 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818064040 con 0x560e2c3c81b0 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb7ff7fe640 1 -- 172.21.15.7:0/3553838816 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb818031450 con 0x560e2c3c81b0 2024-09-21T05:55:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.726+0000 7fb82c987740 1 -- 172.21.15.7:0/3553838816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb814010e10 con 0x560e2c3c81b0 2024-09-21T05:55:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.727+0000 7fb7ff7fe640 1 -- 172.21.15.7:0/3553838816 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb818004760 con 0x560e2c3c81b0 2024-09-21T05:55:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.727+0000 7fb82c987740 10 client.15978 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.727+0000 7fb82c987740 1 -- 172.21.15.7:0/3553838816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560e2c824700 con 0x560e2c3c81b0 2024-09-21T05:55:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.727+0000 7fb7ff7fe640 1 -- 172.21.15.7:0/3553838816 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb814010e10 con 0x560e2c3c81b0 2024-09-21T05:55:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.727+0000 7fb7ff7fe640 1 -- 172.21.15.7:0/3553838816 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb818043040 con 0x560e2c3c81b0 2024-09-21T05:55:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.727+0000 7fb82c987740 10 client.15978 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.727+0000 7fb82c987740 10 client.15978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.727+0000 7fb82c987740 20 client.15978 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.727+0000 7fb82c987740 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560e2c384da0 0x560e2c826db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.727+0000 7fb82c987740 4 client.15978 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:55:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.727+0000 7fb82c987740 1 -- 172.21.15.7:0/3553838816 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560e2c70c8a0 con 0x560e2c384da0 2024-09-21T05:55:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.727+0000 7fb81f7fe640 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560e2c384da0 0x560e2c826db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb81f7fe640 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560e2c384da0 0x560e2c826db0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1895ece9d3bd67d server_cookie=24d12328a9728c45 in_seq=0 out_seq=0 2024-09-21T05:55:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb7ff7fe640 10 client.15978 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb7ff7fe640 1 -- 172.21.15.7:0/3553838816 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560e2c70c8a0 con 0x560e2c384da0 2024-09-21T05:55:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb7ff7fe640 10 client.15978 handle_command_reply: tid=0 2024-09-21T05:55:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb82c987740 1 client.15978 shutdown 2024-09-21T05:55:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb82c987740 1 -- 172.21.15.7:0/3553838816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3c81b0 msgr2=0x560e2c7bd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb82c987740 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3c81b0 0x560e2c7bd860 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb81802fe50 tx=0x7fb818003de0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb82c987740 1 -- 172.21.15.7:0/3553838816 shutdown_connections 2024-09-21T05:55:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb82c987740 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560e2c384da0 0x560e2c826db0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb7ff7fe640 0 client.15978 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb82c987740 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560e2c3f1070 0x560e2c7bb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb82c987740 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560e2c3d0390 0x560e2c7bad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb82c987740 1 --2- 172.21.15.7:0/3553838816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2c3c81b0 0x560e2c7bd860 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb82c987740 1 -- 172.21.15.7:0/3553838816 >> 172.21.15.7:0/3553838816 conn(0x560e2c3e5460 msgr2=0x560e2c799e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:47.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.728+0000 7fb82c987740 1 -- 172.21.15.7:0/3553838816 shutdown_connections 2024-09-21T05:55:47.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb82c987740 1 -- 172.21.15.7:0/3553838816 wait complete. 2024-09-21T05:55:47.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb82c987740 20 client.15978 trim_cache size 0 max 16384 2024-09-21T05:55:47.735 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:55:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb826413640 1 -- 172.21.15.7:0/4160310448 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8080b66b0 msgr2=0x7fb8080b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb826413640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8080b66b0 0x7fb8080b8bc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb810007590 tx=0x7fb810076100 comp rx=0 tx=0).stop 2024-09-21T05:55:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb826413640 1 -- 172.21.15.7:0/4160310448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8201048c0 msgr2=0x7fb82019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb826413640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8201048c0 0x7fb82019a4c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb81000c920 tx=0x7fb81000cde0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb826413640 1 -- 172.21.15.7:0/4160310448 shutdown_connections 2024-09-21T05:55:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb826413640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8080b66b0 0x7fb8080b8bc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb826413640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb82010de70 0x7fb82019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb826413640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8201052a0 0x7fb82019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb826413640 1 --2- 172.21.15.7:0/4160310448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8201048c0 0x7fb82019a4c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb826413640 1 -- 172.21.15.7:0/4160310448 >> 172.21.15.7:0/4160310448 conn(0x7fb8200797b0 msgr2=0x7fb8201079c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:47.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb826413640 1 -- 172.21.15.7:0/4160310448 shutdown_connections 2024-09-21T05:55:47.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:47.729+0000 7fb826413640 1 -- 172.21.15.7:0/4160310448 wait complete. 2024-09-21T05:55:47.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:47 smithi027 ceph-mon[34364]: pgmap v375: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 868 KiB/s wr, 10 op/s 2024-09-21T05:55:48.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:47 smithi007 ceph-mon[30983]: pgmap v375: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 868 KiB/s wr, 10 op/s 2024-09-21T05:55:48.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:47 smithi119 ceph-mon[34833]: pgmap v375: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 868 KiB/s wr, 10 op/s 2024-09-21T05:55:49.415 INFO:tasks.workunit.client.0.smithi007.stdout:setting up random write file 2024-09-21T05:55:49.415 INFO:tasks.workunit.client.0.smithi007.stdout:done setting up random write file 2024-09-21T05:55:49.415 INFO:tasks.workunit.client.0.smithi007.stdout:starting fsync run 2024-09-21T05:55:49.415 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0105s 2024-09-21T05:55:49.415 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0069s 2024-09-21T05:55:49.415 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0058s 2024-09-21T05:55:49.415 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0064s 2024-09-21T05:55:49.415 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0062s 2024-09-21T05:55:49.415 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0057s 2024-09-21T05:55:49.415 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0056s 2024-09-21T05:55:49.415 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0056s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0074s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0060s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0063s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0068s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0057s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0055s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0054s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0056s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0053s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0061s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0059s 2024-09-21T05:55:49.416 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0057s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0053s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0053s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0057s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0053s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0051s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0053s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0053s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0049s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0068s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0064s 2024-09-21T05:55:49.417 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.2942s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0061s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0059s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0063s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0065s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0056s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0070s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0062s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0062s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0058s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0062s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0057s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0060s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0059s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0059s 2024-09-21T05:55:49.418 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0059s 2024-09-21T05:55:49.419 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0058s 2024-09-21T05:55:49.419 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0066s 2024-09-21T05:55:49.419 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0064s 2024-09-21T05:55:49.419 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0069s 2024-09-21T05:55:49.419 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0078s 2024-09-21T05:55:49.419 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0080s 2024-09-21T05:55:49.419 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0075s 2024-09-21T05:55:49.419 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0077s 2024-09-21T05:55:49.419 INFO:tasks.workunit.client.0.smithi007.stdout:run done 61 fsyncs total, killing random writer 2024-09-21T05:55:49.419 INFO:tasks.workunit.client.0.smithi007.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-21T05:55:49.420 INFO:tasks.workunit.client.0.smithi007.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-21T05:55:49.420 INFO:tasks.workunit.client.0.smithi007.stderr:+ whereis lsof 2024-09-21T05:55:49.443 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T05:55:49.443 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T05:55:49.457 INFO:tasks.workunit.client.0.smithi007.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-09-21T05:55:49.457 INFO:tasks.workunit.client.0.smithi007.stderr:+ lsof 2024-09-21T05:55:49.471 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/087f30a9856ebab3650fde159a27e672d7ef09029be038bef85065f5ce9e66ef/merged 2024-09-21T05:55:49.472 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-21T05:55:49.472 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/5e9d5fafda9f8f2f8265be632bc72c53989001c1ef5ef95e72119232bda43dc2/merged 2024-09-21T05:55:49.472 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-21T05:55:49.472 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/9abca39a4deb81afc2856de949e6be4cf69095acdfec535cd6be5d80ad9bea2a/merged 2024-09-21T05:55:49.472 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-21T05:55:49.472 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/4554328cd5c99c60951edc6338bde18711f125d14bcdca3a26959613fc202dbd/merged 2024-09-21T05:55:49.472 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-21T05:55:49.477 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/8e19b50d30c6cbb43a57444d2add7d00b8280063f794b8d87b291854817c162e/merged 2024-09-21T05:55:49.477 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-21T05:55:49.477 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/60e86912791d252aeb770b8395a1e949afea1de10acef2b09a837d8d0140310b/merged 2024-09-21T05:55:49.477 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-21T05:55:49.477 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/b528a48ad128db0cfef005f2a06813efd24f7c7a7e78ed12e7b1c683b81217bc/merged 2024-09-21T05:55:49.477 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-21T05:55:49.477 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/4030a77cdf53155093756ac805736f058418df3f3b41aad38d39abfcf48e2ce3/merged 2024-09-21T05:55:49.477 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-21T05:55:49.477 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/b2d0626a2a272648fa369523f55758a0308e6c3014def964c070f281594950bf/merged 2024-09-21T05:55:49.477 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-21T05:55:49.477 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/8177e59ef19458c0e49ec97a489f83c5ea8643efef40c80f98845dbef4f6bd97/merged 2024-09-21T05:55:49.477 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-21T05:55:49.538 INFO:tasks.workunit.client.0.smithi007.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:pool_work 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:pool_work 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:pool_work 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:pool_work 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-09-21T05:55:49.539 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-09-21T05:55:49.540 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 9 root NOFD /proc/9/fd (opendir: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-09-21T05:55:49.541 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-09-21T05:55:49.542 INFO:tasks.workunit.client.0.smithi007.stdout:pr/ttyS1 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:pr/ttyS1 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:pr/ttyS1 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_preem 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_preem 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_preem 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_preem 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:migration 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:migration 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:migration 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:migration 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-09-21T05:55:49.543 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/0 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/0 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/0 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/0 22 root NOFD /proc/22/fd (opendir: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/1 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/1 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/1 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/1 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:migration 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2024-09-21T05:55:49.544 INFO:tasks.workunit.client.0.smithi007.stdout:migration 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:migration 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:migration 25 root NOFD /proc/25/fd (opendir: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 27 root cwd unknown /proc/27/cwd (readlink: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 27 root rtd unknown /proc/27/root (readlink: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 27 root txt unknown /proc/27/exe (readlink: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 27 root NOFD /proc/27/fd (opendir: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 28 root NOFD /proc/28/fd (opendir: Permission denied) 2024-09-21T05:55:49.545 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/2 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/2 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/2 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/2 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:migration 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:migration 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:migration 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:migration 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-09-21T05:55:49.546 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/3 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/3 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/3 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/3 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:migration 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:migration 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-09-21T05:55:49.547 INFO:tasks.workunit.client.0.smithi007.stdout:migration 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:migration 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 40 root cwd unknown /proc/40/cwd (readlink: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 40 root rtd unknown /proc/40/root (readlink: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 40 root txt unknown /proc/40/exe (readlink: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 40 root NOFD /proc/40/fd (opendir: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-09-21T05:55:49.548 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 46 root NOFD /proc/46/fd (opendir: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/5 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/5 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-09-21T05:55:49.549 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/5 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-09-21T05:55:49.550 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/5 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-09-21T05:55:49.550 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-09-21T05:55:49.550 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-09-21T05:55:49.550 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-09-21T05:55:49.550 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-09-21T05:55:49.550 INFO:tasks.workunit.client.0.smithi007.stdout:migration 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-09-21T05:55:49.550 INFO:tasks.workunit.client.0.smithi007.stdout:migration 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-09-21T05:55:49.550 INFO:tasks.workunit.client.0.smithi007.stdout:migration 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-09-21T05:55:49.550 INFO:tasks.workunit.client.0.smithi007.stdout:migration 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-09-21T05:55:49.550 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2024-09-21T05:55:49.550 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2024-09-21T05:55:49.550 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2024-09-21T05:55:49.550 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 50 root NOFD /proc/50/fd (opendir: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 52 root NOFD /proc/52/fd (opendir: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/6 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/6 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/6 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/6 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:migration 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:migration 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:migration 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2024-09-21T05:55:49.551 INFO:tasks.workunit.client.0.smithi007.stdout:migration 55 root NOFD /proc/55/fd (opendir: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 58 root NOFD /proc/58/fd (opendir: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/7 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/7 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/7 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/7 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 60 root cwd unknown /proc/60/cwd (readlink: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 60 root rtd unknown /proc/60/root (readlink: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 60 root txt unknown /proc/60/exe (readlink: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 60 root NOFD /proc/60/fd (opendir: Permission denied) 2024-09-21T05:55:49.552 INFO:tasks.workunit.client.0.smithi007.stdout:migration 61 root cwd unknown /proc/61/cwd (readlink: Permission denied) 2024-09-21T05:55:49.553 INFO:tasks.workunit.client.0.smithi007.stdout:migration 61 root rtd unknown /proc/61/root (readlink: Permission denied) 2024-09-21T05:55:49.553 INFO:tasks.workunit.client.0.smithi007.stdout:migration 61 root txt unknown /proc/61/exe (readlink: Permission denied) 2024-09-21T05:55:49.553 INFO:tasks.workunit.client.0.smithi007.stdout:migration 61 root NOFD /proc/61/fd (opendir: Permission denied) 2024-09-21T05:55:49.553 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 62 root cwd unknown /proc/62/cwd (readlink: Permission denied) 2024-09-21T05:55:49.553 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 62 root rtd unknown /proc/62/root (readlink: Permission denied) 2024-09-21T05:55:49.553 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 62 root txt unknown /proc/62/exe (readlink: Permission denied) 2024-09-21T05:55:49.553 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 62 root NOFD /proc/62/fd (opendir: Permission denied) 2024-09-21T05:55:49.553 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 64 root cwd unknown /proc/64/cwd (readlink: Permission denied) 2024-09-21T05:55:49.553 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 64 root rtd unknown /proc/64/root (readlink: Permission denied) 2024-09-21T05:55:49.553 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 64 root txt unknown /proc/64/exe (readlink: Permission denied) 2024-09-21T05:55:49.553 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 64 root NOFD /proc/64/fd (opendir: Permission denied) 2024-09-21T05:55:49.553 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 67 root cwd unknown /proc/67/cwd (readlink: Permission denied) 2024-09-21T05:55:49.553 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 67 root rtd unknown /proc/67/root (readlink: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 67 root txt unknown /proc/67/exe (readlink: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 67 root NOFD /proc/67/fd (opendir: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 69 root NOFD /proc/69/fd (opendir: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 71 root cwd unknown /proc/71/cwd (readlink: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 71 root rtd unknown /proc/71/root (readlink: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 71 root txt unknown /proc/71/exe (readlink: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 71 root NOFD /proc/71/fd (opendir: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kdevtmpfs 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kdevtmpfs 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kdevtmpfs 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-09-21T05:55:49.554 INFO:tasks.workunit.client.0.smithi007.stdout:kdevtmpfs 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:kauditd 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:kauditd 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:kauditd 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:kauditd 74 root NOFD /proc/74/fd (opendir: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:khungtask 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:khungtask 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:khungtask 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:khungtask 76 root NOFD /proc/76/fd (opendir: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:oom_reape 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-09-21T05:55:49.555 INFO:tasks.workunit.client.0.smithi007.stdout:oom_reape 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:oom_reape 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:oom_reape 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:kcompactd 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:kcompactd 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:kcompactd 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:kcompactd 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:ksmd 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:ksmd 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:ksmd 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-09-21T05:55:49.556 INFO:tasks.workunit.client.0.smithi007.stdout:ksmd 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:khugepage 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:khugepage 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:khugepage 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:khugepage 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2024-09-21T05:55:49.557 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 84 root NOFD /proc/84/fd (opendir: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 85 root cwd unknown /proc/85/cwd (readlink: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 85 root rtd unknown /proc/85/root (readlink: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 85 root txt unknown /proc/85/exe (readlink: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 85 root NOFD /proc/85/fd (opendir: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 88 root NOFD /proc/88/fd (opendir: Permission denied) 2024-09-21T05:55:49.558 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 90 root NOFD /proc/90/fd (opendir: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:watchdogd 91 root cwd unknown /proc/91/cwd (readlink: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:watchdogd 91 root rtd unknown /proc/91/root (readlink: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:watchdogd 91 root txt unknown /proc/91/exe (readlink: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:watchdogd 91 root NOFD /proc/91/fd (opendir: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 92 root cwd unknown /proc/92/cwd (readlink: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 92 root rtd unknown /proc/92/root (readlink: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 92 root txt unknown /proc/92/exe (readlink: Permission denied) 2024-09-21T05:55:49.559 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 92 root NOFD /proc/92/fd (opendir: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 94 root cwd unknown /proc/94/cwd (readlink: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 94 root rtd unknown /proc/94/root (readlink: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 94 root txt unknown /proc/94/exe (readlink: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 94 root NOFD /proc/94/fd (opendir: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kswapd0 96 root cwd unknown /proc/96/cwd (readlink: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kswapd0 96 root rtd unknown /proc/96/root (readlink: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kswapd0 96 root txt unknown /proc/96/exe (readlink: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kswapd0 96 root NOFD /proc/96/fd (opendir: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 102 root cwd unknown /proc/102/cwd (readlink: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 102 root rtd unknown /proc/102/root (readlink: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 102 root txt unknown /proc/102/exe (readlink: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 102 root NOFD /proc/102/fd (opendir: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 108 root cwd unknown /proc/108/cwd (readlink: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 108 root rtd unknown /proc/108/root (readlink: Permission denied) 2024-09-21T05:55:49.560 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 108 root txt unknown /proc/108/exe (readlink: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 108 root NOFD /proc/108/fd (opendir: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 109 root cwd unknown /proc/109/cwd (readlink: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 109 root rtd unknown /proc/109/root (readlink: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 109 root txt unknown /proc/109/exe (readlink: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 109 root NOFD /proc/109/fd (opendir: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 110 root cwd unknown /proc/110/cwd (readlink: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 110 root rtd unknown /proc/110/root (readlink: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 110 root txt unknown /proc/110/exe (readlink: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 110 root NOFD /proc/110/fd (opendir: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 112 root cwd unknown /proc/112/cwd (readlink: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 112 root rtd unknown /proc/112/root (readlink: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 112 root txt unknown /proc/112/exe (readlink: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 112 root NOFD /proc/112/fd (opendir: Permission denied) 2024-09-21T05:55:49.561 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 113 root cwd unknown /proc/113/cwd (readlink: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 113 root rtd unknown /proc/113/root (readlink: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 113 root txt unknown /proc/113/exe (readlink: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 113 root NOFD /proc/113/fd (opendir: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 117 root cwd unknown /proc/117/cwd (readlink: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 117 root rtd unknown /proc/117/root (readlink: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 117 root txt unknown /proc/117/exe (readlink: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 117 root NOFD /proc/117/fd (opendir: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 118 root cwd unknown /proc/118/cwd (readlink: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 118 root rtd unknown /proc/118/root (readlink: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 118 root txt unknown /proc/118/exe (readlink: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 118 root NOFD /proc/118/fd (opendir: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 119 root cwd unknown /proc/119/cwd (readlink: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 119 root rtd unknown /proc/119/root (readlink: Permission denied) 2024-09-21T05:55:49.562 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 119 root txt unknown /proc/119/exe (readlink: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 119 root NOFD /proc/119/fd (opendir: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 128 root cwd unknown /proc/128/cwd (readlink: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 128 root rtd unknown /proc/128/root (readlink: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 128 root txt unknown /proc/128/exe (readlink: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 128 root NOFD /proc/128/fd (opendir: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 240 root cwd unknown /proc/240/cwd (readlink: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 240 root rtd unknown /proc/240/root (readlink: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 240 root txt unknown /proc/240/exe (readlink: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 240 root NOFD /proc/240/fd (opendir: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 241 root cwd unknown /proc/241/cwd (readlink: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 241 root rtd unknown /proc/241/root (readlink: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 241 root txt unknown /proc/241/exe (readlink: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 241 root NOFD /proc/241/fd (opendir: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 281 root cwd unknown /proc/281/cwd (readlink: Permission denied) 2024-09-21T05:55:49.563 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 281 root rtd unknown /proc/281/root (readlink: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 281 root txt unknown /proc/281/exe (readlink: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 281 root NOFD /proc/281/fd (opendir: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 283 root cwd unknown /proc/283/cwd (readlink: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 283 root rtd unknown /proc/283/root (readlink: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 283 root txt unknown /proc/283/exe (readlink: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 283 root NOFD /proc/283/fd (opendir: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 286 root cwd unknown /proc/286/cwd (readlink: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 286 root rtd unknown /proc/286/root (readlink: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 286 root txt unknown /proc/286/exe (readlink: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 286 root NOFD /proc/286/fd (opendir: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 384 root cwd unknown /proc/384/cwd (readlink: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 384 root rtd unknown /proc/384/root (readlink: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 384 root txt unknown /proc/384/exe (readlink: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 384 root NOFD /proc/384/fd (opendir: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 385 root cwd unknown /proc/385/cwd (readlink: Permission denied) 2024-09-21T05:55:49.564 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 385 root rtd unknown /proc/385/root (readlink: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 385 root txt unknown /proc/385/exe (readlink: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 385 root NOFD /proc/385/fd (opendir: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 425 root cwd unknown /proc/425/cwd (readlink: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 425 root rtd unknown /proc/425/root (readlink: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 425 root txt unknown /proc/425/exe (readlink: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 425 root NOFD /proc/425/fd (opendir: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 426 root cwd unknown /proc/426/cwd (readlink: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 426 root rtd unknown /proc/426/root (readlink: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 426 root txt unknown /proc/426/exe (readlink: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 426 root NOFD /proc/426/fd (opendir: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 427 root cwd unknown /proc/427/cwd (readlink: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 427 root rtd unknown /proc/427/root (readlink: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 427 root txt unknown /proc/427/exe (readlink: Permission denied) 2024-09-21T05:55:49.565 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 427 root NOFD /proc/427/fd (opendir: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 428 root cwd unknown /proc/428/cwd (readlink: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 428 root rtd unknown /proc/428/root (readlink: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 428 root txt unknown /proc/428/exe (readlink: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 428 root NOFD /proc/428/fd (opendir: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 429 root cwd unknown /proc/429/cwd (readlink: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 429 root rtd unknown /proc/429/root (readlink: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 429 root txt unknown /proc/429/exe (readlink: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 429 root NOFD /proc/429/fd (opendir: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 439 root cwd unknown /proc/439/cwd (readlink: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 439 root rtd unknown /proc/439/root (readlink: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 439 root txt unknown /proc/439/exe (readlink: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 439 root NOFD /proc/439/fd (opendir: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_0 450 root cwd unknown /proc/450/cwd (readlink: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_0 450 root rtd unknown /proc/450/root (readlink: Permission denied) 2024-09-21T05:55:49.566 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_0 450 root txt unknown /proc/450/exe (readlink: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_0 450 root NOFD /proc/450/fd (opendir: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 451 root cwd unknown /proc/451/cwd (readlink: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 451 root rtd unknown /proc/451/root (readlink: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 451 root txt unknown /proc/451/exe (readlink: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 451 root NOFD /proc/451/fd (opendir: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_1 452 root cwd unknown /proc/452/cwd (readlink: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_1 452 root rtd unknown /proc/452/root (readlink: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_1 452 root txt unknown /proc/452/exe (readlink: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_1 452 root NOFD /proc/452/fd (opendir: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 453 root cwd unknown /proc/453/cwd (readlink: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 453 root rtd unknown /proc/453/root (readlink: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 453 root txt unknown /proc/453/exe (readlink: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 453 root NOFD /proc/453/fd (opendir: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_2 454 root cwd unknown /proc/454/cwd (readlink: Permission denied) 2024-09-21T05:55:49.567 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_2 454 root rtd unknown /proc/454/root (readlink: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_2 454 root txt unknown /proc/454/exe (readlink: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_2 454 root NOFD /proc/454/fd (opendir: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 455 root cwd unknown /proc/455/cwd (readlink: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 455 root rtd unknown /proc/455/root (readlink: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 455 root txt unknown /proc/455/exe (readlink: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 455 root NOFD /proc/455/fd (opendir: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_3 456 root cwd unknown /proc/456/cwd (readlink: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_3 456 root rtd unknown /proc/456/root (readlink: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_3 456 root txt unknown /proc/456/exe (readlink: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_3 456 root NOFD /proc/456/fd (opendir: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 457 root cwd unknown /proc/457/cwd (readlink: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 457 root rtd unknown /proc/457/root (readlink: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 457 root txt unknown /proc/457/exe (readlink: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 457 root NOFD /proc/457/fd (opendir: Permission denied) 2024-09-21T05:55:49.568 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_4 459 root cwd unknown /proc/459/cwd (readlink: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_4 459 root rtd unknown /proc/459/root (readlink: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_4 459 root txt unknown /proc/459/exe (readlink: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_4 459 root NOFD /proc/459/fd (opendir: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 460 root cwd unknown /proc/460/cwd (readlink: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 460 root rtd unknown /proc/460/root (readlink: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 460 root txt unknown /proc/460/exe (readlink: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 460 root NOFD /proc/460/fd (opendir: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_5 461 root cwd unknown /proc/461/cwd (readlink: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_5 461 root rtd unknown /proc/461/root (readlink: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_5 461 root txt unknown /proc/461/exe (readlink: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_5 461 root NOFD /proc/461/fd (opendir: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 462 root cwd unknown /proc/462/cwd (readlink: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 462 root rtd unknown /proc/462/root (readlink: Permission denied) 2024-09-21T05:55:49.569 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 462 root txt unknown /proc/462/exe (readlink: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 462 root NOFD /proc/462/fd (opendir: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_6 463 root cwd unknown /proc/463/cwd (readlink: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_6 463 root rtd unknown /proc/463/root (readlink: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_6 463 root txt unknown /proc/463/exe (readlink: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_6 463 root NOFD /proc/463/fd (opendir: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 464 root cwd unknown /proc/464/cwd (readlink: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 464 root rtd unknown /proc/464/root (readlink: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 464 root txt unknown /proc/464/exe (readlink: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 464 root NOFD /proc/464/fd (opendir: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_7 465 root cwd unknown /proc/465/cwd (readlink: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_7 465 root rtd unknown /proc/465/root (readlink: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_7 465 root txt unknown /proc/465/exe (readlink: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_7 465 root NOFD /proc/465/fd (opendir: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 466 root cwd unknown /proc/466/cwd (readlink: Permission denied) 2024-09-21T05:55:49.570 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 466 root rtd unknown /proc/466/root (readlink: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 466 root txt unknown /proc/466/exe (readlink: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 466 root NOFD /proc/466/fd (opendir: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_8 467 root cwd unknown /proc/467/cwd (readlink: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_8 467 root rtd unknown /proc/467/root (readlink: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_8 467 root txt unknown /proc/467/exe (readlink: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_8 467 root NOFD /proc/467/fd (opendir: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 468 root cwd unknown /proc/468/cwd (readlink: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 468 root rtd unknown /proc/468/root (readlink: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 468 root txt unknown /proc/468/exe (readlink: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 468 root NOFD /proc/468/fd (opendir: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_9 469 root cwd unknown /proc/469/cwd (readlink: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_9 469 root rtd unknown /proc/469/root (readlink: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_9 469 root txt unknown /proc/469/exe (readlink: Permission denied) 2024-09-21T05:55:49.571 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_9 469 root NOFD /proc/469/fd (opendir: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 470 root cwd unknown /proc/470/cwd (readlink: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 470 root rtd unknown /proc/470/root (readlink: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 470 root txt unknown /proc/470/exe (readlink: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 470 root NOFD /proc/470/fd (opendir: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 471 root cwd unknown /proc/471/cwd (readlink: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 471 root rtd unknown /proc/471/root (readlink: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 471 root txt unknown /proc/471/exe (readlink: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 471 root NOFD /proc/471/fd (opendir: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:jbd2/sda1 498 root cwd unknown /proc/498/cwd (readlink: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:jbd2/sda1 498 root rtd unknown /proc/498/root (readlink: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:jbd2/sda1 498 root txt unknown /proc/498/exe (readlink: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:jbd2/sda1 498 root NOFD /proc/498/fd (opendir: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 499 root cwd unknown /proc/499/cwd (readlink: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 499 root rtd unknown /proc/499/root (readlink: Permission denied) 2024-09-21T05:55:49.572 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 499 root txt unknown /proc/499/exe (readlink: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 499 root NOFD /proc/499/fd (opendir: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 562 root cwd unknown /proc/562/cwd (readlink: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 562 root rtd unknown /proc/562/root (readlink: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 562 root txt unknown /proc/562/exe (readlink: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 562 root NOFD /proc/562/fd (opendir: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-j 577 root cwd unknown /proc/577/cwd (readlink: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-j 577 root rtd unknown /proc/577/root (readlink: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-j 577 root txt unknown /proc/577/exe (readlink: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-j 577 root NOFD /proc/577/fd (opendir: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:ext4lazyi 587 root cwd unknown /proc/587/cwd (readlink: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:ext4lazyi 587 root rtd unknown /proc/587/root (readlink: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:ext4lazyi 587 root txt unknown /proc/587/exe (readlink: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:ext4lazyi 587 root NOFD /proc/587/fd (opendir: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-u 592 root cwd unknown /proc/592/cwd (readlink: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-u 592 root rtd unknown /proc/592/root (readlink: Permission denied) 2024-09-21T05:55:49.573 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-u 592 root txt unknown /proc/592/exe (readlink: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-u 592 root NOFD /proc/592/fd (opendir: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 641 root cwd unknown /proc/641/cwd (readlink: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 641 root rtd unknown /proc/641/root (readlink: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 641 root txt unknown /proc/641/exe (readlink: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 641 root NOFD /proc/641/fd (opendir: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:kipmi0 654 root cwd unknown /proc/654/cwd (readlink: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:kipmi0 654 root rtd unknown /proc/654/root (readlink: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:kipmi0 654 root txt unknown /proc/654/exe (readlink: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:kipmi0 654 root NOFD /proc/654/fd (opendir: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:rpcbind 656 rpc cwd unknown /proc/656/cwd (readlink: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:rpcbind 656 rpc rtd unknown /proc/656/root (readlink: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:rpcbind 656 rpc txt unknown /proc/656/exe (readlink: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:rpcbind 656 rpc NOFD /proc/656/fd (opendir: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 669 root cwd unknown /proc/669/cwd (readlink: Permission denied) 2024-09-21T05:55:49.574 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 669 root rtd unknown /proc/669/root (readlink: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 669 root txt unknown /proc/669/exe (readlink: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 669 root NOFD /proc/669/fd (opendir: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 669 670 auditd root cwd unknown /proc/669/task/670/cwd (readlink: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 669 670 auditd root rtd unknown /proc/669/task/670/root (readlink: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 669 670 auditd root txt unknown /proc/669/task/670/exe (readlink: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 669 670 auditd root NOFD /proc/669/task/670/fd (opendir: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 669 672 auditd root cwd unknown /proc/669/task/672/cwd (readlink: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 669 672 auditd root rtd unknown /proc/669/task/672/root (readlink: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 669 672 auditd root txt unknown /proc/669/task/672/exe (readlink: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 669 672 auditd root NOFD /proc/669/task/672/fd (opendir: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:sedispatc 671 root cwd unknown /proc/671/cwd (readlink: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:sedispatc 671 root rtd unknown /proc/671/root (readlink: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:sedispatc 671 root txt unknown /proc/671/exe (readlink: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:sedispatc 671 root NOFD /proc/671/fd (opendir: Permission denied) 2024-09-21T05:55:49.575 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 675 root cwd unknown /proc/675/cwd (readlink: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 675 root rtd unknown /proc/675/root (readlink: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 675 root txt unknown /proc/675/exe (readlink: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 675 root NOFD /proc/675/fd (opendir: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 676 root cwd unknown /proc/676/cwd (readlink: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 676 root rtd unknown /proc/676/root (readlink: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 676 root txt unknown /proc/676/exe (readlink: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 676 root NOFD /proc/676/fd (opendir: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 717 dbus cwd unknown /proc/717/cwd (readlink: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 717 dbus rtd unknown /proc/717/root (readlink: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 717 dbus txt unknown /proc/717/exe (readlink: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 717 dbus NOFD /proc/717/fd (opendir: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 718 dbus cwd unknown /proc/718/cwd (readlink: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 718 dbus rtd unknown /proc/718/root (readlink: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 718 dbus txt unknown /proc/718/exe (readlink: Permission denied) 2024-09-21T05:55:49.576 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 718 dbus NOFD /proc/718/fd (opendir: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 719 root cwd unknown /proc/719/cwd (readlink: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 719 root rtd unknown /proc/719/root (readlink: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 719 root txt unknown /proc/719/exe (readlink: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 719 root NOFD /proc/719/fd (opendir: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 719 736 gmain root cwd unknown /proc/719/task/736/cwd (readlink: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 719 736 gmain root rtd unknown /proc/719/task/736/root (readlink: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 719 736 gmain root txt unknown /proc/719/task/736/exe (readlink: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 719 736 gmain root NOFD /proc/719/task/736/fd (opendir: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 719 737 gdbus root cwd unknown /proc/719/task/737/cwd (readlink: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 719 737 gdbus root rtd unknown /proc/719/task/737/root (readlink: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 719 737 gdbus root txt unknown /proc/719/task/737/exe (readlink: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 719 737 gdbus root NOFD /proc/719/task/737/fd (opendir: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 722 root cwd unknown /proc/722/cwd (readlink: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 722 root rtd unknown /proc/722/root (readlink: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 722 root txt unknown /proc/722/exe (readlink: Permission denied) 2024-09-21T05:55:49.577 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 722 root NOFD /proc/722/fd (opendir: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 722 729 gmain root cwd unknown /proc/722/task/729/cwd (readlink: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 722 729 gmain root rtd unknown /proc/722/task/729/root (readlink: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 722 729 gmain root txt unknown /proc/722/task/729/exe (readlink: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 722 729 gmain root NOFD /proc/722/task/729/fd (opendir: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:lsmd 723 libstoragemgmt cwd unknown /proc/723/cwd (readlink: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:lsmd 723 libstoragemgmt rtd unknown /proc/723/root (readlink: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:lsmd 723 libstoragemgmt txt unknown /proc/723/exe (readlink: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:lsmd 723 libstoragemgmt NOFD /proc/723/fd (opendir: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:mcelog 724 root cwd unknown /proc/724/cwd (readlink: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:mcelog 724 root rtd unknown /proc/724/root (readlink: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:mcelog 724 root txt unknown /proc/724/exe (readlink: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:mcelog 724 root NOFD /proc/724/fd (opendir: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:smartd 726 root cwd unknown /proc/726/cwd (readlink: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:smartd 726 root rtd unknown /proc/726/root (readlink: Permission denied) 2024-09-21T05:55:49.578 INFO:tasks.workunit.client.0.smithi007.stdout:smartd 726 root txt unknown /proc/726/exe (readlink: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:smartd 726 root NOFD /proc/726/fd (opendir: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-l 728 root cwd unknown /proc/728/cwd (readlink: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-l 728 root rtd unknown /proc/728/root (readlink: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-l 728 root txt unknown /proc/728/exe (readlink: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-l 728 root NOFD /proc/728/fd (opendir: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 771 root cwd unknown /proc/771/cwd (readlink: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 771 root rtd unknown /proc/771/root (readlink: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 771 root txt unknown /proc/771/exe (readlink: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 771 root NOFD /proc/771/fd (opendir: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 root cwd unknown /proc/775/cwd (readlink: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 root rtd unknown /proc/775/root (readlink: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 root txt unknown /proc/775/exe (readlink: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 root NOFD /proc/775/fd (opendir: Permission denied) 2024-09-21T05:55:49.579 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 776 gssproxy root cwd unknown /proc/775/task/776/cwd (readlink: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 776 gssproxy root rtd unknown /proc/775/task/776/root (readlink: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 776 gssproxy root txt unknown /proc/775/task/776/exe (readlink: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 776 gssproxy root NOFD /proc/775/task/776/fd (opendir: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 777 gssproxy root cwd unknown /proc/775/task/777/cwd (readlink: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 777 gssproxy root rtd unknown /proc/775/task/777/root (readlink: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 777 gssproxy root txt unknown /proc/775/task/777/exe (readlink: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 777 gssproxy root NOFD /proc/775/task/777/fd (opendir: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 778 gssproxy root cwd unknown /proc/775/task/778/cwd (readlink: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 778 gssproxy root rtd unknown /proc/775/task/778/root (readlink: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 778 gssproxy root txt unknown /proc/775/task/778/exe (readlink: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 778 gssproxy root NOFD /proc/775/task/778/fd (opendir: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 779 gssproxy root cwd unknown /proc/775/task/779/cwd (readlink: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 779 gssproxy root rtd unknown /proc/775/task/779/root (readlink: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 779 gssproxy root txt unknown /proc/775/task/779/exe (readlink: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 779 gssproxy root NOFD /proc/775/task/779/fd (opendir: Permission denied) 2024-09-21T05:55:49.580 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 780 gssproxy root cwd unknown /proc/775/task/780/cwd (readlink: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 780 gssproxy root rtd unknown /proc/775/task/780/root (readlink: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 780 gssproxy root txt unknown /proc/775/task/780/exe (readlink: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 775 780 gssproxy root NOFD /proc/775/task/780/fd (opendir: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:atd 782 root cwd unknown /proc/782/cwd (readlink: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:atd 782 root rtd unknown /proc/782/root (readlink: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:atd 782 root txt unknown /proc/782/exe (readlink: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:atd 782 root NOFD /proc/782/fd (opendir: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:crond 783 root cwd unknown /proc/783/cwd (readlink: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:crond 783 root rtd unknown /proc/783/root (readlink: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:crond 783 root txt unknown /proc/783/exe (readlink: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:crond 783 root NOFD /proc/783/fd (opendir: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:nrpe 804 nrpe cwd unknown /proc/804/cwd (readlink: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:nrpe 804 nrpe rtd unknown /proc/804/root (readlink: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:nrpe 804 nrpe txt unknown /proc/804/exe (readlink: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:nrpe 804 nrpe NOFD /proc/804/fd (opendir: Permission denied) 2024-09-21T05:55:49.581 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1197 root cwd unknown /proc/1197/cwd (readlink: Permission denied) 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1197 root rtd unknown /proc/1197/root (readlink: Permission denied) 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1197 root txt unknown /proc/1197/exe (readlink: Permission denied) 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1197 root NOFD /proc/1197/fd (opendir: Permission denied) 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1202 root cwd unknown /proc/1202/cwd (readlink: Permission denied) 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1202 root rtd unknown /proc/1202/root (readlink: Permission denied) 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1202 root txt unknown /proc/1202/exe (readlink: Permission denied) 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1202 root NOFD /proc/1202/fd (opendir: Permission denied) 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu cwd DIR 8,1 4096 2 / 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu txt REG 8,1 98208 22394 /usr/lib/systemd/systemd 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 600667 655 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 153600 11397 /usr/lib64/libgpg-error.so.0.32.0 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 912440 11215 /usr/lib64/libm.so.6 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 1714208 11376 /usr/lib64/libp11-kit.so.0.3.1 2024-09-21T05:55:49.582 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu DEL REG 8,1 11595 /usr/lib64/libcrypto.so.3.2.2 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 882376 11287 /usr/lib64/libzstd.so.1.5.1 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 1304864 11471 /usr/lib64/libgcrypt.so.20.4.0 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 3826840 50305 /usr/lib64/systemd/libsystemd-shared-252.so 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 21219 2231 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 44784 11373 /usr/lib64/libffi.so.8.1.0 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 28552 11392 /usr/lib64/libattr.so.1.1.2501 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 178728 11282 /usr/lib64/liblzma.so.5.2.5 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 2162040 50302 /usr/lib64/systemd/libsystemd-core-252.so 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 32528 11311 /usr/lib64/libcap-ng.so.0.0.0 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 40520 12544 /usr/lib64/libeconf.so.0.4.1 2024-09-21T05:55:49.583 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 144120 11455 /usr/lib64/liblz4.so.1.9.3 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 201808 11284 /usr/lib64/libcrypt.so.2.0.0 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 36296 11290 /usr/lib64/libcap.so.2.48 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 229424 11714 /usr/lib64/libblkid.so.1.1.0 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 40496 11393 /usr/lib64/libacl.so.1.1.2301 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 291496 11744 /usr/lib64/libmount.so.1.1.0 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 107528 11768 /usr/lib64/libkmod.so.2.3.6 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 163464 11315 /usr/lib64/libaudit.so.1.0.0 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 69592 12553 /usr/lib64/libpam.so.0.85.1 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 127680 11560 /usr/lib64/libseccomp.so.2.5.2 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 108136 14698 /usr/lib64/libgcc_s-11-20240719.so.1 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-09-21T05:55:49.584 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 1u unix 0x0000000000000000 0t0 23991 type=STREAM (CONNECTED) 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 2u unix 0x0000000000000000 0t0 23991 type=STREAM (CONNECTED) 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 3u unix 0x0000000000000000 0t0 25903 type=DGRAM (CONNECTED) 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 4u a_inode 0,14 0 4117 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 5u a_inode 0,14 0 4117 [signalfd] 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 6r a_inode 0,14 0 4117 inotify 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 7r DIR 0,25 0 3417 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 8u a_inode 0,14 0 4117 [timerfd] 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 9u a_inode 0,14 0 4117 [eventpoll:10,13] 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 10r REG 0,20 0 25892 /proc/4751/mountinfo 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 11r a_inode 0,14 0 4117 inotify 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 12u unix 0x0000000000000000 0t0 25933 /run/user/1000/bus type=STREAM (LISTEN) 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 13r a_inode 0,14 0 4117 inotify 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 14r REG 0,20 0 4026532068 /proc/swaps 2024-09-21T05:55:49.585 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 15u netlink 0t0 25907 KOBJECT_UEVENT 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 16u unix 0x0000000000000000 0t0 25920 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 17u unix 0x0000000000000000 0t0 25921 type=DGRAM (CONNECTED) 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 18u unix 0x0000000000000000 0t0 25922 type=DGRAM (CONNECTED) 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 19u unix 0x0000000000000000 0t0 25923 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 20u unix 0x0000000000000000 0t0 25925 type=STREAM (CONNECTED) 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 4751 ubuntu 21u a_inode 0,14 0 4117 [timerfd] 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 4753 ubuntu cwd unknown /proc/4753/cwd (readlink: Permission denied) 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 4753 ubuntu rtd unknown /proc/4753/root (readlink: Permission denied) 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 4753 ubuntu txt unknown /proc/4753/exe (readlink: Permission denied) 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 4753 ubuntu NOFD /proc/4753/fd (opendir: Permission denied) 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 5075 root cwd unknown /proc/5075/cwd (readlink: Permission denied) 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 5075 root rtd unknown /proc/5075/root (readlink: Permission denied) 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 5075 root txt unknown /proc/5075/exe (readlink: Permission denied) 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 5075 root NOFD /proc/5075/fd (opendir: Permission denied) 2024-09-21T05:55:49.586 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 5075 5077 in:imjour root cwd unknown /proc/5075/task/5077/cwd (readlink: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 5075 5077 in:imjour root rtd unknown /proc/5075/task/5077/root (readlink: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 5075 5077 in:imjour root txt unknown /proc/5075/task/5077/exe (readlink: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 5075 5077 in:imjour root NOFD /proc/5075/task/5077/fd (opendir: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 5075 5078 rs:main root cwd unknown /proc/5075/task/5078/cwd (readlink: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 5075 5078 rs:main root rtd unknown /proc/5075/task/5078/root (readlink: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 5075 5078 rs:main root txt unknown /proc/5075/task/5078/exe (readlink: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 5075 5078 rs:main root NOFD /proc/5075/task/5078/fd (opendir: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 18673 root cwd unknown /proc/18673/cwd (readlink: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 18673 root rtd unknown /proc/18673/root (readlink: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 18673 root txt unknown /proc/18673/exe (readlink: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 18673 root NOFD /proc/18673/fd (opendir: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 polkitd cwd unknown /proc/19236/cwd (readlink: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 polkitd rtd unknown /proc/19236/root (readlink: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 polkitd txt unknown /proc/19236/exe (readlink: Permission denied) 2024-09-21T05:55:49.587 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 polkitd NOFD /proc/19236/fd (opendir: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19238 gmain polkitd cwd unknown /proc/19236/task/19238/cwd (readlink: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19238 gmain polkitd rtd unknown /proc/19236/task/19238/root (readlink: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19238 gmain polkitd txt unknown /proc/19236/task/19238/exe (readlink: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19238 gmain polkitd NOFD /proc/19236/task/19238/fd (opendir: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19239 gdbus polkitd cwd unknown /proc/19236/task/19239/cwd (readlink: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19239 gdbus polkitd rtd unknown /proc/19236/task/19239/root (readlink: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19239 gdbus polkitd txt unknown /proc/19236/task/19239/exe (readlink: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19239 gdbus polkitd NOFD /proc/19236/task/19239/fd (opendir: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19240 JS\x20Hel polkitd cwd unknown /proc/19236/task/19240/cwd (readlink: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19240 JS\x20Hel polkitd rtd unknown /proc/19236/task/19240/root (readlink: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19240 JS\x20Hel polkitd txt unknown /proc/19236/task/19240/exe (readlink: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19240 JS\x20Hel polkitd NOFD /proc/19236/task/19240/fd (opendir: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19241 JS\x20Hel polkitd cwd unknown /proc/19236/task/19241/cwd (readlink: Permission denied) 2024-09-21T05:55:49.588 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19241 JS\x20Hel polkitd rtd unknown /proc/19236/task/19241/root (readlink: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19241 JS\x20Hel polkitd txt unknown /proc/19236/task/19241/exe (readlink: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19241 JS\x20Hel polkitd NOFD /proc/19236/task/19241/fd (opendir: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19242 JS\x20Hel polkitd cwd unknown /proc/19236/task/19242/cwd (readlink: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19242 JS\x20Hel polkitd rtd unknown /proc/19236/task/19242/root (readlink: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19242 JS\x20Hel polkitd txt unknown /proc/19236/task/19242/exe (readlink: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19242 JS\x20Hel polkitd NOFD /proc/19236/task/19242/fd (opendir: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19243 JS\x20Hel polkitd cwd unknown /proc/19236/task/19243/cwd (readlink: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19243 JS\x20Hel polkitd rtd unknown /proc/19236/task/19243/root (readlink: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19243 JS\x20Hel polkitd txt unknown /proc/19236/task/19243/exe (readlink: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19243 JS\x20Hel polkitd NOFD /proc/19236/task/19243/fd (opendir: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19244 JS\x20Hel polkitd cwd unknown /proc/19236/task/19244/cwd (readlink: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19244 JS\x20Hel polkitd rtd unknown /proc/19236/task/19244/root (readlink: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19244 JS\x20Hel polkitd txt unknown /proc/19236/task/19244/exe (readlink: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19244 JS\x20Hel polkitd NOFD /proc/19236/task/19244/fd (opendir: Permission denied) 2024-09-21T05:55:49.589 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19245 JS\x20Hel polkitd cwd unknown /proc/19236/task/19245/cwd (readlink: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19245 JS\x20Hel polkitd rtd unknown /proc/19236/task/19245/root (readlink: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19245 JS\x20Hel polkitd txt unknown /proc/19236/task/19245/exe (readlink: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19245 JS\x20Hel polkitd NOFD /proc/19236/task/19245/fd (opendir: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19246 JS\x20Hel polkitd cwd unknown /proc/19236/task/19246/cwd (readlink: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19246 JS\x20Hel polkitd rtd unknown /proc/19236/task/19246/root (readlink: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19246 JS\x20Hel polkitd txt unknown /proc/19236/task/19246/exe (readlink: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19246 JS\x20Hel polkitd NOFD /proc/19236/task/19246/fd (opendir: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19247 JS\x20Hel polkitd cwd unknown /proc/19236/task/19247/cwd (readlink: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19247 JS\x20Hel polkitd rtd unknown /proc/19236/task/19247/root (readlink: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19247 JS\x20Hel polkitd txt unknown /proc/19236/task/19247/exe (readlink: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19247 JS\x20Hel polkitd NOFD /proc/19236/task/19247/fd (opendir: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19248 polkitd polkitd cwd unknown /proc/19236/task/19248/cwd (readlink: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19248 polkitd polkitd rtd unknown /proc/19236/task/19248/root (readlink: Permission denied) 2024-09-21T05:55:49.590 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19248 polkitd polkitd txt unknown /proc/19236/task/19248/exe (readlink: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19236 19248 polkitd polkitd NOFD /proc/19236/task/19248/fd (opendir: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 19316 root cwd unknown /proc/19316/cwd (readlink: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 19316 root rtd unknown /proc/19316/root (readlink: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 19316 root txt unknown /proc/19316/exe (readlink: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 19316 root NOFD /proc/19316/fd (opendir: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21144 root cwd unknown /proc/21144/cwd (readlink: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21144 root rtd unknown /proc/21144/root (readlink: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21144 root txt unknown /proc/21144/exe (readlink: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21144 root NOFD /proc/21144/fd (opendir: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21173 root cwd unknown /proc/21173/cwd (readlink: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21173 root rtd unknown /proc/21173/root (readlink: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21173 root txt unknown /proc/21173/exe (readlink: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21173 root NOFD /proc/21173/fd (opendir: Permission denied) 2024-09-21T05:55:49.591 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21202 root cwd unknown /proc/21202/cwd (readlink: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21202 root rtd unknown /proc/21202/root (readlink: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21202 root txt unknown /proc/21202/exe (readlink: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21202 root NOFD /proc/21202/fd (opendir: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21231 root cwd unknown /proc/21231/cwd (readlink: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21231 root rtd unknown /proc/21231/root (readlink: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21231 root txt unknown /proc/21231/exe (readlink: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21231 root NOFD /proc/21231/fd (opendir: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21260 root cwd unknown /proc/21260/cwd (readlink: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21260 root rtd unknown /proc/21260/root (readlink: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21260 root txt unknown /proc/21260/exe (readlink: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21260 root NOFD /proc/21260/fd (opendir: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21424 root cwd unknown /proc/21424/cwd (readlink: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21424 root rtd unknown /proc/21424/root (readlink: Permission denied) 2024-09-21T05:55:49.592 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21424 root txt unknown /proc/21424/exe (readlink: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21424 root NOFD /proc/21424/fd (opendir: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21425 root cwd unknown /proc/21425/cwd (readlink: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21425 root rtd unknown /proc/21425/root (readlink: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21425 root txt unknown /proc/21425/exe (readlink: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21425 root NOFD /proc/21425/fd (opendir: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21426 root cwd unknown /proc/21426/cwd (readlink: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21426 root rtd unknown /proc/21426/root (readlink: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21426 root txt unknown /proc/21426/exe (readlink: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21426 root NOFD /proc/21426/fd (opendir: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21427 root cwd unknown /proc/21427/cwd (readlink: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21427 root rtd unknown /proc/21427/root (readlink: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21427 root txt unknown /proc/21427/exe (readlink: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21427 root NOFD /proc/21427/fd (opendir: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21428 root cwd unknown /proc/21428/cwd (readlink: Permission denied) 2024-09-21T05:55:49.593 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21428 root rtd unknown /proc/21428/root (readlink: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21428 root txt unknown /proc/21428/exe (readlink: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21428 root NOFD /proc/21428/fd (opendir: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21429 root cwd unknown /proc/21429/cwd (readlink: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21429 root rtd unknown /proc/21429/root (readlink: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21429 root txt unknown /proc/21429/exe (readlink: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21429 root NOFD /proc/21429/fd (opendir: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21430 root cwd unknown /proc/21430/cwd (readlink: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21430 root rtd unknown /proc/21430/root (readlink: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21430 root txt unknown /proc/21430/exe (readlink: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21430 root NOFD /proc/21430/fd (opendir: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21431 root cwd unknown /proc/21431/cwd (readlink: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21431 root rtd unknown /proc/21431/root (readlink: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21431 root txt unknown /proc/21431/exe (readlink: Permission denied) 2024-09-21T05:55:49.594 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21431 root NOFD /proc/21431/fd (opendir: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21432 root cwd unknown /proc/21432/cwd (readlink: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21432 root rtd unknown /proc/21432/root (readlink: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21432 root txt unknown /proc/21432/exe (readlink: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21432 root NOFD /proc/21432/fd (opendir: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:xfsaild/d 21433 root cwd unknown /proc/21433/cwd (readlink: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:xfsaild/d 21433 root rtd unknown /proc/21433/root (readlink: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:xfsaild/d 21433 root txt unknown /proc/21433/exe (readlink: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:xfsaild/d 21433 root NOFD /proc/21433/fd (opendir: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22366 root cwd unknown /proc/22366/cwd (readlink: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22366 root rtd unknown /proc/22366/root (readlink: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22366 root txt unknown /proc/22366/exe (readlink: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22366 root NOFD /proc/22366/fd (opendir: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22369 ubuntu cwd unknown /proc/22369/cwd (readlink: Permission denied) 2024-09-21T05:55:49.595 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22369 ubuntu rtd unknown /proc/22369/root (readlink: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22369 ubuntu txt unknown /proc/22369/exe (readlink: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22369 ubuntu NOFD /proc/22369/fd (opendir: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:chronyd 22429 chrony cwd unknown /proc/22429/cwd (readlink: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:chronyd 22429 chrony rtd unknown /proc/22429/root (readlink: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:chronyd 22429 chrony txt unknown /proc/22429/exe (readlink: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:chronyd 22429 chrony NOFD /proc/22429/fd (opendir: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-cras 22739 ceph cwd unknown /proc/22739/cwd (readlink: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-cras 22739 ceph rtd unknown /proc/22739/root (readlink: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-cras 22739 ceph txt unknown /proc/22739/exe (readlink: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-cras 22739 ceph NOFD /proc/22739/fd (opendir: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 23263 root cwd unknown /proc/23263/cwd (readlink: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 23263 root rtd unknown /proc/23263/root (readlink: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 23263 root txt unknown /proc/23263/exe (readlink: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 23263 root NOFD /proc/23263/fd (opendir: Permission denied) 2024-09-21T05:55:49.596 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 24878 root cwd unknown /proc/24878/cwd (readlink: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 24878 root rtd unknown /proc/24878/root (readlink: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 24878 root txt unknown /proc/24878/exe (readlink: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 24878 root NOFD /proc/24878/fd (opendir: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 29976 root cwd unknown /proc/29976/cwd (readlink: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 29976 root rtd unknown /proc/29976/root (readlink: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 29976 root txt unknown /proc/29976/exe (readlink: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 29976 root NOFD /proc/29976/fd (opendir: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 29993 root cwd unknown /proc/29993/cwd (readlink: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 29993 root rtd unknown /proc/29993/root (readlink: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 29993 root txt unknown /proc/29993/exe (readlink: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 29993 root NOFD /proc/29993/fd (opendir: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 29994 root cwd unknown /proc/29994/cwd (readlink: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 29994 root rtd unknown /proc/29994/root (readlink: Permission denied) 2024-09-21T05:55:49.597 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 29994 root txt unknown /proc/29994/exe (readlink: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 29994 root NOFD /proc/29994/fd (opendir: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 30011 root cwd unknown /proc/30011/cwd (readlink: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 30011 root rtd unknown /proc/30011/root (readlink: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 30011 root txt unknown /proc/30011/exe (readlink: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 30011 root NOFD /proc/30011/fd (opendir: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 30979 root cwd unknown /proc/30979/cwd (readlink: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 30979 root rtd unknown /proc/30979/root (readlink: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 30979 root txt unknown /proc/30979/exe (readlink: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 30979 root NOFD /proc/30979/fd (opendir: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 30981 root cwd unknown /proc/30981/cwd (readlink: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 30981 root rtd unknown /proc/30981/root (readlink: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 30981 root txt unknown /proc/30981/exe (readlink: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 30981 root NOFD /proc/30981/fd (opendir: Permission denied) 2024-09-21T05:55:49.598 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 ceph cwd unknown /proc/30983/cwd (readlink: Permission denied) 2024-09-21T05:55:49.599 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 ceph rtd unknown /proc/30983/root (readlink: Permission denied) 2024-09-21T05:55:49.599 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 ceph txt unknown /proc/30983/exe (readlink: Permission denied) 2024-09-21T05:55:49.599 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 ceph NOFD /proc/30983/fd (opendir: Permission denied) 2024-09-21T05:55:49.599 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30984 log ceph cwd unknown /proc/30983/task/30984/cwd (readlink: Permission denied) 2024-09-21T05:55:49.599 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30984 log ceph rtd unknown /proc/30983/task/30984/root (readlink: Permission denied) 2024-09-21T05:55:49.599 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30984 log ceph txt unknown /proc/30983/task/30984/exe (readlink: Permission denied) 2024-09-21T05:55:49.599 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30984 log ceph NOFD /proc/30983/task/30984/fd (opendir: Permission denied) 2024-09-21T05:55:49.599 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30985 service ceph cwd unknown /proc/30983/task/30985/cwd (readlink: Permission denied) 2024-09-21T05:55:49.599 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30985 service ceph rtd unknown /proc/30983/task/30985/root (readlink: Permission denied) 2024-09-21T05:55:49.599 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30985 service ceph txt unknown /proc/30983/task/30985/exe (readlink: Permission denied) 2024-09-21T05:55:49.599 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30985 service ceph NOFD /proc/30983/task/30985/fd (opendir: Permission denied) 2024-09-21T05:55:49.599 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30986 admin_soc ceph cwd unknown /proc/30983/task/30986/cwd (readlink: Permission denied) 2024-09-21T05:55:49.599 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30986 admin_soc ceph rtd unknown /proc/30983/task/30986/root (readlink: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30986 admin_soc ceph txt unknown /proc/30983/task/30986/exe (readlink: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30986 admin_soc ceph NOFD /proc/30983/task/30986/fd (opendir: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30987 signal_ha ceph cwd unknown /proc/30983/task/30987/cwd (readlink: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30987 signal_ha ceph rtd unknown /proc/30983/task/30987/root (readlink: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30987 signal_ha ceph txt unknown /proc/30983/task/30987/exe (readlink: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30987 signal_ha ceph NOFD /proc/30983/task/30987/fd (opendir: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30988 rocksdb:l ceph cwd unknown /proc/30983/task/30988/cwd (readlink: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30988 rocksdb:l ceph rtd unknown /proc/30983/task/30988/root (readlink: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30988 rocksdb:l ceph txt unknown /proc/30983/task/30988/exe (readlink: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30988 rocksdb:l ceph NOFD /proc/30983/task/30988/fd (opendir: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30989 rocksdb:h ceph cwd unknown /proc/30983/task/30989/cwd (readlink: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30989 rocksdb:h ceph rtd unknown /proc/30983/task/30989/root (readlink: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30989 rocksdb:h ceph txt unknown /proc/30983/task/30989/exe (readlink: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 30989 rocksdb:h ceph NOFD /proc/30983/task/30989/fd (opendir: Permission denied) 2024-09-21T05:55:49.600 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31005 ceph-mon ceph cwd unknown /proc/30983/task/31005/cwd (readlink: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31005 ceph-mon ceph rtd unknown /proc/30983/task/31005/root (readlink: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31005 ceph-mon ceph txt unknown /proc/30983/task/31005/exe (readlink: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31005 ceph-mon ceph NOFD /proc/30983/task/31005/fd (opendir: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31006 fn_monsto ceph cwd unknown /proc/30983/task/31006/cwd (readlink: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31006 fn_monsto ceph rtd unknown /proc/30983/task/31006/root (readlink: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31006 fn_monsto ceph txt unknown /proc/30983/task/31006/exe (readlink: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31006 fn_monsto ceph NOFD /proc/30983/task/31006/fd (opendir: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31007 msgr-work ceph cwd unknown /proc/30983/task/31007/cwd (readlink: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31007 msgr-work ceph rtd unknown /proc/30983/task/31007/root (readlink: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31007 msgr-work ceph txt unknown /proc/30983/task/31007/exe (readlink: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31007 msgr-work ceph NOFD /proc/30983/task/31007/fd (opendir: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31008 msgr-work ceph cwd unknown /proc/30983/task/31008/cwd (readlink: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31008 msgr-work ceph rtd unknown /proc/30983/task/31008/root (readlink: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31008 msgr-work ceph txt unknown /proc/30983/task/31008/exe (readlink: Permission denied) 2024-09-21T05:55:49.601 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31008 msgr-work ceph NOFD /proc/30983/task/31008/fd (opendir: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31009 msgr-work ceph cwd unknown /proc/30983/task/31009/cwd (readlink: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31009 msgr-work ceph rtd unknown /proc/30983/task/31009/root (readlink: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31009 msgr-work ceph txt unknown /proc/30983/task/31009/exe (readlink: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31009 msgr-work ceph NOFD /proc/30983/task/31009/fd (opendir: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31010 OpHistory ceph cwd unknown /proc/30983/task/31010/cwd (readlink: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31010 OpHistory ceph rtd unknown /proc/30983/task/31010/root (readlink: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31010 OpHistory ceph txt unknown /proc/30983/task/31010/exe (readlink: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31010 OpHistory ceph NOFD /proc/30983/task/31010/fd (opendir: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31011 fin ceph cwd unknown /proc/30983/task/31011/cwd (readlink: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31011 fin ceph rtd unknown /proc/30983/task/31011/root (readlink: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31011 fin ceph txt unknown /proc/30983/task/31011/exe (readlink: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31011 fin ceph NOFD /proc/30983/task/31011/fd (opendir: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31012 safe_time ceph cwd unknown /proc/30983/task/31012/cwd (readlink: Permission denied) 2024-09-21T05:55:49.602 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31012 safe_time ceph rtd unknown /proc/30983/task/31012/root (readlink: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31012 safe_time ceph txt unknown /proc/30983/task/31012/exe (readlink: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31012 safe_time ceph NOFD /proc/30983/task/31012/fd (opendir: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31013 cpu_tp ceph cwd unknown /proc/30983/task/31013/cwd (readlink: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31013 cpu_tp ceph rtd unknown /proc/30983/task/31013/root (readlink: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31013 cpu_tp ceph txt unknown /proc/30983/task/31013/exe (readlink: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31013 cpu_tp ceph NOFD /proc/30983/task/31013/fd (opendir: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31014 cpu_tp ceph cwd unknown /proc/30983/task/31014/cwd (readlink: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31014 cpu_tp ceph rtd unknown /proc/30983/task/31014/root (readlink: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31014 cpu_tp ceph txt unknown /proc/30983/task/31014/exe (readlink: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31014 cpu_tp ceph NOFD /proc/30983/task/31014/fd (opendir: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31015 cpu_tp ceph cwd unknown /proc/30983/task/31015/cwd (readlink: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31015 cpu_tp ceph rtd unknown /proc/30983/task/31015/root (readlink: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31015 cpu_tp ceph txt unknown /proc/30983/task/31015/exe (readlink: Permission denied) 2024-09-21T05:55:49.603 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31015 cpu_tp ceph NOFD /proc/30983/task/31015/fd (opendir: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31016 cpu_tp ceph cwd unknown /proc/30983/task/31016/cwd (readlink: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31016 cpu_tp ceph rtd unknown /proc/30983/task/31016/root (readlink: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31016 cpu_tp ceph txt unknown /proc/30983/task/31016/exe (readlink: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31016 cpu_tp ceph NOFD /proc/30983/task/31016/fd (opendir: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31017 ms_dispat ceph cwd unknown /proc/30983/task/31017/cwd (readlink: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31017 ms_dispat ceph rtd unknown /proc/30983/task/31017/root (readlink: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31017 ms_dispat ceph txt unknown /proc/30983/task/31017/exe (readlink: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31017 ms_dispat ceph NOFD /proc/30983/task/31017/fd (opendir: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31018 ms_local ceph cwd unknown /proc/30983/task/31018/cwd (readlink: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31018 ms_local ceph rtd unknown /proc/30983/task/31018/root (readlink: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31018 ms_local ceph txt unknown /proc/30983/task/31018/exe (readlink: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31018 ms_local ceph NOFD /proc/30983/task/31018/fd (opendir: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31019 safe_time ceph cwd unknown /proc/30983/task/31019/cwd (readlink: Permission denied) 2024-09-21T05:55:49.604 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31019 safe_time ceph rtd unknown /proc/30983/task/31019/root (readlink: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31019 safe_time ceph txt unknown /proc/30983/task/31019/exe (readlink: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31019 safe_time ceph NOFD /proc/30983/task/31019/fd (opendir: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31020 ms_dispat ceph cwd unknown /proc/30983/task/31020/cwd (readlink: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31020 ms_dispat ceph rtd unknown /proc/30983/task/31020/root (readlink: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31020 ms_dispat ceph txt unknown /proc/30983/task/31020/exe (readlink: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31020 ms_dispat ceph NOFD /proc/30983/task/31020/fd (opendir: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31021 ms_local ceph cwd unknown /proc/30983/task/31021/cwd (readlink: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31021 ms_local ceph rtd unknown /proc/30983/task/31021/root (readlink: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31021 ms_local ceph txt unknown /proc/30983/task/31021/exe (readlink: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 31021 ms_local ceph NOFD /proc/30983/task/31021/fd (opendir: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 67407 rstore_co ceph cwd unknown /proc/30983/task/67407/cwd (readlink: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 67407 rstore_co ceph rtd unknown /proc/30983/task/67407/root (readlink: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 67407 rstore_co ceph txt unknown /proc/30983/task/67407/exe (readlink: Permission denied) 2024-09-21T05:55:49.605 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 30983 67407 rstore_co ceph NOFD /proc/30983/task/67407/fd (opendir: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 31207 root cwd unknown /proc/31207/cwd (readlink: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 31207 root rtd unknown /proc/31207/root (readlink: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 31207 root txt unknown /proc/31207/exe (readlink: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 31207 root NOFD /proc/31207/fd (opendir: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 31209 root cwd unknown /proc/31209/cwd (readlink: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 31209 root rtd unknown /proc/31209/root (readlink: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 31209 root txt unknown /proc/31209/exe (readlink: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 31209 root NOFD /proc/31209/fd (opendir: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 ceph cwd unknown /proc/31211/cwd (readlink: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 ceph rtd unknown /proc/31211/root (readlink: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 ceph txt unknown /proc/31211/exe (readlink: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 ceph NOFD /proc/31211/fd (opendir: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40900 log ceph cwd unknown /proc/31211/task/40900/cwd (readlink: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40900 log ceph rtd unknown /proc/31211/task/40900/root (readlink: Permission denied) 2024-09-21T05:55:49.606 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40900 log ceph txt unknown /proc/31211/task/40900/exe (readlink: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40900 log ceph NOFD /proc/31211/task/40900/fd (opendir: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40902 msgr-work ceph cwd unknown /proc/31211/task/40902/cwd (readlink: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40902 msgr-work ceph rtd unknown /proc/31211/task/40902/root (readlink: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40902 msgr-work ceph txt unknown /proc/31211/task/40902/exe (readlink: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40902 msgr-work ceph NOFD /proc/31211/task/40902/fd (opendir: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40903 msgr-work ceph cwd unknown /proc/31211/task/40903/cwd (readlink: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40903 msgr-work ceph rtd unknown /proc/31211/task/40903/root (readlink: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40903 msgr-work ceph txt unknown /proc/31211/task/40903/exe (readlink: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40903 msgr-work ceph NOFD /proc/31211/task/40903/fd (opendir: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40904 msgr-work ceph cwd unknown /proc/31211/task/40904/cwd (readlink: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40904 msgr-work ceph rtd unknown /proc/31211/task/40904/root (readlink: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40904 msgr-work ceph txt unknown /proc/31211/task/40904/exe (readlink: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40904 msgr-work ceph NOFD /proc/31211/task/40904/fd (opendir: Permission denied) 2024-09-21T05:55:49.607 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40908 service ceph cwd unknown /proc/31211/task/40908/cwd (readlink: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40908 service ceph rtd unknown /proc/31211/task/40908/root (readlink: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40908 service ceph txt unknown /proc/31211/task/40908/exe (readlink: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40908 service ceph NOFD /proc/31211/task/40908/fd (opendir: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40909 admin_soc ceph cwd unknown /proc/31211/task/40909/cwd (readlink: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40909 admin_soc ceph rtd unknown /proc/31211/task/40909/root (readlink: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40909 admin_soc ceph txt unknown /proc/31211/task/40909/exe (readlink: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40909 admin_soc ceph NOFD /proc/31211/task/40909/fd (opendir: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40910 ceph_time ceph cwd unknown /proc/31211/task/40910/cwd (readlink: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40910 ceph_time ceph rtd unknown /proc/31211/task/40910/root (readlink: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40910 ceph_time ceph txt unknown /proc/31211/task/40910/exe (readlink: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40910 ceph_time ceph NOFD /proc/31211/task/40910/fd (opendir: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40911 fn_anonym ceph cwd unknown /proc/31211/task/40911/cwd (readlink: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40911 fn_anonym ceph rtd unknown /proc/31211/task/40911/root (readlink: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40911 fn_anonym ceph txt unknown /proc/31211/task/40911/exe (readlink: Permission denied) 2024-09-21T05:55:49.608 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40911 fn_anonym ceph NOFD /proc/31211/task/40911/fd (opendir: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40912 signal_ha ceph cwd unknown /proc/31211/task/40912/cwd (readlink: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40912 signal_ha ceph rtd unknown /proc/31211/task/40912/root (readlink: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40912 signal_ha ceph txt unknown /proc/31211/task/40912/exe (readlink: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40912 signal_ha ceph NOFD /proc/31211/task/40912/fd (opendir: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40913 mgrsb-fin ceph cwd unknown /proc/31211/task/40913/cwd (readlink: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40913 mgrsb-fin ceph rtd unknown /proc/31211/task/40913/root (readlink: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40913 mgrsb-fin ceph txt unknown /proc/31211/task/40913/exe (readlink: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40913 mgrsb-fin ceph NOFD /proc/31211/task/40913/fd (opendir: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40914 ms_dispat ceph cwd unknown /proc/31211/task/40914/cwd (readlink: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40914 ms_dispat ceph rtd unknown /proc/31211/task/40914/root (readlink: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40914 ms_dispat ceph txt unknown /proc/31211/task/40914/exe (readlink: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40914 ms_dispat ceph NOFD /proc/31211/task/40914/fd (opendir: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40915 ms_local ceph cwd unknown /proc/31211/task/40915/cwd (readlink: Permission denied) 2024-09-21T05:55:49.609 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40915 ms_local ceph rtd unknown /proc/31211/task/40915/root (readlink: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40915 ms_local ceph txt unknown /proc/31211/task/40915/exe (readlink: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40915 ms_local ceph NOFD /proc/31211/task/40915/fd (opendir: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40916 io_contex ceph cwd unknown /proc/31211/task/40916/cwd (readlink: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40916 io_contex ceph rtd unknown /proc/31211/task/40916/root (readlink: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40916 io_contex ceph txt unknown /proc/31211/task/40916/exe (readlink: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40916 io_contex ceph NOFD /proc/31211/task/40916/fd (opendir: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40917 io_contex ceph cwd unknown /proc/31211/task/40917/cwd (readlink: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40917 io_contex ceph rtd unknown /proc/31211/task/40917/root (readlink: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40917 io_contex ceph txt unknown /proc/31211/task/40917/exe (readlink: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40917 io_contex ceph NOFD /proc/31211/task/40917/fd (opendir: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40918 safe_time ceph cwd unknown /proc/31211/task/40918/cwd (readlink: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40918 safe_time ceph rtd unknown /proc/31211/task/40918/root (readlink: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40918 safe_time ceph txt unknown /proc/31211/task/40918/exe (readlink: Permission denied) 2024-09-21T05:55:49.610 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40918 safe_time ceph NOFD /proc/31211/task/40918/fd (opendir: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40919 safe_time ceph cwd unknown /proc/31211/task/40919/cwd (readlink: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40919 safe_time ceph rtd unknown /proc/31211/task/40919/root (readlink: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40919 safe_time ceph txt unknown /proc/31211/task/40919/exe (readlink: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40919 safe_time ceph NOFD /proc/31211/task/40919/fd (opendir: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40920 safe_time ceph cwd unknown /proc/31211/task/40920/cwd (readlink: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40920 safe_time ceph rtd unknown /proc/31211/task/40920/root (readlink: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40920 safe_time ceph txt unknown /proc/31211/task/40920/exe (readlink: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40920 safe_time ceph NOFD /proc/31211/task/40920/fd (opendir: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40921 fn_anonym ceph cwd unknown /proc/31211/task/40921/cwd (readlink: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40921 fn_anonym ceph rtd unknown /proc/31211/task/40921/root (readlink: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40921 fn_anonym ceph txt unknown /proc/31211/task/40921/exe (readlink: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40921 fn_anonym ceph NOFD /proc/31211/task/40921/fd (opendir: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40922 flusher ceph cwd unknown /proc/31211/task/40922/cwd (readlink: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40922 flusher ceph rtd unknown /proc/31211/task/40922/root (readlink: Permission denied) 2024-09-21T05:55:49.611 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40922 flusher ceph txt unknown /proc/31211/task/40922/exe (readlink: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40922 flusher ceph NOFD /proc/31211/task/40922/fd (opendir: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40923 safe_time ceph cwd unknown /proc/31211/task/40923/cwd (readlink: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40923 safe_time ceph rtd unknown /proc/31211/task/40923/root (readlink: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40923 safe_time ceph txt unknown /proc/31211/task/40923/exe (readlink: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40923 safe_time ceph NOFD /proc/31211/task/40923/fd (opendir: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40938 OpHistory ceph cwd unknown /proc/31211/task/40938/cwd (readlink: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40938 OpHistory ceph rtd unknown /proc/31211/task/40938/root (readlink: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40938 OpHistory ceph txt unknown /proc/31211/task/40938/exe (readlink: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40938 OpHistory ceph NOFD /proc/31211/task/40938/fd (opendir: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40939 mgr-fin ceph cwd unknown /proc/31211/task/40939/cwd (readlink: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40939 mgr-fin ceph rtd unknown /proc/31211/task/40939/root (readlink: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40939 mgr-fin ceph txt unknown /proc/31211/task/40939/exe (readlink: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40939 mgr-fin ceph NOFD /proc/31211/task/40939/fd (opendir: Permission denied) 2024-09-21T05:55:49.612 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40940 ms_dispat ceph cwd unknown /proc/31211/task/40940/cwd (readlink: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40940 ms_dispat ceph rtd unknown /proc/31211/task/40940/root (readlink: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40940 ms_dispat ceph txt unknown /proc/31211/task/40940/exe (readlink: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40940 ms_dispat ceph NOFD /proc/31211/task/40940/fd (opendir: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40941 ms_local ceph cwd unknown /proc/31211/task/40941/cwd (readlink: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40941 ms_local ceph rtd unknown /proc/31211/task/40941/root (readlink: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40941 ms_local ceph txt unknown /proc/31211/task/40941/exe (readlink: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40941 ms_local ceph NOFD /proc/31211/task/40941/fd (opendir: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40942 safe_time ceph cwd unknown /proc/31211/task/40942/cwd (readlink: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40942 safe_time ceph rtd unknown /proc/31211/task/40942/root (readlink: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40942 safe_time ceph txt unknown /proc/31211/task/40942/exe (readlink: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40942 safe_time ceph NOFD /proc/31211/task/40942/fd (opendir: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40943 cmdfin ceph cwd unknown /proc/31211/task/40943/cwd (readlink: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40943 cmdfin ceph rtd unknown /proc/31211/task/40943/root (readlink: Permission denied) 2024-09-21T05:55:49.613 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40943 cmdfin ceph txt unknown /proc/31211/task/40943/exe (readlink: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40943 cmdfin ceph NOFD /proc/31211/task/40943/fd (opendir: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40947 io_contex ceph cwd unknown /proc/31211/task/40947/cwd (readlink: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40947 io_contex ceph rtd unknown /proc/31211/task/40947/root (readlink: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40947 io_contex ceph txt unknown /proc/31211/task/40947/exe (readlink: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40947 io_contex ceph NOFD /proc/31211/task/40947/fd (opendir: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40948 io_contex ceph cwd unknown /proc/31211/task/40948/cwd (readlink: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40948 io_contex ceph rtd unknown /proc/31211/task/40948/root (readlink: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40948 io_contex ceph txt unknown /proc/31211/task/40948/exe (readlink: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40948 io_contex ceph NOFD /proc/31211/task/40948/fd (opendir: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40949 ceph_time ceph cwd unknown /proc/31211/task/40949/cwd (readlink: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40949 ceph_time ceph rtd unknown /proc/31211/task/40949/root (readlink: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40949 ceph_time ceph txt unknown /proc/31211/task/40949/exe (readlink: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40949 ceph_time ceph NOFD /proc/31211/task/40949/fd (opendir: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40950 ms_dispat ceph cwd unknown /proc/31211/task/40950/cwd (readlink: Permission denied) 2024-09-21T05:55:49.614 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40950 ms_dispat ceph rtd unknown /proc/31211/task/40950/root (readlink: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40950 ms_dispat ceph txt unknown /proc/31211/task/40950/exe (readlink: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40950 ms_dispat ceph NOFD /proc/31211/task/40950/fd (opendir: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40951 ms_local ceph cwd unknown /proc/31211/task/40951/cwd (readlink: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40951 ms_local ceph rtd unknown /proc/31211/task/40951/root (readlink: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40951 ms_local ceph txt unknown /proc/31211/task/40951/exe (readlink: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40951 ms_local ceph NOFD /proc/31211/task/40951/fd (opendir: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40952 safe_time ceph cwd unknown /proc/31211/task/40952/cwd (readlink: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40952 safe_time ceph rtd unknown /proc/31211/task/40952/root (readlink: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40952 safe_time ceph txt unknown /proc/31211/task/40952/exe (readlink: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40952 safe_time ceph NOFD /proc/31211/task/40952/fd (opendir: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40953 safe_time ceph cwd unknown /proc/31211/task/40953/cwd (readlink: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40953 safe_time ceph rtd unknown /proc/31211/task/40953/root (readlink: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40953 safe_time ceph txt unknown /proc/31211/task/40953/exe (readlink: Permission denied) 2024-09-21T05:55:49.615 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40953 safe_time ceph NOFD /proc/31211/task/40953/fd (opendir: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40954 balancer ceph cwd unknown /proc/31211/task/40954/cwd (readlink: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40954 balancer ceph rtd unknown /proc/31211/task/40954/root (readlink: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40954 balancer ceph txt unknown /proc/31211/task/40954/exe (readlink: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40954 balancer ceph NOFD /proc/31211/task/40954/fd (opendir: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40955 m-fin-bal ceph cwd unknown /proc/31211/task/40955/cwd (readlink: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40955 m-fin-bal ceph rtd unknown /proc/31211/task/40955/root (readlink: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40955 m-fin-bal ceph txt unknown /proc/31211/task/40955/exe (readlink: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40955 m-fin-bal ceph NOFD /proc/31211/task/40955/fd (opendir: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40956 mgr-fin ceph cwd unknown /proc/31211/task/40956/cwd (readlink: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40956 mgr-fin ceph rtd unknown /proc/31211/task/40956/root (readlink: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40956 mgr-fin ceph txt unknown /proc/31211/task/40956/exe (readlink: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40956 mgr-fin ceph NOFD /proc/31211/task/40956/fd (opendir: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40957 mgr-fin ceph cwd unknown /proc/31211/task/40957/cwd (readlink: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40957 mgr-fin ceph rtd unknown /proc/31211/task/40957/root (readlink: Permission denied) 2024-09-21T05:55:49.616 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40957 mgr-fin ceph txt unknown /proc/31211/task/40957/exe (readlink: Permission denied) 2024-09-21T05:55:49.617 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40957 mgr-fin ceph NOFD /proc/31211/task/40957/fd (opendir: Permission denied) 2024-09-21T05:55:49.617 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40958 mgr-fin ceph cwd unknown /proc/31211/task/40958/cwd (readlink: Permission denied) 2024-09-21T05:55:49.617 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40958 mgr-fin ceph rtd unknown /proc/31211/task/40958/root (readlink: Permission denied) 2024-09-21T05:55:49.617 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40958 mgr-fin ceph txt unknown /proc/31211/task/40958/exe (readlink: Permission denied) 2024-09-21T05:55:49.617 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40958 mgr-fin ceph NOFD /proc/31211/task/40958/fd (opendir: Permission denied) 2024-09-21T05:55:49.617 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40959 mgr-fin ceph cwd unknown /proc/31211/task/40959/cwd (readlink: Permission denied) 2024-09-21T05:55:49.617 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40959 mgr-fin ceph rtd unknown /proc/31211/task/40959/root (readlink: Permission denied) 2024-09-21T05:55:49.617 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40959 mgr-fin ceph txt unknown /proc/31211/task/40959/exe (readlink: Permission denied) 2024-09-21T05:55:49.617 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40959 mgr-fin ceph NOFD /proc/31211/task/40959/fd (opendir: Permission denied) 2024-09-21T05:55:49.617 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40960 mgr-fin ceph cwd unknown /proc/31211/task/40960/cwd (readlink: Permission denied) 2024-09-21T05:55:49.617 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40960 mgr-fin ceph rtd unknown /proc/31211/task/40960/root (readlink: Permission denied) 2024-09-21T05:55:49.617 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40960 mgr-fin ceph txt unknown /proc/31211/task/40960/exe (readlink: Permission denied) 2024-09-21T05:55:49.617 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40960 mgr-fin ceph NOFD /proc/31211/task/40960/fd (opendir: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40961 mgr-fin ceph cwd unknown /proc/31211/task/40961/cwd (readlink: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40961 mgr-fin ceph rtd unknown /proc/31211/task/40961/root (readlink: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40961 mgr-fin ceph txt unknown /proc/31211/task/40961/exe (readlink: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40961 mgr-fin ceph NOFD /proc/31211/task/40961/fd (opendir: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40962 mgr-fin ceph cwd unknown /proc/31211/task/40962/cwd (readlink: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40962 mgr-fin ceph rtd unknown /proc/31211/task/40962/root (readlink: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40962 mgr-fin ceph txt unknown /proc/31211/task/40962/exe (readlink: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40962 mgr-fin ceph NOFD /proc/31211/task/40962/fd (opendir: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40963 mgr-fin ceph cwd unknown /proc/31211/task/40963/cwd (readlink: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40963 mgr-fin ceph rtd unknown /proc/31211/task/40963/root (readlink: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40963 mgr-fin ceph txt unknown /proc/31211/task/40963/exe (readlink: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40963 mgr-fin ceph NOFD /proc/31211/task/40963/fd (opendir: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40964 mgr-fin ceph cwd unknown /proc/31211/task/40964/cwd (readlink: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40964 mgr-fin ceph rtd unknown /proc/31211/task/40964/root (readlink: Permission denied) 2024-09-21T05:55:49.618 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40964 mgr-fin ceph txt unknown /proc/31211/task/40964/exe (readlink: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40964 mgr-fin ceph NOFD /proc/31211/task/40964/fd (opendir: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40965 mgr-fin ceph cwd unknown /proc/31211/task/40965/cwd (readlink: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40965 mgr-fin ceph rtd unknown /proc/31211/task/40965/root (readlink: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40965 mgr-fin ceph txt unknown /proc/31211/task/40965/exe (readlink: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40965 mgr-fin ceph NOFD /proc/31211/task/40965/fd (opendir: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40966 mgr-fin ceph cwd unknown /proc/31211/task/40966/cwd (readlink: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40966 mgr-fin ceph rtd unknown /proc/31211/task/40966/root (readlink: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40966 mgr-fin ceph txt unknown /proc/31211/task/40966/exe (readlink: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40966 mgr-fin ceph NOFD /proc/31211/task/40966/fd (opendir: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40967 mgr-fin ceph cwd unknown /proc/31211/task/40967/cwd (readlink: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40967 mgr-fin ceph rtd unknown /proc/31211/task/40967/root (readlink: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40967 mgr-fin ceph txt unknown /proc/31211/task/40967/exe (readlink: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40967 mgr-fin ceph NOFD /proc/31211/task/40967/fd (opendir: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40968 mgr-fin ceph cwd unknown /proc/31211/task/40968/cwd (readlink: Permission denied) 2024-09-21T05:55:49.619 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40968 mgr-fin ceph rtd unknown /proc/31211/task/40968/root (readlink: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40968 mgr-fin ceph txt unknown /proc/31211/task/40968/exe (readlink: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40968 mgr-fin ceph NOFD /proc/31211/task/40968/fd (opendir: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40969 mgr-fin ceph cwd unknown /proc/31211/task/40969/cwd (readlink: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40969 mgr-fin ceph rtd unknown /proc/31211/task/40969/root (readlink: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40969 mgr-fin ceph txt unknown /proc/31211/task/40969/exe (readlink: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40969 mgr-fin ceph NOFD /proc/31211/task/40969/fd (opendir: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40970 mgr-fin ceph cwd unknown /proc/31211/task/40970/cwd (readlink: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40970 mgr-fin ceph rtd unknown /proc/31211/task/40970/root (readlink: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40970 mgr-fin ceph txt unknown /proc/31211/task/40970/exe (readlink: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40970 mgr-fin ceph NOFD /proc/31211/task/40970/fd (opendir: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40971 mgr-fin ceph cwd unknown /proc/31211/task/40971/cwd (readlink: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40971 mgr-fin ceph rtd unknown /proc/31211/task/40971/root (readlink: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40971 mgr-fin ceph txt unknown /proc/31211/task/40971/exe (readlink: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40971 mgr-fin ceph NOFD /proc/31211/task/40971/fd (opendir: Permission denied) 2024-09-21T05:55:49.620 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40972 cephadm ceph cwd unknown /proc/31211/task/40972/cwd (readlink: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40972 cephadm ceph rtd unknown /proc/31211/task/40972/root (readlink: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40972 cephadm ceph txt unknown /proc/31211/task/40972/exe (readlink: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40972 cephadm ceph NOFD /proc/31211/task/40972/fd (opendir: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40973 mgr-fin ceph cwd unknown /proc/31211/task/40973/cwd (readlink: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40973 mgr-fin ceph rtd unknown /proc/31211/task/40973/root (readlink: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40973 mgr-fin ceph txt unknown /proc/31211/task/40973/exe (readlink: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40973 mgr-fin ceph NOFD /proc/31211/task/40973/fd (opendir: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40974 m-fin-cep ceph cwd unknown /proc/31211/task/40974/cwd (readlink: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40974 m-fin-cep ceph rtd unknown /proc/31211/task/40974/root (readlink: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40974 m-fin-cep ceph txt unknown /proc/31211/task/40974/exe (readlink: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40974 m-fin-cep ceph NOFD /proc/31211/task/40974/fd (opendir: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40975 mgr-fin ceph cwd unknown /proc/31211/task/40975/cwd (readlink: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40975 mgr-fin ceph rtd unknown /proc/31211/task/40975/root (readlink: Permission denied) 2024-09-21T05:55:49.621 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40975 mgr-fin ceph txt unknown /proc/31211/task/40975/exe (readlink: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40975 mgr-fin ceph NOFD /proc/31211/task/40975/fd (opendir: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40976 cephadm ceph cwd unknown /proc/31211/task/40976/cwd (readlink: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40976 cephadm ceph rtd unknown /proc/31211/task/40976/root (readlink: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40976 cephadm ceph txt unknown /proc/31211/task/40976/exe (readlink: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40976 cephadm ceph NOFD /proc/31211/task/40976/fd (opendir: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40977 mgr-fin ceph cwd unknown /proc/31211/task/40977/cwd (readlink: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40977 mgr-fin ceph rtd unknown /proc/31211/task/40977/root (readlink: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40977 mgr-fin ceph txt unknown /proc/31211/task/40977/exe (readlink: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40977 mgr-fin ceph NOFD /proc/31211/task/40977/fd (opendir: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40978 crash ceph cwd unknown /proc/31211/task/40978/cwd (readlink: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40978 crash ceph rtd unknown /proc/31211/task/40978/root (readlink: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40978 crash ceph txt unknown /proc/31211/task/40978/exe (readlink: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40978 crash ceph NOFD /proc/31211/task/40978/fd (opendir: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40979 m-fin-cra ceph cwd unknown /proc/31211/task/40979/cwd (readlink: Permission denied) 2024-09-21T05:55:49.622 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40979 m-fin-cra ceph rtd unknown /proc/31211/task/40979/root (readlink: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40979 m-fin-cra ceph txt unknown /proc/31211/task/40979/exe (readlink: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40979 m-fin-cra ceph NOFD /proc/31211/task/40979/fd (opendir: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40980 mgr-fin ceph cwd unknown /proc/31211/task/40980/cwd (readlink: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40980 mgr-fin ceph rtd unknown /proc/31211/task/40980/root (readlink: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40980 mgr-fin ceph txt unknown /proc/31211/task/40980/exe (readlink: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40980 mgr-fin ceph NOFD /proc/31211/task/40980/fd (opendir: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40981 mgr-fin ceph cwd unknown /proc/31211/task/40981/cwd (readlink: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40981 mgr-fin ceph rtd unknown /proc/31211/task/40981/root (readlink: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40981 mgr-fin ceph txt unknown /proc/31211/task/40981/exe (readlink: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40981 mgr-fin ceph NOFD /proc/31211/task/40981/fd (opendir: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40982 mgr-fin ceph cwd unknown /proc/31211/task/40982/cwd (readlink: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40982 mgr-fin ceph rtd unknown /proc/31211/task/40982/root (readlink: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40982 mgr-fin ceph txt unknown /proc/31211/task/40982/exe (readlink: Permission denied) 2024-09-21T05:55:49.623 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40982 mgr-fin ceph NOFD /proc/31211/task/40982/fd (opendir: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40983 dashboard ceph cwd unknown /proc/31211/task/40983/cwd (readlink: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40983 dashboard ceph rtd unknown /proc/31211/task/40983/root (readlink: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40983 dashboard ceph txt unknown /proc/31211/task/40983/exe (readlink: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40983 dashboard ceph NOFD /proc/31211/task/40983/fd (opendir: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40984 m-fin-das ceph cwd unknown /proc/31211/task/40984/cwd (readlink: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40984 m-fin-das ceph rtd unknown /proc/31211/task/40984/root (readlink: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40984 m-fin-das ceph txt unknown /proc/31211/task/40984/exe (readlink: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40984 m-fin-das ceph NOFD /proc/31211/task/40984/fd (opendir: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40985 mgr-fin ceph cwd unknown /proc/31211/task/40985/cwd (readlink: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40985 mgr-fin ceph rtd unknown /proc/31211/task/40985/root (readlink: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40985 mgr-fin ceph txt unknown /proc/31211/task/40985/exe (readlink: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40985 mgr-fin ceph NOFD /proc/31211/task/40985/fd (opendir: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40986 mgr-fin ceph cwd unknown /proc/31211/task/40986/cwd (readlink: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40986 mgr-fin ceph rtd unknown /proc/31211/task/40986/root (readlink: Permission denied) 2024-09-21T05:55:49.624 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40986 mgr-fin ceph txt unknown /proc/31211/task/40986/exe (readlink: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40986 mgr-fin ceph NOFD /proc/31211/task/40986/fd (opendir: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40987 mgr-fin ceph cwd unknown /proc/31211/task/40987/cwd (readlink: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40987 mgr-fin ceph rtd unknown /proc/31211/task/40987/root (readlink: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40987 mgr-fin ceph txt unknown /proc/31211/task/40987/exe (readlink: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40987 mgr-fin ceph NOFD /proc/31211/task/40987/fd (opendir: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40988 devicehea ceph cwd unknown /proc/31211/task/40988/cwd (readlink: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40988 devicehea ceph rtd unknown /proc/31211/task/40988/root (readlink: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40988 devicehea ceph txt unknown /proc/31211/task/40988/exe (readlink: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40988 devicehea ceph NOFD /proc/31211/task/40988/fd (opendir: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40989 m-fin-dev ceph cwd unknown /proc/31211/task/40989/cwd (readlink: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40989 m-fin-dev ceph rtd unknown /proc/31211/task/40989/root (readlink: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40989 m-fin-dev ceph txt unknown /proc/31211/task/40989/exe (readlink: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40989 m-fin-dev ceph NOFD /proc/31211/task/40989/fd (opendir: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40990 mgr-fin ceph cwd unknown /proc/31211/task/40990/cwd (readlink: Permission denied) 2024-09-21T05:55:49.625 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40990 mgr-fin ceph rtd unknown /proc/31211/task/40990/root (readlink: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40990 mgr-fin ceph txt unknown /proc/31211/task/40990/exe (readlink: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40990 mgr-fin ceph NOFD /proc/31211/task/40990/fd (opendir: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40991 mgr-fin ceph cwd unknown /proc/31211/task/40991/cwd (readlink: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40991 mgr-fin ceph rtd unknown /proc/31211/task/40991/root (readlink: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40991 mgr-fin ceph txt unknown /proc/31211/task/40991/exe (readlink: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40991 mgr-fin ceph NOFD /proc/31211/task/40991/fd (opendir: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40993 m-fin-ios ceph cwd unknown /proc/31211/task/40993/cwd (readlink: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40993 m-fin-ios ceph rtd unknown /proc/31211/task/40993/root (readlink: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40993 m-fin-ios ceph txt unknown /proc/31211/task/40993/exe (readlink: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40993 m-fin-ios ceph NOFD /proc/31211/task/40993/fd (opendir: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40995 m-fin-nfs ceph cwd unknown /proc/31211/task/40995/cwd (readlink: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40995 m-fin-nfs ceph rtd unknown /proc/31211/task/40995/root (readlink: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40995 m-fin-nfs ceph txt unknown /proc/31211/task/40995/exe (readlink: Permission denied) 2024-09-21T05:55:49.626 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40995 m-fin-nfs ceph NOFD /proc/31211/task/40995/fd (opendir: Permission denied) 2024-09-21T05:55:49.627 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40996 mgr-fin ceph cwd unknown /proc/31211/task/40996/cwd (readlink: Permission denied) 2024-09-21T05:55:49.627 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40996 mgr-fin ceph rtd unknown /proc/31211/task/40996/root (readlink: Permission denied) 2024-09-21T05:55:49.627 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40996 mgr-fin ceph txt unknown /proc/31211/task/40996/exe (readlink: Permission denied) 2024-09-21T05:55:49.627 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40996 mgr-fin ceph NOFD /proc/31211/task/40996/fd (opendir: Permission denied) 2024-09-21T05:55:49.627 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40998 m-fin-orc ceph cwd unknown /proc/31211/task/40998/cwd (readlink: Permission denied) 2024-09-21T05:55:49.627 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40998 m-fin-orc ceph rtd unknown /proc/31211/task/40998/root (readlink: Permission denied) 2024-09-21T05:55:49.627 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40998 m-fin-orc ceph txt unknown /proc/31211/task/40998/exe (readlink: Permission denied) 2024-09-21T05:55:49.627 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40998 m-fin-orc ceph NOFD /proc/31211/task/40998/fd (opendir: Permission denied) 2024-09-21T05:55:49.627 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40999 cephadm ceph cwd unknown /proc/31211/task/40999/cwd (readlink: Permission denied) 2024-09-21T05:55:49.627 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40999 cephadm ceph rtd unknown /proc/31211/task/40999/root (readlink: Permission denied) 2024-09-21T05:55:49.627 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40999 cephadm ceph txt unknown /proc/31211/task/40999/exe (readlink: Permission denied) 2024-09-21T05:55:49.627 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 40999 cephadm ceph NOFD /proc/31211/task/40999/fd (opendir: Permission denied) 2024-09-21T05:55:49.627 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41000 pg_autosc ceph cwd unknown /proc/31211/task/41000/cwd (readlink: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41000 pg_autosc ceph rtd unknown /proc/31211/task/41000/root (readlink: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41000 pg_autosc ceph txt unknown /proc/31211/task/41000/exe (readlink: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41000 pg_autosc ceph NOFD /proc/31211/task/41000/fd (opendir: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41001 m-fin-pg_ ceph cwd unknown /proc/31211/task/41001/cwd (readlink: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41001 m-fin-pg_ ceph rtd unknown /proc/31211/task/41001/root (readlink: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41001 m-fin-pg_ ceph txt unknown /proc/31211/task/41001/exe (readlink: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41001 m-fin-pg_ ceph NOFD /proc/31211/task/41001/fd (opendir: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41002 cephadm ceph cwd unknown /proc/31211/task/41002/cwd (readlink: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41002 cephadm ceph rtd unknown /proc/31211/task/41002/root (readlink: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41002 cephadm ceph txt unknown /proc/31211/task/41002/exe (readlink: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41002 cephadm ceph NOFD /proc/31211/task/41002/fd (opendir: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41003 progress ceph cwd unknown /proc/31211/task/41003/cwd (readlink: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41003 progress ceph rtd unknown /proc/31211/task/41003/root (readlink: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41003 progress ceph txt unknown /proc/31211/task/41003/exe (readlink: Permission denied) 2024-09-21T05:55:49.628 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41003 progress ceph NOFD /proc/31211/task/41003/fd (opendir: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41004 m-fin-pro ceph cwd unknown /proc/31211/task/41004/cwd (readlink: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41004 m-fin-pro ceph rtd unknown /proc/31211/task/41004/root (readlink: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41004 m-fin-pro ceph txt unknown /proc/31211/task/41004/exe (readlink: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41004 m-fin-pro ceph NOFD /proc/31211/task/41004/fd (opendir: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41005 cephadm ceph cwd unknown /proc/31211/task/41005/cwd (readlink: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41005 cephadm ceph rtd unknown /proc/31211/task/41005/root (readlink: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41005 cephadm ceph txt unknown /proc/31211/task/41005/exe (readlink: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41005 cephadm ceph NOFD /proc/31211/task/41005/fd (opendir: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41009 io_contex ceph cwd unknown /proc/31211/task/41009/cwd (readlink: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41009 io_contex ceph rtd unknown /proc/31211/task/41009/root (readlink: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41009 io_contex ceph txt unknown /proc/31211/task/41009/exe (readlink: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41009 io_contex ceph NOFD /proc/31211/task/41009/fd (opendir: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41010 io_contex ceph cwd unknown /proc/31211/task/41010/cwd (readlink: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41010 io_contex ceph rtd unknown /proc/31211/task/41010/root (readlink: Permission denied) 2024-09-21T05:55:49.629 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41010 io_contex ceph txt unknown /proc/31211/task/41010/exe (readlink: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41010 io_contex ceph NOFD /proc/31211/task/41010/fd (opendir: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41011 ceph_time ceph cwd unknown /proc/31211/task/41011/cwd (readlink: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41011 ceph_time ceph rtd unknown /proc/31211/task/41011/root (readlink: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41011 ceph_time ceph txt unknown /proc/31211/task/41011/exe (readlink: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41011 ceph_time ceph NOFD /proc/31211/task/41011/fd (opendir: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41012 ms_dispat ceph cwd unknown /proc/31211/task/41012/cwd (readlink: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41012 ms_dispat ceph rtd unknown /proc/31211/task/41012/root (readlink: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41012 ms_dispat ceph txt unknown /proc/31211/task/41012/exe (readlink: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41012 ms_dispat ceph NOFD /proc/31211/task/41012/fd (opendir: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41013 ms_local ceph cwd unknown /proc/31211/task/41013/cwd (readlink: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41013 ms_local ceph rtd unknown /proc/31211/task/41013/root (readlink: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41013 ms_local ceph txt unknown /proc/31211/task/41013/exe (readlink: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41013 ms_local ceph NOFD /proc/31211/task/41013/fd (opendir: Permission denied) 2024-09-21T05:55:49.630 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41014 safe_time ceph cwd unknown /proc/31211/task/41014/cwd (readlink: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41014 safe_time ceph rtd unknown /proc/31211/task/41014/root (readlink: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41014 safe_time ceph txt unknown /proc/31211/task/41014/exe (readlink: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41014 safe_time ceph NOFD /proc/31211/task/41014/fd (opendir: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41015 safe_time ceph cwd unknown /proc/31211/task/41015/cwd (readlink: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41015 safe_time ceph rtd unknown /proc/31211/task/41015/root (readlink: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41015 safe_time ceph txt unknown /proc/31211/task/41015/exe (readlink: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41015 safe_time ceph NOFD /proc/31211/task/41015/fd (opendir: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41016 mgr-fin ceph cwd unknown /proc/31211/task/41016/cwd (readlink: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41016 mgr-fin ceph rtd unknown /proc/31211/task/41016/root (readlink: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41016 mgr-fin ceph txt unknown /proc/31211/task/41016/exe (readlink: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41016 mgr-fin ceph NOFD /proc/31211/task/41016/fd (opendir: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41018 m-fin-rbd ceph cwd unknown /proc/31211/task/41018/cwd (readlink: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41018 m-fin-rbd ceph rtd unknown /proc/31211/task/41018/root (readlink: Permission denied) 2024-09-21T05:55:49.631 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41018 m-fin-rbd ceph txt unknown /proc/31211/task/41018/exe (readlink: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41018 m-fin-rbd ceph NOFD /proc/31211/task/41018/fd (opendir: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41019 restful ceph cwd unknown /proc/31211/task/41019/cwd (readlink: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41019 restful ceph rtd unknown /proc/31211/task/41019/root (readlink: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41019 restful ceph txt unknown /proc/31211/task/41019/exe (readlink: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41019 restful ceph NOFD /proc/31211/task/41019/fd (opendir: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41020 m-fin-res ceph cwd unknown /proc/31211/task/41020/cwd (readlink: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41020 m-fin-res ceph rtd unknown /proc/31211/task/41020/root (readlink: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41020 m-fin-res ceph txt unknown /proc/31211/task/41020/exe (readlink: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41020 m-fin-res ceph NOFD /proc/31211/task/41020/fd (opendir: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41021 mgr-fin ceph cwd unknown /proc/31211/task/41021/cwd (readlink: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41021 mgr-fin ceph rtd unknown /proc/31211/task/41021/root (readlink: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41021 mgr-fin ceph txt unknown /proc/31211/task/41021/exe (readlink: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41021 mgr-fin ceph NOFD /proc/31211/task/41021/fd (opendir: Permission denied) 2024-09-21T05:55:49.632 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41022 mgr-fin ceph cwd unknown /proc/31211/task/41022/cwd (readlink: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41022 mgr-fin ceph rtd unknown /proc/31211/task/41022/root (readlink: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41022 mgr-fin ceph txt unknown /proc/31211/task/41022/exe (readlink: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41022 mgr-fin ceph NOFD /proc/31211/task/41022/fd (opendir: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41024 mgr-fin ceph cwd unknown /proc/31211/task/41024/cwd (readlink: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41024 mgr-fin ceph rtd unknown /proc/31211/task/41024/root (readlink: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41024 mgr-fin ceph txt unknown /proc/31211/task/41024/exe (readlink: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41024 mgr-fin ceph NOFD /proc/31211/task/41024/fd (opendir: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41025 m-fin-sna ceph cwd unknown /proc/31211/task/41025/cwd (readlink: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41025 m-fin-sna ceph rtd unknown /proc/31211/task/41025/root (readlink: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41025 m-fin-sna ceph txt unknown /proc/31211/task/41025/exe (readlink: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41025 m-fin-sna ceph NOFD /proc/31211/task/41025/fd (opendir: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41026 mgr-fin ceph cwd unknown /proc/31211/task/41026/cwd (readlink: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41026 mgr-fin ceph rtd unknown /proc/31211/task/41026/root (readlink: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41026 mgr-fin ceph txt unknown /proc/31211/task/41026/exe (readlink: Permission denied) 2024-09-21T05:55:49.633 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41026 mgr-fin ceph NOFD /proc/31211/task/41026/fd (opendir: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41028 m-fin-sta ceph cwd unknown /proc/31211/task/41028/cwd (readlink: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41028 m-fin-sta ceph rtd unknown /proc/31211/task/41028/root (readlink: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41028 m-fin-sta ceph txt unknown /proc/31211/task/41028/exe (readlink: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41028 m-fin-sta ceph NOFD /proc/31211/task/41028/fd (opendir: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41029 mgr-fin ceph cwd unknown /proc/31211/task/41029/cwd (readlink: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41029 mgr-fin ceph rtd unknown /proc/31211/task/41029/root (readlink: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41029 mgr-fin ceph txt unknown /proc/31211/task/41029/exe (readlink: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41029 mgr-fin ceph NOFD /proc/31211/task/41029/fd (opendir: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41030 telemetry ceph cwd unknown /proc/31211/task/41030/cwd (readlink: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41030 telemetry ceph rtd unknown /proc/31211/task/41030/root (readlink: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41030 telemetry ceph txt unknown /proc/31211/task/41030/exe (readlink: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41030 telemetry ceph NOFD /proc/31211/task/41030/fd (opendir: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41031 m-fin-tel ceph cwd unknown /proc/31211/task/41031/cwd (readlink: Permission denied) 2024-09-21T05:55:49.634 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41031 m-fin-tel ceph rtd unknown /proc/31211/task/41031/root (readlink: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41031 m-fin-tel ceph txt unknown /proc/31211/task/41031/exe (readlink: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41031 m-fin-tel ceph NOFD /proc/31211/task/41031/fd (opendir: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41032 mgr-fin ceph cwd unknown /proc/31211/task/41032/cwd (readlink: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41032 mgr-fin ceph rtd unknown /proc/31211/task/41032/root (readlink: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41032 mgr-fin ceph txt unknown /proc/31211/task/41032/exe (readlink: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41032 mgr-fin ceph NOFD /proc/31211/task/41032/fd (opendir: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41036 io_contex ceph cwd unknown /proc/31211/task/41036/cwd (readlink: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41036 io_contex ceph rtd unknown /proc/31211/task/41036/root (readlink: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41036 io_contex ceph txt unknown /proc/31211/task/41036/exe (readlink: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41036 io_contex ceph NOFD /proc/31211/task/41036/fd (opendir: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41037 io_contex ceph cwd unknown /proc/31211/task/41037/cwd (readlink: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41037 io_contex ceph rtd unknown /proc/31211/task/41037/root (readlink: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41037 io_contex ceph txt unknown /proc/31211/task/41037/exe (readlink: Permission denied) 2024-09-21T05:55:49.635 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41037 io_contex ceph NOFD /proc/31211/task/41037/fd (opendir: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41038 ceph_time ceph cwd unknown /proc/31211/task/41038/cwd (readlink: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41038 ceph_time ceph rtd unknown /proc/31211/task/41038/root (readlink: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41038 ceph_time ceph txt unknown /proc/31211/task/41038/exe (readlink: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41038 ceph_time ceph NOFD /proc/31211/task/41038/fd (opendir: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41039 ms_dispat ceph cwd unknown /proc/31211/task/41039/cwd (readlink: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41039 ms_dispat ceph rtd unknown /proc/31211/task/41039/root (readlink: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41039 ms_dispat ceph txt unknown /proc/31211/task/41039/exe (readlink: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41039 ms_dispat ceph NOFD /proc/31211/task/41039/fd (opendir: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41040 ms_local ceph cwd unknown /proc/31211/task/41040/cwd (readlink: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41040 ms_local ceph rtd unknown /proc/31211/task/41040/root (readlink: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41040 ms_local ceph txt unknown /proc/31211/task/41040/exe (readlink: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41040 ms_local ceph NOFD /proc/31211/task/41040/fd (opendir: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41041 safe_time ceph cwd unknown /proc/31211/task/41041/cwd (readlink: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41041 safe_time ceph rtd unknown /proc/31211/task/41041/root (readlink: Permission denied) 2024-09-21T05:55:49.636 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41041 safe_time ceph txt unknown /proc/31211/task/41041/exe (readlink: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41041 safe_time ceph NOFD /proc/31211/task/41041/fd (opendir: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41042 safe_time ceph cwd unknown /proc/31211/task/41042/cwd (readlink: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41042 safe_time ceph rtd unknown /proc/31211/task/41042/root (readlink: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41042 safe_time ceph txt unknown /proc/31211/task/41042/exe (readlink: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41042 safe_time ceph NOFD /proc/31211/task/41042/fd (opendir: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41043 mgr-fin ceph cwd unknown /proc/31211/task/41043/cwd (readlink: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41043 mgr-fin ceph rtd unknown /proc/31211/task/41043/root (readlink: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41043 mgr-fin ceph txt unknown /proc/31211/task/41043/exe (readlink: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41043 mgr-fin ceph NOFD /proc/31211/task/41043/fd (opendir: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41044 mgr-fin ceph cwd unknown /proc/31211/task/41044/cwd (readlink: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41044 mgr-fin ceph rtd unknown /proc/31211/task/41044/root (readlink: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41044 mgr-fin ceph txt unknown /proc/31211/task/41044/exe (readlink: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41044 mgr-fin ceph NOFD /proc/31211/task/41044/fd (opendir: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41045 mgr-fin ceph cwd unknown /proc/31211/task/41045/cwd (readlink: Permission denied) 2024-09-21T05:55:49.637 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41045 mgr-fin ceph rtd unknown /proc/31211/task/41045/root (readlink: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41045 mgr-fin ceph txt unknown /proc/31211/task/41045/exe (readlink: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41045 mgr-fin ceph NOFD /proc/31211/task/41045/fd (opendir: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41046 mgr-fin ceph cwd unknown /proc/31211/task/41046/cwd (readlink: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41046 mgr-fin ceph rtd unknown /proc/31211/task/41046/root (readlink: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41046 mgr-fin ceph txt unknown /proc/31211/task/41046/exe (readlink: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41046 mgr-fin ceph NOFD /proc/31211/task/41046/fd (opendir: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41047 mgr-fin ceph cwd unknown /proc/31211/task/41047/cwd (readlink: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41047 mgr-fin ceph rtd unknown /proc/31211/task/41047/root (readlink: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41047 mgr-fin ceph txt unknown /proc/31211/task/41047/exe (readlink: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41047 mgr-fin ceph NOFD /proc/31211/task/41047/fd (opendir: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41048 mgr-fin ceph cwd unknown /proc/31211/task/41048/cwd (readlink: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41048 mgr-fin ceph rtd unknown /proc/31211/task/41048/root (readlink: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41048 mgr-fin ceph txt unknown /proc/31211/task/41048/exe (readlink: Permission denied) 2024-09-21T05:55:49.638 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41048 mgr-fin ceph NOFD /proc/31211/task/41048/fd (opendir: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41049 mgr-fin ceph cwd unknown /proc/31211/task/41049/cwd (readlink: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41049 mgr-fin ceph rtd unknown /proc/31211/task/41049/root (readlink: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41049 mgr-fin ceph txt unknown /proc/31211/task/41049/exe (readlink: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41049 mgr-fin ceph NOFD /proc/31211/task/41049/fd (opendir: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41050 mgr-fin ceph cwd unknown /proc/31211/task/41050/cwd (readlink: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41050 mgr-fin ceph rtd unknown /proc/31211/task/41050/root (readlink: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41050 mgr-fin ceph txt unknown /proc/31211/task/41050/exe (readlink: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41050 mgr-fin ceph NOFD /proc/31211/task/41050/fd (opendir: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41051 mgr-fin ceph cwd unknown /proc/31211/task/41051/cwd (readlink: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41051 mgr-fin ceph rtd unknown /proc/31211/task/41051/root (readlink: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41051 mgr-fin ceph txt unknown /proc/31211/task/41051/exe (readlink: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41051 mgr-fin ceph NOFD /proc/31211/task/41051/fd (opendir: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41052 mgr-fin ceph cwd unknown /proc/31211/task/41052/cwd (readlink: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41052 mgr-fin ceph rtd unknown /proc/31211/task/41052/root (readlink: Permission denied) 2024-09-21T05:55:49.639 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41052 mgr-fin ceph txt unknown /proc/31211/task/41052/exe (readlink: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41052 mgr-fin ceph NOFD /proc/31211/task/41052/fd (opendir: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41053 mgr-fin ceph cwd unknown /proc/31211/task/41053/cwd (readlink: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41053 mgr-fin ceph rtd unknown /proc/31211/task/41053/root (readlink: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41053 mgr-fin ceph txt unknown /proc/31211/task/41053/exe (readlink: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41053 mgr-fin ceph NOFD /proc/31211/task/41053/fd (opendir: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41054 mgr-fin ceph cwd unknown /proc/31211/task/41054/cwd (readlink: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41054 mgr-fin ceph rtd unknown /proc/31211/task/41054/root (readlink: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41054 mgr-fin ceph txt unknown /proc/31211/task/41054/exe (readlink: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41054 mgr-fin ceph NOFD /proc/31211/task/41054/fd (opendir: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41056 m-fin-vol ceph cwd unknown /proc/31211/task/41056/cwd (readlink: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41056 m-fin-vol ceph rtd unknown /proc/31211/task/41056/root (readlink: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41056 m-fin-vol ceph txt unknown /proc/31211/task/41056/exe (readlink: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41056 m-fin-vol ceph NOFD /proc/31211/task/41056/fd (opendir: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41178 dashboard ceph cwd unknown /proc/31211/task/41178/cwd (readlink: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41178 dashboard ceph rtd unknown /proc/31211/task/41178/root (readlink: Permission denied) 2024-09-21T05:55:49.640 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41178 dashboard ceph txt unknown /proc/31211/task/41178/exe (readlink: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41178 dashboard ceph NOFD /proc/31211/task/41178/fd (opendir: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41179 dashboard ceph cwd unknown /proc/31211/task/41179/cwd (readlink: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41179 dashboard ceph rtd unknown /proc/31211/task/41179/root (readlink: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41179 dashboard ceph txt unknown /proc/31211/task/41179/exe (readlink: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41179 dashboard ceph NOFD /proc/31211/task/41179/fd (opendir: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41180 dashboard ceph cwd unknown /proc/31211/task/41180/cwd (readlink: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41180 dashboard ceph rtd unknown /proc/31211/task/41180/root (readlink: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41180 dashboard ceph txt unknown /proc/31211/task/41180/exe (readlink: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41180 dashboard ceph NOFD /proc/31211/task/41180/fd (opendir: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41181 dashboard ceph cwd unknown /proc/31211/task/41181/cwd (readlink: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41181 dashboard ceph rtd unknown /proc/31211/task/41181/root (readlink: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41181 dashboard ceph txt unknown /proc/31211/task/41181/exe (readlink: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41181 dashboard ceph NOFD /proc/31211/task/41181/fd (opendir: Permission denied) 2024-09-21T05:55:49.641 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41182 dashboard ceph cwd unknown /proc/31211/task/41182/cwd (readlink: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41182 dashboard ceph rtd unknown /proc/31211/task/41182/root (readlink: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41182 dashboard ceph txt unknown /proc/31211/task/41182/exe (readlink: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41182 dashboard ceph NOFD /proc/31211/task/41182/fd (opendir: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41183 dashboard ceph cwd unknown /proc/31211/task/41183/cwd (readlink: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41183 dashboard ceph rtd unknown /proc/31211/task/41183/root (readlink: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41183 dashboard ceph txt unknown /proc/31211/task/41183/exe (readlink: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41183 dashboard ceph NOFD /proc/31211/task/41183/fd (opendir: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41184 dashboard ceph cwd unknown /proc/31211/task/41184/cwd (readlink: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41184 dashboard ceph rtd unknown /proc/31211/task/41184/root (readlink: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41184 dashboard ceph txt unknown /proc/31211/task/41184/exe (readlink: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41184 dashboard ceph NOFD /proc/31211/task/41184/fd (opendir: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41185 dashboard ceph cwd unknown /proc/31211/task/41185/cwd (readlink: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41185 dashboard ceph rtd unknown /proc/31211/task/41185/root (readlink: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41185 dashboard ceph txt unknown /proc/31211/task/41185/exe (readlink: Permission denied) 2024-09-21T05:55:49.642 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41185 dashboard ceph NOFD /proc/31211/task/41185/fd (opendir: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41186 dashboard ceph cwd unknown /proc/31211/task/41186/cwd (readlink: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41186 dashboard ceph rtd unknown /proc/31211/task/41186/root (readlink: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41186 dashboard ceph txt unknown /proc/31211/task/41186/exe (readlink: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41186 dashboard ceph NOFD /proc/31211/task/41186/fd (opendir: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41187 dashboard ceph cwd unknown /proc/31211/task/41187/cwd (readlink: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41187 dashboard ceph rtd unknown /proc/31211/task/41187/root (readlink: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41187 dashboard ceph txt unknown /proc/31211/task/41187/exe (readlink: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41187 dashboard ceph NOFD /proc/31211/task/41187/fd (opendir: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41188 dashboard ceph cwd unknown /proc/31211/task/41188/cwd (readlink: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41188 dashboard ceph rtd unknown /proc/31211/task/41188/root (readlink: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41188 dashboard ceph txt unknown /proc/31211/task/41188/exe (readlink: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41188 dashboard ceph NOFD /proc/31211/task/41188/fd (opendir: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41189 dashboard ceph cwd unknown /proc/31211/task/41189/cwd (readlink: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41189 dashboard ceph rtd unknown /proc/31211/task/41189/root (readlink: Permission denied) 2024-09-21T05:55:49.643 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41189 dashboard ceph txt unknown /proc/31211/task/41189/exe (readlink: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 41189 dashboard ceph NOFD /proc/31211/task/41189/fd (opendir: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42490 mgr-fin ceph cwd unknown /proc/31211/task/42490/cwd (readlink: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42490 mgr-fin ceph rtd unknown /proc/31211/task/42490/root (readlink: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42490 mgr-fin ceph txt unknown /proc/31211/task/42490/exe (readlink: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42490 mgr-fin ceph NOFD /proc/31211/task/42490/fd (opendir: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42491 mgr-fin ceph cwd unknown /proc/31211/task/42491/cwd (readlink: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42491 mgr-fin ceph rtd unknown /proc/31211/task/42491/root (readlink: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42491 mgr-fin ceph txt unknown /proc/31211/task/42491/exe (readlink: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42491 mgr-fin ceph NOFD /proc/31211/task/42491/fd (opendir: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42493 mgr-fin ceph cwd unknown /proc/31211/task/42493/cwd (readlink: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42493 mgr-fin ceph rtd unknown /proc/31211/task/42493/root (readlink: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42493 mgr-fin ceph txt unknown /proc/31211/task/42493/exe (readlink: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42493 mgr-fin ceph NOFD /proc/31211/task/42493/fd (opendir: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42494 mgr-fin ceph cwd unknown /proc/31211/task/42494/cwd (readlink: Permission denied) 2024-09-21T05:55:49.644 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42494 mgr-fin ceph rtd unknown /proc/31211/task/42494/root (readlink: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42494 mgr-fin ceph txt unknown /proc/31211/task/42494/exe (readlink: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42494 mgr-fin ceph NOFD /proc/31211/task/42494/fd (opendir: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42495 mgr-fin ceph cwd unknown /proc/31211/task/42495/cwd (readlink: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42495 mgr-fin ceph rtd unknown /proc/31211/task/42495/root (readlink: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42495 mgr-fin ceph txt unknown /proc/31211/task/42495/exe (readlink: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42495 mgr-fin ceph NOFD /proc/31211/task/42495/fd (opendir: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42496 mgr-fin ceph cwd unknown /proc/31211/task/42496/cwd (readlink: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42496 mgr-fin ceph rtd unknown /proc/31211/task/42496/root (readlink: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42496 mgr-fin ceph txt unknown /proc/31211/task/42496/exe (readlink: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42496 mgr-fin ceph NOFD /proc/31211/task/42496/fd (opendir: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42499 mgr-fin ceph cwd unknown /proc/31211/task/42499/cwd (readlink: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42499 mgr-fin ceph rtd unknown /proc/31211/task/42499/root (readlink: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42499 mgr-fin ceph txt unknown /proc/31211/task/42499/exe (readlink: Permission denied) 2024-09-21T05:55:49.645 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42499 mgr-fin ceph NOFD /proc/31211/task/42499/fd (opendir: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42500 mgr-fin ceph cwd unknown /proc/31211/task/42500/cwd (readlink: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42500 mgr-fin ceph rtd unknown /proc/31211/task/42500/root (readlink: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42500 mgr-fin ceph txt unknown /proc/31211/task/42500/exe (readlink: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42500 mgr-fin ceph NOFD /proc/31211/task/42500/fd (opendir: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42507 mgr-fin ceph cwd unknown /proc/31211/task/42507/cwd (readlink: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42507 mgr-fin ceph rtd unknown /proc/31211/task/42507/root (readlink: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42507 mgr-fin ceph txt unknown /proc/31211/task/42507/exe (readlink: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42507 mgr-fin ceph NOFD /proc/31211/task/42507/fd (opendir: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42508 mgr-fin ceph cwd unknown /proc/31211/task/42508/cwd (readlink: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42508 mgr-fin ceph rtd unknown /proc/31211/task/42508/root (readlink: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42508 mgr-fin ceph txt unknown /proc/31211/task/42508/exe (readlink: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42508 mgr-fin ceph NOFD /proc/31211/task/42508/fd (opendir: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42509 mgr-fin ceph cwd unknown /proc/31211/task/42509/cwd (readlink: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42509 mgr-fin ceph rtd unknown /proc/31211/task/42509/root (readlink: Permission denied) 2024-09-21T05:55:49.646 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42509 mgr-fin ceph txt unknown /proc/31211/task/42509/exe (readlink: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42509 mgr-fin ceph NOFD /proc/31211/task/42509/fd (opendir: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42579 mgr-fin ceph cwd unknown /proc/31211/task/42579/cwd (readlink: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42579 mgr-fin ceph rtd unknown /proc/31211/task/42579/root (readlink: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42579 mgr-fin ceph txt unknown /proc/31211/task/42579/exe (readlink: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42579 mgr-fin ceph NOFD /proc/31211/task/42579/fd (opendir: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42580 mgr-fin ceph cwd unknown /proc/31211/task/42580/cwd (readlink: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42580 mgr-fin ceph rtd unknown /proc/31211/task/42580/root (readlink: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42580 mgr-fin ceph txt unknown /proc/31211/task/42580/exe (readlink: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42580 mgr-fin ceph NOFD /proc/31211/task/42580/fd (opendir: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42581 mgr-fin ceph cwd unknown /proc/31211/task/42581/cwd (readlink: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42581 mgr-fin ceph rtd unknown /proc/31211/task/42581/root (readlink: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42581 mgr-fin ceph txt unknown /proc/31211/task/42581/exe (readlink: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42581 mgr-fin ceph NOFD /proc/31211/task/42581/fd (opendir: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42582 mgr-fin ceph cwd unknown /proc/31211/task/42582/cwd (readlink: Permission denied) 2024-09-21T05:55:49.647 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42582 mgr-fin ceph rtd unknown /proc/31211/task/42582/root (readlink: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42582 mgr-fin ceph txt unknown /proc/31211/task/42582/exe (readlink: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42582 mgr-fin ceph NOFD /proc/31211/task/42582/fd (opendir: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42583 mgr-fin ceph cwd unknown /proc/31211/task/42583/cwd (readlink: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42583 mgr-fin ceph rtd unknown /proc/31211/task/42583/root (readlink: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42583 mgr-fin ceph txt unknown /proc/31211/task/42583/exe (readlink: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42583 mgr-fin ceph NOFD /proc/31211/task/42583/fd (opendir: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42584 mgr-fin ceph cwd unknown /proc/31211/task/42584/cwd (readlink: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42584 mgr-fin ceph rtd unknown /proc/31211/task/42584/root (readlink: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42584 mgr-fin ceph txt unknown /proc/31211/task/42584/exe (readlink: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42584 mgr-fin ceph NOFD /proc/31211/task/42584/fd (opendir: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42586 mgr-fin ceph cwd unknown /proc/31211/task/42586/cwd (readlink: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42586 mgr-fin ceph rtd unknown /proc/31211/task/42586/root (readlink: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42586 mgr-fin ceph txt unknown /proc/31211/task/42586/exe (readlink: Permission denied) 2024-09-21T05:55:49.648 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42586 mgr-fin ceph NOFD /proc/31211/task/42586/fd (opendir: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42588 mgr-fin ceph cwd unknown /proc/31211/task/42588/cwd (readlink: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42588 mgr-fin ceph rtd unknown /proc/31211/task/42588/root (readlink: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42588 mgr-fin ceph txt unknown /proc/31211/task/42588/exe (readlink: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42588 mgr-fin ceph NOFD /proc/31211/task/42588/fd (opendir: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42589 mgr-fin ceph cwd unknown /proc/31211/task/42589/cwd (readlink: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42589 mgr-fin ceph rtd unknown /proc/31211/task/42589/root (readlink: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42589 mgr-fin ceph txt unknown /proc/31211/task/42589/exe (readlink: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42589 mgr-fin ceph NOFD /proc/31211/task/42589/fd (opendir: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42590 mgr-fin ceph cwd unknown /proc/31211/task/42590/cwd (readlink: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42590 mgr-fin ceph rtd unknown /proc/31211/task/42590/root (readlink: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42590 mgr-fin ceph txt unknown /proc/31211/task/42590/exe (readlink: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42590 mgr-fin ceph NOFD /proc/31211/task/42590/fd (opendir: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42591 mgr-fin ceph cwd unknown /proc/31211/task/42591/cwd (readlink: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42591 mgr-fin ceph rtd unknown /proc/31211/task/42591/root (readlink: Permission denied) 2024-09-21T05:55:49.649 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42591 mgr-fin ceph txt unknown /proc/31211/task/42591/exe (readlink: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 42591 mgr-fin ceph NOFD /proc/31211/task/42591/fd (opendir: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52779 devicehea ceph cwd unknown /proc/31211/task/52779/cwd (readlink: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52779 devicehea ceph rtd unknown /proc/31211/task/52779/root (readlink: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52779 devicehea ceph txt unknown /proc/31211/task/52779/exe (readlink: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52779 devicehea ceph NOFD /proc/31211/task/52779/fd (opendir: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52943 io_contex ceph cwd unknown /proc/31211/task/52943/cwd (readlink: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52943 io_contex ceph rtd unknown /proc/31211/task/52943/root (readlink: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52943 io_contex ceph txt unknown /proc/31211/task/52943/exe (readlink: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52943 io_contex ceph NOFD /proc/31211/task/52943/fd (opendir: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52944 io_contex ceph cwd unknown /proc/31211/task/52944/cwd (readlink: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52944 io_contex ceph rtd unknown /proc/31211/task/52944/root (readlink: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52944 io_contex ceph txt unknown /proc/31211/task/52944/exe (readlink: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52944 io_contex ceph NOFD /proc/31211/task/52944/fd (opendir: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52945 ceph_time ceph cwd unknown /proc/31211/task/52945/cwd (readlink: Permission denied) 2024-09-21T05:55:49.650 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52945 ceph_time ceph rtd unknown /proc/31211/task/52945/root (readlink: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52945 ceph_time ceph txt unknown /proc/31211/task/52945/exe (readlink: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52945 ceph_time ceph NOFD /proc/31211/task/52945/fd (opendir: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52946 ms_dispat ceph cwd unknown /proc/31211/task/52946/cwd (readlink: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52946 ms_dispat ceph rtd unknown /proc/31211/task/52946/root (readlink: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52946 ms_dispat ceph txt unknown /proc/31211/task/52946/exe (readlink: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52946 ms_dispat ceph NOFD /proc/31211/task/52946/fd (opendir: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52947 ms_local ceph cwd unknown /proc/31211/task/52947/cwd (readlink: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52947 ms_local ceph rtd unknown /proc/31211/task/52947/root (readlink: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52947 ms_local ceph txt unknown /proc/31211/task/52947/exe (readlink: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52947 ms_local ceph NOFD /proc/31211/task/52947/fd (opendir: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52948 safe_time ceph cwd unknown /proc/31211/task/52948/cwd (readlink: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52948 safe_time ceph rtd unknown /proc/31211/task/52948/root (readlink: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52948 safe_time ceph txt unknown /proc/31211/task/52948/exe (readlink: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52948 safe_time ceph NOFD /proc/31211/task/52948/fd (opendir: Permission denied) 2024-09-21T05:55:49.651 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52949 safe_time ceph cwd unknown /proc/31211/task/52949/cwd (readlink: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52949 safe_time ceph rtd unknown /proc/31211/task/52949/root (readlink: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52949 safe_time ceph txt unknown /proc/31211/task/52949/exe (readlink: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 52949 safe_time ceph NOFD /proc/31211/task/52949/fd (opendir: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84300 m-fin-sna ceph cwd unknown /proc/31211/task/84300/cwd (readlink: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84300 m-fin-sna ceph rtd unknown /proc/31211/task/84300/root (readlink: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84300 m-fin-sna ceph txt unknown /proc/31211/task/84300/exe (readlink: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84300 m-fin-sna ceph NOFD /proc/31211/task/84300/fd (opendir: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84304 io_contex ceph cwd unknown /proc/31211/task/84304/cwd (readlink: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84304 io_contex ceph rtd unknown /proc/31211/task/84304/root (readlink: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84304 io_contex ceph txt unknown /proc/31211/task/84304/exe (readlink: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84304 io_contex ceph NOFD /proc/31211/task/84304/fd (opendir: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84305 io_contex ceph cwd unknown /proc/31211/task/84305/cwd (readlink: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84305 io_contex ceph rtd unknown /proc/31211/task/84305/root (readlink: Permission denied) 2024-09-21T05:55:49.652 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84305 io_contex ceph txt unknown /proc/31211/task/84305/exe (readlink: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84305 io_contex ceph NOFD /proc/31211/task/84305/fd (opendir: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84306 ceph_time ceph cwd unknown /proc/31211/task/84306/cwd (readlink: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84306 ceph_time ceph rtd unknown /proc/31211/task/84306/root (readlink: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84306 ceph_time ceph txt unknown /proc/31211/task/84306/exe (readlink: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84306 ceph_time ceph NOFD /proc/31211/task/84306/fd (opendir: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84307 ms_dispat ceph cwd unknown /proc/31211/task/84307/cwd (readlink: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84307 ms_dispat ceph rtd unknown /proc/31211/task/84307/root (readlink: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84307 ms_dispat ceph txt unknown /proc/31211/task/84307/exe (readlink: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84307 ms_dispat ceph NOFD /proc/31211/task/84307/fd (opendir: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84308 ms_local ceph cwd unknown /proc/31211/task/84308/cwd (readlink: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84308 ms_local ceph rtd unknown /proc/31211/task/84308/root (readlink: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84308 ms_local ceph txt unknown /proc/31211/task/84308/exe (readlink: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84308 ms_local ceph NOFD /proc/31211/task/84308/fd (opendir: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84309 safe_time ceph cwd unknown /proc/31211/task/84309/cwd (readlink: Permission denied) 2024-09-21T05:55:49.653 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84309 safe_time ceph rtd unknown /proc/31211/task/84309/root (readlink: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84309 safe_time ceph txt unknown /proc/31211/task/84309/exe (readlink: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84309 safe_time ceph NOFD /proc/31211/task/84309/fd (opendir: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84310 safe_time ceph cwd unknown /proc/31211/task/84310/cwd (readlink: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84310 safe_time ceph rtd unknown /proc/31211/task/84310/root (readlink: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84310 safe_time ceph txt unknown /proc/31211/task/84310/exe (readlink: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 84310 safe_time ceph NOFD /proc/31211/task/84310/fd (opendir: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85173 io_contex ceph cwd unknown /proc/31211/task/85173/cwd (readlink: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85173 io_contex ceph rtd unknown /proc/31211/task/85173/root (readlink: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85173 io_contex ceph txt unknown /proc/31211/task/85173/exe (readlink: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85173 io_contex ceph NOFD /proc/31211/task/85173/fd (opendir: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85174 io_contex ceph cwd unknown /proc/31211/task/85174/cwd (readlink: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85174 io_contex ceph rtd unknown /proc/31211/task/85174/root (readlink: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85174 io_contex ceph txt unknown /proc/31211/task/85174/exe (readlink: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85174 io_contex ceph NOFD /proc/31211/task/85174/fd (opendir: Permission denied) 2024-09-21T05:55:49.654 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85178 ceph_time ceph cwd unknown /proc/31211/task/85178/cwd (readlink: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85178 ceph_time ceph rtd unknown /proc/31211/task/85178/root (readlink: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85178 ceph_time ceph txt unknown /proc/31211/task/85178/exe (readlink: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85178 ceph_time ceph NOFD /proc/31211/task/85178/fd (opendir: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85179 fn_anonym ceph cwd unknown /proc/31211/task/85179/cwd (readlink: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85179 fn_anonym ceph rtd unknown /proc/31211/task/85179/root (readlink: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85179 fn_anonym ceph txt unknown /proc/31211/task/85179/exe (readlink: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85179 fn_anonym ceph NOFD /proc/31211/task/85179/fd (opendir: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85180 safe_time ceph cwd unknown /proc/31211/task/85180/cwd (readlink: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85180 safe_time ceph rtd unknown /proc/31211/task/85180/root (readlink: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85180 safe_time ceph txt unknown /proc/31211/task/85180/exe (readlink: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85180 safe_time ceph NOFD /proc/31211/task/85180/fd (opendir: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85181 fn_anonym ceph cwd unknown /proc/31211/task/85181/cwd (readlink: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85181 fn_anonym ceph rtd unknown /proc/31211/task/85181/root (readlink: Permission denied) 2024-09-21T05:55:49.655 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85181 fn_anonym ceph txt unknown /proc/31211/task/85181/exe (readlink: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85181 fn_anonym ceph NOFD /proc/31211/task/85181/fd (opendir: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85182 flusher ceph cwd unknown /proc/31211/task/85182/cwd (readlink: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85182 flusher ceph rtd unknown /proc/31211/task/85182/root (readlink: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85182 flusher ceph txt unknown /proc/31211/task/85182/exe (readlink: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85182 flusher ceph NOFD /proc/31211/task/85182/fd (opendir: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85183 ms_dispat ceph cwd unknown /proc/31211/task/85183/cwd (readlink: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85183 ms_dispat ceph rtd unknown /proc/31211/task/85183/root (readlink: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85183 ms_dispat ceph txt unknown /proc/31211/task/85183/exe (readlink: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85183 ms_dispat ceph NOFD /proc/31211/task/85183/fd (opendir: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85184 ms_local ceph cwd unknown /proc/31211/task/85184/cwd (readlink: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85184 ms_local ceph rtd unknown /proc/31211/task/85184/root (readlink: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85184 ms_local ceph txt unknown /proc/31211/task/85184/exe (readlink: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85184 ms_local ceph NOFD /proc/31211/task/85184/fd (opendir: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85185 safe_time ceph cwd unknown /proc/31211/task/85185/cwd (readlink: Permission denied) 2024-09-21T05:55:49.656 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85185 safe_time ceph rtd unknown /proc/31211/task/85185/root (readlink: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85185 safe_time ceph txt unknown /proc/31211/task/85185/exe (readlink: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85185 safe_time ceph NOFD /proc/31211/task/85185/fd (opendir: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85186 m-fin-sna ceph cwd unknown /proc/31211/task/85186/cwd (readlink: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85186 m-fin-sna ceph rtd unknown /proc/31211/task/85186/root (readlink: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85186 m-fin-sna ceph txt unknown /proc/31211/task/85186/exe (readlink: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 85186 m-fin-sna ceph NOFD /proc/31211/task/85186/fd (opendir: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 86811 m-fin-sna ceph cwd unknown /proc/31211/task/86811/cwd (readlink: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 86811 m-fin-sna ceph rtd unknown /proc/31211/task/86811/root (readlink: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 86811 m-fin-sna ceph txt unknown /proc/31211/task/86811/exe (readlink: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31211 86811 m-fin-sna ceph NOFD /proc/31211/task/86811/fd (opendir: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 31311 root cwd unknown /proc/31311/cwd (readlink: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 31311 root rtd unknown /proc/31311/root (readlink: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 31311 root txt unknown /proc/31311/exe (readlink: Permission denied) 2024-09-21T05:55:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 31311 root NOFD /proc/31311/fd (opendir: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 32242 root cwd unknown /proc/32242/cwd (readlink: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 32242 root rtd unknown /proc/32242/root (readlink: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 32242 root txt unknown /proc/32242/exe (readlink: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 32242 root NOFD /proc/32242/fd (opendir: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 32244 root cwd unknown /proc/32244/cwd (readlink: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 32244 root rtd unknown /proc/32244/root (readlink: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 32244 root txt unknown /proc/32244/exe (readlink: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 32244 root NOFD /proc/32244/fd (opendir: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 39896 root cwd unknown /proc/39896/cwd (readlink: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 39896 root rtd unknown /proc/39896/root (readlink: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 39896 root txt unknown /proc/39896/exe (readlink: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 39896 root NOFD /proc/39896/fd (opendir: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 41057 root cwd unknown /proc/41057/cwd (readlink: Permission denied) 2024-09-21T05:55:49.658 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 41057 root rtd unknown /proc/41057/root (readlink: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 41057 root txt unknown /proc/41057/exe (readlink: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 41057 root NOFD /proc/41057/fd (opendir: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 41060 root cwd unknown /proc/41060/cwd (readlink: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 41060 root rtd unknown /proc/41060/root (readlink: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 41060 root txt unknown /proc/41060/exe (readlink: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 41060 root NOFD /proc/41060/fd (opendir: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 43208 root cwd unknown /proc/43208/cwd (readlink: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 43208 root rtd unknown /proc/43208/root (readlink: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 43208 root txt unknown /proc/43208/exe (readlink: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 43208 root NOFD /proc/43208/fd (opendir: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 43594 root cwd unknown /proc/43594/cwd (readlink: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 43594 root rtd unknown /proc/43594/root (readlink: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 43594 root txt unknown /proc/43594/exe (readlink: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 43594 root NOFD /proc/43594/fd (opendir: Permission denied) 2024-09-21T05:55:49.659 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 45682 root cwd unknown /proc/45682/cwd (readlink: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 45682 root rtd unknown /proc/45682/root (readlink: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 45682 root txt unknown /proc/45682/exe (readlink: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 45682 root NOFD /proc/45682/fd (opendir: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 47922 root cwd unknown /proc/47922/cwd (readlink: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 47922 root rtd unknown /proc/47922/root (readlink: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 47922 root txt unknown /proc/47922/exe (readlink: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 47922 root NOFD /proc/47922/fd (opendir: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 47924 root cwd unknown /proc/47924/cwd (readlink: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 47924 root rtd unknown /proc/47924/root (readlink: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 47924 root txt unknown /proc/47924/exe (readlink: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 47924 root NOFD /proc/47924/fd (opendir: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 ceph cwd unknown /proc/47926/cwd (readlink: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 ceph rtd unknown /proc/47926/root (readlink: Permission denied) 2024-09-21T05:55:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 ceph txt unknown /proc/47926/exe (readlink: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 ceph NOFD /proc/47926/fd (opendir: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47927 log ceph cwd unknown /proc/47926/task/47927/cwd (readlink: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47927 log ceph rtd unknown /proc/47926/task/47927/root (readlink: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47927 log ceph txt unknown /proc/47926/task/47927/exe (readlink: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47927 log ceph NOFD /proc/47926/task/47927/fd (opendir: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47929 msgr-work ceph cwd unknown /proc/47926/task/47929/cwd (readlink: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47929 msgr-work ceph rtd unknown /proc/47926/task/47929/root (readlink: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47929 msgr-work ceph txt unknown /proc/47926/task/47929/exe (readlink: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47929 msgr-work ceph NOFD /proc/47926/task/47929/fd (opendir: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47930 msgr-work ceph cwd unknown /proc/47926/task/47930/cwd (readlink: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47930 msgr-work ceph rtd unknown /proc/47926/task/47930/root (readlink: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47930 msgr-work ceph txt unknown /proc/47926/task/47930/exe (readlink: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47930 msgr-work ceph NOFD /proc/47926/task/47930/fd (opendir: Permission denied) 2024-09-21T05:55:49.661 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47931 msgr-work ceph cwd unknown /proc/47926/task/47931/cwd (readlink: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47931 msgr-work ceph rtd unknown /proc/47926/task/47931/root (readlink: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47931 msgr-work ceph txt unknown /proc/47926/task/47931/exe (readlink: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47931 msgr-work ceph NOFD /proc/47926/task/47931/fd (opendir: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47935 service ceph cwd unknown /proc/47926/task/47935/cwd (readlink: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47935 service ceph rtd unknown /proc/47926/task/47935/root (readlink: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47935 service ceph txt unknown /proc/47926/task/47935/exe (readlink: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47935 service ceph NOFD /proc/47926/task/47935/fd (opendir: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47936 admin_soc ceph cwd unknown /proc/47926/task/47936/cwd (readlink: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47936 admin_soc ceph rtd unknown /proc/47926/task/47936/root (readlink: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47936 admin_soc ceph txt unknown /proc/47926/task/47936/exe (readlink: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 47936 admin_soc ceph NOFD /proc/47926/task/47936/fd (opendir: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48223 signal_ha ceph cwd unknown /proc/47926/task/48223/cwd (readlink: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48223 signal_ha ceph rtd unknown /proc/47926/task/48223/root (readlink: Permission denied) 2024-09-21T05:55:49.662 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48223 signal_ha ceph txt unknown /proc/47926/task/48223/exe (readlink: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48223 signal_ha ceph NOFD /proc/47926/task/48223/fd (opendir: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48224 io_contex ceph cwd unknown /proc/47926/task/48224/cwd (readlink: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48224 io_contex ceph rtd unknown /proc/47926/task/48224/root (readlink: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48224 io_contex ceph txt unknown /proc/47926/task/48224/exe (readlink: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48224 io_contex ceph NOFD /proc/47926/task/48224/fd (opendir: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48225 io_contex ceph cwd unknown /proc/47926/task/48225/cwd (readlink: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48225 io_contex ceph rtd unknown /proc/47926/task/48225/root (readlink: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48225 io_contex ceph txt unknown /proc/47926/task/48225/exe (readlink: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48225 io_contex ceph NOFD /proc/47926/task/48225/fd (opendir: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48241 OpHistory ceph cwd unknown /proc/47926/task/48241/cwd (readlink: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48241 OpHistory ceph rtd unknown /proc/47926/task/48241/root (readlink: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48241 OpHistory ceph txt unknown /proc/47926/task/48241/exe (readlink: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48241 OpHistory ceph NOFD /proc/47926/task/48241/fd (opendir: Permission denied) 2024-09-21T05:55:49.663 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48242 ceph_time ceph cwd unknown /proc/47926/task/48242/cwd (readlink: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48242 ceph_time ceph rtd unknown /proc/47926/task/48242/root (readlink: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48242 ceph_time ceph txt unknown /proc/47926/task/48242/exe (readlink: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48242 ceph_time ceph NOFD /proc/47926/task/48242/fd (opendir: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48285 ceph-osd ceph cwd unknown /proc/47926/task/48285/cwd (readlink: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48285 ceph-osd ceph rtd unknown /proc/47926/task/48285/root (readlink: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48285 ceph-osd ceph txt unknown /proc/47926/task/48285/exe (readlink: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48285 ceph-osd ceph NOFD /proc/47926/task/48285/fd (opendir: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48296 ceph-osd ceph cwd unknown /proc/47926/task/48296/cwd (readlink: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48296 ceph-osd ceph rtd unknown /proc/47926/task/48296/root (readlink: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48296 ceph-osd ceph txt unknown /proc/47926/task/48296/exe (readlink: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48296 ceph-osd ceph NOFD /proc/47926/task/48296/fd (opendir: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48313 ceph-osd ceph cwd unknown /proc/47926/task/48313/cwd (readlink: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48313 ceph-osd ceph rtd unknown /proc/47926/task/48313/root (readlink: Permission denied) 2024-09-21T05:55:49.664 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48313 ceph-osd ceph txt unknown /proc/47926/task/48313/exe (readlink: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48313 ceph-osd ceph NOFD /proc/47926/task/48313/fd (opendir: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48323 ceph-osd ceph cwd unknown /proc/47926/task/48323/cwd (readlink: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48323 ceph-osd ceph rtd unknown /proc/47926/task/48323/root (readlink: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48323 ceph-osd ceph txt unknown /proc/47926/task/48323/exe (readlink: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48323 ceph-osd ceph NOFD /proc/47926/task/48323/fd (opendir: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48331 ceph-osd ceph cwd unknown /proc/47926/task/48331/cwd (readlink: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48331 ceph-osd ceph rtd unknown /proc/47926/task/48331/root (readlink: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48331 ceph-osd ceph txt unknown /proc/47926/task/48331/exe (readlink: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48331 ceph-osd ceph NOFD /proc/47926/task/48331/fd (opendir: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48336 ceph-osd ceph cwd unknown /proc/47926/task/48336/cwd (readlink: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48336 ceph-osd ceph rtd unknown /proc/47926/task/48336/root (readlink: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48336 ceph-osd ceph txt unknown /proc/47926/task/48336/exe (readlink: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48336 ceph-osd ceph NOFD /proc/47926/task/48336/fd (opendir: Permission denied) 2024-09-21T05:55:49.665 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48356 ceph-osd ceph cwd unknown /proc/47926/task/48356/cwd (readlink: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48356 ceph-osd ceph rtd unknown /proc/47926/task/48356/root (readlink: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48356 ceph-osd ceph txt unknown /proc/47926/task/48356/exe (readlink: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48356 ceph-osd ceph NOFD /proc/47926/task/48356/fd (opendir: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48363 ceph-osd ceph cwd unknown /proc/47926/task/48363/cwd (readlink: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48363 ceph-osd ceph rtd unknown /proc/47926/task/48363/root (readlink: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48363 ceph-osd ceph txt unknown /proc/47926/task/48363/exe (readlink: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48363 ceph-osd ceph NOFD /proc/47926/task/48363/fd (opendir: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48364 ceph-osd ceph cwd unknown /proc/47926/task/48364/cwd (readlink: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48364 ceph-osd ceph rtd unknown /proc/47926/task/48364/root (readlink: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48364 ceph-osd ceph txt unknown /proc/47926/task/48364/exe (readlink: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48364 ceph-osd ceph NOFD /proc/47926/task/48364/fd (opendir: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48365 safe_time ceph cwd unknown /proc/47926/task/48365/cwd (readlink: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48365 safe_time ceph rtd unknown /proc/47926/task/48365/root (readlink: Permission denied) 2024-09-21T05:55:49.666 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48365 safe_time ceph txt unknown /proc/47926/task/48365/exe (readlink: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48365 safe_time ceph NOFD /proc/47926/task/48365/fd (opendir: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48366 safe_time ceph cwd unknown /proc/47926/task/48366/cwd (readlink: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48366 safe_time ceph rtd unknown /proc/47926/task/48366/root (readlink: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48366 safe_time ceph txt unknown /proc/47926/task/48366/exe (readlink: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48366 safe_time ceph NOFD /proc/47926/task/48366/fd (opendir: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48367 safe_time ceph cwd unknown /proc/47926/task/48367/cwd (readlink: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48367 safe_time ceph rtd unknown /proc/47926/task/48367/root (readlink: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48367 safe_time ceph txt unknown /proc/47926/task/48367/exe (readlink: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48367 safe_time ceph NOFD /proc/47926/task/48367/fd (opendir: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48368 safe_time ceph cwd unknown /proc/47926/task/48368/cwd (readlink: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48368 safe_time ceph rtd unknown /proc/47926/task/48368/root (readlink: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48368 safe_time ceph txt unknown /proc/47926/task/48368/exe (readlink: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48368 safe_time ceph NOFD /proc/47926/task/48368/fd (opendir: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48369 fn_anonym ceph cwd unknown /proc/47926/task/48369/cwd (readlink: Permission denied) 2024-09-21T05:55:49.667 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48369 fn_anonym ceph rtd unknown /proc/47926/task/48369/root (readlink: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48369 fn_anonym ceph txt unknown /proc/47926/task/48369/exe (readlink: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48369 fn_anonym ceph NOFD /proc/47926/task/48369/fd (opendir: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48464 rocksdb:l ceph cwd unknown /proc/47926/task/48464/cwd (readlink: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48464 rocksdb:l ceph rtd unknown /proc/47926/task/48464/root (readlink: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48464 rocksdb:l ceph txt unknown /proc/47926/task/48464/exe (readlink: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48464 rocksdb:l ceph NOFD /proc/47926/task/48464/fd (opendir: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48465 rocksdb:l ceph cwd unknown /proc/47926/task/48465/cwd (readlink: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48465 rocksdb:l ceph rtd unknown /proc/47926/task/48465/root (readlink: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48465 rocksdb:l ceph txt unknown /proc/47926/task/48465/exe (readlink: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48465 rocksdb:l ceph NOFD /proc/47926/task/48465/fd (opendir: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48466 rocksdb:l ceph cwd unknown /proc/47926/task/48466/cwd (readlink: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48466 rocksdb:l ceph rtd unknown /proc/47926/task/48466/root (readlink: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48466 rocksdb:l ceph txt unknown /proc/47926/task/48466/exe (readlink: Permission denied) 2024-09-21T05:55:49.668 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48466 rocksdb:l ceph NOFD /proc/47926/task/48466/fd (opendir: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48467 rocksdb:h ceph cwd unknown /proc/47926/task/48467/cwd (readlink: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48467 rocksdb:h ceph rtd unknown /proc/47926/task/48467/root (readlink: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48467 rocksdb:h ceph txt unknown /proc/47926/task/48467/exe (readlink: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48467 rocksdb:h ceph NOFD /proc/47926/task/48467/fd (opendir: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48886 bstore_ai ceph cwd unknown /proc/47926/task/48886/cwd (readlink: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48886 bstore_ai ceph rtd unknown /proc/47926/task/48886/root (readlink: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48886 bstore_ai ceph txt unknown /proc/47926/task/48886/exe (readlink: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 48886 bstore_ai ceph NOFD /proc/47926/task/48886/fd (opendir: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49073 bstore_ai ceph cwd unknown /proc/47926/task/49073/cwd (readlink: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49073 bstore_ai ceph rtd unknown /proc/47926/task/49073/root (readlink: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49073 bstore_ai ceph txt unknown /proc/47926/task/49073/exe (readlink: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49073 bstore_ai ceph NOFD /proc/47926/task/49073/fd (opendir: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49255 ceph-osd ceph cwd unknown /proc/47926/task/49255/cwd (readlink: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49255 ceph-osd ceph rtd unknown /proc/47926/task/49255/root (readlink: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49255 ceph-osd ceph txt unknown /proc/47926/task/49255/exe (readlink: Permission denied) 2024-09-21T05:55:49.669 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49255 ceph-osd ceph NOFD /proc/47926/task/49255/fd (opendir: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49256 cfin ceph cwd unknown /proc/47926/task/49256/cwd (readlink: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49256 cfin ceph rtd unknown /proc/47926/task/49256/root (readlink: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49256 cfin ceph txt unknown /proc/47926/task/49256/exe (readlink: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49256 cfin ceph NOFD /proc/47926/task/49256/fd (opendir: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49257 bstore_kv ceph cwd unknown /proc/47926/task/49257/cwd (readlink: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49257 bstore_kv ceph rtd unknown /proc/47926/task/49257/root (readlink: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49257 bstore_kv ceph txt unknown /proc/47926/task/49257/exe (readlink: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49257 bstore_kv ceph NOFD /proc/47926/task/49257/fd (opendir: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49258 bstore_kv ceph cwd unknown /proc/47926/task/49258/cwd (readlink: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49258 bstore_kv ceph rtd unknown /proc/47926/task/49258/root (readlink: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49258 bstore_kv ceph txt unknown /proc/47926/task/49258/exe (readlink: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49258 bstore_kv ceph NOFD /proc/47926/task/49258/fd (opendir: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49259 bstore_me ceph cwd unknown /proc/47926/task/49259/cwd (readlink: Permission denied) 2024-09-21T05:55:49.670 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49259 bstore_me ceph rtd unknown /proc/47926/task/49259/root (readlink: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49259 bstore_me ceph txt unknown /proc/47926/task/49259/exe (readlink: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49259 bstore_me ceph NOFD /proc/47926/task/49259/fd (opendir: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49260 ms_dispat ceph cwd unknown /proc/47926/task/49260/cwd (readlink: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49260 ms_dispat ceph rtd unknown /proc/47926/task/49260/root (readlink: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49260 ms_dispat ceph txt unknown /proc/47926/task/49260/exe (readlink: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49260 ms_dispat ceph NOFD /proc/47926/task/49260/fd (opendir: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49261 ms_local ceph cwd unknown /proc/47926/task/49261/cwd (readlink: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49261 ms_local ceph rtd unknown /proc/47926/task/49261/root (readlink: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49261 ms_local ceph txt unknown /proc/47926/task/49261/exe (readlink: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49261 ms_local ceph NOFD /proc/47926/task/49261/fd (opendir: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49262 safe_time ceph cwd unknown /proc/47926/task/49262/cwd (readlink: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49262 safe_time ceph rtd unknown /proc/47926/task/49262/root (readlink: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49262 safe_time ceph txt unknown /proc/47926/task/49262/exe (readlink: Permission denied) 2024-09-21T05:55:49.671 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49262 safe_time ceph NOFD /proc/47926/task/49262/fd (opendir: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49263 safe_time ceph cwd unknown /proc/47926/task/49263/cwd (readlink: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49263 safe_time ceph rtd unknown /proc/47926/task/49263/root (readlink: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49263 safe_time ceph txt unknown /proc/47926/task/49263/exe (readlink: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49263 safe_time ceph NOFD /proc/47926/task/49263/fd (opendir: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49264 ms_dispat ceph cwd unknown /proc/47926/task/49264/cwd (readlink: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49264 ms_dispat ceph rtd unknown /proc/47926/task/49264/root (readlink: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49264 ms_dispat ceph txt unknown /proc/47926/task/49264/exe (readlink: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49264 ms_dispat ceph NOFD /proc/47926/task/49264/fd (opendir: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49265 ms_local ceph cwd unknown /proc/47926/task/49265/cwd (readlink: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49265 ms_local ceph rtd unknown /proc/47926/task/49265/root (readlink: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49265 ms_local ceph txt unknown /proc/47926/task/49265/exe (readlink: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49265 ms_local ceph NOFD /proc/47926/task/49265/fd (opendir: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49266 ms_dispat ceph cwd unknown /proc/47926/task/49266/cwd (readlink: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49266 ms_dispat ceph rtd unknown /proc/47926/task/49266/root (readlink: Permission denied) 2024-09-21T05:55:49.672 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49266 ms_dispat ceph txt unknown /proc/47926/task/49266/exe (readlink: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49266 ms_dispat ceph NOFD /proc/47926/task/49266/fd (opendir: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49267 ms_local ceph cwd unknown /proc/47926/task/49267/cwd (readlink: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49267 ms_local ceph rtd unknown /proc/47926/task/49267/root (readlink: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49267 ms_local ceph txt unknown /proc/47926/task/49267/exe (readlink: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49267 ms_local ceph NOFD /proc/47926/task/49267/fd (opendir: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49268 ms_dispat ceph cwd unknown /proc/47926/task/49268/cwd (readlink: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49268 ms_dispat ceph rtd unknown /proc/47926/task/49268/root (readlink: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49268 ms_dispat ceph txt unknown /proc/47926/task/49268/exe (readlink: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49268 ms_dispat ceph NOFD /proc/47926/task/49268/fd (opendir: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49269 ms_local ceph cwd unknown /proc/47926/task/49269/cwd (readlink: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49269 ms_local ceph rtd unknown /proc/47926/task/49269/root (readlink: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49269 ms_local ceph txt unknown /proc/47926/task/49269/exe (readlink: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49269 ms_local ceph NOFD /proc/47926/task/49269/fd (opendir: Permission denied) 2024-09-21T05:55:49.673 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49270 ms_dispat ceph cwd unknown /proc/47926/task/49270/cwd (readlink: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49270 ms_dispat ceph rtd unknown /proc/47926/task/49270/root (readlink: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49270 ms_dispat ceph txt unknown /proc/47926/task/49270/exe (readlink: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49270 ms_dispat ceph NOFD /proc/47926/task/49270/fd (opendir: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49271 ms_local ceph cwd unknown /proc/47926/task/49271/cwd (readlink: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49271 ms_local ceph rtd unknown /proc/47926/task/49271/root (readlink: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49271 ms_local ceph txt unknown /proc/47926/task/49271/exe (readlink: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49271 ms_local ceph NOFD /proc/47926/task/49271/fd (opendir: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49272 ms_dispat ceph cwd unknown /proc/47926/task/49272/cwd (readlink: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49272 ms_dispat ceph rtd unknown /proc/47926/task/49272/root (readlink: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49272 ms_dispat ceph txt unknown /proc/47926/task/49272/exe (readlink: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49272 ms_dispat ceph NOFD /proc/47926/task/49272/fd (opendir: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49273 ms_local ceph cwd unknown /proc/47926/task/49273/cwd (readlink: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49273 ms_local ceph rtd unknown /proc/47926/task/49273/root (readlink: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49273 ms_local ceph txt unknown /proc/47926/task/49273/exe (readlink: Permission denied) 2024-09-21T05:55:49.674 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49273 ms_local ceph NOFD /proc/47926/task/49273/fd (opendir: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49274 ms_dispat ceph cwd unknown /proc/47926/task/49274/cwd (readlink: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49274 ms_dispat ceph rtd unknown /proc/47926/task/49274/root (readlink: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49274 ms_dispat ceph txt unknown /proc/47926/task/49274/exe (readlink: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49274 ms_dispat ceph NOFD /proc/47926/task/49274/fd (opendir: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49275 ms_local ceph cwd unknown /proc/47926/task/49275/cwd (readlink: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49275 ms_local ceph rtd unknown /proc/47926/task/49275/root (readlink: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49275 ms_local ceph txt unknown /proc/47926/task/49275/exe (readlink: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49275 ms_local ceph NOFD /proc/47926/task/49275/fd (opendir: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49276 fn_anonym ceph cwd unknown /proc/47926/task/49276/cwd (readlink: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49276 fn_anonym ceph rtd unknown /proc/47926/task/49276/root (readlink: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49276 fn_anonym ceph txt unknown /proc/47926/task/49276/exe (readlink: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49276 fn_anonym ceph NOFD /proc/47926/task/49276/fd (opendir: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49277 finisher ceph cwd unknown /proc/47926/task/49277/cwd (readlink: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49277 finisher ceph rtd unknown /proc/47926/task/49277/root (readlink: Permission denied) 2024-09-21T05:55:49.675 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49277 finisher ceph txt unknown /proc/47926/task/49277/exe (readlink: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49277 finisher ceph NOFD /proc/47926/task/49277/fd (opendir: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49278 safe_time ceph cwd unknown /proc/47926/task/49278/cwd (readlink: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49278 safe_time ceph rtd unknown /proc/47926/task/49278/root (readlink: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49278 safe_time ceph txt unknown /proc/47926/task/49278/exe (readlink: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49278 safe_time ceph NOFD /proc/47926/task/49278/fd (opendir: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49279 safe_time ceph cwd unknown /proc/47926/task/49279/cwd (readlink: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49279 safe_time ceph rtd unknown /proc/47926/task/49279/root (readlink: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49279 safe_time ceph txt unknown /proc/47926/task/49279/exe (readlink: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49279 safe_time ceph NOFD /proc/47926/task/49279/fd (opendir: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49280 ceph-osd ceph cwd unknown /proc/47926/task/49280/cwd (readlink: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49280 ceph-osd ceph rtd unknown /proc/47926/task/49280/root (readlink: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49280 ceph-osd ceph txt unknown /proc/47926/task/49280/exe (readlink: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49280 ceph-osd ceph NOFD /proc/47926/task/49280/fd (opendir: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49281 osd_srv_a ceph cwd unknown /proc/47926/task/49281/cwd (readlink: Permission denied) 2024-09-21T05:55:49.676 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49281 osd_srv_a ceph rtd unknown /proc/47926/task/49281/root (readlink: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49281 osd_srv_a ceph txt unknown /proc/47926/task/49281/exe (readlink: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49281 osd_srv_a ceph NOFD /proc/47926/task/49281/fd (opendir: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49282 tp_osd_tp ceph cwd unknown /proc/47926/task/49282/cwd (readlink: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49282 tp_osd_tp ceph rtd unknown /proc/47926/task/49282/root (readlink: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49282 tp_osd_tp ceph txt unknown /proc/47926/task/49282/exe (readlink: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49282 tp_osd_tp ceph NOFD /proc/47926/task/49282/fd (opendir: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49283 tp_osd_tp ceph cwd unknown /proc/47926/task/49283/cwd (readlink: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49283 tp_osd_tp ceph rtd unknown /proc/47926/task/49283/root (readlink: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49283 tp_osd_tp ceph txt unknown /proc/47926/task/49283/exe (readlink: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49283 tp_osd_tp ceph NOFD /proc/47926/task/49283/fd (opendir: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49284 tp_osd_tp ceph cwd unknown /proc/47926/task/49284/cwd (readlink: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49284 tp_osd_tp ceph rtd unknown /proc/47926/task/49284/root (readlink: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49284 tp_osd_tp ceph txt unknown /proc/47926/task/49284/exe (readlink: Permission denied) 2024-09-21T05:55:49.677 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49284 tp_osd_tp ceph NOFD /proc/47926/task/49284/fd (opendir: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49285 tp_osd_tp ceph cwd unknown /proc/47926/task/49285/cwd (readlink: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49285 tp_osd_tp ceph rtd unknown /proc/47926/task/49285/root (readlink: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49285 tp_osd_tp ceph txt unknown /proc/47926/task/49285/exe (readlink: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49285 tp_osd_tp ceph NOFD /proc/47926/task/49285/fd (opendir: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49286 tp_osd_tp ceph cwd unknown /proc/47926/task/49286/cwd (readlink: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49286 tp_osd_tp ceph rtd unknown /proc/47926/task/49286/root (readlink: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49286 tp_osd_tp ceph txt unknown /proc/47926/task/49286/exe (readlink: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49286 tp_osd_tp ceph NOFD /proc/47926/task/49286/fd (opendir: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49287 tp_osd_tp ceph cwd unknown /proc/47926/task/49287/cwd (readlink: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49287 tp_osd_tp ceph rtd unknown /proc/47926/task/49287/root (readlink: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49287 tp_osd_tp ceph txt unknown /proc/47926/task/49287/exe (readlink: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49287 tp_osd_tp ceph NOFD /proc/47926/task/49287/fd (opendir: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49288 tp_osd_tp ceph cwd unknown /proc/47926/task/49288/cwd (readlink: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49288 tp_osd_tp ceph rtd unknown /proc/47926/task/49288/root (readlink: Permission denied) 2024-09-21T05:55:49.678 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49288 tp_osd_tp ceph txt unknown /proc/47926/task/49288/exe (readlink: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49288 tp_osd_tp ceph NOFD /proc/47926/task/49288/fd (opendir: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49289 tp_osd_tp ceph cwd unknown /proc/47926/task/49289/cwd (readlink: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49289 tp_osd_tp ceph rtd unknown /proc/47926/task/49289/root (readlink: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49289 tp_osd_tp ceph txt unknown /proc/47926/task/49289/exe (readlink: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49289 tp_osd_tp ceph NOFD /proc/47926/task/49289/fd (opendir: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49290 tp_osd_tp ceph cwd unknown /proc/47926/task/49290/cwd (readlink: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49290 tp_osd_tp ceph rtd unknown /proc/47926/task/49290/root (readlink: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49290 tp_osd_tp ceph txt unknown /proc/47926/task/49290/exe (readlink: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49290 tp_osd_tp ceph NOFD /proc/47926/task/49290/fd (opendir: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49291 tp_osd_tp ceph cwd unknown /proc/47926/task/49291/cwd (readlink: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49291 tp_osd_tp ceph rtd unknown /proc/47926/task/49291/root (readlink: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49291 tp_osd_tp ceph txt unknown /proc/47926/task/49291/exe (readlink: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49291 tp_osd_tp ceph NOFD /proc/47926/task/49291/fd (opendir: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49292 tp_osd_tp ceph cwd unknown /proc/47926/task/49292/cwd (readlink: Permission denied) 2024-09-21T05:55:49.679 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49292 tp_osd_tp ceph rtd unknown /proc/47926/task/49292/root (readlink: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49292 tp_osd_tp ceph txt unknown /proc/47926/task/49292/exe (readlink: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49292 tp_osd_tp ceph NOFD /proc/47926/task/49292/fd (opendir: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49293 tp_osd_tp ceph cwd unknown /proc/47926/task/49293/cwd (readlink: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49293 tp_osd_tp ceph rtd unknown /proc/47926/task/49293/root (readlink: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49293 tp_osd_tp ceph txt unknown /proc/47926/task/49293/exe (readlink: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49293 tp_osd_tp ceph NOFD /proc/47926/task/49293/fd (opendir: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49294 tp_osd_tp ceph cwd unknown /proc/47926/task/49294/cwd (readlink: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49294 tp_osd_tp ceph rtd unknown /proc/47926/task/49294/root (readlink: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49294 tp_osd_tp ceph txt unknown /proc/47926/task/49294/exe (readlink: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49294 tp_osd_tp ceph NOFD /proc/47926/task/49294/fd (opendir: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49295 tp_osd_tp ceph cwd unknown /proc/47926/task/49295/cwd (readlink: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49295 tp_osd_tp ceph rtd unknown /proc/47926/task/49295/root (readlink: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49295 tp_osd_tp ceph txt unknown /proc/47926/task/49295/exe (readlink: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49295 tp_osd_tp ceph NOFD /proc/47926/task/49295/fd (opendir: Permission denied) 2024-09-21T05:55:49.680 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49296 tp_osd_tp ceph cwd unknown /proc/47926/task/49296/cwd (readlink: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49296 tp_osd_tp ceph rtd unknown /proc/47926/task/49296/root (readlink: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49296 tp_osd_tp ceph txt unknown /proc/47926/task/49296/exe (readlink: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49296 tp_osd_tp ceph NOFD /proc/47926/task/49296/fd (opendir: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49297 tp_osd_tp ceph cwd unknown /proc/47926/task/49297/cwd (readlink: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49297 tp_osd_tp ceph rtd unknown /proc/47926/task/49297/root (readlink: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49297 tp_osd_tp ceph txt unknown /proc/47926/task/49297/exe (readlink: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49297 tp_osd_tp ceph NOFD /proc/47926/task/49297/fd (opendir: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49298 osd_srv_h ceph cwd unknown /proc/47926/task/49298/cwd (readlink: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49298 osd_srv_h ceph rtd unknown /proc/47926/task/49298/root (readlink: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49298 osd_srv_h ceph txt unknown /proc/47926/task/49298/exe (readlink: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 47926 49298 osd_srv_h ceph NOFD /proc/47926/task/49298/fd (opendir: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 48649 root cwd unknown /proc/48649/cwd (readlink: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 48649 root rtd unknown /proc/48649/root (readlink: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 48649 root txt unknown /proc/48649/exe (readlink: Permission denied) 2024-09-21T05:55:49.681 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 48649 root NOFD /proc/48649/fd (opendir: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 48666 root cwd unknown /proc/48666/cwd (readlink: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 48666 root rtd unknown /proc/48666/root (readlink: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 48666 root txt unknown /proc/48666/exe (readlink: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 48666 root NOFD /proc/48666/fd (opendir: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 51946 root cwd unknown /proc/51946/cwd (readlink: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 51946 root rtd unknown /proc/51946/root (readlink: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 51946 root txt unknown /proc/51946/exe (readlink: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 51946 root NOFD /proc/51946/fd (opendir: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 54478 root cwd unknown /proc/54478/cwd (readlink: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 54478 root rtd unknown /proc/54478/root (readlink: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 54478 root txt unknown /proc/54478/exe (readlink: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 54478 root NOFD /proc/54478/fd (opendir: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 54480 root cwd unknown /proc/54480/cwd (readlink: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 54480 root rtd unknown /proc/54480/root (readlink: Permission denied) 2024-09-21T05:55:49.682 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 54480 root txt unknown /proc/54480/exe (readlink: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 54480 root NOFD /proc/54480/fd (opendir: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 ceph cwd unknown /proc/54482/cwd (readlink: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 ceph rtd unknown /proc/54482/root (readlink: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 ceph txt unknown /proc/54482/exe (readlink: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 ceph NOFD /proc/54482/fd (opendir: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54483 log ceph cwd unknown /proc/54482/task/54483/cwd (readlink: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54483 log ceph rtd unknown /proc/54482/task/54483/root (readlink: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54483 log ceph txt unknown /proc/54482/task/54483/exe (readlink: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54483 log ceph NOFD /proc/54482/task/54483/fd (opendir: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54485 msgr-work ceph cwd unknown /proc/54482/task/54485/cwd (readlink: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54485 msgr-work ceph rtd unknown /proc/54482/task/54485/root (readlink: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54485 msgr-work ceph txt unknown /proc/54482/task/54485/exe (readlink: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54485 msgr-work ceph NOFD /proc/54482/task/54485/fd (opendir: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54486 msgr-work ceph cwd unknown /proc/54482/task/54486/cwd (readlink: Permission denied) 2024-09-21T05:55:49.683 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54486 msgr-work ceph rtd unknown /proc/54482/task/54486/root (readlink: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54486 msgr-work ceph txt unknown /proc/54482/task/54486/exe (readlink: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54486 msgr-work ceph NOFD /proc/54482/task/54486/fd (opendir: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54487 msgr-work ceph cwd unknown /proc/54482/task/54487/cwd (readlink: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54487 msgr-work ceph rtd unknown /proc/54482/task/54487/root (readlink: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54487 msgr-work ceph txt unknown /proc/54482/task/54487/exe (readlink: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54487 msgr-work ceph NOFD /proc/54482/task/54487/fd (opendir: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54491 service ceph cwd unknown /proc/54482/task/54491/cwd (readlink: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54491 service ceph rtd unknown /proc/54482/task/54491/root (readlink: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54491 service ceph txt unknown /proc/54482/task/54491/exe (readlink: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54491 service ceph NOFD /proc/54482/task/54491/fd (opendir: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54492 admin_soc ceph cwd unknown /proc/54482/task/54492/cwd (readlink: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54492 admin_soc ceph rtd unknown /proc/54482/task/54492/root (readlink: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54492 admin_soc ceph txt unknown /proc/54482/task/54492/exe (readlink: Permission denied) 2024-09-21T05:55:49.684 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54492 admin_soc ceph NOFD /proc/54482/task/54492/fd (opendir: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54775 signal_ha ceph cwd unknown /proc/54482/task/54775/cwd (readlink: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54775 signal_ha ceph rtd unknown /proc/54482/task/54775/root (readlink: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54775 signal_ha ceph txt unknown /proc/54482/task/54775/exe (readlink: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54775 signal_ha ceph NOFD /proc/54482/task/54775/fd (opendir: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54776 io_contex ceph cwd unknown /proc/54482/task/54776/cwd (readlink: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54776 io_contex ceph rtd unknown /proc/54482/task/54776/root (readlink: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54776 io_contex ceph txt unknown /proc/54482/task/54776/exe (readlink: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54776 io_contex ceph NOFD /proc/54482/task/54776/fd (opendir: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54777 io_contex ceph cwd unknown /proc/54482/task/54777/cwd (readlink: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54777 io_contex ceph rtd unknown /proc/54482/task/54777/root (readlink: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54777 io_contex ceph txt unknown /proc/54482/task/54777/exe (readlink: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54777 io_contex ceph NOFD /proc/54482/task/54777/fd (opendir: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54784 OpHistory ceph cwd unknown /proc/54482/task/54784/cwd (readlink: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54784 OpHistory ceph rtd unknown /proc/54482/task/54784/root (readlink: Permission denied) 2024-09-21T05:55:49.685 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54784 OpHistory ceph txt unknown /proc/54482/task/54784/exe (readlink: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54784 OpHistory ceph NOFD /proc/54482/task/54784/fd (opendir: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54785 ceph_time ceph cwd unknown /proc/54482/task/54785/cwd (readlink: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54785 ceph_time ceph rtd unknown /proc/54482/task/54785/root (readlink: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54785 ceph_time ceph txt unknown /proc/54482/task/54785/exe (readlink: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54785 ceph_time ceph NOFD /proc/54482/task/54785/fd (opendir: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54988 ceph-osd ceph cwd unknown /proc/54482/task/54988/cwd (readlink: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54988 ceph-osd ceph rtd unknown /proc/54482/task/54988/root (readlink: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54988 ceph-osd ceph txt unknown /proc/54482/task/54988/exe (readlink: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54988 ceph-osd ceph NOFD /proc/54482/task/54988/fd (opendir: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54989 safe_time ceph cwd unknown /proc/54482/task/54989/cwd (readlink: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54989 safe_time ceph rtd unknown /proc/54482/task/54989/root (readlink: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54989 safe_time ceph txt unknown /proc/54482/task/54989/exe (readlink: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54989 safe_time ceph NOFD /proc/54482/task/54989/fd (opendir: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54990 safe_time ceph cwd unknown /proc/54482/task/54990/cwd (readlink: Permission denied) 2024-09-21T05:55:49.686 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54990 safe_time ceph rtd unknown /proc/54482/task/54990/root (readlink: Permission denied) 2024-09-21T05:55:49.687 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54990 safe_time ceph txt unknown /proc/54482/task/54990/exe (readlink: Permission denied) 2024-09-21T05:55:49.687 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54990 safe_time ceph NOFD /proc/54482/task/54990/fd (opendir: Permission denied) 2024-09-21T05:55:49.687 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54991 safe_time ceph cwd unknown /proc/54482/task/54991/cwd (readlink: Permission denied) 2024-09-21T05:55:49.687 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54991 safe_time ceph rtd unknown /proc/54482/task/54991/root (readlink: Permission denied) 2024-09-21T05:55:49.687 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54991 safe_time ceph txt unknown /proc/54482/task/54991/exe (readlink: Permission denied) 2024-09-21T05:55:49.687 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54991 safe_time ceph NOFD /proc/54482/task/54991/fd (opendir: Permission denied) 2024-09-21T05:55:49.687 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54992 safe_time ceph cwd unknown /proc/54482/task/54992/cwd (readlink: Permission denied) 2024-09-21T05:55:49.687 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54992 safe_time ceph rtd unknown /proc/54482/task/54992/root (readlink: Permission denied) 2024-09-21T05:55:49.687 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54992 safe_time ceph txt unknown /proc/54482/task/54992/exe (readlink: Permission denied) 2024-09-21T05:55:49.687 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54992 safe_time ceph NOFD /proc/54482/task/54992/fd (opendir: Permission denied) 2024-09-21T05:55:49.687 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54993 fn_anonym ceph cwd unknown /proc/54482/task/54993/cwd (readlink: Permission denied) 2024-09-21T05:55:49.687 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54993 fn_anonym ceph rtd unknown /proc/54482/task/54993/root (readlink: Permission denied) 2024-09-21T05:55:49.687 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54993 fn_anonym ceph txt unknown /proc/54482/task/54993/exe (readlink: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 54993 fn_anonym ceph NOFD /proc/54482/task/54993/fd (opendir: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55061 rocksdb:l ceph cwd unknown /proc/54482/task/55061/cwd (readlink: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55061 rocksdb:l ceph rtd unknown /proc/54482/task/55061/root (readlink: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55061 rocksdb:l ceph txt unknown /proc/54482/task/55061/exe (readlink: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55061 rocksdb:l ceph NOFD /proc/54482/task/55061/fd (opendir: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55062 rocksdb:l ceph cwd unknown /proc/54482/task/55062/cwd (readlink: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55062 rocksdb:l ceph rtd unknown /proc/54482/task/55062/root (readlink: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55062 rocksdb:l ceph txt unknown /proc/54482/task/55062/exe (readlink: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55062 rocksdb:l ceph NOFD /proc/54482/task/55062/fd (opendir: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55063 rocksdb:l ceph cwd unknown /proc/54482/task/55063/cwd (readlink: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55063 rocksdb:l ceph rtd unknown /proc/54482/task/55063/root (readlink: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55063 rocksdb:l ceph txt unknown /proc/54482/task/55063/exe (readlink: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55063 rocksdb:l ceph NOFD /proc/54482/task/55063/fd (opendir: Permission denied) 2024-09-21T05:55:49.688 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55064 rocksdb:h ceph cwd unknown /proc/54482/task/55064/cwd (readlink: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55064 rocksdb:h ceph rtd unknown /proc/54482/task/55064/root (readlink: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55064 rocksdb:h ceph txt unknown /proc/54482/task/55064/exe (readlink: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55064 rocksdb:h ceph NOFD /proc/54482/task/55064/fd (opendir: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55471 bstore_ai ceph cwd unknown /proc/54482/task/55471/cwd (readlink: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55471 bstore_ai ceph rtd unknown /proc/54482/task/55471/root (readlink: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55471 bstore_ai ceph txt unknown /proc/54482/task/55471/exe (readlink: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55471 bstore_ai ceph NOFD /proc/54482/task/55471/fd (opendir: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55662 bstore_ai ceph cwd unknown /proc/54482/task/55662/cwd (readlink: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55662 bstore_ai ceph rtd unknown /proc/54482/task/55662/root (readlink: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55662 bstore_ai ceph txt unknown /proc/54482/task/55662/exe (readlink: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55662 bstore_ai ceph NOFD /proc/54482/task/55662/fd (opendir: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55844 ceph-osd ceph cwd unknown /proc/54482/task/55844/cwd (readlink: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55844 ceph-osd ceph rtd unknown /proc/54482/task/55844/root (readlink: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55844 ceph-osd ceph txt unknown /proc/54482/task/55844/exe (readlink: Permission denied) 2024-09-21T05:55:49.689 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55844 ceph-osd ceph NOFD /proc/54482/task/55844/fd (opendir: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55845 cfin ceph cwd unknown /proc/54482/task/55845/cwd (readlink: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55845 cfin ceph rtd unknown /proc/54482/task/55845/root (readlink: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55845 cfin ceph txt unknown /proc/54482/task/55845/exe (readlink: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55845 cfin ceph NOFD /proc/54482/task/55845/fd (opendir: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55846 bstore_kv ceph cwd unknown /proc/54482/task/55846/cwd (readlink: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55846 bstore_kv ceph rtd unknown /proc/54482/task/55846/root (readlink: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55846 bstore_kv ceph txt unknown /proc/54482/task/55846/exe (readlink: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55846 bstore_kv ceph NOFD /proc/54482/task/55846/fd (opendir: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55847 bstore_kv ceph cwd unknown /proc/54482/task/55847/cwd (readlink: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55847 bstore_kv ceph rtd unknown /proc/54482/task/55847/root (readlink: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55847 bstore_kv ceph txt unknown /proc/54482/task/55847/exe (readlink: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55847 bstore_kv ceph NOFD /proc/54482/task/55847/fd (opendir: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55848 bstore_me ceph cwd unknown /proc/54482/task/55848/cwd (readlink: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55848 bstore_me ceph rtd unknown /proc/54482/task/55848/root (readlink: Permission denied) 2024-09-21T05:55:49.690 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55848 bstore_me ceph txt unknown /proc/54482/task/55848/exe (readlink: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55848 bstore_me ceph NOFD /proc/54482/task/55848/fd (opendir: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55849 ms_dispat ceph cwd unknown /proc/54482/task/55849/cwd (readlink: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55849 ms_dispat ceph rtd unknown /proc/54482/task/55849/root (readlink: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55849 ms_dispat ceph txt unknown /proc/54482/task/55849/exe (readlink: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55849 ms_dispat ceph NOFD /proc/54482/task/55849/fd (opendir: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55850 ms_local ceph cwd unknown /proc/54482/task/55850/cwd (readlink: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55850 ms_local ceph rtd unknown /proc/54482/task/55850/root (readlink: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55850 ms_local ceph txt unknown /proc/54482/task/55850/exe (readlink: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55850 ms_local ceph NOFD /proc/54482/task/55850/fd (opendir: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55851 safe_time ceph cwd unknown /proc/54482/task/55851/cwd (readlink: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55851 safe_time ceph rtd unknown /proc/54482/task/55851/root (readlink: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55851 safe_time ceph txt unknown /proc/54482/task/55851/exe (readlink: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55851 safe_time ceph NOFD /proc/54482/task/55851/fd (opendir: Permission denied) 2024-09-21T05:55:49.691 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55852 safe_time ceph cwd unknown /proc/54482/task/55852/cwd (readlink: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55852 safe_time ceph rtd unknown /proc/54482/task/55852/root (readlink: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55852 safe_time ceph txt unknown /proc/54482/task/55852/exe (readlink: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55852 safe_time ceph NOFD /proc/54482/task/55852/fd (opendir: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55853 ms_dispat ceph cwd unknown /proc/54482/task/55853/cwd (readlink: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55853 ms_dispat ceph rtd unknown /proc/54482/task/55853/root (readlink: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55853 ms_dispat ceph txt unknown /proc/54482/task/55853/exe (readlink: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55853 ms_dispat ceph NOFD /proc/54482/task/55853/fd (opendir: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55854 ms_local ceph cwd unknown /proc/54482/task/55854/cwd (readlink: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55854 ms_local ceph rtd unknown /proc/54482/task/55854/root (readlink: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55854 ms_local ceph txt unknown /proc/54482/task/55854/exe (readlink: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55854 ms_local ceph NOFD /proc/54482/task/55854/fd (opendir: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55855 ms_dispat ceph cwd unknown /proc/54482/task/55855/cwd (readlink: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55855 ms_dispat ceph rtd unknown /proc/54482/task/55855/root (readlink: Permission denied) 2024-09-21T05:55:49.692 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55855 ms_dispat ceph txt unknown /proc/54482/task/55855/exe (readlink: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55855 ms_dispat ceph NOFD /proc/54482/task/55855/fd (opendir: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55856 ms_local ceph cwd unknown /proc/54482/task/55856/cwd (readlink: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55856 ms_local ceph rtd unknown /proc/54482/task/55856/root (readlink: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55856 ms_local ceph txt unknown /proc/54482/task/55856/exe (readlink: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55856 ms_local ceph NOFD /proc/54482/task/55856/fd (opendir: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55857 ms_dispat ceph cwd unknown /proc/54482/task/55857/cwd (readlink: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55857 ms_dispat ceph rtd unknown /proc/54482/task/55857/root (readlink: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55857 ms_dispat ceph txt unknown /proc/54482/task/55857/exe (readlink: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55857 ms_dispat ceph NOFD /proc/54482/task/55857/fd (opendir: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55858 ms_local ceph cwd unknown /proc/54482/task/55858/cwd (readlink: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55858 ms_local ceph rtd unknown /proc/54482/task/55858/root (readlink: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55858 ms_local ceph txt unknown /proc/54482/task/55858/exe (readlink: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55858 ms_local ceph NOFD /proc/54482/task/55858/fd (opendir: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55859 ms_dispat ceph cwd unknown /proc/54482/task/55859/cwd (readlink: Permission denied) 2024-09-21T05:55:49.693 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55859 ms_dispat ceph rtd unknown /proc/54482/task/55859/root (readlink: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55859 ms_dispat ceph txt unknown /proc/54482/task/55859/exe (readlink: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55859 ms_dispat ceph NOFD /proc/54482/task/55859/fd (opendir: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55860 ms_local ceph cwd unknown /proc/54482/task/55860/cwd (readlink: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55860 ms_local ceph rtd unknown /proc/54482/task/55860/root (readlink: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55860 ms_local ceph txt unknown /proc/54482/task/55860/exe (readlink: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55860 ms_local ceph NOFD /proc/54482/task/55860/fd (opendir: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55861 ms_dispat ceph cwd unknown /proc/54482/task/55861/cwd (readlink: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55861 ms_dispat ceph rtd unknown /proc/54482/task/55861/root (readlink: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55861 ms_dispat ceph txt unknown /proc/54482/task/55861/exe (readlink: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55861 ms_dispat ceph NOFD /proc/54482/task/55861/fd (opendir: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55862 ms_local ceph cwd unknown /proc/54482/task/55862/cwd (readlink: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55862 ms_local ceph rtd unknown /proc/54482/task/55862/root (readlink: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55862 ms_local ceph txt unknown /proc/54482/task/55862/exe (readlink: Permission denied) 2024-09-21T05:55:49.694 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55862 ms_local ceph NOFD /proc/54482/task/55862/fd (opendir: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55863 ms_dispat ceph cwd unknown /proc/54482/task/55863/cwd (readlink: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55863 ms_dispat ceph rtd unknown /proc/54482/task/55863/root (readlink: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55863 ms_dispat ceph txt unknown /proc/54482/task/55863/exe (readlink: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55863 ms_dispat ceph NOFD /proc/54482/task/55863/fd (opendir: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55864 ms_local ceph cwd unknown /proc/54482/task/55864/cwd (readlink: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55864 ms_local ceph rtd unknown /proc/54482/task/55864/root (readlink: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55864 ms_local ceph txt unknown /proc/54482/task/55864/exe (readlink: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55864 ms_local ceph NOFD /proc/54482/task/55864/fd (opendir: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55865 fn_anonym ceph cwd unknown /proc/54482/task/55865/cwd (readlink: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55865 fn_anonym ceph rtd unknown /proc/54482/task/55865/root (readlink: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55865 fn_anonym ceph txt unknown /proc/54482/task/55865/exe (readlink: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55865 fn_anonym ceph NOFD /proc/54482/task/55865/fd (opendir: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55866 finisher ceph cwd unknown /proc/54482/task/55866/cwd (readlink: Permission denied) 2024-09-21T05:55:49.695 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55866 finisher ceph rtd unknown /proc/54482/task/55866/root (readlink: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55866 finisher ceph txt unknown /proc/54482/task/55866/exe (readlink: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55866 finisher ceph NOFD /proc/54482/task/55866/fd (opendir: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55867 safe_time ceph cwd unknown /proc/54482/task/55867/cwd (readlink: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55867 safe_time ceph rtd unknown /proc/54482/task/55867/root (readlink: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55867 safe_time ceph txt unknown /proc/54482/task/55867/exe (readlink: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55867 safe_time ceph NOFD /proc/54482/task/55867/fd (opendir: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55868 safe_time ceph cwd unknown /proc/54482/task/55868/cwd (readlink: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55868 safe_time ceph rtd unknown /proc/54482/task/55868/root (readlink: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55868 safe_time ceph txt unknown /proc/54482/task/55868/exe (readlink: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55868 safe_time ceph NOFD /proc/54482/task/55868/fd (opendir: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55869 ceph-osd ceph cwd unknown /proc/54482/task/55869/cwd (readlink: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55869 ceph-osd ceph rtd unknown /proc/54482/task/55869/root (readlink: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55869 ceph-osd ceph txt unknown /proc/54482/task/55869/exe (readlink: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55869 ceph-osd ceph NOFD /proc/54482/task/55869/fd (opendir: Permission denied) 2024-09-21T05:55:49.696 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55870 osd_srv_a ceph cwd unknown /proc/54482/task/55870/cwd (readlink: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55870 osd_srv_a ceph rtd unknown /proc/54482/task/55870/root (readlink: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55870 osd_srv_a ceph txt unknown /proc/54482/task/55870/exe (readlink: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55870 osd_srv_a ceph NOFD /proc/54482/task/55870/fd (opendir: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55871 tp_osd_tp ceph cwd unknown /proc/54482/task/55871/cwd (readlink: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55871 tp_osd_tp ceph rtd unknown /proc/54482/task/55871/root (readlink: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55871 tp_osd_tp ceph txt unknown /proc/54482/task/55871/exe (readlink: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55871 tp_osd_tp ceph NOFD /proc/54482/task/55871/fd (opendir: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55872 tp_osd_tp ceph cwd unknown /proc/54482/task/55872/cwd (readlink: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55872 tp_osd_tp ceph rtd unknown /proc/54482/task/55872/root (readlink: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55872 tp_osd_tp ceph txt unknown /proc/54482/task/55872/exe (readlink: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55872 tp_osd_tp ceph NOFD /proc/54482/task/55872/fd (opendir: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55873 tp_osd_tp ceph cwd unknown /proc/54482/task/55873/cwd (readlink: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55873 tp_osd_tp ceph rtd unknown /proc/54482/task/55873/root (readlink: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55873 tp_osd_tp ceph txt unknown /proc/54482/task/55873/exe (readlink: Permission denied) 2024-09-21T05:55:49.697 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55873 tp_osd_tp ceph NOFD /proc/54482/task/55873/fd (opendir: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55874 tp_osd_tp ceph cwd unknown /proc/54482/task/55874/cwd (readlink: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55874 tp_osd_tp ceph rtd unknown /proc/54482/task/55874/root (readlink: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55874 tp_osd_tp ceph txt unknown /proc/54482/task/55874/exe (readlink: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55874 tp_osd_tp ceph NOFD /proc/54482/task/55874/fd (opendir: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55875 tp_osd_tp ceph cwd unknown /proc/54482/task/55875/cwd (readlink: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55875 tp_osd_tp ceph rtd unknown /proc/54482/task/55875/root (readlink: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55875 tp_osd_tp ceph txt unknown /proc/54482/task/55875/exe (readlink: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55875 tp_osd_tp ceph NOFD /proc/54482/task/55875/fd (opendir: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55876 tp_osd_tp ceph cwd unknown /proc/54482/task/55876/cwd (readlink: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55876 tp_osd_tp ceph rtd unknown /proc/54482/task/55876/root (readlink: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55876 tp_osd_tp ceph txt unknown /proc/54482/task/55876/exe (readlink: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55876 tp_osd_tp ceph NOFD /proc/54482/task/55876/fd (opendir: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55877 tp_osd_tp ceph cwd unknown /proc/54482/task/55877/cwd (readlink: Permission denied) 2024-09-21T05:55:49.698 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55877 tp_osd_tp ceph rtd unknown /proc/54482/task/55877/root (readlink: Permission denied) 2024-09-21T05:55:49.699 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55877 tp_osd_tp ceph txt unknown /proc/54482/task/55877/exe (readlink: Permission denied) 2024-09-21T05:55:49.699 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55877 tp_osd_tp ceph NOFD /proc/54482/task/55877/fd (opendir: Permission denied) 2024-09-21T05:55:49.699 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55878 tp_osd_tp ceph cwd unknown /proc/54482/task/55878/cwd (readlink: Permission denied) 2024-09-21T05:55:49.699 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55878 tp_osd_tp ceph rtd unknown /proc/54482/task/55878/root (readlink: Permission denied) 2024-09-21T05:55:49.699 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55878 tp_osd_tp ceph txt unknown /proc/54482/task/55878/exe (readlink: Permission denied) 2024-09-21T05:55:49.699 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55878 tp_osd_tp ceph NOFD /proc/54482/task/55878/fd (opendir: Permission denied) 2024-09-21T05:55:49.699 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55879 tp_osd_tp ceph cwd unknown /proc/54482/task/55879/cwd (readlink: Permission denied) 2024-09-21T05:55:49.699 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55879 tp_osd_tp ceph rtd unknown /proc/54482/task/55879/root (readlink: Permission denied) 2024-09-21T05:55:49.699 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55879 tp_osd_tp ceph txt unknown /proc/54482/task/55879/exe (readlink: Permission denied) 2024-09-21T05:55:49.699 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55879 tp_osd_tp ceph NOFD /proc/54482/task/55879/fd (opendir: Permission denied) 2024-09-21T05:55:49.699 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55880 tp_osd_tp ceph cwd unknown /proc/54482/task/55880/cwd (readlink: Permission denied) 2024-09-21T05:55:49.699 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55880 tp_osd_tp ceph rtd unknown /proc/54482/task/55880/root (readlink: Permission denied) 2024-09-21T05:55:49.699 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55880 tp_osd_tp ceph txt unknown /proc/54482/task/55880/exe (readlink: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55880 tp_osd_tp ceph NOFD /proc/54482/task/55880/fd (opendir: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55881 tp_osd_tp ceph cwd unknown /proc/54482/task/55881/cwd (readlink: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55881 tp_osd_tp ceph rtd unknown /proc/54482/task/55881/root (readlink: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55881 tp_osd_tp ceph txt unknown /proc/54482/task/55881/exe (readlink: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55881 tp_osd_tp ceph NOFD /proc/54482/task/55881/fd (opendir: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55882 tp_osd_tp ceph cwd unknown /proc/54482/task/55882/cwd (readlink: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55882 tp_osd_tp ceph rtd unknown /proc/54482/task/55882/root (readlink: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55882 tp_osd_tp ceph txt unknown /proc/54482/task/55882/exe (readlink: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55882 tp_osd_tp ceph NOFD /proc/54482/task/55882/fd (opendir: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55883 tp_osd_tp ceph cwd unknown /proc/54482/task/55883/cwd (readlink: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55883 tp_osd_tp ceph rtd unknown /proc/54482/task/55883/root (readlink: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55883 tp_osd_tp ceph txt unknown /proc/54482/task/55883/exe (readlink: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55883 tp_osd_tp ceph NOFD /proc/54482/task/55883/fd (opendir: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55884 tp_osd_tp ceph cwd unknown /proc/54482/task/55884/cwd (readlink: Permission denied) 2024-09-21T05:55:49.700 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55884 tp_osd_tp ceph rtd unknown /proc/54482/task/55884/root (readlink: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55884 tp_osd_tp ceph txt unknown /proc/54482/task/55884/exe (readlink: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55884 tp_osd_tp ceph NOFD /proc/54482/task/55884/fd (opendir: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55885 tp_osd_tp ceph cwd unknown /proc/54482/task/55885/cwd (readlink: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55885 tp_osd_tp ceph rtd unknown /proc/54482/task/55885/root (readlink: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55885 tp_osd_tp ceph txt unknown /proc/54482/task/55885/exe (readlink: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55885 tp_osd_tp ceph NOFD /proc/54482/task/55885/fd (opendir: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55886 tp_osd_tp ceph cwd unknown /proc/54482/task/55886/cwd (readlink: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55886 tp_osd_tp ceph rtd unknown /proc/54482/task/55886/root (readlink: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55886 tp_osd_tp ceph txt unknown /proc/54482/task/55886/exe (readlink: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55886 tp_osd_tp ceph NOFD /proc/54482/task/55886/fd (opendir: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55887 osd_srv_h ceph cwd unknown /proc/54482/task/55887/cwd (readlink: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55887 osd_srv_h ceph rtd unknown /proc/54482/task/55887/root (readlink: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55887 osd_srv_h ceph txt unknown /proc/54482/task/55887/exe (readlink: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 54482 55887 osd_srv_h ceph NOFD /proc/54482/task/55887/fd (opendir: Permission denied) 2024-09-21T05:55:49.701 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 55000 root cwd unknown /proc/55000/cwd (readlink: Permission denied) 2024-09-21T05:55:49.702 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 55000 root rtd unknown /proc/55000/root (readlink: Permission denied) 2024-09-21T05:55:49.702 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 55000 root txt unknown /proc/55000/exe (readlink: Permission denied) 2024-09-21T05:55:49.702 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 55000 root NOFD /proc/55000/fd (opendir: Permission denied) 2024-09-21T05:55:49.702 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 55019 root cwd unknown /proc/55019/cwd (readlink: Permission denied) 2024-09-21T05:55:49.702 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 55019 root rtd unknown /proc/55019/root (readlink: Permission denied) 2024-09-21T05:55:49.702 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 55019 root txt unknown /proc/55019/exe (readlink: Permission denied) 2024-09-21T05:55:49.702 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 55019 root NOFD /proc/55019/fd (opendir: Permission denied) 2024-09-21T05:55:49.702 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 57980 root cwd unknown /proc/57980/cwd (readlink: Permission denied) 2024-09-21T05:55:49.702 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 57980 root rtd unknown /proc/57980/root (readlink: Permission denied) 2024-09-21T05:55:49.702 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 57980 root txt unknown /proc/57980/exe (readlink: Permission denied) 2024-09-21T05:55:49.702 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 57980 root NOFD /proc/57980/fd (opendir: Permission denied) 2024-09-21T05:55:49.702 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 60059 root cwd unknown /proc/60059/cwd (readlink: Permission denied) 2024-09-21T05:55:49.702 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 60059 root rtd unknown /proc/60059/root (readlink: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 60059 root txt unknown /proc/60059/exe (readlink: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 60059 root NOFD /proc/60059/fd (opendir: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 60105 root cwd unknown /proc/60105/cwd (readlink: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 60105 root rtd unknown /proc/60105/root (readlink: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 60105 root txt unknown /proc/60105/exe (readlink: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 60105 root NOFD /proc/60105/fd (opendir: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 60618 root cwd unknown /proc/60618/cwd (readlink: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 60618 root rtd unknown /proc/60618/root (readlink: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 60618 root txt unknown /proc/60618/exe (readlink: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 60618 root NOFD /proc/60618/fd (opendir: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 60620 root cwd unknown /proc/60620/cwd (readlink: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 60620 root rtd unknown /proc/60620/root (readlink: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 60620 root txt unknown /proc/60620/exe (readlink: Permission denied) 2024-09-21T05:55:49.703 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 60620 root NOFD /proc/60620/fd (opendir: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 ceph cwd unknown /proc/60622/cwd (readlink: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 ceph rtd unknown /proc/60622/root (readlink: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 ceph txt unknown /proc/60622/exe (readlink: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 ceph NOFD /proc/60622/fd (opendir: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60623 log ceph cwd unknown /proc/60622/task/60623/cwd (readlink: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60623 log ceph rtd unknown /proc/60622/task/60623/root (readlink: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60623 log ceph txt unknown /proc/60622/task/60623/exe (readlink: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60623 log ceph NOFD /proc/60622/task/60623/fd (opendir: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60625 msgr-work ceph cwd unknown /proc/60622/task/60625/cwd (readlink: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60625 msgr-work ceph rtd unknown /proc/60622/task/60625/root (readlink: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60625 msgr-work ceph txt unknown /proc/60622/task/60625/exe (readlink: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60625 msgr-work ceph NOFD /proc/60622/task/60625/fd (opendir: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60626 msgr-work ceph cwd unknown /proc/60622/task/60626/cwd (readlink: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60626 msgr-work ceph rtd unknown /proc/60622/task/60626/root (readlink: Permission denied) 2024-09-21T05:55:49.704 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60626 msgr-work ceph txt unknown /proc/60622/task/60626/exe (readlink: Permission denied) 2024-09-21T05:55:49.705 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60626 msgr-work ceph NOFD /proc/60622/task/60626/fd (opendir: Permission denied) 2024-09-21T05:55:49.705 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60627 msgr-work ceph cwd unknown /proc/60622/task/60627/cwd (readlink: Permission denied) 2024-09-21T05:55:49.705 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60627 msgr-work ceph rtd unknown /proc/60622/task/60627/root (readlink: Permission denied) 2024-09-21T05:55:49.705 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60627 msgr-work ceph txt unknown /proc/60622/task/60627/exe (readlink: Permission denied) 2024-09-21T05:55:49.705 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60627 msgr-work ceph NOFD /proc/60622/task/60627/fd (opendir: Permission denied) 2024-09-21T05:55:49.705 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60631 service ceph cwd unknown /proc/60622/task/60631/cwd (readlink: Permission denied) 2024-09-21T05:55:49.705 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60631 service ceph rtd unknown /proc/60622/task/60631/root (readlink: Permission denied) 2024-09-21T05:55:49.705 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60631 service ceph txt unknown /proc/60622/task/60631/exe (readlink: Permission denied) 2024-09-21T05:55:49.705 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60631 service ceph NOFD /proc/60622/task/60631/fd (opendir: Permission denied) 2024-09-21T05:55:49.705 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60632 admin_soc ceph cwd unknown /proc/60622/task/60632/cwd (readlink: Permission denied) 2024-09-21T05:55:49.705 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60632 admin_soc ceph rtd unknown /proc/60622/task/60632/root (readlink: Permission denied) 2024-09-21T05:55:49.705 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60632 admin_soc ceph txt unknown /proc/60622/task/60632/exe (readlink: Permission denied) 2024-09-21T05:55:49.705 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60632 admin_soc ceph NOFD /proc/60622/task/60632/fd (opendir: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60893 signal_ha ceph cwd unknown /proc/60622/task/60893/cwd (readlink: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60893 signal_ha ceph rtd unknown /proc/60622/task/60893/root (readlink: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60893 signal_ha ceph txt unknown /proc/60622/task/60893/exe (readlink: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60893 signal_ha ceph NOFD /proc/60622/task/60893/fd (opendir: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60894 io_contex ceph cwd unknown /proc/60622/task/60894/cwd (readlink: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60894 io_contex ceph rtd unknown /proc/60622/task/60894/root (readlink: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60894 io_contex ceph txt unknown /proc/60622/task/60894/exe (readlink: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60894 io_contex ceph NOFD /proc/60622/task/60894/fd (opendir: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60895 io_contex ceph cwd unknown /proc/60622/task/60895/cwd (readlink: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60895 io_contex ceph rtd unknown /proc/60622/task/60895/root (readlink: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60895 io_contex ceph txt unknown /proc/60622/task/60895/exe (readlink: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60895 io_contex ceph NOFD /proc/60622/task/60895/fd (opendir: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60900 OpHistory ceph cwd unknown /proc/60622/task/60900/cwd (readlink: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60900 OpHistory ceph rtd unknown /proc/60622/task/60900/root (readlink: Permission denied) 2024-09-21T05:55:49.706 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60900 OpHistory ceph txt unknown /proc/60622/task/60900/exe (readlink: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60900 OpHistory ceph NOFD /proc/60622/task/60900/fd (opendir: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60901 ceph_time ceph cwd unknown /proc/60622/task/60901/cwd (readlink: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60901 ceph_time ceph rtd unknown /proc/60622/task/60901/root (readlink: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60901 ceph_time ceph txt unknown /proc/60622/task/60901/exe (readlink: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 60901 ceph_time ceph NOFD /proc/60622/task/60901/fd (opendir: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61165 ceph-osd ceph cwd unknown /proc/60622/task/61165/cwd (readlink: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61165 ceph-osd ceph rtd unknown /proc/60622/task/61165/root (readlink: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61165 ceph-osd ceph txt unknown /proc/60622/task/61165/exe (readlink: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61165 ceph-osd ceph NOFD /proc/60622/task/61165/fd (opendir: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61166 safe_time ceph cwd unknown /proc/60622/task/61166/cwd (readlink: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61166 safe_time ceph rtd unknown /proc/60622/task/61166/root (readlink: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61166 safe_time ceph txt unknown /proc/60622/task/61166/exe (readlink: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61166 safe_time ceph NOFD /proc/60622/task/61166/fd (opendir: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61167 safe_time ceph cwd unknown /proc/60622/task/61167/cwd (readlink: Permission denied) 2024-09-21T05:55:49.707 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61167 safe_time ceph rtd unknown /proc/60622/task/61167/root (readlink: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61167 safe_time ceph txt unknown /proc/60622/task/61167/exe (readlink: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61167 safe_time ceph NOFD /proc/60622/task/61167/fd (opendir: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61168 safe_time ceph cwd unknown /proc/60622/task/61168/cwd (readlink: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61168 safe_time ceph rtd unknown /proc/60622/task/61168/root (readlink: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61168 safe_time ceph txt unknown /proc/60622/task/61168/exe (readlink: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61168 safe_time ceph NOFD /proc/60622/task/61168/fd (opendir: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61169 safe_time ceph cwd unknown /proc/60622/task/61169/cwd (readlink: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61169 safe_time ceph rtd unknown /proc/60622/task/61169/root (readlink: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61169 safe_time ceph txt unknown /proc/60622/task/61169/exe (readlink: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61169 safe_time ceph NOFD /proc/60622/task/61169/fd (opendir: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61170 fn_anonym ceph cwd unknown /proc/60622/task/61170/cwd (readlink: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61170 fn_anonym ceph rtd unknown /proc/60622/task/61170/root (readlink: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61170 fn_anonym ceph txt unknown /proc/60622/task/61170/exe (readlink: Permission denied) 2024-09-21T05:55:49.708 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61170 fn_anonym ceph NOFD /proc/60622/task/61170/fd (opendir: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61233 rocksdb:l ceph cwd unknown /proc/60622/task/61233/cwd (readlink: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61233 rocksdb:l ceph rtd unknown /proc/60622/task/61233/root (readlink: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61233 rocksdb:l ceph txt unknown /proc/60622/task/61233/exe (readlink: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61233 rocksdb:l ceph NOFD /proc/60622/task/61233/fd (opendir: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61234 rocksdb:l ceph cwd unknown /proc/60622/task/61234/cwd (readlink: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61234 rocksdb:l ceph rtd unknown /proc/60622/task/61234/root (readlink: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61234 rocksdb:l ceph txt unknown /proc/60622/task/61234/exe (readlink: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61234 rocksdb:l ceph NOFD /proc/60622/task/61234/fd (opendir: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61235 rocksdb:l ceph cwd unknown /proc/60622/task/61235/cwd (readlink: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61235 rocksdb:l ceph rtd unknown /proc/60622/task/61235/root (readlink: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61235 rocksdb:l ceph txt unknown /proc/60622/task/61235/exe (readlink: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61235 rocksdb:l ceph NOFD /proc/60622/task/61235/fd (opendir: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61236 rocksdb:h ceph cwd unknown /proc/60622/task/61236/cwd (readlink: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61236 rocksdb:h ceph rtd unknown /proc/60622/task/61236/root (readlink: Permission denied) 2024-09-21T05:55:49.709 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61236 rocksdb:h ceph txt unknown /proc/60622/task/61236/exe (readlink: Permission denied) 2024-09-21T05:55:49.710 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61236 rocksdb:h ceph NOFD /proc/60622/task/61236/fd (opendir: Permission denied) 2024-09-21T05:55:49.710 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61623 bstore_ai ceph cwd unknown /proc/60622/task/61623/cwd (readlink: Permission denied) 2024-09-21T05:55:49.710 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61623 bstore_ai ceph rtd unknown /proc/60622/task/61623/root (readlink: Permission denied) 2024-09-21T05:55:49.710 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61623 bstore_ai ceph txt unknown /proc/60622/task/61623/exe (readlink: Permission denied) 2024-09-21T05:55:49.710 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61623 bstore_ai ceph NOFD /proc/60622/task/61623/fd (opendir: Permission denied) 2024-09-21T05:55:49.710 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61829 bstore_ai ceph cwd unknown /proc/60622/task/61829/cwd (readlink: Permission denied) 2024-09-21T05:55:49.710 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61829 bstore_ai ceph rtd unknown /proc/60622/task/61829/root (readlink: Permission denied) 2024-09-21T05:55:49.710 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61829 bstore_ai ceph txt unknown /proc/60622/task/61829/exe (readlink: Permission denied) 2024-09-21T05:55:49.710 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 61829 bstore_ai ceph NOFD /proc/60622/task/61829/fd (opendir: Permission denied) 2024-09-21T05:55:49.710 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62012 ceph-osd ceph cwd unknown /proc/60622/task/62012/cwd (readlink: Permission denied) 2024-09-21T05:55:49.710 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62012 ceph-osd ceph rtd unknown /proc/60622/task/62012/root (readlink: Permission denied) 2024-09-21T05:55:49.710 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62012 ceph-osd ceph txt unknown /proc/60622/task/62012/exe (readlink: Permission denied) 2024-09-21T05:55:49.710 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62012 ceph-osd ceph NOFD /proc/60622/task/62012/fd (opendir: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62013 cfin ceph cwd unknown /proc/60622/task/62013/cwd (readlink: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62013 cfin ceph rtd unknown /proc/60622/task/62013/root (readlink: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62013 cfin ceph txt unknown /proc/60622/task/62013/exe (readlink: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62013 cfin ceph NOFD /proc/60622/task/62013/fd (opendir: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62014 bstore_kv ceph cwd unknown /proc/60622/task/62014/cwd (readlink: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62014 bstore_kv ceph rtd unknown /proc/60622/task/62014/root (readlink: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62014 bstore_kv ceph txt unknown /proc/60622/task/62014/exe (readlink: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62014 bstore_kv ceph NOFD /proc/60622/task/62014/fd (opendir: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62015 bstore_kv ceph cwd unknown /proc/60622/task/62015/cwd (readlink: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62015 bstore_kv ceph rtd unknown /proc/60622/task/62015/root (readlink: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62015 bstore_kv ceph txt unknown /proc/60622/task/62015/exe (readlink: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62015 bstore_kv ceph NOFD /proc/60622/task/62015/fd (opendir: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62016 bstore_me ceph cwd unknown /proc/60622/task/62016/cwd (readlink: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62016 bstore_me ceph rtd unknown /proc/60622/task/62016/root (readlink: Permission denied) 2024-09-21T05:55:49.711 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62016 bstore_me ceph txt unknown /proc/60622/task/62016/exe (readlink: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62016 bstore_me ceph NOFD /proc/60622/task/62016/fd (opendir: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62017 ms_dispat ceph cwd unknown /proc/60622/task/62017/cwd (readlink: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62017 ms_dispat ceph rtd unknown /proc/60622/task/62017/root (readlink: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62017 ms_dispat ceph txt unknown /proc/60622/task/62017/exe (readlink: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62017 ms_dispat ceph NOFD /proc/60622/task/62017/fd (opendir: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62018 ms_local ceph cwd unknown /proc/60622/task/62018/cwd (readlink: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62018 ms_local ceph rtd unknown /proc/60622/task/62018/root (readlink: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62018 ms_local ceph txt unknown /proc/60622/task/62018/exe (readlink: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62018 ms_local ceph NOFD /proc/60622/task/62018/fd (opendir: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62019 safe_time ceph cwd unknown /proc/60622/task/62019/cwd (readlink: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62019 safe_time ceph rtd unknown /proc/60622/task/62019/root (readlink: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62019 safe_time ceph txt unknown /proc/60622/task/62019/exe (readlink: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62019 safe_time ceph NOFD /proc/60622/task/62019/fd (opendir: Permission denied) 2024-09-21T05:55:49.712 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62020 safe_time ceph cwd unknown /proc/60622/task/62020/cwd (readlink: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62020 safe_time ceph rtd unknown /proc/60622/task/62020/root (readlink: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62020 safe_time ceph txt unknown /proc/60622/task/62020/exe (readlink: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62020 safe_time ceph NOFD /proc/60622/task/62020/fd (opendir: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62021 ms_dispat ceph cwd unknown /proc/60622/task/62021/cwd (readlink: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62021 ms_dispat ceph rtd unknown /proc/60622/task/62021/root (readlink: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62021 ms_dispat ceph txt unknown /proc/60622/task/62021/exe (readlink: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62021 ms_dispat ceph NOFD /proc/60622/task/62021/fd (opendir: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62022 ms_local ceph cwd unknown /proc/60622/task/62022/cwd (readlink: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62022 ms_local ceph rtd unknown /proc/60622/task/62022/root (readlink: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62022 ms_local ceph txt unknown /proc/60622/task/62022/exe (readlink: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62022 ms_local ceph NOFD /proc/60622/task/62022/fd (opendir: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62023 ms_dispat ceph cwd unknown /proc/60622/task/62023/cwd (readlink: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62023 ms_dispat ceph rtd unknown /proc/60622/task/62023/root (readlink: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62023 ms_dispat ceph txt unknown /proc/60622/task/62023/exe (readlink: Permission denied) 2024-09-21T05:55:49.713 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62023 ms_dispat ceph NOFD /proc/60622/task/62023/fd (opendir: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62024 ms_local ceph cwd unknown /proc/60622/task/62024/cwd (readlink: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62024 ms_local ceph rtd unknown /proc/60622/task/62024/root (readlink: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62024 ms_local ceph txt unknown /proc/60622/task/62024/exe (readlink: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62024 ms_local ceph NOFD /proc/60622/task/62024/fd (opendir: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62025 ms_dispat ceph cwd unknown /proc/60622/task/62025/cwd (readlink: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62025 ms_dispat ceph rtd unknown /proc/60622/task/62025/root (readlink: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62025 ms_dispat ceph txt unknown /proc/60622/task/62025/exe (readlink: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62025 ms_dispat ceph NOFD /proc/60622/task/62025/fd (opendir: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62026 ms_local ceph cwd unknown /proc/60622/task/62026/cwd (readlink: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62026 ms_local ceph rtd unknown /proc/60622/task/62026/root (readlink: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62026 ms_local ceph txt unknown /proc/60622/task/62026/exe (readlink: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62026 ms_local ceph NOFD /proc/60622/task/62026/fd (opendir: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62027 ms_dispat ceph cwd unknown /proc/60622/task/62027/cwd (readlink: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62027 ms_dispat ceph rtd unknown /proc/60622/task/62027/root (readlink: Permission denied) 2024-09-21T05:55:49.714 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62027 ms_dispat ceph txt unknown /proc/60622/task/62027/exe (readlink: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62027 ms_dispat ceph NOFD /proc/60622/task/62027/fd (opendir: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62028 ms_local ceph cwd unknown /proc/60622/task/62028/cwd (readlink: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62028 ms_local ceph rtd unknown /proc/60622/task/62028/root (readlink: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62028 ms_local ceph txt unknown /proc/60622/task/62028/exe (readlink: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62028 ms_local ceph NOFD /proc/60622/task/62028/fd (opendir: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62029 ms_dispat ceph cwd unknown /proc/60622/task/62029/cwd (readlink: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62029 ms_dispat ceph rtd unknown /proc/60622/task/62029/root (readlink: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62029 ms_dispat ceph txt unknown /proc/60622/task/62029/exe (readlink: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62029 ms_dispat ceph NOFD /proc/60622/task/62029/fd (opendir: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62030 ms_local ceph cwd unknown /proc/60622/task/62030/cwd (readlink: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62030 ms_local ceph rtd unknown /proc/60622/task/62030/root (readlink: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62030 ms_local ceph txt unknown /proc/60622/task/62030/exe (readlink: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62030 ms_local ceph NOFD /proc/60622/task/62030/fd (opendir: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62031 ms_dispat ceph cwd unknown /proc/60622/task/62031/cwd (readlink: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62031 ms_dispat ceph rtd unknown /proc/60622/task/62031/root (readlink: Permission denied) 2024-09-21T05:55:49.715 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62031 ms_dispat ceph txt unknown /proc/60622/task/62031/exe (readlink: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62031 ms_dispat ceph NOFD /proc/60622/task/62031/fd (opendir: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62032 ms_local ceph cwd unknown /proc/60622/task/62032/cwd (readlink: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62032 ms_local ceph rtd unknown /proc/60622/task/62032/root (readlink: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62032 ms_local ceph txt unknown /proc/60622/task/62032/exe (readlink: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62032 ms_local ceph NOFD /proc/60622/task/62032/fd (opendir: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62033 fn_anonym ceph cwd unknown /proc/60622/task/62033/cwd (readlink: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62033 fn_anonym ceph rtd unknown /proc/60622/task/62033/root (readlink: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62033 fn_anonym ceph txt unknown /proc/60622/task/62033/exe (readlink: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62033 fn_anonym ceph NOFD /proc/60622/task/62033/fd (opendir: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62034 finisher ceph cwd unknown /proc/60622/task/62034/cwd (readlink: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62034 finisher ceph rtd unknown /proc/60622/task/62034/root (readlink: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62034 finisher ceph txt unknown /proc/60622/task/62034/exe (readlink: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62034 finisher ceph NOFD /proc/60622/task/62034/fd (opendir: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62035 safe_time ceph cwd unknown /proc/60622/task/62035/cwd (readlink: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62035 safe_time ceph rtd unknown /proc/60622/task/62035/root (readlink: Permission denied) 2024-09-21T05:55:49.716 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62035 safe_time ceph txt unknown /proc/60622/task/62035/exe (readlink: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62035 safe_time ceph NOFD /proc/60622/task/62035/fd (opendir: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62036 safe_time ceph cwd unknown /proc/60622/task/62036/cwd (readlink: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62036 safe_time ceph rtd unknown /proc/60622/task/62036/root (readlink: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62036 safe_time ceph txt unknown /proc/60622/task/62036/exe (readlink: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62036 safe_time ceph NOFD /proc/60622/task/62036/fd (opendir: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62037 ceph-osd ceph cwd unknown /proc/60622/task/62037/cwd (readlink: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62037 ceph-osd ceph rtd unknown /proc/60622/task/62037/root (readlink: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62037 ceph-osd ceph txt unknown /proc/60622/task/62037/exe (readlink: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62037 ceph-osd ceph NOFD /proc/60622/task/62037/fd (opendir: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62038 osd_srv_a ceph cwd unknown /proc/60622/task/62038/cwd (readlink: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62038 osd_srv_a ceph rtd unknown /proc/60622/task/62038/root (readlink: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62038 osd_srv_a ceph txt unknown /proc/60622/task/62038/exe (readlink: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62038 osd_srv_a ceph NOFD /proc/60622/task/62038/fd (opendir: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62039 tp_osd_tp ceph cwd unknown /proc/60622/task/62039/cwd (readlink: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62039 tp_osd_tp ceph rtd unknown /proc/60622/task/62039/root (readlink: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62039 tp_osd_tp ceph txt unknown /proc/60622/task/62039/exe (readlink: Permission denied) 2024-09-21T05:55:49.717 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62039 tp_osd_tp ceph NOFD /proc/60622/task/62039/fd (opendir: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62040 tp_osd_tp ceph cwd unknown /proc/60622/task/62040/cwd (readlink: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62040 tp_osd_tp ceph rtd unknown /proc/60622/task/62040/root (readlink: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62040 tp_osd_tp ceph txt unknown /proc/60622/task/62040/exe (readlink: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62040 tp_osd_tp ceph NOFD /proc/60622/task/62040/fd (opendir: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62041 tp_osd_tp ceph cwd unknown /proc/60622/task/62041/cwd (readlink: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62041 tp_osd_tp ceph rtd unknown /proc/60622/task/62041/root (readlink: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62041 tp_osd_tp ceph txt unknown /proc/60622/task/62041/exe (readlink: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62041 tp_osd_tp ceph NOFD /proc/60622/task/62041/fd (opendir: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62042 tp_osd_tp ceph cwd unknown /proc/60622/task/62042/cwd (readlink: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62042 tp_osd_tp ceph rtd unknown /proc/60622/task/62042/root (readlink: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62042 tp_osd_tp ceph txt unknown /proc/60622/task/62042/exe (readlink: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62042 tp_osd_tp ceph NOFD /proc/60622/task/62042/fd (opendir: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62043 tp_osd_tp ceph cwd unknown /proc/60622/task/62043/cwd (readlink: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62043 tp_osd_tp ceph rtd unknown /proc/60622/task/62043/root (readlink: Permission denied) 2024-09-21T05:55:49.718 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62043 tp_osd_tp ceph txt unknown /proc/60622/task/62043/exe (readlink: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62043 tp_osd_tp ceph NOFD /proc/60622/task/62043/fd (opendir: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62044 tp_osd_tp ceph cwd unknown /proc/60622/task/62044/cwd (readlink: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62044 tp_osd_tp ceph rtd unknown /proc/60622/task/62044/root (readlink: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62044 tp_osd_tp ceph txt unknown /proc/60622/task/62044/exe (readlink: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62044 tp_osd_tp ceph NOFD /proc/60622/task/62044/fd (opendir: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62045 tp_osd_tp ceph cwd unknown /proc/60622/task/62045/cwd (readlink: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62045 tp_osd_tp ceph rtd unknown /proc/60622/task/62045/root (readlink: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62045 tp_osd_tp ceph txt unknown /proc/60622/task/62045/exe (readlink: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62045 tp_osd_tp ceph NOFD /proc/60622/task/62045/fd (opendir: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62046 tp_osd_tp ceph cwd unknown /proc/60622/task/62046/cwd (readlink: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62046 tp_osd_tp ceph rtd unknown /proc/60622/task/62046/root (readlink: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62046 tp_osd_tp ceph txt unknown /proc/60622/task/62046/exe (readlink: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62046 tp_osd_tp ceph NOFD /proc/60622/task/62046/fd (opendir: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62047 tp_osd_tp ceph cwd unknown /proc/60622/task/62047/cwd (readlink: Permission denied) 2024-09-21T05:55:49.719 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62047 tp_osd_tp ceph rtd unknown /proc/60622/task/62047/root (readlink: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62047 tp_osd_tp ceph txt unknown /proc/60622/task/62047/exe (readlink: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62047 tp_osd_tp ceph NOFD /proc/60622/task/62047/fd (opendir: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62048 tp_osd_tp ceph cwd unknown /proc/60622/task/62048/cwd (readlink: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62048 tp_osd_tp ceph rtd unknown /proc/60622/task/62048/root (readlink: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62048 tp_osd_tp ceph txt unknown /proc/60622/task/62048/exe (readlink: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62048 tp_osd_tp ceph NOFD /proc/60622/task/62048/fd (opendir: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62049 tp_osd_tp ceph cwd unknown /proc/60622/task/62049/cwd (readlink: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62049 tp_osd_tp ceph rtd unknown /proc/60622/task/62049/root (readlink: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62049 tp_osd_tp ceph txt unknown /proc/60622/task/62049/exe (readlink: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62049 tp_osd_tp ceph NOFD /proc/60622/task/62049/fd (opendir: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62050 tp_osd_tp ceph cwd unknown /proc/60622/task/62050/cwd (readlink: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62050 tp_osd_tp ceph rtd unknown /proc/60622/task/62050/root (readlink: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62050 tp_osd_tp ceph txt unknown /proc/60622/task/62050/exe (readlink: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62050 tp_osd_tp ceph NOFD /proc/60622/task/62050/fd (opendir: Permission denied) 2024-09-21T05:55:49.720 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62051 tp_osd_tp ceph cwd unknown /proc/60622/task/62051/cwd (readlink: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62051 tp_osd_tp ceph rtd unknown /proc/60622/task/62051/root (readlink: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62051 tp_osd_tp ceph txt unknown /proc/60622/task/62051/exe (readlink: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62051 tp_osd_tp ceph NOFD /proc/60622/task/62051/fd (opendir: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62052 tp_osd_tp ceph cwd unknown /proc/60622/task/62052/cwd (readlink: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62052 tp_osd_tp ceph rtd unknown /proc/60622/task/62052/root (readlink: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62052 tp_osd_tp ceph txt unknown /proc/60622/task/62052/exe (readlink: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62052 tp_osd_tp ceph NOFD /proc/60622/task/62052/fd (opendir: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62053 tp_osd_tp ceph cwd unknown /proc/60622/task/62053/cwd (readlink: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62053 tp_osd_tp ceph rtd unknown /proc/60622/task/62053/root (readlink: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62053 tp_osd_tp ceph txt unknown /proc/60622/task/62053/exe (readlink: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62053 tp_osd_tp ceph NOFD /proc/60622/task/62053/fd (opendir: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62054 tp_osd_tp ceph cwd unknown /proc/60622/task/62054/cwd (readlink: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62054 tp_osd_tp ceph rtd unknown /proc/60622/task/62054/root (readlink: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62054 tp_osd_tp ceph txt unknown /proc/60622/task/62054/exe (readlink: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62054 tp_osd_tp ceph NOFD /proc/60622/task/62054/fd (opendir: Permission denied) 2024-09-21T05:55:49.721 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62055 osd_srv_h ceph cwd unknown /proc/60622/task/62055/cwd (readlink: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62055 osd_srv_h ceph rtd unknown /proc/60622/task/62055/root (readlink: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62055 osd_srv_h ceph txt unknown /proc/60622/task/62055/exe (readlink: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 60622 62055 osd_srv_h ceph NOFD /proc/60622/task/62055/fd (opendir: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 61195 root cwd unknown /proc/61195/cwd (readlink: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 61195 root rtd unknown /proc/61195/root (readlink: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 61195 root txt unknown /proc/61195/exe (readlink: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 61195 root NOFD /proc/61195/fd (opendir: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 61227 root cwd unknown /proc/61227/cwd (readlink: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 61227 root rtd unknown /proc/61227/root (readlink: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 61227 root txt unknown /proc/61227/exe (readlink: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 61227 root NOFD /proc/61227/fd (opendir: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 66413 root cwd unknown /proc/66413/cwd (readlink: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 66413 root rtd unknown /proc/66413/root (readlink: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 66413 root txt unknown /proc/66413/exe (readlink: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 66413 root NOFD /proc/66413/fd (opendir: Permission denied) 2024-09-21T05:55:49.722 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 66976 root cwd unknown /proc/66976/cwd (readlink: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 66976 root rtd unknown /proc/66976/root (readlink: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 66976 root txt unknown /proc/66976/exe (readlink: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 66976 root NOFD /proc/66976/fd (opendir: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 66978 root cwd unknown /proc/66978/cwd (readlink: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 66978 root rtd unknown /proc/66978/root (readlink: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 66978 root txt unknown /proc/66978/exe (readlink: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 66978 root NOFD /proc/66978/fd (opendir: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 ceph cwd unknown /proc/66980/cwd (readlink: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 ceph rtd unknown /proc/66980/root (readlink: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 ceph txt unknown /proc/66980/exe (readlink: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 ceph NOFD /proc/66980/fd (opendir: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66981 log ceph cwd unknown /proc/66980/task/66981/cwd (readlink: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66981 log ceph rtd unknown /proc/66980/task/66981/root (readlink: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66981 log ceph txt unknown /proc/66980/task/66981/exe (readlink: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66981 log ceph NOFD /proc/66980/task/66981/fd (opendir: Permission denied) 2024-09-21T05:55:49.723 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66983 msgr-work ceph cwd unknown /proc/66980/task/66983/cwd (readlink: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66983 msgr-work ceph rtd unknown /proc/66980/task/66983/root (readlink: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66983 msgr-work ceph txt unknown /proc/66980/task/66983/exe (readlink: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66983 msgr-work ceph NOFD /proc/66980/task/66983/fd (opendir: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66984 msgr-work ceph cwd unknown /proc/66980/task/66984/cwd (readlink: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66984 msgr-work ceph rtd unknown /proc/66980/task/66984/root (readlink: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66984 msgr-work ceph txt unknown /proc/66980/task/66984/exe (readlink: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66984 msgr-work ceph NOFD /proc/66980/task/66984/fd (opendir: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66985 msgr-work ceph cwd unknown /proc/66980/task/66985/cwd (readlink: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66985 msgr-work ceph rtd unknown /proc/66980/task/66985/root (readlink: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66985 msgr-work ceph txt unknown /proc/66980/task/66985/exe (readlink: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66985 msgr-work ceph NOFD /proc/66980/task/66985/fd (opendir: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66989 service ceph cwd unknown /proc/66980/task/66989/cwd (readlink: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66989 service ceph rtd unknown /proc/66980/task/66989/root (readlink: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66989 service ceph txt unknown /proc/66980/task/66989/exe (readlink: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66989 service ceph NOFD /proc/66980/task/66989/fd (opendir: Permission denied) 2024-09-21T05:55:49.724 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66990 admin_soc ceph cwd unknown /proc/66980/task/66990/cwd (readlink: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66990 admin_soc ceph rtd unknown /proc/66980/task/66990/root (readlink: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66990 admin_soc ceph txt unknown /proc/66980/task/66990/exe (readlink: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 66990 admin_soc ceph NOFD /proc/66980/task/66990/fd (opendir: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67261 signal_ha ceph cwd unknown /proc/66980/task/67261/cwd (readlink: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67261 signal_ha ceph rtd unknown /proc/66980/task/67261/root (readlink: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67261 signal_ha ceph txt unknown /proc/66980/task/67261/exe (readlink: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67261 signal_ha ceph NOFD /proc/66980/task/67261/fd (opendir: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67262 io_contex ceph cwd unknown /proc/66980/task/67262/cwd (readlink: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67262 io_contex ceph rtd unknown /proc/66980/task/67262/root (readlink: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67262 io_contex ceph txt unknown /proc/66980/task/67262/exe (readlink: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67262 io_contex ceph NOFD /proc/66980/task/67262/fd (opendir: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67263 io_contex ceph cwd unknown /proc/66980/task/67263/cwd (readlink: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67263 io_contex ceph rtd unknown /proc/66980/task/67263/root (readlink: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67263 io_contex ceph txt unknown /proc/66980/task/67263/exe (readlink: Permission denied) 2024-09-21T05:55:49.725 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67263 io_contex ceph NOFD /proc/66980/task/67263/fd (opendir: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67279 OpHistory ceph cwd unknown /proc/66980/task/67279/cwd (readlink: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67279 OpHistory ceph rtd unknown /proc/66980/task/67279/root (readlink: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67279 OpHistory ceph txt unknown /proc/66980/task/67279/exe (readlink: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67279 OpHistory ceph NOFD /proc/66980/task/67279/fd (opendir: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67280 ceph_time ceph cwd unknown /proc/66980/task/67280/cwd (readlink: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67280 ceph_time ceph rtd unknown /proc/66980/task/67280/root (readlink: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67280 ceph_time ceph txt unknown /proc/66980/task/67280/exe (readlink: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67280 ceph_time ceph NOFD /proc/66980/task/67280/fd (opendir: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67580 ceph-osd ceph cwd unknown /proc/66980/task/67580/cwd (readlink: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67580 ceph-osd ceph rtd unknown /proc/66980/task/67580/root (readlink: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67580 ceph-osd ceph txt unknown /proc/66980/task/67580/exe (readlink: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67580 ceph-osd ceph NOFD /proc/66980/task/67580/fd (opendir: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67581 safe_time ceph cwd unknown /proc/66980/task/67581/cwd (readlink: Permission denied) 2024-09-21T05:55:49.726 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67581 safe_time ceph rtd unknown /proc/66980/task/67581/root (readlink: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67581 safe_time ceph txt unknown /proc/66980/task/67581/exe (readlink: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67581 safe_time ceph NOFD /proc/66980/task/67581/fd (opendir: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67582 safe_time ceph cwd unknown /proc/66980/task/67582/cwd (readlink: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67582 safe_time ceph rtd unknown /proc/66980/task/67582/root (readlink: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67582 safe_time ceph txt unknown /proc/66980/task/67582/exe (readlink: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67582 safe_time ceph NOFD /proc/66980/task/67582/fd (opendir: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67583 safe_time ceph cwd unknown /proc/66980/task/67583/cwd (readlink: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67583 safe_time ceph rtd unknown /proc/66980/task/67583/root (readlink: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67583 safe_time ceph txt unknown /proc/66980/task/67583/exe (readlink: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67583 safe_time ceph NOFD /proc/66980/task/67583/fd (opendir: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67584 safe_time ceph cwd unknown /proc/66980/task/67584/cwd (readlink: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67584 safe_time ceph rtd unknown /proc/66980/task/67584/root (readlink: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67584 safe_time ceph txt unknown /proc/66980/task/67584/exe (readlink: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67584 safe_time ceph NOFD /proc/66980/task/67584/fd (opendir: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67585 fn_anonym ceph cwd unknown /proc/66980/task/67585/cwd (readlink: Permission denied) 2024-09-21T05:55:49.727 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67585 fn_anonym ceph rtd unknown /proc/66980/task/67585/root (readlink: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67585 fn_anonym ceph txt unknown /proc/66980/task/67585/exe (readlink: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67585 fn_anonym ceph NOFD /proc/66980/task/67585/fd (opendir: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67614 rocksdb:l ceph cwd unknown /proc/66980/task/67614/cwd (readlink: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67614 rocksdb:l ceph rtd unknown /proc/66980/task/67614/root (readlink: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67614 rocksdb:l ceph txt unknown /proc/66980/task/67614/exe (readlink: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67614 rocksdb:l ceph NOFD /proc/66980/task/67614/fd (opendir: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67615 rocksdb:l ceph cwd unknown /proc/66980/task/67615/cwd (readlink: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67615 rocksdb:l ceph rtd unknown /proc/66980/task/67615/root (readlink: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67615 rocksdb:l ceph txt unknown /proc/66980/task/67615/exe (readlink: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67615 rocksdb:l ceph NOFD /proc/66980/task/67615/fd (opendir: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67616 rocksdb:l ceph cwd unknown /proc/66980/task/67616/cwd (readlink: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67616 rocksdb:l ceph rtd unknown /proc/66980/task/67616/root (readlink: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67616 rocksdb:l ceph txt unknown /proc/66980/task/67616/exe (readlink: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67616 rocksdb:l ceph NOFD /proc/66980/task/67616/fd (opendir: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67617 rocksdb:h ceph cwd unknown /proc/66980/task/67617/cwd (readlink: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67617 rocksdb:h ceph rtd unknown /proc/66980/task/67617/root (readlink: Permission denied) 2024-09-21T05:55:49.728 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67617 rocksdb:h ceph txt unknown /proc/66980/task/67617/exe (readlink: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 67617 rocksdb:h ceph NOFD /proc/66980/task/67617/fd (opendir: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68016 bstore_ai ceph cwd unknown /proc/66980/task/68016/cwd (readlink: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68016 bstore_ai ceph rtd unknown /proc/66980/task/68016/root (readlink: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68016 bstore_ai ceph txt unknown /proc/66980/task/68016/exe (readlink: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68016 bstore_ai ceph NOFD /proc/66980/task/68016/fd (opendir: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68226 bstore_ai ceph cwd unknown /proc/66980/task/68226/cwd (readlink: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68226 bstore_ai ceph rtd unknown /proc/66980/task/68226/root (readlink: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68226 bstore_ai ceph txt unknown /proc/66980/task/68226/exe (readlink: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68226 bstore_ai ceph NOFD /proc/66980/task/68226/fd (opendir: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68412 ceph-osd ceph cwd unknown /proc/66980/task/68412/cwd (readlink: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68412 ceph-osd ceph rtd unknown /proc/66980/task/68412/root (readlink: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68412 ceph-osd ceph txt unknown /proc/66980/task/68412/exe (readlink: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68412 ceph-osd ceph NOFD /proc/66980/task/68412/fd (opendir: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68413 cfin ceph cwd unknown /proc/66980/task/68413/cwd (readlink: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68413 cfin ceph rtd unknown /proc/66980/task/68413/root (readlink: Permission denied) 2024-09-21T05:55:49.729 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68413 cfin ceph txt unknown /proc/66980/task/68413/exe (readlink: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68413 cfin ceph NOFD /proc/66980/task/68413/fd (opendir: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68414 bstore_kv ceph cwd unknown /proc/66980/task/68414/cwd (readlink: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68414 bstore_kv ceph rtd unknown /proc/66980/task/68414/root (readlink: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68414 bstore_kv ceph txt unknown /proc/66980/task/68414/exe (readlink: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68414 bstore_kv ceph NOFD /proc/66980/task/68414/fd (opendir: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68415 bstore_kv ceph cwd unknown /proc/66980/task/68415/cwd (readlink: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68415 bstore_kv ceph rtd unknown /proc/66980/task/68415/root (readlink: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68415 bstore_kv ceph txt unknown /proc/66980/task/68415/exe (readlink: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68415 bstore_kv ceph NOFD /proc/66980/task/68415/fd (opendir: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68416 bstore_me ceph cwd unknown /proc/66980/task/68416/cwd (readlink: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68416 bstore_me ceph rtd unknown /proc/66980/task/68416/root (readlink: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68416 bstore_me ceph txt unknown /proc/66980/task/68416/exe (readlink: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68416 bstore_me ceph NOFD /proc/66980/task/68416/fd (opendir: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68419 ms_dispat ceph cwd unknown /proc/66980/task/68419/cwd (readlink: Permission denied) 2024-09-21T05:55:49.730 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68419 ms_dispat ceph rtd unknown /proc/66980/task/68419/root (readlink: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68419 ms_dispat ceph txt unknown /proc/66980/task/68419/exe (readlink: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68419 ms_dispat ceph NOFD /proc/66980/task/68419/fd (opendir: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68420 ms_local ceph cwd unknown /proc/66980/task/68420/cwd (readlink: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68420 ms_local ceph rtd unknown /proc/66980/task/68420/root (readlink: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68420 ms_local ceph txt unknown /proc/66980/task/68420/exe (readlink: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68420 ms_local ceph NOFD /proc/66980/task/68420/fd (opendir: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68421 safe_time ceph cwd unknown /proc/66980/task/68421/cwd (readlink: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68421 safe_time ceph rtd unknown /proc/66980/task/68421/root (readlink: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68421 safe_time ceph txt unknown /proc/66980/task/68421/exe (readlink: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68421 safe_time ceph NOFD /proc/66980/task/68421/fd (opendir: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68422 safe_time ceph cwd unknown /proc/66980/task/68422/cwd (readlink: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68422 safe_time ceph rtd unknown /proc/66980/task/68422/root (readlink: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68422 safe_time ceph txt unknown /proc/66980/task/68422/exe (readlink: Permission denied) 2024-09-21T05:55:49.731 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68422 safe_time ceph NOFD /proc/66980/task/68422/fd (opendir: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68423 ms_dispat ceph cwd unknown /proc/66980/task/68423/cwd (readlink: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68423 ms_dispat ceph rtd unknown /proc/66980/task/68423/root (readlink: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68423 ms_dispat ceph txt unknown /proc/66980/task/68423/exe (readlink: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68423 ms_dispat ceph NOFD /proc/66980/task/68423/fd (opendir: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68424 ms_local ceph cwd unknown /proc/66980/task/68424/cwd (readlink: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68424 ms_local ceph rtd unknown /proc/66980/task/68424/root (readlink: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68424 ms_local ceph txt unknown /proc/66980/task/68424/exe (readlink: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68424 ms_local ceph NOFD /proc/66980/task/68424/fd (opendir: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68425 ms_dispat ceph cwd unknown /proc/66980/task/68425/cwd (readlink: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68425 ms_dispat ceph rtd unknown /proc/66980/task/68425/root (readlink: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68425 ms_dispat ceph txt unknown /proc/66980/task/68425/exe (readlink: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68425 ms_dispat ceph NOFD /proc/66980/task/68425/fd (opendir: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68426 ms_local ceph cwd unknown /proc/66980/task/68426/cwd (readlink: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68426 ms_local ceph rtd unknown /proc/66980/task/68426/root (readlink: Permission denied) 2024-09-21T05:55:49.732 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68426 ms_local ceph txt unknown /proc/66980/task/68426/exe (readlink: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68426 ms_local ceph NOFD /proc/66980/task/68426/fd (opendir: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68427 ms_dispat ceph cwd unknown /proc/66980/task/68427/cwd (readlink: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68427 ms_dispat ceph rtd unknown /proc/66980/task/68427/root (readlink: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68427 ms_dispat ceph txt unknown /proc/66980/task/68427/exe (readlink: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68427 ms_dispat ceph NOFD /proc/66980/task/68427/fd (opendir: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68428 ms_local ceph cwd unknown /proc/66980/task/68428/cwd (readlink: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68428 ms_local ceph rtd unknown /proc/66980/task/68428/root (readlink: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68428 ms_local ceph txt unknown /proc/66980/task/68428/exe (readlink: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68428 ms_local ceph NOFD /proc/66980/task/68428/fd (opendir: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68429 ms_dispat ceph cwd unknown /proc/66980/task/68429/cwd (readlink: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68429 ms_dispat ceph rtd unknown /proc/66980/task/68429/root (readlink: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68429 ms_dispat ceph txt unknown /proc/66980/task/68429/exe (readlink: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68429 ms_dispat ceph NOFD /proc/66980/task/68429/fd (opendir: Permission denied) 2024-09-21T05:55:49.733 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68430 ms_local ceph cwd unknown /proc/66980/task/68430/cwd (readlink: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68430 ms_local ceph rtd unknown /proc/66980/task/68430/root (readlink: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68430 ms_local ceph txt unknown /proc/66980/task/68430/exe (readlink: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68430 ms_local ceph NOFD /proc/66980/task/68430/fd (opendir: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68431 ms_dispat ceph cwd unknown /proc/66980/task/68431/cwd (readlink: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68431 ms_dispat ceph rtd unknown /proc/66980/task/68431/root (readlink: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68431 ms_dispat ceph txt unknown /proc/66980/task/68431/exe (readlink: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68431 ms_dispat ceph NOFD /proc/66980/task/68431/fd (opendir: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68432 ms_local ceph cwd unknown /proc/66980/task/68432/cwd (readlink: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68432 ms_local ceph rtd unknown /proc/66980/task/68432/root (readlink: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68432 ms_local ceph txt unknown /proc/66980/task/68432/exe (readlink: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68432 ms_local ceph NOFD /proc/66980/task/68432/fd (opendir: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68433 ms_dispat ceph cwd unknown /proc/66980/task/68433/cwd (readlink: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68433 ms_dispat ceph rtd unknown /proc/66980/task/68433/root (readlink: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68433 ms_dispat ceph txt unknown /proc/66980/task/68433/exe (readlink: Permission denied) 2024-09-21T05:55:49.734 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68433 ms_dispat ceph NOFD /proc/66980/task/68433/fd (opendir: Permission denied) 2024-09-21T05:55:49.735 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68434 ms_local ceph cwd unknown /proc/66980/task/68434/cwd (readlink: Permission denied) 2024-09-21T05:55:49.735 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68434 ms_local ceph rtd unknown /proc/66980/task/68434/root (readlink: Permission denied) 2024-09-21T05:55:49.735 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68434 ms_local ceph txt unknown /proc/66980/task/68434/exe (readlink: Permission denied) 2024-09-21T05:55:49.735 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68434 ms_local ceph NOFD /proc/66980/task/68434/fd (opendir: Permission denied) 2024-09-21T05:55:49.735 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68435 fn_anonym ceph cwd unknown /proc/66980/task/68435/cwd (readlink: Permission denied) 2024-09-21T05:55:49.735 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68435 fn_anonym ceph rtd unknown /proc/66980/task/68435/root (readlink: Permission denied) 2024-09-21T05:55:49.735 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68435 fn_anonym ceph txt unknown /proc/66980/task/68435/exe (readlink: Permission denied) 2024-09-21T05:55:49.735 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68435 fn_anonym ceph NOFD /proc/66980/task/68435/fd (opendir: Permission denied) 2024-09-21T05:55:49.735 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68436 finisher ceph cwd unknown /proc/66980/task/68436/cwd (readlink: Permission denied) 2024-09-21T05:55:49.735 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68436 finisher ceph rtd unknown /proc/66980/task/68436/root (readlink: Permission denied) 2024-09-21T05:55:49.735 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68436 finisher ceph txt unknown /proc/66980/task/68436/exe (readlink: Permission denied) 2024-09-21T05:55:49.735 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68436 finisher ceph NOFD /proc/66980/task/68436/fd (opendir: Permission denied) 2024-09-21T05:55:49.735 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68437 safe_time ceph cwd unknown /proc/66980/task/68437/cwd (readlink: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68437 safe_time ceph rtd unknown /proc/66980/task/68437/root (readlink: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68437 safe_time ceph txt unknown /proc/66980/task/68437/exe (readlink: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68437 safe_time ceph NOFD /proc/66980/task/68437/fd (opendir: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68438 safe_time ceph cwd unknown /proc/66980/task/68438/cwd (readlink: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68438 safe_time ceph rtd unknown /proc/66980/task/68438/root (readlink: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68438 safe_time ceph txt unknown /proc/66980/task/68438/exe (readlink: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68438 safe_time ceph NOFD /proc/66980/task/68438/fd (opendir: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68439 ceph-osd ceph cwd unknown /proc/66980/task/68439/cwd (readlink: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68439 ceph-osd ceph rtd unknown /proc/66980/task/68439/root (readlink: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68439 ceph-osd ceph txt unknown /proc/66980/task/68439/exe (readlink: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68439 ceph-osd ceph NOFD /proc/66980/task/68439/fd (opendir: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68440 osd_srv_a ceph cwd unknown /proc/66980/task/68440/cwd (readlink: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68440 osd_srv_a ceph rtd unknown /proc/66980/task/68440/root (readlink: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68440 osd_srv_a ceph txt unknown /proc/66980/task/68440/exe (readlink: Permission denied) 2024-09-21T05:55:49.736 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68440 osd_srv_a ceph NOFD /proc/66980/task/68440/fd (opendir: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68441 tp_osd_tp ceph cwd unknown /proc/66980/task/68441/cwd (readlink: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68441 tp_osd_tp ceph rtd unknown /proc/66980/task/68441/root (readlink: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68441 tp_osd_tp ceph txt unknown /proc/66980/task/68441/exe (readlink: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68441 tp_osd_tp ceph NOFD /proc/66980/task/68441/fd (opendir: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68442 tp_osd_tp ceph cwd unknown /proc/66980/task/68442/cwd (readlink: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68442 tp_osd_tp ceph rtd unknown /proc/66980/task/68442/root (readlink: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68442 tp_osd_tp ceph txt unknown /proc/66980/task/68442/exe (readlink: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68442 tp_osd_tp ceph NOFD /proc/66980/task/68442/fd (opendir: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68443 tp_osd_tp ceph cwd unknown /proc/66980/task/68443/cwd (readlink: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68443 tp_osd_tp ceph rtd unknown /proc/66980/task/68443/root (readlink: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68443 tp_osd_tp ceph txt unknown /proc/66980/task/68443/exe (readlink: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68443 tp_osd_tp ceph NOFD /proc/66980/task/68443/fd (opendir: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68444 tp_osd_tp ceph cwd unknown /proc/66980/task/68444/cwd (readlink: Permission denied) 2024-09-21T05:55:49.737 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68444 tp_osd_tp ceph rtd unknown /proc/66980/task/68444/root (readlink: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68444 tp_osd_tp ceph txt unknown /proc/66980/task/68444/exe (readlink: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68444 tp_osd_tp ceph NOFD /proc/66980/task/68444/fd (opendir: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68445 tp_osd_tp ceph cwd unknown /proc/66980/task/68445/cwd (readlink: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68445 tp_osd_tp ceph rtd unknown /proc/66980/task/68445/root (readlink: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68445 tp_osd_tp ceph txt unknown /proc/66980/task/68445/exe (readlink: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68445 tp_osd_tp ceph NOFD /proc/66980/task/68445/fd (opendir: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68446 tp_osd_tp ceph cwd unknown /proc/66980/task/68446/cwd (readlink: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68446 tp_osd_tp ceph rtd unknown /proc/66980/task/68446/root (readlink: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68446 tp_osd_tp ceph txt unknown /proc/66980/task/68446/exe (readlink: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68446 tp_osd_tp ceph NOFD /proc/66980/task/68446/fd (opendir: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68447 tp_osd_tp ceph cwd unknown /proc/66980/task/68447/cwd (readlink: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68447 tp_osd_tp ceph rtd unknown /proc/66980/task/68447/root (readlink: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68447 tp_osd_tp ceph txt unknown /proc/66980/task/68447/exe (readlink: Permission denied) 2024-09-21T05:55:49.738 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68447 tp_osd_tp ceph NOFD /proc/66980/task/68447/fd (opendir: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68448 tp_osd_tp ceph cwd unknown /proc/66980/task/68448/cwd (readlink: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68448 tp_osd_tp ceph rtd unknown /proc/66980/task/68448/root (readlink: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68448 tp_osd_tp ceph txt unknown /proc/66980/task/68448/exe (readlink: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68448 tp_osd_tp ceph NOFD /proc/66980/task/68448/fd (opendir: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68449 tp_osd_tp ceph cwd unknown /proc/66980/task/68449/cwd (readlink: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68449 tp_osd_tp ceph rtd unknown /proc/66980/task/68449/root (readlink: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68449 tp_osd_tp ceph txt unknown /proc/66980/task/68449/exe (readlink: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68449 tp_osd_tp ceph NOFD /proc/66980/task/68449/fd (opendir: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68450 tp_osd_tp ceph cwd unknown /proc/66980/task/68450/cwd (readlink: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68450 tp_osd_tp ceph rtd unknown /proc/66980/task/68450/root (readlink: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68450 tp_osd_tp ceph txt unknown /proc/66980/task/68450/exe (readlink: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68450 tp_osd_tp ceph NOFD /proc/66980/task/68450/fd (opendir: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68451 tp_osd_tp ceph cwd unknown /proc/66980/task/68451/cwd (readlink: Permission denied) 2024-09-21T05:55:49.739 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68451 tp_osd_tp ceph rtd unknown /proc/66980/task/68451/root (readlink: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68451 tp_osd_tp ceph txt unknown /proc/66980/task/68451/exe (readlink: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68451 tp_osd_tp ceph NOFD /proc/66980/task/68451/fd (opendir: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68452 tp_osd_tp ceph cwd unknown /proc/66980/task/68452/cwd (readlink: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68452 tp_osd_tp ceph rtd unknown /proc/66980/task/68452/root (readlink: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68452 tp_osd_tp ceph txt unknown /proc/66980/task/68452/exe (readlink: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68452 tp_osd_tp ceph NOFD /proc/66980/task/68452/fd (opendir: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68453 tp_osd_tp ceph cwd unknown /proc/66980/task/68453/cwd (readlink: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68453 tp_osd_tp ceph rtd unknown /proc/66980/task/68453/root (readlink: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68453 tp_osd_tp ceph txt unknown /proc/66980/task/68453/exe (readlink: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68453 tp_osd_tp ceph NOFD /proc/66980/task/68453/fd (opendir: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68454 tp_osd_tp ceph cwd unknown /proc/66980/task/68454/cwd (readlink: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68454 tp_osd_tp ceph rtd unknown /proc/66980/task/68454/root (readlink: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68454 tp_osd_tp ceph txt unknown /proc/66980/task/68454/exe (readlink: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68454 tp_osd_tp ceph NOFD /proc/66980/task/68454/fd (opendir: Permission denied) 2024-09-21T05:55:49.740 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68455 tp_osd_tp ceph cwd unknown /proc/66980/task/68455/cwd (readlink: Permission denied) 2024-09-21T05:55:49.741 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68455 tp_osd_tp ceph rtd unknown /proc/66980/task/68455/root (readlink: Permission denied) 2024-09-21T05:55:49.741 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68455 tp_osd_tp ceph txt unknown /proc/66980/task/68455/exe (readlink: Permission denied) 2024-09-21T05:55:49.741 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68455 tp_osd_tp ceph NOFD /proc/66980/task/68455/fd (opendir: Permission denied) 2024-09-21T05:55:49.741 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68456 tp_osd_tp ceph cwd unknown /proc/66980/task/68456/cwd (readlink: Permission denied) 2024-09-21T05:55:49.741 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68456 tp_osd_tp ceph rtd unknown /proc/66980/task/68456/root (readlink: Permission denied) 2024-09-21T05:55:49.741 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68456 tp_osd_tp ceph txt unknown /proc/66980/task/68456/exe (readlink: Permission denied) 2024-09-21T05:55:49.741 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68456 tp_osd_tp ceph NOFD /proc/66980/task/68456/fd (opendir: Permission denied) 2024-09-21T05:55:49.741 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68457 osd_srv_h ceph cwd unknown /proc/66980/task/68457/cwd (readlink: Permission denied) 2024-09-21T05:55:49.741 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68457 osd_srv_h ceph rtd unknown /proc/66980/task/68457/root (readlink: Permission denied) 2024-09-21T05:55:49.741 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68457 osd_srv_h ceph txt unknown /proc/66980/task/68457/exe (readlink: Permission denied) 2024-09-21T05:55:49.741 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 66980 68457 osd_srv_h ceph NOFD /proc/66980/task/68457/fd (opendir: Permission denied) 2024-09-21T05:55:49.741 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 67185 root cwd unknown /proc/67185/cwd (readlink: Permission denied) 2024-09-21T05:55:49.741 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 67185 root rtd unknown /proc/67185/root (readlink: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 67185 root txt unknown /proc/67185/exe (readlink: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 67185 root NOFD /proc/67185/fd (opendir: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 67532 root cwd unknown /proc/67532/cwd (readlink: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 67532 root rtd unknown /proc/67532/root (readlink: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 67532 root txt unknown /proc/67532/exe (readlink: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 67532 root NOFD /proc/67532/fd (opendir: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 67553 root cwd unknown /proc/67553/cwd (readlink: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 67553 root rtd unknown /proc/67553/root (readlink: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 67553 root txt unknown /proc/67553/exe (readlink: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 67553 root NOFD /proc/67553/fd (opendir: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 70828 root cwd unknown /proc/70828/cwd (readlink: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 70828 root rtd unknown /proc/70828/root (readlink: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 70828 root txt unknown /proc/70828/exe (readlink: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 70828 root NOFD /proc/70828/fd (opendir: Permission denied) 2024-09-21T05:55:49.742 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 71437 root cwd unknown /proc/71437/cwd (readlink: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 71437 root rtd unknown /proc/71437/root (readlink: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 71437 root txt unknown /proc/71437/exe (readlink: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 71437 root NOFD /proc/71437/fd (opendir: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71441 root cwd unknown /proc/71441/cwd (readlink: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71441 root rtd unknown /proc/71441/root (readlink: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71441 root txt unknown /proc/71441/exe (readlink: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71441 root NOFD /proc/71441/fd (opendir: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71458 root cwd unknown /proc/71458/cwd (readlink: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71458 root rtd unknown /proc/71458/root (readlink: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71458 root txt unknown /proc/71458/exe (readlink: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71458 root NOFD /proc/71458/fd (opendir: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71459 root cwd unknown /proc/71459/cwd (readlink: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71459 root rtd unknown /proc/71459/root (readlink: Permission denied) 2024-09-21T05:55:49.743 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71459 root txt unknown /proc/71459/exe (readlink: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71459 root NOFD /proc/71459/fd (opendir: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71476 root cwd unknown /proc/71476/cwd (readlink: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71476 root rtd unknown /proc/71476/root (readlink: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71476 root txt unknown /proc/71476/exe (readlink: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71476 root NOFD /proc/71476/fd (opendir: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71477 root cwd unknown /proc/71477/cwd (readlink: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71477 root rtd unknown /proc/71477/root (readlink: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71477 root txt unknown /proc/71477/exe (readlink: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71477 root NOFD /proc/71477/fd (opendir: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71494 root cwd unknown /proc/71494/cwd (readlink: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71494 root rtd unknown /proc/71494/root (readlink: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71494 root txt unknown /proc/71494/exe (readlink: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71494 root NOFD /proc/71494/fd (opendir: Permission denied) 2024-09-21T05:55:49.744 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71495 root cwd unknown /proc/71495/cwd (readlink: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71495 root rtd unknown /proc/71495/root (readlink: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71495 root txt unknown /proc/71495/exe (readlink: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 71495 root NOFD /proc/71495/fd (opendir: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71512 root cwd unknown /proc/71512/cwd (readlink: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71512 root rtd unknown /proc/71512/root (readlink: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71512 root txt unknown /proc/71512/exe (readlink: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 71512 root NOFD /proc/71512/fd (opendir: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 71979 root cwd unknown /proc/71979/cwd (readlink: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 71979 root rtd unknown /proc/71979/root (readlink: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 71979 root txt unknown /proc/71979/exe (readlink: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 71979 root NOFD /proc/71979/fd (opendir: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 71981 root cwd unknown /proc/71981/cwd (readlink: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 71981 root rtd unknown /proc/71981/root (readlink: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 71981 root txt unknown /proc/71981/exe (readlink: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 71981 root NOFD /proc/71981/fd (opendir: Permission denied) 2024-09-21T05:55:49.745 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 ceph cwd unknown /proc/71983/cwd (readlink: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 ceph rtd unknown /proc/71983/root (readlink: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 ceph txt unknown /proc/71983/exe (readlink: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 ceph NOFD /proc/71983/fd (opendir: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71984 log ceph cwd unknown /proc/71983/task/71984/cwd (readlink: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71984 log ceph rtd unknown /proc/71983/task/71984/root (readlink: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71984 log ceph txt unknown /proc/71983/task/71984/exe (readlink: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71984 log ceph NOFD /proc/71983/task/71984/fd (opendir: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71986 msgr-work ceph cwd unknown /proc/71983/task/71986/cwd (readlink: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71986 msgr-work ceph rtd unknown /proc/71983/task/71986/root (readlink: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71986 msgr-work ceph txt unknown /proc/71983/task/71986/exe (readlink: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71986 msgr-work ceph NOFD /proc/71983/task/71986/fd (opendir: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71987 msgr-work ceph cwd unknown /proc/71983/task/71987/cwd (readlink: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71987 msgr-work ceph rtd unknown /proc/71983/task/71987/root (readlink: Permission denied) 2024-09-21T05:55:49.746 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71987 msgr-work ceph txt unknown /proc/71983/task/71987/exe (readlink: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71987 msgr-work ceph NOFD /proc/71983/task/71987/fd (opendir: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71988 msgr-work ceph cwd unknown /proc/71983/task/71988/cwd (readlink: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71988 msgr-work ceph rtd unknown /proc/71983/task/71988/root (readlink: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71988 msgr-work ceph txt unknown /proc/71983/task/71988/exe (readlink: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71988 msgr-work ceph NOFD /proc/71983/task/71988/fd (opendir: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71992 service ceph cwd unknown /proc/71983/task/71992/cwd (readlink: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71992 service ceph rtd unknown /proc/71983/task/71992/root (readlink: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71992 service ceph txt unknown /proc/71983/task/71992/exe (readlink: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71992 service ceph NOFD /proc/71983/task/71992/fd (opendir: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71993 admin_soc ceph cwd unknown /proc/71983/task/71993/cwd (readlink: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71993 admin_soc ceph rtd unknown /proc/71983/task/71993/root (readlink: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71993 admin_soc ceph txt unknown /proc/71983/task/71993/exe (readlink: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71993 admin_soc ceph NOFD /proc/71983/task/71993/fd (opendir: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71994 signal_ha ceph cwd unknown /proc/71983/task/71994/cwd (readlink: Permission denied) 2024-09-21T05:55:49.747 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71994 signal_ha ceph rtd unknown /proc/71983/task/71994/root (readlink: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71994 signal_ha ceph txt unknown /proc/71983/task/71994/exe (readlink: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71994 signal_ha ceph NOFD /proc/71983/task/71994/fd (opendir: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71995 io_contex ceph cwd unknown /proc/71983/task/71995/cwd (readlink: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71995 io_contex ceph rtd unknown /proc/71983/task/71995/root (readlink: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71995 io_contex ceph txt unknown /proc/71983/task/71995/exe (readlink: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71995 io_contex ceph NOFD /proc/71983/task/71995/fd (opendir: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71996 io_contex ceph cwd unknown /proc/71983/task/71996/cwd (readlink: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71996 io_contex ceph rtd unknown /proc/71983/task/71996/root (readlink: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71996 io_contex ceph txt unknown /proc/71983/task/71996/exe (readlink: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71996 io_contex ceph NOFD /proc/71983/task/71996/fd (opendir: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71997 ms_dispat ceph cwd unknown /proc/71983/task/71997/cwd (readlink: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71997 ms_dispat ceph rtd unknown /proc/71983/task/71997/root (readlink: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71997 ms_dispat ceph txt unknown /proc/71983/task/71997/exe (readlink: Permission denied) 2024-09-21T05:55:49.748 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71997 ms_dispat ceph NOFD /proc/71983/task/71997/fd (opendir: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71998 ms_local ceph cwd unknown /proc/71983/task/71998/cwd (readlink: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71998 ms_local ceph rtd unknown /proc/71983/task/71998/root (readlink: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71998 ms_local ceph txt unknown /proc/71983/task/71998/exe (readlink: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71998 ms_local ceph NOFD /proc/71983/task/71998/fd (opendir: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71999 safe_time ceph cwd unknown /proc/71983/task/71999/cwd (readlink: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71999 safe_time ceph rtd unknown /proc/71983/task/71999/root (readlink: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71999 safe_time ceph txt unknown /proc/71983/task/71999/exe (readlink: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 71999 safe_time ceph NOFD /proc/71983/task/71999/fd (opendir: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 72000 safe_time ceph cwd unknown /proc/71983/task/72000/cwd (readlink: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 72000 safe_time ceph rtd unknown /proc/71983/task/72000/root (readlink: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 72000 safe_time ceph txt unknown /proc/71983/task/72000/exe (readlink: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 72000 safe_time ceph NOFD /proc/71983/task/72000/fd (opendir: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 72001 ceph-mds ceph cwd unknown /proc/71983/task/72001/cwd (readlink: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 72001 ceph-mds ceph rtd unknown /proc/71983/task/72001/root (readlink: Permission denied) 2024-09-21T05:55:49.749 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 72001 ceph-mds ceph txt unknown /proc/71983/task/72001/exe (readlink: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 72001 ceph-mds ceph NOFD /proc/71983/task/72001/fd (opendir: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 72040 safe_time ceph cwd unknown /proc/71983/task/72040/cwd (readlink: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 72040 safe_time ceph rtd unknown /proc/71983/task/72040/root (readlink: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 72040 safe_time ceph txt unknown /proc/71983/task/72040/exe (readlink: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71983 72040 safe_time ceph NOFD /proc/71983/task/72040/fd (opendir: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 72359 root cwd unknown /proc/72359/cwd (readlink: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 72359 root rtd unknown /proc/72359/root (readlink: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 72359 root txt unknown /proc/72359/exe (readlink: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 72359 root NOFD /proc/72359/fd (opendir: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 72361 root cwd unknown /proc/72361/cwd (readlink: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 72361 root rtd unknown /proc/72361/root (readlink: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 72361 root txt unknown /proc/72361/exe (readlink: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 72361 root NOFD /proc/72361/fd (opendir: Permission denied) 2024-09-21T05:55:49.750 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 ceph cwd unknown /proc/72367/cwd (readlink: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 ceph rtd unknown /proc/72367/root (readlink: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 ceph txt unknown /proc/72367/exe (readlink: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 ceph NOFD /proc/72367/fd (opendir: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72368 log ceph cwd unknown /proc/72367/task/72368/cwd (readlink: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72368 log ceph rtd unknown /proc/72367/task/72368/root (readlink: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72368 log ceph txt unknown /proc/72367/task/72368/exe (readlink: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72368 log ceph NOFD /proc/72367/task/72368/fd (opendir: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72370 msgr-work ceph cwd unknown /proc/72367/task/72370/cwd (readlink: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72370 msgr-work ceph rtd unknown /proc/72367/task/72370/root (readlink: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72370 msgr-work ceph txt unknown /proc/72367/task/72370/exe (readlink: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72370 msgr-work ceph NOFD /proc/72367/task/72370/fd (opendir: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72371 msgr-work ceph cwd unknown /proc/72367/task/72371/cwd (readlink: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72371 msgr-work ceph rtd unknown /proc/72367/task/72371/root (readlink: Permission denied) 2024-09-21T05:55:49.751 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72371 msgr-work ceph txt unknown /proc/72367/task/72371/exe (readlink: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72371 msgr-work ceph NOFD /proc/72367/task/72371/fd (opendir: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72372 msgr-work ceph cwd unknown /proc/72367/task/72372/cwd (readlink: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72372 msgr-work ceph rtd unknown /proc/72367/task/72372/root (readlink: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72372 msgr-work ceph txt unknown /proc/72367/task/72372/exe (readlink: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72372 msgr-work ceph NOFD /proc/72367/task/72372/fd (opendir: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72376 service ceph cwd unknown /proc/72367/task/72376/cwd (readlink: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72376 service ceph rtd unknown /proc/72367/task/72376/root (readlink: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72376 service ceph txt unknown /proc/72367/task/72376/exe (readlink: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72376 service ceph NOFD /proc/72367/task/72376/fd (opendir: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72377 admin_soc ceph cwd unknown /proc/72367/task/72377/cwd (readlink: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72377 admin_soc ceph rtd unknown /proc/72367/task/72377/root (readlink: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72377 admin_soc ceph txt unknown /proc/72367/task/72377/exe (readlink: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72377 admin_soc ceph NOFD /proc/72367/task/72377/fd (opendir: Permission denied) 2024-09-21T05:55:49.752 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72378 signal_ha ceph cwd unknown /proc/72367/task/72378/cwd (readlink: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72378 signal_ha ceph rtd unknown /proc/72367/task/72378/root (readlink: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72378 signal_ha ceph txt unknown /proc/72367/task/72378/exe (readlink: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72378 signal_ha ceph NOFD /proc/72367/task/72378/fd (opendir: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72379 io_contex ceph cwd unknown /proc/72367/task/72379/cwd (readlink: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72379 io_contex ceph rtd unknown /proc/72367/task/72379/root (readlink: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72379 io_contex ceph txt unknown /proc/72367/task/72379/exe (readlink: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72379 io_contex ceph NOFD /proc/72367/task/72379/fd (opendir: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72380 io_contex ceph cwd unknown /proc/72367/task/72380/cwd (readlink: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72380 io_contex ceph rtd unknown /proc/72367/task/72380/root (readlink: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72380 io_contex ceph txt unknown /proc/72367/task/72380/exe (readlink: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72380 io_contex ceph NOFD /proc/72367/task/72380/fd (opendir: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72381 ms_dispat ceph cwd unknown /proc/72367/task/72381/cwd (readlink: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72381 ms_dispat ceph rtd unknown /proc/72367/task/72381/root (readlink: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72381 ms_dispat ceph txt unknown /proc/72367/task/72381/exe (readlink: Permission denied) 2024-09-21T05:55:49.753 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72381 ms_dispat ceph NOFD /proc/72367/task/72381/fd (opendir: Permission denied) 2024-09-21T05:55:49.754 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72382 ms_local ceph cwd unknown /proc/72367/task/72382/cwd (readlink: Permission denied) 2024-09-21T05:55:49.754 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72382 ms_local ceph rtd unknown /proc/72367/task/72382/root (readlink: Permission denied) 2024-09-21T05:55:49.754 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72382 ms_local ceph txt unknown /proc/72367/task/72382/exe (readlink: Permission denied) 2024-09-21T05:55:49.754 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72382 ms_local ceph NOFD /proc/72367/task/72382/fd (opendir: Permission denied) 2024-09-21T05:55:49.754 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72383 safe_time ceph cwd unknown /proc/72367/task/72383/cwd (readlink: Permission denied) 2024-09-21T05:55:49.754 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72383 safe_time ceph rtd unknown /proc/72367/task/72383/root (readlink: Permission denied) 2024-09-21T05:55:49.754 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72383 safe_time ceph txt unknown /proc/72367/task/72383/exe (readlink: Permission denied) 2024-09-21T05:55:49.754 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72383 safe_time ceph NOFD /proc/72367/task/72383/fd (opendir: Permission denied) 2024-09-21T05:55:49.754 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72384 safe_time ceph cwd unknown /proc/72367/task/72384/cwd (readlink: Permission denied) 2024-09-21T05:55:49.754 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72384 safe_time ceph rtd unknown /proc/72367/task/72384/root (readlink: Permission denied) 2024-09-21T05:55:49.754 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72384 safe_time ceph txt unknown /proc/72367/task/72384/exe (readlink: Permission denied) 2024-09-21T05:55:49.754 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72384 safe_time ceph NOFD /proc/72367/task/72384/fd (opendir: Permission denied) 2024-09-21T05:55:49.754 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72385 ceph-mds ceph cwd unknown /proc/72367/task/72385/cwd (readlink: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72385 ceph-mds ceph rtd unknown /proc/72367/task/72385/root (readlink: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72385 ceph-mds ceph txt unknown /proc/72367/task/72385/exe (readlink: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72385 ceph-mds ceph NOFD /proc/72367/task/72385/fd (opendir: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72390 safe_time ceph cwd unknown /proc/72367/task/72390/cwd (readlink: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72390 safe_time ceph rtd unknown /proc/72367/task/72390/root (readlink: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72390 safe_time ceph txt unknown /proc/72367/task/72390/exe (readlink: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72367 72390 safe_time ceph NOFD /proc/72367/task/72390/fd (opendir: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 72469 root cwd unknown /proc/72469/cwd (readlink: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 72469 root rtd unknown /proc/72469/root (readlink: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 72469 root txt unknown /proc/72469/exe (readlink: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 72469 root NOFD /proc/72469/fd (opendir: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 73100 root cwd unknown /proc/73100/cwd (readlink: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 73100 root rtd unknown /proc/73100/root (readlink: Permission denied) 2024-09-21T05:55:49.755 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 73100 root txt unknown /proc/73100/exe (readlink: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 73100 root NOFD /proc/73100/fd (opendir: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 73102 root cwd unknown /proc/73102/cwd (readlink: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 73102 root rtd unknown /proc/73102/root (readlink: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 73102 root txt unknown /proc/73102/exe (readlink: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 73102 root NOFD /proc/73102/fd (opendir: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 ceph cwd unknown /proc/73104/cwd (readlink: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 ceph rtd unknown /proc/73104/root (readlink: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 ceph txt unknown /proc/73104/exe (readlink: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 ceph NOFD /proc/73104/fd (opendir: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73105 log ceph cwd unknown /proc/73104/task/73105/cwd (readlink: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73105 log ceph rtd unknown /proc/73104/task/73105/root (readlink: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73105 log ceph txt unknown /proc/73104/task/73105/exe (readlink: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73105 log ceph NOFD /proc/73104/task/73105/fd (opendir: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73107 msgr-work ceph cwd unknown /proc/73104/task/73107/cwd (readlink: Permission denied) 2024-09-21T05:55:49.756 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73107 msgr-work ceph rtd unknown /proc/73104/task/73107/root (readlink: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73107 msgr-work ceph txt unknown /proc/73104/task/73107/exe (readlink: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73107 msgr-work ceph NOFD /proc/73104/task/73107/fd (opendir: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73108 msgr-work ceph cwd unknown /proc/73104/task/73108/cwd (readlink: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73108 msgr-work ceph rtd unknown /proc/73104/task/73108/root (readlink: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73108 msgr-work ceph txt unknown /proc/73104/task/73108/exe (readlink: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73108 msgr-work ceph NOFD /proc/73104/task/73108/fd (opendir: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73109 msgr-work ceph cwd unknown /proc/73104/task/73109/cwd (readlink: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73109 msgr-work ceph rtd unknown /proc/73104/task/73109/root (readlink: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73109 msgr-work ceph txt unknown /proc/73104/task/73109/exe (readlink: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73109 msgr-work ceph NOFD /proc/73104/task/73109/fd (opendir: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73113 service ceph cwd unknown /proc/73104/task/73113/cwd (readlink: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73113 service ceph rtd unknown /proc/73104/task/73113/root (readlink: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73113 service ceph txt unknown /proc/73104/task/73113/exe (readlink: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73113 service ceph NOFD /proc/73104/task/73113/fd (opendir: Permission denied) 2024-09-21T05:55:49.757 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73114 admin_soc ceph cwd unknown /proc/73104/task/73114/cwd (readlink: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73114 admin_soc ceph rtd unknown /proc/73104/task/73114/root (readlink: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73114 admin_soc ceph txt unknown /proc/73104/task/73114/exe (readlink: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73114 admin_soc ceph NOFD /proc/73104/task/73114/fd (opendir: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73115 signal_ha ceph cwd unknown /proc/73104/task/73115/cwd (readlink: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73115 signal_ha ceph rtd unknown /proc/73104/task/73115/root (readlink: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73115 signal_ha ceph txt unknown /proc/73104/task/73115/exe (readlink: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73115 signal_ha ceph NOFD /proc/73104/task/73115/fd (opendir: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73116 io_contex ceph cwd unknown /proc/73104/task/73116/cwd (readlink: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73116 io_contex ceph rtd unknown /proc/73104/task/73116/root (readlink: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73116 io_contex ceph txt unknown /proc/73104/task/73116/exe (readlink: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73116 io_contex ceph NOFD /proc/73104/task/73116/fd (opendir: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73117 io_contex ceph cwd unknown /proc/73104/task/73117/cwd (readlink: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73117 io_contex ceph rtd unknown /proc/73104/task/73117/root (readlink: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73117 io_contex ceph txt unknown /proc/73104/task/73117/exe (readlink: Permission denied) 2024-09-21T05:55:49.758 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73117 io_contex ceph NOFD /proc/73104/task/73117/fd (opendir: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73118 ms_dispat ceph cwd unknown /proc/73104/task/73118/cwd (readlink: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73118 ms_dispat ceph rtd unknown /proc/73104/task/73118/root (readlink: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73118 ms_dispat ceph txt unknown /proc/73104/task/73118/exe (readlink: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73118 ms_dispat ceph NOFD /proc/73104/task/73118/fd (opendir: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73119 ms_local ceph cwd unknown /proc/73104/task/73119/cwd (readlink: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73119 ms_local ceph rtd unknown /proc/73104/task/73119/root (readlink: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73119 ms_local ceph txt unknown /proc/73104/task/73119/exe (readlink: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73119 ms_local ceph NOFD /proc/73104/task/73119/fd (opendir: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73120 safe_time ceph cwd unknown /proc/73104/task/73120/cwd (readlink: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73120 safe_time ceph rtd unknown /proc/73104/task/73120/root (readlink: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73120 safe_time ceph txt unknown /proc/73104/task/73120/exe (readlink: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73120 safe_time ceph NOFD /proc/73104/task/73120/fd (opendir: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73121 safe_time ceph cwd unknown /proc/73104/task/73121/cwd (readlink: Permission denied) 2024-09-21T05:55:49.759 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73121 safe_time ceph rtd unknown /proc/73104/task/73121/root (readlink: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73121 safe_time ceph txt unknown /proc/73104/task/73121/exe (readlink: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73121 safe_time ceph NOFD /proc/73104/task/73121/fd (opendir: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73122 ceph-mds ceph cwd unknown /proc/73104/task/73122/cwd (readlink: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73122 ceph-mds ceph rtd unknown /proc/73104/task/73122/root (readlink: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73122 ceph-mds ceph txt unknown /proc/73104/task/73122/exe (readlink: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73122 ceph-mds ceph NOFD /proc/73104/task/73122/fd (opendir: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73178 safe_time ceph cwd unknown /proc/73104/task/73178/cwd (readlink: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73178 safe_time ceph rtd unknown /proc/73104/task/73178/root (readlink: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73178 safe_time ceph txt unknown /proc/73104/task/73178/exe (readlink: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73104 73178 safe_time ceph NOFD /proc/73104/task/73178/fd (opendir: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 73374 root cwd unknown /proc/73374/cwd (readlink: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 73374 root rtd unknown /proc/73374/root (readlink: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 73374 root txt unknown /proc/73374/exe (readlink: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 73374 root NOFD /proc/73374/fd (opendir: Permission denied) 2024-09-21T05:55:49.760 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 73376 root cwd unknown /proc/73376/cwd (readlink: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 73376 root rtd unknown /proc/73376/root (readlink: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 73376 root txt unknown /proc/73376/exe (readlink: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 73376 root NOFD /proc/73376/fd (opendir: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 ceph cwd unknown /proc/73396/cwd (readlink: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 ceph rtd unknown /proc/73396/root (readlink: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 ceph txt unknown /proc/73396/exe (readlink: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 ceph NOFD /proc/73396/fd (opendir: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73397 log ceph cwd unknown /proc/73396/task/73397/cwd (readlink: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73397 log ceph rtd unknown /proc/73396/task/73397/root (readlink: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73397 log ceph txt unknown /proc/73396/task/73397/exe (readlink: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73397 log ceph NOFD /proc/73396/task/73397/fd (opendir: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73399 msgr-work ceph cwd unknown /proc/73396/task/73399/cwd (readlink: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73399 msgr-work ceph rtd unknown /proc/73396/task/73399/root (readlink: Permission denied) 2024-09-21T05:55:49.761 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73399 msgr-work ceph txt unknown /proc/73396/task/73399/exe (readlink: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73399 msgr-work ceph NOFD /proc/73396/task/73399/fd (opendir: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73400 msgr-work ceph cwd unknown /proc/73396/task/73400/cwd (readlink: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73400 msgr-work ceph rtd unknown /proc/73396/task/73400/root (readlink: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73400 msgr-work ceph txt unknown /proc/73396/task/73400/exe (readlink: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73400 msgr-work ceph NOFD /proc/73396/task/73400/fd (opendir: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73401 msgr-work ceph cwd unknown /proc/73396/task/73401/cwd (readlink: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73401 msgr-work ceph rtd unknown /proc/73396/task/73401/root (readlink: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73401 msgr-work ceph txt unknown /proc/73396/task/73401/exe (readlink: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73401 msgr-work ceph NOFD /proc/73396/task/73401/fd (opendir: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73405 service ceph cwd unknown /proc/73396/task/73405/cwd (readlink: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73405 service ceph rtd unknown /proc/73396/task/73405/root (readlink: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73405 service ceph txt unknown /proc/73396/task/73405/exe (readlink: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73405 service ceph NOFD /proc/73396/task/73405/fd (opendir: Permission denied) 2024-09-21T05:55:49.762 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73406 admin_soc ceph cwd unknown /proc/73396/task/73406/cwd (readlink: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73406 admin_soc ceph rtd unknown /proc/73396/task/73406/root (readlink: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73406 admin_soc ceph txt unknown /proc/73396/task/73406/exe (readlink: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73406 admin_soc ceph NOFD /proc/73396/task/73406/fd (opendir: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73407 signal_ha ceph cwd unknown /proc/73396/task/73407/cwd (readlink: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73407 signal_ha ceph rtd unknown /proc/73396/task/73407/root (readlink: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73407 signal_ha ceph txt unknown /proc/73396/task/73407/exe (readlink: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73407 signal_ha ceph NOFD /proc/73396/task/73407/fd (opendir: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73408 io_contex ceph cwd unknown /proc/73396/task/73408/cwd (readlink: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73408 io_contex ceph rtd unknown /proc/73396/task/73408/root (readlink: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73408 io_contex ceph txt unknown /proc/73396/task/73408/exe (readlink: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73408 io_contex ceph NOFD /proc/73396/task/73408/fd (opendir: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73409 io_contex ceph cwd unknown /proc/73396/task/73409/cwd (readlink: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73409 io_contex ceph rtd unknown /proc/73396/task/73409/root (readlink: Permission denied) 2024-09-21T05:55:49.763 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73409 io_contex ceph txt unknown /proc/73396/task/73409/exe (readlink: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73409 io_contex ceph NOFD /proc/73396/task/73409/fd (opendir: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73410 ms_dispat ceph cwd unknown /proc/73396/task/73410/cwd (readlink: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73410 ms_dispat ceph rtd unknown /proc/73396/task/73410/root (readlink: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73410 ms_dispat ceph txt unknown /proc/73396/task/73410/exe (readlink: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73410 ms_dispat ceph NOFD /proc/73396/task/73410/fd (opendir: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73411 ms_local ceph cwd unknown /proc/73396/task/73411/cwd (readlink: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73411 ms_local ceph rtd unknown /proc/73396/task/73411/root (readlink: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73411 ms_local ceph txt unknown /proc/73396/task/73411/exe (readlink: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73411 ms_local ceph NOFD /proc/73396/task/73411/fd (opendir: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73412 safe_time ceph cwd unknown /proc/73396/task/73412/cwd (readlink: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73412 safe_time ceph rtd unknown /proc/73396/task/73412/root (readlink: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73412 safe_time ceph txt unknown /proc/73396/task/73412/exe (readlink: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73412 safe_time ceph NOFD /proc/73396/task/73412/fd (opendir: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73413 safe_time ceph cwd unknown /proc/73396/task/73413/cwd (readlink: Permission denied) 2024-09-21T05:55:49.764 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73413 safe_time ceph rtd unknown /proc/73396/task/73413/root (readlink: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73413 safe_time ceph txt unknown /proc/73396/task/73413/exe (readlink: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73413 safe_time ceph NOFD /proc/73396/task/73413/fd (opendir: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73414 ceph-mds ceph cwd unknown /proc/73396/task/73414/cwd (readlink: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73414 ceph-mds ceph rtd unknown /proc/73396/task/73414/root (readlink: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73414 ceph-mds ceph txt unknown /proc/73396/task/73414/exe (readlink: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73414 ceph-mds ceph NOFD /proc/73396/task/73414/fd (opendir: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73502 safe_time ceph cwd unknown /proc/73396/task/73502/cwd (readlink: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73502 safe_time ceph rtd unknown /proc/73396/task/73502/root (readlink: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73502 safe_time ceph txt unknown /proc/73396/task/73502/exe (readlink: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 73396 73502 safe_time ceph NOFD /proc/73396/task/73502/fd (opendir: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 73905 root cwd unknown /proc/73905/cwd (readlink: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 73905 root rtd unknown /proc/73905/root (readlink: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 73905 root txt unknown /proc/73905/exe (readlink: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 73905 root NOFD /proc/73905/fd (opendir: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 76192 root cwd unknown /proc/76192/cwd (readlink: Permission denied) 2024-09-21T05:55:49.765 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 76192 root rtd unknown /proc/76192/root (readlink: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 76192 root txt unknown /proc/76192/exe (readlink: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 76192 root NOFD /proc/76192/fd (opendir: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 78883 root cwd unknown /proc/78883/cwd (readlink: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 78883 root rtd unknown /proc/78883/root (readlink: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 78883 root txt unknown /proc/78883/exe (readlink: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 78883 root NOFD /proc/78883/fd (opendir: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83410 root cwd unknown /proc/83410/cwd (readlink: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83410 root rtd unknown /proc/83410/root (readlink: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83410 root txt unknown /proc/83410/exe (readlink: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83410 root NOFD /proc/83410/fd (opendir: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83411 root cwd unknown /proc/83411/cwd (readlink: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83411 root rtd unknown /proc/83411/root (readlink: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83411 root txt unknown /proc/83411/exe (readlink: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83411 root NOFD /proc/83411/fd (opendir: Permission denied) 2024-09-21T05:55:49.766 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83412 root cwd unknown /proc/83412/cwd (readlink: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83412 root rtd unknown /proc/83412/root (readlink: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83412 root txt unknown /proc/83412/exe (readlink: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83412 root NOFD /proc/83412/fd (opendir: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 84534 root cwd unknown /proc/84534/cwd (readlink: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 84534 root rtd unknown /proc/84534/root (readlink: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 84534 root txt unknown /proc/84534/exe (readlink: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 84534 root NOFD /proc/84534/fd (opendir: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 84574 root cwd unknown /proc/84574/cwd (readlink: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 84574 root rtd unknown /proc/84574/root (readlink: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 84574 root txt unknown /proc/84574/exe (readlink: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 84574 root NOFD /proc/84574/fd (opendir: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:bash 84596 root cwd unknown /proc/84596/cwd (readlink: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:bash 84596 root rtd unknown /proc/84596/root (readlink: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:bash 84596 root txt unknown /proc/84596/exe (readlink: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:bash 84596 root NOFD /proc/84596/fd (opendir: Permission denied) 2024-09-21T05:55:49.767 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 85886 root cwd unknown /proc/85886/cwd (readlink: Permission denied) 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 85886 root rtd unknown /proc/85886/root (readlink: Permission denied) 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 85886 root txt unknown /proc/85886/exe (readlink: Permission denied) 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 85886 root NOFD /proc/85886/fd (opendir: Permission denied) 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 86194 root cwd unknown /proc/86194/cwd (readlink: Permission denied) 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 86194 root rtd unknown /proc/86194/root (readlink: Permission denied) 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 86194 root txt unknown /proc/86194/exe (readlink: Permission denied) 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 86194 root NOFD /proc/86194/fd (opendir: Permission denied) 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu txt REG 8,1 41128 11685 /usr/bin/timeout 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-21T05:55:49.768 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu 0r FIFO 0,13 0t0 234811 pipe 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu 1w FIFO 0,13 0t0 234812 pipe 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 86342 ubuntu 2w FIFO 0,13 0t0 234813 pipe 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T05:55:49.769 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-09-21T05:55:49.770 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu 0r FIFO 0,13 0t0 234811 pipe 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu 1w FIFO 0,13 0t0 234812 pipe 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu 2w FIFO 0,13 0t0 234813 pipe 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 86360 ubuntu 255r REG 8,1 207 552884 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 87593 root cwd unknown /proc/87593/cwd (readlink: Permission denied) 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 87593 root rtd unknown /proc/87593/root (readlink: Permission denied) 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 87593 root txt unknown /proc/87593/exe (readlink: Permission denied) 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 87593 root NOFD /proc/87593/fd (opendir: Permission denied) 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 setroubleshoot cwd unknown /proc/87782/cwd (readlink: Permission denied) 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 setroubleshoot rtd unknown /proc/87782/root (readlink: Permission denied) 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 setroubleshoot txt unknown /proc/87782/exe (readlink: Permission denied) 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 setroubleshoot NOFD /proc/87782/fd (opendir: Permission denied) 2024-09-21T05:55:49.771 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 87788 setrouble setroubleshoot cwd unknown /proc/87782/task/87788/cwd (readlink: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 87788 setrouble setroubleshoot rtd unknown /proc/87782/task/87788/root (readlink: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 87788 setrouble setroubleshoot txt unknown /proc/87782/task/87788/exe (readlink: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 87788 setrouble setroubleshoot NOFD /proc/87782/task/87788/fd (opendir: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 87795 gmain setroubleshoot cwd unknown /proc/87782/task/87795/cwd (readlink: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 87795 gmain setroubleshoot rtd unknown /proc/87782/task/87795/root (readlink: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 87795 gmain setroubleshoot txt unknown /proc/87782/task/87795/exe (readlink: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 87795 gmain setroubleshoot NOFD /proc/87782/task/87795/fd (opendir: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 87796 gdbus setroubleshoot cwd unknown /proc/87782/task/87796/cwd (readlink: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 87796 gdbus setroubleshoot rtd unknown /proc/87782/task/87796/root (readlink: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 87796 gdbus setroubleshoot txt unknown /proc/87782/task/87796/exe (readlink: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:setrouble 87782 87796 gdbus setroubleshoot NOFD /proc/87782/task/87796/fd (opendir: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:Setrouble 87797 root cwd unknown /proc/87797/cwd (readlink: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:Setrouble 87797 root rtd unknown /proc/87797/root (readlink: Permission denied) 2024-09-21T05:55:49.772 INFO:tasks.workunit.client.0.smithi007.stdout:Setrouble 87797 root txt unknown /proc/87797/exe (readlink: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:Setrouble 87797 root NOFD /proc/87797/fd (opendir: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:Setrouble 87797 87816 gmain root cwd unknown /proc/87797/task/87816/cwd (readlink: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:Setrouble 87797 87816 gmain root rtd unknown /proc/87797/task/87816/root (readlink: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:Setrouble 87797 87816 gmain root txt unknown /proc/87797/task/87816/exe (readlink: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:Setrouble 87797 87816 gmain root NOFD /proc/87797/task/87816/fd (opendir: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:Setrouble 87797 87817 gdbus root cwd unknown /proc/87797/task/87817/cwd (readlink: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:Setrouble 87797 87817 gdbus root rtd unknown /proc/87797/task/87817/root (readlink: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:Setrouble 87797 87817 gdbus root txt unknown /proc/87797/task/87817/exe (readlink: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:Setrouble 87797 87817 gdbus root NOFD /proc/87797/task/87817/fd (opendir: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:sleep 87919 root cwd unknown /proc/87919/cwd (readlink: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:sleep 87919 root rtd unknown /proc/87919/root (readlink: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:sleep 87919 root txt unknown /proc/87919/exe (readlink: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:sleep 87919 root NOFD /proc/87919/fd (opendir: Permission denied) 2024-09-21T05:55:49.773 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 88371 root cwd unknown /proc/88371/cwd (readlink: Permission denied) 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 88371 root rtd unknown /proc/88371/root (readlink: Permission denied) 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 88371 root txt unknown /proc/88371/exe (readlink: Permission denied) 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 88371 root NOFD /proc/88371/fd (opendir: Permission denied) 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 5436544 2391 /usr/lib64/libcrypto.so.3.2.2 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-21T05:55:49.774 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu 0r FIFO 0,13 0t0 234811 pipe 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu 1w FIFO 0,13 0t0 234812 pipe 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu 2w FIFO 0,13 0t0 234813 pipe 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu 3r DIR 0,20 0 1 /proc 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu 4r DIR 0,20 0 235377 /proc/88387/fd 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu 5w FIFO 0,13 0t0 235382 pipe 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88387 ubuntu 6r FIFO 0,13 0t0 235383 pipe 2024-09-21T05:55:49.775 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 5436544 2391 /usr/lib64/libcrypto.so.3.2.2 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-21T05:55:49.776 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-21T05:55:49.777 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-21T05:55:49.777 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T05:55:49.777 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu 4r FIFO 0,13 0t0 235382 pipe 2024-09-21T05:55:49.777 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 88389 ubuntu 7w FIFO 0,13 0t0 235383 pipe 2024-09-21T05:55:49.777 INFO:tasks.workunit.client.0.smithi007.stdout:cephadm 88390 root cwd unknown /proc/88390/cwd (readlink: Permission denied) 2024-09-21T05:55:49.777 INFO:tasks.workunit.client.0.smithi007.stdout:cephadm 88390 root rtd unknown /proc/88390/root (readlink: Permission denied) 2024-09-21T05:55:49.777 INFO:tasks.workunit.client.0.smithi007.stdout:cephadm 88390 root txt unknown /proc/88390/exe (readlink: Permission denied) 2024-09-21T05:55:49.777 INFO:tasks.workunit.client.0.smithi007.stdout:cephadm 88390 root NOFD /proc/88390/fd (opendir: Permission denied) 2024-09-21T05:55:49.777 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T05:55:49.777 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T05:55:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:49.801 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:49 smithi007 ceph-mon[30983]: pgmap v376: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 874 KiB/s wr, 12 op/s 2024-09-21T05:55:49.821 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-09-21T05:55:49.821 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T05:55:49.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:49 smithi027 ceph-mon[34364]: pgmap v376: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 874 KiB/s wr, 12 op/s 2024-09-21T05:55:50.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:49 smithi119 ceph-mon[34833]: pgmap v376: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 874 KiB/s wr, 12 op/s 2024-09-21T05:55:50.176 DEBUG:teuthology.parallel:result is None 2024-09-21T05:55:50.176 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T05:55:50.214 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T05:55:50.214 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T05:55:50.226 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T05:55:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.237+0000 7f38d5a83640 1 -- 172.21.15.7:0/1290878830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d0109e10 msgr2=0x7f38d0110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.237+0000 7f38d5a83640 1 --2- 172.21.15.7:0/1290878830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d0109e10 0x7f38d0110640 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009ca0 tx=0x7f38c802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.237+0000 7f38d5a83640 1 -- 172.21.15.7:0/1290878830 shutdown_connections 2024-09-21T05:55:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.237+0000 7f38d5a83640 1 --2- 172.21.15.7:0/1290878830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d0109e10 0x7f38d0110640 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.237+0000 7f38d5a83640 1 --2- 172.21.15.7:0/1290878830 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d01094c0 0x7f38d01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.237+0000 7f38d5a83640 1 --2- 172.21.15.7:0/1290878830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d0103b80 0x7f38d0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.237+0000 7f38d5a83640 1 -- 172.21.15.7:0/1290878830 >> 172.21.15.7:0/1290878830 conn(0x7f38d00ff5d0 msgr2=0x7f38d0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.237+0000 7f38d5a83640 1 -- 172.21.15.7:0/1290878830 shutdown_connections 2024-09-21T05:55:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.237+0000 7f38d5a83640 1 -- 172.21.15.7:0/1290878830 wait complete. 2024-09-21T05:55:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.238+0000 7f38d5a83640 1 Processor -- start 2024-09-21T05:55:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.238+0000 7f38d5a83640 1 -- start start 2024-09-21T05:55:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.238+0000 7f38d5a83640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d0103b80 0x7f38d019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.238+0000 7f38d5a83640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d01094c0 0x7f38d019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.238+0000 7f38d5a83640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d0109e10 0x7f38d019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.238+0000 7f38d5a83640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f38d0113ad0 con 0x7f38d01094c0 2024-09-21T05:55:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.238+0000 7f38d5a83640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f38d0113950 con 0x7f38d0103b80 2024-09-21T05:55:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.238+0000 7f38d5a83640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f38d0113c50 con 0x7f38d0109e10 2024-09-21T05:55:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.238+0000 7f38ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d01094c0 0x7f38d019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.238+0000 7f38ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d01094c0 0x7f38d019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52784/0 (socket says 172.21.15.7:52784) 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.238+0000 7f38ceffd640 1 -- 172.21.15.7:0/3604385985 learned_addr learned my addr 172.21.15.7:0/3604385985 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.238+0000 7f38cf7fe640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d0103b80 0x7f38d019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.239+0000 7f38cffff640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d0109e10 0x7f38d019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.239+0000 7f38ceffd640 1 -- 172.21.15.7:0/3604385985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d0109e10 msgr2=0x7f38d019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.239+0000 7f38ceffd640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d0109e10 0x7f38d019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.239+0000 7f38ceffd640 1 -- 172.21.15.7:0/3604385985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d0103b80 msgr2=0x7f38d019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.239+0000 7f38ceffd640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d0103b80 0x7f38d019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.239+0000 7f38ceffd640 1 -- 172.21.15.7:0/3604385985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d01a03b0 con 0x7f38d01094c0 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.239+0000 7f38ceffd640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d01094c0 0x7f38d019a9e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f38c400d740 tx=0x7f38c400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.239+0000 7f38ccff9640 1 -- 172.21.15.7:0/3604385985 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4017070 con 0x7f38d01094c0 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.239+0000 7f38ccff9640 1 -- 172.21.15.7:0/3604385985 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38c400de50 con 0x7f38d01094c0 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.239+0000 7f38d5a83640 1 -- 172.21.15.7:0/3604385985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d01a06a0 con 0x7f38d01094c0 2024-09-21T05:55:50.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.239+0000 7f38ccff9640 1 -- 172.21.15.7:0/3604385985 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c400f620 con 0x7f38d01094c0 2024-09-21T05:55:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.239+0000 7f38d5a83640 1 -- 172.21.15.7:0/3604385985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d01a6e00 con 0x7f38d01094c0 2024-09-21T05:55:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38dbff7740 1 Processor -- start 2024-09-21T05:55:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38dbff7740 1 -- start start 2024-09-21T05:55:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38ccff9640 1 -- 172.21.15.7:0/3604385985 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f38c401a070 con 0x7f38d01094c0 2024-09-21T05:55:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38dbff7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 0x563a41914430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38dbff7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a41914970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38dbff7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a4154c670 0x563a41914eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38dbff7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563a4188ae60 con 0x563a41544490 2024-09-21T05:55:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38dbff7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x563a4187a290 con 0x563a4154c670 2024-09-21T05:55:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38dbff7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563a4187e0a0 con 0x563a4156d350 2024-09-21T05:55:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38cf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a41914970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38cf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a41914970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52800/0 (socket says 172.21.15.7:52800) 2024-09-21T05:55:50.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38cf7fe640 1 -- 172.21.15.7:0/1519348934 learned_addr learned my addr 172.21.15.7:0/1519348934 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38ceffd640 1 --2- 172.21.15.7:0/1519348934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a4154c670 0x563a41914eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.242+0000 7f38cffff640 1 --2- 172.21.15.7:0/1519348934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 0x563a41914430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.243+0000 7f38cf7fe640 1 -- 172.21.15.7:0/1519348934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 msgr2=0x563a41914430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.243+0000 7f38cf7fe640 1 --2- 172.21.15.7:0/1519348934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 0x563a41914430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.243+0000 7f38cf7fe640 1 -- 172.21.15.7:0/1519348934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a4154c670 msgr2=0x563a41914eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.243+0000 7f38cf7fe640 1 --2- 172.21.15.7:0/1519348934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a4154c670 0x563a41914eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.243+0000 7f38cf7fe640 1 -- 172.21.15.7:0/1519348934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a415d8930 con 0x563a41544490 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.243+0000 7f38ceffd640 1 --2- 172.21.15.7:0/1519348934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a4154c670 0x563a41914eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.243+0000 7f38cf7fe640 1 --2- 172.21.15.7:0/1519348934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a41914970 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f38c000b760 tx=0x7f38c000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5672c9033a0c44c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.243+0000 7f38ccff9640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38b80b6700 0x7f38b80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.243+0000 7f38b5ffb640 1 -- 172.21.15.7:0/1519348934 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c0003dd0 con 0x563a41544490 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.243+0000 7f38b5ffb640 1 -- 172.21.15.7:0/1519348934 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38c0015070 con 0x563a41544490 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.243+0000 7f38b5ffb640 1 -- 172.21.15.7:0/1519348934 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c0004d90 con 0x563a41544490 2024-09-21T05:55:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.243+0000 7f38cffff640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38b80b6700 0x7f38b80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.243+0000 7f38ccff9640 1 -- 172.21.15.7:0/3604385985 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f38c40e6f60 con 0x7f38d01094c0 2024-09-21T05:55:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.244+0000 7f38dbff7740 1 -- 172.21.15.7:0/1519348934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 msgr2=0x563a41914970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.244+0000 7f38cffff640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38b80b6700 0x7f38b80b8c10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f38c8006010 tx=0x7f38c8009440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.244+0000 7f38dbff7740 1 --2- 172.21.15.7:0/1519348934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a41914970 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f38c000b760 tx=0x7f38c000bc20 comp rx=0 tx=0).stop 2024-09-21T05:55:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.244+0000 7f38dbff7740 1 -- 172.21.15.7:0/1519348934 shutdown_connections 2024-09-21T05:55:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.244+0000 7f38dbff7740 1 --2- 172.21.15.7:0/1519348934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a41914970 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.244+0000 7f38dbff7740 1 --2- 172.21.15.7:0/1519348934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a4154c670 0x563a41914eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.244+0000 7f38dbff7740 1 --2- 172.21.15.7:0/1519348934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 0x563a41914430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.244+0000 7f38dbff7740 1 -- 172.21.15.7:0/1519348934 >> 172.21.15.7:0/1519348934 conn(0x563a41561740 msgr2=0x563a41912320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.244+0000 7f38dbff7740 1 -- 172.21.15.7:0/1519348934 shutdown_connections 2024-09-21T05:55:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.244+0000 7f38dbff7740 1 -- 172.21.15.7:0/1519348934 wait complete. 2024-09-21T05:55:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.244+0000 7f38dbff7740 1 -- start start 2024-09-21T05:55:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.245+0000 7f38dbff7740 1 Processor -- start 2024-09-21T05:55:50.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.245+0000 7f38dbff7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a41544490 0x563a4191fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.245+0000 7f38dbff7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a4154c670 0x563a41920530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.245+0000 7f38dbff7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 0x563a4192bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.245+0000 7f38dbff7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563a416db890 con 0x563a4154c670 2024-09-21T05:55:50.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.245+0000 7f38dbff7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x563a41814d40 con 0x563a41544490 2024-09-21T05:55:50.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.245+0000 7f38dbff7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563a41922c10 con 0x563a4156d350 2024-09-21T05:55:50.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.245+0000 7f38dbff7740 10 client.0 _ll_register_callbacks cb 0x563a41878c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:50.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.245+0000 7f38ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a4154c670 0x563a41920530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.245+0000 7f38ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a4154c670 0x563a41920530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52810/0 (socket says 172.21.15.7:52810) 2024-09-21T05:55:50.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.245+0000 7f38ceffd640 1 -- 172.21.15.7:0/3296246328 learned_addr learned my addr 172.21.15.7:0/3296246328 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:50.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.245+0000 7f38cf7fe640 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a41544490 0x563a4191fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.245+0000 7f38cffff640 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 0x563a4192bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38ceffd640 1 -- 172.21.15.7:0/3296246328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 msgr2=0x563a4192bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38ceffd640 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 0x563a4192bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38ceffd640 1 -- 172.21.15.7:0/3296246328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a41544490 msgr2=0x563a4191fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38ceffd640 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a41544490 0x563a4191fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38ceffd640 1 -- 172.21.15.7:0/3296246328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a4192c4d0 con 0x563a4154c670 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38cffff640 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 0x563a4192bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38ceffd640 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a4154c670 0x563a41920530 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009610 tx=0x7f38c40a9620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aceb097d41ce73b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38aeffd640 1 -- 172.21.15.7:0/3296246328 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4021030 con 0x563a4154c670 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38aeffd640 1 -- 172.21.15.7:0/3296246328 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f38c4094070 con 0x563a4154c670 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38dbff7740 1 -- 172.21.15.7:0/3296246328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38c0015070 con 0x563a4154c670 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38aeffd640 1 -- 172.21.15.7:0/3296246328 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f38c40ac650 con 0x563a4154c670 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38dbff7740 10 client.15990 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38dbff7740 1 -- 172.21.15.7:0/3296246328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563a4192ee00 con 0x563a4154c670 2024-09-21T05:55:50.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.246+0000 7f38aeffd640 1 -- 172.21.15.7:0/3296246328 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38c0015070 con 0x563a4154c670 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.247+0000 7f38aeffd640 1 -- 172.21.15.7:0/3296246328 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f38c40abbb0 con 0x563a4154c670 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.247+0000 7f38dbff7740 10 client.15990 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.247+0000 7f38dbff7740 10 client.15990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.247+0000 7f38dbff7740 20 client.15990 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.247+0000 7f38dbff7740 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563a4152bcd0 0x563a419322e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.247+0000 7f38dbff7740 4 client.15990 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.247+0000 7f38dbff7740 1 -- 172.21.15.7:0/3296246328 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a4188cdb0 con 0x563a4152bcd0 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.247+0000 7f38cf7fe640 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563a4152bcd0 0x563a419322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.248+0000 7f38aeffd640 10 client.15990 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.248+0000 7f38cf7fe640 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563a4152bcd0 0x563a419322e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bea78662d64b66c server_cookie=762df443ad49ee2 in_seq=0 out_seq=0 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.248+0000 7f38aeffd640 1 -- 172.21.15.7:0/3296246328 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563a4188cdb0 con 0x563a4152bcd0 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.248+0000 7f38aeffd640 10 client.15990 handle_command_reply: tid=0 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.248+0000 7f38dbff7740 1 client.15990 shutdown 2024-09-21T05:55:50.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.249+0000 7f38dbff7740 1 -- 172.21.15.7:0/3296246328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a4154c670 msgr2=0x563a41920530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.249+0000 7f38dbff7740 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a4154c670 0x563a41920530 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009610 tx=0x7f38c40a9620 comp rx=0 tx=0).stop 2024-09-21T05:55:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.249+0000 7f38dbff7740 1 -- 172.21.15.7:0/3296246328 shutdown_connections 2024-09-21T05:55:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.249+0000 7f38dbff7740 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563a4152bcd0 0x563a419322e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.249+0000 7f38dbff7740 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a4154c670 0x563a41920530 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.249+0000 7f38dbff7740 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 0x563a4192bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.249+0000 7f38dbff7740 1 --2- 172.21.15.7:0/3296246328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a41544490 0x563a4191fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.249+0000 7f38dbff7740 1 -- 172.21.15.7:0/3296246328 >> 172.21.15.7:0/3296246328 conn(0x563a41561740 msgr2=0x563a419175c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.249+0000 7f38aeffd640 0 client.15990 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.249+0000 7f38dbff7740 1 -- 172.21.15.7:0/3296246328 shutdown_connections 2024-09-21T05:55:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.249+0000 7f38dbff7740 1 -- 172.21.15.7:0/3296246328 wait complete. 2024-09-21T05:55:50.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.250+0000 7f38dbff7740 20 client.15990 trim_cache size 0 max 16384 2024-09-21T05:55:50.263 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-21T05:55:50.272 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-21T05:55:50.273 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T05:55:50.273 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T05:55:50.273 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-21T05:55:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.270+0000 7f38dbff7740 1 Processor -- start 2024-09-21T05:55:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.270+0000 7f38dbff7740 1 -- start start 2024-09-21T05:55:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38dbff7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a41561740 0x563a4191b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38dbff7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a4191f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38dbff7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 0x563a4191a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38dbff7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f38d01b1ec0 con 0x563a41544490 2024-09-21T05:55:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38dbff7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f38d01af790 con 0x563a41561740 2024-09-21T05:55:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38dbff7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f38d01ad5e0 con 0x563a4156d350 2024-09-21T05:55:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38cf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a41561740 0x563a4191b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38cf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a41561740 0x563a4191b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:42700/0 (socket says 172.21.15.7:42700) 2024-09-21T05:55:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38cf7fe640 1 -- 172.21.15.7:0/1460748212 learned_addr learned my addr 172.21.15.7:0/1460748212 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38cffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 0x563a4191a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38ceffd640 1 --2- 172.21.15.7:0/1460748212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a4191f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38cf7fe640 1 -- 172.21.15.7:0/1460748212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 msgr2=0x563a4191a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38cf7fe640 1 --2- 172.21.15.7:0/1460748212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 0x563a4191a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38cf7fe640 1 -- 172.21.15.7:0/1460748212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 msgr2=0x563a4191f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38cf7fe640 1 --2- 172.21.15.7:0/1460748212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a4191f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38cf7fe640 1 -- 172.21.15.7:0/1460748212 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a41916720 con 0x563a41561740 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.271+0000 7f38cf7fe640 1 --2- 172.21.15.7:0/1460748212 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a41561740 0x563a4191b5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f38c00044d0 tx=0x7f38c0004970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea9c46f6c980698a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.272+0000 7f38b57fa640 1 -- 172.21.15.7:0/1460748212 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c0003dd0 con 0x563a41561740 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.272+0000 7f38b57fa640 1 -- 172.21.15.7:0/1460748212 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38c0015040 con 0x563a41561740 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.272+0000 7f38b57fa640 1 -- 172.21.15.7:0/1460748212 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c0019420 con 0x563a41561740 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.273+0000 7f38dbff7740 1 -- 172.21.15.7:0/1460748212 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a41561740 msgr2=0x563a4191b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.273+0000 7f38dbff7740 1 --2- 172.21.15.7:0/1460748212 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a41561740 0x563a4191b5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f38c00044d0 tx=0x7f38c0004970 comp rx=0 tx=0).stop 2024-09-21T05:55:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.273+0000 7f38dbff7740 1 -- 172.21.15.7:0/1460748212 shutdown_connections 2024-09-21T05:55:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.273+0000 7f38dbff7740 1 --2- 172.21.15.7:0/1460748212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a4191f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.273+0000 7f38dbff7740 1 --2- 172.21.15.7:0/1460748212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a4156d350 0x563a4191a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.273+0000 7f38dbff7740 1 --2- 172.21.15.7:0/1460748212 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a41561740 0x563a4191b5a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.273+0000 7f38dbff7740 1 -- 172.21.15.7:0/1460748212 >> 172.21.15.7:0/1460748212 conn(0x563a41932630 msgr2=0x563a41915460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.273+0000 7f38dbff7740 1 -- 172.21.15.7:0/1460748212 shutdown_connections 2024-09-21T05:55:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.273+0000 7f38dbff7740 1 -- 172.21.15.7:0/1460748212 wait complete. 2024-09-21T05:55:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.273+0000 7f38dbff7740 1 -- start start 2024-09-21T05:55:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38dbff7740 1 Processor -- start 2024-09-21T05:55:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38dbff7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a41924990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38dbff7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a41561740 0x563a41924f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38dbff7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a4156d350 0x563a41995d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38dbff7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f38d01adc50 con 0x563a41544490 2024-09-21T05:55:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38dbff7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f38d01af0c0 con 0x563a4156d350 2024-09-21T05:55:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38dbff7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f38d01ae320 con 0x563a41561740 2024-09-21T05:55:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38dbff7740 10 client.0 _ll_register_callbacks cb 0x7f38c4009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38cf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a41924990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38cf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a41924990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52828/0 (socket says 172.21.15.7:52828) 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38cf7fe640 1 -- 172.21.15.7:0/2233380566 learned_addr learned my addr 172.21.15.7:0/2233380566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38ceffd640 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a41561740 0x563a41924f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38cffff640 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a4156d350 0x563a41995d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38cf7fe640 1 -- 172.21.15.7:0/2233380566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a41561740 msgr2=0x563a41924f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.274+0000 7f38cf7fe640 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a41561740 0x563a41924f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.275+0000 7f38cf7fe640 1 -- 172.21.15.7:0/2233380566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a4156d350 msgr2=0x563a41995d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.275+0000 7f38cf7fe640 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a4156d350 0x563a41995d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.275+0000 7f38cf7fe640 1 -- 172.21.15.7:0/2233380566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a41996400 con 0x563a41544490 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.275+0000 7f38ceffd640 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a41561740 0x563a41924f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.275+0000 7f38cf7fe640 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a41924990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f38c0000c00 tx=0x7f38c0012c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad733e721c53713 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.275+0000 7f38aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.275+0000 7f38aeffd640 1 -- 172.21.15.7:0/2233380566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c0032040 con 0x563a41544490 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.275+0000 7f38aeffd640 1 -- 172.21.15.7:0/2233380566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f38c0003a70 con 0x563a41544490 2024-09-21T05:55:50.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.275+0000 7f38dbff7740 1 -- 172.21.15.7:0/2233380566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38c0015040 con 0x563a41544490 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.275+0000 7f38aeffd640 1 -- 172.21.15.7:0/2233380566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f38c0003cb0 con 0x563a41544490 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.275+0000 7f38dbff7740 10 client.15996 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.275+0000 7f38dbff7740 1 -- 172.21.15.7:0/2233380566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563a419a1c20 con 0x563a41544490 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.276+0000 7f38aeffd640 1 -- 172.21.15.7:0/2233380566 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38c0015040 con 0x563a41544490 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.276+0000 7f38aeffd640 1 -- 172.21.15.7:0/2233380566 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f38c0035070 con 0x563a41544490 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.276+0000 7f38dbff7740 10 client.15996 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.276+0000 7f38dbff7740 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.276+0000 7f38dbff7740 20 client.15996 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.276+0000 7f38dbff7740 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563a41501080 0x563a419a4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.276+0000 7f38dbff7740 4 client.15996 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.276+0000 7f38dbff7740 1 -- 172.21.15.7:0/2233380566 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563a41888860 con 0x563a41501080 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.276+0000 7f38ceffd640 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563a41501080 0x563a419a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.277+0000 7f38ceffd640 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563a41501080 0x563a419a4130 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b92b9c2dd7897a6d server_cookie=5d87d8778d0e76 in_seq=0 out_seq=0 2024-09-21T05:55:50.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.277+0000 7f38aeffd640 10 client.15996 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.278+0000 7f38aeffd640 1 -- 172.21.15.7:0/2233380566 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563a41888860 con 0x563a41501080 2024-09-21T05:55:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.278+0000 7f38aeffd640 10 client.15996 handle_command_reply: tid=0 2024-09-21T05:55:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.278+0000 7f38dbff7740 1 client.15996 shutdown 2024-09-21T05:55:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.278+0000 7f38dbff7740 1 -- 172.21.15.7:0/2233380566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 msgr2=0x563a41924990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.278+0000 7f38dbff7740 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a41924990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f38c0000c00 tx=0x7f38c0012c60 comp rx=0 tx=0).stop 2024-09-21T05:55:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.279+0000 7f38dbff7740 1 -- 172.21.15.7:0/2233380566 shutdown_connections 2024-09-21T05:55:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.279+0000 7f38dbff7740 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563a41501080 0x563a419a4130 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.279+0000 7f38dbff7740 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563a4156d350 0x563a41995d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.279+0000 7f38dbff7740 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563a41561740 0x563a41924f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.279+0000 7f38dbff7740 1 --2- 172.21.15.7:0/2233380566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a41544490 0x563a41924990 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.279+0000 7f38dbff7740 1 -- 172.21.15.7:0/2233380566 >> 172.21.15.7:0/2233380566 conn(0x563a41932630 msgr2=0x563a4191ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:50.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.279+0000 7f38aeffd640 0 client.15996 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:50.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.279+0000 7f38dbff7740 1 -- 172.21.15.7:0/2233380566 shutdown_connections 2024-09-21T05:55:50.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.279+0000 7f38dbff7740 1 -- 172.21.15.7:0/2233380566 wait complete. 2024-09-21T05:55:50.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.279+0000 7f38dbff7740 20 client.15996 trim_cache size 0 max 16384 2024-09-21T05:55:50.285 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:55:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T05:55:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "438db71b-3351-4115-a5b5-9aa0035a3911", 2024-09-21T05:55:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T05:55:50.285 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:55:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.280+0000 7f38d5a83640 1 -- 172.21.15.7:0/3604385985 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38b80b6700 msgr2=0x7f38b80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.280+0000 7f38d5a83640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38b80b6700 0x7f38b80b8c10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f38c8006010 tx=0x7f38c8009440 comp rx=0 tx=0).stop 2024-09-21T05:55:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.280+0000 7f38d5a83640 1 -- 172.21.15.7:0/3604385985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d01094c0 msgr2=0x7f38d019a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.280+0000 7f38d5a83640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d01094c0 0x7f38d019a9e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f38c400d740 tx=0x7f38c400dc00 comp rx=0 tx=0).stop 2024-09-21T05:55:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.280+0000 7f38d5a83640 1 -- 172.21.15.7:0/3604385985 shutdown_connections 2024-09-21T05:55:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.280+0000 7f38d5a83640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38b80b6700 0x7f38b80b8c10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.280+0000 7f38d5a83640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38d01094c0 0x7f38d019a9e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.280+0000 7f38d5a83640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d0109e10 0x7f38d019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.280+0000 7f38d5a83640 1 --2- 172.21.15.7:0/3604385985 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38d0103b80 0x7f38d019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.280+0000 7f38d5a83640 1 -- 172.21.15.7:0/3604385985 >> 172.21.15.7:0/3604385985 conn(0x7f38d00ff5d0 msgr2=0x7f38d01019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.280+0000 7f38d5a83640 1 -- 172.21.15.7:0/3604385985 shutdown_connections 2024-09-21T05:55:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:50.280+0000 7f38d5a83640 1 -- 172.21.15.7:0/3604385985 wait complete. 2024-09-21T05:55:50.304 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-21T05:55:50.999 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:55:51.257 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:51.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.767+0000 7f0e776c2640 1 -- 172.21.15.7:0/2616393128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e70103b80 msgr2=0x7f0e70103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:51.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.767+0000 7f0e776c2640 1 --2- 172.21.15.7:0/2616393128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e70103b80 0x7f0e70103f90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009900 tx=0x7f0e6802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.767+0000 7f0e776c2640 1 -- 172.21.15.7:0/2616393128 shutdown_connections 2024-09-21T05:55:51.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.767+0000 7f0e776c2640 1 --2- 172.21.15.7:0/2616393128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e70109e10 0x7f0e70110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.767+0000 7f0e776c2640 1 --2- 172.21.15.7:0/2616393128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e701094c0 0x7f0e701098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.767+0000 7f0e776c2640 1 --2- 172.21.15.7:0/2616393128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e70103b80 0x7f0e70103f90 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.767+0000 7f0e776c2640 1 -- 172.21.15.7:0/2616393128 >> 172.21.15.7:0/2616393128 conn(0x7f0e700ff610 msgr2=0x7f0e70101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:51.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.767+0000 7f0e776c2640 1 -- 172.21.15.7:0/2616393128 shutdown_connections 2024-09-21T05:55:51.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.767+0000 7f0e776c2640 1 -- 172.21.15.7:0/2616393128 wait complete. 2024-09-21T05:55:51.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.768+0000 7f0e776c2640 1 Processor -- start 2024-09-21T05:55:51.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.768+0000 7f0e776c2640 1 -- start start 2024-09-21T05:55:51.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.768+0000 7f0e776c2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e70103b80 0x7f0e70075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.768+0000 7f0e776c2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e701094c0 0x7f0e70075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.768+0000 7f0e776c2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e70109e10 0x7f0e70076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.768+0000 7f0e776c2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0e70113ad0 con 0x7f0e701094c0 2024-09-21T05:55:51.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.768+0000 7f0e776c2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0e70113950 con 0x7f0e70109e10 2024-09-21T05:55:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.768+0000 7f0e776c2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0e70113c50 con 0x7f0e70103b80 2024-09-21T05:55:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e74c5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e701094c0 0x7f0e70075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e74c5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e701094c0 0x7f0e70075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52844/0 (socket says 172.21.15.7:52844) 2024-09-21T05:55:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e7545e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e70103b80 0x7f0e70075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e74c5d640 1 -- 172.21.15.7:0/390999998 learned_addr learned my addr 172.21.15.7:0/390999998 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e75c5f640 1 --2- 172.21.15.7:0/390999998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e70109e10 0x7f0e70076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e74c5d640 1 -- 172.21.15.7:0/390999998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e70103b80 msgr2=0x7f0e70075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e74c5d640 1 --2- 172.21.15.7:0/390999998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e70103b80 0x7f0e70075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e74c5d640 1 -- 172.21.15.7:0/390999998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e70109e10 msgr2=0x7f0e70076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e74c5d640 1 --2- 172.21.15.7:0/390999998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e70109e10 0x7f0e70076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e74c5d640 1 -- 172.21.15.7:0/390999998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e701a86d0 con 0x7f0e701094c0 2024-09-21T05:55:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e74c5d640 1 --2- 172.21.15.7:0/390999998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e701094c0 0x7f0e70075c50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c8c0 tx=0x7f0e6400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e6e7fc640 1 -- 172.21.15.7:0/390999998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64007bb0 con 0x7f0e701094c0 2024-09-21T05:55:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e776c2640 1 -- 172.21.15.7:0/390999998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e701a89c0 con 0x7f0e701094c0 2024-09-21T05:55:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e6e7fc640 1 -- 172.21.15.7:0/390999998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e64007d50 con 0x7f0e701094c0 2024-09-21T05:55:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e6e7fc640 1 -- 172.21.15.7:0/390999998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e640187c0 con 0x7f0e701094c0 2024-09-21T05:55:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.769+0000 7f0e776c2640 1 -- 172.21.15.7:0/390999998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e701a8f00 con 0x7f0e701094c0 2024-09-21T05:55:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.772+0000 7f0e7dc36740 1 Processor -- start 2024-09-21T05:55:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.772+0000 7f0e7dc36740 1 -- start start 2024-09-21T05:55:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.772+0000 7f0e6e7fc640 1 -- 172.21.15.7:0/390999998 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0e6400fa20 con 0x7f0e701094c0 2024-09-21T05:55:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.772+0000 7f0e7dc36740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49395070 0x55be4973c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7dc36740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 0x55be4973c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7dc36740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49374390 0x55be4973ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7dc36740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55be496b2e50 con 0x55be4936c1b0 2024-09-21T05:55:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7dc36740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55be496a2280 con 0x55be49374390 2024-09-21T05:55:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7dc36740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55be496a6090 con 0x55be49395070 2024-09-21T05:55:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7545e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 0x55be4973c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7545e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 0x55be4973c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52858/0 (socket says 172.21.15.7:52858) 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7545e640 1 -- 172.21.15.7:0/3296671963 learned_addr learned my addr 172.21.15.7:0/3296671963 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e74c5d640 1 --2- 172.21.15.7:0/3296671963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49374390 0x55be4973ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e75c5f640 1 --2- 172.21.15.7:0/3296671963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49395070 0x55be4973c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7545e640 1 -- 172.21.15.7:0/3296671963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49395070 msgr2=0x55be4973c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7545e640 1 --2- 172.21.15.7:0/3296671963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49395070 0x55be4973c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7545e640 1 -- 172.21.15.7:0/3296671963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49374390 msgr2=0x55be4973ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7545e640 1 --2- 172.21.15.7:0/3296671963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49374390 0x55be4973ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7545e640 1 -- 172.21.15.7:0/3296671963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be49400650 con 0x55be4936c1b0 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e7545e640 1 --2- 172.21.15.7:0/3296671963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 0x55be4973c7b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009900 tx=0x7f0e68032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7347288f3c54e679 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.773+0000 7f0e6e7fc640 1 --2- 172.21.15.7:0/390999998 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0e580b6680 0x7f0e580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.774+0000 7f0e75c5f640 1 --2- 172.21.15.7:0/390999998 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0e580b6680 0x7f0e580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.774+0000 7f0e577fe640 1 -- 172.21.15.7:0/3296671963 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e68040070 con 0x55be4936c1b0 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.774+0000 7f0e577fe640 1 -- 172.21.15.7:0/3296671963 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e68005db0 con 0x55be4936c1b0 2024-09-21T05:55:51.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.774+0000 7f0e6e7fc640 1 -- 172.21.15.7:0/390999998 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f0e640e76f0 con 0x7f0e701094c0 2024-09-21T05:55:51.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.774+0000 7f0e577fe640 1 -- 172.21.15.7:0/3296671963 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e68035040 con 0x55be4936c1b0 2024-09-21T05:55:51.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.775+0000 7f0e7dc36740 1 -- 172.21.15.7:0/3296671963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 msgr2=0x55be4973c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:51.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.775+0000 7f0e75c5f640 1 --2- 172.21.15.7:0/390999998 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0e580b6680 0x7f0e580b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0e60005fd0 tx=0x7f0e60009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:51.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.775+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/3296671963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 0x55be4973c7b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009900 tx=0x7f0e68032df0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.775+0000 7f0e7dc36740 1 -- 172.21.15.7:0/3296671963 shutdown_connections 2024-09-21T05:55:51.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.775+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/3296671963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 0x55be4973c7b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.775+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/3296671963 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49374390 0x55be4973ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.775+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/3296671963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49395070 0x55be4973c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.775+0000 7f0e7dc36740 1 -- 172.21.15.7:0/3296671963 >> 172.21.15.7:0/3296671963 conn(0x55be49389460 msgr2=0x55be4973a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:51.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.775+0000 7f0e7dc36740 1 -- 172.21.15.7:0/3296671963 shutdown_connections 2024-09-21T05:55:51.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.775+0000 7f0e7dc36740 1 -- 172.21.15.7:0/3296671963 wait complete. 2024-09-21T05:55:51.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.775+0000 7f0e7dc36740 1 -- start start 2024-09-21T05:55:51.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.775+0000 7f0e7dc36740 1 Processor -- start 2024-09-21T05:55:51.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7dc36740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 0x55be49747930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7dc36740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49374390 0x55be49747e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7dc36740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49395070 0x55be49753d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7dc36740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55be49503700 con 0x55be4936c1b0 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7dc36740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55be4963d110 con 0x55be49395070 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7dc36740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55be4974aa40 con 0x55be49374390 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7dc36740 10 client.0 _ll_register_callbacks cb 0x55be49656990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7545e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 0x55be49747930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7545e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 0x55be49747930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52862/0 (socket says 172.21.15.7:52862) 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7545e640 1 -- 172.21.15.7:0/1613890599 learned_addr learned my addr 172.21.15.7:0/1613890599 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e74c5d640 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49374390 0x55be49747e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7545e640 1 -- 172.21.15.7:0/1613890599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49374390 msgr2=0x55be49747e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7545e640 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49374390 0x55be49747e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7545e640 1 -- 172.21.15.7:0/1613890599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49395070 msgr2=0x55be49753d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e75c5f640 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49395070 0x55be49753d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7545e640 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49395070 0x55be49753d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e7545e640 1 -- 172.21.15.7:0/1613890599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be4966ac40 con 0x55be4936c1b0 2024-09-21T05:55:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.776+0000 7f0e75c5f640 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49395070 0x55be49753d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e7545e640 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 0x55be49747930 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0e6802a910 tx=0x7f0e68005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50515aab58eb510f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e54ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e54ff9640 1 -- 172.21.15.7:0/1613890599 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6804b030 con 0x55be4936c1b0 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e54ff9640 1 -- 172.21.15.7:0/1613890599 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f0e680316b0 con 0x55be4936c1b0 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e7dc36740 1 -- 172.21.15.7:0/1613890599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e68005db0 con 0x55be4936c1b0 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e54ff9640 1 -- 172.21.15.7:0/1613890599 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0e68035070 con 0x55be4936c1b0 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e7dc36740 10 client.16008 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e7dc36740 1 -- 172.21.15.7:0/1613890599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55be49756720 con 0x55be4936c1b0 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e54ff9640 1 -- 172.21.15.7:0/1613890599 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e68005db0 con 0x55be4936c1b0 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e54ff9640 1 -- 172.21.15.7:0/1613890599 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0e68003b60 con 0x55be4936c1b0 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e7dc36740 10 client.16008 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e7dc36740 10 client.16008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e7dc36740 20 client.16008 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.777+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55be493539f0 0x55be49759a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.778+0000 7f0e7dc36740 4 client.16008 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.778+0000 7f0e7dc36740 1 -- 172.21.15.7:0/1613890599 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be496b4da0 con 0x55be493539f0 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.778+0000 7f0e74c5d640 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55be493539f0 0x55be49759a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.778+0000 7f0e74c5d640 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55be493539f0 0x55be49759a80 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b1fa73469b88ced server_cookie=b297c897cb888852 in_seq=0 out_seq=0 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.778+0000 7f0e54ff9640 10 client.16008 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e54ff9640 1 -- 172.21.15.7:0/1613890599 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55be496b4da0 con 0x55be493539f0 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e54ff9640 10 client.16008 handle_command_reply: tid=0 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e7dc36740 1 client.16008 shutdown 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e7dc36740 1 -- 172.21.15.7:0/1613890599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 msgr2=0x55be49747930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 0x55be49747930 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0e6802a910 tx=0x7f0e68005630 comp rx=0 tx=0).stop 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e7dc36740 1 -- 172.21.15.7:0/1613890599 shutdown_connections 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55be493539f0 0x55be49759a80 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49395070 0x55be49753d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49374390 0x55be49747e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e54ff9640 0 client.16008 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/1613890599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be4936c1b0 0x55be49747930 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e7dc36740 1 -- 172.21.15.7:0/1613890599 >> 172.21.15.7:0/1613890599 conn(0x55be49389460 msgr2=0x55be4973dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:51.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e7dc36740 1 -- 172.21.15.7:0/1613890599 shutdown_connections 2024-09-21T05:55:51.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.779+0000 7f0e7dc36740 1 -- 172.21.15.7:0/1613890599 wait complete. 2024-09-21T05:55:51.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.780+0000 7f0e7dc36740 20 client.16008 trim_cache size 0 max 16384 2024-09-21T05:55:51.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e7dc36740 1 Processor -- start 2024-09-21T05:55:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e7dc36740 1 -- start start 2024-09-21T05:55:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e7dc36740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be4936c1b0 0x55be4973a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e7dc36740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 0x55be49753cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e7dc36740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49395070 0x55be49744b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e7dc36740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0e701b3fa0 con 0x55be49374390 2024-09-21T05:55:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e7dc36740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0e701b1870 con 0x55be4936c1b0 2024-09-21T05:55:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e7dc36740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0e701af6c0 con 0x55be49395070 2024-09-21T05:55:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e74c5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 0x55be49753cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e74c5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 0x55be49753cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52872/0 (socket says 172.21.15.7:52872) 2024-09-21T05:55:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e74c5d640 1 -- 172.21.15.7:0/116525431 learned_addr learned my addr 172.21.15.7:0/116525431 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e7545e640 1 --2- 172.21.15.7:0/116525431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be4936c1b0 0x55be4973a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e74c5d640 1 -- 172.21.15.7:0/116525431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49395070 msgr2=0x55be49744b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e74c5d640 1 --2- 172.21.15.7:0/116525431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49395070 0x55be49744b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e74c5d640 1 -- 172.21.15.7:0/116525431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be4936c1b0 msgr2=0x55be4973a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:51.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e74c5d640 1 --2- 172.21.15.7:0/116525431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be4936c1b0 0x55be4973a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.797+0000 7f0e74c5d640 1 -- 172.21.15.7:0/116525431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be4974a070 con 0x55be49374390 2024-09-21T05:55:51.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.798+0000 7f0e74c5d640 1 --2- 172.21.15.7:0/116525431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 0x55be49753cd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400cfd0 tx=0x7f0e640e9c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810bde85e04ef300 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:51.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.798+0000 7f0e56ffd640 1 -- 172.21.15.7:0/116525431 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e640acd30 con 0x55be49374390 2024-09-21T05:55:51.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.798+0000 7f0e56ffd640 1 -- 172.21.15.7:0/116525431 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e640ad0d0 con 0x55be49374390 2024-09-21T05:55:51.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.798+0000 7f0e56ffd640 1 -- 172.21.15.7:0/116525431 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e640e7ba0 con 0x55be49374390 2024-09-21T05:55:51.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.798+0000 7f0e7dc36740 1 -- 172.21.15.7:0/116525431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 msgr2=0x55be49753cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:51.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.798+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/116525431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 0x55be49753cd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400cfd0 tx=0x7f0e640e9c00 comp rx=0 tx=0).stop 2024-09-21T05:55:51.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.799+0000 7f0e7dc36740 1 -- 172.21.15.7:0/116525431 shutdown_connections 2024-09-21T05:55:51.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.799+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/116525431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 0x55be49753cd0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.799+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/116525431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be49395070 0x55be49744b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.799+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/116525431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be4936c1b0 0x55be4973a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.799+0000 7f0e7dc36740 1 -- 172.21.15.7:0/116525431 >> 172.21.15.7:0/116525431 conn(0x55be49389460 msgr2=0x55be49739ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:51.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.799+0000 7f0e7dc36740 1 -- 172.21.15.7:0/116525431 shutdown_connections 2024-09-21T05:55:51.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.799+0000 7f0e7dc36740 1 -- 172.21.15.7:0/116525431 wait complete. 2024-09-21T05:55:51.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.799+0000 7f0e7dc36740 1 -- start start 2024-09-21T05:55:51.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.799+0000 7f0e7dc36740 1 Processor -- start 2024-09-21T05:55:51.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e7dc36740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be4936c1b0 0x55be4975d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e7dc36740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 0x55be4975aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e7dc36740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49395070 0x55be4975b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e7dc36740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0e701afd30 con 0x55be49374390 2024-09-21T05:55:51.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e7dc36740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0e701b11a0 con 0x55be49395070 2024-09-21T05:55:51.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e7dc36740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0e701b0400 con 0x55be4936c1b0 2024-09-21T05:55:51.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e7dc36740 10 client.0 _ll_register_callbacks cb 0x7f0e640ed420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:51.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e74c5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 0x55be4975aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e74c5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 0x55be4975aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52886/0 (socket says 172.21.15.7:52886) 2024-09-21T05:55:51.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e74c5d640 1 -- 172.21.15.7:0/169790359 learned_addr learned my addr 172.21.15.7:0/169790359 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:55:51.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e75c5f640 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49395070 0x55be4975b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e7545e640 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be4936c1b0 0x55be4975d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e74c5d640 1 -- 172.21.15.7:0/169790359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be4936c1b0 msgr2=0x55be4975d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e74c5d640 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be4936c1b0 0x55be4975d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e74c5d640 1 -- 172.21.15.7:0/169790359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49395070 msgr2=0x55be4975b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e74c5d640 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49395070 0x55be4975b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e74c5d640 1 -- 172.21.15.7:0/169790359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be497c3200 con 0x55be49374390 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e75c5f640 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49395070 0x55be4975b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e74c5d640 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 0x55be4975aa90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0e640e4f70 tx=0x7f0e640ed550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3e06d4a76db9aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e54ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e54ff9640 1 -- 172.21.15.7:0/169790359 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e640b6fe0 con 0x55be49374390 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e54ff9640 1 -- 172.21.15.7:0/169790359 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f0e640e7ba0 con 0x55be49374390 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.800+0000 7f0e7dc36740 1 -- 172.21.15.7:0/169790359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e640ad0d0 con 0x55be49374390 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.801+0000 7f0e54ff9640 1 -- 172.21.15.7:0/169790359 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0e640adcc0 con 0x55be49374390 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.801+0000 7f0e7dc36740 10 client.16014 fetch_fsmap learned FSMap version 25 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.801+0000 7f0e7dc36740 1 -- 172.21.15.7:0/169790359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55be497c43d0 con 0x55be49374390 2024-09-21T05:55:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.801+0000 7f0e54ff9640 1 -- 172.21.15.7:0/169790359 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e640ad0d0 con 0x55be49374390 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.801+0000 7f0e54ff9640 1 -- 172.21.15.7:0/169790359 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0e640a8fa0 con 0x55be49374390 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.801+0000 7f0e7dc36740 10 client.16014 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.801+0000 7f0e7dc36740 10 client.16014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.801+0000 7f0e7dc36740 20 client.16014 populate_metadata read hostname 'smithi007' 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.801+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55be49328da0 0x55be497c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.801+0000 7f0e7dc36740 4 client.16014 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.801+0000 7f0e7dc36740 1 -- 172.21.15.7:0/169790359 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55be496b0850 con 0x55be49328da0 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.801+0000 7f0e7545e640 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55be49328da0 0x55be497c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e54ff9640 10 client.16014 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e7545e640 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55be49328da0 0x55be497c6b20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d21fd0fb0536ab2 server_cookie=4be7f8db256754c3 in_seq=0 out_seq=0 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e54ff9640 1 -- 172.21.15.7:0/169790359 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x55be496b0850 con 0x55be49328da0 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e54ff9640 10 client.16014 handle_command_reply: tid=0 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e7dc36740 1 client.16014 shutdown 2024-09-21T05:55:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e7dc36740 1 -- 172.21.15.7:0/169790359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 msgr2=0x55be4975aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:51.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 0x55be4975aa90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0e640e4f70 tx=0x7f0e640ed550 comp rx=0 tx=0).stop 2024-09-21T05:55:51.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e7dc36740 1 -- 172.21.15.7:0/169790359 shutdown_connections 2024-09-21T05:55:51.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55be49328da0 0x55be497c6b20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be49374390 0x55be4975aa90 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55be49395070 0x55be4975b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e54ff9640 0 client.16014 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:55:51.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e7dc36740 1 --2- 172.21.15.7:0/169790359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55be4936c1b0 0x55be4975d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.802+0000 7f0e7dc36740 1 -- 172.21.15.7:0/169790359 >> 172.21.15.7:0/169790359 conn(0x55be49389460 msgr2=0x55be49748de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:51.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e7dc36740 1 -- 172.21.15.7:0/169790359 shutdown_connections 2024-09-21T05:55:51.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e7dc36740 1 -- 172.21.15.7:0/169790359 wait complete. 2024-09-21T05:55:51.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e7dc36740 20 client.16014 trim_cache size 0 max 16384 2024-09-21T05:55:51.811 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:55:51.811 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T05:55:51.811 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T05:55:51.811 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:55:51.811 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:55:51.811 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "438db71b-3351-4115-a5b5-9aa0035a3911", 2024-09-21T05:55:51.811 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T05:55:51.811 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:55:51.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:55:51.811 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:55:51.811 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:55:51.811 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:55:51.811 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:55:51.812 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:55:51.812 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:55:51.812 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:55:51.812 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:55:51.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:55:51.812 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:55:51.812 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:55:51.812 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:55:51.812 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:55:51.813 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:55:51.813 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:55:51.813 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:55:51.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:55:51.813 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:55:51.813 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:55:51.813 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:55:51.813 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:55:51.813 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:55:51.813 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:55:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:55:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:55:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:55:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:55:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:55:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:55:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:55:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:55:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:55:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:55:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:55:51.814 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:55:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e776c2640 1 -- 172.21.15.7:0/390999998 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0e580b6680 msgr2=0x7f0e580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e776c2640 1 --2- 172.21.15.7:0/390999998 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0e580b6680 0x7f0e580b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0e60005fd0 tx=0x7f0e60009600 comp rx=0 tx=0).stop 2024-09-21T05:55:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e776c2640 1 -- 172.21.15.7:0/390999998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e701094c0 msgr2=0x7f0e70075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e776c2640 1 --2- 172.21.15.7:0/390999998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e701094c0 0x7f0e70075c50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c8c0 tx=0x7f0e6400cd80 comp rx=0 tx=0).stop 2024-09-21T05:55:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e776c2640 1 -- 172.21.15.7:0/390999998 shutdown_connections 2024-09-21T05:55:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e776c2640 1 --2- 172.21.15.7:0/390999998 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0e580b6680 0x7f0e580b8b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e776c2640 1 --2- 172.21.15.7:0/390999998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e701094c0 0x7f0e70075c50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e776c2640 1 --2- 172.21.15.7:0/390999998 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e70109e10 0x7f0e70076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e776c2640 1 --2- 172.21.15.7:0/390999998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e70103b80 0x7f0e70075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:51.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e776c2640 1 -- 172.21.15.7:0/390999998 >> 172.21.15.7:0/390999998 conn(0x7f0e700ff610 msgr2=0x7f0e70101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:51.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e776c2640 1 -- 172.21.15.7:0/390999998 shutdown_connections 2024-09-21T05:55:51.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:55:51.803+0000 7f0e776c2640 1 -- 172.21.15.7:0/390999998 wait complete. 2024-09-21T05:55:51.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:51 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T05:55:51.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:51 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:55:51.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:51 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T05:55:51.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:51 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:55:51.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:51 smithi027 ceph-mon[34364]: pgmap v377: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-21T05:55:52.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:51 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T05:55:52.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:51 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:55:52.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:51 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T05:55:52.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:51 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:55:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:51 smithi007 ceph-mon[30983]: pgmap v377: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-21T05:55:52.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:51 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T05:55:52.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:51 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:55:52.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:51 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T05:55:52.093 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:51 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:55:52.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:51 smithi119 ceph-mon[34833]: pgmap v377: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-21T05:55:52.541 INFO:tasks.cephfs.filesystem:scrub status for tag:438db71b-3351-4115-a5b5-9aa0035a3911 - {'path': '/', 'tag': '438db71b-3351-4115-a5b5-9aa0035a3911', 'options': 'recursive,force'} 2024-09-21T05:55:52.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:52 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T05:55:52.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:52 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T05:55:53.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:52 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T05:55:53.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:53 smithi027 ceph-mon[34364]: pgmap v378: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 867 KiB/s wr, 10 op/s 2024-09-21T05:55:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:53 smithi007 ceph-mon[30983]: pgmap v378: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 867 KiB/s wr, 10 op/s 2024-09-21T05:55:54.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:53 smithi119 ceph-mon[34833]: pgmap v378: 97 pgs: 97 active+clean; 474 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 867 KiB/s wr, 10 op/s 2024-09-21T05:55:55.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:55 smithi027 ceph-mon[34364]: pgmap v379: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 873 KiB/s wr, 14 op/s 2024-09-21T05:55:56.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:55 smithi007 ceph-mon[30983]: pgmap v379: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 873 KiB/s wr, 14 op/s 2024-09-21T05:55:56.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:55 smithi119 ceph-mon[34833]: pgmap v379: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 873 KiB/s wr, 14 op/s 2024-09-21T05:55:57.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:57 smithi027 ceph-mon[34364]: pgmap v380: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-09-21T05:55:57.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:55:58.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:57 smithi007 ceph-mon[30983]: pgmap v380: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-09-21T05:55:58.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:55:58.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:57 smithi119 ceph-mon[34833]: pgmap v380: 97 pgs: 97 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-09-21T05:55:58.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:55:58.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:55:58.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:55:58.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:55:59.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:55:59.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:55:59.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:55:59.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:55:59.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:55:59.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:56:00.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:55:59 smithi027 ceph-mon[34364]: pgmap v381: 97 pgs: 97 active+clean; 487 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 12 op/s 2024-09-21T05:56:00.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:55:59 smithi007 ceph-mon[30983]: pgmap v381: 97 pgs: 97 active+clean; 487 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 12 op/s 2024-09-21T05:56:00.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:55:59 smithi119 ceph-mon[34833]: pgmap v381: 97 pgs: 97 active+clean; 487 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 12 op/s 2024-09-21T05:56:02.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:01 smithi027 ceph-mon[34364]: pgmap v382: 97 pgs: 97 active+clean; 515 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 13 op/s 2024-09-21T05:56:02.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:01 smithi007 ceph-mon[30983]: pgmap v382: 97 pgs: 97 active+clean; 515 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 13 op/s 2024-09-21T05:56:02.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:01 smithi119 ceph-mon[34833]: pgmap v382: 97 pgs: 97 active+clean; 515 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 13 op/s 2024-09-21T05:56:04.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:03 smithi027 ceph-mon[34364]: pgmap v383: 97 pgs: 97 active+clean; 515 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 12 op/s 2024-09-21T05:56:04.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:03 smithi007 ceph-mon[30983]: pgmap v383: 97 pgs: 97 active+clean; 515 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 12 op/s 2024-09-21T05:56:04.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:03 smithi119 ceph-mon[34833]: pgmap v383: 97 pgs: 97 active+clean; 515 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 12 op/s 2024-09-21T05:56:06.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:05 smithi027 ceph-mon[34364]: pgmap v384: 97 pgs: 97 active+clean; 371 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 MiB/s wr, 31 op/s 2024-09-21T05:56:06.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:05 smithi007 ceph-mon[30983]: pgmap v384: 97 pgs: 97 active+clean; 371 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 MiB/s wr, 31 op/s 2024-09-21T05:56:06.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:05 smithi119 ceph-mon[34833]: pgmap v384: 97 pgs: 97 active+clean; 371 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 MiB/s wr, 31 op/s 2024-09-21T05:56:08.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:07 smithi027 ceph-mon[34364]: pgmap v385: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 32 op/s 2024-09-21T05:56:08.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:07 smithi007 ceph-mon[30983]: pgmap v385: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 32 op/s 2024-09-21T05:56:08.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:07 smithi119 ceph-mon[34833]: pgmap v385: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 32 op/s 2024-09-21T05:56:10.144 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:09 smithi119 ceph-mon[34833]: pgmap v386: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 32 op/s 2024-09-21T05:56:10.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:09 smithi027 ceph-mon[34364]: pgmap v386: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 32 op/s 2024-09-21T05:56:10.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:09 smithi007 ceph-mon[30983]: pgmap v386: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 32 op/s 2024-09-21T05:56:12.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:11 smithi027 ceph-mon[34364]: pgmap v387: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 31 op/s 2024-09-21T05:56:12.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:11 smithi007 ceph-mon[30983]: pgmap v387: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 31 op/s 2024-09-21T05:56:12.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:11 smithi119 ceph-mon[34833]: pgmap v387: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 31 op/s 2024-09-21T05:56:14.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:13 smithi027 ceph-mon[34364]: pgmap v388: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 27 op/s 2024-09-21T05:56:14.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:13 smithi007 ceph-mon[30983]: pgmap v388: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 27 op/s 2024-09-21T05:56:14.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:13 smithi119 ceph-mon[34833]: pgmap v388: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 27 op/s 2024-09-21T05:56:16.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:15 smithi027 ceph-mon[34364]: pgmap v389: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 29 op/s 2024-09-21T05:56:16.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:15 smithi007 ceph-mon[30983]: pgmap v389: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 29 op/s 2024-09-21T05:56:16.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:15 smithi119 ceph-mon[34833]: pgmap v389: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 29 op/s 2024-09-21T05:56:18.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:17 smithi027 ceph-mon[34364]: pgmap v390: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-09-21T05:56:18.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:17 smithi007 ceph-mon[30983]: pgmap v390: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-09-21T05:56:18.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:17 smithi119 ceph-mon[34833]: pgmap v390: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-09-21T05:56:20.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:19 smithi027 ceph-mon[34364]: pgmap v391: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T05:56:20.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:19 smithi007 ceph-mon[30983]: pgmap v391: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T05:56:20.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:19 smithi119 ceph-mon[34833]: pgmap v391: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T05:56:22.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:21 smithi027 ceph-mon[34364]: pgmap v392: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:56:22.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:21 smithi007 ceph-mon[30983]: pgmap v392: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:56:22.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:21 smithi119 ceph-mon[34833]: pgmap v392: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:56:22.542 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:56:22.819 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:56:23.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.427+0000 7fad1a190640 1 -- 172.21.15.7:0/2359483102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad14108d10 msgr2=0x7fad1410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.427+0000 7fad1a190640 1 --2- 172.21.15.7:0/2359483102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad14108d10 0x7fad1410f540 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009ca0 tx=0x7fad0c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.427+0000 7fad1a190640 1 -- 172.21.15.7:0/2359483102 shutdown_connections 2024-09-21T05:56:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.427+0000 7fad1a190640 1 --2- 172.21.15.7:0/2359483102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad14108d10 0x7fad1410f540 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.427+0000 7fad1a190640 1 --2- 172.21.15.7:0/2359483102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad141083c0 0x7fad141087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.427+0000 7fad1a190640 1 --2- 172.21.15.7:0/2359483102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad14102a80 0x7fad14102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.427+0000 7fad1a190640 1 -- 172.21.15.7:0/2359483102 >> 172.21.15.7:0/2359483102 conn(0x7fad14079740 msgr2=0x7fad14079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.427+0000 7fad1a190640 1 -- 172.21.15.7:0/2359483102 shutdown_connections 2024-09-21T05:56:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.427+0000 7fad1a190640 1 -- 172.21.15.7:0/2359483102 wait complete. 2024-09-21T05:56:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.427+0000 7fad1a190640 1 Processor -- start 2024-09-21T05:56:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.428+0000 7fad1a190640 1 -- start start 2024-09-21T05:56:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.428+0000 7fad1a190640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad14102a80 0x7fad140ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.428+0000 7fad1a190640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad141083c0 0x7fad140ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.428+0000 7fad1a190640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad14108d10 0x7fad14100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.428+0000 7fad1a190640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad14112980 con 0x7fad14108d10 2024-09-21T05:56:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.428+0000 7fad1a190640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fad14112800 con 0x7fad14102a80 2024-09-21T05:56:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.428+0000 7fad1a190640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fad14112b00 con 0x7fad141083c0 2024-09-21T05:56:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.428+0000 7fad13fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad14108d10 0x7fad14100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.428+0000 7fad13fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad14108d10 0x7fad14100110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33738/0 (socket says 172.21.15.7:33738) 2024-09-21T05:56:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.428+0000 7fad13fff640 1 -- 172.21.15.7:0/4127403309 learned_addr learned my addr 172.21.15.7:0/4127403309 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.428+0000 7fad137fe640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad14102a80 0x7fad140ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.428+0000 7fad12ffd640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad141083c0 0x7fad140ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.429+0000 7fad13fff640 1 -- 172.21.15.7:0/4127403309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad141083c0 msgr2=0x7fad140ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.429+0000 7fad13fff640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad141083c0 0x7fad140ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.429+0000 7fad13fff640 1 -- 172.21.15.7:0/4127403309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad14102a80 msgr2=0x7fad140ff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.429+0000 7fad13fff640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad14102a80 0x7fad140ff690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.429+0000 7fad13fff640 1 -- 172.21.15.7:0/4127403309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad141a86e0 con 0x7fad14108d10 2024-09-21T05:56:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.429+0000 7fad137fe640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad14102a80 0x7fad140ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.429+0000 7fad13fff640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad14108d10 0x7fad14100110 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0098d0 tx=0x7fad0c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.429+0000 7fad10ff9640 1 -- 172.21.15.7:0/4127403309 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c003b70 con 0x7fad14108d10 2024-09-21T05:56:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.429+0000 7fad1a190640 1 -- 172.21.15.7:0/4127403309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad141a8970 con 0x7fad14108d10 2024-09-21T05:56:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.429+0000 7fad10ff9640 1 -- 172.21.15.7:0/4127403309 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad0c003d10 con 0x7fad14108d10 2024-09-21T05:56:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.429+0000 7fad10ff9640 1 -- 172.21.15.7:0/4127403309 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c02fa20 con 0x7fad14108d10 2024-09-21T05:56:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.429+0000 7fad1a190640 1 -- 172.21.15.7:0/4127403309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad141a8eb0 con 0x7fad14108d10 2024-09-21T05:56:23.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.432+0000 7fad20704740 1 Processor -- start 2024-09-21T05:56:23.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.432+0000 7fad10ff9640 1 -- 172.21.15.7:0/4127403309 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fad0c02fc40 con 0x7fad14108d10 2024-09-21T05:56:23.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.432+0000 7fad20704740 1 -- start start 2024-09-21T05:56:23.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.432+0000 7fad20704740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e42270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.432+0000 7fad20704740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e427b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.432+0000 7fad20704740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e42cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.432+0000 7fad20704740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55df55db8e50 con 0x55df55a7a390 2024-09-21T05:56:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.432+0000 7fad20704740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55df55da8280 con 0x55df55a721b0 2024-09-21T05:56:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.432+0000 7fad20704740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55df55dac090 con 0x55df55a9b070 2024-09-21T05:56:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.432+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e42cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.432+0000 7fad137fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.433+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e42cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33742/0 (socket says 172.21.15.7:33742) 2024-09-21T05:56:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.433+0000 7fad12ffd640 1 -- 172.21.15.7:0/1724725372 learned_addr learned my addr 172.21.15.7:0/1724725372 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.433+0000 7fad12ffd640 1 --2- 172.21.15.7:0/1724725372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e42270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.433+0000 7fad137fe640 1 -- 172.21.15.7:0/1724725372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 msgr2=0x55df55e42270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.433+0000 7fad137fe640 1 --2- 172.21.15.7:0/1724725372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e42270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.433+0000 7fad137fe640 1 -- 172.21.15.7:0/1724725372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 msgr2=0x55df55e42cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.433+0000 7fad137fe640 1 --2- 172.21.15.7:0/1724725372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e42cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.433+0000 7fad137fe640 1 -- 172.21.15.7:0/1724725372 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df55b06650 con 0x55df55a721b0 2024-09-21T05:56:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.433+0000 7fad12ffd640 1 --2- 172.21.15.7:0/1724725372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e42cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.433+0000 7fad10ff9640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7facfc0b6680 0x7facfc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.433+0000 7fad12ffd640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7facfc0b6680 0x7facfc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.433+0000 7fad10ff9640 1 -- 172.21.15.7:0/4127403309 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fad0c108940 con 0x7fad14108d10 2024-09-21T05:56:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.433+0000 7fad137fe640 1 --2- 172.21.15.7:0/1724725372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e427b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad04009fa0 tx=0x7fad040118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec4c8c7efa095e3b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.434+0000 7facf9ffb640 1 -- 172.21.15.7:0/1724725372 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04004030 con 0x55df55a721b0 2024-09-21T05:56:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.434+0000 7fad12ffd640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7facfc0b6680 0x7facfc0b8b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fad0800bfd0 tx=0x7fad08004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.434+0000 7facf9ffb640 1 -- 172.21.15.7:0/1724725372 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad040054d0 con 0x55df55a721b0 2024-09-21T05:56:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.434+0000 7facf9ffb640 1 -- 172.21.15.7:0/1724725372 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04004c00 con 0x55df55a721b0 2024-09-21T05:56:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.434+0000 7fad20704740 1 -- 172.21.15.7:0/1724725372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 msgr2=0x55df55e427b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.434+0000 7fad20704740 1 --2- 172.21.15.7:0/1724725372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e427b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad04009fa0 tx=0x7fad040118d0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.435+0000 7fad20704740 1 -- 172.21.15.7:0/1724725372 shutdown_connections 2024-09-21T05:56:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.435+0000 7fad20704740 1 --2- 172.21.15.7:0/1724725372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e42cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.435+0000 7fad20704740 1 --2- 172.21.15.7:0/1724725372 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e427b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.435+0000 7fad20704740 1 --2- 172.21.15.7:0/1724725372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e42270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.435+0000 7fad20704740 1 -- 172.21.15.7:0/1724725372 >> 172.21.15.7:0/1724725372 conn(0x55df55a8f460 msgr2=0x55df55e40160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.435+0000 7fad20704740 1 -- 172.21.15.7:0/1724725372 shutdown_connections 2024-09-21T05:56:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.435+0000 7fad20704740 1 -- 172.21.15.7:0/1724725372 wait complete. 2024-09-21T05:56:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.435+0000 7fad20704740 1 -- start start 2024-09-21T05:56:23.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.435+0000 7fad20704740 1 Processor -- start 2024-09-21T05:56:23.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad20704740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e4d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad20704740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e4de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad20704740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e59d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad20704740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55df55c09700 con 0x55df55a7a390 2024-09-21T05:56:23.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad20704740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55df55d43110 con 0x55df55a721b0 2024-09-21T05:56:23.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad20704740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55df55e50a50 con 0x55df55a9b070 2024-09-21T05:56:23.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad20704740 10 client.0 _ll_register_callbacks cb 0x55df55d5c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:23.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e4de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e4de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33746/0 (socket says 172.21.15.7:33746) 2024-09-21T05:56:23.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad12ffd640 1 -- 172.21.15.7:0/255059395 learned_addr learned my addr 172.21.15.7:0/255059395 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad137fe640 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e4d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad13fff640 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e59d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad12ffd640 1 -- 172.21.15.7:0/255059395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 msgr2=0x55df55e59d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad12ffd640 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e59d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad12ffd640 1 -- 172.21.15.7:0/255059395 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 msgr2=0x55df55e4d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad12ffd640 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e4d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad12ffd640 1 -- 172.21.15.7:0/255059395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df55d70c40 con 0x55df55a7a390 2024-09-21T05:56:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad13fff640 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e59d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:56:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7fad12ffd640 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e4de40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fad0800b5f0 tx=0x7fad0800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921bf54e8a9e759b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.436+0000 7facf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:56:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7facf2ffd640 1 -- 172.21.15.7:0/255059395 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08005020 con 0x55df55a7a390 2024-09-21T05:56:23.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7facf2ffd640 1 -- 172.21.15.7:0/255059395 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fad080051c0 con 0x55df55a7a390 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7fad20704740 1 -- 172.21.15.7:0/255059395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad040054d0 con 0x55df55a7a390 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7facf2ffd640 1 -- 172.21.15.7:0/255059395 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad080053c0 con 0x55df55a7a390 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7fad20704740 10 client.16026 fetch_fsmap learned FSMap version 25 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7fad20704740 1 -- 172.21.15.7:0/255059395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55df55e5c7c0 con 0x55df55a7a390 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7facf2ffd640 1 -- 172.21.15.7:0/255059395 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad040054d0 con 0x55df55a7a390 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7facf2ffd640 1 -- 172.21.15.7:0/255059395 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fad080108f0 con 0x55df55a7a390 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7fad20704740 10 client.16026 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7fad20704740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7fad20704740 20 client.16026 populate_metadata read hostname 'smithi007' 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7fad20704740 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55df55a599f0 0x55df55e5fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7fad20704740 4 client.16026 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.437+0000 7fad20704740 1 -- 172.21.15.7:0/255059395 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df55dbada0 con 0x55df55a599f0 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.438+0000 7fad137fe640 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55df55a599f0 0x55df55e5fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.438+0000 7facf2ffd640 10 client.16026 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.438+0000 7fad137fe640 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55df55a599f0 0x55df55e5fc80 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84f02bb553cc53a server_cookie=f22c561a30e3fc0f in_seq=0 out_seq=0 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.439+0000 7facf2ffd640 1 -- 172.21.15.7:0/255059395 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55df55dbada0 con 0x55df55a599f0 2024-09-21T05:56:23.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.439+0000 7facf2ffd640 10 client.16026 handle_command_reply: tid=0 2024-09-21T05:56:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.439+0000 7fad20704740 1 client.16026 shutdown 2024-09-21T05:56:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.439+0000 7fad20704740 1 -- 172.21.15.7:0/255059395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 msgr2=0x55df55e4de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.439+0000 7fad20704740 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e4de40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fad0800b5f0 tx=0x7fad0800b390 comp rx=0 tx=0).stop 2024-09-21T05:56:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.439+0000 7fad20704740 1 -- 172.21.15.7:0/255059395 shutdown_connections 2024-09-21T05:56:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.439+0000 7fad20704740 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55df55a599f0 0x55df55e5fc80 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.439+0000 7fad20704740 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e4de40 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.439+0000 7fad20704740 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e59d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.439+0000 7fad20704740 1 --2- 172.21.15.7:0/255059395 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e4d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.439+0000 7fad20704740 1 -- 172.21.15.7:0/255059395 >> 172.21.15.7:0/255059395 conn(0x55df55a8f460 msgr2=0x55df55e45400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.439+0000 7facf2ffd640 0 client.16026 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.440+0000 7fad20704740 1 -- 172.21.15.7:0/255059395 shutdown_connections 2024-09-21T05:56:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.440+0000 7fad20704740 1 -- 172.21.15.7:0/255059395 wait complete. 2024-09-21T05:56:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.440+0000 7fad20704740 20 client.16026 trim_cache size 0 max 16384 2024-09-21T05:56:23.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.457+0000 7fad20704740 1 Processor -- start 2024-09-21T05:56:23.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.457+0000 7fad20704740 1 -- start start 2024-09-21T05:56:23.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad20704740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e43c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad20704740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e4f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad20704740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e59c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad20704740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad141b3fa0 con 0x55df55a7a390 2024-09-21T05:56:23.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad20704740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fad141b1870 con 0x55df55a721b0 2024-09-21T05:56:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad20704740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fad141af6c0 con 0x55df55a9b070 2024-09-21T05:56:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e4f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e4f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33752/0 (socket says 172.21.15.7:33752) 2024-09-21T05:56:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad12ffd640 1 -- 172.21.15.7:0/245781538 learned_addr learned my addr 172.21.15.7:0/245781538 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad137fe640 1 --2- 172.21.15.7:0/245781538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e43c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad13fff640 1 --2- 172.21.15.7:0/245781538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e59c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad12ffd640 1 -- 172.21.15.7:0/245781538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 msgr2=0x55df55e59c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad12ffd640 1 --2- 172.21.15.7:0/245781538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e59c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad12ffd640 1 -- 172.21.15.7:0/245781538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 msgr2=0x55df55e43c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad12ffd640 1 --2- 172.21.15.7:0/245781538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e43c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad12ffd640 1 -- 172.21.15.7:0/245781538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df55e3b580 con 0x55df55a7a390 2024-09-21T05:56:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.458+0000 7fad137fe640 1 --2- 172.21.15.7:0/245781538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e43c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:23.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.459+0000 7fad12ffd640 1 --2- 172.21.15.7:0/245781538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e4f530 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fad08010d40 tx=0x7fad08012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e7839c03453630 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:23.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.459+0000 7facf97fa640 1 -- 172.21.15.7:0/245781538 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08012df0 con 0x55df55a7a390 2024-09-21T05:56:23.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.459+0000 7facf97fa640 1 -- 172.21.15.7:0/245781538 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad08005560 con 0x55df55a7a390 2024-09-21T05:56:23.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.459+0000 7facf97fa640 1 -- 172.21.15.7:0/245781538 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0803fc20 con 0x55df55a7a390 2024-09-21T05:56:23.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.460+0000 7fad20704740 1 -- 172.21.15.7:0/245781538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 msgr2=0x55df55e4f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:23.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.460+0000 7fad20704740 1 --2- 172.21.15.7:0/245781538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e4f530 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fad08010d40 tx=0x7fad08012040 comp rx=0 tx=0).stop 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.460+0000 7fad20704740 1 -- 172.21.15.7:0/245781538 shutdown_connections 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.460+0000 7fad20704740 1 --2- 172.21.15.7:0/245781538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e4f530 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.460+0000 7fad20704740 1 --2- 172.21.15.7:0/245781538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e59c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.460+0000 7fad20704740 1 --2- 172.21.15.7:0/245781538 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e43c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.460+0000 7fad20704740 1 -- 172.21.15.7:0/245781538 >> 172.21.15.7:0/245781538 conn(0x55df55a8f460 msgr2=0x55df55e4ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.460+0000 7fad20704740 1 -- 172.21.15.7:0/245781538 shutdown_connections 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.460+0000 7fad20704740 1 -- 172.21.15.7:0/245781538 wait complete. 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.460+0000 7fad20704740 1 -- start start 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.461+0000 7fad20704740 1 Processor -- start 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.461+0000 7fad20704740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e51e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.461+0000 7fad20704740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e52390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.461+0000 7fad20704740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.461+0000 7fad20704740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad141afd30 con 0x55df55a7a390 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.461+0000 7fad20704740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fad141b11a0 con 0x55df55a721b0 2024-09-21T05:56:23.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.461+0000 7fad20704740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fad141b0400 con 0x55df55a9b070 2024-09-21T05:56:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.461+0000 7fad20704740 10 client.0 _ll_register_callbacks cb 0x7fad08005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.461+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e52390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.461+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e52390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33764/0 (socket says 172.21.15.7:33764) 2024-09-21T05:56:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.461+0000 7fad12ffd640 1 -- 172.21.15.7:0/1881197771 learned_addr learned my addr 172.21.15.7:0/1881197771 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.461+0000 7fad13fff640 1 --2- 172.21.15.7:0/1881197771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.461+0000 7fad137fe640 1 --2- 172.21.15.7:0/1881197771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e51e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.462+0000 7fad12ffd640 1 -- 172.21.15.7:0/1881197771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 msgr2=0x55df55e528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.462+0000 7fad12ffd640 1 --2- 172.21.15.7:0/1881197771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.462+0000 7fad12ffd640 1 -- 172.21.15.7:0/1881197771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 msgr2=0x55df55e51e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.462+0000 7fad12ffd640 1 --2- 172.21.15.7:0/1881197771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e51e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.462+0000 7fad12ffd640 1 -- 172.21.15.7:0/1881197771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df55ec97f0 con 0x55df55a7a390 2024-09-21T05:56:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.462+0000 7fad12ffd640 1 --2- 172.21.15.7:0/1881197771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e52390 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fad0803f800 tx=0x7fad080057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f330da9bcc00d0af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.462+0000 7facf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:56:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.462+0000 7facf2ffd640 1 -- 172.21.15.7:0/1881197771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0800bb70 con 0x55df55a7a390 2024-09-21T05:56:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.462+0000 7facf2ffd640 1 -- 172.21.15.7:0/1881197771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fad08010730 con 0x55df55a7a390 2024-09-21T05:56:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.462+0000 7fad20704740 1 -- 172.21.15.7:0/1881197771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad08005560 con 0x55df55a7a390 2024-09-21T05:56:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.462+0000 7facf2ffd640 1 -- 172.21.15.7:0/1881197771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad08010930 con 0x55df55a7a390 2024-09-21T05:56:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.462+0000 7fad20704740 10 client.16032 fetch_fsmap learned FSMap version 25 2024-09-21T05:56:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.462+0000 7fad20704740 1 -- 172.21.15.7:0/1881197771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55df55ecaa80 con 0x55df55a7a390 2024-09-21T05:56:23.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.463+0000 7facf2ffd640 1 -- 172.21.15.7:0/1881197771 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad08005560 con 0x55df55a7a390 2024-09-21T05:56:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.463+0000 7facf2ffd640 1 -- 172.21.15.7:0/1881197771 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fad0802b6f0 con 0x55df55a7a390 2024-09-21T05:56:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.463+0000 7fad20704740 10 client.16032 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:56:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.463+0000 7fad20704740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:56:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.463+0000 7fad20704740 20 client.16032 populate_metadata read hostname 'smithi007' 2024-09-21T05:56:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.463+0000 7fad20704740 1 --2- 172.21.15.7:0/1881197771 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55df55a2eda0 0x55df55ecd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.463+0000 7fad20704740 4 client.16032 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:56:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.463+0000 7fad20704740 1 -- 172.21.15.7:0/1881197771 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55df55e4e1f0 con 0x55df55a2eda0 2024-09-21T05:56:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.463+0000 7fad137fe640 1 --2- 172.21.15.7:0/1881197771 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55df55a2eda0 0x55df55ecd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7fad137fe640 1 --2- 172.21.15.7:0/1881197771 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55df55a2eda0 0x55df55ecd0a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e6c65bee366d921 server_cookie=a8f36db06781c103 in_seq=0 out_seq=0 2024-09-21T05:56:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7facf2ffd640 10 client.16032 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7facf2ffd640 1 -- 172.21.15.7:0/1881197771 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55df55e4e1f0 con 0x55df55a2eda0 2024-09-21T05:56:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7facf2ffd640 10 client.16032 handle_command_reply: tid=0 2024-09-21T05:56:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7fad20704740 1 client.16032 shutdown 2024-09-21T05:56:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7fad20704740 1 -- 172.21.15.7:0/1881197771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 msgr2=0x55df55e52390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7fad20704740 1 --2- 172.21.15.7:0/1881197771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e52390 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fad0803f800 tx=0x7fad080057a0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7fad20704740 1 -- 172.21.15.7:0/1881197771 shutdown_connections 2024-09-21T05:56:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7fad20704740 1 --2- 172.21.15.7:0/1881197771 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55df55a2eda0 0x55df55ecd0a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7facf2ffd640 0 client.16032 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7fad20704740 1 --2- 172.21.15.7:0/1881197771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df55a7a390 0x55df55e52390 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7fad20704740 1 --2- 172.21.15.7:0/1881197771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55df55a9b070 0x55df55e528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7fad20704740 1 --2- 172.21.15.7:0/1881197771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55df55a721b0 0x55df55e51e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.464+0000 7fad20704740 1 -- 172.21.15.7:0/1881197771 >> 172.21.15.7:0/1881197771 conn(0x55df55a8f460 msgr2=0x55df55e43a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:23.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.465+0000 7fad20704740 1 -- 172.21.15.7:0/1881197771 shutdown_connections 2024-09-21T05:56:23.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.465+0000 7fad20704740 1 -- 172.21.15.7:0/1881197771 wait complete. 2024-09-21T05:56:23.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.465+0000 7fad20704740 20 client.16032 trim_cache size 0 max 16384 2024-09-21T05:56:23.471 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:56:23.471 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T05:56:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T05:56:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:56:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:56:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:56:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:56:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:56:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:56:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:56:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:56:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:56:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:56:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:56:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:56:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:56:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:56:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:56:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:56:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:56:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:56:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:56:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:56:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:56:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:56:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:56:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:56:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:56:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:56:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:56:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:56:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:56:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:56:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:56:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:56:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:56:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:56:23.474 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:56:23.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.465+0000 7fad1a190640 1 -- 172.21.15.7:0/4127403309 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7facfc0b6680 msgr2=0x7facfc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:23.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.465+0000 7fad1a190640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7facfc0b6680 0x7facfc0b8b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fad0800bfd0 tx=0x7fad08004730 comp rx=0 tx=0).stop 2024-09-21T05:56:23.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.465+0000 7fad1a190640 1 -- 172.21.15.7:0/4127403309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad14108d10 msgr2=0x7fad14100110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.465+0000 7fad1a190640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad14108d10 0x7fad14100110 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0098d0 tx=0x7fad0c0317b0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.465+0000 7fad1a190640 1 -- 172.21.15.7:0/4127403309 shutdown_connections 2024-09-21T05:56:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.465+0000 7fad1a190640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7facfc0b6680 0x7facfc0b8b90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.465+0000 7fad1a190640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad14108d10 0x7fad14100110 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.465+0000 7fad1a190640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad141083c0 0x7fad140ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.465+0000 7fad1a190640 1 --2- 172.21.15.7:0/4127403309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad14102a80 0x7fad140ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.465+0000 7fad1a190640 1 -- 172.21.15.7:0/4127403309 >> 172.21.15.7:0/4127403309 conn(0x7fad14079740 msgr2=0x7fad1406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.466+0000 7fad1a190640 1 -- 172.21.15.7:0/4127403309 shutdown_connections 2024-09-21T05:56:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:23.466+0000 7fad1a190640 1 -- 172.21.15.7:0/4127403309 wait complete. 2024-09-21T05:56:24.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:23 smithi007 ceph-mon[30983]: pgmap v393: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:56:24.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:23 smithi027 ceph-mon[34364]: pgmap v393: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:56:24.309 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T05:56:24.309 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:56:24.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:23 smithi119 ceph-mon[34833]: pgmap v393: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:56:24.583 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:56:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.084+0000 7fd462537640 1 -- 172.21.15.7:0/3450223482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c1094a0 msgr2=0x7fd45c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.084+0000 7fd462537640 1 --2- 172.21.15.7:0/3450223482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c1094a0 0x7fd45c1098b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd450009900 tx=0x7fd45002a410 comp rx=0 tx=0).stop 2024-09-21T05:56:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.084+0000 7fd462537640 1 -- 172.21.15.7:0/3450223482 shutdown_connections 2024-09-21T05:56:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.084+0000 7fd462537640 1 --2- 172.21.15.7:0/3450223482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c1094a0 0x7fd45c1098b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.084+0000 7fd462537640 1 --2- 172.21.15.7:0/3450223482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd45c109df0 0x7fd45c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.084+0000 7fd462537640 1 --2- 172.21.15.7:0/3450223482 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd45c103b60 0x7fd45c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.084+0000 7fd462537640 1 -- 172.21.15.7:0/3450223482 >> 172.21.15.7:0/3450223482 conn(0x7fd45c07b850 msgr2=0x7fd45c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.084+0000 7fd462537640 1 -- 172.21.15.7:0/3450223482 shutdown_connections 2024-09-21T05:56:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.084+0000 7fd462537640 1 -- 172.21.15.7:0/3450223482 wait complete. 2024-09-21T05:56:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.085+0000 7fd462537640 1 Processor -- start 2024-09-21T05:56:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.085+0000 7fd462537640 1 -- start start 2024-09-21T05:56:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.085+0000 7fd462537640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd45c103b60 0x7fd45c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.085+0000 7fd462537640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd45c1094a0 0x7fd45c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.085+0000 7fd462537640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c109df0 0x7fd45c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.085+0000 7fd462537640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd45c113ad0 con 0x7fd45c109df0 2024-09-21T05:56:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd462537640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd45c113950 con 0x7fd45c1094a0 2024-09-21T05:56:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd462537640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd45c113c50 con 0x7fd45c103b60 2024-09-21T05:56:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd460ad4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c109df0 0x7fd45c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd45bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd45c103b60 0x7fd45c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd460ad4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c109df0 0x7fd45c076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33784/0 (socket says 172.21.15.7:33784) 2024-09-21T05:56:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd460ad4640 1 -- 172.21.15.7:0/2684931769 learned_addr learned my addr 172.21.15.7:0/2684931769 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd45b7fe640 1 --2- 172.21.15.7:0/2684931769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd45c1094a0 0x7fd45c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd460ad4640 1 -- 172.21.15.7:0/2684931769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd45c103b60 msgr2=0x7fd45c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd460ad4640 1 --2- 172.21.15.7:0/2684931769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd45c103b60 0x7fd45c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd460ad4640 1 -- 172.21.15.7:0/2684931769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd45c1094a0 msgr2=0x7fd45c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd460ad4640 1 --2- 172.21.15.7:0/2684931769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd45c1094a0 0x7fd45c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd460ad4640 1 -- 172.21.15.7:0/2684931769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45c1a8860 con 0x7fd45c109df0 2024-09-21T05:56:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd460ad4640 1 --2- 172.21.15.7:0/2684931769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c109df0 0x7fd45c076190 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd45400b970 tx=0x7fd45400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd4597fa640 1 -- 172.21.15.7:0/2684931769 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454019070 con 0x7fd45c109df0 2024-09-21T05:56:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.086+0000 7fd4597fa640 1 -- 172.21.15.7:0/2684931769 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd454014440 con 0x7fd45c109df0 2024-09-21T05:56:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.087+0000 7fd462537640 1 -- 172.21.15.7:0/2684931769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd45c1a8b50 con 0x7fd45c109df0 2024-09-21T05:56:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.087+0000 7fd4597fa640 1 -- 172.21.15.7:0/2684931769 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4540075d0 con 0x7fd45c109df0 2024-09-21T05:56:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.087+0000 7fd462537640 1 -- 172.21.15.7:0/2684931769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd45c1a9010 con 0x7fd45c109df0 2024-09-21T05:56:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.088+0000 7fd462537640 1 -- 172.21.15.7:0/2684931769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd45c104de0 con 0x7fd45c109df0 2024-09-21T05:56:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.089+0000 7fd4597fa640 1 -- 172.21.15.7:0/2684931769 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd45401c070 con 0x7fd45c109df0 2024-09-21T05:56:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.090+0000 7fd4597fa640 1 --2- 172.21.15.7:0/2684931769 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4440b6680 0x7fd4440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:25.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.090+0000 7fd45bfff640 1 --2- 172.21.15.7:0/2684931769 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4440b6680 0x7fd4440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:25.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.090+0000 7fd4597fa640 1 -- 172.21.15.7:0/2684931769 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fd4540e6fc0 con 0x7fd45c109df0 2024-09-21T05:56:25.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.091+0000 7fd45bfff640 1 --2- 172.21.15.7:0/2684931769 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4440b6680 0x7fd4440b8b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd45c077160 tx=0x7fd44c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:25.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.093+0000 7fd4597fa640 1 -- 172.21.15.7:0/2684931769 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4540b1970 con 0x7fd45c109df0 2024-09-21T05:56:25.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.319+0000 7fd462537640 1 -- 172.21.15.7:0/2684931769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd45c103f70 con 0x7fd45c109df0 2024-09-21T05:56:25.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.320+0000 7fd4597fa640 1 -- 172.21.15.7:0/2684931769 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7fd45c103f70 con 0x7fd45c109df0 2024-09-21T05:56:25.325 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:56:25.325 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:56:25.326 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:56:25.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.322+0000 7fd462537640 1 -- 172.21.15.7:0/2684931769 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4440b6680 msgr2=0x7fd4440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:25.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.322+0000 7fd462537640 1 --2- 172.21.15.7:0/2684931769 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4440b6680 0x7fd4440b8b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd45c077160 tx=0x7fd44c00b390 comp rx=0 tx=0).stop 2024-09-21T05:56:25.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.322+0000 7fd462537640 1 -- 172.21.15.7:0/2684931769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c109df0 msgr2=0x7fd45c076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:25.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.322+0000 7fd462537640 1 --2- 172.21.15.7:0/2684931769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c109df0 0x7fd45c076190 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd45400b970 tx=0x7fd45400be30 comp rx=0 tx=0).stop 2024-09-21T05:56:25.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.322+0000 7fd462537640 1 -- 172.21.15.7:0/2684931769 shutdown_connections 2024-09-21T05:56:25.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.322+0000 7fd462537640 1 --2- 172.21.15.7:0/2684931769 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4440b6680 0x7fd4440b8b90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.322+0000 7fd462537640 1 --2- 172.21.15.7:0/2684931769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45c109df0 0x7fd45c076190 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.322+0000 7fd462537640 1 --2- 172.21.15.7:0/2684931769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd45c1094a0 0x7fd45c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.322+0000 7fd462537640 1 --2- 172.21.15.7:0/2684931769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd45c103b60 0x7fd45c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.322+0000 7fd462537640 1 -- 172.21.15.7:0/2684931769 >> 172.21.15.7:0/2684931769 conn(0x7fd45c07b850 msgr2=0x7fd45c1075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:25.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.322+0000 7fd462537640 1 -- 172.21.15.7:0/2684931769 shutdown_connections 2024-09-21T05:56:25.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:25.322+0000 7fd462537640 1 -- 172.21.15.7:0/2684931769 wait complete. 2024-09-21T05:56:25.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:25 smithi007 ceph-mon[30983]: pgmap v394: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:56:25.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:25 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2684931769' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:56:25.952 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T05:56:26.213 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:56:26.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:25 smithi027 ceph-mon[34364]: pgmap v394: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:56:26.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:25 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2684931769' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:56:26.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:25 smithi119 ceph-mon[34833]: pgmap v394: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:56:26.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:25 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2684931769' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.687+0000 7ff0911f5640 1 -- 172.21.15.7:0/431879219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff08c103b90 msgr2=0x7ff08c103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.687+0000 7ff0911f5640 1 --2- 172.21.15.7:0/431879219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff08c103b90 0x7ff08c103fa0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009900 tx=0x7ff07c02a410 comp rx=0 tx=0).stop 2024-09-21T05:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.687+0000 7ff0911f5640 1 -- 172.21.15.7:0/431879219 shutdown_connections 2024-09-21T05:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.687+0000 7ff0911f5640 1 --2- 172.21.15.7:0/431879219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff08c109e20 0x7ff08c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.687+0000 7ff0911f5640 1 --2- 172.21.15.7:0/431879219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff08c1094d0 0x7ff08c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.687+0000 7ff0911f5640 1 --2- 172.21.15.7:0/431879219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff08c103b90 0x7ff08c103fa0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.687+0000 7ff0911f5640 1 -- 172.21.15.7:0/431879219 >> 172.21.15.7:0/431879219 conn(0x7ff08c0ff5e0 msgr2=0x7ff08c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.687+0000 7ff0911f5640 1 -- 172.21.15.7:0/431879219 shutdown_connections 2024-09-21T05:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.687+0000 7ff0911f5640 1 -- 172.21.15.7:0/431879219 wait complete. 2024-09-21T05:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff0911f5640 1 Processor -- start 2024-09-21T05:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff0911f5640 1 -- start start 2024-09-21T05:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff0911f5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff08c103b90 0x7ff08c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff0911f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff08c1094d0 0x7ff08c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff0911f5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff08c109e20 0x7ff08c19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff0911f5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c113ae0 con 0x7ff08c1094d0 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff0911f5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c113960 con 0x7ff08c103b90 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff0911f5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c113c60 con 0x7ff08c109e20 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff083fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff08c1094d0 0x7ff08c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff083fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff08c1094d0 0x7ff08c19aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33796/0 (socket says 172.21.15.7:33796) 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff083fff640 1 -- 172.21.15.7:0/1867425996 learned_addr learned my addr 172.21.15.7:0/1867425996 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff08ad9d640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff08c103b90 0x7ff08c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff08b59e640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff08c109e20 0x7ff08c19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff083fff640 1 -- 172.21.15.7:0/1867425996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff08c109e20 msgr2=0x7ff08c19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff083fff640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff08c109e20 0x7ff08c19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff083fff640 1 -- 172.21.15.7:0/1867425996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff08c103b90 msgr2=0x7ff08c19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff083fff640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff08c103b90 0x7ff08c19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff083fff640 1 -- 172.21.15.7:0/1867425996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c1a0420 con 0x7ff08c1094d0 2024-09-21T05:56:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.688+0000 7ff08ad9d640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff08c103b90 0x7ff08c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:56:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.689+0000 7ff083fff640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff08c1094d0 0x7ff08c19aa50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff07400e9f0 tx=0x7ff07400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.689+0000 7ff088d99640 1 -- 172.21.15.7:0/1867425996 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07400ccc0 con 0x7ff08c1094d0 2024-09-21T05:56:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.689+0000 7ff0911f5640 1 -- 172.21.15.7:0/1867425996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08c1a0710 con 0x7ff08c1094d0 2024-09-21T05:56:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.689+0000 7ff088d99640 1 -- 172.21.15.7:0/1867425996 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0740108e0 con 0x7ff08c1094d0 2024-09-21T05:56:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.689+0000 7ff088d99640 1 -- 172.21.15.7:0/1867425996 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074018860 con 0x7ff08c1094d0 2024-09-21T05:56:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.689+0000 7ff0911f5640 1 -- 172.21.15.7:0/1867425996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff08c1a6e70 con 0x7ff08c1094d0 2024-09-21T05:56:26.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.692+0000 7ff097769740 1 Processor -- start 2024-09-21T05:56:26.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.692+0000 7ff097769740 1 -- start start 2024-09-21T05:56:26.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.692+0000 7ff088d99640 1 -- 172.21.15.7:0/1867425996 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff074010430 con 0x7ff08c1094d0 2024-09-21T05:56:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.692+0000 7ff097769740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b0b0070 0x55db1b4572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.692+0000 7ff097769740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 0x55db1b457800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.692+0000 7ff097769740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 0x55db1b457d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.692+0000 7ff097769740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55db1b3cdea0 con 0x55db1b08f390 2024-09-21T05:56:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.692+0000 7ff097769740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55db1b3bd2d0 con 0x55db1b0b0070 2024-09-21T05:56:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.692+0000 7ff097769740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55db1b3c10e0 con 0x55db1b0871b0 2024-09-21T05:56:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.693+0000 7ff083fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 0x55db1b457d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.693+0000 7ff083fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 0x55db1b457d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33804/0 (socket says 172.21.15.7:33804) 2024-09-21T05:56:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.693+0000 7ff083fff640 1 -- 172.21.15.7:0/3285210505 learned_addr learned my addr 172.21.15.7:0/3285210505 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.693+0000 7ff08b59e640 1 --2- 172.21.15.7:0/3285210505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b0b0070 0x55db1b4572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.693+0000 7ff08ad9d640 1 --2- 172.21.15.7:0/3285210505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 0x55db1b457800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.693+0000 7ff083fff640 1 -- 172.21.15.7:0/3285210505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 msgr2=0x55db1b457800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.693+0000 7ff083fff640 1 --2- 172.21.15.7:0/3285210505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 0x55db1b457800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.693+0000 7ff083fff640 1 -- 172.21.15.7:0/3285210505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b0b0070 msgr2=0x55db1b4572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.693+0000 7ff083fff640 1 --2- 172.21.15.7:0/3285210505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b0b0070 0x55db1b4572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.693+0000 7ff083fff640 1 -- 172.21.15.7:0/3285210505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1b11b650 con 0x55db1b08f390 2024-09-21T05:56:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.693+0000 7ff08b59e640 1 --2- 172.21.15.7:0/3285210505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b0b0070 0x55db1b4572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:56:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.693+0000 7ff088d99640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff0780b6680 0x7ff0780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.693+0000 7ff083fff640 1 --2- 172.21.15.7:0/3285210505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 0x55db1b457d40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff0740e51c0 tx=0x7ff0740f05c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98447d7710369fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.694+0000 7ff08b59e640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff0780b6680 0x7ff0780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.694+0000 7ff0817fa640 1 -- 172.21.15.7:0/3285210505 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0740ef040 con 0x55db1b08f390 2024-09-21T05:56:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.694+0000 7ff0817fa640 1 -- 172.21.15.7:0/3285210505 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff074010720 con 0x55db1b08f390 2024-09-21T05:56:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.694+0000 7ff0817fa640 1 -- 172.21.15.7:0/3285210505 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0740a97f0 con 0x55db1b08f390 2024-09-21T05:56:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.694+0000 7ff088d99640 1 -- 172.21.15.7:0/1867425996 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7ff0740e7a80 con 0x7ff08c1094d0 2024-09-21T05:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.695+0000 7ff097769740 1 -- 172.21.15.7:0/3285210505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 msgr2=0x55db1b457d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.695+0000 7ff08b59e640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff0780b6680 0x7ff0780b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff084005fd0 tx=0x7ff084009580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.695+0000 7ff097769740 1 --2- 172.21.15.7:0/3285210505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 0x55db1b457d40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff0740e51c0 tx=0x7ff0740f05c0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.695+0000 7ff097769740 1 -- 172.21.15.7:0/3285210505 shutdown_connections 2024-09-21T05:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.695+0000 7ff097769740 1 --2- 172.21.15.7:0/3285210505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 0x55db1b457d40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.695+0000 7ff097769740 1 --2- 172.21.15.7:0/3285210505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 0x55db1b457800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.695+0000 7ff097769740 1 --2- 172.21.15.7:0/3285210505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b0b0070 0x55db1b4572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.695+0000 7ff097769740 1 -- 172.21.15.7:0/3285210505 >> 172.21.15.7:0/3285210505 conn(0x55db1b0a4460 msgr2=0x55db1b4551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.695+0000 7ff097769740 1 -- 172.21.15.7:0/3285210505 shutdown_connections 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.695+0000 7ff097769740 1 -- 172.21.15.7:0/3285210505 wait complete. 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.695+0000 7ff097769740 1 -- start start 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.695+0000 7ff097769740 1 Processor -- start 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff097769740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b0871b0 0x55db1b4628f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff097769740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b08f390 0x55db1b462e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff097769740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b0b0070 0x55db1b4633b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff097769740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55db1b21e700 con 0x55db1b0b0070 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff097769740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55db1b358160 con 0x55db1b0871b0 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff097769740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55db1b465aa0 con 0x55db1b08f390 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff097769740 10 client.0 _ll_register_callbacks cb 0x55db1b3719e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff08b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b0b0070 0x55db1b4633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff08b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b0b0070 0x55db1b4633b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33810/0 (socket says 172.21.15.7:33810) 2024-09-21T05:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff08b59e640 1 -- 172.21.15.7:0/2308069859 learned_addr learned my addr 172.21.15.7:0/2308069859 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff08ad9d640 1 --2- 172.21.15.7:0/2308069859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b0871b0 0x55db1b4628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff083fff640 1 --2- 172.21.15.7:0/2308069859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b08f390 0x55db1b462e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff08b59e640 1 -- 172.21.15.7:0/2308069859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b08f390 msgr2=0x55db1b462e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff08b59e640 1 --2- 172.21.15.7:0/2308069859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b08f390 0x55db1b462e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff08b59e640 1 -- 172.21.15.7:0/2308069859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b0871b0 msgr2=0x55db1b4628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff08b59e640 1 --2- 172.21.15.7:0/2308069859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b0871b0 0x55db1b4628f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff08b59e640 1 -- 172.21.15.7:0/2308069859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db1b385c90 con 0x55db1b0b0070 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff08b59e640 1 --2- 172.21.15.7:0/2308069859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b0b0070 0x55db1b4633b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff084012930 tx=0x7ff084004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77f90a7f1eaafa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.696+0000 7ff0727fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff0727fc640 1 -- 172.21.15.7:0/2308069859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08400ebe0 con 0x55db1b0b0070 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff0727fc640 1 -- 172.21.15.7:0/2308069859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7ff08400ed80 con 0x55db1b0b0070 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff097769740 1 -- 172.21.15.7:0/2308069859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55db1b3cfdf0 con 0x55db1b0b0070 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff0727fc640 1 -- 172.21.15.7:0/2308069859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff08401f420 con 0x55db1b0b0070 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff097769740 10 client.16050 fetch_fsmap learned FSMap version 25 2024-09-21T05:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff097769740 1 -- 172.21.15.7:0/2308069859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55db1b4717a0 con 0x55db1b0b0070 2024-09-21T05:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff0727fc640 1 -- 172.21.15.7:0/2308069859 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55db1b3cfdf0 con 0x55db1b0b0070 2024-09-21T05:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff0727fc640 1 -- 172.21.15.7:0/2308069859 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff08400f040 con 0x55db1b0b0070 2024-09-21T05:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff097769740 10 client.16050 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff097769740 10 client.16050 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff097769740 20 client.16050 populate_metadata read hostname 'smithi007' 2024-09-21T05:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff097769740 1 --2- 172.21.15.7:0/2308069859 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55db1b06e9f0 0x55db1b474c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff097769740 4 client.16050 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.697+0000 7ff097769740 1 -- 172.21.15.7:0/2308069859 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db1b3cb8a0 con 0x55db1b06e9f0 2024-09-21T05:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.698+0000 7ff08ad9d640 1 --2- 172.21.15.7:0/2308069859 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55db1b06e9f0 0x55db1b474c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.698+0000 7ff08ad9d640 1 --2- 172.21.15.7:0/2308069859 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55db1b06e9f0 0x55db1b474c70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c13b865450f526fa server_cookie=f4b67c489e5cd39b in_seq=0 out_seq=0 2024-09-21T05:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.698+0000 7ff0727fc640 10 client.16050 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff0727fc640 1 -- 172.21.15.7:0/2308069859 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55db1b3cb8a0 con 0x55db1b06e9f0 2024-09-21T05:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff0727fc640 10 client.16050 handle_command_reply: tid=0 2024-09-21T05:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff097769740 1 client.16050 shutdown 2024-09-21T05:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff097769740 1 -- 172.21.15.7:0/2308069859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b0b0070 msgr2=0x55db1b4633b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff097769740 1 --2- 172.21.15.7:0/2308069859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b0b0070 0x55db1b4633b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff084012930 tx=0x7ff084004a40 comp rx=0 tx=0).stop 2024-09-21T05:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff097769740 1 -- 172.21.15.7:0/2308069859 shutdown_connections 2024-09-21T05:56:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff097769740 1 --2- 172.21.15.7:0/2308069859 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55db1b06e9f0 0x55db1b474c70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff097769740 1 --2- 172.21.15.7:0/2308069859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b0b0070 0x55db1b4633b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff097769740 1 --2- 172.21.15.7:0/2308069859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b08f390 0x55db1b462e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff097769740 1 --2- 172.21.15.7:0/2308069859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b0871b0 0x55db1b4628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff0727fc640 0 client.16050 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:56:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff097769740 1 -- 172.21.15.7:0/2308069859 >> 172.21.15.7:0/2308069859 conn(0x55db1b0a4460 msgr2=0x55db1b45a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff097769740 1 -- 172.21.15.7:0/2308069859 shutdown_connections 2024-09-21T05:56:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff097769740 1 -- 172.21.15.7:0/2308069859 wait complete. 2024-09-21T05:56:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.699+0000 7ff097769740 20 client.16050 trim_cache size 0 max 16384 2024-09-21T05:56:26.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.712+0000 7ff097769740 1 Processor -- start 2024-09-21T05:56:26.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.712+0000 7ff097769740 1 -- start start 2024-09-21T05:56:26.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff097769740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b06e9f0 0x55db1b458cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff097769740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 0x55db1b464520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff097769740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b08f390 0x55db1b454760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff097769740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1b1f60 con 0x55db1b06e9f0 2024-09-21T05:56:26.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff097769740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1af830 con 0x55db1b08f390 2024-09-21T05:56:26.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff097769740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1ad680 con 0x55db1b0871b0 2024-09-21T05:56:26.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff08ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b06e9f0 0x55db1b458cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff08ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b06e9f0 0x55db1b458cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33818/0 (socket says 172.21.15.7:33818) 2024-09-21T05:56:26.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff08ad9d640 1 -- 172.21.15.7:0/419591102 learned_addr learned my addr 172.21.15.7:0/419591102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:26.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff08b59e640 1 --2- 172.21.15.7:0/419591102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b08f390 0x55db1b454760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff083fff640 1 --2- 172.21.15.7:0/419591102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 0x55db1b464520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff08ad9d640 1 -- 172.21.15.7:0/419591102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 msgr2=0x55db1b464520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff08ad9d640 1 --2- 172.21.15.7:0/419591102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 0x55db1b464520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff08ad9d640 1 -- 172.21.15.7:0/419591102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b08f390 msgr2=0x55db1b454760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff08ad9d640 1 --2- 172.21.15.7:0/419591102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b08f390 0x55db1b454760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.713+0000 7ff08ad9d640 1 -- 172.21.15.7:0/419591102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1b4556f0 con 0x55db1b06e9f0 2024-09-21T05:56:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.714+0000 7ff08ad9d640 1 --2- 172.21.15.7:0/419591102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b06e9f0 0x55db1b458cb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff07c02a930 tx=0x7ff07c0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34e1df5cded56d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.714+0000 7ff080ff9640 1 -- 172.21.15.7:0/419591102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c035040 con 0x55db1b06e9f0 2024-09-21T05:56:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.714+0000 7ff080ff9640 1 -- 172.21.15.7:0/419591102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff07c0054f0 con 0x55db1b06e9f0 2024-09-21T05:56:26.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.714+0000 7ff080ff9640 1 -- 172.21.15.7:0/419591102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c004dd0 con 0x55db1b06e9f0 2024-09-21T05:56:26.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.715+0000 7ff097769740 1 -- 172.21.15.7:0/419591102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b06e9f0 msgr2=0x55db1b458cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:26.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.715+0000 7ff097769740 1 --2- 172.21.15.7:0/419591102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b06e9f0 0x55db1b458cb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff07c02a930 tx=0x7ff07c0058b0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.715+0000 7ff097769740 1 -- 172.21.15.7:0/419591102 shutdown_connections 2024-09-21T05:56:26.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.715+0000 7ff097769740 1 --2- 172.21.15.7:0/419591102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b08f390 0x55db1b454760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.715+0000 7ff097769740 1 --2- 172.21.15.7:0/419591102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 0x55db1b464520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.715+0000 7ff097769740 1 --2- 172.21.15.7:0/419591102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b06e9f0 0x55db1b458cb0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.715+0000 7ff097769740 1 -- 172.21.15.7:0/419591102 >> 172.21.15.7:0/419591102 conn(0x55db1b0a4460 msgr2=0x55db1b463e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:26.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.715+0000 7ff097769740 1 -- 172.21.15.7:0/419591102 shutdown_connections 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.715+0000 7ff097769740 1 -- 172.21.15.7:0/419591102 wait complete. 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.715+0000 7ff097769740 1 -- start start 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.715+0000 7ff097769740 1 Processor -- start 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff097769740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b06e9f0 0x55db1b466ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff097769740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 0x55db1b467220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff097769740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 0x55db1b467760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff097769740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1adcf0 con 0x55db1b08f390 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff097769740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1af160 con 0x55db1b06e9f0 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff097769740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1ae3c0 con 0x55db1b0871b0 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff097769740 10 client.0 _ll_register_callbacks cb 0x7ff084009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff08b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 0x55db1b467760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff08b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 0x55db1b467760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33824/0 (socket says 172.21.15.7:33824) 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff08b59e640 1 -- 172.21.15.7:0/560119211 learned_addr learned my addr 172.21.15.7:0/560119211 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff08ad9d640 1 --2- 172.21.15.7:0/560119211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b06e9f0 0x55db1b466ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff083fff640 1 --2- 172.21.15.7:0/560119211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 0x55db1b467220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff08b59e640 1 -- 172.21.15.7:0/560119211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 msgr2=0x55db1b467220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff08b59e640 1 --2- 172.21.15.7:0/560119211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 0x55db1b467220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff08b59e640 1 -- 172.21.15.7:0/560119211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b06e9f0 msgr2=0x55db1b466ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff08b59e640 1 --2- 172.21.15.7:0/560119211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b06e9f0 0x55db1b466ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff08b59e640 1 -- 172.21.15.7:0/560119211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db1b4de670 con 0x55db1b08f390 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff08b59e640 1 --2- 172.21.15.7:0/560119211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 0x55db1b467760 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x55db1b465610 tx=0x7ff0840124e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d48756d8b258f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.716+0000 7ff0727fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff0727fc640 1 -- 172.21.15.7:0/560119211 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084036040 con 0x55db1b08f390 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff0727fc640 1 -- 172.21.15.7:0/560119211 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7ff08400ebe0 con 0x55db1b08f390 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff097769740 1 -- 172.21.15.7:0/560119211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff07c0054f0 con 0x55db1b08f390 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff0727fc640 1 -- 172.21.15.7:0/560119211 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff08400ee20 con 0x55db1b08f390 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff097769740 10 client.16056 fetch_fsmap learned FSMap version 25 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff097769740 1 -- 172.21.15.7:0/560119211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55db1b4df8c0 con 0x55db1b08f390 2024-09-21T05:56:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff0727fc640 1 -- 172.21.15.7:0/560119211 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff07c0054f0 con 0x55db1b08f390 2024-09-21T05:56:26.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff0727fc640 1 -- 172.21.15.7:0/560119211 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff084039070 con 0x55db1b08f390 2024-09-21T05:56:26.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff097769740 10 client.16056 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:56:26.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff097769740 10 client.16056 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:56:26.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff097769740 20 client.16056 populate_metadata read hostname 'smithi007' 2024-09-21T05:56:26.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff097769740 1 --2- 172.21.15.7:0/560119211 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55db1b0b0070 0x55db1b4e2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:26.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff097769740 4 client.16056 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:56:26.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.717+0000 7ff097769740 1 -- 172.21.15.7:0/560119211 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55db1b3c8cd0 con 0x55db1b0b0070 2024-09-21T05:56:26.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.718+0000 7ff08ad9d640 1 --2- 172.21.15.7:0/560119211 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55db1b0b0070 0x55db1b4e2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:26.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.718+0000 7ff0727fc640 10 client.16056 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:56:26.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.718+0000 7ff08ad9d640 1 --2- 172.21.15.7:0/560119211 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55db1b0b0070 0x55db1b4e2070 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c5bab58bb2e23822 server_cookie=9eddcaaeead69216 in_seq=0 out_seq=0 2024-09-21T05:56:26.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.718+0000 7ff0727fc640 1 -- 172.21.15.7:0/560119211 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55db1b3c8cd0 con 0x55db1b0b0070 2024-09-21T05:56:26.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.718+0000 7ff0727fc640 10 client.16056 handle_command_reply: tid=0 2024-09-21T05:56:26.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.718+0000 7ff097769740 1 client.16056 shutdown 2024-09-21T05:56:26.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff097769740 1 -- 172.21.15.7:0/560119211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 msgr2=0x55db1b467760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:26.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff097769740 1 --2- 172.21.15.7:0/560119211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 0x55db1b467760 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x55db1b465610 tx=0x7ff0840124e0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff097769740 1 -- 172.21.15.7:0/560119211 shutdown_connections 2024-09-21T05:56:26.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff097769740 1 --2- 172.21.15.7:0/560119211 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55db1b0b0070 0x55db1b4e2070 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff097769740 1 --2- 172.21.15.7:0/560119211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db1b08f390 0x55db1b467760 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff097769740 1 --2- 172.21.15.7:0/560119211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55db1b0871b0 0x55db1b467220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff0727fc640 0 client.16056 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:56:26.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff097769740 1 --2- 172.21.15.7:0/560119211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55db1b06e9f0 0x55db1b466ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff097769740 1 -- 172.21.15.7:0/560119211 >> 172.21.15.7:0/560119211 conn(0x55db1b0a4460 msgr2=0x55db1b458a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:26.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff097769740 1 -- 172.21.15.7:0/560119211 shutdown_connections 2024-09-21T05:56:26.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff097769740 1 -- 172.21.15.7:0/560119211 wait complete. 2024-09-21T05:56:26.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff097769740 20 client.16056 trim_cache size 0 max 16384 2024-09-21T05:56:26.726 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:56:26.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff0911f5640 1 -- 172.21.15.7:0/1867425996 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff0780b6680 msgr2=0x7ff0780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:26.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff0911f5640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff0780b6680 0x7ff0780b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff084005fd0 tx=0x7ff084009580 comp rx=0 tx=0).stop 2024-09-21T05:56:26.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff0911f5640 1 -- 172.21.15.7:0/1867425996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff08c1094d0 msgr2=0x7ff08c19aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:26.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.719+0000 7ff0911f5640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff08c1094d0 0x7ff08c19aa50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff07400e9f0 tx=0x7ff07400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.720+0000 7ff0911f5640 1 -- 172.21.15.7:0/1867425996 shutdown_connections 2024-09-21T05:56:26.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.720+0000 7ff0911f5640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff0780b6680 0x7ff0780b8b90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.720+0000 7ff0911f5640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff08c1094d0 0x7ff08c19aa50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.720+0000 7ff0911f5640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff08c109e20 0x7ff08c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.720+0000 7ff0911f5640 1 --2- 172.21.15.7:0/1867425996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff08c103b90 0x7ff08c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:26.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.720+0000 7ff0911f5640 1 -- 172.21.15.7:0/1867425996 >> 172.21.15.7:0/1867425996 conn(0x7ff08c0ff5e0 msgr2=0x7ff08c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:26.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.720+0000 7ff0911f5640 1 -- 172.21.15.7:0/1867425996 shutdown_connections 2024-09-21T05:56:26.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:26.720+0000 7ff0911f5640 1 -- 172.21.15.7:0/1867425996 wait complete. 2024-09-21T05:56:27.555 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T05:56:27.812 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:56:28.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:27 smithi007 ceph-mon[30983]: pgmap v395: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:56:28.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:27 smithi027 ceph-mon[34364]: pgmap v395: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:56:28.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.289+0000 7f450bc9c640 1 -- 172.21.15.7:0/3132044949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4504108530 msgr2=0x7f450410ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:28.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.289+0000 7f450bc9c640 1 --2- 172.21.15.7:0/3132044949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4504108530 0x7f450410ed60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009ca0 tx=0x7f44fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.289+0000 7f450bc9c640 1 -- 172.21.15.7:0/3132044949 shutdown_connections 2024-09-21T05:56:28.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.289+0000 7f450bc9c640 1 --2- 172.21.15.7:0/3132044949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4504108530 0x7f450410ed60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.289+0000 7f450bc9c640 1 --2- 172.21.15.7:0/3132044949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4504107be0 0x7f4504107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.289+0000 7f450bc9c640 1 --2- 172.21.15.7:0/3132044949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45041022a0 0x7f45041026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.289+0000 7f450bc9c640 1 -- 172.21.15.7:0/3132044949 >> 172.21.15.7:0/3132044949 conn(0x7f4504079ec0 msgr2=0x7f450407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:28.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.289+0000 7f450bc9c640 1 -- 172.21.15.7:0/3132044949 shutdown_connections 2024-09-21T05:56:28.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.289+0000 7f450bc9c640 1 -- 172.21.15.7:0/3132044949 wait complete. 2024-09-21T05:56:28.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.290+0000 7f450bc9c640 1 Processor -- start 2024-09-21T05:56:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.290+0000 7f450bc9c640 1 -- start start 2024-09-21T05:56:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.290+0000 7f450bc9c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45041022a0 0x7f45041993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.290+0000 7f450bc9c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4504107be0 0x7f4504199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.290+0000 7f450bc9c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4504108530 0x7f450419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.290+0000 7f450bc9c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4504112a70 con 0x7f4504108530 2024-09-21T05:56:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.290+0000 7f450bc9c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f45041128f0 con 0x7f45041022a0 2024-09-21T05:56:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.290+0000 7f450bc9c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4504112bf0 con 0x7f4504107be0 2024-09-21T05:56:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.290+0000 7f450a239640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4504108530 0x7f450419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.290+0000 7f450a239640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4504108530 0x7f450419ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33828/0 (socket says 172.21.15.7:33828) 2024-09-21T05:56:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.290+0000 7f450a239640 1 -- 172.21.15.7:0/2858658782 learned_addr learned my addr 172.21.15.7:0/2858658782 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.290+0000 7f4509237640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4504107be0 0x7f4504199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.290+0000 7f4509a38640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45041022a0 0x7f45041993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.291+0000 7f450a239640 1 -- 172.21.15.7:0/2858658782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4504107be0 msgr2=0x7f4504199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.291+0000 7f450a239640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4504107be0 0x7f4504199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.291+0000 7f450a239640 1 -- 172.21.15.7:0/2858658782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45041022a0 msgr2=0x7f45041993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.291+0000 7f450a239640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45041022a0 0x7f45041993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.291+0000 7f450a239640 1 -- 172.21.15.7:0/2858658782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450419f330 con 0x7f4504108530 2024-09-21T05:56:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.291+0000 7f450a239640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4504108530 0x7f450419ec00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f44fc005cc0 tx=0x7f44fc031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.291+0000 7f44faffd640 1 -- 172.21.15.7:0/2858658782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc04a070 con 0x7f4504108530 2024-09-21T05:56:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.291+0000 7f44faffd640 1 -- 172.21.15.7:0/2858658782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44fc003e20 con 0x7f4504108530 2024-09-21T05:56:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.291+0000 7f450bc9c640 1 -- 172.21.15.7:0/2858658782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450419f5c0 con 0x7f4504108530 2024-09-21T05:56:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.291+0000 7f44faffd640 1 -- 172.21.15.7:0/2858658782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc004860 con 0x7f4504108530 2024-09-21T05:56:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.291+0000 7f450bc9c640 1 -- 172.21.15.7:0/2858658782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450410f720 con 0x7f4504108530 2024-09-21T05:56:28.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.294+0000 7f4512210740 1 Processor -- start 2024-09-21T05:56:28.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.294+0000 7f44faffd640 1 -- 172.21.15.7:0/2858658782 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f44fc04d070 con 0x7f4504108530 2024-09-21T05:56:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.295+0000 7f4512210740 1 -- start start 2024-09-21T05:56:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.295+0000 7f4512210740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 0x55654be6e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.295+0000 7f4512210740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654ba9e1b0 0x55654be6e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.295+0000 7f4512210740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654baa6390 0x55654be6ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.295+0000 7f4512210740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55654bde4ea0 con 0x55654baa6390 2024-09-21T05:56:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.295+0000 7f4512210740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55654bdd42d0 con 0x55654ba9e1b0 2024-09-21T05:56:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.295+0000 7f4512210740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55654bdd80e0 con 0x55654bac7070 2024-09-21T05:56:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.295+0000 7f4509237640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654baa6390 0x55654be6ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.295+0000 7f4509237640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654baa6390 0x55654be6ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33830/0 (socket says 172.21.15.7:33830) 2024-09-21T05:56:28.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.295+0000 7f4509237640 1 -- 172.21.15.7:0/4060880242 learned_addr learned my addr 172.21.15.7:0/4060880242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:28.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.295+0000 7f4509237640 1 --2- 172.21.15.7:0/4060880242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 0x55654be6e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.295+0000 7f4509a38640 1 --2- 172.21.15.7:0/4060880242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654ba9e1b0 0x55654be6e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.295+0000 7f44faffd640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f44f00b6680 0x7f44f00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.296+0000 7f4509237640 1 -- 172.21.15.7:0/4060880242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 msgr2=0x55654be6e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:28.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.296+0000 7f4509237640 1 --2- 172.21.15.7:0/4060880242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 0x55654be6e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.296+0000 7f4509237640 1 -- 172.21.15.7:0/4060880242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654ba9e1b0 msgr2=0x55654be6e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:28.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.296+0000 7f4509237640 1 --2- 172.21.15.7:0/4060880242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654ba9e1b0 0x55654be6e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.296+0000 7f4509237640 1 -- 172.21.15.7:0/4060880242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55654bb32650 con 0x55654baa6390 2024-09-21T05:56:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.296+0000 7f4509a38640 1 --2- 172.21.15.7:0/4060880242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654ba9e1b0 0x55654be6e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.296+0000 7f450a239640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f44f00b6680 0x7f44f00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.296+0000 7f44faffd640 1 -- 172.21.15.7:0/2858658782 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f44fc109be0 con 0x7f4504108530 2024-09-21T05:56:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.296+0000 7f4509237640 1 --2- 172.21.15.7:0/4060880242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654baa6390 0x55654be6ed40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f44f40058c0 tx=0x7f44f4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966e224257605492 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.296+0000 7f44effff640 1 -- 172.21.15.7:0/4060880242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4005020 con 0x55654baa6390 2024-09-21T05:56:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.296+0000 7f44effff640 1 -- 172.21.15.7:0/4060880242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44f40047a0 con 0x55654baa6390 2024-09-21T05:56:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.296+0000 7f450a239640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f44f00b6680 0x7f44f00b8b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f44fc107460 tx=0x7f44fc0045c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.296+0000 7f44effff640 1 -- 172.21.15.7:0/4060880242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f400f9c0 con 0x55654baa6390 2024-09-21T05:56:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.297+0000 7f4512210740 1 -- 172.21.15.7:0/4060880242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654baa6390 msgr2=0x55654be6ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.297+0000 7f4512210740 1 --2- 172.21.15.7:0/4060880242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654baa6390 0x55654be6ed40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f44f40058c0 tx=0x7f44f4005850 comp rx=0 tx=0).stop 2024-09-21T05:56:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.297+0000 7f4512210740 1 -- 172.21.15.7:0/4060880242 shutdown_connections 2024-09-21T05:56:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.297+0000 7f4512210740 1 --2- 172.21.15.7:0/4060880242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654baa6390 0x55654be6ed40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.297+0000 7f4512210740 1 --2- 172.21.15.7:0/4060880242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654ba9e1b0 0x55654be6e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.297+0000 7f4512210740 1 --2- 172.21.15.7:0/4060880242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 0x55654be6e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.297+0000 7f4512210740 1 -- 172.21.15.7:0/4060880242 >> 172.21.15.7:0/4060880242 conn(0x55654babb460 msgr2=0x55654be6c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.297+0000 7f4512210740 1 -- 172.21.15.7:0/4060880242 shutdown_connections 2024-09-21T05:56:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.297+0000 7f4512210740 1 -- 172.21.15.7:0/4060880242 wait complete. 2024-09-21T05:56:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.297+0000 7f4512210740 1 -- start start 2024-09-21T05:56:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.298+0000 7f4512210740 1 Processor -- start 2024-09-21T05:56:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.298+0000 7f4512210740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be79a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.298+0000 7f4512210740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 0x55654be79fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.298+0000 7f4512210740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 0x55654be85d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.298+0000 7f4512210740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55654bc35700 con 0x55654ba9e1b0 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.298+0000 7f4512210740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55654bd6f160 con 0x55654baa6390 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.298+0000 7f4512210740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55654be7caa0 con 0x55654bac7070 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.298+0000 7f4512210740 10 client.0 _ll_register_callbacks cb 0x55654bd889e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.298+0000 7f4509237640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be79a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.298+0000 7f4509237640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be79a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33840/0 (socket says 172.21.15.7:33840) 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.298+0000 7f4509237640 1 -- 172.21.15.7:0/730565260 learned_addr learned my addr 172.21.15.7:0/730565260 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.298+0000 7f4509a38640 1 --2- 172.21.15.7:0/730565260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 0x55654be79fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f4509237640 1 -- 172.21.15.7:0/730565260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 msgr2=0x55654be85d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f4509237640 1 --2- 172.21.15.7:0/730565260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 0x55654be85d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f4509237640 1 -- 172.21.15.7:0/730565260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 msgr2=0x55654be79fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f4509237640 1 --2- 172.21.15.7:0/730565260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 0x55654be79fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f4509237640 1 -- 172.21.15.7:0/730565260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55654bd9cc90 con 0x55654ba9e1b0 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f4509237640 1 --2- 172.21.15.7:0/730565260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be79a70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f44f4004fc0 tx=0x7f44f4004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ce88749d88bfd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f44ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f44ed7fa640 1 -- 172.21.15.7:0/730565260 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4004bb0 con 0x55654ba9e1b0 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f4512210740 1 -- 172.21.15.7:0/730565260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44f40047a0 con 0x55654ba9e1b0 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f44ed7fa640 1 -- 172.21.15.7:0/730565260 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f44f4004020 con 0x55654ba9e1b0 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f44ed7fa640 1 -- 172.21.15.7:0/730565260 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f44f4004d50 con 0x55654ba9e1b0 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f4512210740 10 client.16068 fetch_fsmap learned FSMap version 25 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f4512210740 1 -- 172.21.15.7:0/730565260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55654be888a0 con 0x55654ba9e1b0 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.299+0000 7f44ed7fa640 1 -- 172.21.15.7:0/730565260 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44f40047a0 con 0x55654ba9e1b0 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.300+0000 7f44ed7fa640 1 -- 172.21.15.7:0/730565260 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f44f401d030 con 0x55654ba9e1b0 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.300+0000 7f4512210740 10 client.16068 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.300+0000 7f4512210740 10 client.16068 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.300+0000 7f4512210740 20 client.16068 populate_metadata read hostname 'smithi007' 2024-09-21T05:56:28.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.300+0000 7f4512210740 1 --2- 172.21.15.7:0/730565260 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55654ba859f0 0x55654be8bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.300+0000 7f4512210740 4 client.16068 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.300+0000 7f4512210740 1 -- 172.21.15.7:0/730565260 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55654bde6df0 con 0x55654ba859f0 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.300+0000 7f4509a38640 1 --2- 172.21.15.7:0/730565260 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55654ba859f0 0x55654be8bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.301+0000 7f44ed7fa640 10 client.16068 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.301+0000 7f4509a38640 1 --2- 172.21.15.7:0/730565260 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55654ba859f0 0x55654be8bc00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f96723ebdf35f82e server_cookie=5f987c5ca9b8f28a in_seq=0 out_seq=0 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.301+0000 7f44ed7fa640 1 -- 172.21.15.7:0/730565260 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55654bde6df0 con 0x55654ba859f0 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.301+0000 7f44ed7fa640 10 client.16068 handle_command_reply: tid=0 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.301+0000 7f4512210740 1 client.16068 shutdown 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.301+0000 7f4512210740 1 -- 172.21.15.7:0/730565260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 msgr2=0x55654be79a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.301+0000 7f4512210740 1 --2- 172.21.15.7:0/730565260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be79a70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f44f4004fc0 tx=0x7f44f4004950 comp rx=0 tx=0).stop 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.302+0000 7f4512210740 1 -- 172.21.15.7:0/730565260 shutdown_connections 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.302+0000 7f4512210740 1 --2- 172.21.15.7:0/730565260 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55654ba859f0 0x55654be8bc00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.302+0000 7f4512210740 1 --2- 172.21.15.7:0/730565260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 0x55654be85d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.302+0000 7f4512210740 1 --2- 172.21.15.7:0/730565260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 0x55654be79fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.302+0000 7f44ed7fa640 0 client.16068 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:56:28.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.302+0000 7f4512210740 1 --2- 172.21.15.7:0/730565260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be79a70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.302+0000 7f4512210740 1 -- 172.21.15.7:0/730565260 >> 172.21.15.7:0/730565260 conn(0x55654babb460 msgr2=0x55654be71450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:28.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.302+0000 7f4512210740 1 -- 172.21.15.7:0/730565260 shutdown_connections 2024-09-21T05:56:28.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.302+0000 7f4512210740 1 -- 172.21.15.7:0/730565260 wait complete. 2024-09-21T05:56:28.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.302+0000 7f4512210740 20 client.16068 trim_cache size 0 max 16384 2024-09-21T05:56:28.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.315+0000 7f4512210740 1 Processor -- start 2024-09-21T05:56:28.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.315+0000 7f4512210740 1 -- start start 2024-09-21T05:56:28.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.315+0000 7f4512210740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be71ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.315+0000 7f4512210740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 0x55654be76c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.315+0000 7f4512210740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 0x55654be771a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.315+0000 7f4512210740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f45041afbb0 con 0x55654ba9e1b0 2024-09-21T05:56:28.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.315+0000 7f4512210740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f45041ad480 con 0x55654baa6390 2024-09-21T05:56:28.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.315+0000 7f4512210740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f45041ab2d0 con 0x55654bac7070 2024-09-21T05:56:28.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.315+0000 7f4509237640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be71ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.315+0000 7f4509237640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be71ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33854/0 (socket says 172.21.15.7:33854) 2024-09-21T05:56:28.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.315+0000 7f4509237640 1 -- 172.21.15.7:0/2481605434 learned_addr learned my addr 172.21.15.7:0/2481605434 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:28.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.316+0000 7f4509a38640 1 --2- 172.21.15.7:0/2481605434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 0x55654be76c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.316+0000 7f4509237640 1 -- 172.21.15.7:0/2481605434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 msgr2=0x55654be771a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:28.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.316+0000 7f4509237640 1 --2- 172.21.15.7:0/2481605434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 0x55654be771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.316+0000 7f4509237640 1 -- 172.21.15.7:0/2481605434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 msgr2=0x55654be76c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:28.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.316+0000 7f4509237640 1 --2- 172.21.15.7:0/2481605434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 0x55654be76c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.316+0000 7f4509237640 1 -- 172.21.15.7:0/2481605434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55654be7c050 con 0x55654ba9e1b0 2024-09-21T05:56:28.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.316+0000 7f4509a38640 1 --2- 172.21.15.7:0/2481605434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 0x55654be76c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:56:28.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.316+0000 7f4509237640 1 --2- 172.21.15.7:0/2481605434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be71ad0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f44f40059f0 tx=0x7f44f4009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d747842e53536e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:28.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.316+0000 7f44ef7fe640 1 -- 172.21.15.7:0/2481605434 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4004bb0 con 0x55654ba9e1b0 2024-09-21T05:56:28.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.316+0000 7f44ef7fe640 1 -- 172.21.15.7:0/2481605434 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44f40046f0 con 0x55654ba9e1b0 2024-09-21T05:56:28.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.316+0000 7f44ef7fe640 1 -- 172.21.15.7:0/2481605434 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f402a430 con 0x55654ba9e1b0 2024-09-21T05:56:28.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.317+0000 7f4512210740 1 -- 172.21.15.7:0/2481605434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 msgr2=0x55654be71ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:28.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.317+0000 7f4512210740 1 --2- 172.21.15.7:0/2481605434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be71ad0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f44f40059f0 tx=0x7f44f4009660 comp rx=0 tx=0).stop 2024-09-21T05:56:28.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.317+0000 7f4512210740 1 -- 172.21.15.7:0/2481605434 shutdown_connections 2024-09-21T05:56:28.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.317+0000 7f4512210740 1 --2- 172.21.15.7:0/2481605434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 0x55654be771a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.317+0000 7f4512210740 1 --2- 172.21.15.7:0/2481605434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 0x55654be76c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.317+0000 7f4512210740 1 --2- 172.21.15.7:0/2481605434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be71ad0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.317+0000 7f4512210740 1 -- 172.21.15.7:0/2481605434 >> 172.21.15.7:0/2481605434 conn(0x55654babb460 msgr2=0x55654be713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:28.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.317+0000 7f4512210740 1 -- 172.21.15.7:0/2481605434 shutdown_connections 2024-09-21T05:56:28.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.317+0000 7f4512210740 1 -- 172.21.15.7:0/2481605434 wait complete. 2024-09-21T05:56:28.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.317+0000 7f4512210740 1 -- start start 2024-09-21T05:56:28.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.317+0000 7f4512210740 1 Processor -- start 2024-09-21T05:56:28.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4512210740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be8cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4512210740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 0x55654be8d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4512210740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 0x55654bef5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4512210740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f45041ab940 con 0x55654ba9e1b0 2024-09-21T05:56:28.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4512210740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f45041acdb0 con 0x55654baa6390 2024-09-21T05:56:28.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4512210740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f45041ac010 con 0x55654bac7070 2024-09-21T05:56:28.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4512210740 10 client.0 _ll_register_callbacks cb 0x7f45000097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:28.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4509237640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be8cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4509237640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be8cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33864/0 (socket says 172.21.15.7:33864) 2024-09-21T05:56:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4509237640 1 -- 172.21.15.7:0/969055004 learned_addr learned my addr 172.21.15.7:0/969055004 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4509a38640 1 --2- 172.21.15.7:0/969055004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 0x55654be8d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4509237640 1 -- 172.21.15.7:0/969055004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 msgr2=0x55654bef5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4509237640 1 --2- 172.21.15.7:0/969055004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 0x55654bef5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4509237640 1 -- 172.21.15.7:0/969055004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 msgr2=0x55654be8d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4509237640 1 --2- 172.21.15.7:0/969055004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 0x55654be8d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.318+0000 7f4509237640 1 -- 172.21.15.7:0/969055004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55654be8dc20 con 0x55654ba9e1b0 2024-09-21T05:56:28.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.319+0000 7f4509237640 1 --2- 172.21.15.7:0/969055004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be8cec0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009e60 tx=0x7f44f4009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd1be27b2f23f76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:28.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.319+0000 7f44ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:56:28.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.319+0000 7f44ed7fa640 1 -- 172.21.15.7:0/969055004 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4004950 con 0x55654ba9e1b0 2024-09-21T05:56:28.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.319+0000 7f44ed7fa640 1 -- 172.21.15.7:0/969055004 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f44f40054c0 con 0x55654ba9e1b0 2024-09-21T05:56:28.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.319+0000 7f4512210740 1 -- 172.21.15.7:0/969055004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44f40046f0 con 0x55654ba9e1b0 2024-09-21T05:56:28.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.319+0000 7f44ed7fa640 1 -- 172.21.15.7:0/969055004 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f44f40056c0 con 0x55654ba9e1b0 2024-09-21T05:56:28.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.319+0000 7f4512210740 10 client.16074 fetch_fsmap learned FSMap version 25 2024-09-21T05:56:28.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.319+0000 7f4512210740 1 -- 172.21.15.7:0/969055004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55654bef6890 con 0x55654ba9e1b0 2024-09-21T05:56:28.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.319+0000 7f44ed7fa640 1 -- 172.21.15.7:0/969055004 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44f40046f0 con 0x55654ba9e1b0 2024-09-21T05:56:28.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.319+0000 7f44ed7fa640 1 -- 172.21.15.7:0/969055004 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f44f401d040 con 0x55654ba9e1b0 2024-09-21T05:56:28.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.320+0000 7f4512210740 10 client.16074 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:56:28.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.320+0000 7f4512210740 10 client.16074 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:56:28.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.320+0000 7f4512210740 20 client.16074 populate_metadata read hostname 'smithi007' 2024-09-21T05:56:28.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.320+0000 7f4512210740 1 --2- 172.21.15.7:0/969055004 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55654ba5ada0 0x55654bef8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:28.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.320+0000 7f4512210740 4 client.16074 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:56:28.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.320+0000 7f4512210740 1 -- 172.21.15.7:0/969055004 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55654be75620 con 0x55654ba5ada0 2024-09-21T05:56:28.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.320+0000 7f4509a38640 1 --2- 172.21.15.7:0/969055004 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55654ba5ada0 0x55654bef8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:28.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.320+0000 7f44ed7fa640 10 client.16074 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:56:28.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.320+0000 7f4509a38640 1 --2- 172.21.15.7:0/969055004 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55654ba5ada0 0x55654bef8fe0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f2a976e35cd6934f server_cookie=e9ffee989b16c3be in_seq=0 out_seq=0 2024-09-21T05:56:28.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f44ed7fa640 1 -- 172.21.15.7:0/969055004 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55654be75620 con 0x55654ba5ada0 2024-09-21T05:56:28.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f44ed7fa640 10 client.16074 handle_command_reply: tid=0 2024-09-21T05:56:28.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f4512210740 1 client.16074 shutdown 2024-09-21T05:56:28.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f4512210740 1 -- 172.21.15.7:0/969055004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 msgr2=0x55654be8cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:28.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f4512210740 1 --2- 172.21.15.7:0/969055004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be8cec0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009e60 tx=0x7f44f4009a50 comp rx=0 tx=0).stop 2024-09-21T05:56:28.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f4512210740 1 -- 172.21.15.7:0/969055004 shutdown_connections 2024-09-21T05:56:28.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f4512210740 1 --2- 172.21.15.7:0/969055004 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55654ba5ada0 0x55654bef8fe0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f4512210740 1 --2- 172.21.15.7:0/969055004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55654bac7070 0x55654bef5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f4512210740 1 --2- 172.21.15.7:0/969055004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55654baa6390 0x55654be8d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f44ed7fa640 0 client.16074 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:56:28.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f4512210740 1 --2- 172.21.15.7:0/969055004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55654ba9e1b0 0x55654be8cec0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f4512210740 1 -- 172.21.15.7:0/969055004 >> 172.21.15.7:0/969055004 conn(0x55654babb460 msgr2=0x55654be77f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:28.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f4512210740 1 -- 172.21.15.7:0/969055004 shutdown_connections 2024-09-21T05:56:28.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f4512210740 1 -- 172.21.15.7:0/969055004 wait complete. 2024-09-21T05:56:28.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.321+0000 7f4512210740 20 client.16074 trim_cache size 0 max 16384 2024-09-21T05:56:28.338 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:56:28.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.322+0000 7f450bc9c640 1 -- 172.21.15.7:0/2858658782 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f44f00b6680 msgr2=0x7f44f00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:28.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.322+0000 7f450bc9c640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f44f00b6680 0x7f44f00b8b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f44fc107460 tx=0x7f44fc0045c0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.322+0000 7f450bc9c640 1 -- 172.21.15.7:0/2858658782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4504108530 msgr2=0x7f450419ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:28.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.322+0000 7f450bc9c640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4504108530 0x7f450419ec00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f44fc005cc0 tx=0x7f44fc031680 comp rx=0 tx=0).stop 2024-09-21T05:56:28.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.322+0000 7f450bc9c640 1 -- 172.21.15.7:0/2858658782 shutdown_connections 2024-09-21T05:56:28.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.322+0000 7f450bc9c640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f44f00b6680 0x7f44f00b8b90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.322+0000 7f450bc9c640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4504108530 0x7f450419ec00 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.322+0000 7f450bc9c640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4504107be0 0x7f4504199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.322+0000 7f450bc9c640 1 --2- 172.21.15.7:0/2858658782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45041022a0 0x7f45041993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:28.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.322+0000 7f450bc9c640 1 -- 172.21.15.7:0/2858658782 >> 172.21.15.7:0/2858658782 conn(0x7f4504079ec0 msgr2=0x7f4504105bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:28.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.322+0000 7f450bc9c640 1 -- 172.21.15.7:0/2858658782 shutdown_connections 2024-09-21T05:56:28.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:28.322+0000 7f450bc9c640 1 -- 172.21.15.7:0/2858658782 wait complete. 2024-09-21T05:56:28.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:27 smithi119 ceph-mon[34833]: pgmap v395: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:56:29.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T05:56:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:56:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.754+0000 7fb399593640 1 -- 172.21.15.7:0/3596984098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb394105300 msgr2=0x7fb39410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.754+0000 7fb399593640 1 --2- 172.21.15.7:0/3596984098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb394105300 0x7fb39410d850 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb388009900 tx=0x7fb38802a410 comp rx=0 tx=0).stop 2024-09-21T05:56:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.754+0000 7fb399593640 1 -- 172.21.15.7:0/3596984098 shutdown_connections 2024-09-21T05:56:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.754+0000 7fb399593640 1 --2- 172.21.15.7:0/3596984098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb394105300 0x7fb39410d850 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.754+0000 7fb399593640 1 --2- 172.21.15.7:0/3596984098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb39410de10 0x7fb394110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.754+0000 7fb399593640 1 --2- 172.21.15.7:0/3596984098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3941049b0 0x7fb394104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.754+0000 7fb399593640 1 -- 172.21.15.7:0/3596984098 >> 172.21.15.7:0/3596984098 conn(0x7fb394079720 msgr2=0x7fb394079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.754+0000 7fb399593640 1 -- 172.21.15.7:0/3596984098 shutdown_connections 2024-09-21T05:56:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.755+0000 7fb399593640 1 -- 172.21.15.7:0/3596984098 wait complete. 2024-09-21T05:56:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.755+0000 7fb399593640 1 Processor -- start 2024-09-21T05:56:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.755+0000 7fb399593640 1 -- start start 2024-09-21T05:56:29.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb399593640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3941049b0 0x7fb39419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb399593640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb394105300 0x7fb39419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb399593640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb39410de10 0x7fb39419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb399593640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb394113a70 con 0x7fb394105300 2024-09-21T05:56:29.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb399593640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb3941138f0 con 0x7fb39410de10 2024-09-21T05:56:29.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb399593640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb394113bf0 con 0x7fb3941049b0 2024-09-21T05:56:29.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb3927fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb394105300 0x7fb39419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb3927fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb394105300 0x7fb39419aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60834/0 (socket says 172.21.15.7:60834) 2024-09-21T05:56:29.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb3927fc640 1 -- 172.21.15.7:0/2169954311 learned_addr learned my addr 172.21.15.7:0/2169954311 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:29.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb392ffd640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3941049b0 0x7fb39419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb3937fe640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb39410de10 0x7fb39419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb3927fc640 1 -- 172.21.15.7:0/2169954311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3941049b0 msgr2=0x7fb39419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:29.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb3927fc640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3941049b0 0x7fb39419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb3927fc640 1 -- 172.21.15.7:0/2169954311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb39410de10 msgr2=0x7fb39419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:29.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb3927fc640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb39410de10 0x7fb39419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.756+0000 7fb3927fc640 1 -- 172.21.15.7:0/2169954311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3941a03d0 con 0x7fb394105300 2024-09-21T05:56:29.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.757+0000 7fb3927fc640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb394105300 0x7fb39419aa00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb38802a930 tx=0x7fb388004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:29.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.757+0000 7fb37bfff640 1 -- 172.21.15.7:0/2169954311 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38803f030 con 0x7fb394105300 2024-09-21T05:56:29.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.757+0000 7fb399593640 1 -- 172.21.15.7:0/2169954311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3941a0660 con 0x7fb394105300 2024-09-21T05:56:29.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.757+0000 7fb37bfff640 1 -- 172.21.15.7:0/2169954311 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb388003aa0 con 0x7fb394105300 2024-09-21T05:56:29.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.757+0000 7fb37bfff640 1 -- 172.21.15.7:0/2169954311 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb388035070 con 0x7fb394105300 2024-09-21T05:56:29.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.757+0000 7fb399593640 1 -- 172.21.15.7:0/2169954311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3941a6e20 con 0x7fb394105300 2024-09-21T05:56:29.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb39fb07740 1 Processor -- start 2024-09-21T05:56:29.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb39fb07740 1 -- start start 2024-09-21T05:56:29.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb37bfff640 1 -- 172.21.15.7:0/2169954311 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb388042030 con 0x7fb394105300 2024-09-21T05:56:29.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb39fb07740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beee03070 0x563bef1aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb39fb07740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1aa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb39fb07740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beede2390 0x563bef1aad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb39fb07740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563bef120ea0 con 0x563beedda1b0 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb39fb07740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x563bef1102d0 con 0x563beede2390 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb39fb07740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563bef1140e0 con 0x563beee03070 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb392ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb392ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1aa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60848/0 (socket says 172.21.15.7:60848) 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb392ffd640 1 -- 172.21.15.7:0/1151582492 learned_addr learned my addr 172.21.15.7:0/1151582492 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb3937fe640 1 --2- 172.21.15.7:0/1151582492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beee03070 0x563bef1aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.760+0000 7fb3927fc640 1 --2- 172.21.15.7:0/1151582492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beede2390 0x563bef1aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.761+0000 7fb392ffd640 1 -- 172.21.15.7:0/1151582492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beee03070 msgr2=0x563bef1aa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.761+0000 7fb392ffd640 1 --2- 172.21.15.7:0/1151582492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beee03070 0x563bef1aa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.761+0000 7fb392ffd640 1 -- 172.21.15.7:0/1151582492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beede2390 msgr2=0x563bef1aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.761+0000 7fb392ffd640 1 --2- 172.21.15.7:0/1151582492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beede2390 0x563bef1aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.761+0000 7fb392ffd640 1 -- 172.21.15.7:0/1151582492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563beee6e650 con 0x563beedda1b0 2024-09-21T05:56:29.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.761+0000 7fb3927fc640 1 --2- 172.21.15.7:0/1151582492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beede2390 0x563bef1aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:56:29.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.761+0000 7fb392ffd640 1 --2- 172.21.15.7:0/1151582492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1aa800 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb38400b7d0 tx=0x7fb384004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bb60f2f4c8c566 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:29.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.761+0000 7fb37bfff640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb37c0b6680 0x7fb37c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.761+0000 7fb3937fe640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb37c0b6680 0x7fb37c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.761+0000 7fb3797fa640 1 -- 172.21.15.7:0/1151582492 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384003dd0 con 0x563beedda1b0 2024-09-21T05:56:29.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.761+0000 7fb37bfff640 1 -- 172.21.15.7:0/2169954311 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb3881077a0 con 0x7fb394105300 2024-09-21T05:56:29.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.761+0000 7fb3797fa640 1 -- 172.21.15.7:0/1151582492 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb384015070 con 0x563beedda1b0 2024-09-21T05:56:29.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.761+0000 7fb3797fa640 1 -- 172.21.15.7:0/1151582492 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384011730 con 0x563beedda1b0 2024-09-21T05:56:29.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.762+0000 7fb39fb07740 1 -- 172.21.15.7:0/1151582492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 msgr2=0x563bef1aa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:29.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.762+0000 7fb3937fe640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb37c0b6680 0x7fb37c0b8b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb38c00ae90 tx=0x7fb38c00a4d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:29.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.762+0000 7fb39fb07740 1 --2- 172.21.15.7:0/1151582492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1aa800 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb38400b7d0 tx=0x7fb384004610 comp rx=0 tx=0).stop 2024-09-21T05:56:29.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.762+0000 7fb39fb07740 1 -- 172.21.15.7:0/1151582492 shutdown_connections 2024-09-21T05:56:29.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.762+0000 7fb39fb07740 1 --2- 172.21.15.7:0/1151582492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1aa800 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.762+0000 7fb39fb07740 1 --2- 172.21.15.7:0/1151582492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beede2390 0x563bef1aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.762+0000 7fb39fb07740 1 --2- 172.21.15.7:0/1151582492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beee03070 0x563bef1aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.762+0000 7fb39fb07740 1 -- 172.21.15.7:0/1151582492 >> 172.21.15.7:0/1151582492 conn(0x563beedf7460 msgr2=0x563bef1a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:29.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.762+0000 7fb39fb07740 1 -- 172.21.15.7:0/1151582492 shutdown_connections 2024-09-21T05:56:29.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.762+0000 7fb39fb07740 1 -- 172.21.15.7:0/1151582492 wait complete. 2024-09-21T05:56:29.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb39fb07740 1 -- start start 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb39fb07740 1 Processor -- start 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb39fb07740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb39fb07740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beede2390 0x563bef1b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb39fb07740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beee03070 0x563bef1c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb39fb07740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563beef71700 con 0x563beedda1b0 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb39fb07740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x563bef0ab160 con 0x563beee03070 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb39fb07740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563bef1b8aa0 con 0x563beede2390 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb392ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb39fb07740 10 client.0 _ll_register_callbacks cb 0x563bef0c49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb392ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60852/0 (socket says 172.21.15.7:60852) 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb392ffd640 1 -- 172.21.15.7:0/313992075 learned_addr learned my addr 172.21.15.7:0/313992075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb3927fc640 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beede2390 0x563bef1b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb3937fe640 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beee03070 0x563bef1c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb392ffd640 1 -- 172.21.15.7:0/313992075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beede2390 msgr2=0x563bef1b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb392ffd640 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beede2390 0x563bef1b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb392ffd640 1 -- 172.21.15.7:0/313992075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beee03070 msgr2=0x563bef1c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb392ffd640 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beee03070 0x563bef1c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.763+0000 7fb392ffd640 1 -- 172.21.15.7:0/313992075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bef0d8c90 con 0x563beedda1b0 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.764+0000 7fb3937fe640 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beee03070 0x563bef1c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.764+0000 7fb392ffd640 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1b59d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb38401aed0 tx=0x7fb384003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbdb931e29dd951 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.764+0000 7fb376ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.764+0000 7fb376ff5640 1 -- 172.21.15.7:0/313992075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384027020 con 0x563beedda1b0 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.764+0000 7fb39fb07740 1 -- 172.21.15.7:0/313992075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb384015070 con 0x563beedda1b0 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.764+0000 7fb376ff5640 1 -- 172.21.15.7:0/313992075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb38401a880 con 0x563beedda1b0 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.764+0000 7fb376ff5640 1 -- 172.21.15.7:0/313992075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb384032050 con 0x563beedda1b0 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.764+0000 7fb39fb07740 10 client.16086 fetch_fsmap learned FSMap version 25 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.764+0000 7fb39fb07740 1 -- 172.21.15.7:0/313992075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563bef1c4750 con 0x563beedda1b0 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.764+0000 7fb376ff5640 1 -- 172.21.15.7:0/313992075 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb384015070 con 0x563beedda1b0 2024-09-21T05:56:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.765+0000 7fb376ff5640 1 -- 172.21.15.7:0/313992075 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb384011cc0 con 0x563beedda1b0 2024-09-21T05:56:29.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.765+0000 7fb39fb07740 10 client.16086 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:56:29.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.765+0000 7fb39fb07740 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:56:29.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.765+0000 7fb39fb07740 20 client.16086 populate_metadata read hostname 'smithi007' 2024-09-21T05:56:29.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.765+0000 7fb39fb07740 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563beedc19f0 0x563bef1c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.765+0000 7fb39fb07740 4 client.16086 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:56:29.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.765+0000 7fb39fb07740 1 -- 172.21.15.7:0/313992075 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bef122df0 con 0x563beedc19f0 2024-09-21T05:56:29.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.765+0000 7fb3927fc640 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563beedc19f0 0x563bef1c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.766+0000 7fb3927fc640 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563beedc19f0 0x563bef1c7b60 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54dd0ab92463221f server_cookie=1fbdc67449695d63 in_seq=0 out_seq=0 2024-09-21T05:56:29.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.766+0000 7fb376ff5640 10 client.16086 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:29.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.766+0000 7fb376ff5640 1 -- 172.21.15.7:0/313992075 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563bef122df0 con 0x563beedc19f0 2024-09-21T05:56:29.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.766+0000 7fb376ff5640 10 client.16086 handle_command_reply: tid=0 2024-09-21T05:56:29.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.766+0000 7fb39fb07740 1 client.16086 shutdown 2024-09-21T05:56:29.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.767+0000 7fb39fb07740 1 -- 172.21.15.7:0/313992075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 msgr2=0x563bef1b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:29.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.767+0000 7fb39fb07740 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1b59d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb38401aed0 tx=0x7fb384003e00 comp rx=0 tx=0).stop 2024-09-21T05:56:29.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.767+0000 7fb39fb07740 1 -- 172.21.15.7:0/313992075 shutdown_connections 2024-09-21T05:56:29.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.767+0000 7fb39fb07740 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563beedc19f0 0x563bef1c7b60 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.767+0000 7fb39fb07740 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beee03070 0x563bef1c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.767+0000 7fb39fb07740 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beede2390 0x563bef1b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.767+0000 7fb39fb07740 1 --2- 172.21.15.7:0/313992075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1b59d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.767+0000 7fb39fb07740 1 -- 172.21.15.7:0/313992075 >> 172.21.15.7:0/313992075 conn(0x563beedf7460 msgr2=0x563bef1ad450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:29.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.767+0000 7fb376ff5640 0 client.16086 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:29.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.767+0000 7fb39fb07740 1 -- 172.21.15.7:0/313992075 shutdown_connections 2024-09-21T05:56:29.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.767+0000 7fb39fb07740 1 -- 172.21.15.7:0/313992075 wait complete. 2024-09-21T05:56:29.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.767+0000 7fb39fb07740 20 client.16086 trim_cache size 0 max 16384 2024-09-21T05:56:29.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.780+0000 7fb39fb07740 1 Processor -- start 2024-09-21T05:56:29.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.780+0000 7fb39fb07740 1 -- start start 2024-09-21T05:56:29.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.780+0000 7fb39fb07740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.780+0000 7fb39fb07740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beede2390 0x563bef1adad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.780+0000 7fb39fb07740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beee03070 0x563bef1b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.780+0000 7fb39fb07740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb3941b1e50 con 0x563beedda1b0 2024-09-21T05:56:29.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.780+0000 7fb39fb07740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb3941af720 con 0x563beee03070 2024-09-21T05:56:29.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.780+0000 7fb39fb07740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb3941ad570 con 0x563beede2390 2024-09-21T05:56:29.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.780+0000 7fb392ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.780+0000 7fb392ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60858/0 (socket says 172.21.15.7:60858) 2024-09-21T05:56:29.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.780+0000 7fb392ffd640 1 -- 172.21.15.7:0/470375006 learned_addr learned my addr 172.21.15.7:0/470375006 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:29.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.781+0000 7fb3927fc640 1 --2- 172.21.15.7:0/470375006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beede2390 0x563bef1adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.781+0000 7fb392ffd640 1 -- 172.21.15.7:0/470375006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beede2390 msgr2=0x563bef1adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:29.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.781+0000 7fb392ffd640 1 --2- 172.21.15.7:0/470375006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beede2390 0x563bef1adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.781+0000 7fb392ffd640 1 -- 172.21.15.7:0/470375006 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beee03070 msgr2=0x563bef1b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:29.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.781+0000 7fb392ffd640 1 --2- 172.21.15.7:0/470375006 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beee03070 0x563bef1b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.781+0000 7fb392ffd640 1 -- 172.21.15.7:0/470375006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563beedc1c20 con 0x563beedda1b0 2024-09-21T05:56:29.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.781+0000 7fb392ffd640 1 --2- 172.21.15.7:0/470375006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1b48c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb384006010 tx=0x7fb38400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49285280c80ab90 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:29.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.781+0000 7fb378ff9640 1 -- 172.21.15.7:0/470375006 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384027070 con 0x563beedda1b0 2024-09-21T05:56:29.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.781+0000 7fb378ff9640 1 -- 172.21.15.7:0/470375006 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb384015040 con 0x563beedda1b0 2024-09-21T05:56:29.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.781+0000 7fb378ff9640 1 -- 172.21.15.7:0/470375006 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38401a8e0 con 0x563beedda1b0 2024-09-21T05:56:29.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.782+0000 7fb39fb07740 1 -- 172.21.15.7:0/470375006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 msgr2=0x563bef1b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:29.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.782+0000 7fb39fb07740 1 --2- 172.21.15.7:0/470375006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1b48c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb384006010 tx=0x7fb38400b410 comp rx=0 tx=0).stop 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.782+0000 7fb39fb07740 1 -- 172.21.15.7:0/470375006 shutdown_connections 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.782+0000 7fb39fb07740 1 --2- 172.21.15.7:0/470375006 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beee03070 0x563bef1b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.782+0000 7fb39fb07740 1 --2- 172.21.15.7:0/470375006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beede2390 0x563bef1adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.782+0000 7fb39fb07740 1 --2- 172.21.15.7:0/470375006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1b48c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.782+0000 7fb39fb07740 1 -- 172.21.15.7:0/470375006 >> 172.21.15.7:0/470375006 conn(0x563beedf7460 msgr2=0x563bef1ad3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.782+0000 7fb39fb07740 1 -- 172.21.15.7:0/470375006 shutdown_connections 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.782+0000 7fb39fb07740 1 -- 172.21.15.7:0/470375006 wait complete. 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.782+0000 7fb39fb07740 1 -- start start 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.782+0000 7fb39fb07740 1 Processor -- start 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb39fb07740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb39fb07740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beede2390 0x563bef1c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb39fb07740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beee03070 0x563bef1c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb39fb07740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb3941adbe0 con 0x563beedda1b0 2024-09-21T05:56:29.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb39fb07740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb3941af050 con 0x563beede2390 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb39fb07740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb3941ae2b0 con 0x563beee03070 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb39fb07740 10 client.0 _ll_register_callbacks cb 0x7fb38c00a7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb392ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb392ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60870/0 (socket says 172.21.15.7:60870) 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb392ffd640 1 -- 172.21.15.7:0/345042197 learned_addr learned my addr 172.21.15.7:0/345042197 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb3927fc640 1 --2- 172.21.15.7:0/345042197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beede2390 0x563bef1c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb392ffd640 1 -- 172.21.15.7:0/345042197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beee03070 msgr2=0x563bef1c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb392ffd640 1 --2- 172.21.15.7:0/345042197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beee03070 0x563bef1c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb392ffd640 1 -- 172.21.15.7:0/345042197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beede2390 msgr2=0x563bef1c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb392ffd640 1 --2- 172.21.15.7:0/345042197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beede2390 0x563bef1c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb392ffd640 1 -- 172.21.15.7:0/345042197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bef1c9240 con 0x563beedda1b0 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb3927fc640 1 --2- 172.21.15.7:0/345042197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beede2390 0x563bef1c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb392ffd640 1 --2- 172.21.15.7:0/345042197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1cb1f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb384005730 tx=0x7fb384003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af05fa76a7012db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.783+0000 7fb376ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:56:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb376ff5640 1 -- 172.21.15.7:0/345042197 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384027070 con 0x563beedda1b0 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb376ff5640 1 -- 172.21.15.7:0/345042197 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb38401a680 con 0x563beedda1b0 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb39fb07740 1 -- 172.21.15.7:0/345042197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb384015040 con 0x563beedda1b0 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb376ff5640 1 -- 172.21.15.7:0/345042197 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb384023970 con 0x563beedda1b0 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb39fb07740 10 client.16092 fetch_fsmap learned FSMap version 25 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb39fb07740 1 -- 172.21.15.7:0/345042197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563bef232090 con 0x563beedda1b0 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb376ff5640 1 -- 172.21.15.7:0/345042197 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb384015040 con 0x563beedda1b0 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb376ff5640 1 -- 172.21.15.7:0/345042197 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb38403fb80 con 0x563beedda1b0 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb39fb07740 10 client.16092 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb39fb07740 10 client.16092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb39fb07740 20 client.16092 populate_metadata read hostname 'smithi007' 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb39fb07740 1 --2- 172.21.15.7:0/345042197 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563beed96da0 0x563bef2346b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb39fb07740 4 client.16092 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.784+0000 7fb39fb07740 1 -- 172.21.15.7:0/345042197 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563bef11e8a0 con 0x563beed96da0 2024-09-21T05:56:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb3927fc640 1 --2- 172.21.15.7:0/345042197 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563beed96da0 0x563bef2346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb376ff5640 10 client.16092 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb3927fc640 1 --2- 172.21.15.7:0/345042197 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563beed96da0 0x563bef2346b0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe604b264e4e43b1 server_cookie=bed2b62dfc250439 in_seq=0 out_seq=0 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb376ff5640 1 -- 172.21.15.7:0/345042197 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563bef11e8a0 con 0x563beed96da0 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb376ff5640 10 client.16092 handle_command_reply: tid=0 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb39fb07740 1 client.16092 shutdown 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb39fb07740 1 -- 172.21.15.7:0/345042197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 msgr2=0x563bef1cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb39fb07740 1 --2- 172.21.15.7:0/345042197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1cb1f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb384005730 tx=0x7fb384003a80 comp rx=0 tx=0).stop 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb39fb07740 1 -- 172.21.15.7:0/345042197 shutdown_connections 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb39fb07740 1 --2- 172.21.15.7:0/345042197 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563beed96da0 0x563bef2346b0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb39fb07740 1 --2- 172.21.15.7:0/345042197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563beee03070 0x563bef1c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb39fb07740 1 --2- 172.21.15.7:0/345042197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563beede2390 0x563bef1c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb39fb07740 1 --2- 172.21.15.7:0/345042197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563beedda1b0 0x563bef1cb1f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb39fb07740 1 -- 172.21.15.7:0/345042197 >> 172.21.15.7:0/345042197 conn(0x563beedf7460 msgr2=0x563bef1ab2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.785+0000 7fb376ff5640 0 client.16092 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:29.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb39fb07740 1 -- 172.21.15.7:0/345042197 shutdown_connections 2024-09-21T05:56:29.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb39fb07740 1 -- 172.21.15.7:0/345042197 wait complete. 2024-09-21T05:56:29.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb39fb07740 20 client.16092 trim_cache size 0 max 16384 2024-09-21T05:56:29.792 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:56:29.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb399593640 1 -- 172.21.15.7:0/2169954311 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb37c0b6680 msgr2=0x7fb37c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:29.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb399593640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb37c0b6680 0x7fb37c0b8b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb38c00ae90 tx=0x7fb38c00a4d0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb399593640 1 -- 172.21.15.7:0/2169954311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb394105300 msgr2=0x7fb39419aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:29.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb399593640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb394105300 0x7fb39419aa00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb38802a930 tx=0x7fb388004270 comp rx=0 tx=0).stop 2024-09-21T05:56:29.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb399593640 1 -- 172.21.15.7:0/2169954311 shutdown_connections 2024-09-21T05:56:29.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb399593640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb37c0b6680 0x7fb37c0b8b90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb399593640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb394105300 0x7fb39419aa00 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb399593640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb39410de10 0x7fb39419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb399593640 1 --2- 172.21.15.7:0/2169954311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3941049b0 0x7fb39419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:29.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb399593640 1 -- 172.21.15.7:0/2169954311 >> 172.21.15.7:0/2169954311 conn(0x7fb394079720 msgr2=0x7fb394100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:29.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb399593640 1 -- 172.21.15.7:0/2169954311 shutdown_connections 2024-09-21T05:56:29.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:29.786+0000 7fb399593640 1 -- 172.21.15.7:0/2169954311 wait complete. 2024-09-21T05:56:30.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:29 smithi007 ceph-mon[30983]: pgmap v396: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:56:30.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:29 smithi027 ceph-mon[34364]: pgmap v396: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:56:30.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:29 smithi119 ceph-mon[34833]: pgmap v396: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:56:31.581 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T05:56:31.581 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T05:56:31.853 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:56:32.150 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:31 smithi007 ceph-mon[30983]: pgmap v397: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:56:32.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:31 smithi027 ceph-mon[34364]: pgmap v397: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:56:32.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:31 smithi119 ceph-mon[34833]: pgmap v397: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:56:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.384+0000 7f4b4448c640 1 -- 172.21.15.7:0/219855941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c108d10 msgr2=0x7f4b3c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.384+0000 7f4b4448c640 1 --2- 172.21.15.7:0/219855941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c108d10 0x7f4b3c10f540 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4b34009900 tx=0x7f4b3402a410 comp rx=0 tx=0).stop 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.384+0000 7f4b4448c640 1 -- 172.21.15.7:0/219855941 shutdown_connections 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.384+0000 7f4b4448c640 1 --2- 172.21.15.7:0/219855941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c108d10 0x7f4b3c10f540 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.384+0000 7f4b4448c640 1 --2- 172.21.15.7:0/219855941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b3c1083c0 0x7f4b3c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.384+0000 7f4b4448c640 1 --2- 172.21.15.7:0/219855941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b3c102a80 0x7f4b3c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.384+0000 7f4b4448c640 1 -- 172.21.15.7:0/219855941 >> 172.21.15.7:0/219855941 conn(0x7f4b3c079740 msgr2=0x7f4b3c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.384+0000 7f4b4448c640 1 -- 172.21.15.7:0/219855941 shutdown_connections 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.384+0000 7f4b4448c640 1 -- 172.21.15.7:0/219855941 wait complete. 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.385+0000 7f4b4448c640 1 Processor -- start 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.385+0000 7f4b4448c640 1 -- start start 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.385+0000 7f4b4448c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b3c102a80 0x7f4b3c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.385+0000 7f4b4448c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c1083c0 0x7f4b3c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.385+0000 7f4b4448c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b3c108d10 0x7f4b3c19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.385+0000 7f4b4448c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c113aa0 con 0x7f4b3c1083c0 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.385+0000 7f4b4448c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c113920 con 0x7f4b3c108d10 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.385+0000 7f4b4448c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c113c20 con 0x7f4b3c102a80 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.385+0000 7f4b41a27640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c1083c0 0x7f4b3c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.385+0000 7f4b41a27640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c1083c0 0x7f4b3c19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60888/0 (socket says 172.21.15.7:60888) 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.385+0000 7f4b41a27640 1 -- 172.21.15.7:0/1341289462 learned_addr learned my addr 172.21.15.7:0/1341289462 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.386+0000 7f4b42228640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b3c102a80 0x7f4b3c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.386+0000 7f4b42a29640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b3c108d10 0x7f4b3c19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.386+0000 7f4b41a27640 1 -- 172.21.15.7:0/1341289462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b3c102a80 msgr2=0x7f4b3c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.386+0000 7f4b41a27640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b3c102a80 0x7f4b3c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.386+0000 7f4b41a27640 1 -- 172.21.15.7:0/1341289462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b3c108d10 msgr2=0x7f4b3c19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.386+0000 7f4b41a27640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b3c108d10 0x7f4b3c19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.386+0000 7f4b41a27640 1 -- 172.21.15.7:0/1341289462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c1a03a0 con 0x7f4b3c1083c0 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.386+0000 7f4b41a27640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c1083c0 0x7f4b3c19a9d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000d740 tx=0x7f4b3000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.386+0000 7f4b2f7fe640 1 -- 172.21.15.7:0/1341289462 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30017070 con 0x7f4b3c1083c0 2024-09-21T05:56:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.386+0000 7f4b2f7fe640 1 -- 172.21.15.7:0/1341289462 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b3000de50 con 0x7f4b3c1083c0 2024-09-21T05:56:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.386+0000 7f4b4448c640 1 -- 172.21.15.7:0/1341289462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3c1a0690 con 0x7f4b3c1083c0 2024-09-21T05:56:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.386+0000 7f4b2f7fe640 1 -- 172.21.15.7:0/1341289462 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30004ce0 con 0x7f4b3c1083c0 2024-09-21T05:56:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.386+0000 7f4b4448c640 1 -- 172.21.15.7:0/1341289462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3c1a6df0 con 0x7f4b3c1083c0 2024-09-21T05:56:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.389+0000 7f4b4aa00740 1 Processor -- start 2024-09-21T05:56:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.389+0000 7f4b4aa00740 1 -- start start 2024-09-21T05:56:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.389+0000 7f4b4aa00740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e18e350 0x56354e535430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.389+0000 7f4b4aa00740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e535970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.389+0000 7f4b4aa00740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e16d670 0x56354e535eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.389+0000 7f4b4aa00740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56354e4abe60 con 0x56354e165490 2024-09-21T05:56:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.389+0000 7f4b4aa00740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56354e49b290 con 0x56354e16d670 2024-09-21T05:56:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.389+0000 7f4b4aa00740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56354e49f0a0 con 0x56354e18e350 2024-09-21T05:56:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.389+0000 7f4b2f7fe640 1 -- 172.21.15.7:0/1341289462 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f4b30010460 con 0x7f4b3c1083c0 2024-09-21T05:56:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b42228640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e535970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b42228640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e535970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60904/0 (socket says 172.21.15.7:60904) 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b42228640 1 -- 172.21.15.7:0/2837466481 learned_addr learned my addr 172.21.15.7:0/2837466481 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b42a29640 1 --2- 172.21.15.7:0/2837466481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e18e350 0x56354e535430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b42228640 1 -- 172.21.15.7:0/2837466481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e18e350 msgr2=0x56354e535430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b42228640 1 --2- 172.21.15.7:0/2837466481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e18e350 0x56354e535430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b42228640 1 -- 172.21.15.7:0/2837466481 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e16d670 msgr2=0x56354e535eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b42228640 1 --2- 172.21.15.7:0/2837466481 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e16d670 0x56354e535eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b42228640 1 -- 172.21.15.7:0/2837466481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56354e1f9930 con 0x56354e165490 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b42a29640 1 --2- 172.21.15.7:0/2837466481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e18e350 0x56354e535430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b42228640 1 --2- 172.21.15.7:0/2837466481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e535970 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4b380039f0 tx=0x7f4b38003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfe678e4688390f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b2cd9a640 1 -- 172.21.15.7:0/2837466481 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38004b20 con 0x56354e165490 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b2f7fe640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b280b6680 0x7f4b280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b2cd9a640 1 -- 172.21.15.7:0/2837466481 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b38004cc0 con 0x56354e165490 2024-09-21T05:56:32.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.390+0000 7f4b2cd9a640 1 -- 172.21.15.7:0/2837466481 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b380126b0 con 0x56354e165490 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.391+0000 7f4b42a29640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b280b6680 0x7f4b280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.391+0000 7f4b2f7fe640 1 -- 172.21.15.7:0/1341289462 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4b300e6fd0 con 0x7f4b3c1083c0 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.391+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2837466481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 msgr2=0x56354e535970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.391+0000 7f4b42a29640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b280b6680 0x7f4b280b8b90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4b34006010 tx=0x7f4b340058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.391+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2837466481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e535970 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4b380039f0 tx=0x7f4b38003eb0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.391+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2837466481 shutdown_connections 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.391+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2837466481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e535970 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.391+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2837466481 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e16d670 0x56354e535eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.391+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2837466481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e18e350 0x56354e535430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.392+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2837466481 >> 172.21.15.7:0/2837466481 conn(0x56354e182740 msgr2=0x56354e533320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.392+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2837466481 shutdown_connections 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.392+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2837466481 wait complete. 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.392+0000 7f4b4aa00740 1 -- start start 2024-09-21T05:56:32.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.392+0000 7f4b4aa00740 1 Processor -- start 2024-09-21T05:56:32.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.392+0000 7f4b4aa00740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e5453e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.392+0000 7f4b4aa00740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e16d670 0x56354e545920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.392+0000 7f4b4aa00740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e18e350 0x56354e5512d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.392+0000 7f4b4aa00740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56354e2fc890 con 0x56354e165490 2024-09-21T05:56:32.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.392+0000 7f4b4aa00740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56354e435d40 con 0x56354e16d670 2024-09-21T05:56:32.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.392+0000 7f4b4aa00740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56354e547f70 con 0x56354e18e350 2024-09-21T05:56:32.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b4aa00740 10 client.0 _ll_register_callbacks cb 0x56354e499c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:32.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b42228640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e5453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b42228640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e5453e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60906/0 (socket says 172.21.15.7:60906) 2024-09-21T05:56:32.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b42228640 1 -- 172.21.15.7:0/1130324291 learned_addr learned my addr 172.21.15.7:0/1130324291 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:32.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b41a27640 1 --2- 172.21.15.7:0/1130324291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e16d670 0x56354e545920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b42a29640 1 --2- 172.21.15.7:0/1130324291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e18e350 0x56354e5512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b42228640 1 -- 172.21.15.7:0/1130324291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e18e350 msgr2=0x56354e5512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b42228640 1 --2- 172.21.15.7:0/1130324291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e18e350 0x56354e5512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b42228640 1 -- 172.21.15.7:0/1130324291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e16d670 msgr2=0x56354e545920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b42228640 1 --2- 172.21.15.7:0/1130324291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e16d670 0x56354e545920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b42228640 1 -- 172.21.15.7:0/1130324291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354e551860 con 0x56354e165490 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b42228640 1 --2- 172.21.15.7:0/1130324291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e5453e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4b38004ac0 tx=0x7f4b38004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6bd41e50ba5cda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b25ffb640 1 -- 172.21.15.7:0/1130324291 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38005280 con 0x56354e165490 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b25ffb640 1 -- 172.21.15.7:0/1130324291 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4b38005420 con 0x56354e165490 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.393+0000 7f4b4aa00740 1 -- 172.21.15.7:0/1130324291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b38004cc0 con 0x56354e165490 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.394+0000 7f4b25ffb640 1 -- 172.21.15.7:0/1130324291 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b38004820 con 0x56354e165490 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.394+0000 7f4b4aa00740 10 client.16104 fetch_fsmap learned FSMap version 25 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.394+0000 7f4b4aa00740 1 -- 172.21.15.7:0/1130324291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56354e554170 con 0x56354e165490 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.394+0000 7f4b25ffb640 1 -- 172.21.15.7:0/1130324291 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b38004cc0 con 0x56354e165490 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.394+0000 7f4b25ffb640 1 -- 172.21.15.7:0/1130324291 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4b3800f040 con 0x56354e165490 2024-09-21T05:56:32.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.394+0000 7f4b4aa00740 10 client.16104 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:56:32.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.394+0000 7f4b4aa00740 10 client.16104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:56:32.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.394+0000 7f4b4aa00740 20 client.16104 populate_metadata read hostname 'smithi007' 2024-09-21T05:56:32.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.394+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/1130324291 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56354e14ccd0 0x56354e557530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.394+0000 7f4b4aa00740 4 client.16104 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:56:32.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.394+0000 7f4b4aa00740 1 -- 172.21.15.7:0/1130324291 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56354e4addb0 con 0x56354e14ccd0 2024-09-21T05:56:32.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.395+0000 7f4b41a27640 1 --2- 172.21.15.7:0/1130324291 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56354e14ccd0 0x56354e557530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.395+0000 7f4b41a27640 1 --2- 172.21.15.7:0/1130324291 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56354e14ccd0 0x56354e557530 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8fb8211ec463e43 server_cookie=e0f3e3f0d427ade6 in_seq=0 out_seq=0 2024-09-21T05:56:32.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.395+0000 7f4b25ffb640 10 client.16104 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:32.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b25ffb640 1 -- 172.21.15.7:0/1130324291 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56354e4addb0 con 0x56354e14ccd0 2024-09-21T05:56:32.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b25ffb640 10 client.16104 handle_command_reply: tid=0 2024-09-21T05:56:32.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b4aa00740 1 client.16104 shutdown 2024-09-21T05:56:32.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b4aa00740 1 -- 172.21.15.7:0/1130324291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 msgr2=0x56354e5453e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:32.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/1130324291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e5453e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4b38004ac0 tx=0x7f4b38004af0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b4aa00740 1 -- 172.21.15.7:0/1130324291 shutdown_connections 2024-09-21T05:56:32.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/1130324291 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56354e14ccd0 0x56354e557530 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/1130324291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e18e350 0x56354e5512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/1130324291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e16d670 0x56354e545920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/1130324291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e5453e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b4aa00740 1 -- 172.21.15.7:0/1130324291 >> 172.21.15.7:0/1130324291 conn(0x56354e182740 msgr2=0x56354e536e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:32.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b25ffb640 0 client.16104 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:32.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b4aa00740 1 -- 172.21.15.7:0/1130324291 shutdown_connections 2024-09-21T05:56:32.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b4aa00740 1 -- 172.21.15.7:0/1130324291 wait complete. 2024-09-21T05:56:32.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.396+0000 7f4b4aa00740 20 client.16104 trim_cache size 0 max 16384 2024-09-21T05:56:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.414+0000 7f4b4aa00740 1 Processor -- start 2024-09-21T05:56:32.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.414+0000 7f4b4aa00740 1 -- start start 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.414+0000 7f4b4aa00740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e543a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.414+0000 7f4b4aa00740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e16d670 0x56354e543fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.414+0000 7f4b4aa00740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e18e350 0x56354e532c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.414+0000 7f4b4aa00740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1afc00 con 0x56354e165490 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.414+0000 7f4b4aa00740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1ad4d0 con 0x56354e18e350 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.414+0000 7f4b4aa00740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1ab320 con 0x56354e16d670 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.414+0000 7f4b42a29640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e18e350 0x56354e532c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.414+0000 7f4b42228640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e543a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.414+0000 7f4b42a29640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e18e350 0x56354e532c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:60020/0 (socket says 172.21.15.7:60020) 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.414+0000 7f4b42a29640 1 -- 172.21.15.7:0/2760546414 learned_addr learned my addr 172.21.15.7:0/2760546414 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.415+0000 7f4b41a27640 1 --2- 172.21.15.7:0/2760546414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e16d670 0x56354e543fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.415+0000 7f4b42a29640 1 -- 172.21.15.7:0/2760546414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e16d670 msgr2=0x56354e543fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.415+0000 7f4b42a29640 1 --2- 172.21.15.7:0/2760546414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e16d670 0x56354e543fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.415+0000 7f4b42a29640 1 -- 172.21.15.7:0/2760546414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 msgr2=0x56354e543a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:32.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.415+0000 7f4b42a29640 1 --2- 172.21.15.7:0/2760546414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e543a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.415+0000 7f4b42a29640 1 -- 172.21.15.7:0/2760546414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56354e14cf00 con 0x56354e18e350 2024-09-21T05:56:32.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.415+0000 7f4b42228640 1 --2- 172.21.15.7:0/2760546414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e543a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:32.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.415+0000 7f4b42a29640 1 --2- 172.21.15.7:0/2760546414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e18e350 0x56354e532c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4b3402a930 tx=0x7f4b3403e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e16015c551010ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:32.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.415+0000 7f4b27fff640 1 -- 172.21.15.7:0/2760546414 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b34035040 con 0x56354e18e350 2024-09-21T05:56:32.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.415+0000 7f4b27fff640 1 -- 172.21.15.7:0/2760546414 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b3404d070 con 0x56354e18e350 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.415+0000 7f4b27fff640 1 -- 172.21.15.7:0/2760546414 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b34004bc0 con 0x56354e18e350 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.416+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2760546414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e18e350 msgr2=0x56354e532c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.416+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2760546414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e18e350 0x56354e532c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4b3402a930 tx=0x7f4b3403e000 comp rx=0 tx=0).stop 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.416+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2760546414 shutdown_connections 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.416+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2760546414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e18e350 0x56354e532c40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.416+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2760546414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e16d670 0x56354e543fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.416+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2760546414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e165490 0x56354e543a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.416+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2760546414 >> 172.21.15.7:0/2760546414 conn(0x56354e182740 msgr2=0x56354e53a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.416+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2760546414 shutdown_connections 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.416+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2760546414 wait complete. 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.417+0000 7f4b4aa00740 1 -- start start 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.417+0000 7f4b4aa00740 1 Processor -- start 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.417+0000 7f4b4aa00740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e165490 0x56354e54da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.417+0000 7f4b4aa00740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e16d670 0x56354e535160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.417+0000 7f4b4aa00740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e18e350 0x56354e535700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.417+0000 7f4b4aa00740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1ab990 con 0x56354e18e350 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.417+0000 7f4b4aa00740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1ace00 con 0x56354e165490 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.417+0000 7f4b4aa00740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1ac060 con 0x56354e16d670 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.417+0000 7f4b4aa00740 10 client.0 _ll_register_callbacks cb 0x7f4b38009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.417+0000 7f4b42a29640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e18e350 0x56354e535700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.417+0000 7f4b42228640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e165490 0x56354e54da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.417+0000 7f4b42a29640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e18e350 0x56354e535700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60934/0 (socket says 172.21.15.7:60934) 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.417+0000 7f4b42a29640 1 -- 172.21.15.7:0/2305544763 learned_addr learned my addr 172.21.15.7:0/2305544763 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b41a27640 1 --2- 172.21.15.7:0/2305544763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e16d670 0x56354e535160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b42228640 1 -- 172.21.15.7:0/2305544763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e16d670 msgr2=0x56354e535160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b42228640 1 --2- 172.21.15.7:0/2305544763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e16d670 0x56354e535160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b42228640 1 -- 172.21.15.7:0/2305544763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e18e350 msgr2=0x56354e535700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b42228640 1 --2- 172.21.15.7:0/2305544763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e18e350 0x56354e535700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b42228640 1 -- 172.21.15.7:0/2305544763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354e535e90 con 0x56354e165490 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b42a29640 1 --2- 172.21.15.7:0/2305544763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e18e350 0x56354e535700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b42228640 1 --2- 172.21.15.7:0/2305544763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e165490 0x56354e54da80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4b38002230 tx=0x7f4b3801a970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=504bdf3389273859 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:32.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:56:32.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b25ffb640 1 -- 172.21.15.7:0/2305544763 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38033070 con 0x56354e165490 2024-09-21T05:56:32.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b25ffb640 1 -- 172.21.15.7:0/2305544763 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4b38005490 con 0x56354e165490 2024-09-21T05:56:32.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2305544763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b3404d070 con 0x56354e165490 2024-09-21T05:56:32.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b25ffb640 1 -- 172.21.15.7:0/2305544763 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b3803e050 con 0x56354e165490 2024-09-21T05:56:32.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b4aa00740 10 client.25784 fetch_fsmap learned FSMap version 25 2024-09-21T05:56:32.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.418+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2305544763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56354e5c1e60 con 0x56354e165490 2024-09-21T05:56:32.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.419+0000 7f4b25ffb640 1 -- 172.21.15.7:0/2305544763 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b3404d070 con 0x56354e165490 2024-09-21T05:56:32.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.419+0000 7f4b25ffb640 1 -- 172.21.15.7:0/2305544763 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4b38011b10 con 0x56354e165490 2024-09-21T05:56:32.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.419+0000 7f4b4aa00740 10 client.25784 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:56:32.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.419+0000 7f4b4aa00740 10 client.25784 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:56:32.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.419+0000 7f4b4aa00740 20 client.25784 populate_metadata read hostname 'smithi007' 2024-09-21T05:56:32.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.419+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2305544763 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56354e122080 0x56354e5c4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.419+0000 7f4b4aa00740 4 client.25784 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.419+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2305544763 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56354e4a9860 con 0x56354e122080 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.419+0000 7f4b41a27640 1 --2- 172.21.15.7:0/2305544763 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56354e122080 0x56354e5c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.420+0000 7f4b41a27640 1 --2- 172.21.15.7:0/2305544763 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56354e122080 0x56354e5c4500 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f151db0fa4c60aa6 server_cookie=6ab93af1a2b65406 in_seq=0 out_seq=0 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.420+0000 7f4b25ffb640 10 client.25784 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.421+0000 7f4b25ffb640 1 -- 172.21.15.7:0/2305544763 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56354e4a9860 con 0x56354e122080 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.421+0000 7f4b25ffb640 10 client.25784 handle_command_reply: tid=0 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.421+0000 7f4b4aa00740 1 client.25784 shutdown 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.421+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2305544763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e165490 msgr2=0x56354e54da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.421+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2305544763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e165490 0x56354e54da80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4b38002230 tx=0x7f4b3801a970 comp rx=0 tx=0).stop 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.422+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2305544763 shutdown_connections 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.422+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2305544763 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56354e122080 0x56354e5c4500 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.422+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2305544763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354e18e350 0x56354e535700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.422+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2305544763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56354e16d670 0x56354e535160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.422+0000 7f4b4aa00740 1 --2- 172.21.15.7:0/2305544763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56354e165490 0x56354e54da80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.422+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2305544763 >> 172.21.15.7:0/2305544763 conn(0x56354e182740 msgr2=0x56354e5439a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:32.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.422+0000 7f4b25ffb640 0 client.25784 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:32.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.422+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2305544763 shutdown_connections 2024-09-21T05:56:32.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.422+0000 7f4b4aa00740 1 -- 172.21.15.7:0/2305544763 wait complete. 2024-09-21T05:56:32.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.422+0000 7f4b4aa00740 20 client.25784 trim_cache size 0 max 16384 2024-09-21T05:56:32.426 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:56:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T05:56:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "549be0a1-71cf-47fc-82a9-6f66cf789bca", 2024-09-21T05:56:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T05:56:32.426 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:56:32.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.422+0000 7f4b4448c640 1 -- 172.21.15.7:0/1341289462 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b280b6680 msgr2=0x7f4b280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:32.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.422+0000 7f4b4448c640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b280b6680 0x7f4b280b8b90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4b34006010 tx=0x7f4b340058d0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.423+0000 7f4b4448c640 1 -- 172.21.15.7:0/1341289462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c1083c0 msgr2=0x7f4b3c19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:32.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.423+0000 7f4b4448c640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c1083c0 0x7f4b3c19a9d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000d740 tx=0x7f4b3000dc00 comp rx=0 tx=0).stop 2024-09-21T05:56:32.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.423+0000 7f4b4448c640 1 -- 172.21.15.7:0/1341289462 shutdown_connections 2024-09-21T05:56:32.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.423+0000 7f4b4448c640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b280b6680 0x7f4b280b8b90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.423+0000 7f4b4448c640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c1083c0 0x7f4b3c19a9d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.423+0000 7f4b4448c640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b3c108d10 0x7f4b3c19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.423+0000 7f4b4448c640 1 --2- 172.21.15.7:0/1341289462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b3c102a80 0x7f4b3c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:32.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.423+0000 7f4b4448c640 1 -- 172.21.15.7:0/1341289462 >> 172.21.15.7:0/1341289462 conn(0x7f4b3c079740 msgr2=0x7f4b3c105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:32.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.423+0000 7f4b4448c640 1 -- 172.21.15.7:0/1341289462 shutdown_connections 2024-09-21T05:56:32.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:32.423+0000 7f4b4448c640 1 -- 172.21.15.7:0/1341289462 wait complete. 2024-09-21T05:56:33.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:56:33.307 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:56:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.790+0000 7f6cbe88c640 1 -- 172.21.15.7:0/1144395739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb81094a0 msgr2=0x7f6cb81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.790+0000 7f6cbe88c640 1 --2- 172.21.15.7:0/1144395739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb81094a0 0x7f6cb81098b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009900 tx=0x7f6cac02a410 comp rx=0 tx=0).stop 2024-09-21T05:56:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.790+0000 7f6cbe88c640 1 -- 172.21.15.7:0/1144395739 shutdown_connections 2024-09-21T05:56:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.790+0000 7f6cbe88c640 1 --2- 172.21.15.7:0/1144395739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb81094a0 0x7f6cb81098b0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.790+0000 7f6cbe88c640 1 --2- 172.21.15.7:0/1144395739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cb8109df0 0x7f6cb8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.790+0000 7f6cbe88c640 1 --2- 172.21.15.7:0/1144395739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb8103b60 0x7f6cb8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.790+0000 7f6cbe88c640 1 -- 172.21.15.7:0/1144395739 >> 172.21.15.7:0/1144395739 conn(0x7f6cb807b850 msgr2=0x7f6cb807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.790+0000 7f6cbe88c640 1 -- 172.21.15.7:0/1144395739 shutdown_connections 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.790+0000 7f6cbe88c640 1 -- 172.21.15.7:0/1144395739 wait complete. 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.791+0000 7f6cbe88c640 1 Processor -- start 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.791+0000 7f6cbe88c640 1 -- start start 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.791+0000 7f6cbe88c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cb8103b60 0x7f6cb819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.791+0000 7f6cbe88c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb81094a0 0x7f6cb819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.791+0000 7f6cbe88c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb8109df0 0x7f6cb819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.791+0000 7f6cbe88c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb8113ab0 con 0x7f6cb81094a0 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.791+0000 7f6cbe88c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb8113930 con 0x7f6cb8109df0 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.791+0000 7f6cbe88c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb8113c30 con 0x7f6cb8103b60 2024-09-21T05:56:33.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cb77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb81094a0 0x7f6cb819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cb77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb81094a0 0x7f6cb819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60966/0 (socket says 172.21.15.7:60966) 2024-09-21T05:56:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cb77fe640 1 -- 172.21.15.7:0/379426905 learned_addr learned my addr 172.21.15.7:0/379426905 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cb7fff640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cb8103b60 0x7f6cb819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cbce29640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb8109df0 0x7f6cb819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cb77fe640 1 -- 172.21.15.7:0/379426905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cb8103b60 msgr2=0x7f6cb819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cb77fe640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cb8103b60 0x7f6cb819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cb77fe640 1 -- 172.21.15.7:0/379426905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb8109df0 msgr2=0x7f6cb819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cb77fe640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb8109df0 0x7f6cb819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cb77fe640 1 -- 172.21.15.7:0/379426905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb81a03f0 con 0x7f6cb81094a0 2024-09-21T05:56:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cb77fe640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb81094a0 0x7f6cb819aa20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6cac02a930 tx=0x7f6cac031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cb57fa640 1 -- 172.21.15.7:0/379426905 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac03f030 con 0x7f6cb81094a0 2024-09-21T05:56:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cbe88c640 1 -- 172.21.15.7:0/379426905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb81a0680 con 0x7f6cb81094a0 2024-09-21T05:56:33.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cb57fa640 1 -- 172.21.15.7:0/379426905 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cac004490 con 0x7f6cb81094a0 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cb57fa640 1 -- 172.21.15.7:0/379426905 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac035070 con 0x7f6cb81094a0 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.792+0000 7f6cbe88c640 1 -- 172.21.15.7:0/379426905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb81a6e40 con 0x7f6cb81094a0 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.795+0000 7f6cc4e00740 1 Processor -- start 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.795+0000 7f6cc4e00740 1 -- start start 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.795+0000 7f6cb57fa640 1 -- 172.21.15.7:0/379426905 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6cac042030 con 0x7f6cb81094a0 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.795+0000 7f6cc4e00740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3b0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.795+0000 7f6cc4e00740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe01b0 0x564a4e3b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cc4e00740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 0x564a4e3b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cc4e00740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564a4e326e50 con 0x564a4e009070 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cc4e00740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x564a4e316280 con 0x564a4dfe8390 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cc4e00740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564a4e31a090 con 0x564a4dfe01b0 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cbce29640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cbce29640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3b0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60976/0 (socket says 172.21.15.7:60976) 2024-09-21T05:56:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cbce29640 1 -- 172.21.15.7:0/4164583411 learned_addr learned my addr 172.21.15.7:0/4164583411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cb7fff640 1 --2- 172.21.15.7:0/4164583411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe01b0 0x564a4e3b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cb77fe640 1 --2- 172.21.15.7:0/4164583411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 0x564a4e3b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cbce29640 1 -- 172.21.15.7:0/4164583411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe01b0 msgr2=0x564a4e3b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cbce29640 1 --2- 172.21.15.7:0/4164583411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe01b0 0x564a4e3b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cbce29640 1 -- 172.21.15.7:0/4164583411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 msgr2=0x564a4e3b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cbce29640 1 --2- 172.21.15.7:0/4164583411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 0x564a4e3b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cbce29640 1 -- 172.21.15.7:0/4164583411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4e074650 con 0x564a4e009070 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6cbce29640 1 --2- 172.21.15.7:0/4164583411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3b0650 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009fd0 tx=0x7f6cb00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cf2d602a1b91ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6c9e7fc640 1 -- 172.21.15.7:0/4164583411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0004d20 con 0x564a4e009070 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6c9e7fc640 1 -- 172.21.15.7:0/4164583411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cb0004050 con 0x564a4e009070 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.796+0000 7f6c9e7fc640 1 -- 172.21.15.7:0/4164583411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0005240 con 0x564a4e009070 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.797+0000 7f6cb57fa640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6ca00b6680 0x7f6ca00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.797+0000 7f6cb7fff640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6ca00b6680 0x7f6ca00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.797+0000 7f6cb57fa640 1 -- 172.21.15.7:0/379426905 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f6cac107960 con 0x7f6cb81094a0 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.797+0000 7f6cc4e00740 1 -- 172.21.15.7:0/4164583411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 msgr2=0x564a4e3b0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.797+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/4164583411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3b0650 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009fd0 tx=0x7f6cb00118d0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.797+0000 7f6cb7fff640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6ca00b6680 0x7f6ca00b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x564a4e3af2d0 tx=0x7f6ca8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.797+0000 7f6cc4e00740 1 -- 172.21.15.7:0/4164583411 shutdown_connections 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.797+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/4164583411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 0x564a4e3b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.797+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/4164583411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe01b0 0x564a4e3b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.797+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/4164583411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3b0650 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.798+0000 7f6cc4e00740 1 -- 172.21.15.7:0/4164583411 >> 172.21.15.7:0/4164583411 conn(0x564a4dffd460 msgr2=0x564a4e3ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.798+0000 7f6cc4e00740 1 -- 172.21.15.7:0/4164583411 shutdown_connections 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.798+0000 7f6cc4e00740 1 -- 172.21.15.7:0/4164583411 wait complete. 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.798+0000 7f6cc4e00740 1 -- start start 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.798+0000 7f6cc4e00740 1 Processor -- start 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.798+0000 7f6cc4e00740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe01b0 0x564a4e3c00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.798+0000 7f6cc4e00740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe8390 0x564a4e3c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cc4e00740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cc4e00740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564a4e177700 con 0x564a4e009070 2024-09-21T05:56:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cc4e00740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x564a4e2b1110 con 0x564a4dfe01b0 2024-09-21T05:56:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cc4e00740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564a4e3c3190 con 0x564a4dfe8390 2024-09-21T05:56:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cc4e00740 10 client.0 _ll_register_callbacks cb 0x564a4e2ca990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cbce29640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cbce29640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60978/0 (socket says 172.21.15.7:60978) 2024-09-21T05:56:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cbce29640 1 -- 172.21.15.7:0/1118178128 learned_addr learned my addr 172.21.15.7:0/1118178128 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cb77fe640 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe8390 0x564a4e3c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cb7fff640 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe01b0 0x564a4e3c00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cbce29640 1 -- 172.21.15.7:0/1118178128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe8390 msgr2=0x564a4e3c0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cbce29640 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe8390 0x564a4e3c0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cbce29640 1 -- 172.21.15.7:0/1118178128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe01b0 msgr2=0x564a4e3c00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cbce29640 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe01b0 0x564a4e3c00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cbce29640 1 -- 172.21.15.7:0/1118178128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a4e2dec40 con 0x564a4e009070 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cb7fff640 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe01b0 0x564a4e3c00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cbce29640 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3cc4f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0005c40 tx=0x7f6cb00044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4290fac4ee3c552d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6c977fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6c977fe640 1 -- 172.21.15.7:0/1118178128 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0028020 con 0x564a4e009070 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6c977fe640 1 -- 172.21.15.7:0/1118178128 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f6cb0004c50 con 0x564a4e009070 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.799+0000 7f6cc4e00740 1 -- 172.21.15.7:0/1118178128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cb0004050 con 0x564a4e009070 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.800+0000 7f6c977fe640 1 -- 172.21.15.7:0/1118178128 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6cb0004e50 con 0x564a4e009070 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.800+0000 7f6cc4e00740 10 client.16122 fetch_fsmap learned FSMap version 25 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.800+0000 7f6cc4e00740 1 -- 172.21.15.7:0/1118178128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564a4e3ceeb0 con 0x564a4e009070 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.800+0000 7f6c977fe640 1 -- 172.21.15.7:0/1118178128 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cb0004050 con 0x564a4e009070 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.800+0000 7f6c977fe640 1 -- 172.21.15.7:0/1118178128 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6cb00234e0 con 0x564a4e009070 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.800+0000 7f6cc4e00740 10 client.16122 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:56:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.800+0000 7f6cc4e00740 10 client.16122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.800+0000 7f6cc4e00740 20 client.16122 populate_metadata read hostname 'smithi007' 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.800+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x564a4dfc79f0 0x564a4e3d2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.800+0000 7f6cc4e00740 4 client.16122 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.800+0000 7f6cc4e00740 1 -- 172.21.15.7:0/1118178128 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a4e328da0 con 0x564a4dfc79f0 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.801+0000 7f6cb7fff640 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x564a4dfc79f0 0x564a4e3d2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.801+0000 7f6cb7fff640 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x564a4dfc79f0 0x564a4e3d2320 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=572193a4de437cab server_cookie=1faef9fab28015b5 in_seq=0 out_seq=0 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.801+0000 7f6c977fe640 10 client.16122 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6c977fe640 1 -- 172.21.15.7:0/1118178128 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a4e328da0 con 0x564a4dfc79f0 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6c977fe640 10 client.16122 handle_command_reply: tid=0 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6cc4e00740 1 client.16122 shutdown 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6cc4e00740 1 -- 172.21.15.7:0/1118178128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 msgr2=0x564a4e3cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3cc4f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0005c40 tx=0x7f6cb00044b0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6cc4e00740 1 -- 172.21.15.7:0/1118178128 shutdown_connections 2024-09-21T05:56:33.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x564a4dfc79f0 0x564a4e3d2320 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3cc4f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe8390 0x564a4e3c0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6c977fe640 0 client.16122 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/1118178128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe01b0 0x564a4e3c00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6cc4e00740 1 -- 172.21.15.7:0/1118178128 >> 172.21.15.7:0/1118178128 conn(0x564a4dffd460 msgr2=0x564a4e3acb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6cc4e00740 1 -- 172.21.15.7:0/1118178128 shutdown_connections 2024-09-21T05:56:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6cc4e00740 1 -- 172.21.15.7:0/1118178128 wait complete. 2024-09-21T05:56:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.802+0000 7f6cc4e00740 20 client.16122 trim_cache size 0 max 16384 2024-09-21T05:56:33.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.820+0000 7f6cc4e00740 1 Processor -- start 2024-09-21T05:56:33.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.820+0000 7f6cc4e00740 1 -- start start 2024-09-21T05:56:33.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.820+0000 7f6cc4e00740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4dfe01b0 0x564a4e3c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.820+0000 7f6cc4e00740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 0x564a4e3bd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.820+0000 7f6cc4e00740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4e009070 0x564a4e3bd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.820+0000 7f6cc4e00740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb81afbe0 con 0x564a4dfe01b0 2024-09-21T05:56:33.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.820+0000 7f6cc4e00740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb81ad4b0 con 0x564a4dfe8390 2024-09-21T05:56:33.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.820+0000 7f6cc4e00740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb81ab300 con 0x564a4e009070 2024-09-21T05:56:33.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6cb7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4dfe01b0 0x564a4e3c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6cb7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4dfe01b0 0x564a4e3c1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60984/0 (socket says 172.21.15.7:60984) 2024-09-21T05:56:33.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6cb7fff640 1 -- 172.21.15.7:0/1886416654 learned_addr learned my addr 172.21.15.7:0/1886416654 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:33.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6cbce29640 1 --2- 172.21.15.7:0/1886416654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4e009070 0x564a4e3bd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6cb77fe640 1 --2- 172.21.15.7:0/1886416654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 0x564a4e3bd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6cb7fff640 1 -- 172.21.15.7:0/1886416654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4e009070 msgr2=0x564a4e3bd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:33.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6cb7fff640 1 --2- 172.21.15.7:0/1886416654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4e009070 0x564a4e3bd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6cb7fff640 1 -- 172.21.15.7:0/1886416654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 msgr2=0x564a4e3bd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6cb7fff640 1 --2- 172.21.15.7:0/1886416654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 0x564a4e3bd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6cb7fff640 1 -- 172.21.15.7:0/1886416654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4e3b3480 con 0x564a4dfe01b0 2024-09-21T05:56:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6cbce29640 1 --2- 172.21.15.7:0/1886416654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4e009070 0x564a4e3bd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:56:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6cb77fe640 1 --2- 172.21.15.7:0/1886416654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 0x564a4e3bd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:56:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6cb7fff640 1 --2- 172.21.15.7:0/1886416654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4dfe01b0 0x564a4e3c1d20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x564a4e3d2860 tx=0x7f6ca8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f593418d58d7b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6c9dffb640 1 -- 172.21.15.7:0/1886416654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8004440 con 0x564a4dfe01b0 2024-09-21T05:56:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6c9dffb640 1 -- 172.21.15.7:0/1886416654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ca802b430 con 0x564a4dfe01b0 2024-09-21T05:56:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.821+0000 7f6c9dffb640 1 -- 172.21.15.7:0/1886416654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca801f430 con 0x564a4dfe01b0 2024-09-21T05:56:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.822+0000 7f6cc4e00740 1 -- 172.21.15.7:0/1886416654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4dfe01b0 msgr2=0x564a4e3c1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.822+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/1886416654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4dfe01b0 0x564a4e3c1d20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x564a4e3d2860 tx=0x7f6ca8017000 comp rx=0 tx=0).stop 2024-09-21T05:56:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.822+0000 7f6cc4e00740 1 -- 172.21.15.7:0/1886416654 shutdown_connections 2024-09-21T05:56:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.822+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/1886416654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4e009070 0x564a4e3bd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.822+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/1886416654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 0x564a4e3bd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.822+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/1886416654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4dfe01b0 0x564a4e3c1d20 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.822+0000 7f6cc4e00740 1 -- 172.21.15.7:0/1886416654 >> 172.21.15.7:0/1886416654 conn(0x564a4dffd460 msgr2=0x564a4e3c1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.822+0000 7f6cc4e00740 1 -- 172.21.15.7:0/1886416654 shutdown_connections 2024-09-21T05:56:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.822+0000 7f6cc4e00740 1 -- 172.21.15.7:0/1886416654 wait complete. 2024-09-21T05:56:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.823+0000 7f6cc4e00740 1 -- start start 2024-09-21T05:56:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.823+0000 7f6cc4e00740 1 Processor -- start 2024-09-21T05:56:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.823+0000 7f6cc4e00740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe01b0 0x564a4e3c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.823+0000 7f6cc4e00740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 0x564a4e3c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.823+0000 7f6cc4e00740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.823+0000 7f6cc4e00740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb81ab970 con 0x564a4e009070 2024-09-21T05:56:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.823+0000 7f6cc4e00740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb81acde0 con 0x564a4dfe8390 2024-09-21T05:56:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.823+0000 7f6cc4e00740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb81ac040 con 0x564a4dfe01b0 2024-09-21T05:56:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.823+0000 7f6cc4e00740 10 client.0 _ll_register_callbacks cb 0x7f6ca80097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6cbce29640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6cbce29640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60988/0 (socket says 172.21.15.7:60988) 2024-09-21T05:56:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6cb7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe01b0 0x564a4e3c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6cbce29640 1 -- 172.21.15.7:0/227879345 learned_addr learned my addr 172.21.15.7:0/227879345 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:56:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6cb77fe640 1 --2- 172.21.15.7:0/227879345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 0x564a4e3c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6cbce29640 1 -- 172.21.15.7:0/227879345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe01b0 msgr2=0x564a4e3c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6cbce29640 1 --2- 172.21.15.7:0/227879345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe01b0 0x564a4e3c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6cbce29640 1 -- 172.21.15.7:0/227879345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 msgr2=0x564a4e3c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6cbce29640 1 --2- 172.21.15.7:0/227879345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 0x564a4e3c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6cbce29640 1 -- 172.21.15.7:0/227879345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a4e43bad0 con 0x564a4e009070 2024-09-21T05:56:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6cbce29640 1 --2- 172.21.15.7:0/227879345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3c6970 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0011910 tx=0x7f6cb0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0b3b7f5ab2d65e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6c977fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:56:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6c977fe640 1 -- 172.21.15.7:0/227879345 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb003b020 con 0x564a4e009070 2024-09-21T05:56:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6c977fe640 1 -- 172.21.15.7:0/227879345 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f6cb0003d40 con 0x564a4e009070 2024-09-21T05:56:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.824+0000 7f6cc4e00740 1 -- 172.21.15.7:0/227879345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ca802b430 con 0x564a4e009070 2024-09-21T05:56:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.825+0000 7f6c977fe640 1 -- 172.21.15.7:0/227879345 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6cb0004870 con 0x564a4e009070 2024-09-21T05:56:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.825+0000 7f6cc4e00740 10 client.16128 fetch_fsmap learned FSMap version 25 2024-09-21T05:56:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.825+0000 7f6cc4e00740 1 -- 172.21.15.7:0/227879345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564a4e43cb20 con 0x564a4e009070 2024-09-21T05:56:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.825+0000 7f6c977fe640 1 -- 172.21.15.7:0/227879345 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ca802b430 con 0x564a4e009070 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.825+0000 7f6c977fe640 1 -- 172.21.15.7:0/227879345 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6cb0019430 con 0x564a4e009070 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.825+0000 7f6cc4e00740 10 client.16128 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.825+0000 7f6cc4e00740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.825+0000 7f6cc4e00740 20 client.16128 populate_metadata read hostname 'smithi007' 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.825+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/227879345 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x564a4df9cda0 0x564a4e43f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.825+0000 7f6cc4e00740 4 client.16128 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.825+0000 7f6cc4e00740 1 -- 172.21.15.7:0/227879345 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564a4e324850 con 0x564a4df9cda0 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.825+0000 7f6cb7fff640 1 --2- 172.21.15.7:0/227879345 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x564a4df9cda0 0x564a4e43f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.826+0000 7f6c977fe640 10 client.16128 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.826+0000 7f6cb7fff640 1 --2- 172.21.15.7:0/227879345 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x564a4df9cda0 0x564a4e43f360 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e6b5d0a9ba69b92 server_cookie=c6001298458c8386 in_seq=0 out_seq=0 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.826+0000 7f6c977fe640 1 -- 172.21.15.7:0/227879345 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x564a4e324850 con 0x564a4df9cda0 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.826+0000 7f6c977fe640 10 client.16128 handle_command_reply: tid=0 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.826+0000 7f6cc4e00740 1 client.16128 shutdown 2024-09-21T05:56:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cc4e00740 1 -- 172.21.15.7:0/227879345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 msgr2=0x564a4e3c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/227879345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3c6970 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0011910 tx=0x7f6cb0009ca0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cc4e00740 1 -- 172.21.15.7:0/227879345 shutdown_connections 2024-09-21T05:56:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/227879345 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x564a4df9cda0 0x564a4e43f360 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/227879345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a4e009070 0x564a4e3c6970 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/227879345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564a4dfe8390 0x564a4e3c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cc4e00740 1 --2- 172.21.15.7:0/227879345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564a4dfe01b0 0x564a4e3c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cc4e00740 1 -- 172.21.15.7:0/227879345 >> 172.21.15.7:0/227879345 conn(0x564a4dffd460 msgr2=0x564a4e3c1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6c977fe640 0 client.16128 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:56:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cc4e00740 1 -- 172.21.15.7:0/227879345 shutdown_connections 2024-09-21T05:56:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cc4e00740 1 -- 172.21.15.7:0/227879345 wait complete. 2024-09-21T05:56:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cc4e00740 20 client.16128 trim_cache size 0 max 16384 2024-09-21T05:56:33.835 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:56:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T05:56:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T05:56:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T05:56:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:56:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "549be0a1-71cf-47fc-82a9-6f66cf789bca", 2024-09-21T05:56:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T05:56:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:56:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:56:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:56:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T05:56:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T05:56:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:56:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:56:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:56:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:56:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:56:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:56:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:56:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:56:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:56:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:56:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:56:33.838 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:56:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cbe88c640 1 -- 172.21.15.7:0/379426905 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6ca00b6680 msgr2=0x7f6ca00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cbe88c640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6ca00b6680 0x7f6ca00b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x564a4e3af2d0 tx=0x7f6ca8005f90 comp rx=0 tx=0).stop 2024-09-21T05:56:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cbe88c640 1 -- 172.21.15.7:0/379426905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb81094a0 msgr2=0x7f6cb819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cbe88c640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb81094a0 0x7f6cb819aa20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6cac02a930 tx=0x7f6cac031a20 comp rx=0 tx=0).stop 2024-09-21T05:56:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.827+0000 7f6cbe88c640 1 -- 172.21.15.7:0/379426905 shutdown_connections 2024-09-21T05:56:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.828+0000 7f6cbe88c640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6ca00b6680 0x7f6ca00b8b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.828+0000 7f6cbe88c640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cb81094a0 0x7f6cb819aa20 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.828+0000 7f6cbe88c640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cb8109df0 0x7f6cb819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.828+0000 7f6cbe88c640 1 --2- 172.21.15.7:0/379426905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cb8103b60 0x7f6cb819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.828+0000 7f6cbe88c640 1 -- 172.21.15.7:0/379426905 >> 172.21.15.7:0/379426905 conn(0x7f6cb807b850 msgr2=0x7f6cb8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.828+0000 7f6cbe88c640 1 -- 172.21.15.7:0/379426905 shutdown_connections 2024-09-21T05:56:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:56:33.828+0000 7f6cbe88c640 1 -- 172.21.15.7:0/379426905 wait complete. 2024-09-21T05:56:34.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:33 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T05:56:34.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:33 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:56:34.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:33 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T05:56:34.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:33 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:56:34.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:33 smithi007 ceph-mon[30983]: pgmap v398: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:56:34.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:33 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T05:56:34.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:33 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:56:34.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:33 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T05:56:34.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:33 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:56:34.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:33 smithi027 ceph-mon[34364]: pgmap v398: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:56:34.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:33 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T05:56:34.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:33 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:56:34.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:33 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T05:56:34.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:33 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:56:34.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:33 smithi119 ceph-mon[34833]: pgmap v398: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:56:34.584 INFO:tasks.cephfs.filesystem:scrub status for tag:549be0a1-71cf-47fc-82a9-6f66cf789bca - {'path': '/', 'tag': '549be0a1-71cf-47fc-82a9-6f66cf789bca', 'options': 'recursive,force'} 2024-09-21T05:56:36.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:35 smithi027 ceph-mon[34364]: pgmap v399: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:56:36.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:35 smithi007 ceph-mon[30983]: pgmap v399: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:56:36.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:35 smithi119 ceph-mon[34833]: pgmap v399: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:56:38.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:37 smithi007 ceph-mon[30983]: pgmap v400: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T05:56:38.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:37 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T05:56:38.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:37 smithi027 ceph-mon[34364]: pgmap v400: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T05:56:38.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:37 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T05:56:38.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:37 smithi119 ceph-mon[34833]: pgmap v400: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T05:56:38.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:37 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T05:56:40.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:39 smithi027 ceph-mon[34364]: pgmap v401: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:56:40.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:39 smithi007 ceph-mon[30983]: pgmap v401: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:56:40.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:39 smithi119 ceph-mon[34833]: pgmap v401: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:56:42.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:41 smithi027 ceph-mon[34364]: pgmap v402: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:56:42.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:41 smithi007 ceph-mon[30983]: pgmap v402: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:56:42.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:41 smithi119 ceph-mon[34833]: pgmap v402: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:56:44.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:43 smithi027 ceph-mon[34364]: pgmap v403: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T05:56:44.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:43 smithi007 ceph-mon[30983]: pgmap v403: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T05:56:44.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:43 smithi119 ceph-mon[34833]: pgmap v403: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T05:56:46.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:45 smithi027 ceph-mon[34364]: pgmap v404: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T05:56:46.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:45 smithi007 ceph-mon[30983]: pgmap v404: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T05:56:46.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:45 smithi119 ceph-mon[34833]: pgmap v404: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T05:56:48.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:47 smithi027 ceph-mon[34364]: pgmap v405: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T05:56:48.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:47 smithi007 ceph-mon[30983]: pgmap v405: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T05:56:48.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:47 smithi119 ceph-mon[34833]: pgmap v405: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T05:56:50.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:49 smithi027 ceph-mon[34364]: pgmap v406: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:56:50.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:49 smithi007 ceph-mon[30983]: pgmap v406: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:56:50.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:49 smithi119 ceph-mon[34833]: pgmap v406: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:56:52.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:51 smithi027 ceph-mon[34364]: pgmap v407: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:56:52.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:51 smithi007 ceph-mon[30983]: pgmap v407: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:56:52.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:51 smithi119 ceph-mon[34833]: pgmap v407: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:56:54.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:53 smithi027 ceph-mon[34364]: pgmap v408: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:56:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:53 smithi007 ceph-mon[30983]: pgmap v408: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:56:54.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:53 smithi119 ceph-mon[34833]: pgmap v408: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:56:56.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:55 smithi027 ceph-mon[34364]: pgmap v409: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:56:56.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:55 smithi007 ceph-mon[30983]: pgmap v409: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:56:56.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:55 smithi119 ceph-mon[34833]: pgmap v409: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:56:58.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:57 smithi027 ceph-mon[34364]: pgmap v410: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:56:58.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:57 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:56:58.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:57 smithi007 ceph-mon[30983]: pgmap v410: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:56:58.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:56:58.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:57 smithi119 ceph-mon[34833]: pgmap v410: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:56:58.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:57 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:56:59.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:56:59.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:56:59.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:56:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:56:59.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:56:59.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:56:59.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:56:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:56:59.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:56:59.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:56:59.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:56:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:57:00.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:00 smithi007 ceph-mon[30983]: pgmap v411: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:57:00.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:00 smithi119 ceph-mon[34833]: pgmap v411: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:57:00.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:00 smithi027 ceph-mon[34364]: pgmap v411: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:57:01.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:01 smithi027 ceph-mon[34364]: pgmap v412: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:57:01.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:01 smithi007 ceph-mon[30983]: pgmap v412: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:57:01.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:01 smithi119 ceph-mon[34833]: pgmap v412: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:57:03.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:03 smithi027 ceph-mon[34364]: pgmap v413: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:57:04.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:03 smithi007 ceph-mon[30983]: pgmap v413: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:57:04.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:03 smithi119 ceph-mon[34833]: pgmap v413: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:57:04.584 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:57:04.861 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:05.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.376+0000 7f16b81bc640 1 -- 172.21.15.7:0/1773424944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b0108d20 msgr2=0x7f16b010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:05.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.376+0000 7f16b81bc640 1 --2- 172.21.15.7:0/1773424944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b0108d20 0x7f16b010f550 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009ca0 tx=0x7f16a802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.376+0000 7f16b81bc640 1 -- 172.21.15.7:0/1773424944 shutdown_connections 2024-09-21T05:57:05.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.376+0000 7f16b81bc640 1 --2- 172.21.15.7:0/1773424944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b0108d20 0x7f16b010f550 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.376+0000 7f16b81bc640 1 --2- 172.21.15.7:0/1773424944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16b01083d0 0x7f16b01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.376+0000 7f16b81bc640 1 --2- 172.21.15.7:0/1773424944 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16b0102ae0 0x7f16b0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.376+0000 7f16b81bc640 1 -- 172.21.15.7:0/1773424944 >> 172.21.15.7:0/1773424944 conn(0x7f16b0079760 msgr2=0x7f16b0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:05.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.376+0000 7f16b81bc640 1 -- 172.21.15.7:0/1773424944 shutdown_connections 2024-09-21T05:57:05.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.376+0000 7f16b81bc640 1 -- 172.21.15.7:0/1773424944 wait complete. 2024-09-21T05:57:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.376+0000 7f16b81bc640 1 Processor -- start 2024-09-21T05:57:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.377+0000 7f16b81bc640 1 -- start start 2024-09-21T05:57:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.377+0000 7f16b81bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16b0102ae0 0x7f16b019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.377+0000 7f16b81bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b01083d0 0x7f16b019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.377+0000 7f16b81bc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16b0108d20 0x7f16b019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.377+0000 7f16b81bc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16b0112990 con 0x7f16b01083d0 2024-09-21T05:57:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.377+0000 7f16b81bc640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f16b0112810 con 0x7f16b0108d20 2024-09-21T05:57:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.377+0000 7f16b81bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f16b0112b10 con 0x7f16b0102ae0 2024-09-21T05:57:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.377+0000 7f16b5757640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b01083d0 0x7f16b019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.377+0000 7f16b5757640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b01083d0 0x7f16b019a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33288/0 (socket says 172.21.15.7:33288) 2024-09-21T05:57:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.377+0000 7f16b5757640 1 -- 172.21.15.7:0/1859181662 learned_addr learned my addr 172.21.15.7:0/1859181662 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.377+0000 7f16b6759640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16b0108d20 0x7f16b019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.377+0000 7f16b5f58640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16b0102ae0 0x7f16b019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.378+0000 7f16b5757640 1 -- 172.21.15.7:0/1859181662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16b0102ae0 msgr2=0x7f16b019a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.378+0000 7f16b5757640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16b0102ae0 0x7f16b019a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.378+0000 7f16b5757640 1 -- 172.21.15.7:0/1859181662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16b0108d20 msgr2=0x7f16b019fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.378+0000 7f16b5757640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16b0108d20 0x7f16b019fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.378+0000 7f16b5757640 1 -- 172.21.15.7:0/1859181662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b01a03a0 con 0x7f16b01083d0 2024-09-21T05:57:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.378+0000 7f16b6759640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16b0108d20 0x7f16b019fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.378+0000 7f16b5757640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b01083d0 0x7f16b019a9d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f16a000c970 tx=0x7f16a000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.378+0000 7f16a6ffd640 1 -- 172.21.15.7:0/1859181662 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0007bb0 con 0x7f16b01083d0 2024-09-21T05:57:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.378+0000 7f16a6ffd640 1 -- 172.21.15.7:0/1859181662 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16a0007d50 con 0x7f16b01083d0 2024-09-21T05:57:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.378+0000 7f16a6ffd640 1 -- 172.21.15.7:0/1859181662 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0018730 con 0x7f16b01083d0 2024-09-21T05:57:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.378+0000 7f16b81bc640 1 -- 172.21.15.7:0/1859181662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b01a0690 con 0x7f16b01083d0 2024-09-21T05:57:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.378+0000 7f16b81bc640 1 -- 172.21.15.7:0/1859181662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b01a6df0 con 0x7f16b01083d0 2024-09-21T05:57:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.381+0000 7f16a6ffd640 1 -- 172.21.15.7:0/1859181662 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f16a000f990 con 0x7f16b01083d0 2024-09-21T05:57:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.381+0000 7f16be730740 1 Processor -- start 2024-09-21T05:57:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.381+0000 7f16be730740 1 -- start start 2024-09-21T05:57:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.381+0000 7f16be730740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d10f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.381+0000 7f16be730740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 0x55b52d10fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.381+0000 7f16be730740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d1100d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.381+0000 7f16be730740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b52d085e50 con 0x55b52cd47390 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.381+0000 7f16be730740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b52d075280 con 0x55b52cd68070 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.381+0000 7f16be730740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b52d079090 con 0x55b52cd3f1b0 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16b5757640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d1100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16b5757640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d1100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33298/0 (socket says 172.21.15.7:33298) 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16b5757640 1 -- 172.21.15.7:0/3775865446 learned_addr learned my addr 172.21.15.7:0/3775865446 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16b5f58640 1 --2- 172.21.15.7:0/3775865446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 0x55b52d10fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16b6759640 1 --2- 172.21.15.7:0/3775865446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d10f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16b5757640 1 -- 172.21.15.7:0/3775865446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 msgr2=0x55b52d10fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16b5757640 1 --2- 172.21.15.7:0/3775865446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 0x55b52d10fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16b5757640 1 -- 172.21.15.7:0/3775865446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 msgr2=0x55b52d10f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16b5757640 1 --2- 172.21.15.7:0/3775865446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d10f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16b5757640 1 -- 172.21.15.7:0/3775865446 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b52cdd3650 con 0x55b52cd47390 2024-09-21T05:57:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16a6ffd640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f169c0b6700 0x7f169c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16b5757640 1 --2- 172.21.15.7:0/3775865446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d1100d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f16a00e4e40 tx=0x7f16a00ef690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563222d712537629 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16b6759640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f169c0b6700 0x7f169c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.382+0000 7f16a6ffd640 1 -- 172.21.15.7:0/1859181662 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f16a00e7700 con 0x7f16b01083d0 2024-09-21T05:57:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.383+0000 7f169bfff640 1 -- 172.21.15.7:0/3775865446 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a00a9c20 con 0x55b52cd47390 2024-09-21T05:57:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.383+0000 7f169bfff640 1 -- 172.21.15.7:0/3775865446 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16a00ad0e0 con 0x55b52cd47390 2024-09-21T05:57:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.383+0000 7f169bfff640 1 -- 172.21.15.7:0/3775865446 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a00acd40 con 0x55b52cd47390 2024-09-21T05:57:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.383+0000 7f16be730740 1 -- 172.21.15.7:0/3775865446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 msgr2=0x55b52d1100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.383+0000 7f16be730740 1 --2- 172.21.15.7:0/3775865446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d1100d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f16a00e4e40 tx=0x7f16a00ef690 comp rx=0 tx=0).stop 2024-09-21T05:57:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.383+0000 7f16b6759640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f169c0b6700 0x7f169c0b8c10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f16a8005cc0 tx=0x7f16a8005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.384+0000 7f16be730740 1 -- 172.21.15.7:0/3775865446 shutdown_connections 2024-09-21T05:57:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.384+0000 7f16be730740 1 --2- 172.21.15.7:0/3775865446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d1100d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.384+0000 7f16be730740 1 --2- 172.21.15.7:0/3775865446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 0x55b52d10fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.384+0000 7f16be730740 1 --2- 172.21.15.7:0/3775865446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d10f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.384+0000 7f16be730740 1 -- 172.21.15.7:0/3775865446 >> 172.21.15.7:0/3775865446 conn(0x55b52cd5c460 msgr2=0x55b52d10d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.384+0000 7f16be730740 1 -- 172.21.15.7:0/3775865446 shutdown_connections 2024-09-21T05:57:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.384+0000 7f16be730740 1 -- 172.21.15.7:0/3775865446 wait complete. 2024-09-21T05:57:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.384+0000 7f16be730740 1 -- start start 2024-09-21T05:57:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.384+0000 7f16be730740 1 Processor -- start 2024-09-21T05:57:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16be730740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 0x55b52d11ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16be730740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d11b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16be730740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d127120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16be730740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b52ced6700 con 0x55b52cd47390 2024-09-21T05:57:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16be730740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b52d010110 con 0x55b52cd68070 2024-09-21T05:57:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16be730740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b52d11de30 con 0x55b52cd3f1b0 2024-09-21T05:57:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16be730740 10 client.0 _ll_register_callbacks cb 0x55b52d029990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16b5757640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d11b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16b5757640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d11b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33314/0 (socket says 172.21.15.7:33314) 2024-09-21T05:57:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16b5757640 1 -- 172.21.15.7:0/3389296763 learned_addr learned my addr 172.21.15.7:0/3389296763 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16b5f58640 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 0x55b52d11ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16b6759640 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d127120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16b5757640 1 -- 172.21.15.7:0/3389296763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 msgr2=0x55b52d11ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16b5757640 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 0x55b52d11ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16b5757640 1 -- 172.21.15.7:0/3389296763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 msgr2=0x55b52d127120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16b5757640 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d127120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16b5757640 1 -- 172.21.15.7:0/3389296763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b52d03dc40 con 0x55b52cd47390 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16b6759640 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d127120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16b5757640 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d11b260 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f16a00058c0 tx=0x7f16a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5599202299b64fdf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.385+0000 7f16997fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16997fa640 1 -- 172.21.15.7:0/3389296763 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a00acf20 con 0x55b52cd47390 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16997fa640 1 -- 172.21.15.7:0/3389296763 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f16a00b6d60 con 0x55b52cd47390 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16be730740 1 -- 172.21.15.7:0/3389296763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16a00ad0e0 con 0x55b52cd47390 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16997fa640 1 -- 172.21.15.7:0/3389296763 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f16a00ad3a0 con 0x55b52cd47390 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16be730740 10 client.16140 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16be730740 1 -- 172.21.15.7:0/3389296763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b52d129b50 con 0x55b52cd47390 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16997fa640 1 -- 172.21.15.7:0/3389296763 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16a00ad0e0 con 0x55b52cd47390 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16997fa640 1 -- 172.21.15.7:0/3389296763 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f16a0020030 con 0x55b52cd47390 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16be730740 10 client.16140 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16be730740 10 client.16140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:05.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16be730740 20 client.16140 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:05.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16be730740 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b52cd269f0 0x55b52d12ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16be730740 4 client.16140 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:57:05.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.386+0000 7f16be730740 1 -- 172.21.15.7:0/3389296763 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b52d087da0 con 0x55b52cd269f0 2024-09-21T05:57:05.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.387+0000 7f16b5f58640 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b52cd269f0 0x55b52d12ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.387+0000 7f16b5f58640 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b52cd269f0 0x55b52d12ceb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30221bfc5e2f0129 server_cookie=a66870810bc5402c in_seq=0 out_seq=0 2024-09-21T05:57:05.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.387+0000 7f16997fa640 10 client.16140 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16997fa640 1 -- 172.21.15.7:0/3389296763 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b52d087da0 con 0x55b52cd269f0 2024-09-21T05:57:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16997fa640 10 client.16140 handle_command_reply: tid=0 2024-09-21T05:57:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16be730740 1 client.16140 shutdown 2024-09-21T05:57:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16be730740 1 -- 172.21.15.7:0/3389296763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 msgr2=0x55b52d11b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16be730740 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d11b260 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f16a00058c0 tx=0x7f16a00046c0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16be730740 1 -- 172.21.15.7:0/3389296763 shutdown_connections 2024-09-21T05:57:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16be730740 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b52cd269f0 0x55b52d12ceb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16be730740 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d11b260 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16be730740 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d127120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16be730740 1 --2- 172.21.15.7:0/3389296763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 0x55b52d11ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16997fa640 0 client.16140 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16be730740 1 -- 172.21.15.7:0/3389296763 >> 172.21.15.7:0/3389296763 conn(0x55b52cd5c460 msgr2=0x55b52d112830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16be730740 1 -- 172.21.15.7:0/3389296763 shutdown_connections 2024-09-21T05:57:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16be730740 1 -- 172.21.15.7:0/3389296763 wait complete. 2024-09-21T05:57:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.388+0000 7f16be730740 20 client.16140 trim_cache size 0 max 16384 2024-09-21T05:57:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.406+0000 7f16be730740 1 Processor -- start 2024-09-21T05:57:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.406+0000 7f16be730740 1 -- start start 2024-09-21T05:57:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.406+0000 7f16be730740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 0x55b52d112e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.406+0000 7f16be730740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d127090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.406+0000 7f16be730740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d10cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.406+0000 7f16be730740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01b1dd0 con 0x55b52cd47390 2024-09-21T05:57:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.406+0000 7f16be730740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01af6a0 con 0x55b52cd68070 2024-09-21T05:57:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.406+0000 7f16be730740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01ad4f0 con 0x55b52cd3f1b0 2024-09-21T05:57:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.406+0000 7f16b5757640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d127090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.406+0000 7f16b5757640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d127090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33322/0 (socket says 172.21.15.7:33322) 2024-09-21T05:57:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.406+0000 7f16b5757640 1 -- 172.21.15.7:0/712880654 learned_addr learned my addr 172.21.15.7:0/712880654 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.407+0000 7f16b5757640 1 -- 172.21.15.7:0/712880654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 msgr2=0x55b52d112e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.407+0000 7f16b6759640 1 --2- 172.21.15.7:0/712880654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d10cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.407+0000 7f16b5f58640 1 --2- 172.21.15.7:0/712880654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 0x55b52d112e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.407+0000 7f16b5757640 1 --2- 172.21.15.7:0/712880654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 0x55b52d112e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.407+0000 7f16b5757640 1 -- 172.21.15.7:0/712880654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 msgr2=0x55b52d10cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.407+0000 7f16b5757640 1 --2- 172.21.15.7:0/712880654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d10cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.407+0000 7f16b5757640 1 -- 172.21.15.7:0/712880654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b52d111940 con 0x55b52cd47390 2024-09-21T05:57:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.407+0000 7f16b6759640 1 --2- 172.21.15.7:0/712880654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d10cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:57:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.407+0000 7f16b5757640 1 --2- 172.21.15.7:0/712880654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d127090 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f16a00a9ba0 tx=0x7f16a000fd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd1b8eb50435a2f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.407+0000 7f169b7fe640 1 -- 172.21.15.7:0/712880654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a00a9470 con 0x55b52cd47390 2024-09-21T05:57:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.407+0000 7f169b7fe640 1 -- 172.21.15.7:0/712880654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16a00b6940 con 0x55b52cd47390 2024-09-21T05:57:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.407+0000 7f169b7fe640 1 -- 172.21.15.7:0/712880654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a00a9c20 con 0x55b52cd47390 2024-09-21T05:57:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.408+0000 7f16be730740 1 -- 172.21.15.7:0/712880654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 msgr2=0x55b52d127090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.408+0000 7f16be730740 1 --2- 172.21.15.7:0/712880654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d127090 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f16a00a9ba0 tx=0x7f16a000fd30 comp rx=0 tx=0).stop 2024-09-21T05:57:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.408+0000 7f16be730740 1 -- 172.21.15.7:0/712880654 shutdown_connections 2024-09-21T05:57:05.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.408+0000 7f16be730740 1 --2- 172.21.15.7:0/712880654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d127090 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.408+0000 7f16be730740 1 --2- 172.21.15.7:0/712880654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd68070 0x55b52d10cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.408+0000 7f16be730740 1 --2- 172.21.15.7:0/712880654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd3f1b0 0x55b52d112e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.408+0000 7f16be730740 1 -- 172.21.15.7:0/712880654 >> 172.21.15.7:0/712880654 conn(0x55b52cd5c460 msgr2=0x55b52d112750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.408+0000 7f16be730740 1 -- 172.21.15.7:0/712880654 shutdown_connections 2024-09-21T05:57:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.408+0000 7f16be730740 1 -- 172.21.15.7:0/712880654 wait complete. 2024-09-21T05:57:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.408+0000 7f16be730740 1 -- start start 2024-09-21T05:57:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.408+0000 7f16be730740 1 Processor -- start 2024-09-21T05:57:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16be730740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd3f1b0 0x55b52d12df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16be730740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d12e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16be730740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd68070 0x55b52d12e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16be730740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01adb60 con 0x55b52cd47390 2024-09-21T05:57:05.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16be730740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01aefd0 con 0x55b52cd3f1b0 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16be730740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01ae230 con 0x55b52cd68070 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16be730740 10 client.0 _ll_register_callbacks cb 0x7f16a8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16b5757640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d12e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16b5757640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d12e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33332/0 (socket says 172.21.15.7:33332) 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16b5757640 1 -- 172.21.15.7:0/4119294922 learned_addr learned my addr 172.21.15.7:0/4119294922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16b5f58640 1 --2- 172.21.15.7:0/4119294922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd3f1b0 0x55b52d12df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16b6759640 1 --2- 172.21.15.7:0/4119294922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd68070 0x55b52d12e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16b5757640 1 -- 172.21.15.7:0/4119294922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd68070 msgr2=0x55b52d12e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16b5757640 1 --2- 172.21.15.7:0/4119294922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd68070 0x55b52d12e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16b5757640 1 -- 172.21.15.7:0/4119294922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd3f1b0 msgr2=0x55b52d12df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16b5757640 1 --2- 172.21.15.7:0/4119294922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd3f1b0 0x55b52d12df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.409+0000 7f16b5757640 1 -- 172.21.15.7:0/4119294922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b52d196660 con 0x55b52cd47390 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16b5757640 1 --2- 172.21.15.7:0/4119294922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d12e450 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f16a000c940 tx=0x7f16a00edf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4092ef2bdb0b11b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:05.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16997fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16997fa640 1 -- 172.21.15.7:0/4119294922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a00c8060 con 0x55b52cd47390 2024-09-21T05:57:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16997fa640 1 -- 172.21.15.7:0/4119294922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f16a00b6d70 con 0x55b52cd47390 2024-09-21T05:57:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16be730740 1 -- 172.21.15.7:0/4119294922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16a00b6940 con 0x55b52cd47390 2024-09-21T05:57:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16997fa640 1 -- 172.21.15.7:0/4119294922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f16a00a9c20 con 0x55b52cd47390 2024-09-21T05:57:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16be730740 10 client.16146 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16be730740 1 -- 172.21.15.7:0/4119294922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b52d196660 con 0x55b52cd47390 2024-09-21T05:57:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16997fa640 1 -- 172.21.15.7:0/4119294922 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16a00b6940 con 0x55b52cd47390 2024-09-21T05:57:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16997fa640 1 -- 172.21.15.7:0/4119294922 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f16a00a8f20 con 0x55b52cd47390 2024-09-21T05:57:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16be730740 10 client.16146 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16be730740 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16be730740 20 client.16146 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16be730740 1 --2- 172.21.15.7:0/4119294922 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b52ccfbda0 0x55b52d199c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16be730740 4 client.16146 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.410+0000 7f16be730740 1 -- 172.21.15.7:0/4119294922 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b52d083850 con 0x55b52ccfbda0 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.411+0000 7f16b5f58640 1 --2- 172.21.15.7:0/4119294922 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b52ccfbda0 0x55b52d199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.411+0000 7f16997fa640 10 client.16146 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.411+0000 7f16b5f58640 1 --2- 172.21.15.7:0/4119294922 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b52ccfbda0 0x55b52d199c30 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92f6c705432fba62 server_cookie=6f0db28c1c55bfa in_seq=0 out_seq=0 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.411+0000 7f16997fa640 1 -- 172.21.15.7:0/4119294922 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x55b52d083850 con 0x55b52ccfbda0 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.411+0000 7f16997fa640 10 client.16146 handle_command_reply: tid=0 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.411+0000 7f16be730740 1 client.16146 shutdown 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.412+0000 7f16be730740 1 -- 172.21.15.7:0/4119294922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 msgr2=0x55b52d12e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.412+0000 7f16be730740 1 --2- 172.21.15.7:0/4119294922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d12e450 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f16a000c940 tx=0x7f16a00edf50 comp rx=0 tx=0).stop 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.412+0000 7f16be730740 1 -- 172.21.15.7:0/4119294922 shutdown_connections 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.412+0000 7f16be730740 1 --2- 172.21.15.7:0/4119294922 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b52ccfbda0 0x55b52d199c30 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.412+0000 7f16be730740 1 --2- 172.21.15.7:0/4119294922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b52cd47390 0x55b52d12e450 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.412+0000 7f16be730740 1 --2- 172.21.15.7:0/4119294922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b52cd68070 0x55b52d12e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.412+0000 7f16be730740 1 --2- 172.21.15.7:0/4119294922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b52cd3f1b0 0x55b52d12df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.412+0000 7f16997fa640 0 client.16146 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.412+0000 7f16be730740 1 -- 172.21.15.7:0/4119294922 >> 172.21.15.7:0/4119294922 conn(0x55b52cd5c460 msgr2=0x55b52d10cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.412+0000 7f16be730740 1 -- 172.21.15.7:0/4119294922 shutdown_connections 2024-09-21T05:57:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.412+0000 7f16be730740 1 -- 172.21.15.7:0/4119294922 wait complete. 2024-09-21T05:57:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.412+0000 7f16be730740 20 client.16146 trim_cache size 0 max 16384 2024-09-21T05:57:05.420 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:57:05.420 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T05:57:05.420 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T05:57:05.420 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:05.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:05.422 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:57:05.422 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:57:05.422 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:05.422 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:05.422 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:05.422 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:05.422 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:05.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:05.422 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:05.423 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:05.424 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:57:05.424 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:57:05.424 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:57:05.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.413+0000 7f16b81bc640 1 -- 172.21.15.7:0/1859181662 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f169c0b6700 msgr2=0x7f169c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:05.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.413+0000 7f16b81bc640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f169c0b6700 0x7f169c0b8c10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f16a8005cc0 tx=0x7f16a8005c30 comp rx=0 tx=0).stop 2024-09-21T05:57:05.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.413+0000 7f16b81bc640 1 -- 172.21.15.7:0/1859181662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b01083d0 msgr2=0x7f16b019a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:05.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.413+0000 7f16b81bc640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b01083d0 0x7f16b019a9d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f16a000c970 tx=0x7f16a000ce30 comp rx=0 tx=0).stop 2024-09-21T05:57:05.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.413+0000 7f16b81bc640 1 -- 172.21.15.7:0/1859181662 shutdown_connections 2024-09-21T05:57:05.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.413+0000 7f16b81bc640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f169c0b6700 0x7f169c0b8c10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.413+0000 7f16b81bc640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b01083d0 0x7f16b019a9d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.413+0000 7f16b81bc640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16b0108d20 0x7f16b019fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.413+0000 7f16b81bc640 1 --2- 172.21.15.7:0/1859181662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16b0102ae0 0x7f16b019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:05.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.413+0000 7f16b81bc640 1 -- 172.21.15.7:0/1859181662 >> 172.21.15.7:0/1859181662 conn(0x7f16b0079760 msgr2=0x7f16b006be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:05.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.413+0000 7f16b81bc640 1 -- 172.21.15.7:0/1859181662 shutdown_connections 2024-09-21T05:57:05.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:05.413+0000 7f16b81bc640 1 -- 172.21.15.7:0/1859181662 wait complete. 2024-09-21T05:57:05.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:05 smithi027 ceph-mon[34364]: pgmap v414: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T05:57:06.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:05 smithi007 ceph-mon[30983]: pgmap v414: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T05:57:06.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:05 smithi119 ceph-mon[34833]: pgmap v414: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T05:57:06.263 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T05:57:06.263 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:57:06.526 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:07.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.024+0000 7fe8183c0640 1 -- 172.21.15.7:0/37371457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810108cf0 msgr2=0x7fe81010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:07.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.024+0000 7fe8183c0640 1 --2- 172.21.15.7:0/37371457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810108cf0 0x7fe81010f520 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe808009ca0 tx=0x7fe80802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:57:07.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.024+0000 7fe8183c0640 1 -- 172.21.15.7:0/37371457 shutdown_connections 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.024+0000 7fe8183c0640 1 --2- 172.21.15.7:0/37371457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810108cf0 0x7fe81010f520 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.024+0000 7fe8183c0640 1 --2- 172.21.15.7:0/37371457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8101083a0 0x7fe8101087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.024+0000 7fe8183c0640 1 --2- 172.21.15.7:0/37371457 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe810102a60 0x7fe810102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.024+0000 7fe8183c0640 1 -- 172.21.15.7:0/37371457 >> 172.21.15.7:0/37371457 conn(0x7fe810079730 msgr2=0x7fe810079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.024+0000 7fe8183c0640 1 -- 172.21.15.7:0/37371457 shutdown_connections 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.024+0000 7fe8183c0640 1 -- 172.21.15.7:0/37371457 wait complete. 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.025+0000 7fe8183c0640 1 Processor -- start 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.025+0000 7fe8183c0640 1 -- start start 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.025+0000 7fe8183c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810102a60 0x7fe81019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.025+0000 7fe8183c0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8101083a0 0x7fe81019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.025+0000 7fe8183c0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe810108cf0 0x7fe81019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.025+0000 7fe8183c0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe810112960 con 0x7fe810102a60 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.025+0000 7fe8183c0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe8101127e0 con 0x7fe810108cf0 2024-09-21T05:57:07.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.025+0000 7fe8183c0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe810112ae0 con 0x7fe8101083a0 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.025+0000 7fe81615c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810102a60 0x7fe81019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.025+0000 7fe81615c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810102a60 0x7fe81019a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33342/0 (socket says 172.21.15.7:33342) 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.025+0000 7fe81615c640 1 -- 172.21.15.7:0/2210525649 learned_addr learned my addr 172.21.15.7:0/2210525649 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe81695d640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe810108cf0 0x7fe81019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe81595b640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8101083a0 0x7fe81019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe81615c640 1 -- 172.21.15.7:0/2210525649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8101083a0 msgr2=0x7fe81019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe81615c640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8101083a0 0x7fe81019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe81615c640 1 -- 172.21.15.7:0/2210525649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe810108cf0 msgr2=0x7fe81019fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe81615c640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe810108cf0 0x7fe81019fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe81615c640 1 -- 172.21.15.7:0/2210525649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8101a03d0 con 0x7fe810102a60 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe81595b640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8101083a0 0x7fe81019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe81615c640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810102a60 0x7fe81019a460 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00d950 tx=0x7fe80c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe8077fe640 1 -- 172.21.15.7:0/2210525649 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c017070 con 0x7fe810102a60 2024-09-21T05:57:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe8077fe640 1 -- 172.21.15.7:0/2210525649 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe80c009c30 con 0x7fe810102a60 2024-09-21T05:57:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe8183c0640 1 -- 172.21.15.7:0/2210525649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8101a06c0 con 0x7fe810102a60 2024-09-21T05:57:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe8077fe640 1 -- 172.21.15.7:0/2210525649 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c00f620 con 0x7fe810102a60 2024-09-21T05:57:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.026+0000 7fe8183c0640 1 -- 172.21.15.7:0/2210525649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8101a6e20 con 0x7fe810102a60 2024-09-21T05:57:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.028+0000 7fe8183c0640 1 -- 172.21.15.7:0/2210525649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe810102e70 con 0x7fe810102a60 2024-09-21T05:57:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.029+0000 7fe8077fe640 1 -- 172.21.15.7:0/2210525649 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe80c005030 con 0x7fe810102a60 2024-09-21T05:57:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.030+0000 7fe8077fe640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe7fc0b6680 0x7fe7fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.030+0000 7fe81595b640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe7fc0b6680 0x7fe7fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.030+0000 7fe8077fe640 1 -- 172.21.15.7:0/2210525649 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fe80c0e72a0 con 0x7fe810102a60 2024-09-21T05:57:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.031+0000 7fe81595b640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe7fc0b6680 0x7fe7fc0b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe800005fd0 tx=0x7fe800005ea0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:07.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.033+0000 7fe8077fe640 1 -- 172.21.15.7:0/2210525649 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe80c0ad870 con 0x7fe810102a60 2024-09-21T05:57:07.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.257+0000 7fe8183c0640 1 -- 172.21.15.7:0/2210525649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe81019b590 con 0x7fe810102a60 2024-09-21T05:57:07.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.258+0000 7fe8077fe640 1 -- 172.21.15.7:0/2210525649 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7fe81019b590 con 0x7fe810102a60 2024-09-21T05:57:07.260 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:57:07.260 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:57:07.260 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:57:07.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.260+0000 7fe8183c0640 1 -- 172.21.15.7:0/2210525649 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe7fc0b6680 msgr2=0x7fe7fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:07.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.260+0000 7fe8183c0640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe7fc0b6680 0x7fe7fc0b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe800005fd0 tx=0x7fe800005ea0 comp rx=0 tx=0).stop 2024-09-21T05:57:07.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.260+0000 7fe8183c0640 1 -- 172.21.15.7:0/2210525649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810102a60 msgr2=0x7fe81019a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:07.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.260+0000 7fe8183c0640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810102a60 0x7fe81019a460 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00d950 tx=0x7fe80c00de10 comp rx=0 tx=0).stop 2024-09-21T05:57:07.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.261+0000 7fe8183c0640 1 -- 172.21.15.7:0/2210525649 shutdown_connections 2024-09-21T05:57:07.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.261+0000 7fe8183c0640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe7fc0b6680 0x7fe7fc0b8b90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:07.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.261+0000 7fe8183c0640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe810108cf0 0x7fe81019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:07.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.261+0000 7fe8183c0640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8101083a0 0x7fe81019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:07.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.261+0000 7fe8183c0640 1 --2- 172.21.15.7:0/2210525649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810102a60 0x7fe81019a460 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:07.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.261+0000 7fe8183c0640 1 -- 172.21.15.7:0/2210525649 >> 172.21.15.7:0/2210525649 conn(0x7fe810079730 msgr2=0x7fe8101019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:07.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.261+0000 7fe8183c0640 1 -- 172.21.15.7:0/2210525649 shutdown_connections 2024-09-21T05:57:07.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:07.261+0000 7fe8183c0640 1 -- 172.21.15.7:0/2210525649 wait complete. 2024-09-21T05:57:07.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:07 smithi007 ceph-mon[30983]: pgmap v415: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T05:57:07.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:07 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2210525649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:57:07.920 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T05:57:07.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:07 smithi027 ceph-mon[34364]: pgmap v415: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T05:57:07.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:07 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2210525649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:57:08.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:07 smithi119 ceph-mon[34833]: pgmap v415: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T05:57:08.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:07 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2210525649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:57:08.181 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.669+0000 7fd0044e4640 1 -- 172.21.15.7:0/2149917093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcffc1025f0 msgr2=0x7fcffc102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.669+0000 7fd0044e4640 1 --2- 172.21.15.7:0/2149917093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcffc1025f0 0x7fcffc102a00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009ca0 tx=0x7fcfec02a950 comp rx=0 tx=0).stop 2024-09-21T05:57:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.669+0000 7fd0044e4640 1 -- 172.21.15.7:0/2149917093 shutdown_connections 2024-09-21T05:57:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.669+0000 7fd0044e4640 1 --2- 172.21.15.7:0/2149917093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcffc1101a0 0x7fcffc1125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.669+0000 7fd0044e4640 1 --2- 172.21.15.7:0/2149917093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcffc102f40 0x7fcffc10fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.669+0000 7fd0044e4640 1 --2- 172.21.15.7:0/2149917093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcffc1025f0 0x7fcffc102a00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.669+0000 7fd0044e4640 1 -- 172.21.15.7:0/2149917093 >> 172.21.15.7:0/2149917093 conn(0x7fcffc079740 msgr2=0x7fcffc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.669+0000 7fd0044e4640 1 -- 172.21.15.7:0/2149917093 shutdown_connections 2024-09-21T05:57:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.669+0000 7fd0044e4640 1 -- 172.21.15.7:0/2149917093 wait complete. 2024-09-21T05:57:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.670+0000 7fd0044e4640 1 Processor -- start 2024-09-21T05:57:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.670+0000 7fd0044e4640 1 -- start start 2024-09-21T05:57:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.670+0000 7fd0044e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcffc1025f0 0x7fcffc19c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.670+0000 7fd0044e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcffc102f40 0x7fcffc19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.670+0000 7fd0044e4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcffc1101a0 0x7fcffc1a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.670+0000 7fd0044e4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc115cb0 con 0x7fcffc1101a0 2024-09-21T05:57:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.670+0000 7fd0044e4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc115b30 con 0x7fcffc1025f0 2024-09-21T05:57:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.670+0000 7fd0044e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc115e30 con 0x7fcffc102f40 2024-09-21T05:57:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.670+0000 7fd002a81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcffc1101a0 0x7fcffc1a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.670+0000 7fd002a81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcffc1101a0 0x7fcffc1a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49712/0 (socket says 172.21.15.7:49712) 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.670+0000 7fd002a81640 1 -- 172.21.15.7:0/2657032610 learned_addr learned my addr 172.21.15.7:0/2657032610 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.670+0000 7fd002280640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcffc1025f0 0x7fcffc19c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.671+0000 7fd001a7f640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcffc102f40 0x7fcffc19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.671+0000 7fd002a81640 1 -- 172.21.15.7:0/2657032610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcffc102f40 msgr2=0x7fcffc19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.671+0000 7fd002a81640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcffc102f40 0x7fcffc19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.671+0000 7fd002a81640 1 -- 172.21.15.7:0/2657032610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcffc1025f0 msgr2=0x7fcffc19c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.671+0000 7fd002a81640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcffc1025f0 0x7fcffc19c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.671+0000 7fd002a81640 1 -- 172.21.15.7:0/2657032610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc1a2630 con 0x7fcffc1101a0 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.671+0000 7fd002a81640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcffc1101a0 0x7fcffc1a1f00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fcff400e970 tx=0x7fcff400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.671+0000 7fcffb7fe640 1 -- 172.21.15.7:0/2657032610 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff400ccc0 con 0x7fcffc1101a0 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.671+0000 7fcffb7fe640 1 -- 172.21.15.7:0/2657032610 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcff400ce60 con 0x7fcffc1101a0 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.671+0000 7fd0044e4640 1 -- 172.21.15.7:0/2657032610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcffc1a2920 con 0x7fcffc1101a0 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.671+0000 7fcffb7fe640 1 -- 172.21.15.7:0/2657032610 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4010430 con 0x7fcffc1101a0 2024-09-21T05:57:08.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.671+0000 7fd0044e4640 1 -- 172.21.15.7:0/2657032610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcffc1a9080 con 0x7fcffc1101a0 2024-09-21T05:57:08.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.674+0000 7fd00aa58740 1 Processor -- start 2024-09-21T05:57:08.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.674+0000 7fcffb7fe640 1 -- 172.21.15.7:0/2657032610 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fcff4004f20 con 0x7fcffc1101a0 2024-09-21T05:57:08.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.674+0000 7fd00aa58740 1 -- start start 2024-09-21T05:57:08.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.674+0000 7fd00aa58740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f9a070 0x55e1e13416a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.674+0000 7fd00aa58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f711b0 0x55e1e1341be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.674+0000 7fd00aa58740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f79390 0x55e1e1342120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.674+0000 7fd00aa58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e1e12b7ea0 con 0x55e1e0f711b0 2024-09-21T05:57:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.674+0000 7fd00aa58740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e1e12a72d0 con 0x55e1e0f9a070 2024-09-21T05:57:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.674+0000 7fd00aa58740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e1e12ab0e0 con 0x55e1e0f79390 2024-09-21T05:57:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fd002280640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f711b0 0x55e1e1341be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fd002280640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f711b0 0x55e1e1341be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49726/0 (socket says 172.21.15.7:49726) 2024-09-21T05:57:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fd002280640 1 -- 172.21.15.7:0/2782740021 learned_addr learned my addr 172.21.15.7:0/2782740021 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fd001a7f640 1 --2- 172.21.15.7:0/2782740021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f9a070 0x55e1e13416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fd001a7f640 1 --2- 172.21.15.7:0/2782740021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f79390 0x55e1e1342120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fd002280640 1 -- 172.21.15.7:0/2782740021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f79390 msgr2=0x55e1e1342120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fd002280640 1 --2- 172.21.15.7:0/2782740021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f79390 0x55e1e1342120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fd002280640 1 -- 172.21.15.7:0/2782740021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f9a070 msgr2=0x55e1e13416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fd002280640 1 --2- 172.21.15.7:0/2782740021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f9a070 0x55e1e13416a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fd002280640 1 -- 172.21.15.7:0/2782740021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1e1005650 con 0x55e1e0f711b0 2024-09-21T05:57:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fcffb7fe640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcfe40b6680 0x7fcfe40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fd002280640 1 --2- 172.21.15.7:0/2782740021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f711b0 0x55e1e1341be0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009ca0 tx=0x7fcfec02fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9b11c21cec2965 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fd001a7f640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcfe40b6680 0x7fcfe40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.675+0000 7fcffb7fe640 1 -- 172.21.15.7:0/2657032610 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fcff40e7980 con 0x7fcffc1101a0 2024-09-21T05:57:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.676+0000 7fcff8ff9640 1 -- 172.21.15.7:0/2782740021 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec048070 con 0x55e1e0f711b0 2024-09-21T05:57:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.676+0000 7fcff8ff9640 1 -- 172.21.15.7:0/2782740021 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfec003e20 con 0x55e1e0f711b0 2024-09-21T05:57:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.676+0000 7fcff8ff9640 1 -- 172.21.15.7:0/2782740021 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec034040 con 0x55e1e0f711b0 2024-09-21T05:57:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.677+0000 7fd00aa58740 1 -- 172.21.15.7:0/2782740021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f711b0 msgr2=0x55e1e1341be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.677+0000 7fd001a7f640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcfe40b6680 0x7fcfe40b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcffc079ef0 tx=0x7fcff0009470 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.677+0000 7fd00aa58740 1 --2- 172.21.15.7:0/2782740021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f711b0 0x55e1e1341be0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009ca0 tx=0x7fcfec02fe80 comp rx=0 tx=0).stop 2024-09-21T05:57:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.677+0000 7fd00aa58740 1 -- 172.21.15.7:0/2782740021 shutdown_connections 2024-09-21T05:57:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.677+0000 7fd00aa58740 1 --2- 172.21.15.7:0/2782740021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f711b0 0x55e1e1341be0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.677+0000 7fd00aa58740 1 --2- 172.21.15.7:0/2782740021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f79390 0x55e1e1342120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.677+0000 7fd00aa58740 1 --2- 172.21.15.7:0/2782740021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f9a070 0x55e1e13416a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.677+0000 7fd00aa58740 1 -- 172.21.15.7:0/2782740021 >> 172.21.15.7:0/2782740021 conn(0x55e1e0f8e460 msgr2=0x55e1e133f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.677+0000 7fd00aa58740 1 -- 172.21.15.7:0/2782740021 shutdown_connections 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.677+0000 7fd00aa58740 1 -- 172.21.15.7:0/2782740021 wait complete. 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.677+0000 7fd00aa58740 1 -- start start 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.677+0000 7fd00aa58740 1 Processor -- start 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd00aa58740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f711b0 0x55e1e134cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd00aa58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f79390 0x55e1e134d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd00aa58740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f9a070 0x55e1e1359140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd00aa58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e1e1108700 con 0x55e1e0f79390 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd00aa58740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e1e1242160 con 0x55e1e0f9a070 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd00aa58740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e1e134fe20 con 0x55e1e0f711b0 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd00aa58740 10 client.0 _ll_register_callbacks cb 0x55e1e125b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd001a7f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f79390 0x55e1e134d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd001a7f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f79390 0x55e1e134d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49736/0 (socket says 172.21.15.7:49736) 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd001a7f640 1 -- 172.21.15.7:0/1211206882 learned_addr learned my addr 172.21.15.7:0/1211206882 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd002280640 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f711b0 0x55e1e134cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd002a81640 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f9a070 0x55e1e1359140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd001a7f640 1 -- 172.21.15.7:0/1211206882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f711b0 msgr2=0x55e1e134cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd001a7f640 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f711b0 0x55e1e134cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd001a7f640 1 -- 172.21.15.7:0/1211206882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f9a070 msgr2=0x55e1e1359140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd001a7f640 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f9a070 0x55e1e1359140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd001a7f640 1 -- 172.21.15.7:0/1211206882 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1e126fc90 con 0x55e1e0f79390 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd002a81640 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f9a070 0x55e1e1359140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fd001a7f640 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f79390 0x55e1e134d300 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009d80 tx=0x7fcff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8807727321ba4551 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.678+0000 7fcfe1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fcfe1ffb640 1 -- 172.21.15.7:0/1211206882 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff0027070 con 0x55e1e0f79390 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fcfe1ffb640 1 -- 172.21.15.7:0/1211206882 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fcff0016950 con 0x55e1e0f79390 2024-09-21T05:57:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fd00aa58740 1 -- 172.21.15.7:0/1211206882 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfec003e20 con 0x55e1e0f79390 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fcfe1ffb640 1 -- 172.21.15.7:0/1211206882 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcff0033050 con 0x55e1e0f79390 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fd00aa58740 10 client.16164 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fd00aa58740 1 -- 172.21.15.7:0/1211206882 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e1e135bbc0 con 0x55e1e0f79390 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fcfe1ffb640 1 -- 172.21.15.7:0/1211206882 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfec003e20 con 0x55e1e0f79390 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fcfe1ffb640 1 -- 172.21.15.7:0/1211206882 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcff0022070 con 0x55e1e0f79390 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fd00aa58740 10 client.16164 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fd00aa58740 10 client.16164 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fd00aa58740 20 client.16164 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fd00aa58740 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1e0f589f0 0x55e1e135f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fd00aa58740 4 client.16164 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.679+0000 7fd00aa58740 1 -- 172.21.15.7:0/1211206882 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1e12b9df0 con 0x55e1e0f589f0 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.680+0000 7fd002280640 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1e0f589f0 0x55e1e135f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.680+0000 7fd002280640 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1e0f589f0 0x55e1e135f150 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=39d630095282501 server_cookie=bd87d50acb4b05c8 in_seq=0 out_seq=0 2024-09-21T05:57:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.680+0000 7fcfe1ffb640 10 client.16164 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:57:08.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fcfe1ffb640 1 -- 172.21.15.7:0/1211206882 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e1e12b9df0 con 0x55e1e0f589f0 2024-09-21T05:57:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fcfe1ffb640 10 client.16164 handle_command_reply: tid=0 2024-09-21T05:57:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fd00aa58740 1 client.16164 shutdown 2024-09-21T05:57:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fd00aa58740 1 -- 172.21.15.7:0/1211206882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f79390 msgr2=0x55e1e134d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fd00aa58740 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f79390 0x55e1e134d300 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009d80 tx=0x7fcff00046c0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fd00aa58740 1 -- 172.21.15.7:0/1211206882 shutdown_connections 2024-09-21T05:57:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fd00aa58740 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1e0f589f0 0x55e1e135f150 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fd00aa58740 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f79390 0x55e1e134d300 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fd00aa58740 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f9a070 0x55e1e1359140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fd00aa58740 1 --2- 172.21.15.7:0/1211206882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f711b0 0x55e1e134cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fcfe1ffb640 0 client.16164 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:57:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fd00aa58740 1 -- 172.21.15.7:0/1211206882 >> 172.21.15.7:0/1211206882 conn(0x55e1e0f8e460 msgr2=0x55e1e1344830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fd00aa58740 1 -- 172.21.15.7:0/1211206882 shutdown_connections 2024-09-21T05:57:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fd00aa58740 1 -- 172.21.15.7:0/1211206882 wait complete. 2024-09-21T05:57:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.681+0000 7fd00aa58740 20 client.16164 trim_cache size 0 max 16384 2024-09-21T05:57:08.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.694+0000 7fd00aa58740 1 Processor -- start 2024-09-21T05:57:08.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd00aa58740 1 -- start start 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd00aa58740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f711b0 0x55e1e134bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd00aa58740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f79390 0x55e1e133f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd00aa58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 0x55e1e1359040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd00aa58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc1b40e0 con 0x55e1e0f9a070 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd00aa58740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc1b19b0 con 0x55e1e0f711b0 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd00aa58740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc1af800 con 0x55e1e0f79390 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd002a81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 0x55e1e1359040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd002a81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 0x55e1e1359040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49748/0 (socket says 172.21.15.7:49748) 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd002a81640 1 -- 172.21.15.7:0/14587967 learned_addr learned my addr 172.21.15.7:0/14587967 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd002280640 1 --2- 172.21.15.7:0/14587967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f711b0 0x55e1e134bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd001a7f640 1 --2- 172.21.15.7:0/14587967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f79390 0x55e1e133f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd002a81640 1 -- 172.21.15.7:0/14587967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f79390 msgr2=0x55e1e133f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd002a81640 1 --2- 172.21.15.7:0/14587967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f79390 0x55e1e133f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd002a81640 1 -- 172.21.15.7:0/14587967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f711b0 msgr2=0x55e1e134bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:08.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd002a81640 1 --2- 172.21.15.7:0/14587967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f711b0 0x55e1e134bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd002a81640 1 -- 172.21.15.7:0/14587967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1e134f500 con 0x55e1e0f9a070 2024-09-21T05:57:08.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd002280640 1 --2- 172.21.15.7:0/14587967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f711b0 0x55e1e134bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:08.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.695+0000 7fd002a81640 1 --2- 172.21.15.7:0/14587967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 0x55e1e1359040 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fcff400e940 tx=0x7fcff40acfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c764d016b9a30705 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:08.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.696+0000 7fcfe3fff640 1 -- 172.21.15.7:0/14587967 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff40adf50 con 0x55e1e0f9a070 2024-09-21T05:57:08.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.696+0000 7fcfe3fff640 1 -- 172.21.15.7:0/14587967 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcff40b2330 con 0x55e1e0f9a070 2024-09-21T05:57:08.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.696+0000 7fcfe3fff640 1 -- 172.21.15.7:0/14587967 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4005210 con 0x55e1e0f9a070 2024-09-21T05:57:08.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.696+0000 7fd00aa58740 1 -- 172.21.15.7:0/14587967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 msgr2=0x55e1e1359040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:08.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.696+0000 7fd00aa58740 1 --2- 172.21.15.7:0/14587967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 0x55e1e1359040 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fcff400e940 tx=0x7fcff40acfc0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.696+0000 7fd00aa58740 1 -- 172.21.15.7:0/14587967 shutdown_connections 2024-09-21T05:57:08.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.696+0000 7fd00aa58740 1 --2- 172.21.15.7:0/14587967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 0x55e1e1359040 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.696+0000 7fd00aa58740 1 --2- 172.21.15.7:0/14587967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f79390 0x55e1e133f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.696+0000 7fd00aa58740 1 --2- 172.21.15.7:0/14587967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f711b0 0x55e1e134bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.696+0000 7fd00aa58740 1 -- 172.21.15.7:0/14587967 >> 172.21.15.7:0/14587967 conn(0x55e1e0f8e460 msgr2=0x55e1e133eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:08.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.696+0000 7fd00aa58740 1 -- 172.21.15.7:0/14587967 shutdown_connections 2024-09-21T05:57:08.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd00aa58740 1 -- 172.21.15.7:0/14587967 wait complete. 2024-09-21T05:57:08.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd00aa58740 1 -- start start 2024-09-21T05:57:08.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd00aa58740 1 Processor -- start 2024-09-21T05:57:08.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd00aa58740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f711b0 0x55e1e1355930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd00aa58740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f79390 0x55e1e1350e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd00aa58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 0x55e1e1351410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd00aa58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc1afe70 con 0x55e1e0f9a070 2024-09-21T05:57:08.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd00aa58740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc1b12e0 con 0x55e1e0f79390 2024-09-21T05:57:08.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd00aa58740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc1b0540 con 0x55e1e0f711b0 2024-09-21T05:57:08.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd00aa58740 10 client.0 _ll_register_callbacks cb 0x7fcff0017470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:08.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd002a81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 0x55e1e1351410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd002a81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 0x55e1e1351410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49754/0 (socket says 172.21.15.7:49754) 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd002a81640 1 -- 172.21.15.7:0/1800489867 learned_addr learned my addr 172.21.15.7:0/1800489867 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.697+0000 7fd001a7f640 1 --2- 172.21.15.7:0/1800489867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f79390 0x55e1e1350e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fd002280640 1 --2- 172.21.15.7:0/1800489867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f711b0 0x55e1e1355930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fd002a81640 1 -- 172.21.15.7:0/1800489867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f711b0 msgr2=0x55e1e1355930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fd002a81640 1 --2- 172.21.15.7:0/1800489867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f711b0 0x55e1e1355930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fd002a81640 1 -- 172.21.15.7:0/1800489867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f79390 msgr2=0x55e1e1350e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fd002a81640 1 --2- 172.21.15.7:0/1800489867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f79390 0x55e1e1350e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fd002a81640 1 -- 172.21.15.7:0/1800489867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1e1351ba0 con 0x55e1e0f9a070 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fd002a81640 1 --2- 172.21.15.7:0/1800489867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 0x55e1e1351410 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fcff40ad550 tx=0x7fcff40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae47bb8615b486b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fcfe1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fcfe1ffb640 1 -- 172.21.15.7:0/1800489867 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff40adf50 con 0x55e1e0f9a070 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fd00aa58740 1 -- 172.21.15.7:0/1800489867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcff40b2330 con 0x55e1e0f9a070 2024-09-21T05:57:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fcfe1ffb640 1 -- 172.21.15.7:0/1800489867 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fcff4005210 con 0x55e1e0f9a070 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fcfe1ffb640 1 -- 172.21.15.7:0/1800489867 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcff4005410 con 0x55e1e0f9a070 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fd00aa58740 10 client.16170 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.698+0000 7fd00aa58740 1 -- 172.21.15.7:0/1800489867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e1e13c9b30 con 0x55e1e0f9a070 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.699+0000 7fcfe1ffb640 1 -- 172.21.15.7:0/1800489867 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcff40b2330 con 0x55e1e0f9a070 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.699+0000 7fcfe1ffb640 1 -- 172.21.15.7:0/1800489867 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcff40ac520 con 0x55e1e0f9a070 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.699+0000 7fd00aa58740 10 client.16170 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.699+0000 7fd00aa58740 10 client.16170 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.699+0000 7fd00aa58740 20 client.16170 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.699+0000 7fd00aa58740 1 --2- 172.21.15.7:0/1800489867 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1e0f2dda0 0x55e1e13cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.699+0000 7fd00aa58740 4 client.16170 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.699+0000 7fd00aa58740 1 -- 172.21.15.7:0/1800489867 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e1e12b58a0 con 0x55e1e0f2dda0 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.699+0000 7fd002280640 1 --2- 172.21.15.7:0/1800489867 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1e0f2dda0 0x55e1e13cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fd002280640 1 --2- 172.21.15.7:0/1800489867 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1e0f2dda0 0x55e1e13cc190 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4814d1fbfd79f761 server_cookie=683885a28cba7b9f in_seq=0 out_seq=0 2024-09-21T05:57:08.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fcfe1ffb640 10 client.16170 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fcfe1ffb640 1 -- 172.21.15.7:0/1800489867 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e1e12b58a0 con 0x55e1e0f2dda0 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fcfe1ffb640 10 client.16170 handle_command_reply: tid=0 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fd00aa58740 1 client.16170 shutdown 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fd00aa58740 1 -- 172.21.15.7:0/1800489867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 msgr2=0x55e1e1351410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fd00aa58740 1 --2- 172.21.15.7:0/1800489867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 0x55e1e1351410 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fcff40ad550 tx=0x7fcff40048f0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fd00aa58740 1 -- 172.21.15.7:0/1800489867 shutdown_connections 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fd00aa58740 1 --2- 172.21.15.7:0/1800489867 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e1e0f2dda0 0x55e1e13cc190 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fd00aa58740 1 --2- 172.21.15.7:0/1800489867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e1e0f9a070 0x55e1e1351410 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fd00aa58740 1 --2- 172.21.15.7:0/1800489867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e1e0f79390 0x55e1e1350e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fd00aa58740 1 --2- 172.21.15.7:0/1800489867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e1e0f711b0 0x55e1e1355930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fd00aa58740 1 -- 172.21.15.7:0/1800489867 >> 172.21.15.7:0/1800489867 conn(0x55e1e0f8e460 msgr2=0x55e1e13447a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fcfe1ffb640 0 client.16170 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fd00aa58740 1 -- 172.21.15.7:0/1800489867 shutdown_connections 2024-09-21T05:57:08.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fd00aa58740 1 -- 172.21.15.7:0/1800489867 wait complete. 2024-09-21T05:57:08.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.700+0000 7fd00aa58740 20 client.16170 trim_cache size 0 max 16384 2024-09-21T05:57:08.709 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:57:08.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.701+0000 7fd0044e4640 1 -- 172.21.15.7:0/2657032610 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcfe40b6680 msgr2=0x7fcfe40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:08.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.701+0000 7fd0044e4640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcfe40b6680 0x7fcfe40b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcffc079ef0 tx=0x7fcff0009470 comp rx=0 tx=0).stop 2024-09-21T05:57:08.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.701+0000 7fd0044e4640 1 -- 172.21.15.7:0/2657032610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcffc1101a0 msgr2=0x7fcffc1a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:08.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.701+0000 7fd0044e4640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcffc1101a0 0x7fcffc1a1f00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fcff400e970 tx=0x7fcff400ed70 comp rx=0 tx=0).stop 2024-09-21T05:57:08.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.701+0000 7fd0044e4640 1 -- 172.21.15.7:0/2657032610 shutdown_connections 2024-09-21T05:57:08.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.701+0000 7fd0044e4640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcfe40b6680 0x7fcfe40b8b90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.701+0000 7fd0044e4640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcffc1101a0 0x7fcffc1a1f00 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.701+0000 7fd0044e4640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcffc102f40 0x7fcffc19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.701+0000 7fd0044e4640 1 --2- 172.21.15.7:0/2657032610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcffc1025f0 0x7fcffc19c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:08.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.701+0000 7fd0044e4640 1 -- 172.21.15.7:0/2657032610 >> 172.21.15.7:0/2657032610 conn(0x7fcffc079740 msgr2=0x7fcffc1115e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:08.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.701+0000 7fd0044e4640 1 -- 172.21.15.7:0/2657032610 shutdown_connections 2024-09-21T05:57:08.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:08.701+0000 7fd0044e4640 1 -- 172.21.15.7:0/2657032610 wait complete. 2024-09-21T05:57:09.446 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T05:57:09.707 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:09.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:09 smithi007 ceph-mon[30983]: pgmap v416: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:57:09.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:09 smithi027 ceph-mon[34364]: pgmap v416: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:57:10.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:09 smithi119 ceph-mon[34833]: pgmap v416: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:57:10.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.228+0000 7fbe9b997640 1 -- 172.21.15.7:0/2901953807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94102f50 msgr2=0x7fbe9410fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:10.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.228+0000 7fbe9b997640 1 --2- 172.21.15.7:0/2901953807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94102f50 0x7fbe9410fc70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009900 tx=0x7fbe8402a480 comp rx=0 tx=0).stop 2024-09-21T05:57:10.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.228+0000 7fbe9b997640 1 -- 172.21.15.7:0/2901953807 shutdown_connections 2024-09-21T05:57:10.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.228+0000 7fbe9b997640 1 --2- 172.21.15.7:0/2901953807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94102f50 0x7fbe9410fc70 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.228+0000 7fbe9b997640 1 --2- 172.21.15.7:0/2901953807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe941101b0 0x7fbe941125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.228+0000 7fbe9b997640 1 --2- 172.21.15.7:0/2901953807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe94102600 0x7fbe94102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.229+0000 7fbe9b997640 1 -- 172.21.15.7:0/2901953807 >> 172.21.15.7:0/2901953807 conn(0x7fbe94079750 msgr2=0x7fbe94079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:10.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.229+0000 7fbe9b997640 1 -- 172.21.15.7:0/2901953807 shutdown_connections 2024-09-21T05:57:10.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.229+0000 7fbe9b997640 1 -- 172.21.15.7:0/2901953807 wait complete. 2024-09-21T05:57:10.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.229+0000 7fbe9b997640 1 Processor -- start 2024-09-21T05:57:10.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.229+0000 7fbe9b997640 1 -- start start 2024-09-21T05:57:10.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe9b997640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe94102600 0x7fbe9419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe9b997640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe94102f50 0x7fbe9419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe9b997640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe941101b0 0x7fbe941a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe9b997640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94115ca0 con 0x7fbe941101b0 2024-09-21T05:57:10.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe9b997640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94115b20 con 0x7fbe94102f50 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe9b997640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94115e20 con 0x7fbe94102600 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe99f34640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe941101b0 0x7fbe941a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe99f34640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe941101b0 0x7fbe941a1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49774/0 (socket says 172.21.15.7:49774) 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe99f34640 1 -- 172.21.15.7:0/523241086 learned_addr learned my addr 172.21.15.7:0/523241086 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe98f32640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe94102f50 0x7fbe9419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe99733640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe94102600 0x7fbe9419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe99f34640 1 -- 172.21.15.7:0/523241086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe94102600 msgr2=0x7fbe9419c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe99f34640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe94102600 0x7fbe9419c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe99f34640 1 -- 172.21.15.7:0/523241086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe94102f50 msgr2=0x7fbe9419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe99f34640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe94102f50 0x7fbe9419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe99f34640 1 -- 172.21.15.7:0/523241086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe941a2600 con 0x7fbe941101b0 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.230+0000 7fbe99f34640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe941101b0 0x7fbe941a1ed0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00eaa0 tx=0x7fbe8c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.231+0000 7fbe8a7fc640 1 -- 172.21.15.7:0/523241086 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c00cdb0 con 0x7fbe941101b0 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.231+0000 7fbe8a7fc640 1 -- 172.21.15.7:0/523241086 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe8c005020 con 0x7fbe941101b0 2024-09-21T05:57:10.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.231+0000 7fbe9b997640 1 -- 172.21.15.7:0/523241086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe941a28f0 con 0x7fbe941101b0 2024-09-21T05:57:10.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.231+0000 7fbe8a7fc640 1 -- 172.21.15.7:0/523241086 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0116d0 con 0x7fbe941101b0 2024-09-21T05:57:10.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.231+0000 7fbe9b997640 1 -- 172.21.15.7:0/523241086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe941a9050 con 0x7fbe941101b0 2024-09-21T05:57:10.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.234+0000 7fbea1f0b740 1 Processor -- start 2024-09-21T05:57:10.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.234+0000 7fbe8a7fc640 1 -- 172.21.15.7:0/523241086 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fbe8c0051d0 con 0x7fbe941101b0 2024-09-21T05:57:10.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.234+0000 7fbea1f0b740 1 -- start start 2024-09-21T05:57:10.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.234+0000 7fbea1f0b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0d19070 0x55c9c10c06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.234+0000 7fbea1f0b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf01b0 0x55c9c10c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.234+0000 7fbea1f0b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0cf8390 0x55c9c10c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.234+0000 7fbea1f0b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c9c1036ea0 con 0x55c9c0cf8390 2024-09-21T05:57:10.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.234+0000 7fbea1f0b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c9c10262d0 con 0x55c9c0cf01b0 2024-09-21T05:57:10.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.234+0000 7fbea1f0b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c9c102a0e0 con 0x55c9c0d19070 2024-09-21T05:57:10.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.234+0000 7fbe98f32640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0cf8390 0x55c9c10c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.234+0000 7fbe98f32640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0cf8390 0x55c9c10c1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49776/0 (socket says 172.21.15.7:49776) 2024-09-21T05:57:10.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.234+0000 7fbe98f32640 1 -- 172.21.15.7:0/3825654075 learned_addr learned my addr 172.21.15.7:0/3825654075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:10.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.234+0000 7fbe99733640 1 --2- 172.21.15.7:0/3825654075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf01b0 0x55c9c10c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.235+0000 7fbe98f32640 1 --2- 172.21.15.7:0/3825654075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0d19070 0x55c9c10c06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.235+0000 7fbe99733640 1 -- 172.21.15.7:0/3825654075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0d19070 msgr2=0x55c9c10c06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:10.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.235+0000 7fbe99733640 1 --2- 172.21.15.7:0/3825654075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0d19070 0x55c9c10c06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.235+0000 7fbe99733640 1 -- 172.21.15.7:0/3825654075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0cf8390 msgr2=0x55c9c10c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:10.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.235+0000 7fbe99733640 1 --2- 172.21.15.7:0/3825654075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0cf8390 0x55c9c10c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.235+0000 7fbe99733640 1 -- 172.21.15.7:0/3825654075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c0d84650 con 0x55c9c0cf01b0 2024-09-21T05:57:10.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.235+0000 7fbe8a7fc640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbe800b6700 0x7fbe800b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.235+0000 7fbe98f32640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbe800b6700 0x7fbe800b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.235+0000 7fbe99733640 1 --2- 172.21.15.7:0/3825654075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf01b0 0x55c9c10c0be0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000ab40 tx=0x7fbe9000f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceb5a83db59d7ecc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:10.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.235+0000 7fbe8a7fc640 1 -- 172.21.15.7:0/523241086 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fbe8c0e7730 con 0x7fbe941101b0 2024-09-21T05:57:10.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.235+0000 7fbe7f7fe640 1 -- 172.21.15.7:0/3825654075 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90004020 con 0x55c9c0cf01b0 2024-09-21T05:57:10.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.235+0000 7fbe7f7fe640 1 -- 172.21.15.7:0/3825654075 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe900041c0 con 0x55c9c0cf01b0 2024-09-21T05:57:10.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.235+0000 7fbe7f7fe640 1 -- 172.21.15.7:0/3825654075 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe900186a0 con 0x55c9c0cf01b0 2024-09-21T05:57:10.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.236+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3825654075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf01b0 msgr2=0x55c9c10c0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:10.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.236+0000 7fbe98f32640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbe800b6700 0x7fbe800b8c10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbe84005f70 tx=0x7fbe84009640 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:10.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.236+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3825654075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf01b0 0x55c9c10c0be0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000ab40 tx=0x7fbe9000f3c0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.236+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3825654075 shutdown_connections 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.236+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3825654075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0cf8390 0x55c9c10c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.236+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3825654075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf01b0 0x55c9c10c0be0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.236+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3825654075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0d19070 0x55c9c10c06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.236+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3825654075 >> 172.21.15.7:0/3825654075 conn(0x55c9c0d0d460 msgr2=0x55c9c10be590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.236+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3825654075 shutdown_connections 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.236+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3825654075 wait complete. 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.237+0000 7fbea1f0b740 1 -- start start 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.237+0000 7fbea1f0b740 1 Processor -- start 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.237+0000 7fbea1f0b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf01b0 0x55c9c10cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.237+0000 7fbea1f0b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0cf8390 0x55c9c10cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.237+0000 7fbea1f0b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0d19070 0x55c9c10cc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.237+0000 7fbea1f0b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c9c0e87700 con 0x55c9c0cf8390 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.237+0000 7fbea1f0b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c9c0fc1160 con 0x55c9c0d19070 2024-09-21T05:57:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.237+0000 7fbea1f0b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c9c10cee80 con 0x55c9c0cf01b0 2024-09-21T05:57:10.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbea1f0b740 10 client.0 _ll_register_callbacks cb 0x55c9c0fda9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:10.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe98f32640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0cf8390 0x55c9c10cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe98f32640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0cf8390 0x55c9c10cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49790/0 (socket says 172.21.15.7:49790) 2024-09-21T05:57:10.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe98f32640 1 -- 172.21.15.7:0/3463970547 learned_addr learned my addr 172.21.15.7:0/3463970547 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:10.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe99f34640 1 --2- 172.21.15.7:0/3463970547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0d19070 0x55c9c10cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe99733640 1 --2- 172.21.15.7:0/3463970547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf01b0 0x55c9c10cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe98f32640 1 -- 172.21.15.7:0/3463970547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf01b0 msgr2=0x55c9c10cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:10.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe98f32640 1 --2- 172.21.15.7:0/3463970547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf01b0 0x55c9c10cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe98f32640 1 -- 172.21.15.7:0/3463970547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0d19070 msgr2=0x55c9c10cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:10.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe98f32640 1 --2- 172.21.15.7:0/3463970547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0d19070 0x55c9c10cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe98f32640 1 -- 172.21.15.7:0/3463970547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c0feec90 con 0x55c9c0cf8390 2024-09-21T05:57:10.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe98f32640 1 --2- 172.21.15.7:0/3463970547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0cf8390 0x55c9c10cc1e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fbe840042c0 tx=0x7fbe8402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216fa24dca53fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:10.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:10.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe7cff9640 1 -- 172.21.15.7:0/3463970547 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8404e070 con 0x55c9c0cf8390 2024-09-21T05:57:10.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbe7cff9640 1 -- 172.21.15.7:0/3463970547 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fbe84003c70 con 0x55c9c0cf8390 2024-09-21T05:57:10.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.238+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3463970547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe900041c0 con 0x55c9c0cf8390 2024-09-21T05:57:10.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.239+0000 7fbe7cff9640 1 -- 172.21.15.7:0/3463970547 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbe84035040 con 0x55c9c0cf8390 2024-09-21T05:57:10.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.239+0000 7fbea1f0b740 10 client.16182 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:10.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.239+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3463970547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c9c10dab00 con 0x55c9c0cf8390 2024-09-21T05:57:10.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.239+0000 7fbe7cff9640 1 -- 172.21.15.7:0/3463970547 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe900041c0 con 0x55c9c0cf8390 2024-09-21T05:57:10.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.239+0000 7fbe7cff9640 1 -- 172.21.15.7:0/3463970547 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbe8403d450 con 0x55c9c0cf8390 2024-09-21T05:57:10.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.239+0000 7fbea1f0b740 10 client.16182 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:10.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.239+0000 7fbea1f0b740 10 client.16182 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:57:10.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.239+0000 7fbea1f0b740 20 client.16182 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:10.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.239+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3463970547 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c9c0cd79f0 0x55c9c10ddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.239+0000 7fbea1f0b740 4 client.16182 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:57:10.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.239+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3463970547 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9c1038df0 con 0x55c9c0cd79f0 2024-09-21T05:57:10.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.240+0000 7fbe99733640 1 --2- 172.21.15.7:0/3463970547 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c9c0cd79f0 0x55c9c10ddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.240+0000 7fbe99733640 1 --2- 172.21.15.7:0/3463970547 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c9c0cd79f0 0x55c9c10ddfe0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9405e3924d2a233a server_cookie=6872f870865f1567 in_seq=0 out_seq=0 2024-09-21T05:57:10.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.240+0000 7fbe7cff9640 10 client.16182 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:57:10.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.241+0000 7fbe7cff9640 1 -- 172.21.15.7:0/3463970547 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c9c1038df0 con 0x55c9c0cd79f0 2024-09-21T05:57:10.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.241+0000 7fbe7cff9640 10 client.16182 handle_command_reply: tid=0 2024-09-21T05:57:10.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.241+0000 7fbea1f0b740 1 client.16182 shutdown 2024-09-21T05:57:10.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.241+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3463970547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0cf8390 msgr2=0x55c9c10cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:10.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.241+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3463970547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0cf8390 0x55c9c10cc1e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fbe840042c0 tx=0x7fbe8402a480 comp rx=0 tx=0).stop 2024-09-21T05:57:10.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.241+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3463970547 shutdown_connections 2024-09-21T05:57:10.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.241+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3463970547 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c9c0cd79f0 0x55c9c10ddfe0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.241+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3463970547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0cf8390 0x55c9c10cc1e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.241+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3463970547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0d19070 0x55c9c10cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.241+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3463970547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf01b0 0x55c9c10cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.241+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3463970547 >> 172.21.15.7:0/3463970547 conn(0x55c9c0d0d460 msgr2=0x55c9c10c3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:10.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.241+0000 7fbe7cff9640 0 client.16182 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:57:10.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.242+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3463970547 shutdown_connections 2024-09-21T05:57:10.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.242+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3463970547 wait complete. 2024-09-21T05:57:10.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.242+0000 7fbea1f0b740 20 client.16182 trim_cache size 0 max 16384 2024-09-21T05:57:10.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.256+0000 7fbea1f0b740 1 Processor -- start 2024-09-21T05:57:10.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.256+0000 7fbea1f0b740 1 -- start start 2024-09-21T05:57:10.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.256+0000 7fbea1f0b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf01b0 0x55c9c10c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.256+0000 7fbea1f0b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf8390 0x55c9c10cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.256+0000 7fbea1f0b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0d19070 0x55c9c10c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.256+0000 7fbea1f0b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941b4000 con 0x55c9c0d19070 2024-09-21T05:57:10.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.256+0000 7fbea1f0b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941b18d0 con 0x55c9c0cf8390 2024-09-21T05:57:10.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.256+0000 7fbea1f0b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941af720 con 0x55c9c0cf01b0 2024-09-21T05:57:10.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.257+0000 7fbe99733640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf01b0 0x55c9c10c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.257+0000 7fbe98f32640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf8390 0x55c9c10cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.257+0000 7fbe98f32640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf8390 0x55c9c10cd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:46246/0 (socket says 172.21.15.7:46246) 2024-09-21T05:57:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.257+0000 7fbe98f32640 1 -- 172.21.15.7:0/2744559014 learned_addr learned my addr 172.21.15.7:0/2744559014 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.257+0000 7fbe99733640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf01b0 0x55c9c10c2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:41298/0 (socket says 172.21.15.7:41298) 2024-09-21T05:57:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.257+0000 7fbe99f34640 1 --2- 172.21.15.7:0/2744559014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0d19070 0x55c9c10c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.257+0000 7fbe99733640 1 -- 172.21.15.7:0/2744559014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf8390 msgr2=0x55c9c10cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.257+0000 7fbe99733640 1 --2- 172.21.15.7:0/2744559014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf8390 0x55c9c10cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.257+0000 7fbe99733640 1 -- 172.21.15.7:0/2744559014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0d19070 msgr2=0x55c9c10c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.257+0000 7fbe99733640 1 --2- 172.21.15.7:0/2744559014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0d19070 0x55c9c10c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.257+0000 7fbe99733640 1 -- 172.21.15.7:0/2744559014 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c10c14e0 con 0x55c9c0cf01b0 2024-09-21T05:57:10.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.257+0000 7fbe99733640 1 --2- 172.21.15.7:0/2744559014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf01b0 0x55c9c10c2090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe900058c0 tx=0x7fbe9000a450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4654c03eb2e0dc4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.258+0000 7fbe7effd640 1 -- 172.21.15.7:0/2744559014 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90032070 con 0x55c9c0cf01b0 2024-09-21T05:57:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.258+0000 7fbe7effd640 1 -- 172.21.15.7:0/2744559014 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe90005040 con 0x55c9c0cf01b0 2024-09-21T05:57:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.258+0000 7fbe7effd640 1 -- 172.21.15.7:0/2744559014 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe900035f0 con 0x55c9c0cf01b0 2024-09-21T05:57:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.259+0000 7fbea1f0b740 1 -- 172.21.15.7:0/2744559014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf01b0 msgr2=0x55c9c10c2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.259+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/2744559014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf01b0 0x55c9c10c2090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe900058c0 tx=0x7fbe9000a450 comp rx=0 tx=0).stop 2024-09-21T05:57:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.259+0000 7fbea1f0b740 1 -- 172.21.15.7:0/2744559014 shutdown_connections 2024-09-21T05:57:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.259+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/2744559014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0d19070 0x55c9c10c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.259+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/2744559014 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf8390 0x55c9c10cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.259+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/2744559014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf01b0 0x55c9c10c2090 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.259+0000 7fbea1f0b740 1 -- 172.21.15.7:0/2744559014 >> 172.21.15.7:0/2744559014 conn(0x55c9c0d0d460 msgr2=0x55c9c10cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.259+0000 7fbea1f0b740 1 -- 172.21.15.7:0/2744559014 shutdown_connections 2024-09-21T05:57:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.259+0000 7fbea1f0b740 1 -- 172.21.15.7:0/2744559014 wait complete. 2024-09-21T05:57:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.259+0000 7fbea1f0b740 1 -- start start 2024-09-21T05:57:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.259+0000 7fbea1f0b740 1 Processor -- start 2024-09-21T05:57:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbea1f0b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf01b0 0x55c9c10d4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbea1f0b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf8390 0x55c9c10cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbea1f0b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0d19070 0x55c9c10d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbea1f0b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941afd90 con 0x55c9c0d19070 2024-09-21T05:57:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbea1f0b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941b1200 con 0x55c9c0cf01b0 2024-09-21T05:57:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbea1f0b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941b0460 con 0x55c9c0cf8390 2024-09-21T05:57:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbea1f0b740 10 client.0 _ll_register_callbacks cb 0x7fbe84005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbe99f34640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0d19070 0x55c9c10d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbe99f34640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0d19070 0x55c9c10d0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49810/0 (socket says 172.21.15.7:49810) 2024-09-21T05:57:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbe99f34640 1 -- 172.21.15.7:0/3795710549 learned_addr learned my addr 172.21.15.7:0/3795710549 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:10.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbe98f32640 1 --2- 172.21.15.7:0/3795710549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf8390 0x55c9c10cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbe99733640 1 --2- 172.21.15.7:0/3795710549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf01b0 0x55c9c10d4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbe99f34640 1 -- 172.21.15.7:0/3795710549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf8390 msgr2=0x55c9c10cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:10.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbe99f34640 1 --2- 172.21.15.7:0/3795710549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf8390 0x55c9c10cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbe99f34640 1 -- 172.21.15.7:0/3795710549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf01b0 msgr2=0x55c9c10d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:10.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbe99f34640 1 --2- 172.21.15.7:0/3795710549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf01b0 0x55c9c10d4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbe99f34640 1 -- 172.21.15.7:0/3795710549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c10d0700 con 0x55c9c0d19070 2024-09-21T05:57:10.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbe99f34640 1 --2- 172.21.15.7:0/3795710549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0d19070 0x55c9c10d0140 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009270 tx=0x7fbe8c0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ae4273ee613e8f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:10.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.260+0000 7fbe7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:10.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbe7cff9640 1 -- 172.21.15.7:0/3795710549 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c01f070 con 0x55c9c0d19070 2024-09-21T05:57:10.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbe7cff9640 1 -- 172.21.15.7:0/3795710549 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fbe8c0acb10 con 0x55c9c0d19070 2024-09-21T05:57:10.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3795710549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe90005040 con 0x55c9c0d19070 2024-09-21T05:57:10.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbe7cff9640 1 -- 172.21.15.7:0/3795710549 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbe8c0b7020 con 0x55c9c0d19070 2024-09-21T05:57:10.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbea1f0b740 10 client.16188 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:10.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3795710549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c9c1148750 con 0x55c9c0d19070 2024-09-21T05:57:10.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbe7cff9640 1 -- 172.21.15.7:0/3795710549 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe90005040 con 0x55c9c0d19070 2024-09-21T05:57:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbe7cff9640 1 -- 172.21.15.7:0/3795710549 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbe8c00f040 con 0x55c9c0d19070 2024-09-21T05:57:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbea1f0b740 10 client.16188 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbea1f0b740 10 client.16188 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:57:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbea1f0b740 20 client.16188 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3795710549 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c9c0cacda0 0x55c9c114aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbea1f0b740 4 client.16188 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:57:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.261+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3795710549 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c9c10348a0 con 0x55c9c0cacda0 2024-09-21T05:57:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.262+0000 7fbe99733640 1 --2- 172.21.15.7:0/3795710549 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c9c0cacda0 0x55c9c114aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.262+0000 7fbe7cff9640 10 client.16188 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:57:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.262+0000 7fbe99733640 1 --2- 172.21.15.7:0/3795710549 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c9c0cacda0 0x55c9c114aee0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e24248fa5284c07c server_cookie=5182f93a156612f9 in_seq=0 out_seq=0 2024-09-21T05:57:10.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbe7cff9640 1 -- 172.21.15.7:0/3795710549 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c9c10348a0 con 0x55c9c0cacda0 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbe7cff9640 10 client.16188 handle_command_reply: tid=0 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbea1f0b740 1 client.16188 shutdown 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3795710549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0d19070 msgr2=0x55c9c10d0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3795710549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0d19070 0x55c9c10d0140 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009270 tx=0x7fbe8c0094a0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3795710549 shutdown_connections 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3795710549 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c9c0cacda0 0x55c9c114aee0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3795710549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9c0d19070 0x55c9c10d0140 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3795710549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c9c0cf8390 0x55c9c10cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbea1f0b740 1 --2- 172.21.15.7:0/3795710549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c9c0cf01b0 0x55c9c10d4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbe7cff9640 0 client.16188 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3795710549 >> 172.21.15.7:0/3795710549 conn(0x55c9c0d0d460 msgr2=0x55c9c10c1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3795710549 shutdown_connections 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbea1f0b740 1 -- 172.21.15.7:0/3795710549 wait complete. 2024-09-21T05:57:10.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.263+0000 7fbea1f0b740 20 client.16188 trim_cache size 0 max 16384 2024-09-21T05:57:10.271 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:57:10.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.264+0000 7fbe9b997640 1 -- 172.21.15.7:0/523241086 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbe800b6700 msgr2=0x7fbe800b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:10.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.264+0000 7fbe9b997640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbe800b6700 0x7fbe800b8c10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbe84005f70 tx=0x7fbe84009640 comp rx=0 tx=0).stop 2024-09-21T05:57:10.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.264+0000 7fbe9b997640 1 -- 172.21.15.7:0/523241086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe941101b0 msgr2=0x7fbe941a1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:10.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.264+0000 7fbe9b997640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe941101b0 0x7fbe941a1ed0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00eaa0 tx=0x7fbe8c00ef60 comp rx=0 tx=0).stop 2024-09-21T05:57:10.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.264+0000 7fbe9b997640 1 -- 172.21.15.7:0/523241086 shutdown_connections 2024-09-21T05:57:10.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.264+0000 7fbe9b997640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbe800b6700 0x7fbe800b8c10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.264+0000 7fbe9b997640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe941101b0 0x7fbe941a1ed0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.264+0000 7fbe9b997640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe94102f50 0x7fbe9419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.264+0000 7fbe9b997640 1 --2- 172.21.15.7:0/523241086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe94102600 0x7fbe9419c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:10.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.264+0000 7fbe9b997640 1 -- 172.21.15.7:0/523241086 >> 172.21.15.7:0/523241086 conn(0x7fbe94079750 msgr2=0x7fbe94109d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:10.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.264+0000 7fbe9b997640 1 -- 172.21.15.7:0/523241086 shutdown_connections 2024-09-21T05:57:10.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:10.264+0000 7fbe9b997640 1 -- 172.21.15.7:0/523241086 wait complete. 2024-09-21T05:57:11.119 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T05:57:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:11.803 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:11 smithi007 ceph-mon[30983]: pgmap v417: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:57:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.818+0000 7fba0b59c640 1 -- 172.21.15.7:0/956554565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba04108d20 msgr2=0x7fba0410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.818+0000 7fba0b59c640 1 --2- 172.21.15.7:0/956554565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba04108d20 0x7fba0410f550 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009ca0 tx=0x7fb9fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.818+0000 7fba0b59c640 1 -- 172.21.15.7:0/956554565 shutdown_connections 2024-09-21T05:57:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.818+0000 7fba0b59c640 1 --2- 172.21.15.7:0/956554565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba04108d20 0x7fba0410f550 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.818+0000 7fba0b59c640 1 --2- 172.21.15.7:0/956554565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba041083d0 0x7fba041087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.818+0000 7fba0b59c640 1 --2- 172.21.15.7:0/956554565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba04102ae0 0x7fba04102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.818+0000 7fba0b59c640 1 -- 172.21.15.7:0/956554565 >> 172.21.15.7:0/956554565 conn(0x7fba04079760 msgr2=0x7fba04079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.818+0000 7fba0b59c640 1 -- 172.21.15.7:0/956554565 shutdown_connections 2024-09-21T05:57:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.818+0000 7fba0b59c640 1 -- 172.21.15.7:0/956554565 wait complete. 2024-09-21T05:57:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.819+0000 7fba0b59c640 1 Processor -- start 2024-09-21T05:57:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.819+0000 7fba0b59c640 1 -- start start 2024-09-21T05:57:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.819+0000 7fba0b59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba04102ae0 0x7fba0419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.819+0000 7fba0b59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba041083d0 0x7fba0419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.819+0000 7fba0b59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba04108d20 0x7fba0419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.819+0000 7fba0b59c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba04113ab0 con 0x7fba04108d20 2024-09-21T05:57:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.819+0000 7fba0b59c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fba04113930 con 0x7fba041083d0 2024-09-21T05:57:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.819+0000 7fba0b59c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fba04113c30 con 0x7fba04102ae0 2024-09-21T05:57:11.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.820+0000 7fba09b39640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba04108d20 0x7fba0419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.820+0000 7fba09338640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba04102ae0 0x7fba0419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.820+0000 7fba09b39640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba04108d20 0x7fba0419fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49828/0 (socket says 172.21.15.7:49828) 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.820+0000 7fba09b39640 1 -- 172.21.15.7:0/643554886 learned_addr learned my addr 172.21.15.7:0/643554886 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.820+0000 7fba08b37640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba041083d0 0x7fba0419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.820+0000 7fba09b39640 1 -- 172.21.15.7:0/643554886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba04102ae0 msgr2=0x7fba0419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.820+0000 7fba09b39640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba04102ae0 0x7fba0419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.820+0000 7fba09b39640 1 -- 172.21.15.7:0/643554886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba041083d0 msgr2=0x7fba0419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.820+0000 7fba09b39640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba041083d0 0x7fba0419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.820+0000 7fba09b39640 1 -- 172.21.15.7:0/643554886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba041a0330 con 0x7fba04108d20 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.820+0000 7fba08b37640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba041083d0 0x7fba0419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.820+0000 7fba09b39640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba04108d20 0x7fba0419fcc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc005cc0 tx=0x7fb9fc02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.821+0000 7fb9fa7fc640 1 -- 172.21.15.7:0/643554886 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc003cf0 con 0x7fba04108d20 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.821+0000 7fb9fa7fc640 1 -- 172.21.15.7:0/643554886 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9fc0044f0 con 0x7fba04108d20 2024-09-21T05:57:11.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.821+0000 7fba0b59c640 1 -- 172.21.15.7:0/643554886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba041a05c0 con 0x7fba04108d20 2024-09-21T05:57:11.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.821+0000 7fb9fa7fc640 1 -- 172.21.15.7:0/643554886 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc02fc30 con 0x7fba04108d20 2024-09-21T05:57:11.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.821+0000 7fba0b59c640 1 -- 172.21.15.7:0/643554886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba041a0b00 con 0x7fba04108d20 2024-09-21T05:57:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.824+0000 7fba11b10740 1 Processor -- start 2024-09-21T05:57:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.824+0000 7fb9fa7fc640 1 -- 172.21.15.7:0/643554886 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb9fc0046a0 con 0x7fba04108d20 2024-09-21T05:57:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.824+0000 7fba11b10740 1 -- start start 2024-09-21T05:57:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.824+0000 7fba11b10740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c852070 0x56432cbf92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.824+0000 7fba11b10740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c8291b0 0x56432cbf9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.824+0000 7fba11b10740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c831390 0x56432cbf9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.824+0000 7fba11b10740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56432cb6fea0 con 0x56432c8291b0 2024-09-21T05:57:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.824+0000 7fba11b10740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56432cb5f2d0 con 0x56432c852070 2024-09-21T05:57:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.824+0000 7fba11b10740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56432cb630e0 con 0x56432c831390 2024-09-21T05:57:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.824+0000 7fba09338640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c8291b0 0x56432cbf9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.824+0000 7fba09338640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c8291b0 0x56432cbf9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49834/0 (socket says 172.21.15.7:49834) 2024-09-21T05:57:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.824+0000 7fba09338640 1 -- 172.21.15.7:0/131607704 learned_addr learned my addr 172.21.15.7:0/131607704 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.824+0000 7fba08b37640 1 --2- 172.21.15.7:0/131607704 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c852070 0x56432cbf92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.825+0000 7fba08b37640 1 --2- 172.21.15.7:0/131607704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c831390 0x56432cbf9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.825+0000 7fb9fa7fc640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9f00b66b0 0x7fb9f00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.825+0000 7fba09338640 1 -- 172.21.15.7:0/131607704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c831390 msgr2=0x56432cbf9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.825+0000 7fba09338640 1 --2- 172.21.15.7:0/131607704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c831390 0x56432cbf9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.825+0000 7fba09338640 1 -- 172.21.15.7:0/131607704 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c852070 msgr2=0x56432cbf92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.825+0000 7fba09338640 1 --2- 172.21.15.7:0/131607704 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c852070 0x56432cbf92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.825+0000 7fba09338640 1 -- 172.21.15.7:0/131607704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432c8bd650 con 0x56432c8291b0 2024-09-21T05:57:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.825+0000 7fba09b39640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9f00b66b0 0x7fb9f00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.825+0000 7fba09338640 1 --2- 172.21.15.7:0/131607704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c8291b0 0x56432cbf9800 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fba0000ad00 tx=0x7fba0000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b7abd484083083 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.825+0000 7fb9fa7fc640 1 -- 172.21.15.7:0/643554886 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb9fc108b40 con 0x7fba04108d20 2024-09-21T05:57:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.825+0000 7fb9ef7fe640 1 -- 172.21.15.7:0/131607704 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0001d070 con 0x56432c8291b0 2024-09-21T05:57:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.825+0000 7fb9ef7fe640 1 -- 172.21.15.7:0/131607704 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba00018af0 con 0x56432c8291b0 2024-09-21T05:57:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.825+0000 7fb9ef7fe640 1 -- 172.21.15.7:0/131607704 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00010a50 con 0x56432c8291b0 2024-09-21T05:57:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.826+0000 7fba11b10740 1 -- 172.21.15.7:0/131607704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c8291b0 msgr2=0x56432cbf9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.826+0000 7fba09b39640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9f00b66b0 0x7fb9f00b8bc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0ce710 tx=0x7fb9fc09be00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.826+0000 7fba11b10740 1 --2- 172.21.15.7:0/131607704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c8291b0 0x56432cbf9800 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fba0000ad00 tx=0x7fba0000f790 comp rx=0 tx=0).stop 2024-09-21T05:57:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.826+0000 7fba11b10740 1 -- 172.21.15.7:0/131607704 shutdown_connections 2024-09-21T05:57:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.826+0000 7fba11b10740 1 --2- 172.21.15.7:0/131607704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c8291b0 0x56432cbf9800 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.826+0000 7fba11b10740 1 --2- 172.21.15.7:0/131607704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c831390 0x56432cbf9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.826+0000 7fba11b10740 1 --2- 172.21.15.7:0/131607704 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c852070 0x56432cbf92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.826+0000 7fba11b10740 1 -- 172.21.15.7:0/131607704 >> 172.21.15.7:0/131607704 conn(0x56432c846460 msgr2=0x56432cbf71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.826+0000 7fba11b10740 1 -- 172.21.15.7:0/131607704 shutdown_connections 2024-09-21T05:57:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.827+0000 7fba11b10740 1 -- 172.21.15.7:0/131607704 wait complete. 2024-09-21T05:57:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.827+0000 7fba11b10740 1 -- start start 2024-09-21T05:57:11.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.827+0000 7fba11b10740 1 Processor -- start 2024-09-21T05:57:11.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.827+0000 7fba11b10740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 0x56432cc049b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.827+0000 7fba11b10740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 0x56432cc04ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.827+0000 7fba11b10740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c852070 0x56432cc10d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.827+0000 7fba11b10740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56432c9c0700 con 0x56432c831390 2024-09-21T05:57:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.827+0000 7fba11b10740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56432cafa160 con 0x56432c8291b0 2024-09-21T05:57:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.827+0000 7fba11b10740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56432cc07aa0 con 0x56432c852070 2024-09-21T05:57:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba11b10740 10 client.0 _ll_register_callbacks cb 0x56432cb139e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba09338640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 0x56432cc04ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba09338640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 0x56432cc04ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49846/0 (socket says 172.21.15.7:49846) 2024-09-21T05:57:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba09338640 1 -- 172.21.15.7:0/156890692 learned_addr learned my addr 172.21.15.7:0/156890692 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba08b37640 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 0x56432cc049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba08b37640 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c852070 0x56432cc10d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba09338640 1 -- 172.21.15.7:0/156890692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c852070 msgr2=0x56432cc10d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba09338640 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c852070 0x56432cc10d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba09338640 1 -- 172.21.15.7:0/156890692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 msgr2=0x56432cc049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:11.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba09338640 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 0x56432cc049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba09338640 1 -- 172.21.15.7:0/156890692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432cb27c90 con 0x56432c831390 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba08b37640 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c852070 0x56432cc10d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba09338640 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 0x56432cc04ef0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fba000105f0 tx=0x7fba00018650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04e2d86f7e906a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fb9ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fb9ecff9640 1 -- 172.21.15.7:0/156890692 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0001d040 con 0x56432c831390 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fb9ecff9640 1 -- 172.21.15.7:0/156890692 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fba00005040 con 0x56432c831390 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.828+0000 7fba11b10740 1 -- 172.21.15.7:0/156890692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba00018af0 con 0x56432c831390 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.829+0000 7fb9ecff9640 1 -- 172.21.15.7:0/156890692 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba00005240 con 0x56432c831390 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.829+0000 7fba11b10740 10 client.16200 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.829+0000 7fba11b10740 1 -- 172.21.15.7:0/156890692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56432cc13780 con 0x56432c831390 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.829+0000 7fb9ecff9640 1 -- 172.21.15.7:0/156890692 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba00018af0 con 0x56432c831390 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.829+0000 7fb9ecff9640 1 -- 172.21.15.7:0/156890692 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba00020030 con 0x56432c831390 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.829+0000 7fba11b10740 10 client.16200 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:11.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.829+0000 7fba11b10740 10 client.16200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.829+0000 7fba11b10740 20 client.16200 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.829+0000 7fba11b10740 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56432c8109f0 0x56432cc16ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.829+0000 7fba11b10740 4 client.16200 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.829+0000 7fba11b10740 1 -- 172.21.15.7:0/156890692 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56432cb71df0 con 0x56432c8109f0 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.830+0000 7fba08b37640 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56432c8109f0 0x56432cc16ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.830+0000 7fb9ecff9640 10 client.16200 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.830+0000 7fba08b37640 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56432c8109f0 0x56432cc16ae0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9d704ff9fb8ebc2 server_cookie=84f6ebd44a0ffb36 in_seq=0 out_seq=0 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fb9ecff9640 1 -- 172.21.15.7:0/156890692 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56432cb71df0 con 0x56432c8109f0 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fb9ecff9640 10 client.16200 handle_command_reply: tid=0 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fba11b10740 1 client.16200 shutdown 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fba11b10740 1 -- 172.21.15.7:0/156890692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 msgr2=0x56432cc04ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fba11b10740 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 0x56432cc04ef0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fba000105f0 tx=0x7fba00018650 comp rx=0 tx=0).stop 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fba11b10740 1 -- 172.21.15.7:0/156890692 shutdown_connections 2024-09-21T05:57:11.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fba11b10740 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56432c8109f0 0x56432cc16ae0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fba11b10740 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 0x56432cc04ef0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fba11b10740 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c852070 0x56432cc10d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fba11b10740 1 --2- 172.21.15.7:0/156890692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 0x56432cc049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fba11b10740 1 -- 172.21.15.7:0/156890692 >> 172.21.15.7:0/156890692 conn(0x56432c846460 msgr2=0x56432cbfc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fb9ecff9640 0 client.16200 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fba11b10740 1 -- 172.21.15.7:0/156890692 shutdown_connections 2024-09-21T05:57:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fba11b10740 1 -- 172.21.15.7:0/156890692 wait complete. 2024-09-21T05:57:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.831+0000 7fba11b10740 20 client.16200 trim_cache size 0 max 16384 2024-09-21T05:57:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.844+0000 7fba11b10740 1 Processor -- start 2024-09-21T05:57:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.844+0000 7fba11b10740 1 -- start start 2024-09-21T05:57:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba11b10740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 0x56432cc04e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba11b10740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 0x56432cc10d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba11b10740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c852070 0x56432cbf6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba11b10740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba041b1e50 con 0x56432c831390 2024-09-21T05:57:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba11b10740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fba041af720 con 0x56432c8291b0 2024-09-21T05:57:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba11b10740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fba041ad570 con 0x56432c852070 2024-09-21T05:57:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba09338640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 0x56432cc10d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba09338640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 0x56432cc10d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49856/0 (socket says 172.21.15.7:49856) 2024-09-21T05:57:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba09338640 1 -- 172.21.15.7:0/739657349 learned_addr learned my addr 172.21.15.7:0/739657349 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba08b37640 1 --2- 172.21.15.7:0/739657349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c852070 0x56432cbf6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba08b37640 1 --2- 172.21.15.7:0/739657349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 0x56432cc04e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba09338640 1 -- 172.21.15.7:0/739657349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c852070 msgr2=0x56432cbf6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba09338640 1 --2- 172.21.15.7:0/739657349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c852070 0x56432cbf6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba09338640 1 -- 172.21.15.7:0/739657349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 msgr2=0x56432cc04e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba09338640 1 --2- 172.21.15.7:0/739657349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 0x56432cc04e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba09338640 1 -- 172.21.15.7:0/739657349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432c810c20 con 0x56432c831390 2024-09-21T05:57:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.845+0000 7fba09338640 1 --2- 172.21.15.7:0/739657349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 0x56432cc10d00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fba0000a7b0 tx=0x7fba00005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fc27201ae9f988 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.846+0000 7fb9eeffd640 1 -- 172.21.15.7:0/739657349 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0001d040 con 0x56432c831390 2024-09-21T05:57:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.846+0000 7fb9eeffd640 1 -- 172.21.15.7:0/739657349 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba00028070 con 0x56432c831390 2024-09-21T05:57:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.846+0000 7fb9eeffd640 1 -- 172.21.15.7:0/739657349 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00010b50 con 0x56432c831390 2024-09-21T05:57:11.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.846+0000 7fba11b10740 1 -- 172.21.15.7:0/739657349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 msgr2=0x56432cc10d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:11.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.846+0000 7fba11b10740 1 --2- 172.21.15.7:0/739657349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 0x56432cc10d00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fba0000a7b0 tx=0x7fba00005e40 comp rx=0 tx=0).stop 2024-09-21T05:57:11.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.846+0000 7fba11b10740 1 -- 172.21.15.7:0/739657349 shutdown_connections 2024-09-21T05:57:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.846+0000 7fba11b10740 1 --2- 172.21.15.7:0/739657349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c831390 0x56432cc10d00 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.846+0000 7fba11b10740 1 --2- 172.21.15.7:0/739657349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c852070 0x56432cbf6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.846+0000 7fba11b10740 1 --2- 172.21.15.7:0/739657349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 0x56432cc04e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.846+0000 7fba11b10740 1 -- 172.21.15.7:0/739657349 >> 172.21.15.7:0/739657349 conn(0x56432c846460 msgr2=0x56432cc04760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.846+0000 7fba11b10740 1 -- 172.21.15.7:0/739657349 shutdown_connections 2024-09-21T05:57:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.847+0000 7fba11b10740 1 -- 172.21.15.7:0/739657349 wait complete. 2024-09-21T05:57:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.847+0000 7fba11b10740 1 -- start start 2024-09-21T05:57:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.847+0000 7fba11b10740 1 Processor -- start 2024-09-21T05:57:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.847+0000 7fba11b10740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 0x56432cc1a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.847+0000 7fba11b10740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c831390 0x56432cc175d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.847+0000 7fba11b10740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c852070 0x56432cc17b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.847+0000 7fba11b10740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba041adbe0 con 0x56432c852070 2024-09-21T05:57:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.847+0000 7fba11b10740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fba041af050 con 0x56432c8291b0 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.847+0000 7fba11b10740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fba041ae2b0 con 0x56432c831390 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.847+0000 7fba11b10740 10 client.0 _ll_register_callbacks cb 0x7fba0001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba08b37640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c852070 0x56432cc17b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba09338640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c831390 0x56432cc175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba09338640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c831390 0x56432cc175d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:41342/0 (socket says 172.21.15.7:41342) 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba09338640 1 -- 172.21.15.7:0/4185479810 learned_addr learned my addr 172.21.15.7:0/4185479810 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba08b37640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c852070 0x56432cc17b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49860/0 (socket says 172.21.15.7:49860) 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba08b37640 1 --2- 172.21.15.7:0/4185479810 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 0x56432cc1a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba09338640 1 -- 172.21.15.7:0/4185479810 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 msgr2=0x56432cc1a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba09338640 1 --2- 172.21.15.7:0/4185479810 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 0x56432cc1a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba09338640 1 -- 172.21.15.7:0/4185479810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c852070 msgr2=0x56432cc17b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba09338640 1 --2- 172.21.15.7:0/4185479810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c852070 0x56432cc17b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba09338640 1 -- 172.21.15.7:0/4185479810 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432cc180a0 con 0x56432c831390 2024-09-21T05:57:11.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba08b37640 1 --2- 172.21.15.7:0/4185479810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c852070 0x56432cc17b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:57:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba09338640 1 --2- 172.21.15.7:0/4185479810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c831390 0x56432cc175d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba00010770 tx=0x7fba0000a580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f79037b25c34412c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fb9ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:57:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fb9ecff9640 1 -- 172.21.15.7:0/4185479810 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0001d040 con 0x56432c831390 2024-09-21T05:57:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fba11b10740 1 -- 172.21.15.7:0/4185479810 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba00028070 con 0x56432c831390 2024-09-21T05:57:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.848+0000 7fb9ecff9640 1 -- 172.21.15.7:0/4185479810 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fba00023440 con 0x56432c831390 2024-09-21T05:57:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.849+0000 7fb9ecff9640 1 -- 172.21.15.7:0/4185479810 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba000109d0 con 0x56432c831390 2024-09-21T05:57:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.849+0000 7fba11b10740 10 client.25795 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.849+0000 7fba11b10740 1 -- 172.21.15.7:0/4185479810 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56432cc80fa0 con 0x56432c831390 2024-09-21T05:57:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.849+0000 7fb9ecff9640 1 -- 172.21.15.7:0/4185479810 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba00028070 con 0x56432c831390 2024-09-21T05:57:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.849+0000 7fb9ecff9640 1 -- 172.21.15.7:0/4185479810 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba00034030 con 0x56432c831390 2024-09-21T05:57:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.849+0000 7fba11b10740 10 client.25795 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.849+0000 7fba11b10740 10 client.25795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:11.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.849+0000 7fba11b10740 20 client.25795 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.849+0000 7fba11b10740 1 --2- 172.21.15.7:0/4185479810 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56432c7e5da0 0x56432cc835e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.849+0000 7fba11b10740 4 client.25795 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.849+0000 7fba11b10740 1 -- 172.21.15.7:0/4185479810 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56432cb6d8a0 con 0x56432c7e5da0 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.849+0000 7fba08b37640 1 --2- 172.21.15.7:0/4185479810 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56432c7e5da0 0x56432cc835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fba08b37640 1 --2- 172.21.15.7:0/4185479810 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56432c7e5da0 0x56432cc835e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfe398ac8eedcd18 server_cookie=6747311d48b7bb90 in_seq=0 out_seq=0 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fb9ecff9640 10 client.25795 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fb9ecff9640 1 -- 172.21.15.7:0/4185479810 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56432cb6d8a0 con 0x56432c7e5da0 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fb9ecff9640 10 client.25795 handle_command_reply: tid=0 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fba11b10740 1 client.25795 shutdown 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fba11b10740 1 -- 172.21.15.7:0/4185479810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c831390 msgr2=0x56432cc175d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fba11b10740 1 --2- 172.21.15.7:0/4185479810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c831390 0x56432cc175d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba00010770 tx=0x7fba0000a580 comp rx=0 tx=0).stop 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fba11b10740 1 -- 172.21.15.7:0/4185479810 shutdown_connections 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fba11b10740 1 --2- 172.21.15.7:0/4185479810 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56432c7e5da0 0x56432cc835e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fba11b10740 1 --2- 172.21.15.7:0/4185479810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432c852070 0x56432cc17b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fba11b10740 1 --2- 172.21.15.7:0/4185479810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56432c831390 0x56432cc175d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fba11b10740 1 --2- 172.21.15.7:0/4185479810 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56432c8291b0 0x56432cc1a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fb9ecff9640 0 client.25795 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fba11b10740 1 -- 172.21.15.7:0/4185479810 >> 172.21.15.7:0/4185479810 conn(0x56432c846460 msgr2=0x56432cbfc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fba11b10740 1 -- 172.21.15.7:0/4185479810 shutdown_connections 2024-09-21T05:57:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.850+0000 7fba11b10740 1 -- 172.21.15.7:0/4185479810 wait complete. 2024-09-21T05:57:11.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.851+0000 7fba11b10740 20 client.25795 trim_cache size 0 max 16384 2024-09-21T05:57:11.858 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:57:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.851+0000 7fba0b59c640 1 -- 172.21.15.7:0/643554886 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9f00b66b0 msgr2=0x7fb9f00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.851+0000 7fba0b59c640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9f00b66b0 0x7fb9f00b8bc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0ce710 tx=0x7fb9fc09be00 comp rx=0 tx=0).stop 2024-09-21T05:57:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.851+0000 7fba0b59c640 1 -- 172.21.15.7:0/643554886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba04108d20 msgr2=0x7fba0419fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.851+0000 7fba0b59c640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba04108d20 0x7fba0419fcc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc005cc0 tx=0x7fb9fc02f470 comp rx=0 tx=0).stop 2024-09-21T05:57:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.851+0000 7fba0b59c640 1 -- 172.21.15.7:0/643554886 shutdown_connections 2024-09-21T05:57:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.851+0000 7fba0b59c640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9f00b66b0 0x7fb9f00b8bc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.851+0000 7fba0b59c640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba04108d20 0x7fba0419fcc0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.851+0000 7fba0b59c640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba041083d0 0x7fba0419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.851+0000 7fba0b59c640 1 --2- 172.21.15.7:0/643554886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba04102ae0 0x7fba0419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.851+0000 7fba0b59c640 1 -- 172.21.15.7:0/643554886 >> 172.21.15.7:0/643554886 conn(0x7fba04079760 msgr2=0x7fba04105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.851+0000 7fba0b59c640 1 -- 172.21.15.7:0/643554886 shutdown_connections 2024-09-21T05:57:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:11.851+0000 7fba0b59c640 1 -- 172.21.15.7:0/643554886 wait complete. 2024-09-21T05:57:11.894 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:11 smithi119 ceph-mon[34833]: pgmap v417: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:57:11.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:11 smithi027 ceph-mon[34364]: pgmap v417: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:57:13.562 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T05:57:13.562 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T05:57:13.834 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:13.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:13 smithi007 ceph-mon[30983]: pgmap v418: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T05:57:13.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:13 smithi027 ceph-mon[34364]: pgmap v418: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T05:57:14.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:13 smithi119 ceph-mon[34833]: pgmap v418: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T05:57:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.298+0000 7f08e77a6640 1 -- 172.21.15.7:0/2086681810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0104a30 msgr2=0x7f08e0104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.298+0000 7f08e77a6640 1 --2- 172.21.15.7:0/2086681810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0104a30 0x7f08e0104e40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009900 tx=0x7f08dc02a410 comp rx=0 tx=0).stop 2024-09-21T05:57:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.298+0000 7f08e77a6640 1 -- 172.21.15.7:0/2086681810 shutdown_connections 2024-09-21T05:57:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.298+0000 7f08e77a6640 1 --2- 172.21.15.7:0/2086681810 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08e010de60 0x7f08e0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.298+0000 7f08e77a6640 1 --2- 172.21.15.7:0/2086681810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08e0105380 0x7f08e010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.298+0000 7f08e77a6640 1 --2- 172.21.15.7:0/2086681810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0104a30 0x7f08e0104e40 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.298+0000 7f08e77a6640 1 -- 172.21.15.7:0/2086681810 >> 172.21.15.7:0/2086681810 conn(0x7f08e0079760 msgr2=0x7f08e0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.298+0000 7f08e77a6640 1 -- 172.21.15.7:0/2086681810 shutdown_connections 2024-09-21T05:57:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.298+0000 7f08e77a6640 1 -- 172.21.15.7:0/2086681810 wait complete. 2024-09-21T05:57:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e77a6640 1 Processor -- start 2024-09-21T05:57:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e77a6640 1 -- start start 2024-09-21T05:57:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e77a6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08e0104a30 0x7f08e019c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e77a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0105380 0x7f08e019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e77a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08e010de60 0x7f08e01a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e77a6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0113b10 con 0x7f08e0105380 2024-09-21T05:57:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e77a6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0113990 con 0x7f08e0104a30 2024-09-21T05:57:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e77a6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0113c90 con 0x7f08e010de60 2024-09-21T05:57:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e4d41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0105380 0x7f08e019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e4d41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0105380 0x7f08e019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49884/0 (socket says 172.21.15.7:49884) 2024-09-21T05:57:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e4d41640 1 -- 172.21.15.7:0/2749673343 learned_addr learned my addr 172.21.15.7:0/2749673343 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e5542640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08e0104a30 0x7f08e019c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e5d43640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08e010de60 0x7f08e01a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e4d41640 1 -- 172.21.15.7:0/2749673343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08e010de60 msgr2=0x7f08e01a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e4d41640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08e010de60 0x7f08e01a1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e4d41640 1 -- 172.21.15.7:0/2749673343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08e0104a30 msgr2=0x7f08e019c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e4d41640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08e0104a30 0x7f08e019c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.299+0000 7f08e4d41640 1 -- 172.21.15.7:0/2749673343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e01a26f0 con 0x7f08e0105380 2024-09-21T05:57:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.300+0000 7f08e4d41640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0105380 0x7f08e019cd20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f08d000d750 tx=0x7f08d000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.300+0000 7f08d67fc640 1 -- 172.21.15.7:0/2749673343 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d0017070 con 0x7f08e0105380 2024-09-21T05:57:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.300+0000 7f08d67fc640 1 -- 172.21.15.7:0/2749673343 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08d00054d0 con 0x7f08e0105380 2024-09-21T05:57:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.300+0000 7f08d67fc640 1 -- 172.21.15.7:0/2749673343 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d0004c30 con 0x7f08e0105380 2024-09-21T05:57:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.300+0000 7f08e77a6640 1 -- 172.21.15.7:0/2749673343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e01a29e0 con 0x7f08e0105380 2024-09-21T05:57:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.300+0000 7f08e77a6640 1 -- 172.21.15.7:0/2749673343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e01a9140 con 0x7f08e0105380 2024-09-21T05:57:14.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.303+0000 7f08edd1a740 1 Processor -- start 2024-09-21T05:57:14.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.303+0000 7f08edd1a740 1 -- start start 2024-09-21T05:57:14.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.303+0000 7f08d67fc640 1 -- 172.21.15.7:0/2749673343 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f08d0004dd0 con 0x7f08e0105380 2024-09-21T05:57:14.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.303+0000 7f08edd1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7d3350 0x55929ab7a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.303+0000 7f08edd1a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7aa490 0x55929ab7a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.303+0000 7f08edd1a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 0x55929ab7aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.303+0000 7f08edd1a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55929aaf0e60 con 0x55929a7b2670 2024-09-21T05:57:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.303+0000 7f08edd1a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55929aae0290 con 0x55929a7aa490 2024-09-21T05:57:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.303+0000 7f08edd1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55929aae40a0 con 0x55929a7d3350 2024-09-21T05:57:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.303+0000 7f08e4d41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 0x55929ab7aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.303+0000 7f08e4d41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 0x55929ab7aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49890/0 (socket says 172.21.15.7:49890) 2024-09-21T05:57:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.304+0000 7f08e4d41640 1 -- 172.21.15.7:0/1280397990 learned_addr learned my addr 172.21.15.7:0/1280397990 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.304+0000 7f08e5d43640 1 --2- 172.21.15.7:0/1280397990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7d3350 0x55929ab7a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.304+0000 7f08e5542640 1 --2- 172.21.15.7:0/1280397990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7aa490 0x55929ab7a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.304+0000 7f08e4d41640 1 -- 172.21.15.7:0/1280397990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7d3350 msgr2=0x55929ab7a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.304+0000 7f08e4d41640 1 --2- 172.21.15.7:0/1280397990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7d3350 0x55929ab7a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.304+0000 7f08e4d41640 1 -- 172.21.15.7:0/1280397990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7aa490 msgr2=0x55929ab7a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.304+0000 7f08e4d41640 1 --2- 172.21.15.7:0/1280397990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7aa490 0x55929ab7a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.304+0000 7f08e4d41640 1 -- 172.21.15.7:0/1280397990 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929a83e930 con 0x55929a7b2670 2024-09-21T05:57:14.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.304+0000 7f08d67fc640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f08cc0b6680 0x7f08cc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.304+0000 7f08e4d41640 1 --2- 172.21.15.7:0/1280397990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 0x55929ab7aeb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f08d00e4750 tx=0x7f08d00ef700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1781e447c35d2e94 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:14.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.304+0000 7f08e5d43640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f08cc0b6680 0x7f08cc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.304+0000 7f08cb7fe640 1 -- 172.21.15.7:0/1280397990 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d00a95e0 con 0x55929a7b2670 2024-09-21T05:57:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.305+0000 7f08cb7fe640 1 -- 172.21.15.7:0/1280397990 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08d00acaa0 con 0x55929a7b2670 2024-09-21T05:57:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.305+0000 7f08d67fc640 1 -- 172.21.15.7:0/2749673343 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f08d00e7010 con 0x7f08e0105380 2024-09-21T05:57:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.305+0000 7f08cb7fe640 1 -- 172.21.15.7:0/1280397990 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d00c1880 con 0x55929a7b2670 2024-09-21T05:57:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.305+0000 7f08edd1a740 1 -- 172.21.15.7:0/1280397990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 msgr2=0x55929ab7aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.305+0000 7f08e5d43640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f08cc0b6680 0x7f08cc0b8b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f08d8005fd0 tx=0x7f08d80096a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.305+0000 7f08edd1a740 1 --2- 172.21.15.7:0/1280397990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 0x55929ab7aeb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f08d00e4750 tx=0x7f08d00ef700 comp rx=0 tx=0).stop 2024-09-21T05:57:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.306+0000 7f08edd1a740 1 -- 172.21.15.7:0/1280397990 shutdown_connections 2024-09-21T05:57:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.306+0000 7f08edd1a740 1 --2- 172.21.15.7:0/1280397990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 0x55929ab7aeb0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.306+0000 7f08edd1a740 1 --2- 172.21.15.7:0/1280397990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7aa490 0x55929ab7a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.306+0000 7f08edd1a740 1 --2- 172.21.15.7:0/1280397990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7d3350 0x55929ab7a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.306+0000 7f08edd1a740 1 -- 172.21.15.7:0/1280397990 >> 172.21.15.7:0/1280397990 conn(0x55929a7c7740 msgr2=0x55929ab78320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.306+0000 7f08edd1a740 1 -- 172.21.15.7:0/1280397990 shutdown_connections 2024-09-21T05:57:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.306+0000 7f08edd1a740 1 -- 172.21.15.7:0/1280397990 wait complete. 2024-09-21T05:57:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.306+0000 7f08edd1a740 1 -- start start 2024-09-21T05:57:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.306+0000 7f08edd1a740 1 Processor -- start 2024-09-21T05:57:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08edd1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7aa490 0x55929ab85f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08edd1a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 0x55929ab86450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08edd1a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7d3350 0x55929ab91f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08edd1a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55929a941890 con 0x55929a7b2670 2024-09-21T05:57:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08edd1a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55929aa7ad40 con 0x55929a7d3350 2024-09-21T05:57:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08edd1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55929ab88c10 con 0x55929a7aa490 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08edd1a740 10 client.0 _ll_register_callbacks cb 0x55929aadec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08e4d41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 0x55929ab86450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08e4d41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 0x55929ab86450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49904/0 (socket says 172.21.15.7:49904) 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08e4d41640 1 -- 172.21.15.7:0/654253971 learned_addr learned my addr 172.21.15.7:0/654253971 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08e5542640 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7aa490 0x55929ab85f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08e5d43640 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7d3350 0x55929ab91f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08e4d41640 1 -- 172.21.15.7:0/654253971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7aa490 msgr2=0x55929ab85f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08e4d41640 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7aa490 0x55929ab85f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08e4d41640 1 -- 172.21.15.7:0/654253971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7d3350 msgr2=0x55929ab91f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08e4d41640 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7d3350 0x55929ab91f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08e4d41640 1 -- 172.21.15.7:0/654253971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55929ab92440 con 0x55929a7b2670 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08e5542640 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7aa490 0x55929ab85f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08e4d41640 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 0x55929ab86450 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f08d00acc90 tx=0x7f08d0009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8c1d7fc99d8fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.307+0000 7f08c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08c8ff9640 1 -- 172.21.15.7:0/654253971 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d00b9070 con 0x55929a7b2670 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08c8ff9640 1 -- 172.21.15.7:0/654253971 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f08d00e4a60 con 0x55929a7b2670 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08edd1a740 1 -- 172.21.15.7:0/654253971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08d00acaa0 con 0x55929a7b2670 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08c8ff9640 1 -- 172.21.15.7:0/654253971 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f08d00b7de0 con 0x55929a7b2670 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08edd1a740 10 client.16218 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08edd1a740 1 -- 172.21.15.7:0/654253971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55929ab94d20 con 0x55929a7b2670 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08c8ff9640 1 -- 172.21.15.7:0/654253971 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08d00acaa0 con 0x55929a7b2670 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08c8ff9640 1 -- 172.21.15.7:0/654253971 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f08d00b1030 con 0x55929a7b2670 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08edd1a740 10 client.16218 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08edd1a740 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08edd1a740 20 client.16218 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08edd1a740 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55929a791cd0 0x55929ab98080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08edd1a740 4 client.16218 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:57:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.308+0000 7f08edd1a740 1 -- 172.21.15.7:0/654253971 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55929aaf2db0 con 0x55929a791cd0 2024-09-21T05:57:14.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.309+0000 7f08e5542640 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55929a791cd0 0x55929ab98080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.309+0000 7f08e5542640 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55929a791cd0 0x55929ab98080 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54b4a2f7eb9d612c server_cookie=dbe7e5c3bb9f28b7 in_seq=0 out_seq=0 2024-09-21T05:57:14.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.309+0000 7f08c8ff9640 10 client.16218 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08c8ff9640 1 -- 172.21.15.7:0/654253971 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55929aaf2db0 con 0x55929a791cd0 2024-09-21T05:57:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08c8ff9640 10 client.16218 handle_command_reply: tid=0 2024-09-21T05:57:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08edd1a740 1 client.16218 shutdown 2024-09-21T05:57:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08edd1a740 1 -- 172.21.15.7:0/654253971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 msgr2=0x55929ab86450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08edd1a740 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 0x55929ab86450 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f08d00acc90 tx=0x7f08d0009f00 comp rx=0 tx=0).stop 2024-09-21T05:57:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08edd1a740 1 -- 172.21.15.7:0/654253971 shutdown_connections 2024-09-21T05:57:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08edd1a740 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55929a791cd0 0x55929ab98080 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08edd1a740 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7b2670 0x55929ab86450 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08edd1a740 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7d3350 0x55929ab91f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08edd1a740 1 --2- 172.21.15.7:0/654253971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7aa490 0x55929ab85f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08edd1a740 1 -- 172.21.15.7:0/654253971 >> 172.21.15.7:0/654253971 conn(0x55929a7c7740 msgr2=0x55929ab7d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08c8ff9640 0 client.16218 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08edd1a740 1 -- 172.21.15.7:0/654253971 shutdown_connections 2024-09-21T05:57:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.310+0000 7f08edd1a740 1 -- 172.21.15.7:0/654253971 wait complete. 2024-09-21T05:57:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.311+0000 7f08edd1a740 20 client.16218 trim_cache size 0 max 16384 2024-09-21T05:57:14.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.328+0000 7f08edd1a740 1 Processor -- start 2024-09-21T05:57:14.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.328+0000 7f08edd1a740 1 -- start start 2024-09-21T05:57:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.328+0000 7f08edd1a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7aa490 0x55929ab80550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.328+0000 7f08edd1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7b2670 0x55929ab87940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.328+0000 7f08edd1a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 0x55929ab82f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08edd1a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01b40e0 con 0x55929a7d3350 2024-09-21T05:57:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08edd1a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01b19b0 con 0x55929a7aa490 2024-09-21T05:57:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08edd1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01af800 con 0x55929a7b2670 2024-09-21T05:57:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08e5d43640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 0x55929ab82f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08e5d43640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 0x55929ab82f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49914/0 (socket says 172.21.15.7:49914) 2024-09-21T05:57:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08e5d43640 1 -- 172.21.15.7:0/93682444 learned_addr learned my addr 172.21.15.7:0/93682444 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08e5542640 1 --2- 172.21.15.7:0/93682444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7aa490 0x55929ab80550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08e4d41640 1 --2- 172.21.15.7:0/93682444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7b2670 0x55929ab87940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08e5d43640 1 -- 172.21.15.7:0/93682444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7b2670 msgr2=0x55929ab87940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08e5d43640 1 --2- 172.21.15.7:0/93682444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7b2670 0x55929ab87940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08e5d43640 1 -- 172.21.15.7:0/93682444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7aa490 msgr2=0x55929ab80550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08e5d43640 1 --2- 172.21.15.7:0/93682444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7aa490 0x55929ab80550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08e5d43640 1 -- 172.21.15.7:0/93682444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929ab72520 con 0x55929a7d3350 2024-09-21T05:57:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08e5d43640 1 --2- 172.21.15.7:0/93682444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 0x55929ab82f00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f08d80108c0 tx=0x7f08d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b430dcdd172d593 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08caffd640 1 -- 172.21.15.7:0/93682444 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d8010d80 con 0x55929a7d3350 2024-09-21T05:57:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08caffd640 1 -- 172.21.15.7:0/93682444 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08d801f930 con 0x55929a7d3350 2024-09-21T05:57:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.329+0000 7f08caffd640 1 -- 172.21.15.7:0/93682444 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d8005380 con 0x55929a7d3350 2024-09-21T05:57:14.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.330+0000 7f08edd1a740 1 -- 172.21.15.7:0/93682444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 msgr2=0x55929ab82f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:14.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.330+0000 7f08edd1a740 1 --2- 172.21.15.7:0/93682444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 0x55929ab82f00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f08d80108c0 tx=0x7f08d8016000 comp rx=0 tx=0).stop 2024-09-21T05:57:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.330+0000 7f08edd1a740 1 -- 172.21.15.7:0/93682444 shutdown_connections 2024-09-21T05:57:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.330+0000 7f08edd1a740 1 --2- 172.21.15.7:0/93682444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 0x55929ab82f00 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.330+0000 7f08edd1a740 1 --2- 172.21.15.7:0/93682444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7b2670 0x55929ab87940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.330+0000 7f08edd1a740 1 --2- 172.21.15.7:0/93682444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7aa490 0x55929ab80550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.330+0000 7f08edd1a740 1 -- 172.21.15.7:0/93682444 >> 172.21.15.7:0/93682444 conn(0x55929a7c7740 msgr2=0x55929ab87230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.330+0000 7f08edd1a740 1 -- 172.21.15.7:0/93682444 shutdown_connections 2024-09-21T05:57:14.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.330+0000 7f08edd1a740 1 -- 172.21.15.7:0/93682444 wait complete. 2024-09-21T05:57:14.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.331+0000 7f08edd1a740 1 -- start start 2024-09-21T05:57:14.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.331+0000 7f08edd1a740 1 Processor -- start 2024-09-21T05:57:14.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.331+0000 7f08edd1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7aa490 0x55929ab99840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.331+0000 7f08edd1a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7b2670 0x55929ab99d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.331+0000 7f08edd1a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 0x55929ac01800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.331+0000 7f08edd1a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01afe70 con 0x55929a7d3350 2024-09-21T05:57:14.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.331+0000 7f08edd1a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01b12e0 con 0x55929a7b2670 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.331+0000 7f08edd1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01b0540 con 0x55929a7aa490 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.331+0000 7f08edd1a740 10 client.0 _ll_register_callbacks cb 0x7f08dc005e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08e5d43640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 0x55929ac01800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08e4d41640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7b2670 0x55929ab99d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08e5d43640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 0x55929ac01800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49920/0 (socket says 172.21.15.7:49920) 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08e5d43640 1 -- 172.21.15.7:0/1512179926 learned_addr learned my addr 172.21.15.7:0/1512179926 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08e5542640 1 --2- 172.21.15.7:0/1512179926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7aa490 0x55929ab99840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08e4d41640 1 -- 172.21.15.7:0/1512179926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7aa490 msgr2=0x55929ab99840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08e4d41640 1 --2- 172.21.15.7:0/1512179926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7aa490 0x55929ab99840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08e4d41640 1 -- 172.21.15.7:0/1512179926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 msgr2=0x55929ac01800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08e4d41640 1 --2- 172.21.15.7:0/1512179926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 0x55929ac01800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08e4d41640 1 -- 172.21.15.7:0/1512179926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55929ac01d90 con 0x55929a7b2670 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08e5d43640 1 --2- 172.21.15.7:0/1512179926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 0x55929ac01800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:57:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08e4d41640 1 --2- 172.21.15.7:0/1512179926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7b2670 0x55929ab99d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009610 tx=0x7f08d00eacb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e03e29eca18980e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:57:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08c8ff9640 1 -- 172.21.15.7:0/1512179926 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d00b9070 con 0x55929a7b2670 2024-09-21T05:57:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08edd1a740 1 -- 172.21.15.7:0/1512179926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08d801f930 con 0x55929a7b2670 2024-09-21T05:57:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.332+0000 7f08c8ff9640 1 -- 172.21.15.7:0/1512179926 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f08d00052c0 con 0x55929a7b2670 2024-09-21T05:57:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.333+0000 7f08c8ff9640 1 -- 172.21.15.7:0/1512179926 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f08d00d4040 con 0x55929a7b2670 2024-09-21T05:57:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.333+0000 7f08edd1a740 10 client.25883 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.333+0000 7f08edd1a740 1 -- 172.21.15.7:0/1512179926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55929ac03050 con 0x55929a7b2670 2024-09-21T05:57:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.333+0000 7f08c8ff9640 1 -- 172.21.15.7:0/1512179926 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08d801f930 con 0x55929a7b2670 2024-09-21T05:57:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.333+0000 7f08c8ff9640 1 -- 172.21.15.7:0/1512179926 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f08d00d41e0 con 0x55929a7b2670 2024-09-21T05:57:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.333+0000 7f08edd1a740 10 client.25883 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.333+0000 7f08edd1a740 10 client.25883 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.333+0000 7f08edd1a740 20 client.25883 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.333+0000 7f08edd1a740 1 --2- 172.21.15.7:0/1512179926 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55929a767080 0x55929ac05540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.333+0000 7f08edd1a740 4 client.25883 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T05:57:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.333+0000 7f08edd1a740 1 -- 172.21.15.7:0/1512179926 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55929aaee860 con 0x55929a767080 2024-09-21T05:57:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.333+0000 7f08e5542640 1 --2- 172.21.15.7:0/1512179926 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55929a767080 0x55929ac05540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.334+0000 7f08c8ff9640 10 client.25883 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.334+0000 7f08e5542640 1 --2- 172.21.15.7:0/1512179926 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55929a767080 0x55929ac05540 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be0ad91cfc3f6982 server_cookie=7ecd4e34365f42fd in_seq=0 out_seq=0 2024-09-21T05:57:14.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.335+0000 7f08c8ff9640 1 -- 172.21.15.7:0/1512179926 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55929aaee860 con 0x55929a767080 2024-09-21T05:57:14.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.335+0000 7f08c8ff9640 10 client.25883 handle_command_reply: tid=0 2024-09-21T05:57:14.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.335+0000 7f08edd1a740 1 client.25883 shutdown 2024-09-21T05:57:14.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08edd1a740 1 -- 172.21.15.7:0/1512179926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7b2670 msgr2=0x55929ab99d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:14.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08edd1a740 1 --2- 172.21.15.7:0/1512179926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7b2670 0x55929ab99d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009610 tx=0x7f08d00eacb0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08edd1a740 1 -- 172.21.15.7:0/1512179926 shutdown_connections 2024-09-21T05:57:14.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08edd1a740 1 --2- 172.21.15.7:0/1512179926 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55929a767080 0x55929ac05540 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08edd1a740 1 --2- 172.21.15.7:0/1512179926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55929a7d3350 0x55929ac01800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08edd1a740 1 --2- 172.21.15.7:0/1512179926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55929a7b2670 0x55929ab99d80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08c8ff9640 0 client.25883 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08edd1a740 1 --2- 172.21.15.7:0/1512179926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55929a7aa490 0x55929ab99840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08edd1a740 1 -- 172.21.15.7:0/1512179926 >> 172.21.15.7:0/1512179926 conn(0x55929a7c7740 msgr2=0x55929ab871c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08edd1a740 1 -- 172.21.15.7:0/1512179926 shutdown_connections 2024-09-21T05:57:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08edd1a740 1 -- 172.21.15.7:0/1512179926 wait complete. 2024-09-21T05:57:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08edd1a740 20 client.25883 trim_cache size 0 max 16384 2024-09-21T05:57:14.344 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:57:14.344 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T05:57:14.344 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "64dcdb40-1029-4909-9044-77c05eff7591", 2024-09-21T05:57:14.345 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T05:57:14.345 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:57:14.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08e77a6640 1 -- 172.21.15.7:0/2749673343 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f08cc0b6680 msgr2=0x7f08cc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:14.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.336+0000 7f08e77a6640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f08cc0b6680 0x7f08cc0b8b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f08d8005fd0 tx=0x7f08d80096a0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.337+0000 7f08e77a6640 1 -- 172.21.15.7:0/2749673343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0105380 msgr2=0x7f08e019cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:14.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.337+0000 7f08e77a6640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0105380 0x7f08e019cd20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f08d000d750 tx=0x7f08d000dc10 comp rx=0 tx=0).stop 2024-09-21T05:57:14.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.337+0000 7f08e77a6640 1 -- 172.21.15.7:0/2749673343 shutdown_connections 2024-09-21T05:57:14.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.337+0000 7f08e77a6640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f08cc0b6680 0x7f08cc0b8b90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.337+0000 7f08e77a6640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0105380 0x7f08e019cd20 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.337+0000 7f08e77a6640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08e010de60 0x7f08e01a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.337+0000 7f08e77a6640 1 --2- 172.21.15.7:0/2749673343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08e0104a30 0x7f08e019c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:14.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.337+0000 7f08e77a6640 1 -- 172.21.15.7:0/2749673343 >> 172.21.15.7:0/2749673343 conn(0x7f08e0079760 msgr2=0x7f08e00ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:14.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.337+0000 7f08e77a6640 1 -- 172.21.15.7:0/2749673343 shutdown_connections 2024-09-21T05:57:14.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:14.337+0000 7f08e77a6640 1 -- 172.21.15.7:0/2749673343 wait complete. 2024-09-21T05:57:15.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:57:15.405 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:15.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:15 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T05:57:15.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:15 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:57:15.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:15 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T05:57:15.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:15 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:57:15.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:15 smithi007 ceph-mon[30983]: pgmap v419: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T05:57:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.931+0000 7fc9a79cd640 1 -- 172.21.15.7:0/1397238749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a0109df0 msgr2=0x7fc9a0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.931+0000 7fc9a79cd640 1 --2- 172.21.15.7:0/1397238749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a0109df0 0x7fc9a0110620 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc998009ca0 tx=0x7fc99802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.931+0000 7fc9a79cd640 1 -- 172.21.15.7:0/1397238749 shutdown_connections 2024-09-21T05:57:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.931+0000 7fc9a79cd640 1 --2- 172.21.15.7:0/1397238749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a0109df0 0x7fc9a0110620 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.931+0000 7fc9a79cd640 1 --2- 172.21.15.7:0/1397238749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9a01094a0 0x7fc9a01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.931+0000 7fc9a79cd640 1 --2- 172.21.15.7:0/1397238749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9a0103b60 0x7fc9a0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.931+0000 7fc9a79cd640 1 -- 172.21.15.7:0/1397238749 >> 172.21.15.7:0/1397238749 conn(0x7fc9a007b850 msgr2=0x7fc9a007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.931+0000 7fc9a79cd640 1 -- 172.21.15.7:0/1397238749 shutdown_connections 2024-09-21T05:57:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.932+0000 7fc9a79cd640 1 -- 172.21.15.7:0/1397238749 wait complete. 2024-09-21T05:57:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.932+0000 7fc9a79cd640 1 Processor -- start 2024-09-21T05:57:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.932+0000 7fc9a79cd640 1 -- start start 2024-09-21T05:57:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a79cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a0103b60 0x7fc9a0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a79cd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9a01094a0 0x7fc9a0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a79cd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9a0109df0 0x7fc9a0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a79cd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a0113ab0 con 0x7fc9a0103b60 2024-09-21T05:57:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a79cd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a0113930 con 0x7fc9a01094a0 2024-09-21T05:57:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a79cd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a0113c30 con 0x7fc9a0109df0 2024-09-21T05:57:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a5769640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a0103b60 0x7fc9a0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a5769640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a0103b60 0x7fc9a0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49932/0 (socket says 172.21.15.7:49932) 2024-09-21T05:57:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a5769640 1 -- 172.21.15.7:0/1739186066 learned_addr learned my addr 172.21.15.7:0/1739186066 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a4f68640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9a01094a0 0x7fc9a0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a5f6a640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9a0109df0 0x7fc9a0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a5769640 1 -- 172.21.15.7:0/1739186066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9a0109df0 msgr2=0x7fc9a0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a5769640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9a0109df0 0x7fc9a0076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a5769640 1 -- 172.21.15.7:0/1739186066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9a01094a0 msgr2=0x7fc9a0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a5769640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9a01094a0 0x7fc9a0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a5769640 1 -- 172.21.15.7:0/1739186066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a01a8610 con 0x7fc9a0103b60 2024-09-21T05:57:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.933+0000 7fc9a5769640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a0103b60 0x7fc9a0075710 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00d950 tx=0x7fc99c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.934+0000 7fc9967fc640 1 -- 172.21.15.7:0/1739186066 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c017070 con 0x7fc9a0103b60 2024-09-21T05:57:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.934+0000 7fc9967fc640 1 -- 172.21.15.7:0/1739186066 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc99c009c30 con 0x7fc9a0103b60 2024-09-21T05:57:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.934+0000 7fc9967fc640 1 -- 172.21.15.7:0/1739186066 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00f620 con 0x7fc9a0103b60 2024-09-21T05:57:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.934+0000 7fc9a79cd640 1 -- 172.21.15.7:0/1739186066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a01a8900 con 0x7fc9a0103b60 2024-09-21T05:57:15.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.934+0000 7fc9a79cd640 1 -- 172.21.15.7:0/1739186066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a01a8df0 con 0x7fc9a0103b60 2024-09-21T05:57:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.937+0000 7fc9adf41740 1 Processor -- start 2024-09-21T05:57:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.937+0000 7fc9967fc640 1 -- 172.21.15.7:0/1739186066 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fc99c010460 con 0x7fc9a0103b60 2024-09-21T05:57:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.937+0000 7fc9adf41740 1 -- start start 2024-09-21T05:57:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.937+0000 7fc9adf41740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f9b0070 0x559c7fd57650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.937+0000 7fc9adf41740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd57b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.937+0000 7fc9adf41740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f98f390 0x559c7fd580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.937+0000 7fc9adf41740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559c7fccde50 con 0x559c7f9871b0 2024-09-21T05:57:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.937+0000 7fc9adf41740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559c7fcbd280 con 0x559c7f98f390 2024-09-21T05:57:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.937+0000 7fc9adf41740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559c7fcc1090 con 0x559c7f9b0070 2024-09-21T05:57:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.938+0000 7fc9a5769640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd57b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.938+0000 7fc9a5769640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd57b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49934/0 (socket says 172.21.15.7:49934) 2024-09-21T05:57:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.938+0000 7fc9a5769640 1 -- 172.21.15.7:0/1232316208 learned_addr learned my addr 172.21.15.7:0/1232316208 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.938+0000 7fc9a5f6a640 1 --2- 172.21.15.7:0/1232316208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f9b0070 0x559c7fd57650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.938+0000 7fc9a4f68640 1 --2- 172.21.15.7:0/1232316208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f98f390 0x559c7fd580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.938+0000 7fc9a5769640 1 -- 172.21.15.7:0/1232316208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f9b0070 msgr2=0x559c7fd57650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.938+0000 7fc9a5769640 1 --2- 172.21.15.7:0/1232316208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f9b0070 0x559c7fd57650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.938+0000 7fc9a5769640 1 -- 172.21.15.7:0/1232316208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f98f390 msgr2=0x559c7fd580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.938+0000 7fc9a5769640 1 --2- 172.21.15.7:0/1232316208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f98f390 0x559c7fd580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.938+0000 7fc9a5769640 1 -- 172.21.15.7:0/1232316208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c7fa1b650 con 0x559c7f9871b0 2024-09-21T05:57:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.938+0000 7fc9a4f68640 1 --2- 172.21.15.7:0/1232316208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f98f390 0x559c7fd580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.938+0000 7fc9967fc640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc98c0b6680 0x7fc98c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.938+0000 7fc9a5f6a640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc98c0b6680 0x7fc98c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.939+0000 7fc9967fc640 1 -- 172.21.15.7:0/1739186066 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fc99c0e73c0 con 0x7fc9a0103b60 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.939+0000 7fc9a5769640 1 --2- 172.21.15.7:0/1232316208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd57b90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0e4b00 tx=0x7fc99c0eda30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2303768ce50244 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.939+0000 7fc98b7fe640 1 -- 172.21.15.7:0/1232316208 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c020020 con 0x559c7f9871b0 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.939+0000 7fc98b7fe640 1 -- 172.21.15.7:0/1232316208 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc99c0acda0 con 0x559c7f9871b0 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.939+0000 7fc98b7fe640 1 -- 172.21.15.7:0/1232316208 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c0a9130 con 0x559c7f9871b0 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.940+0000 7fc9adf41740 1 -- 172.21.15.7:0/1232316208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 msgr2=0x559c7fd57b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.940+0000 7fc9a5f6a640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc98c0b6680 0x7fc98c0b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc998006010 tx=0x7fc998009440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.940+0000 7fc9adf41740 1 --2- 172.21.15.7:0/1232316208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd57b90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0e4b00 tx=0x7fc99c0eda30 comp rx=0 tx=0).stop 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.940+0000 7fc9adf41740 1 -- 172.21.15.7:0/1232316208 shutdown_connections 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.940+0000 7fc9adf41740 1 --2- 172.21.15.7:0/1232316208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd57b90 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.940+0000 7fc9adf41740 1 --2- 172.21.15.7:0/1232316208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f98f390 0x559c7fd580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.940+0000 7fc9adf41740 1 --2- 172.21.15.7:0/1232316208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f9b0070 0x559c7fd57650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.940+0000 7fc9adf41740 1 -- 172.21.15.7:0/1232316208 >> 172.21.15.7:0/1232316208 conn(0x559c7f9a4460 msgr2=0x559c7fd55540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.940+0000 7fc9adf41740 1 -- 172.21.15.7:0/1232316208 shutdown_connections 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.940+0000 7fc9adf41740 1 -- 172.21.15.7:0/1232316208 wait complete. 2024-09-21T05:57:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.940+0000 7fc9adf41740 1 -- start start 2024-09-21T05:57:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.941+0000 7fc9adf41740 1 Processor -- start 2024-09-21T05:57:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.941+0000 7fc9adf41740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f9871b0 0x559c7fd62cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.941+0000 7fc9adf41740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f98f390 0x559c7fd63200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.941+0000 7fc9adf41740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9b0070 0x559c7fd6f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.941+0000 7fc9adf41740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559c7fb1e700 con 0x559c7f9b0070 2024-09-21T05:57:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.941+0000 7fc9adf41740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559c7fc58110 con 0x559c7f9871b0 2024-09-21T05:57:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.941+0000 7fc9adf41740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559c7fd65e30 con 0x559c7f98f390 2024-09-21T05:57:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.941+0000 7fc9adf41740 10 client.0 _ll_register_callbacks cb 0x559c7fc71990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.941+0000 7fc9a5f6a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9b0070 0x559c7fd6f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.941+0000 7fc9a5f6a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9b0070 0x559c7fd6f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49948/0 (socket says 172.21.15.7:49948) 2024-09-21T05:57:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.941+0000 7fc9a5f6a640 1 -- 172.21.15.7:0/2341968191 learned_addr learned my addr 172.21.15.7:0/2341968191 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.941+0000 7fc9a5769640 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f9871b0 0x559c7fd62cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.941+0000 7fc9a4f68640 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f98f390 0x559c7fd63200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.942+0000 7fc9a5f6a640 1 -- 172.21.15.7:0/2341968191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f98f390 msgr2=0x559c7fd63200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.942+0000 7fc9a5f6a640 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f98f390 0x559c7fd63200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.942+0000 7fc9a5f6a640 1 -- 172.21.15.7:0/2341968191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f9871b0 msgr2=0x559c7fd62cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.942+0000 7fc9a5f6a640 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f9871b0 0x559c7fd62cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.942+0000 7fc9a5f6a640 1 -- 172.21.15.7:0/2341968191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c7fc85c40 con 0x559c7f9b0070 2024-09-21T05:57:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.942+0000 7fc9a5769640 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f9871b0 0x559c7fd62cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:57:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.942+0000 7fc9a5f6a640 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9b0070 0x559c7fd6f120 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc99802b000 tx=0x7fc99802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4b5de15cd55280 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.942+0000 7fc988ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.942+0000 7fc988ff9640 1 -- 172.21.15.7:0/2341968191 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9980318e0 con 0x559c7f9b0070 2024-09-21T05:57:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.942+0000 7fc988ff9640 1 -- 172.21.15.7:0/2341968191 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fc998004250 con 0x559c7f9b0070 2024-09-21T05:57:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.942+0000 7fc9adf41740 1 -- 172.21.15.7:0/2341968191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc99c0acda0 con 0x559c7f9b0070 2024-09-21T05:57:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.943+0000 7fc988ff9640 1 -- 172.21.15.7:0/2341968191 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc998004450 con 0x559c7f9b0070 2024-09-21T05:57:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.943+0000 7fc9adf41740 10 client.16236 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.943+0000 7fc9adf41740 1 -- 172.21.15.7:0/2341968191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559c7fd71b00 con 0x559c7f9b0070 2024-09-21T05:57:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.943+0000 7fc988ff9640 1 -- 172.21.15.7:0/2341968191 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc99c0acda0 con 0x559c7f9b0070 2024-09-21T05:57:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.943+0000 7fc988ff9640 1 -- 172.21.15.7:0/2341968191 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc998050070 con 0x559c7f9b0070 2024-09-21T05:57:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.943+0000 7fc9adf41740 10 client.16236 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.943+0000 7fc9adf41740 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.943+0000 7fc9adf41740 20 client.16236 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.943+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559c7f96e9f0 0x559c7fd74fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.943+0000 7fc9adf41740 4 client.16236 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:57:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.943+0000 7fc9adf41740 1 -- 172.21.15.7:0/2341968191 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c7fccfda0 con 0x559c7f96e9f0 2024-09-21T05:57:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.944+0000 7fc9a5769640 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559c7f96e9f0 0x559c7fd74fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.944+0000 7fc9a5769640 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559c7f96e9f0 0x559c7fd74fb0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f558685b28f8478 server_cookie=15b53008fdf4d585 in_seq=0 out_seq=0 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.944+0000 7fc988ff9640 10 client.16236 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc988ff9640 1 -- 172.21.15.7:0/2341968191 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559c7fccfda0 con 0x559c7f96e9f0 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc988ff9640 10 client.16236 handle_command_reply: tid=0 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc9adf41740 1 client.16236 shutdown 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc9adf41740 1 -- 172.21.15.7:0/2341968191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9b0070 msgr2=0x559c7fd6f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9b0070 0x559c7fd6f120 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc99802b000 tx=0x7fc99802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc9adf41740 1 -- 172.21.15.7:0/2341968191 shutdown_connections 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559c7f96e9f0 0x559c7fd74fb0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc988ff9640 0 client.16236 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9b0070 0x559c7fd6f120 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f98f390 0x559c7fd63200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2341968191 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f9871b0 0x559c7fd62cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc9adf41740 1 -- 172.21.15.7:0/2341968191 >> 172.21.15.7:0/2341968191 conn(0x559c7f9a4460 msgr2=0x559c7fd5a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc9adf41740 1 -- 172.21.15.7:0/2341968191 shutdown_connections 2024-09-21T05:57:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc9adf41740 1 -- 172.21.15.7:0/2341968191 wait complete. 2024-09-21T05:57:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.945+0000 7fc9adf41740 20 client.16236 trim_cache size 0 max 16384 2024-09-21T05:57:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9adf41740 1 Processor -- start 2024-09-21T05:57:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9adf41740 1 -- start start 2024-09-21T05:57:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9adf41740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f96e9f0 0x559c7fd58d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9adf41740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd54b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9adf41740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f98f390 0x559c7fd550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9adf41740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01b3f20 con 0x559c7f9871b0 2024-09-21T05:57:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9adf41740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01b17f0 con 0x559c7f96e9f0 2024-09-21T05:57:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9adf41740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01af640 con 0x559c7f98f390 2024-09-21T05:57:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9a4f68640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd54b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9a4f68640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd54b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49956/0 (socket says 172.21.15.7:49956) 2024-09-21T05:57:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9a4f68640 1 -- 172.21.15.7:0/2666824365 learned_addr learned my addr 172.21.15.7:0/2666824365 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9a5f6a640 1 --2- 172.21.15.7:0/2666824365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f98f390 0x559c7fd550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9a5769640 1 --2- 172.21.15.7:0/2666824365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f96e9f0 0x559c7fd58d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9a4f68640 1 -- 172.21.15.7:0/2666824365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f98f390 msgr2=0x559c7fd550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9a4f68640 1 --2- 172.21.15.7:0/2666824365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f98f390 0x559c7fd550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9a4f68640 1 -- 172.21.15.7:0/2666824365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f96e9f0 msgr2=0x559c7fd58d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9a4f68640 1 --2- 172.21.15.7:0/2666824365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f96e9f0 0x559c7fd58d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9a4f68640 1 -- 172.21.15.7:0/2666824365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c7fd63f80 con 0x559c7f9871b0 2024-09-21T05:57:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.963+0000 7fc9a5769640 1 --2- 172.21.15.7:0/2666824365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f96e9f0 0x559c7fd58d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:57:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.964+0000 7fc9a4f68640 1 --2- 172.21.15.7:0/2666824365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd54b70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc99000cd10 tx=0x7fc990011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1f7fd39f8688e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.964+0000 7fc98affd640 1 -- 172.21.15.7:0/2666824365 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99001b420 con 0x559c7f9871b0 2024-09-21T05:57:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.964+0000 7fc98affd640 1 -- 172.21.15.7:0/2666824365 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9900108e0 con 0x559c7f9871b0 2024-09-21T05:57:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.964+0000 7fc98affd640 1 -- 172.21.15.7:0/2666824365 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99000e980 con 0x559c7f9871b0 2024-09-21T05:57:15.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.965+0000 7fc9adf41740 1 -- 172.21.15.7:0/2666824365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 msgr2=0x559c7fd54b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:15.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.965+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2666824365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd54b70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc99000cd10 tx=0x7fc990011810 comp rx=0 tx=0).stop 2024-09-21T05:57:15.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.965+0000 7fc9adf41740 1 -- 172.21.15.7:0/2666824365 shutdown_connections 2024-09-21T05:57:15.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.965+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2666824365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd54b70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.965+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2666824365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f98f390 0x559c7fd550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.965+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2666824365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f96e9f0 0x559c7fd58d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.965+0000 7fc9adf41740 1 -- 172.21.15.7:0/2666824365 >> 172.21.15.7:0/2666824365 conn(0x559c7f9a4460 msgr2=0x559c7fd58680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.965+0000 7fc9adf41740 1 -- 172.21.15.7:0/2666824365 shutdown_connections 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.965+0000 7fc9adf41740 1 -- 172.21.15.7:0/2666824365 wait complete. 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.965+0000 7fc9adf41740 1 -- start start 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.965+0000 7fc9adf41740 1 Processor -- start 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9adf41740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f96e9f0 0x559c7fd67020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9adf41740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd67560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9adf41740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f98f390 0x559c7fd67aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9adf41740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01afcb0 con 0x559c7f9871b0 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9adf41740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01b1120 con 0x559c7f98f390 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9adf41740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01b0380 con 0x559c7f96e9f0 2024-09-21T05:57:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9adf41740 10 client.0 _ll_register_callbacks cb 0x7fc998009990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9a4f68640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd67560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9a4f68640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd67560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49958/0 (socket says 172.21.15.7:49958) 2024-09-21T05:57:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9a4f68640 1 -- 172.21.15.7:0/2093614845 learned_addr learned my addr 172.21.15.7:0/2093614845 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9a5769640 1 --2- 172.21.15.7:0/2093614845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f96e9f0 0x559c7fd67020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9a5f6a640 1 --2- 172.21.15.7:0/2093614845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f98f390 0x559c7fd67aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9a4f68640 1 -- 172.21.15.7:0/2093614845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f96e9f0 msgr2=0x559c7fd67020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9a4f68640 1 --2- 172.21.15.7:0/2093614845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f96e9f0 0x559c7fd67020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9a4f68640 1 -- 172.21.15.7:0/2093614845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f98f390 msgr2=0x559c7fd67aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9a4f68640 1 --2- 172.21.15.7:0/2093614845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f98f390 0x559c7fd67aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9a4f68640 1 -- 172.21.15.7:0/2093614845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c7fdde970 con 0x559c7f9871b0 2024-09-21T05:57:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc9a4f68640 1 --2- 172.21.15.7:0/2093614845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd67560 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c960 tx=0x7fc990010d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d315ae851c9f25d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.966+0000 7fc988ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc988ff9640 1 -- 172.21.15.7:0/2093614845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990020040 con 0x559c7f9871b0 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc988ff9640 1 -- 172.21.15.7:0/2093614845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fc990005040 con 0x559c7f9871b0 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc9adf41740 1 -- 172.21.15.7:0/2093614845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9900108e0 con 0x559c7f9871b0 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc988ff9640 1 -- 172.21.15.7:0/2093614845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc990005240 con 0x559c7f9871b0 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc9adf41740 10 client.16242 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc9adf41740 1 -- 172.21.15.7:0/2093614845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559c7fddfb40 con 0x559c7f9871b0 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc988ff9640 1 -- 172.21.15.7:0/2093614845 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9900108e0 con 0x559c7f9871b0 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc988ff9640 1 -- 172.21.15.7:0/2093614845 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc990023070 con 0x559c7f9871b0 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc9adf41740 10 client.16242 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc9adf41740 10 client.16242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc9adf41740 20 client.16242 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2093614845 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559c7f9b0070 0x559c7fde2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc9adf41740 4 client.16242 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.967+0000 7fc9adf41740 1 -- 172.21.15.7:0/2093614845 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559c7fccb850 con 0x559c7f9b0070 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc9a5769640 1 --2- 172.21.15.7:0/2093614845 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559c7f9b0070 0x559c7fde2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc988ff9640 10 client.16242 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:15.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc9a5769640 1 --2- 172.21.15.7:0/2093614845 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559c7f9b0070 0x559c7fde2290 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21debc5444c21252 server_cookie=fbbabc8a527933e2 in_seq=0 out_seq=0 2024-09-21T05:57:15.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc988ff9640 1 -- 172.21.15.7:0/2093614845 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x559c7fccb850 con 0x559c7f9b0070 2024-09-21T05:57:15.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc988ff9640 10 client.16242 handle_command_reply: tid=0 2024-09-21T05:57:15.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc9adf41740 1 client.16242 shutdown 2024-09-21T05:57:15.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc9adf41740 1 -- 172.21.15.7:0/2093614845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 msgr2=0x559c7fd67560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:15.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2093614845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd67560 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c960 tx=0x7fc990010d40 comp rx=0 tx=0).stop 2024-09-21T05:57:15.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc9adf41740 1 -- 172.21.15.7:0/2093614845 shutdown_connections 2024-09-21T05:57:15.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2093614845 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559c7f9b0070 0x559c7fde2290 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2093614845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c7f9871b0 0x559c7fd67560 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2093614845 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c7f98f390 0x559c7fd67aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc988ff9640 0 client.16242 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:15.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.968+0000 7fc9adf41740 1 --2- 172.21.15.7:0/2093614845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c7f96e9f0 0x559c7fd67020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.969+0000 7fc9adf41740 1 -- 172.21.15.7:0/2093614845 >> 172.21.15.7:0/2093614845 conn(0x559c7f9a4460 msgr2=0x559c7fd64150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:15.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.969+0000 7fc9adf41740 1 -- 172.21.15.7:0/2093614845 shutdown_connections 2024-09-21T05:57:15.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.969+0000 7fc9adf41740 1 -- 172.21.15.7:0/2093614845 wait complete. 2024-09-21T05:57:15.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.969+0000 7fc9adf41740 20 client.16242 trim_cache size 0 max 16384 2024-09-21T05:57:15.977 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:57:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T05:57:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T05:57:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T05:57:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "64dcdb40-1029-4909-9044-77c05eff7591", 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T05:57:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T05:57:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:57:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:57:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:57:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:57:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:57:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:57:15.981 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:57:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.969+0000 7fc9a79cd640 1 -- 172.21.15.7:0/1739186066 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc98c0b6680 msgr2=0x7fc98c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.969+0000 7fc9a79cd640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc98c0b6680 0x7fc98c0b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc998006010 tx=0x7fc998009440 comp rx=0 tx=0).stop 2024-09-21T05:57:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.969+0000 7fc9a79cd640 1 -- 172.21.15.7:0/1739186066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a0103b60 msgr2=0x7fc9a0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.969+0000 7fc9a79cd640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a0103b60 0x7fc9a0075710 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00d950 tx=0x7fc99c00de10 comp rx=0 tx=0).stop 2024-09-21T05:57:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.969+0000 7fc9a79cd640 1 -- 172.21.15.7:0/1739186066 shutdown_connections 2024-09-21T05:57:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.969+0000 7fc9a79cd640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc98c0b6680 0x7fc98c0b8b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.969+0000 7fc9a79cd640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9a0109df0 0x7fc9a0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.969+0000 7fc9a79cd640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9a01094a0 0x7fc9a0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.969+0000 7fc9a79cd640 1 --2- 172.21.15.7:0/1739186066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9a0103b60 0x7fc9a0075710 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.970+0000 7fc9a79cd640 1 -- 172.21.15.7:0/1739186066 >> 172.21.15.7:0/1739186066 conn(0x7fc9a007b850 msgr2=0x7fc9a0105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.970+0000 7fc9a79cd640 1 -- 172.21.15.7:0/1739186066 shutdown_connections 2024-09-21T05:57:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:15.970+0000 7fc9a79cd640 1 -- 172.21.15.7:0/1739186066 wait complete. 2024-09-21T05:57:15.983 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:15 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T05:57:15.983 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:15 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:57:15.983 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:15 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T05:57:15.983 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:15 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:57:15.983 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:15 smithi027 ceph-mon[34364]: pgmap v419: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T05:57:16.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:15 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T05:57:16.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:15 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:57:16.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:15 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T05:57:16.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:15 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:57:16.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:15 smithi119 ceph-mon[34833]: pgmap v419: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T05:57:16.742 INFO:tasks.cephfs.filesystem:scrub status for tag:64dcdb40-1029-4909-9044-77c05eff7591 - {'path': '/', 'tag': '64dcdb40-1029-4909-9044-77c05eff7591', 'options': 'recursive,force'} 2024-09-21T05:57:17.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:17 smithi027 ceph-mon[34364]: pgmap v420: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-21T05:57:17.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:17 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T05:57:18.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:17 smithi007 ceph-mon[30983]: pgmap v420: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-21T05:57:18.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:17 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T05:57:18.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:17 smithi119 ceph-mon[34833]: pgmap v420: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-21T05:57:18.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:17 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T05:57:19.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:19 smithi027 ceph-mon[34364]: pgmap v421: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T05:57:20.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:19 smithi007 ceph-mon[30983]: pgmap v421: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T05:57:20.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:19 smithi119 ceph-mon[34833]: pgmap v421: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T05:57:21.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:21 smithi027 ceph-mon[34364]: pgmap v422: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:57:22.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:21 smithi007 ceph-mon[30983]: pgmap v422: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:57:22.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:21 smithi119 ceph-mon[34833]: pgmap v422: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:57:23.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:23 smithi027 ceph-mon[34364]: pgmap v423: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T05:57:24.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:23 smithi007 ceph-mon[30983]: pgmap v423: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T05:57:24.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:23 smithi119 ceph-mon[34833]: pgmap v423: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T05:57:25.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:25 smithi027 ceph-mon[34364]: pgmap v424: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T05:57:26.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:25 smithi007 ceph-mon[30983]: pgmap v424: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T05:57:26.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:25 smithi119 ceph-mon[34833]: pgmap v424: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T05:57:27.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:27 smithi027 ceph-mon[34364]: pgmap v425: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T05:57:28.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:27 smithi007 ceph-mon[30983]: pgmap v425: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T05:57:28.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:27 smithi119 ceph-mon[34833]: pgmap v425: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T05:57:29.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:29 smithi027 ceph-mon[34364]: pgmap v426: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T05:57:30.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:29 smithi007 ceph-mon[30983]: pgmap v426: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T05:57:30.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:29 smithi119 ceph-mon[34833]: pgmap v426: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T05:57:31.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:31 smithi027 ceph-mon[34364]: pgmap v427: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T05:57:32.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:31 smithi007 ceph-mon[30983]: pgmap v427: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T05:57:32.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:31 smithi119 ceph-mon[34833]: pgmap v427: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T05:57:33.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:33 smithi027 ceph-mon[34364]: pgmap v428: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:57:34.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:33 smithi007 ceph-mon[30983]: pgmap v428: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:57:34.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:33 smithi119 ceph-mon[34833]: pgmap v428: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:57:35.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:35 smithi027 ceph-mon[34364]: pgmap v429: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:57:36.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:35 smithi007 ceph-mon[30983]: pgmap v429: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:57:36.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:35 smithi119 ceph-mon[34833]: pgmap v429: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:57:37.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:37 smithi027 ceph-mon[34364]: pgmap v430: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:57:38.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:37 smithi007 ceph-mon[30983]: pgmap v430: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:57:38.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:37 smithi119 ceph-mon[34833]: pgmap v430: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:57:39.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:39 smithi027 ceph-mon[34364]: pgmap v431: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:57:40.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:39 smithi007 ceph-mon[30983]: pgmap v431: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:57:40.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:39 smithi119 ceph-mon[34833]: pgmap v431: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:57:41.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:41 smithi027 ceph-mon[34364]: pgmap v432: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:57:42.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:41 smithi007 ceph-mon[30983]: pgmap v432: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:57:42.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:41 smithi119 ceph-mon[34833]: pgmap v432: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:57:43.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:43 smithi027 ceph-mon[34364]: pgmap v433: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:57:44.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:43 smithi007 ceph-mon[30983]: pgmap v433: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:57:44.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:43 smithi119 ceph-mon[34833]: pgmap v433: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:57:45.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:45 smithi027 ceph-mon[34364]: pgmap v434: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:57:46.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:45 smithi007 ceph-mon[30983]: pgmap v434: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:57:46.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:45 smithi119 ceph-mon[34833]: pgmap v434: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:57:46.743 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:57:47.019 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:47.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.475+0000 7f7e76907640 1 -- 172.21.15.7:0/1495482979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e70109ec0 msgr2=0x7f7e701106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.475+0000 7f7e76907640 1 --2- 172.21.15.7:0/1495482979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e70109ec0 0x7f7e701106f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009ca0 tx=0x7f7e6802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.475+0000 7f7e76907640 1 -- 172.21.15.7:0/1495482979 shutdown_connections 2024-09-21T05:57:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.475+0000 7f7e76907640 1 --2- 172.21.15.7:0/1495482979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e70109ec0 0x7f7e701106f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.475+0000 7f7e76907640 1 --2- 172.21.15.7:0/1495482979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e70109570 0x7f7e70109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.475+0000 7f7e76907640 1 --2- 172.21.15.7:0/1495482979 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e70103c30 0x7f7e70104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.475+0000 7f7e76907640 1 -- 172.21.15.7:0/1495482979 >> 172.21.15.7:0/1495482979 conn(0x7f7e7007b8d0 msgr2=0x7f7e7007bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.476+0000 7f7e76907640 1 -- 172.21.15.7:0/1495482979 shutdown_connections 2024-09-21T05:57:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.476+0000 7f7e76907640 1 -- 172.21.15.7:0/1495482979 wait complete. 2024-09-21T05:57:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.476+0000 7f7e76907640 1 Processor -- start 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.476+0000 7f7e76907640 1 -- start start 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.477+0000 7f7e76907640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e70103c30 0x7f7e7019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.477+0000 7f7e76907640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e70109570 0x7f7e7019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.477+0000 7f7e76907640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e70109ec0 0x7f7e701a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.477+0000 7f7e76907640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7e700762f0 con 0x7f7e70109570 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.477+0000 7f7e76907640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7e70076170 con 0x7f7e70109ec0 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.477+0000 7f7e76907640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7e70076470 con 0x7f7e70103c30 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.477+0000 7f7e6f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e70109570 0x7f7e7019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.477+0000 7f7e6f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e70109570 0x7f7e7019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60344/0 (socket says 172.21.15.7:60344) 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.477+0000 7f7e6f7fe640 1 -- 172.21.15.7:0/824709346 learned_addr learned my addr 172.21.15.7:0/824709346 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.477+0000 7f7e74ea4640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e70109ec0 0x7f7e701a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.477+0000 7f7e6ffff640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e70103c30 0x7f7e7019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.478+0000 7f7e6f7fe640 1 -- 172.21.15.7:0/824709346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e70103c30 msgr2=0x7f7e7019c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.478+0000 7f7e6f7fe640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e70103c30 0x7f7e7019c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.478+0000 7f7e6f7fe640 1 -- 172.21.15.7:0/824709346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e70109ec0 msgr2=0x7f7e701a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.478+0000 7f7e6f7fe640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e70109ec0 0x7f7e701a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.478+0000 7f7e6f7fe640 1 -- 172.21.15.7:0/824709346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e701a25c0 con 0x7f7e70109570 2024-09-21T05:57:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.478+0000 7f7e74ea4640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e70109ec0 0x7f7e701a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.478+0000 7f7e6f7fe640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e70109570 0x7f7e7019cbf0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400e9c0 tx=0x7f7e6400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.478+0000 7f7e6d7fa640 1 -- 172.21.15.7:0/824709346 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400ccc0 con 0x7f7e70109570 2024-09-21T05:57:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.478+0000 7f7e76907640 1 -- 172.21.15.7:0/824709346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e701a28b0 con 0x7f7e70109570 2024-09-21T05:57:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.478+0000 7f7e6d7fa640 1 -- 172.21.15.7:0/824709346 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e640054d0 con 0x7f7e70109570 2024-09-21T05:57:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.478+0000 7f7e6d7fa640 1 -- 172.21.15.7:0/824709346 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64010430 con 0x7f7e70109570 2024-09-21T05:57:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.478+0000 7f7e76907640 1 -- 172.21.15.7:0/824709346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e701a9010 con 0x7f7e70109570 2024-09-21T05:57:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.481+0000 7f7e7ce7b740 1 Processor -- start 2024-09-21T05:57:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.481+0000 7f7e7ce7b740 1 -- start start 2024-09-21T05:57:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.481+0000 7f7e6d7fa640 1 -- 172.21.15.7:0/824709346 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7e64005020 con 0x7f7e70109570 2024-09-21T05:57:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.481+0000 7f7e7ce7b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3c6070 0x562a5a76d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.481+0000 7f7e7ce7b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 0x562a5a76db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.481+0000 7f7e7ce7b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3a5390 0x562a5a76e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.481+0000 7f7e7ce7b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562a5a6e3e50 con 0x562a5a39d1b0 2024-09-21T05:57:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.481+0000 7f7e7ce7b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562a5a6d3280 con 0x562a5a3a5390 2024-09-21T05:57:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.481+0000 7f7e7ce7b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562a5a6d7090 con 0x562a5a3c6070 2024-09-21T05:57:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.481+0000 7f7e6ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 0x562a5a76db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e6f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3a5390 0x562a5a76e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e6ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 0x562a5a76db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60358/0 (socket says 172.21.15.7:60358) 2024-09-21T05:57:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e6ffff640 1 -- 172.21.15.7:0/3253609799 learned_addr learned my addr 172.21.15.7:0/3253609799 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e74ea4640 1 --2- 172.21.15.7:0/3253609799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3c6070 0x562a5a76d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e6ffff640 1 -- 172.21.15.7:0/3253609799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3c6070 msgr2=0x562a5a76d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e6ffff640 1 --2- 172.21.15.7:0/3253609799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3c6070 0x562a5a76d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e6ffff640 1 -- 172.21.15.7:0/3253609799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3a5390 msgr2=0x562a5a76e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e6ffff640 1 --2- 172.21.15.7:0/3253609799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3a5390 0x562a5a76e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e6ffff640 1 -- 172.21.15.7:0/3253609799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a5a431650 con 0x562a5a39d1b0 2024-09-21T05:57:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e6ffff640 1 --2- 172.21.15.7:0/3253609799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 0x562a5a76db90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000bd10 tx=0x7f7e6000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afedf829a0cb027 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e6d7fa640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e580b6680 0x7f7e580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e567fc640 1 -- 172.21.15.7:0/3253609799 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e60015070 con 0x562a5a39d1b0 2024-09-21T05:57:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e74ea4640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e580b6680 0x7f7e580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.482+0000 7f7e567fc640 1 -- 172.21.15.7:0/3253609799 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e6001a910 con 0x562a5a39d1b0 2024-09-21T05:57:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.483+0000 7f7e567fc640 1 -- 172.21.15.7:0/3253609799 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e60011980 con 0x562a5a39d1b0 2024-09-21T05:57:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.483+0000 7f7e6d7fa640 1 -- 172.21.15.7:0/824709346 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f7e640e7ad0 con 0x7f7e70109570 2024-09-21T05:57:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.484+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/3253609799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 msgr2=0x562a5a76db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.484+0000 7f7e74ea4640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e580b6680 0x7f7e580b8b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7e68006010 tx=0x7f7e6802f3f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.484+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/3253609799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 0x562a5a76db90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000bd10 tx=0x7f7e6000f730 comp rx=0 tx=0).stop 2024-09-21T05:57:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.484+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/3253609799 shutdown_connections 2024-09-21T05:57:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.484+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/3253609799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 0x562a5a76db90 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.484+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/3253609799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3a5390 0x562a5a76e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.484+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/3253609799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3c6070 0x562a5a76d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.484+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/3253609799 >> 172.21.15.7:0/3253609799 conn(0x562a5a3ba460 msgr2=0x562a5a76b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.484+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/3253609799 shutdown_connections 2024-09-21T05:57:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.484+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/3253609799 wait complete. 2024-09-21T05:57:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.484+0000 7f7e7ce7b740 1 -- start start 2024-09-21T05:57:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.485+0000 7f7e7ce7b740 1 Processor -- start 2024-09-21T05:57:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.485+0000 7f7e7ce7b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 0x562a5a778c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.485+0000 7f7e7ce7b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3a5390 0x562a5a7791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.485+0000 7f7e7ce7b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3c6070 0x562a5a779700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.485+0000 7f7e7ce7b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562a5a534700 con 0x562a5a39d1b0 2024-09-21T05:57:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.485+0000 7f7e7ce7b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562a5a66e110 con 0x562a5a3c6070 2024-09-21T05:57:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.485+0000 7f7e7ce7b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562a5a77be30 con 0x562a5a3a5390 2024-09-21T05:57:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.485+0000 7f7e6ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 0x562a5a778c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.485+0000 7f7e7ce7b740 10 client.0 _ll_register_callbacks cb 0x562a5a687990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.485+0000 7f7e6ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 0x562a5a778c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60372/0 (socket says 172.21.15.7:60372) 2024-09-21T05:57:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.485+0000 7f7e6ffff640 1 -- 172.21.15.7:0/1504113279 learned_addr learned my addr 172.21.15.7:0/1504113279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.485+0000 7f7e6f7fe640 1 --2- 172.21.15.7:0/1504113279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3a5390 0x562a5a7791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.485+0000 7f7e74ea4640 1 --2- 172.21.15.7:0/1504113279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3c6070 0x562a5a779700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.486+0000 7f7e6ffff640 1 -- 172.21.15.7:0/1504113279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3a5390 msgr2=0x562a5a7791c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.486+0000 7f7e6ffff640 1 --2- 172.21.15.7:0/1504113279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3a5390 0x562a5a7791c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.486+0000 7f7e6ffff640 1 -- 172.21.15.7:0/1504113279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3c6070 msgr2=0x562a5a779700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.486+0000 7f7e6ffff640 1 --2- 172.21.15.7:0/1504113279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3c6070 0x562a5a779700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.486+0000 7f7e6ffff640 1 -- 172.21.15.7:0/1504113279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a5a69bc40 con 0x562a5a39d1b0 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.486+0000 7f7e6ffff640 1 --2- 172.21.15.7:0/1504113279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 0x562a5a778c80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7e60000c00 tx=0x7f7e6000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ee83f4da7b4a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.486+0000 7f7e4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.486+0000 7f7e4f7fe640 1 -- 172.21.15.7:0/1504113279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e60015070 con 0x562a5a39d1b0 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.486+0000 7f7e4f7fe640 1 -- 172.21.15.7:0/1504113279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f7e6001aac0 con 0x562a5a39d1b0 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.486+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/1504113279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e6001a910 con 0x562a5a39d1b0 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.486+0000 7f7e4f7fe640 1 -- 172.21.15.7:0/1504113279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7e6001a730 con 0x562a5a39d1b0 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.486+0000 7f7e7ce7b740 10 client.16254 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.486+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/1504113279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a5a787a90 con 0x562a5a39d1b0 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.487+0000 7f7e4f7fe640 1 -- 172.21.15.7:0/1504113279 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e6001a910 con 0x562a5a39d1b0 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.487+0000 7f7e4f7fe640 1 -- 172.21.15.7:0/1504113279 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7e6002b070 con 0x562a5a39d1b0 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.487+0000 7f7e7ce7b740 10 client.16254 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.487+0000 7f7e7ce7b740 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.487+0000 7f7e7ce7b740 20 client.16254 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.487+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/1504113279 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562a5a3849f0 0x562a5a78aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.487+0000 7f7e7ce7b740 4 client.16254 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:57:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.487+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/1504113279 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a5a6e5da0 con 0x562a5a3849f0 2024-09-21T05:57:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.487+0000 7f7e6f7fe640 1 --2- 172.21.15.7:0/1504113279 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562a5a3849f0 0x562a5a78aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.488+0000 7f7e4f7fe640 10 client.16254 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.488+0000 7f7e6f7fe640 1 --2- 172.21.15.7:0/1504113279 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562a5a3849f0 0x562a5a78aea0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c0b8daea4d8f703 server_cookie=211fdc63e0fd4489 in_seq=0 out_seq=0 2024-09-21T05:57:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e4f7fe640 1 -- 172.21.15.7:0/1504113279 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a5a6e5da0 con 0x562a5a3849f0 2024-09-21T05:57:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e4f7fe640 10 client.16254 handle_command_reply: tid=0 2024-09-21T05:57:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e7ce7b740 1 client.16254 shutdown 2024-09-21T05:57:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/1504113279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 msgr2=0x562a5a778c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/1504113279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 0x562a5a778c80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7e60000c00 tx=0x7f7e6000ba50 comp rx=0 tx=0).stop 2024-09-21T05:57:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/1504113279 shutdown_connections 2024-09-21T05:57:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/1504113279 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562a5a3849f0 0x562a5a78aea0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/1504113279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3c6070 0x562a5a779700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e4f7fe640 0 client.16254 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/1504113279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3a5390 0x562a5a7791c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/1504113279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a39d1b0 0x562a5a778c80 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/1504113279 >> 172.21.15.7:0/1504113279 conn(0x562a5a3ba460 msgr2=0x562a5a7707e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/1504113279 shutdown_connections 2024-09-21T05:57:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/1504113279 wait complete. 2024-09-21T05:57:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.489+0000 7f7e7ce7b740 20 client.16254 trim_cache size 0 max 16384 2024-09-21T05:57:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.525+0000 7f7e7ce7b740 1 Processor -- start 2024-09-21T05:57:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.525+0000 7f7e7ce7b740 1 -- start start 2024-09-21T05:57:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.525+0000 7f7e7ce7b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3849f0 0x562a5a775e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.525+0000 7f7e7ce7b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a39d1b0 0x562a5a7763b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.525+0000 7f7e7ce7b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 0x562a5a77a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.525+0000 7f7e7ce7b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7e701b40a0 con 0x562a5a3a5390 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.525+0000 7f7e7ce7b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7e701b1970 con 0x562a5a39d1b0 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.525+0000 7f7e7ce7b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7e701af7c0 con 0x562a5a3849f0 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.526+0000 7f7e74ea4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 0x562a5a77a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.526+0000 7f7e74ea4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 0x562a5a77a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60384/0 (socket says 172.21.15.7:60384) 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.526+0000 7f7e74ea4640 1 -- 172.21.15.7:0/612918167 learned_addr learned my addr 172.21.15.7:0/612918167 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.526+0000 7f7e6ffff640 1 --2- 172.21.15.7:0/612918167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3849f0 0x562a5a775e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.526+0000 7f7e6f7fe640 1 --2- 172.21.15.7:0/612918167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a39d1b0 0x562a5a7763b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.526+0000 7f7e74ea4640 1 -- 172.21.15.7:0/612918167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3849f0 msgr2=0x562a5a775e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.526+0000 7f7e74ea4640 1 --2- 172.21.15.7:0/612918167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3849f0 0x562a5a775e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.526+0000 7f7e74ea4640 1 -- 172.21.15.7:0/612918167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a39d1b0 msgr2=0x562a5a7763b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.526+0000 7f7e74ea4640 1 --2- 172.21.15.7:0/612918167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a39d1b0 0x562a5a7763b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.526+0000 7f7e74ea4640 1 -- 172.21.15.7:0/612918167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a5a76ba80 con 0x562a5a3a5390 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.526+0000 7f7e74ea4640 1 --2- 172.21.15.7:0/612918167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 0x562a5a77a1a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009ca0 tx=0x7f7e68041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ad0c0d4930c899 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.526+0000 7f7e55ffb640 1 -- 172.21.15.7:0/612918167 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68031920 con 0x562a5a3a5390 2024-09-21T05:57:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.527+0000 7f7e55ffb640 1 -- 172.21.15.7:0/612918167 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e68036040 con 0x562a5a3a5390 2024-09-21T05:57:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.527+0000 7f7e55ffb640 1 -- 172.21.15.7:0/612918167 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68004780 con 0x562a5a3a5390 2024-09-21T05:57:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.527+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/612918167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 msgr2=0x562a5a77a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.527+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/612918167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 0x562a5a77a1a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009ca0 tx=0x7f7e68041000 comp rx=0 tx=0).stop 2024-09-21T05:57:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.527+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/612918167 shutdown_connections 2024-09-21T05:57:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.527+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/612918167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 0x562a5a77a1a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.527+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/612918167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a39d1b0 0x562a5a7763b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.527+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/612918167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a3849f0 0x562a5a775e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.527+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/612918167 >> 172.21.15.7:0/612918167 conn(0x562a5a3ba460 msgr2=0x562a5a777500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.527+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/612918167 shutdown_connections 2024-09-21T05:57:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.528+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/612918167 wait complete. 2024-09-21T05:57:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.528+0000 7f7e7ce7b740 1 -- start start 2024-09-21T05:57:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.528+0000 7f7e7ce7b740 1 Processor -- start 2024-09-21T05:57:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e7ce7b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3849f0 0x562a5a78e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e7ce7b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a39d1b0 0x562a5a78bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e7ce7b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 0x562a5a78c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e7ce7b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7e701afe30 con 0x562a5a3a5390 2024-09-21T05:57:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e7ce7b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7e701b12a0 con 0x562a5a3849f0 2024-09-21T05:57:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e7ce7b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7e701b0500 con 0x562a5a39d1b0 2024-09-21T05:57:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e7ce7b740 10 client.0 _ll_register_callbacks cb 0x7f7e640eb4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e74ea4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 0x562a5a78c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e74ea4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 0x562a5a78c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60400/0 (socket says 172.21.15.7:60400) 2024-09-21T05:57:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e74ea4640 1 -- 172.21.15.7:0/4141388714 learned_addr learned my addr 172.21.15.7:0/4141388714 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e6ffff640 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3849f0 0x562a5a78e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e6f7fe640 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a39d1b0 0x562a5a78bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e74ea4640 1 -- 172.21.15.7:0/4141388714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a39d1b0 msgr2=0x562a5a78bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e74ea4640 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a39d1b0 0x562a5a78bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e74ea4640 1 -- 172.21.15.7:0/4141388714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3849f0 msgr2=0x562a5a78e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e74ea4640 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3849f0 0x562a5a78e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e74ea4640 1 -- 172.21.15.7:0/4141388714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a5a78c960 con 0x562a5a3a5390 2024-09-21T05:57:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e6f7fe640 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a39d1b0 0x562a5a78bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e74ea4640 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 0x562a5a78c1d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7e68043040 tx=0x7f7e680043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8328ff3ae477087d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.529+0000 7f7e4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.530+0000 7f7e4f7fe640 1 -- 172.21.15.7:0/4141388714 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68061060 con 0x562a5a3a5390 2024-09-21T05:57:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.530+0000 7f7e4f7fe640 1 -- 172.21.15.7:0/4141388714 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f7e680047d0 con 0x562a5a3a5390 2024-09-21T05:57:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.530+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/4141388714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e68036040 con 0x562a5a3a5390 2024-09-21T05:57:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.530+0000 7f7e4f7fe640 1 -- 172.21.15.7:0/4141388714 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7e68003970 con 0x562a5a3a5390 2024-09-21T05:57:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.530+0000 7f7e7ce7b740 10 client.16260 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.530+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/4141388714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a5a7f55f0 con 0x562a5a3a5390 2024-09-21T05:57:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.530+0000 7f7e4f7fe640 1 -- 172.21.15.7:0/4141388714 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e68036040 con 0x562a5a3a5390 2024-09-21T05:57:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.531+0000 7f7e4f7fe640 1 -- 172.21.15.7:0/4141388714 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7e680305c0 con 0x562a5a3a5390 2024-09-21T05:57:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.531+0000 7f7e7ce7b740 10 client.16260 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.531+0000 7f7e7ce7b740 10 client.16260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.531+0000 7f7e7ce7b740 20 client.16260 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.531+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562a5a3c6070 0x562a5a7f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.531+0000 7f7e7ce7b740 4 client.16260 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:57:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.531+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/4141388714 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562a5a6e1850 con 0x562a5a3c6070 2024-09-21T05:57:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.531+0000 7f7e6ffff640 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562a5a3c6070 0x562a5a7f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:47.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.531+0000 7f7e4f7fe640 10 client.16260 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.531+0000 7f7e6ffff640 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562a5a3c6070 0x562a5a7f7d00 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aea4171873552c0 server_cookie=d0f444bd65cc3e1a in_seq=0 out_seq=0 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e4f7fe640 1 -- 172.21.15.7:0/4141388714 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x562a5a6e1850 con 0x562a5a3c6070 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e4f7fe640 10 client.16260 handle_command_reply: tid=0 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e7ce7b740 1 client.16260 shutdown 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/4141388714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 msgr2=0x562a5a78c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 0x562a5a78c1d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7e68043040 tx=0x7f7e680043b0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/4141388714 shutdown_connections 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562a5a3c6070 0x562a5a7f7d00 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a5a3a5390 0x562a5a78c1d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562a5a39d1b0 0x562a5a78bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e7ce7b740 1 --2- 172.21.15.7:0/4141388714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562a5a3849f0 0x562a5a78e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/4141388714 >> 172.21.15.7:0/4141388714 conn(0x562a5a3ba460 msgr2=0x562a5a76e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e4f7fe640 0 client.16260 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/4141388714 shutdown_connections 2024-09-21T05:57:47.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e7ce7b740 1 -- 172.21.15.7:0/4141388714 wait complete. 2024-09-21T05:57:47.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.532+0000 7f7e7ce7b740 20 client.16260 trim_cache size 0 max 16384 2024-09-21T05:57:47.539 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:57:47.539 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T05:57:47.539 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T05:57:47.539 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:57:47.539 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T05:57:47.539 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T05:57:47.539 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:47.539 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T05:57:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T05:57:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:57:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:57:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:57:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:57:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:57:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:47.543 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:47.543 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:47.543 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:47.543 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:47.543 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:57:47.543 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:57:47.543 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:57:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.533+0000 7f7e76907640 1 -- 172.21.15.7:0/824709346 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e580b6680 msgr2=0x7f7e580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.533+0000 7f7e76907640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e580b6680 0x7f7e580b8b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7e68006010 tx=0x7f7e6802f3f0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.533+0000 7f7e76907640 1 -- 172.21.15.7:0/824709346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e70109570 msgr2=0x7f7e7019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.533+0000 7f7e76907640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e70109570 0x7f7e7019cbf0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400e9c0 tx=0x7f7e6400ee80 comp rx=0 tx=0).stop 2024-09-21T05:57:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.533+0000 7f7e76907640 1 -- 172.21.15.7:0/824709346 shutdown_connections 2024-09-21T05:57:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.533+0000 7f7e76907640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e580b6680 0x7f7e580b8b90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.533+0000 7f7e76907640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e70109570 0x7f7e7019cbf0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.533+0000 7f7e76907640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e70109ec0 0x7f7e701a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.533+0000 7f7e76907640 1 --2- 172.21.15.7:0/824709346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e70103c30 0x7f7e7019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.533+0000 7f7e76907640 1 -- 172.21.15.7:0/824709346 >> 172.21.15.7:0/824709346 conn(0x7f7e7007b8d0 msgr2=0x7f7e701026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.533+0000 7f7e76907640 1 -- 172.21.15.7:0/824709346 shutdown_connections 2024-09-21T05:57:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:47.533+0000 7f7e76907640 1 -- 172.21.15.7:0/824709346 wait complete. 2024-09-21T05:57:47.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:47 smithi007 ceph-mon[30983]: pgmap v435: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:57:47.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:47 smithi027 ceph-mon[34364]: pgmap v435: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:57:48.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:47 smithi119 ceph-mon[34833]: pgmap v435: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:57:48.332 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T05:57:48.333 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:57:48.597 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.091+0000 7f7045236640 1 -- 172.21.15.7:0/1542268395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7040103b60 msgr2=0x7f7040103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.091+0000 7f7045236640 1 --2- 172.21.15.7:0/1542268395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7040103b60 0x7f7040103f70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7030009ca0 tx=0x7f703002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:57:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.091+0000 7f7045236640 1 -- 172.21.15.7:0/1542268395 shutdown_connections 2024-09-21T05:57:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.091+0000 7f7045236640 1 --2- 172.21.15.7:0/1542268395 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7040109df0 0x7f7040110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.091+0000 7f7045236640 1 --2- 172.21.15.7:0/1542268395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70401094a0 0x7f70401098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.091+0000 7f7045236640 1 --2- 172.21.15.7:0/1542268395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7040103b60 0x7f7040103f70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.091+0000 7f7045236640 1 -- 172.21.15.7:0/1542268395 >> 172.21.15.7:0/1542268395 conn(0x7f704007b850 msgr2=0x7f704007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.091+0000 7f7045236640 1 -- 172.21.15.7:0/1542268395 shutdown_connections 2024-09-21T05:57:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.091+0000 7f7045236640 1 -- 172.21.15.7:0/1542268395 wait complete. 2024-09-21T05:57:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.092+0000 7f7045236640 1 Processor -- start 2024-09-21T05:57:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.092+0000 7f7045236640 1 -- start start 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.092+0000 7f7045236640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7040103b60 0x7f7040075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.092+0000 7f7045236640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70401094a0 0x7f7040075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.092+0000 7f7045236640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7040109df0 0x7f7040076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.092+0000 7f7045236640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7040113ab0 con 0x7f7040103b60 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.092+0000 7f7045236640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7040113930 con 0x7f7040109df0 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.092+0000 7f7045236640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7040113c30 con 0x7f70401094a0 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.092+0000 7f703ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7040103b60 0x7f7040075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.092+0000 7f703ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7040103b60 0x7f7040075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37628/0 (socket says 172.21.15.7:37628) 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.092+0000 7f703ed9d640 1 -- 172.21.15.7:0/2584567938 learned_addr learned my addr 172.21.15.7:0/2584567938 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.093+0000 7f703e59c640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70401094a0 0x7f7040075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.093+0000 7f703f59e640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7040109df0 0x7f7040076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.093+0000 7f703ed9d640 1 -- 172.21.15.7:0/2584567938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70401094a0 msgr2=0x7f7040075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.093+0000 7f703ed9d640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70401094a0 0x7f7040075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.093+0000 7f703ed9d640 1 -- 172.21.15.7:0/2584567938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7040109df0 msgr2=0x7f7040076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.093+0000 7f703ed9d640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7040109df0 0x7f7040076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.093+0000 7f703ed9d640 1 -- 172.21.15.7:0/2584567938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70401a8760 con 0x7f7040103b60 2024-09-21T05:57:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.093+0000 7f703ed9d640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7040103b60 0x7f7040075710 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7030006010 tx=0x7f70300319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.093+0000 7f7037fff640 1 -- 172.21.15.7:0/2584567938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030003bf0 con 0x7f7040103b60 2024-09-21T05:57:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.093+0000 7f7037fff640 1 -- 172.21.15.7:0/2584567938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7030003d90 con 0x7f7040103b60 2024-09-21T05:57:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.093+0000 7f7045236640 1 -- 172.21.15.7:0/2584567938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70401a89f0 con 0x7f7040103b60 2024-09-21T05:57:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.093+0000 7f7037fff640 1 -- 172.21.15.7:0/2584567938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703002fc20 con 0x7f7040103b60 2024-09-21T05:57:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.093+0000 7f7045236640 1 -- 172.21.15.7:0/2584567938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70401a8f30 con 0x7f7040103b60 2024-09-21T05:57:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.094+0000 7f7045236640 1 -- 172.21.15.7:0/2584567938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7040103f70 con 0x7f7040103b60 2024-09-21T05:57:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.096+0000 7f7037fff640 1 -- 172.21.15.7:0/2584567938 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f70300046a0 con 0x7f7040103b60 2024-09-21T05:57:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.097+0000 7f7037fff640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f702c0b6680 0x7f702c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.097+0000 7f703e59c640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f702c0b6680 0x7f702c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.097+0000 7f7037fff640 1 -- 172.21.15.7:0/2584567938 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f7030108b50 con 0x7f7040103b60 2024-09-21T05:57:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.097+0000 7f703e59c640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f702c0b6680 0x7f702c0b8b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f70401091a0 tx=0x7f702800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.100+0000 7f7037fff640 1 -- 172.21.15.7:0/2584567938 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70300cf120 con 0x7f7040103b60 2024-09-21T05:57:49.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.328+0000 7f7045236640 1 -- 172.21.15.7:0/2584567938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7040076a10 con 0x7f7040103b60 2024-09-21T05:57:49.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.329+0000 7f7037fff640 1 -- 172.21.15.7:0/2584567938 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f7040076a10 con 0x7f7040103b60 2024-09-21T05:57:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:57:49.331 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:57:49.331 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:57:49.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.331+0000 7f7045236640 1 -- 172.21.15.7:0/2584567938 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f702c0b6680 msgr2=0x7f702c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:49.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.331+0000 7f7045236640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f702c0b6680 0x7f702c0b8b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f70401091a0 tx=0x7f702800b390 comp rx=0 tx=0).stop 2024-09-21T05:57:49.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.331+0000 7f7045236640 1 -- 172.21.15.7:0/2584567938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7040103b60 msgr2=0x7f7040075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:49.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.331+0000 7f7045236640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7040103b60 0x7f7040075710 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7030006010 tx=0x7f70300319f0 comp rx=0 tx=0).stop 2024-09-21T05:57:49.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.331+0000 7f7045236640 1 -- 172.21.15.7:0/2584567938 shutdown_connections 2024-09-21T05:57:49.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.331+0000 7f7045236640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f702c0b6680 0x7f702c0b8b90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:49.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.331+0000 7f7045236640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7040109df0 0x7f7040076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:49.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.331+0000 7f7045236640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70401094a0 0x7f7040075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:49.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.331+0000 7f7045236640 1 --2- 172.21.15.7:0/2584567938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7040103b60 0x7f7040075710 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:49.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.331+0000 7f7045236640 1 -- 172.21.15.7:0/2584567938 >> 172.21.15.7:0/2584567938 conn(0x7f704007b850 msgr2=0x7f7040107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:49.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.332+0000 7f7045236640 1 -- 172.21.15.7:0/2584567938 shutdown_connections 2024-09-21T05:57:49.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:49.332+0000 7f7045236640 1 -- 172.21.15.7:0/2584567938 wait complete. 2024-09-21T05:57:49.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:49 smithi027 ceph-mon[34364]: pgmap v436: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:57:49.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:49 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2584567938' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:57:50.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:49 smithi007 ceph-mon[30983]: pgmap v436: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:57:50.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:49 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2584567938' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:57:50.082 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T05:57:50.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:49 smithi119 ceph-mon[34833]: pgmap v436: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:57:50.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:49 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2584567938' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:57:50.352 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:50.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.884+0000 7fb4a0bbf640 1 -- 172.21.15.7:0/2696183635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c102a80 msgr2=0x7fb49c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:50.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.884+0000 7fb4a0bbf640 1 --2- 172.21.15.7:0/2696183635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c102a80 0x7fb49c102e90 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009900 tx=0x7fb48c02a410 comp rx=0 tx=0).stop 2024-09-21T05:57:50.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.884+0000 7fb4a0bbf640 1 -- 172.21.15.7:0/2696183635 shutdown_connections 2024-09-21T05:57:50.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.884+0000 7fb4a0bbf640 1 --2- 172.21.15.7:0/2696183635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb49c108d10 0x7fb49c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.884+0000 7fb4a0bbf640 1 --2- 172.21.15.7:0/2696183635 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb49c1083c0 0x7fb49c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.884+0000 7fb4a0bbf640 1 --2- 172.21.15.7:0/2696183635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c102a80 0x7fb49c102e90 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.884+0000 7fb4a0bbf640 1 -- 172.21.15.7:0/2696183635 >> 172.21.15.7:0/2696183635 conn(0x7fb49c079740 msgr2=0x7fb49c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:50.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.884+0000 7fb4a0bbf640 1 -- 172.21.15.7:0/2696183635 shutdown_connections 2024-09-21T05:57:50.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.884+0000 7fb4a0bbf640 1 -- 172.21.15.7:0/2696183635 wait complete. 2024-09-21T05:57:50.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.884+0000 7fb4a0bbf640 1 Processor -- start 2024-09-21T05:57:50.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.885+0000 7fb4a0bbf640 1 -- start start 2024-09-21T05:57:50.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.885+0000 7fb4a0bbf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb49c102a80 0x7fb49c19b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.885+0000 7fb4a0bbf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb49c1083c0 0x7fb49c19b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.885+0000 7fb4a0bbf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c108d10 0x7fb49c19bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.885+0000 7fb4a0bbf640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c112980 con 0x7fb49c108d10 2024-09-21T05:57:50.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.885+0000 7fb4a0bbf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c112800 con 0x7fb49c1083c0 2024-09-21T05:57:50.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.885+0000 7fb4a0bbf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c112b00 con 0x7fb49c102a80 2024-09-21T05:57:50.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.885+0000 7fb49ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c108d10 0x7fb49c19bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.885+0000 7fb49a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb49c102a80 0x7fb49c19b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.885+0000 7fb49ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c108d10 0x7fb49c19bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37650/0 (socket says 172.21.15.7:37650) 2024-09-21T05:57:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.885+0000 7fb49ad9d640 1 -- 172.21.15.7:0/4196902252 learned_addr learned my addr 172.21.15.7:0/4196902252 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.885+0000 7fb491d9b640 1 --2- 172.21.15.7:0/4196902252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb49c1083c0 0x7fb49c19b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.886+0000 7fb49ad9d640 1 -- 172.21.15.7:0/4196902252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb49c102a80 msgr2=0x7fb49c19b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.886+0000 7fb49ad9d640 1 --2- 172.21.15.7:0/4196902252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb49c102a80 0x7fb49c19b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.886+0000 7fb49ad9d640 1 -- 172.21.15.7:0/4196902252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb49c1083c0 msgr2=0x7fb49c19b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.886+0000 7fb49ad9d640 1 --2- 172.21.15.7:0/4196902252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb49c1083c0 0x7fb49c19b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.886+0000 7fb49ad9d640 1 -- 172.21.15.7:0/4196902252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49c1a6540 con 0x7fb49c108d10 2024-09-21T05:57:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.886+0000 7fb49ad9d640 1 --2- 172.21.15.7:0/4196902252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c108d10 0x7fb49c19bcb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb49400eaa0 tx=0x7fb49400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.886+0000 7fb493fff640 1 -- 172.21.15.7:0/4196902252 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49400cdb0 con 0x7fb49c108d10 2024-09-21T05:57:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.886+0000 7fb493fff640 1 -- 172.21.15.7:0/4196902252 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb494005020 con 0x7fb49c108d10 2024-09-21T05:57:50.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.886+0000 7fb493fff640 1 -- 172.21.15.7:0/4196902252 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4940116d0 con 0x7fb49c108d10 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.886+0000 7fb4a0bbf640 1 -- 172.21.15.7:0/4196902252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb49c1a6830 con 0x7fb49c108d10 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.886+0000 7fb4a0bbf640 1 -- 172.21.15.7:0/4196902252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb49c1a6d70 con 0x7fb49c108d10 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.889+0000 7fb4a7133740 1 Processor -- start 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.889+0000 7fb493fff640 1 -- 172.21.15.7:0/4196902252 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb4940051d0 con 0x7fb49c108d10 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.889+0000 7fb4a7133740 1 -- start start 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb4a7133740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf74ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb4a7133740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf74ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb4a7133740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 0x56494cf75530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb4a7133740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56494cee6ea0 con 0x56494cbc9070 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb4a7133740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56494ced62d0 con 0x56494cba8390 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb4a7133740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56494ceda0e0 con 0x56494cba01b0 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb491d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf74ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb491d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf74ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37658/0 (socket says 172.21.15.7:37658) 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb491d9b640 1 -- 172.21.15.7:0/2546036738 learned_addr learned my addr 172.21.15.7:0/2546036738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:50.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb49a59c640 1 --2- 172.21.15.7:0/2546036738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf74ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb491d9b640 1 --2- 172.21.15.7:0/2546036738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 0x56494cf75530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb491d9b640 1 -- 172.21.15.7:0/2546036738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 msgr2=0x56494cf74ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb491d9b640 1 --2- 172.21.15.7:0/2546036738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf74ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb491d9b640 1 -- 172.21.15.7:0/2546036738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 msgr2=0x56494cf75530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb491d9b640 1 --2- 172.21.15.7:0/2546036738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 0x56494cf75530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb491d9b640 1 -- 172.21.15.7:0/2546036738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56494cc34650 con 0x56494cbc9070 2024-09-21T05:57:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.890+0000 7fb491d9b640 1 --2- 172.21.15.7:0/2546036738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf74ab0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb48400ae30 tx=0x7fb48400a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad492f9f0a88dfe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.891+0000 7fb490d99640 1 -- 172.21.15.7:0/2546036738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484004220 con 0x56494cbc9070 2024-09-21T05:57:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.891+0000 7fb493fff640 1 --2- 172.21.15.7:0/4196902252 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb4880b6680 0x7fb4880b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.891+0000 7fb490d99640 1 -- 172.21.15.7:0/2546036738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb484017030 con 0x56494cbc9070 2024-09-21T05:57:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.891+0000 7fb490d99640 1 -- 172.21.15.7:0/2546036738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48400f450 con 0x56494cbc9070 2024-09-21T05:57:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.891+0000 7fb49a59c640 1 --2- 172.21.15.7:0/4196902252 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb4880b6680 0x7fb4880b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.891+0000 7fb493fff640 1 -- 172.21.15.7:0/4196902252 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb4940e7780 con 0x7fb49c108d10 2024-09-21T05:57:50.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.892+0000 7fb4a7133740 1 -- 172.21.15.7:0/2546036738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 msgr2=0x56494cf74ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:50.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.892+0000 7fb49a59c640 1 --2- 172.21.15.7:0/4196902252 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb4880b6680 0x7fb4880b8b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb48c000c00 tx=0x7fb48c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:50.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.892+0000 7fb4a7133740 1 --2- 172.21.15.7:0/2546036738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf74ab0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb48400ae30 tx=0x7fb48400a720 comp rx=0 tx=0).stop 2024-09-21T05:57:50.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.892+0000 7fb4a7133740 1 -- 172.21.15.7:0/2546036738 shutdown_connections 2024-09-21T05:57:50.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.892+0000 7fb4a7133740 1 --2- 172.21.15.7:0/2546036738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 0x56494cf75530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.892+0000 7fb4a7133740 1 --2- 172.21.15.7:0/2546036738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf74ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.892+0000 7fb4a7133740 1 --2- 172.21.15.7:0/2546036738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf74ab0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.892+0000 7fb4a7133740 1 -- 172.21.15.7:0/2546036738 >> 172.21.15.7:0/2546036738 conn(0x56494cbbd460 msgr2=0x56494cf729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:50.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.892+0000 7fb4a7133740 1 -- 172.21.15.7:0/2546036738 shutdown_connections 2024-09-21T05:57:50.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.892+0000 7fb4a7133740 1 -- 172.21.15.7:0/2546036738 wait complete. 2024-09-21T05:57:50.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.892+0000 7fb4a7133740 1 -- start start 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.892+0000 7fb4a7133740 1 Processor -- start 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb4a7133740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf80160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb4a7133740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 0x56494cf806a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb4a7133740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf8c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb4a7133740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56494cd37700 con 0x56494cbc9070 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb4a7133740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56494ce71160 con 0x56494cba8390 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb4a7133740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56494cf83290 con 0x56494cba01b0 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb4a7133740 10 client.0 _ll_register_callbacks cb 0x56494ce8a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb49ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf8c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb49ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf8c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37668/0 (socket says 172.21.15.7:37668) 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb49ad9d640 1 -- 172.21.15.7:0/3108792132 learned_addr learned my addr 172.21.15.7:0/3108792132 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb49a59c640 1 --2- 172.21.15.7:0/3108792132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf80160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb491d9b640 1 --2- 172.21.15.7:0/3108792132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 0x56494cf806a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb49ad9d640 1 -- 172.21.15.7:0/3108792132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 msgr2=0x56494cf80160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb49ad9d640 1 --2- 172.21.15.7:0/3108792132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf80160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb49ad9d640 1 -- 172.21.15.7:0/3108792132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 msgr2=0x56494cf806a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb49ad9d640 1 --2- 172.21.15.7:0/3108792132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 0x56494cf806a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.893+0000 7fb49ad9d640 1 -- 172.21.15.7:0/3108792132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56494ce9ec90 con 0x56494cbc9070 2024-09-21T05:57:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.894+0000 7fb49ad9d640 1 --2- 172.21.15.7:0/3108792132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf8c580 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb4940ad400 tx=0x7fb494005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36795fb55b104624 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.894+0000 7fb481ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.894+0000 7fb481ffb640 1 -- 172.21.15.7:0/3108792132 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49401f030 con 0x56494cbc9070 2024-09-21T05:57:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.894+0000 7fb481ffb640 1 -- 172.21.15.7:0/3108792132 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb4940b6250 con 0x56494cbc9070 2024-09-21T05:57:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.894+0000 7fb4a7133740 1 -- 172.21.15.7:0/3108792132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb484017030 con 0x56494cbc9070 2024-09-21T05:57:50.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.894+0000 7fb481ffb640 1 -- 172.21.15.7:0/3108792132 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb4940b7070 con 0x56494cbc9070 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.894+0000 7fb4a7133740 10 client.16278 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.894+0000 7fb4a7133740 1 -- 172.21.15.7:0/3108792132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56494cf8f000 con 0x56494cbc9070 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.894+0000 7fb481ffb640 1 -- 172.21.15.7:0/3108792132 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb484017030 con 0x56494cbc9070 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.894+0000 7fb481ffb640 1 -- 172.21.15.7:0/3108792132 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb49400f040 con 0x56494cbc9070 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.894+0000 7fb4a7133740 10 client.16278 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.894+0000 7fb4a7133740 10 client.16278 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.895+0000 7fb4a7133740 20 client.16278 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.895+0000 7fb4a7133740 1 --2- 172.21.15.7:0/3108792132 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56494cb879f0 0x56494cf924d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.895+0000 7fb4a7133740 4 client.16278 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.895+0000 7fb4a7133740 1 -- 172.21.15.7:0/3108792132 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56494cee8df0 con 0x56494cb879f0 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.895+0000 7fb49a59c640 1 --2- 172.21.15.7:0/3108792132 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56494cb879f0 0x56494cf924d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.895+0000 7fb481ffb640 10 client.16278 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.895+0000 7fb49a59c640 1 --2- 172.21.15.7:0/3108792132 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56494cb879f0 0x56494cf924d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f5544d2b0de3fc9 server_cookie=96716a478630459 in_seq=0 out_seq=0 2024-09-21T05:57:50.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.896+0000 7fb481ffb640 1 -- 172.21.15.7:0/3108792132 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56494cee8df0 con 0x56494cb879f0 2024-09-21T05:57:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.896+0000 7fb481ffb640 10 client.16278 handle_command_reply: tid=0 2024-09-21T05:57:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.896+0000 7fb4a7133740 1 client.16278 shutdown 2024-09-21T05:57:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.896+0000 7fb4a7133740 1 -- 172.21.15.7:0/3108792132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 msgr2=0x56494cf8c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.896+0000 7fb4a7133740 1 --2- 172.21.15.7:0/3108792132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf8c580 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb4940ad400 tx=0x7fb494005750 comp rx=0 tx=0).stop 2024-09-21T05:57:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.897+0000 7fb4a7133740 1 -- 172.21.15.7:0/3108792132 shutdown_connections 2024-09-21T05:57:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.897+0000 7fb4a7133740 1 --2- 172.21.15.7:0/3108792132 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56494cb879f0 0x56494cf924d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.897+0000 7fb4a7133740 1 --2- 172.21.15.7:0/3108792132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf8c580 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.897+0000 7fb4a7133740 1 --2- 172.21.15.7:0/3108792132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 0x56494cf806a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.897+0000 7fb4a7133740 1 --2- 172.21.15.7:0/3108792132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf80160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.897+0000 7fb4a7133740 1 -- 172.21.15.7:0/3108792132 >> 172.21.15.7:0/3108792132 conn(0x56494cbbd460 msgr2=0x56494cf77c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:50.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.897+0000 7fb481ffb640 0 client.16278 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:57:50.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.897+0000 7fb4a7133740 1 -- 172.21.15.7:0/3108792132 shutdown_connections 2024-09-21T05:57:50.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.897+0000 7fb4a7133740 1 -- 172.21.15.7:0/3108792132 wait complete. 2024-09-21T05:57:50.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.897+0000 7fb4a7133740 20 client.16278 trim_cache size 0 max 16384 2024-09-21T05:57:50.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.910+0000 7fb4a7133740 1 Processor -- start 2024-09-21T05:57:50.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.910+0000 7fb4a7133740 1 -- start start 2024-09-21T05:57:50.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb4a7133740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba01b0 0x56494cf761f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb4a7133740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba8390 0x56494cf8c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb4a7133740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf7d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb4a7133740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c1afb90 con 0x56494cbc9070 2024-09-21T05:57:50.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb4a7133740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c1ad460 con 0x56494cba01b0 2024-09-21T05:57:50.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb4a7133740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c1ab2b0 con 0x56494cba8390 2024-09-21T05:57:50.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb49ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf7d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb49ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf7d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37674/0 (socket says 172.21.15.7:37674) 2024-09-21T05:57:50.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb49ad9d640 1 -- 172.21.15.7:0/2107091728 learned_addr learned my addr 172.21.15.7:0/2107091728 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:50.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb491d9b640 1 --2- 172.21.15.7:0/2107091728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba8390 0x56494cf8c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb49a59c640 1 --2- 172.21.15.7:0/2107091728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba01b0 0x56494cf761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb49ad9d640 1 -- 172.21.15.7:0/2107091728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba8390 msgr2=0x56494cf8c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:50.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb49ad9d640 1 --2- 172.21.15.7:0/2107091728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba8390 0x56494cf8c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb49ad9d640 1 -- 172.21.15.7:0/2107091728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba01b0 msgr2=0x56494cf761f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:50.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb49ad9d640 1 --2- 172.21.15.7:0/2107091728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba01b0 0x56494cf761f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb49ad9d640 1 -- 172.21.15.7:0/2107091728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56494cf81420 con 0x56494cbc9070 2024-09-21T05:57:50.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.911+0000 7fb49ad9d640 1 --2- 172.21.15.7:0/2107091728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf7d350 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb4940ad690 tx=0x7fb494000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61554834c69b68c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:50.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.912+0000 7fb483fff640 1 -- 172.21.15.7:0/2107091728 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49401f070 con 0x56494cbc9070 2024-09-21T05:57:50.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.912+0000 7fb483fff640 1 -- 172.21.15.7:0/2107091728 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4940b6250 con 0x56494cbc9070 2024-09-21T05:57:50.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.912+0000 7fb483fff640 1 -- 172.21.15.7:0/2107091728 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4940a9390 con 0x56494cbc9070 2024-09-21T05:57:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.912+0000 7fb4a7133740 1 -- 172.21.15.7:0/2107091728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 msgr2=0x56494cf7d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.912+0000 7fb4a7133740 1 --2- 172.21.15.7:0/2107091728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf7d350 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb4940ad690 tx=0x7fb494000f40 comp rx=0 tx=0).stop 2024-09-21T05:57:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.912+0000 7fb4a7133740 1 -- 172.21.15.7:0/2107091728 shutdown_connections 2024-09-21T05:57:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.912+0000 7fb4a7133740 1 --2- 172.21.15.7:0/2107091728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cf7d350 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.912+0000 7fb4a7133740 1 --2- 172.21.15.7:0/2107091728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba8390 0x56494cf8c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.912+0000 7fb4a7133740 1 --2- 172.21.15.7:0/2107091728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba01b0 0x56494cf761f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.912+0000 7fb4a7133740 1 -- 172.21.15.7:0/2107091728 >> 172.21.15.7:0/2107091728 conn(0x56494cbbd460 msgr2=0x56494cf75ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.913+0000 7fb4a7133740 1 -- 172.21.15.7:0/2107091728 shutdown_connections 2024-09-21T05:57:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.913+0000 7fb4a7133740 1 -- 172.21.15.7:0/2107091728 wait complete. 2024-09-21T05:57:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.913+0000 7fb4a7133740 1 -- start start 2024-09-21T05:57:50.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.913+0000 7fb4a7133740 1 Processor -- start 2024-09-21T05:57:50.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.913+0000 7fb4a7133740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf84740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.913+0000 7fb4a7133740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 0x56494cf84c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.913+0000 7fb4a7133740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cffbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.913+0000 7fb4a7133740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c1ab920 con 0x56494cbc9070 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.913+0000 7fb4a7133740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c1acd90 con 0x56494cba8390 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.913+0000 7fb4a7133740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c1abff0 con 0x56494cba01b0 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb4a7133740 10 client.0 _ll_register_callbacks cb 0x7fb4940a9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb49a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf84740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb49ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cffbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb49a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf84740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:36530/0 (socket says 172.21.15.7:36530) 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb49ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cffbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37678/0 (socket says 172.21.15.7:37678) 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb49a59c640 1 -- 172.21.15.7:0/3213274174 learned_addr learned my addr 172.21.15.7:0/3213274174 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb491d9b640 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 0x56494cf84c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb49a59c640 1 -- 172.21.15.7:0/3213274174 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 msgr2=0x56494cf84c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb49a59c640 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 0x56494cf84c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb49a59c640 1 -- 172.21.15.7:0/3213274174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 msgr2=0x56494cffbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb49a59c640 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cffbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb49a59c640 1 -- 172.21.15.7:0/3213274174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56494cf85490 con 0x56494cba01b0 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb49ad9d640 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cffbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb491d9b640 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 0x56494cf84c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb49a59c640 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf84740 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb48c02a930 tx=0x7fb48c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11ff298a460435a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.914+0000 7fb481ffb640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb481ffb640 1 -- 172.21.15.7:0/3213274174 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c05f060 con 0x56494cba01b0 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb481ffb640 1 -- 172.21.15.7:0/3213274174 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fb48c005040 con 0x56494cba01b0 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb4a7133740 1 -- 172.21.15.7:0/3213274174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4940b6250 con 0x56494cba01b0 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb481ffb640 1 -- 172.21.15.7:0/3213274174 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb48c035040 con 0x56494cba01b0 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb4a7133740 10 client.25870 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb4a7133740 1 -- 172.21.15.7:0/3213274174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56494cffd380 con 0x56494cba01b0 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb481ffb640 1 -- 172.21.15.7:0/3213274174 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4940b6250 con 0x56494cba01b0 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb481ffb640 1 -- 172.21.15.7:0/3213274174 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb48c0035f0 con 0x56494cba01b0 2024-09-21T05:57:50.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb4a7133740 10 client.25870 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:50.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb4a7133740 10 client.25870 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:57:50.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb4a7133740 20 client.25870 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:50.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb4a7133740 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56494cb5cda0 0x56494cfffb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:50.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb4a7133740 4 client.25870 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:57:50.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.915+0000 7fb4a7133740 1 -- 172.21.15.7:0/3213274174 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56494cee48a0 con 0x56494cb5cda0 2024-09-21T05:57:50.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb491d9b640 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56494cb5cda0 0x56494cfffb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:50.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb491d9b640 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56494cb5cda0 0x56494cfffb20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7955c993f8f4c57c server_cookie=2620ddc256fb0a7c in_seq=0 out_seq=0 2024-09-21T05:57:50.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb481ffb640 10 client.25870 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:57:50.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb481ffb640 1 -- 172.21.15.7:0/3213274174 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56494cee48a0 con 0x56494cb5cda0 2024-09-21T05:57:50.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb481ffb640 10 client.25870 handle_command_reply: tid=0 2024-09-21T05:57:50.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb4a7133740 1 client.25870 shutdown 2024-09-21T05:57:50.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb4a7133740 1 -- 172.21.15.7:0/3213274174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 msgr2=0x56494cf84740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:50.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb4a7133740 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf84740 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb48c02a930 tx=0x7fb48c009260 comp rx=0 tx=0).stop 2024-09-21T05:57:50.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb4a7133740 1 -- 172.21.15.7:0/3213274174 shutdown_connections 2024-09-21T05:57:50.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb4a7133740 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56494cb5cda0 0x56494cfffb20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb4a7133740 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56494cbc9070 0x56494cffbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb481ffb640 0 client.25870 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:57:50.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb4a7133740 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56494cba8390 0x56494cf84c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb4a7133740 1 --2- 172.21.15.7:0/3213274174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56494cba01b0 0x56494cf84740 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.916+0000 7fb4a7133740 1 -- 172.21.15.7:0/3213274174 >> 172.21.15.7:0/3213274174 conn(0x56494cbbd460 msgr2=0x56494cf7e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:50.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a7133740 1 -- 172.21.15.7:0/3213274174 shutdown_connections 2024-09-21T05:57:50.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a7133740 1 -- 172.21.15.7:0/3213274174 wait complete. 2024-09-21T05:57:50.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a7133740 20 client.25870 trim_cache size 0 max 16384 2024-09-21T05:57:50.924 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:57:50.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a0bbf640 1 -- 172.21.15.7:0/4196902252 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb4880b6680 msgr2=0x7fb4880b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:50.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a0bbf640 1 --2- 172.21.15.7:0/4196902252 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb4880b6680 0x7fb4880b8b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb48c000c00 tx=0x7fb48c031400 comp rx=0 tx=0).stop 2024-09-21T05:57:50.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a0bbf640 1 -- 172.21.15.7:0/4196902252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c108d10 msgr2=0x7fb49c19bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:50.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a0bbf640 1 --2- 172.21.15.7:0/4196902252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c108d10 0x7fb49c19bcb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb49400eaa0 tx=0x7fb49400ef60 comp rx=0 tx=0).stop 2024-09-21T05:57:50.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a0bbf640 1 -- 172.21.15.7:0/4196902252 shutdown_connections 2024-09-21T05:57:50.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a0bbf640 1 --2- 172.21.15.7:0/4196902252 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb4880b6680 0x7fb4880b8b90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a0bbf640 1 --2- 172.21.15.7:0/4196902252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c108d10 0x7fb49c19bcb0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a0bbf640 1 --2- 172.21.15.7:0/4196902252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb49c1083c0 0x7fb49c19b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a0bbf640 1 --2- 172.21.15.7:0/4196902252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb49c102a80 0x7fb49c19b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a0bbf640 1 -- 172.21.15.7:0/4196902252 >> 172.21.15.7:0/4196902252 conn(0x7fb49c079740 msgr2=0x7fb49c101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a0bbf640 1 -- 172.21.15.7:0/4196902252 shutdown_connections 2024-09-21T05:57:50.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:50.917+0000 7fb4a0bbf640 1 -- 172.21.15.7:0/4196902252 wait complete. 2024-09-21T05:57:51.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T05:57:51.896 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:51.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:51 smithi027 ceph-mon[34364]: pgmap v437: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:57:52.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:51 smithi007 ceph-mon[30983]: pgmap v437: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:57:52.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:51 smithi119 ceph-mon[34833]: pgmap v437: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:57:52.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.393+0000 7fa2a2fd9640 1 -- 172.21.15.7:0/2049842037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa29c109e00 msgr2=0x7fa29c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:52.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.393+0000 7fa2a2fd9640 1 --2- 172.21.15.7:0/2049842037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa29c109e00 0x7fa29c110630 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa294009900 tx=0x7fa29402a410 comp rx=0 tx=0).stop 2024-09-21T05:57:52.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.393+0000 7fa2a2fd9640 1 -- 172.21.15.7:0/2049842037 shutdown_connections 2024-09-21T05:57:52.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.393+0000 7fa2a2fd9640 1 --2- 172.21.15.7:0/2049842037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa29c109e00 0x7fa29c110630 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.393+0000 7fa2a2fd9640 1 --2- 172.21.15.7:0/2049842037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa29c1094b0 0x7fa29c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.393+0000 7fa2a2fd9640 1 --2- 172.21.15.7:0/2049842037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa29c103b70 0x7fa29c103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.393+0000 7fa2a2fd9640 1 -- 172.21.15.7:0/2049842037 >> 172.21.15.7:0/2049842037 conn(0x7fa29c0ff5e0 msgr2=0x7fa29c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.393+0000 7fa2a2fd9640 1 -- 172.21.15.7:0/2049842037 shutdown_connections 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.393+0000 7fa2a2fd9640 1 -- 172.21.15.7:0/2049842037 wait complete. 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.394+0000 7fa2a2fd9640 1 Processor -- start 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.394+0000 7fa2a2fd9640 1 -- start start 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.394+0000 7fa2a2fd9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa29c103b70 0x7fa29c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.394+0000 7fa2a2fd9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa29c1094b0 0x7fa29c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.394+0000 7fa2a2fd9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa29c109e00 0x7fa29c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.394+0000 7fa2a2fd9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c113b20 con 0x7fa29c1094b0 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.394+0000 7fa2a2fd9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c1139a0 con 0x7fa29c103b70 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.394+0000 7fa2a2fd9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c113ca0 con 0x7fa29c109e00 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.394+0000 7fa29bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa29c1094b0 0x7fa29c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.394+0000 7fa29bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa29c1094b0 0x7fa29c19aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37690/0 (socket says 172.21.15.7:37690) 2024-09-21T05:57:52.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.394+0000 7fa29bfff640 1 -- 172.21.15.7:0/2658227659 learned_addr learned my addr 172.21.15.7:0/2658227659 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.395+0000 7fa2a1576640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa29c109e00 0x7fa29c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.395+0000 7fa2a0d75640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa29c103b70 0x7fa29c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.395+0000 7fa29bfff640 1 -- 172.21.15.7:0/2658227659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa29c109e00 msgr2=0x7fa29c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.395+0000 7fa29bfff640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa29c109e00 0x7fa29c19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.395+0000 7fa29bfff640 1 -- 172.21.15.7:0/2658227659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa29c103b70 msgr2=0x7fa29c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.395+0000 7fa29bfff640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa29c103b70 0x7fa29c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.395+0000 7fa29bfff640 1 -- 172.21.15.7:0/2658227659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29c1a0440 con 0x7fa29c1094b0 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.395+0000 7fa29bfff640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa29c1094b0 0x7fa29c19aa70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00ea50 tx=0x7fa28c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.395+0000 7fa299ffb640 1 -- 172.21.15.7:0/2658227659 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00cd00 con 0x7fa29c1094b0 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.395+0000 7fa299ffb640 1 -- 172.21.15.7:0/2658227659 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa28c011920 con 0x7fa29c1094b0 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.395+0000 7fa2a2fd9640 1 -- 172.21.15.7:0/2658227659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29c1a0730 con 0x7fa29c1094b0 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.395+0000 7fa299ffb640 1 -- 172.21.15.7:0/2658227659 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c01a9f0 con 0x7fa29c1094b0 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.396+0000 7fa2a2fd9640 1 -- 172.21.15.7:0/2658227659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa29c1a6f10 con 0x7fa29c1094b0 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.398+0000 7fa2a954d740 1 Processor -- start 2024-09-21T05:57:52.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.398+0000 7fa299ffb640 1 -- 172.21.15.7:0/2658227659 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa28c011ad0 con 0x7fa29c1094b0 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.398+0000 7fa2a954d740 1 -- start start 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa2a954d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f29070 0x5600b62d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa2a954d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa2a954d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 0x5600b62d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa2a954d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5600b6246ea0 con 0x5600b5f08390 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa2a954d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5600b62362d0 con 0x5600b5f29070 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa2a954d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5600b623a0e0 con 0x5600b5f001b0 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa29bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 0x5600b62d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa29bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 0x5600b62d1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37692/0 (socket says 172.21.15.7:37692) 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa2a1576640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f29070 0x5600b62d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa29bfff640 1 -- 172.21.15.7:0/180057124 learned_addr learned my addr 172.21.15.7:0/180057124 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa2a0d75640 1 --2- 172.21.15.7:0/180057124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa299ffb640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa2880b6700 0x7fa2880b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa29bfff640 1 -- 172.21.15.7:0/180057124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 msgr2=0x5600b62d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa29bfff640 1 --2- 172.21.15.7:0/180057124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa29bfff640 1 -- 172.21.15.7:0/180057124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f29070 msgr2=0x5600b62d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa29bfff640 1 --2- 172.21.15.7:0/180057124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f29070 0x5600b62d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa29bfff640 1 -- 172.21.15.7:0/180057124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b5f94650 con 0x5600b5f08390 2024-09-21T05:57:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa2a0d75640 1 --2- 172.21.15.7:0/180057124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:57:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa2a1576640 1 --2- 172.21.15.7:0/180057124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f29070 0x5600b62d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:57:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.399+0000 7fa2a1576640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa2880b6700 0x7fa2880b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.400+0000 7fa299ffb640 1 -- 172.21.15.7:0/2658227659 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa28c0e7af0 con 0x7fa29c1094b0 2024-09-21T05:57:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.400+0000 7fa29bfff640 1 --2- 172.21.15.7:0/180057124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 0x5600b62d1120 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0e5230 tx=0x7fa28c071a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86435dcb487b17f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:52.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.400+0000 7fa292ffd640 1 -- 172.21.15.7:0/180057124 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0ad790 con 0x5600b5f08390 2024-09-21T05:57:52.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.400+0000 7fa292ffd640 1 -- 172.21.15.7:0/180057124 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa28c0ad4d0 con 0x5600b5f08390 2024-09-21T05:57:52.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.400+0000 7fa292ffd640 1 -- 172.21.15.7:0/180057124 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0ad130 con 0x5600b5f08390 2024-09-21T05:57:52.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.401+0000 7fa2a954d740 1 -- 172.21.15.7:0/180057124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 msgr2=0x5600b62d1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:52.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.401+0000 7fa2a954d740 1 --2- 172.21.15.7:0/180057124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 0x5600b62d1120 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0e5230 tx=0x7fa28c071a00 comp rx=0 tx=0).stop 2024-09-21T05:57:52.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.401+0000 7fa2a1576640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa2880b6700 0x7fa2880b8c10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa294006010 tx=0x7fa294009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:52.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.401+0000 7fa2a954d740 1 -- 172.21.15.7:0/180057124 shutdown_connections 2024-09-21T05:57:52.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.401+0000 7fa2a954d740 1 --2- 172.21.15.7:0/180057124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 0x5600b62d1120 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.401+0000 7fa2a954d740 1 --2- 172.21.15.7:0/180057124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.401+0000 7fa2a954d740 1 --2- 172.21.15.7:0/180057124 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f29070 0x5600b62d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.401+0000 7fa2a954d740 1 -- 172.21.15.7:0/180057124 >> 172.21.15.7:0/180057124 conn(0x5600b5f1d460 msgr2=0x5600b62ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.401+0000 7fa2a954d740 1 -- 172.21.15.7:0/180057124 shutdown_connections 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.401+0000 7fa2a954d740 1 -- 172.21.15.7:0/180057124 wait complete. 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.401+0000 7fa2a954d740 1 -- start start 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.402+0000 7fa2a954d740 1 Processor -- start 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.402+0000 7fa2a954d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.402+0000 7fa2a954d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f08390 0x5600b62d81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.402+0000 7fa2a954d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 0x5600b62d8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.402+0000 7fa2a954d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5600b6097700 con 0x5600b5f29070 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.402+0000 7fa2a954d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5600b61d1160 con 0x5600b5f08390 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.402+0000 7fa2a954d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5600b62e7610 con 0x5600b5f001b0 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.402+0000 7fa2a954d740 10 client.0 _ll_register_callbacks cb 0x5600b61ea9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.402+0000 7fa2a1576640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 0x5600b62d8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.402+0000 7fa2a1576640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 0x5600b62d8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37704/0 (socket says 172.21.15.7:37704) 2024-09-21T05:57:52.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.402+0000 7fa2a1576640 1 -- 172.21.15.7:0/844139643 learned_addr learned my addr 172.21.15.7:0/844139643 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.402+0000 7fa2a0d75640 1 --2- 172.21.15.7:0/844139643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.402+0000 7fa29bfff640 1 --2- 172.21.15.7:0/844139643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f08390 0x5600b62d81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa2a1576640 1 -- 172.21.15.7:0/844139643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 msgr2=0x5600b62d7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa2a1576640 1 --2- 172.21.15.7:0/844139643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa2a1576640 1 -- 172.21.15.7:0/844139643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f08390 msgr2=0x5600b62d81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa2a1576640 1 --2- 172.21.15.7:0/844139643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f08390 0x5600b62d81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa2a1576640 1 -- 172.21.15.7:0/844139643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600b61fec90 con 0x5600b5f29070 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa2a1576640 1 --2- 172.21.15.7:0/844139643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 0x5600b62d8700 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa294009900 tx=0x7fa29402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65936397c896149 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa27bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa27bfff640 1 -- 172.21.15.7:0/844139643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294035040 con 0x5600b5f29070 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa27bfff640 1 -- 172.21.15.7:0/844139643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa294005030 con 0x5600b5f29070 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa2a954d740 1 -- 172.21.15.7:0/844139643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa28c0ad4d0 con 0x5600b5f29070 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa27bfff640 1 -- 172.21.15.7:0/844139643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa294057050 con 0x5600b5f29070 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa2a954d740 10 client.16296 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa2a954d740 1 -- 172.21.15.7:0/844139643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5600b62f32a0 con 0x5600b5f29070 2024-09-21T05:57:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.403+0000 7fa27bfff640 1 -- 172.21.15.7:0/844139643 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa28c0ad4d0 con 0x5600b5f29070 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.404+0000 7fa27bfff640 1 -- 172.21.15.7:0/844139643 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa2940035f0 con 0x5600b5f29070 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.404+0000 7fa2a954d740 10 client.16296 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.404+0000 7fa2a954d740 10 client.16296 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.404+0000 7fa2a954d740 20 client.16296 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.404+0000 7fa2a954d740 1 --2- 172.21.15.7:0/844139643 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5600b5ee79f0 0x5600b62f6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.404+0000 7fa2a954d740 4 client.16296 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.404+0000 7fa2a954d740 1 -- 172.21.15.7:0/844139643 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600b6248df0 con 0x5600b5ee79f0 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.404+0000 7fa2a0d75640 1 --2- 172.21.15.7:0/844139643 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5600b5ee79f0 0x5600b62f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.404+0000 7fa2a0d75640 1 --2- 172.21.15.7:0/844139643 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5600b5ee79f0 0x5600b62f6840 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=95467e83b92082d2 server_cookie=3ef4c61a74219709 in_seq=0 out_seq=0 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.404+0000 7fa27bfff640 10 client.16296 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.405+0000 7fa27bfff640 1 -- 172.21.15.7:0/844139643 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5600b6248df0 con 0x5600b5ee79f0 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.405+0000 7fa27bfff640 10 client.16296 handle_command_reply: tid=0 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.405+0000 7fa2a954d740 1 client.16296 shutdown 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.405+0000 7fa2a954d740 1 -- 172.21.15.7:0/844139643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 msgr2=0x5600b62d8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.405+0000 7fa2a954d740 1 --2- 172.21.15.7:0/844139643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 0x5600b62d8700 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa294009900 tx=0x7fa29402a410 comp rx=0 tx=0).stop 2024-09-21T05:57:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.405+0000 7fa2a954d740 1 -- 172.21.15.7:0/844139643 shutdown_connections 2024-09-21T05:57:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.405+0000 7fa2a954d740 1 --2- 172.21.15.7:0/844139643 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5600b5ee79f0 0x5600b62f6840 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.405+0000 7fa2a954d740 1 --2- 172.21.15.7:0/844139643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 0x5600b62d8700 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.405+0000 7fa27bfff640 0 client.16296 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:57:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.405+0000 7fa2a954d740 1 --2- 172.21.15.7:0/844139643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f08390 0x5600b62d81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.405+0000 7fa2a954d740 1 --2- 172.21.15.7:0/844139643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.405+0000 7fa2a954d740 1 -- 172.21.15.7:0/844139643 >> 172.21.15.7:0/844139643 conn(0x5600b5f1d460 msgr2=0x5600b62d2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.406+0000 7fa2a954d740 1 -- 172.21.15.7:0/844139643 shutdown_connections 2024-09-21T05:57:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.406+0000 7fa2a954d740 1 -- 172.21.15.7:0/844139643 wait complete. 2024-09-21T05:57:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.406+0000 7fa2a954d740 20 client.16296 trim_cache size 0 max 16384 2024-09-21T05:57:52.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.419+0000 7fa2a954d740 1 Processor -- start 2024-09-21T05:57:52.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.419+0000 7fa2a954d740 1 -- start start 2024-09-21T05:57:52.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.419+0000 7fa2a954d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.419+0000 7fa2a954d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 0x5600b62d4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.419+0000 7fa2a954d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f29070 0x5600b62d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.419+0000 7fa2a954d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c1afc90 con 0x5600b5f08390 2024-09-21T05:57:52.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.419+0000 7fa2a954d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c1ad560 con 0x5600b5f29070 2024-09-21T05:57:52.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.419+0000 7fa2a954d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c1ab3d0 con 0x5600b5f001b0 2024-09-21T05:57:52.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.419+0000 7fa29bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 0x5600b62d4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.419+0000 7fa29bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 0x5600b62d4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37720/0 (socket says 172.21.15.7:37720) 2024-09-21T05:57:52.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.419+0000 7fa29bfff640 1 -- 172.21.15.7:0/843925420 learned_addr learned my addr 172.21.15.7:0/843925420 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:52.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.419+0000 7fa2a1576640 1 --2- 172.21.15.7:0/843925420 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f29070 0x5600b62d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.420+0000 7fa2a0d75640 1 --2- 172.21.15.7:0/843925420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.420+0000 7fa29bfff640 1 -- 172.21.15.7:0/843925420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 msgr2=0x5600b62d98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:52.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.420+0000 7fa29bfff640 1 --2- 172.21.15.7:0/843925420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.420+0000 7fa29bfff640 1 -- 172.21.15.7:0/843925420 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f29070 msgr2=0x5600b62d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:52.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.420+0000 7fa29bfff640 1 --2- 172.21.15.7:0/843925420 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f29070 0x5600b62d53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.420+0000 7fa29bfff640 1 -- 172.21.15.7:0/843925420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b62dac10 con 0x5600b5f08390 2024-09-21T05:57:52.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.420+0000 7fa2a0d75640 1 --2- 172.21.15.7:0/843925420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:52.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.420+0000 7fa29bfff640 1 --2- 172.21.15.7:0/843925420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 0x5600b62d4e70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0e58c0 tx=0x7fa28c00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c97f15d446f5efb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:52.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.420+0000 7fa2927fc640 1 -- 172.21.15.7:0/843925420 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0ad310 con 0x5600b5f08390 2024-09-21T05:57:52.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.420+0000 7fa2927fc640 1 -- 172.21.15.7:0/843925420 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa28c0ad4d0 con 0x5600b5f08390 2024-09-21T05:57:52.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.420+0000 7fa2927fc640 1 -- 172.21.15.7:0/843925420 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0b24a0 con 0x5600b5f08390 2024-09-21T05:57:52.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.421+0000 7fa2a954d740 1 -- 172.21.15.7:0/843925420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 msgr2=0x5600b62d4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:52.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.421+0000 7fa2a954d740 1 --2- 172.21.15.7:0/843925420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 0x5600b62d4e70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0e58c0 tx=0x7fa28c00cea0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.421+0000 7fa2a954d740 1 -- 172.21.15.7:0/843925420 shutdown_connections 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.421+0000 7fa2a954d740 1 --2- 172.21.15.7:0/843925420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f08390 0x5600b62d4e70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.421+0000 7fa2a954d740 1 --2- 172.21.15.7:0/843925420 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f29070 0x5600b62d53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.421+0000 7fa2a954d740 1 --2- 172.21.15.7:0/843925420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62d98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.421+0000 7fa2a954d740 1 -- 172.21.15.7:0/843925420 >> 172.21.15.7:0/843925420 conn(0x5600b5f1d460 msgr2=0x5600b62d91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.421+0000 7fa2a954d740 1 -- 172.21.15.7:0/843925420 shutdown_connections 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.421+0000 7fa2a954d740 1 -- 172.21.15.7:0/843925420 wait complete. 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.421+0000 7fa2a954d740 1 -- start start 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.421+0000 7fa2a954d740 1 Processor -- start 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a954d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62e8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a954d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f08390 0x5600b62e8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a954d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 0x5600b62e91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a954d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c1aba20 con 0x5600b5f29070 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a954d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c1ace90 con 0x5600b5f08390 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a954d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c1ac0f0 con 0x5600b5f001b0 2024-09-21T05:57:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a954d740 10 client.0 _ll_register_callbacks cb 0x7fa294032b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a1576640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 0x5600b62e91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a1576640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 0x5600b62e91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37734/0 (socket says 172.21.15.7:37734) 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a1576640 1 -- 172.21.15.7:0/2286661110 learned_addr learned my addr 172.21.15.7:0/2286661110 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa29bfff640 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f08390 0x5600b62e8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a0d75640 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62e8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a1576640 1 -- 172.21.15.7:0/2286661110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 msgr2=0x5600b62e8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a1576640 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62e8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a1576640 1 -- 172.21.15.7:0/2286661110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f08390 msgr2=0x5600b62e8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a1576640 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f08390 0x5600b62e8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.422+0000 7fa2a1576640 1 -- 172.21.15.7:0/2286661110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600b6360200 con 0x5600b5f29070 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.423+0000 7fa2a0d75640 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62e8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.423+0000 7fa29bfff640 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f08390 0x5600b62e8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.423+0000 7fa2a1576640 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 0x5600b62e91e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa294003a90 tx=0x7fa294031580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3abd74b7edb3786 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.423+0000 7fa27bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.423+0000 7fa27bfff640 1 -- 172.21.15.7:0/2286661110 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294035040 con 0x5600b5f29070 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.423+0000 7fa27bfff640 1 -- 172.21.15.7:0/2286661110 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa294003e00 con 0x5600b5f29070 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.423+0000 7fa2a954d740 1 -- 172.21.15.7:0/2286661110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa28c0ad4d0 con 0x5600b5f29070 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.423+0000 7fa27bfff640 1 -- 172.21.15.7:0/2286661110 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa29406d050 con 0x5600b5f29070 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.423+0000 7fa2a954d740 10 client.16302 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.423+0000 7fa2a954d740 1 -- 172.21.15.7:0/2286661110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5600b63613a0 con 0x5600b5f29070 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.423+0000 7fa27bfff640 1 -- 172.21.15.7:0/2286661110 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa28c0ad4d0 con 0x5600b5f29070 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.424+0000 7fa27bfff640 1 -- 172.21.15.7:0/2286661110 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa294004a40 con 0x5600b5f29070 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.424+0000 7fa2a954d740 10 client.16302 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.424+0000 7fa2a954d740 10 client.16302 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.424+0000 7fa2a954d740 20 client.16302 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.424+0000 7fa2a954d740 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5600b5ebcda0 0x5600b6363b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.424+0000 7fa2a954d740 4 client.16302 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.424+0000 7fa2a954d740 1 -- 172.21.15.7:0/2286661110 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5600b62448a0 con 0x5600b5ebcda0 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.424+0000 7fa2a0d75640 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5600b5ebcda0 0x5600b6363b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:52.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa2a0d75640 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5600b5ebcda0 0x5600b6363b90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=596bde1c0bd7ea6a server_cookie=6fd0d2d82e433560 in_seq=0 out_seq=0 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa27bfff640 10 client.16302 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa27bfff640 1 -- 172.21.15.7:0/2286661110 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5600b62448a0 con 0x5600b5ebcda0 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa27bfff640 10 client.16302 handle_command_reply: tid=0 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa2a954d740 1 client.16302 shutdown 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa2a954d740 1 -- 172.21.15.7:0/2286661110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 msgr2=0x5600b62e91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa2a954d740 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 0x5600b62e91e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa294003a90 tx=0x7fa294031580 comp rx=0 tx=0).stop 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa2a954d740 1 -- 172.21.15.7:0/2286661110 shutdown_connections 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa2a954d740 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5600b5ebcda0 0x5600b6363b90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa2a954d740 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600b5f29070 0x5600b62e91e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa2a954d740 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600b5f08390 0x5600b62e8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa27bfff640 0 client.16302 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa2a954d740 1 --2- 172.21.15.7:0/2286661110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600b5f001b0 0x5600b62e8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa2a954d740 1 -- 172.21.15.7:0/2286661110 >> 172.21.15.7:0/2286661110 conn(0x5600b5f1d460 msgr2=0x5600b62ce580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa2a954d740 1 -- 172.21.15.7:0/2286661110 shutdown_connections 2024-09-21T05:57:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa2a954d740 1 -- 172.21.15.7:0/2286661110 wait complete. 2024-09-21T05:57:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.425+0000 7fa2a954d740 20 client.16302 trim_cache size 0 max 16384 2024-09-21T05:57:52.432 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:57:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.426+0000 7fa2a2fd9640 1 -- 172.21.15.7:0/2658227659 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa2880b6700 msgr2=0x7fa2880b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.426+0000 7fa2a2fd9640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa2880b6700 0x7fa2880b8c10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa294006010 tx=0x7fa294009260 comp rx=0 tx=0).stop 2024-09-21T05:57:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.426+0000 7fa2a2fd9640 1 -- 172.21.15.7:0/2658227659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa29c1094b0 msgr2=0x7fa29c19aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.426+0000 7fa2a2fd9640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa29c1094b0 0x7fa29c19aa70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00ea50 tx=0x7fa28c00ee50 comp rx=0 tx=0).stop 2024-09-21T05:57:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.426+0000 7fa2a2fd9640 1 -- 172.21.15.7:0/2658227659 shutdown_connections 2024-09-21T05:57:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.426+0000 7fa2a2fd9640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa2880b6700 0x7fa2880b8c10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.426+0000 7fa2a2fd9640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa29c1094b0 0x7fa29c19aa70 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.426+0000 7fa2a2fd9640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa29c109e00 0x7fa29c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.426+0000 7fa2a2fd9640 1 --2- 172.21.15.7:0/2658227659 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa29c103b70 0x7fa29c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.426+0000 7fa2a2fd9640 1 -- 172.21.15.7:0/2658227659 >> 172.21.15.7:0/2658227659 conn(0x7fa29c0ff5e0 msgr2=0x7fa29c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.426+0000 7fa2a2fd9640 1 -- 172.21.15.7:0/2658227659 shutdown_connections 2024-09-21T05:57:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:52.426+0000 7fa2a2fd9640 1 -- 172.21.15.7:0/2658227659 wait complete. 2024-09-21T05:57:53.029 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T05:57:53.291 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.826+0000 7f27265c4640 1 -- 172.21.15.7:0/1563386652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2720109e10 msgr2=0x7f2720110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.826+0000 7f27265c4640 1 --2- 172.21.15.7:0/1563386652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2720109e10 0x7f2720110640 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2718009ca0 tx=0x7f271802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.826+0000 7f27265c4640 1 -- 172.21.15.7:0/1563386652 shutdown_connections 2024-09-21T05:57:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.826+0000 7f27265c4640 1 --2- 172.21.15.7:0/1563386652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2720109e10 0x7f2720110640 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.826+0000 7f27265c4640 1 --2- 172.21.15.7:0/1563386652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27201094c0 0x7f27201098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.826+0000 7f27265c4640 1 --2- 172.21.15.7:0/1563386652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2720103b80 0x7f2720103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.826+0000 7f27265c4640 1 -- 172.21.15.7:0/1563386652 >> 172.21.15.7:0/1563386652 conn(0x7f27200ff610 msgr2=0x7f2720101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.826+0000 7f27265c4640 1 -- 172.21.15.7:0/1563386652 shutdown_connections 2024-09-21T05:57:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.826+0000 7f27265c4640 1 -- 172.21.15.7:0/1563386652 wait complete. 2024-09-21T05:57:53.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.827+0000 7f27265c4640 1 Processor -- start 2024-09-21T05:57:53.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.827+0000 7f27265c4640 1 -- start start 2024-09-21T05:57:53.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f27265c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2720103b80 0x7f272019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f27265c4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27201094c0 0x7f272019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f27265c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2720109e10 0x7f272019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f27265c4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2720113ad0 con 0x7f2720103b80 2024-09-21T05:57:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f27265c4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2720113950 con 0x7f27201094c0 2024-09-21T05:57:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f27265c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2720113c50 con 0x7f2720109e10 2024-09-21T05:57:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f271ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2720103b80 0x7f272019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f271ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2720103b80 0x7f272019a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37746/0 (socket says 172.21.15.7:37746) 2024-09-21T05:57:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f271ffff640 1 -- 172.21.15.7:0/2885833778 learned_addr learned my addr 172.21.15.7:0/2885833778 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f2724b61640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2720109e10 0x7f272019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f2717fff640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27201094c0 0x7f272019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f271ffff640 1 -- 172.21.15.7:0/2885833778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2720109e10 msgr2=0x7f272019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f271ffff640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2720109e10 0x7f272019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f271ffff640 1 -- 172.21.15.7:0/2885833778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27201094c0 msgr2=0x7f272019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f271ffff640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27201094c0 0x7f272019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f271ffff640 1 -- 172.21.15.7:0/2885833778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27201a02f0 con 0x7f2720103b80 2024-09-21T05:57:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f2717fff640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27201094c0 0x7f272019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:57:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.828+0000 7f271ffff640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2720103b80 0x7f272019a440 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f271000d950 tx=0x7f271000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.829+0000 7f271dffb640 1 -- 172.21.15.7:0/2885833778 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2710017030 con 0x7f2720103b80 2024-09-21T05:57:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.829+0000 7f27265c4640 1 -- 172.21.15.7:0/2885833778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27201a05e0 con 0x7f2720103b80 2024-09-21T05:57:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.829+0000 7f271dffb640 1 -- 172.21.15.7:0/2885833778 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2710004020 con 0x7f2720103b80 2024-09-21T05:57:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.829+0000 7f271dffb640 1 -- 172.21.15.7:0/2885833778 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27100047a0 con 0x7f2720103b80 2024-09-21T05:57:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.829+0000 7f27265c4640 1 -- 172.21.15.7:0/2885833778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27201a6e00 con 0x7f2720103b80 2024-09-21T05:57:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.831+0000 7f272cb38740 1 Processor -- start 2024-09-21T05:57:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f272cb38740 1 -- start start 2024-09-21T05:57:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f271dffb640 1 -- 172.21.15.7:0/2885833778 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f2710009a30 con 0x7f2720103b80 2024-09-21T05:57:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f272cb38740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd48c070 0x55e6dd8332c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f272cb38740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 0x55e6dd833800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f272cb38740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd833d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f272cb38740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e6dd7a9ea0 con 0x55e6dd46b390 2024-09-21T05:57:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f272cb38740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e6dd7992d0 con 0x55e6dd4631b0 2024-09-21T05:57:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f272cb38740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e6dd79d0e0 con 0x55e6dd48c070 2024-09-21T05:57:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f2717fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd833d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f2717fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd833d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37760/0 (socket says 172.21.15.7:37760) 2024-09-21T05:57:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f2717fff640 1 -- 172.21.15.7:0/340623047 learned_addr learned my addr 172.21.15.7:0/340623047 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f2724b61640 1 --2- 172.21.15.7:0/340623047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd48c070 0x55e6dd8332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f271ffff640 1 --2- 172.21.15.7:0/340623047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 0x55e6dd833800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f2717fff640 1 -- 172.21.15.7:0/340623047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd48c070 msgr2=0x55e6dd8332c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.832+0000 7f2717fff640 1 --2- 172.21.15.7:0/340623047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd48c070 0x55e6dd8332c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.833+0000 7f2717fff640 1 -- 172.21.15.7:0/340623047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 msgr2=0x55e6dd833800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.833+0000 7f2717fff640 1 --2- 172.21.15.7:0/340623047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 0x55e6dd833800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.833+0000 7f2717fff640 1 -- 172.21.15.7:0/340623047 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6dd4f7650 con 0x55e6dd46b390 2024-09-21T05:57:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.833+0000 7f2717fff640 1 --2- 172.21.15.7:0/340623047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd833d40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f270800bb20 tx=0x7f270800d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cb53ee04bcd901 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.833+0000 7f27167fc640 1 -- 172.21.15.7:0/340623047 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708017420 con 0x55e6dd46b390 2024-09-21T05:57:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.833+0000 7f27167fc640 1 -- 172.21.15.7:0/340623047 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2708017a70 con 0x55e6dd46b390 2024-09-21T05:57:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.833+0000 7f27167fc640 1 -- 172.21.15.7:0/340623047 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270800f9f0 con 0x55e6dd46b390 2024-09-21T05:57:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.833+0000 7f271dffb640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f270c0b6730 0x7f270c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.833+0000 7f2724b61640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f270c0b6730 0x7f270c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.833+0000 7f271dffb640 1 -- 172.21.15.7:0/2885833778 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f27100e71b0 con 0x7f2720103b80 2024-09-21T05:57:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.834+0000 7f272cb38740 1 -- 172.21.15.7:0/340623047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 msgr2=0x55e6dd833d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.834+0000 7f2724b61640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f270c0b6730 0x7f270c0b8c40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2718005cc0 tx=0x7f2718005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.834+0000 7f272cb38740 1 --2- 172.21.15.7:0/340623047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd833d40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f270800bb20 tx=0x7f270800d340 comp rx=0 tx=0).stop 2024-09-21T05:57:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.834+0000 7f272cb38740 1 -- 172.21.15.7:0/340623047 shutdown_connections 2024-09-21T05:57:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.834+0000 7f272cb38740 1 --2- 172.21.15.7:0/340623047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd833d40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.834+0000 7f272cb38740 1 --2- 172.21.15.7:0/340623047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 0x55e6dd833800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.834+0000 7f272cb38740 1 --2- 172.21.15.7:0/340623047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd48c070 0x55e6dd8332c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.834+0000 7f272cb38740 1 -- 172.21.15.7:0/340623047 >> 172.21.15.7:0/340623047 conn(0x55e6dd480460 msgr2=0x55e6dd8311b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.834+0000 7f272cb38740 1 -- 172.21.15.7:0/340623047 shutdown_connections 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.834+0000 7f272cb38740 1 -- 172.21.15.7:0/340623047 wait complete. 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.835+0000 7f272cb38740 1 -- start start 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.835+0000 7f272cb38740 1 Processor -- start 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.835+0000 7f272cb38740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 0x55e6dd842d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.835+0000 7f272cb38740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd843260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.835+0000 7f272cb38740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd48c070 0x55e6dd8437c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.835+0000 7f272cb38740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e6dd5fa700 con 0x55e6dd46b390 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.835+0000 7f272cb38740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e6dd734160 con 0x55e6dd4631b0 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.835+0000 7f272cb38740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e6dd845e00 con 0x55e6dd48c070 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.835+0000 7f272cb38740 10 client.0 _ll_register_callbacks cb 0x55e6dd74d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.835+0000 7f2717fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd843260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.835+0000 7f2717fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd843260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37770/0 (socket says 172.21.15.7:37770) 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.835+0000 7f2717fff640 1 -- 172.21.15.7:0/623552280 learned_addr learned my addr 172.21.15.7:0/623552280 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.835+0000 7f2724b61640 1 --2- 172.21.15.7:0/623552280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd48c070 0x55e6dd8437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f271ffff640 1 --2- 172.21.15.7:0/623552280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 0x55e6dd842d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f2717fff640 1 -- 172.21.15.7:0/623552280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd48c070 msgr2=0x55e6dd8437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f2717fff640 1 --2- 172.21.15.7:0/623552280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd48c070 0x55e6dd8437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f2717fff640 1 -- 172.21.15.7:0/623552280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 msgr2=0x55e6dd842d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f2717fff640 1 --2- 172.21.15.7:0/623552280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 0x55e6dd842d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f2717fff640 1 -- 172.21.15.7:0/623552280 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6dd761c90 con 0x55e6dd46b390 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f2717fff640 1 --2- 172.21.15.7:0/623552280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd843260 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f270800f570 tx=0x7f2708017ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6d79cd92fd2187 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f26ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f26ff7fe640 1 -- 172.21.15.7:0/623552280 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708025070 con 0x55e6dd46b390 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f26ff7fe640 1 -- 172.21.15.7:0/623552280 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f2708005040 con 0x55e6dd46b390 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f272cb38740 1 -- 172.21.15.7:0/623552280 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2708017a70 con 0x55e6dd46b390 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f26ff7fe640 1 -- 172.21.15.7:0/623552280 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2708031050 con 0x55e6dd46b390 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f272cb38740 10 client.16314 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.836+0000 7f272cb38740 1 -- 172.21.15.7:0/623552280 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e6dd851ac0 con 0x55e6dd46b390 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.837+0000 7f26ff7fe640 1 -- 172.21.15.7:0/623552280 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2708017a70 con 0x55e6dd46b390 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.837+0000 7f26ff7fe640 1 -- 172.21.15.7:0/623552280 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f27080046c0 con 0x55e6dd46b390 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.837+0000 7f272cb38740 10 client.16314 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.837+0000 7f272cb38740 10 client.16314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.837+0000 7f272cb38740 20 client.16314 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.837+0000 7f272cb38740 1 --2- 172.21.15.7:0/623552280 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e6dd44a9f0 0x55e6dd854ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.837+0000 7f272cb38740 4 client.16314 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.837+0000 7f272cb38740 1 -- 172.21.15.7:0/623552280 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6dd7abdf0 con 0x55e6dd44a9f0 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.837+0000 7f271ffff640 1 --2- 172.21.15.7:0/623552280 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e6dd44a9f0 0x55e6dd854ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.838+0000 7f26ff7fe640 10 client.16314 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.838+0000 7f271ffff640 1 --2- 172.21.15.7:0/623552280 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e6dd44a9f0 0x55e6dd854ee0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f16ca0385f680a4 server_cookie=322d81d4ca983d57 in_seq=0 out_seq=0 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.838+0000 7f26ff7fe640 1 -- 172.21.15.7:0/623552280 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6dd7abdf0 con 0x55e6dd44a9f0 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.838+0000 7f26ff7fe640 10 client.16314 handle_command_reply: tid=0 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.838+0000 7f272cb38740 1 client.16314 shutdown 2024-09-21T05:57:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.839+0000 7f272cb38740 1 -- 172.21.15.7:0/623552280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 msgr2=0x55e6dd843260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.839+0000 7f272cb38740 1 --2- 172.21.15.7:0/623552280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd843260 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f270800f570 tx=0x7f2708017ed0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.839+0000 7f272cb38740 1 -- 172.21.15.7:0/623552280 shutdown_connections 2024-09-21T05:57:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.839+0000 7f272cb38740 1 --2- 172.21.15.7:0/623552280 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e6dd44a9f0 0x55e6dd854ee0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.839+0000 7f272cb38740 1 --2- 172.21.15.7:0/623552280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd843260 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.839+0000 7f26ff7fe640 0 client.16314 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.839+0000 7f272cb38740 1 --2- 172.21.15.7:0/623552280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd48c070 0x55e6dd8437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.839+0000 7f272cb38740 1 --2- 172.21.15.7:0/623552280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 0x55e6dd842d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.839+0000 7f272cb38740 1 -- 172.21.15.7:0/623552280 >> 172.21.15.7:0/623552280 conn(0x55e6dd480460 msgr2=0x55e6dd834cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.839+0000 7f272cb38740 1 -- 172.21.15.7:0/623552280 shutdown_connections 2024-09-21T05:57:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.839+0000 7f272cb38740 1 -- 172.21.15.7:0/623552280 wait complete. 2024-09-21T05:57:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.839+0000 7f272cb38740 20 client.16314 trim_cache size 0 max 16384 2024-09-21T05:57:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.852+0000 7f272cb38740 1 Processor -- start 2024-09-21T05:57:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.852+0000 7f272cb38740 1 -- start start 2024-09-21T05:57:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.852+0000 7f272cb38740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd44a9f0 0x55e6dd83e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.852+0000 7f272cb38740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd4631b0 0x55e6dd831220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.852+0000 7f272cb38740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd46b390 0x55e6dd83ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f272cb38740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27201afb80 con 0x55e6dd44a9f0 2024-09-21T05:57:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f272cb38740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f27201ad450 con 0x55e6dd46b390 2024-09-21T05:57:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f272cb38740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f27201ab2a0 con 0x55e6dd4631b0 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f271ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd44a9f0 0x55e6dd83e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f271ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd44a9f0 0x55e6dd83e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37778/0 (socket says 172.21.15.7:37778) 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f271ffff640 1 -- 172.21.15.7:0/1839047150 learned_addr learned my addr 172.21.15.7:0/1839047150 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f2717fff640 1 --2- 172.21.15.7:0/1839047150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd4631b0 0x55e6dd831220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f2724b61640 1 --2- 172.21.15.7:0/1839047150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd46b390 0x55e6dd83ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f271ffff640 1 -- 172.21.15.7:0/1839047150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd4631b0 msgr2=0x55e6dd831220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f271ffff640 1 --2- 172.21.15.7:0/1839047150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd4631b0 0x55e6dd831220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f271ffff640 1 -- 172.21.15.7:0/1839047150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd46b390 msgr2=0x55e6dd83ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f271ffff640 1 --2- 172.21.15.7:0/1839047150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd46b390 0x55e6dd83ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f271ffff640 1 -- 172.21.15.7:0/1839047150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6dd845850 con 0x55e6dd44a9f0 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f2717fff640 1 --2- 172.21.15.7:0/1839047150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd4631b0 0x55e6dd831220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f271ffff640 1 --2- 172.21.15.7:0/1839047150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd44a9f0 0x55e6dd83e4d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f27100aa2f0 tx=0x7f2710000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd88e39e960f9cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f2715ffb640 1 -- 172.21.15.7:0/1839047150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27100ac9d0 con 0x55e6dd44a9f0 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f2715ffb640 1 -- 172.21.15.7:0/1839047150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2710092e50 con 0x55e6dd44a9f0 2024-09-21T05:57:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.853+0000 7f2715ffb640 1 -- 172.21.15.7:0/1839047150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27100ac7f0 con 0x55e6dd44a9f0 2024-09-21T05:57:53.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.854+0000 7f272cb38740 1 -- 172.21.15.7:0/1839047150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd44a9f0 msgr2=0x55e6dd83e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:53.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.854+0000 7f272cb38740 1 --2- 172.21.15.7:0/1839047150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd44a9f0 0x55e6dd83e4d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f27100aa2f0 tx=0x7f2710000bc0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.854+0000 7f272cb38740 1 -- 172.21.15.7:0/1839047150 shutdown_connections 2024-09-21T05:57:53.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.854+0000 7f272cb38740 1 --2- 172.21.15.7:0/1839047150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd46b390 0x55e6dd83ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.854+0000 7f272cb38740 1 --2- 172.21.15.7:0/1839047150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd4631b0 0x55e6dd831220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.854+0000 7f272cb38740 1 --2- 172.21.15.7:0/1839047150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd44a9f0 0x55e6dd83e4d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.854+0000 7f272cb38740 1 -- 172.21.15.7:0/1839047150 >> 172.21.15.7:0/1839047150 conn(0x55e6dd480460 msgr2=0x55e6dd830b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.854+0000 7f272cb38740 1 -- 172.21.15.7:0/1839047150 shutdown_connections 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.854+0000 7f272cb38740 1 -- 172.21.15.7:0/1839047150 wait complete. 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.855+0000 7f272cb38740 1 -- start start 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.855+0000 7f272cb38740 1 Processor -- start 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.855+0000 7f272cb38740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd44a9f0 0x55e6dd847410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.855+0000 7f272cb38740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 0x55e6dd847950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.855+0000 7f272cb38740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd8be6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.855+0000 7f272cb38740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27201ab910 con 0x55e6dd46b390 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.855+0000 7f272cb38740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f27201acd80 con 0x55e6dd4631b0 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.855+0000 7f272cb38740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f27201abfe0 con 0x55e6dd44a9f0 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.855+0000 7f272cb38740 10 client.0 _ll_register_callbacks cb 0x7f2718009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:53.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.855+0000 7f2724b61640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd8be6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.855+0000 7f2724b61640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd8be6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37786/0 (socket says 172.21.15.7:37786) 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.855+0000 7f2724b61640 1 -- 172.21.15.7:0/3857733095 learned_addr learned my addr 172.21.15.7:0/3857733095 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.855+0000 7f2717fff640 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 0x55e6dd847950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.856+0000 7f271ffff640 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd44a9f0 0x55e6dd847410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.856+0000 7f2717fff640 1 -- 172.21.15.7:0/3857733095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd44a9f0 msgr2=0x55e6dd847410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.856+0000 7f2717fff640 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd44a9f0 0x55e6dd847410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.856+0000 7f2717fff640 1 -- 172.21.15.7:0/3857733095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 msgr2=0x55e6dd8be6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.856+0000 7f2717fff640 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd8be6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.856+0000 7f2717fff640 1 -- 172.21.15.7:0/3857733095 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6dd84f030 con 0x55e6dd4631b0 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.856+0000 7f2724b61640 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd8be6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.856+0000 7f2717fff640 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 0x55e6dd847950 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2708005c20 tx=0x7f270800b3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9c36900513ab972 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.856+0000 7f26ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.856+0000 7f26ff7fe640 1 -- 172.21.15.7:0/3857733095 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708039070 con 0x55e6dd4631b0 2024-09-21T05:57:53.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.856+0000 7f26ff7fe640 1 -- 172.21.15.7:0/3857733095 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f2708017730 con 0x55e6dd4631b0 2024-09-21T05:57:53.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.856+0000 7f272cb38740 1 -- 172.21.15.7:0/3857733095 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2710092e50 con 0x55e6dd4631b0 2024-09-21T05:57:53.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.857+0000 7f26ff7fe640 1 -- 172.21.15.7:0/3857733095 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2708045050 con 0x55e6dd4631b0 2024-09-21T05:57:53.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.857+0000 7f272cb38740 10 client.25955 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:53.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.857+0000 7f272cb38740 1 -- 172.21.15.7:0/3857733095 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e6dd8bfb40 con 0x55e6dd4631b0 2024-09-21T05:57:53.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.857+0000 7f26ff7fe640 1 -- 172.21.15.7:0/3857733095 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2710092e50 con 0x55e6dd4631b0 2024-09-21T05:57:53.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.857+0000 7f26ff7fe640 1 -- 172.21.15.7:0/3857733095 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2708004dc0 con 0x55e6dd4631b0 2024-09-21T05:57:53.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.857+0000 7f272cb38740 10 client.25955 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:53.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.857+0000 7f272cb38740 10 client.25955 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:53.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.857+0000 7f272cb38740 20 client.25955 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:53.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.857+0000 7f272cb38740 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e6dd48c070 0x55e6dd8c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:53.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.857+0000 7f272cb38740 4 client.25955 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:57:53.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.857+0000 7f272cb38740 1 -- 172.21.15.7:0/3857733095 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e6dd7a78a0 con 0x55e6dd48c070 2024-09-21T05:57:53.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.857+0000 7f271ffff640 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e6dd48c070 0x55e6dd8c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:53.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f271ffff640 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e6dd48c070 0x55e6dd8c2270 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32a89a386ba83518 server_cookie=e3f490650a992828 in_seq=0 out_seq=0 2024-09-21T05:57:53.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f26ff7fe640 10 client.25955 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f26ff7fe640 1 -- 172.21.15.7:0/3857733095 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e6dd7a78a0 con 0x55e6dd48c070 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f26ff7fe640 10 client.25955 handle_command_reply: tid=0 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f272cb38740 1 client.25955 shutdown 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f272cb38740 1 -- 172.21.15.7:0/3857733095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 msgr2=0x55e6dd847950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f272cb38740 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 0x55e6dd847950 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2708005c20 tx=0x7f270800b3f0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f272cb38740 1 -- 172.21.15.7:0/3857733095 shutdown_connections 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f272cb38740 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55e6dd48c070 0x55e6dd8c2270 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f272cb38740 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e6dd46b390 0x55e6dd8be6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f272cb38740 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e6dd4631b0 0x55e6dd847950 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f26ff7fe640 0 client.25955 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f272cb38740 1 --2- 172.21.15.7:0/3857733095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e6dd44a9f0 0x55e6dd847410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f272cb38740 1 -- 172.21.15.7:0/3857733095 >> 172.21.15.7:0/3857733095 conn(0x55e6dd480460 msgr2=0x55e6dd8342f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.858+0000 7f272cb38740 1 -- 172.21.15.7:0/3857733095 shutdown_connections 2024-09-21T05:57:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f272cb38740 1 -- 172.21.15.7:0/3857733095 wait complete. 2024-09-21T05:57:53.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f272cb38740 20 client.25955 trim_cache size 0 max 16384 2024-09-21T05:57:53.865 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f27265c4640 1 -- 172.21.15.7:0/2885833778 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f270c0b6730 msgr2=0x7f270c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f27265c4640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f270c0b6730 0x7f270c0b8c40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2718005cc0 tx=0x7f2718005c30 comp rx=0 tx=0).stop 2024-09-21T05:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f27265c4640 1 -- 172.21.15.7:0/2885833778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2720103b80 msgr2=0x7f272019a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f27265c4640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2720103b80 0x7f272019a440 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f271000d950 tx=0x7f271000de10 comp rx=0 tx=0).stop 2024-09-21T05:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f27265c4640 1 -- 172.21.15.7:0/2885833778 shutdown_connections 2024-09-21T05:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f27265c4640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f270c0b6730 0x7f270c0b8c40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f27265c4640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2720109e10 0x7f272019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f27265c4640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27201094c0 0x7f272019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f27265c4640 1 --2- 172.21.15.7:0/2885833778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2720103b80 0x7f272019a440 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f27265c4640 1 -- 172.21.15.7:0/2885833778 >> 172.21.15.7:0/2885833778 conn(0x7f27200ff610 msgr2=0x7f2720106ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f27265c4640 1 -- 172.21.15.7:0/2885833778 shutdown_connections 2024-09-21T05:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:53.859+0000 7f27265c4640 1 -- 172.21.15.7:0/2885833778 wait complete. 2024-09-21T05:57:53.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:53 smithi027 ceph-mon[34364]: pgmap v438: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:57:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:53 smithi007 ceph-mon[30983]: pgmap v438: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:57:54.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:53 smithi119 ceph-mon[34833]: pgmap v438: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:57:55.577 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T05:57:55.578 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T05:57:55.853 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:55.974 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:55 smithi007 ceph-mon[30983]: pgmap v439: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:57:55.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:55 smithi027 ceph-mon[34364]: pgmap v439: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:57:56.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:55 smithi119 ceph-mon[34833]: pgmap v439: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:57:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.345+0000 7f62eb1e3640 1 -- 172.21.15.7:0/864758158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4109df0 msgr2=0x7f62e4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.345+0000 7f62eb1e3640 1 --2- 172.21.15.7:0/864758158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4109df0 0x7f62e4110620 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009ca0 tx=0x7f62dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.345+0000 7f62eb1e3640 1 -- 172.21.15.7:0/864758158 shutdown_connections 2024-09-21T05:57:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.345+0000 7f62eb1e3640 1 --2- 172.21.15.7:0/864758158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4109df0 0x7f62e4110620 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.345+0000 7f62eb1e3640 1 --2- 172.21.15.7:0/864758158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e41094a0 0x7f62e41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.345+0000 7f62eb1e3640 1 --2- 172.21.15.7:0/864758158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62e4103b60 0x7f62e4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.345+0000 7f62eb1e3640 1 -- 172.21.15.7:0/864758158 >> 172.21.15.7:0/864758158 conn(0x7f62e407b850 msgr2=0x7f62e407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.345+0000 7f62eb1e3640 1 -- 172.21.15.7:0/864758158 shutdown_connections 2024-09-21T05:57:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.345+0000 7f62eb1e3640 1 -- 172.21.15.7:0/864758158 wait complete. 2024-09-21T05:57:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.345+0000 7f62eb1e3640 1 Processor -- start 2024-09-21T05:57:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62eb1e3640 1 -- start start 2024-09-21T05:57:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62eb1e3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e4103b60 0x7f62e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62eb1e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62e41094a0 0x7f62e4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62eb1e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4109df0 0x7f62e4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62eb1e3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62e4113ab0 con 0x7f62e4109df0 2024-09-21T05:57:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62eb1e3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f62e4113930 con 0x7f62e41094a0 2024-09-21T05:57:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62eb1e3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f62e4113c30 con 0x7f62e4103b60 2024-09-21T05:57:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62e9780640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4109df0 0x7f62e4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62e9780640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4109df0 0x7f62e4076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37816/0 (socket says 172.21.15.7:37816) 2024-09-21T05:57:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62e9780640 1 -- 172.21.15.7:0/4168957374 learned_addr learned my addr 172.21.15.7:0/4168957374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62e3fff640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62e41094a0 0x7f62e4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e4103b60 0x7f62e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62e9780640 1 -- 172.21.15.7:0/4168957374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e4103b60 msgr2=0x7f62e4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62e9780640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e4103b60 0x7f62e4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62e9780640 1 -- 172.21.15.7:0/4168957374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62e41094a0 msgr2=0x7f62e4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62e9780640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62e41094a0 0x7f62e4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62e9780640 1 -- 172.21.15.7:0/4168957374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e41a8720 con 0x7f62e4109df0 2024-09-21T05:57:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.346+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e4103b60 0x7f62e4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.347+0000 7f62e9780640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4109df0 0x7f62e4076190 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f62dc005cc0 tx=0x7f62dc02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.347+0000 7f62e1ffb640 1 -- 172.21.15.7:0/4168957374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc003bf0 con 0x7f62e4109df0 2024-09-21T05:57:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.347+0000 7f62e1ffb640 1 -- 172.21.15.7:0/4168957374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62dc003d90 con 0x7f62e4109df0 2024-09-21T05:57:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.347+0000 7f62eb1e3640 1 -- 172.21.15.7:0/4168957374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e41a89b0 con 0x7f62e4109df0 2024-09-21T05:57:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.347+0000 7f62e1ffb640 1 -- 172.21.15.7:0/4168957374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc02fbc0 con 0x7f62e4109df0 2024-09-21T05:57:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.347+0000 7f62eb1e3640 1 -- 172.21.15.7:0/4168957374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e41a8ef0 con 0x7f62e4109df0 2024-09-21T05:57:56.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.350+0000 7f62f1757740 1 Processor -- start 2024-09-21T05:57:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.350+0000 7f62e1ffb640 1 -- 172.21.15.7:0/4168957374 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f62dc02fd60 con 0x7f62e4109df0 2024-09-21T05:57:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.350+0000 7f62f1757740 1 -- start start 2024-09-21T05:57:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62f1757740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250d2350 0x55b025479430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62f1757740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 0x55b025479970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62f1757740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250b1670 0x55b025479eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62f1757740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b0253efe60 con 0x55b0250a9490 2024-09-21T05:57:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62f1757740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b0253df290 con 0x55b0250b1670 2024-09-21T05:57:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62f1757740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b0253e30a0 con 0x55b0250d2350 2024-09-21T05:57:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62e8f7f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 0x55b025479970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62e8f7f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 0x55b025479970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37826/0 (socket says 172.21.15.7:37826) 2024-09-21T05:57:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62e8f7f640 1 -- 172.21.15.7:0/3692830827 learned_addr learned my addr 172.21.15.7:0/3692830827 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3692830827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250d2350 0x55b025479430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3692830827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250b1670 0x55b025479eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62e8f7f640 1 -- 172.21.15.7:0/3692830827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250d2350 msgr2=0x55b025479430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/3692830827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250d2350 0x55b025479430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62e8f7f640 1 -- 172.21.15.7:0/3692830827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250b1670 msgr2=0x55b025479eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/3692830827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250b1670 0x55b025479eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62e8f7f640 1 -- 172.21.15.7:0/3692830827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02513d930 con 0x55b0250a9490 2024-09-21T05:57:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.351+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3692830827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250b1670 0x55b025479eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.352+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/3692830827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 0x55b025479970 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00bd40 tx=0x7f62cc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68e37848b88a8d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.352+0000 7f62e1ffb640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f62d00b6680 0x7f62d00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.352+0000 7f62daffd640 1 -- 172.21.15.7:0/3692830827 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc011640 con 0x55b0250a9490 2024-09-21T05:57:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.352+0000 7f62e3fff640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f62d00b6680 0x7f62d00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.352+0000 7f62e1ffb640 1 -- 172.21.15.7:0/4168957374 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f62dc108bd0 con 0x7f62e4109df0 2024-09-21T05:57:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.352+0000 7f62daffd640 1 -- 172.21.15.7:0/3692830827 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62cc00be30 con 0x55b0250a9490 2024-09-21T05:57:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.352+0000 7f62daffd640 1 -- 172.21.15.7:0/3692830827 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc010ab0 con 0x55b0250a9490 2024-09-21T05:57:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.353+0000 7f62f1757740 1 -- 172.21.15.7:0/3692830827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 msgr2=0x55b025479970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.353+0000 7f62f1757740 1 --2- 172.21.15.7:0/3692830827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 0x55b025479970 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00bd40 tx=0x7f62cc00f730 comp rx=0 tx=0).stop 2024-09-21T05:57:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.353+0000 7f62e3fff640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f62d00b6680 0x7f62d00b8b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f62e4109040 tx=0x7f62d4004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.353+0000 7f62f1757740 1 -- 172.21.15.7:0/3692830827 shutdown_connections 2024-09-21T05:57:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.353+0000 7f62f1757740 1 --2- 172.21.15.7:0/3692830827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 0x55b025479970 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.353+0000 7f62f1757740 1 --2- 172.21.15.7:0/3692830827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250b1670 0x55b025479eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.353+0000 7f62f1757740 1 --2- 172.21.15.7:0/3692830827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250d2350 0x55b025479430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.353+0000 7f62f1757740 1 -- 172.21.15.7:0/3692830827 >> 172.21.15.7:0/3692830827 conn(0x55b0250c6740 msgr2=0x55b025477320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.353+0000 7f62f1757740 1 -- 172.21.15.7:0/3692830827 shutdown_connections 2024-09-21T05:57:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.353+0000 7f62f1757740 1 -- 172.21.15.7:0/3692830827 wait complete. 2024-09-21T05:57:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.353+0000 7f62f1757740 1 -- start start 2024-09-21T05:57:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.353+0000 7f62f1757740 1 Processor -- start 2024-09-21T05:57:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62f1757740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250a9490 0x55b02548d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62f1757740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250b1670 0x55b02548dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62f1757740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250d2350 0x55b0254996a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62f1757740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b025240890 con 0x55b0250d2350 2024-09-21T05:57:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62f1757740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b025379d40 con 0x55b0250b1670 2024-09-21T05:57:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62f1757740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b025490340 con 0x55b0250a9490 2024-09-21T05:57:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62f1757740 10 client.0 _ll_register_callbacks cb 0x55b0253ddc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62e9780640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250d2350 0x55b0254996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62e9780640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250d2350 0x55b0254996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37838/0 (socket says 172.21.15.7:37838) 2024-09-21T05:57:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62e9780640 1 -- 172.21.15.7:0/3822138954 learned_addr learned my addr 172.21.15.7:0/3822138954 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250b1670 0x55b02548dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250a9490 0x55b02548d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62e9780640 1 -- 172.21.15.7:0/3822138954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250a9490 msgr2=0x55b02548d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:56.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62e9780640 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250a9490 0x55b02548d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62e9780640 1 -- 172.21.15.7:0/3822138954 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250b1670 msgr2=0x55b02548dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:56.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62e9780640 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250b1670 0x55b02548dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62e9780640 1 -- 172.21.15.7:0/3822138954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b025499c10 con 0x55b0250d2350 2024-09-21T05:57:56.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250a9490 0x55b02548d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:56.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.354+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250b1670 0x55b02548dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:56.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.355+0000 7f62e9780640 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250d2350 0x55b0254996a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0cbd10 tx=0x7f62dc0ce210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885b53c8a64828de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:56.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.355+0000 7f62c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:56.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.355+0000 7f62c3fff640 1 -- 172.21.15.7:0/3822138954 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0cf1a0 con 0x55b0250d2350 2024-09-21T05:57:56.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.355+0000 7f62f1757740 1 -- 172.21.15.7:0/3822138954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62cc00be30 con 0x55b0250d2350 2024-09-21T05:57:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.355+0000 7f62c3fff640 1 -- 172.21.15.7:0/3822138954 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f62dc0cdd00 con 0x55b0250d2350 2024-09-21T05:57:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.355+0000 7f62c3fff640 1 -- 172.21.15.7:0/3822138954 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f62dc0098b0 con 0x55b0250d2350 2024-09-21T05:57:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.355+0000 7f62f1757740 10 client.16332 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.355+0000 7f62f1757740 1 -- 172.21.15.7:0/3822138954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b02549c540 con 0x55b0250d2350 2024-09-21T05:57:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.355+0000 7f62c3fff640 1 -- 172.21.15.7:0/3822138954 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62cc00be30 con 0x55b0250d2350 2024-09-21T05:57:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.355+0000 7f62c3fff640 1 -- 172.21.15.7:0/3822138954 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f62dc0d31c0 con 0x55b0250d2350 2024-09-21T05:57:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.355+0000 7f62f1757740 10 client.16332 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.355+0000 7f62f1757740 10 client.16332 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.355+0000 7f62f1757740 20 client.16332 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.356+0000 7f62f1757740 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b025090cd0 0x55b02549fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.356+0000 7f62f1757740 4 client.16332 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:57:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.356+0000 7f62f1757740 1 -- 172.21.15.7:0/3822138954 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0253f1db0 con 0x55b025090cd0 2024-09-21T05:57:56.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.356+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b025090cd0 0x55b02549fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.356+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b025090cd0 0x55b02549fa00 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39d041e5c7ec7d16 server_cookie=23b6000ff4a4dc8e in_seq=0 out_seq=0 2024-09-21T05:57:56.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.356+0000 7f62c3fff640 10 client.16332 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:56.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62c3fff640 1 -- 172.21.15.7:0/3822138954 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0253f1db0 con 0x55b025090cd0 2024-09-21T05:57:56.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62c3fff640 10 client.16332 handle_command_reply: tid=0 2024-09-21T05:57:56.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62f1757740 1 client.16332 shutdown 2024-09-21T05:57:56.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62f1757740 1 -- 172.21.15.7:0/3822138954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250d2350 msgr2=0x55b0254996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:56.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62f1757740 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250d2350 0x55b0254996a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0cbd10 tx=0x7f62dc0ce210 comp rx=0 tx=0).stop 2024-09-21T05:57:56.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62f1757740 1 -- 172.21.15.7:0/3822138954 shutdown_connections 2024-09-21T05:57:56.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62f1757740 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b025090cd0 0x55b02549fa00 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62f1757740 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250d2350 0x55b0254996a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62f1757740 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250b1670 0x55b02548dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62f1757740 1 --2- 172.21.15.7:0/3822138954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250a9490 0x55b02548d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62c3fff640 0 client.16332 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62f1757740 1 -- 172.21.15.7:0/3822138954 >> 172.21.15.7:0/3822138954 conn(0x55b0250c6740 msgr2=0x55b025475850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62f1757740 1 -- 172.21.15.7:0/3822138954 shutdown_connections 2024-09-21T05:57:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.357+0000 7f62f1757740 1 -- 172.21.15.7:0/3822138954 wait complete. 2024-09-21T05:57:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.358+0000 7f62f1757740 20 client.16332 trim_cache size 0 max 16384 2024-09-21T05:57:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.375+0000 7f62f1757740 1 Processor -- start 2024-09-21T05:57:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.375+0000 7f62f1757740 1 -- start start 2024-09-21T05:57:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.375+0000 7f62f1757740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250a9490 0x55b025475850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.375+0000 7f62f1757740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250b1670 0x55b025475d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.375+0000 7f62f1757740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250d2350 0x55b02548a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.375+0000 7f62f1757740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41afb20 con 0x55b0250b1670 2024-09-21T05:57:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.375+0000 7f62f1757740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41ad3f0 con 0x55b0250a9490 2024-09-21T05:57:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.375+0000 7f62f1757740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41ab260 con 0x55b0250d2350 2024-09-21T05:57:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250b1670 0x55b025475d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250b1670 0x55b025475d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37842/0 (socket says 172.21.15.7:37842) 2024-09-21T05:57:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62e3fff640 1 -- 172.21.15.7:0/3581097610 learned_addr learned my addr 172.21.15.7:0/3581097610 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/3581097610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250a9490 0x55b025475850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62e9780640 1 --2- 172.21.15.7:0/3581097610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250d2350 0x55b02548a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62e3fff640 1 -- 172.21.15.7:0/3581097610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250d2350 msgr2=0x55b02548a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3581097610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250d2350 0x55b02548a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62e3fff640 1 -- 172.21.15.7:0/3581097610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250a9490 msgr2=0x55b025475850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3581097610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250a9490 0x55b025475850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62e3fff640 1 -- 172.21.15.7:0/3581097610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b025490220 con 0x55b0250b1670 2024-09-21T05:57:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/3581097610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250a9490 0x55b025475850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3581097610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250b1670 0x55b025475d90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f62d4003f20 tx=0x7f62d400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd88634e346b938 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62da7fc640 1 -- 172.21.15.7:0/3581097610 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4005020 con 0x55b0250b1670 2024-09-21T05:57:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62da7fc640 1 -- 172.21.15.7:0/3581097610 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62d40047a0 con 0x55b0250b1670 2024-09-21T05:57:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.376+0000 7f62da7fc640 1 -- 172.21.15.7:0/3581097610 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d402a6d0 con 0x55b0250b1670 2024-09-21T05:57:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.377+0000 7f62f1757740 1 -- 172.21.15.7:0/3581097610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250b1670 msgr2=0x55b025475d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.377+0000 7f62f1757740 1 --2- 172.21.15.7:0/3581097610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250b1670 0x55b025475d90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f62d4003f20 tx=0x7f62d400b390 comp rx=0 tx=0).stop 2024-09-21T05:57:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.377+0000 7f62f1757740 1 -- 172.21.15.7:0/3581097610 shutdown_connections 2024-09-21T05:57:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.377+0000 7f62f1757740 1 --2- 172.21.15.7:0/3581097610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250b1670 0x55b025475d90 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.377+0000 7f62f1757740 1 --2- 172.21.15.7:0/3581097610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250d2350 0x55b02548a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.377+0000 7f62f1757740 1 --2- 172.21.15.7:0/3581097610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250a9490 0x55b025475850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.377+0000 7f62f1757740 1 -- 172.21.15.7:0/3581097610 >> 172.21.15.7:0/3581097610 conn(0x55b0250c6740 msgr2=0x55b02548be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.377+0000 7f62f1757740 1 -- 172.21.15.7:0/3581097610 shutdown_connections 2024-09-21T05:57:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.377+0000 7f62f1757740 1 -- 172.21.15.7:0/3581097610 wait complete. 2024-09-21T05:57:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.377+0000 7f62f1757740 1 -- start start 2024-09-21T05:57:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.378+0000 7f62f1757740 1 Processor -- start 2024-09-21T05:57:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.378+0000 7f62f1757740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 0x55b0254905c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.378+0000 7f62f1757740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250b1670 0x55b025490b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.378+0000 7f62f1757740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250d2350 0x55b025491040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.378+0000 7f62f1757740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41ab8b0 con 0x55b0250a9490 2024-09-21T05:57:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.378+0000 7f62f1757740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41acd20 con 0x55b0250d2350 2024-09-21T05:57:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.378+0000 7f62f1757740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41abf80 con 0x55b0250b1670 2024-09-21T05:57:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.378+0000 7f62f1757740 10 client.0 _ll_register_callbacks cb 0x7f62dc009430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.378+0000 7f62e8f7f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 0x55b0254905c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.378+0000 7f62e8f7f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 0x55b0254905c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37856/0 (socket says 172.21.15.7:37856) 2024-09-21T05:57:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.378+0000 7f62e8f7f640 1 -- 172.21.15.7:0/796868620 learned_addr learned my addr 172.21.15.7:0/796868620 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.378+0000 7f62e9780640 1 --2- 172.21.15.7:0/796868620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250d2350 0x55b025491040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.378+0000 7f62e3fff640 1 --2- 172.21.15.7:0/796868620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250b1670 0x55b025490b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.379+0000 7f62e8f7f640 1 -- 172.21.15.7:0/796868620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250b1670 msgr2=0x55b025490b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.379+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/796868620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250b1670 0x55b025490b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.379+0000 7f62e8f7f640 1 -- 172.21.15.7:0/796868620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250d2350 msgr2=0x55b025491040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.379+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/796868620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250d2350 0x55b025491040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.379+0000 7f62e8f7f640 1 -- 172.21.15.7:0/796868620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02550a3c0 con 0x55b0250a9490 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.379+0000 7f62e8f7f640 1 --2- 172.21.15.7:0/796868620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 0x55b0254905c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x55b0254780b0 tx=0x7f62cc00b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee4d973896e9f78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.379+0000 7f62c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.379+0000 7f62c3fff640 1 -- 172.21.15.7:0/796868620 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc032060 con 0x55b0250a9490 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.379+0000 7f62c3fff640 1 -- 172.21.15.7:0/796868620 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f62cc005330 con 0x55b0250a9490 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.379+0000 7f62f1757740 1 -- 172.21.15.7:0/796868620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62d40047a0 con 0x55b0250a9490 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.379+0000 7f62c3fff640 1 -- 172.21.15.7:0/796868620 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f62cc00b880 con 0x55b0250a9490 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.379+0000 7f62f1757740 10 client.16338 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.379+0000 7f62f1757740 1 -- 172.21.15.7:0/796868620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b02550b650 con 0x55b0250a9490 2024-09-21T05:57:56.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.380+0000 7f62c3fff640 1 -- 172.21.15.7:0/796868620 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62d40047a0 con 0x55b0250a9490 2024-09-21T05:57:56.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.380+0000 7f62c3fff640 1 -- 172.21.15.7:0/796868620 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f62cc0037b0 con 0x55b0250a9490 2024-09-21T05:57:56.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.380+0000 7f62f1757740 10 client.16338 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:56.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.380+0000 7f62f1757740 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:56.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.380+0000 7f62f1757740 20 client.16338 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:56.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.380+0000 7f62f1757740 1 --2- 172.21.15.7:0/796868620 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b025066080 0x55b02550db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:56.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.380+0000 7f62f1757740 4 client.16338 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T05:57:56.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.380+0000 7f62f1757740 1 -- 172.21.15.7:0/796868620 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b0253ed860 con 0x55b025066080 2024-09-21T05:57:56.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.380+0000 7f62e3fff640 1 --2- 172.21.15.7:0/796868620 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b025066080 0x55b02550db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:56.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.380+0000 7f62e3fff640 1 --2- 172.21.15.7:0/796868620 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b025066080 0x55b02550db00 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f624e0cb85b4ebf1 server_cookie=96bfbe84b1ed879f in_seq=0 out_seq=0 2024-09-21T05:57:56.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.380+0000 7f62c3fff640 10 client.16338 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:56.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62c3fff640 1 -- 172.21.15.7:0/796868620 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b0253ed860 con 0x55b025066080 2024-09-21T05:57:56.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62c3fff640 10 client.16338 handle_command_reply: tid=0 2024-09-21T05:57:56.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62f1757740 1 client.16338 shutdown 2024-09-21T05:57:56.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62f1757740 1 -- 172.21.15.7:0/796868620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 msgr2=0x55b0254905c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:56.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62f1757740 1 --2- 172.21.15.7:0/796868620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 0x55b0254905c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x55b0254780b0 tx=0x7f62cc00b4c0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62f1757740 1 -- 172.21.15.7:0/796868620 shutdown_connections 2024-09-21T05:57:56.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62f1757740 1 --2- 172.21.15.7:0/796868620 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b025066080 0x55b02550db00 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62f1757740 1 --2- 172.21.15.7:0/796868620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b0250d2350 0x55b025491040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62f1757740 1 --2- 172.21.15.7:0/796868620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b0250b1670 0x55b025490b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62f1757740 1 --2- 172.21.15.7:0/796868620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0250a9490 0x55b0254905c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62f1757740 1 -- 172.21.15.7:0/796868620 >> 172.21.15.7:0/796868620 conn(0x55b0250c6740 msgr2=0x55b02547a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:56.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62c3fff640 0 client.16338 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:56.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62f1757740 1 -- 172.21.15.7:0/796868620 shutdown_connections 2024-09-21T05:57:56.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62f1757740 1 -- 172.21.15.7:0/796868620 wait complete. 2024-09-21T05:57:56.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.383+0000 7f62f1757740 20 client.16338 trim_cache size 0 max 16384 2024-09-21T05:57:56.390 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:57:56.390 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T05:57:56.390 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "b3113b80-a15f-4fb0-9571-c99baad2936b", 2024-09-21T05:57:56.390 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T05:57:56.391 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:57:56.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.384+0000 7f62eb1e3640 1 -- 172.21.15.7:0/4168957374 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f62d00b6680 msgr2=0x7f62d00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:56.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.384+0000 7f62eb1e3640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f62d00b6680 0x7f62d00b8b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f62e4109040 tx=0x7f62d4004730 comp rx=0 tx=0).stop 2024-09-21T05:57:56.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.384+0000 7f62eb1e3640 1 -- 172.21.15.7:0/4168957374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4109df0 msgr2=0x7f62e4076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:56.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.384+0000 7f62eb1e3640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4109df0 0x7f62e4076190 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f62dc005cc0 tx=0x7f62dc02f380 comp rx=0 tx=0).stop 2024-09-21T05:57:56.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.384+0000 7f62eb1e3640 1 -- 172.21.15.7:0/4168957374 shutdown_connections 2024-09-21T05:57:56.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.384+0000 7f62eb1e3640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f62d00b6680 0x7f62d00b8b90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.384+0000 7f62eb1e3640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4109df0 0x7f62e4076190 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.384+0000 7f62eb1e3640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62e41094a0 0x7f62e4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.384+0000 7f62eb1e3640 1 --2- 172.21.15.7:0/4168957374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62e4103b60 0x7f62e4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:56.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.384+0000 7f62eb1e3640 1 -- 172.21.15.7:0/4168957374 >> 172.21.15.7:0/4168957374 conn(0x7f62e407b850 msgr2=0x7f62e41074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:56.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.384+0000 7f62eb1e3640 1 -- 172.21.15.7:0/4168957374 shutdown_connections 2024-09-21T05:57:56.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:56.384+0000 7f62eb1e3640 1 -- 172.21.15.7:0/4168957374 wait complete. 2024-09-21T05:57:57.285 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:57:57.546 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:57.960 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:57 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T05:57:57.960 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:57 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:57:57.961 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:57 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T05:57:57.961 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:57 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:57:57.961 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:57 smithi007 ceph-mon[30983]: pgmap v440: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:57:57.961 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:57 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T05:57:57.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:57 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T05:57:57.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:57 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:57:57.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:57 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T05:57:57.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:57 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:57:57.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:57 smithi027 ceph-mon[34364]: pgmap v440: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:57:57.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:57 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T05:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.052+0000 7fc834317640 1 -- 172.21.15.7:0/3639807428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc82c1083a0 msgr2=0x7fc82c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.052+0000 7fc834317640 1 --2- 172.21.15.7:0/3639807428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc82c1083a0 0x7fc82c1087b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc820009900 tx=0x7fc82002a410 comp rx=0 tx=0).stop 2024-09-21T05:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.052+0000 7fc834317640 1 -- 172.21.15.7:0/3639807428 shutdown_connections 2024-09-21T05:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.052+0000 7fc834317640 1 --2- 172.21.15.7:0/3639807428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc82c1083a0 0x7fc82c1087b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.052+0000 7fc834317640 1 --2- 172.21.15.7:0/3639807428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc82c108cf0 0x7fc82c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.052+0000 7fc834317640 1 --2- 172.21.15.7:0/3639807428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc82c102a60 0x7fc82c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.052+0000 7fc834317640 1 -- 172.21.15.7:0/3639807428 >> 172.21.15.7:0/3639807428 conn(0x7fc82c079730 msgr2=0x7fc82c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.052+0000 7fc834317640 1 -- 172.21.15.7:0/3639807428 shutdown_connections 2024-09-21T05:57:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.052+0000 7fc834317640 1 -- 172.21.15.7:0/3639807428 wait complete. 2024-09-21T05:57:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.053+0000 7fc834317640 1 Processor -- start 2024-09-21T05:57:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.053+0000 7fc834317640 1 -- start start 2024-09-21T05:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc834317640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc82c102a60 0x7fc82c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc834317640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc82c1083a0 0x7fc82c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc834317640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc82c108cf0 0x7fc82c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc834317640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c112960 con 0x7fc82c108cf0 2024-09-21T05:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc834317640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c1127e0 con 0x7fc82c1083a0 2024-09-21T05:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc834317640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c112ae0 con 0x7fc82c102a60 2024-09-21T05:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc8328b4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc82c108cf0 0x7fc82c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc8328b4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc82c108cf0 0x7fc82c1000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37872/0 (socket says 172.21.15.7:37872) 2024-09-21T05:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc8328b4640 1 -- 172.21.15.7:0/2255194259 learned_addr learned my addr 172.21.15.7:0/2255194259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc8318b2640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc82c1083a0 0x7fc82c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc8320b3640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc82c102a60 0x7fc82c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc8328b4640 1 -- 172.21.15.7:0/2255194259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc82c102a60 msgr2=0x7fc82c0ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc8328b4640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc82c102a60 0x7fc82c0ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc8328b4640 1 -- 172.21.15.7:0/2255194259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc82c1083a0 msgr2=0x7fc82c0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc8328b4640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc82c1083a0 0x7fc82c0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc8328b4640 1 -- 172.21.15.7:0/2255194259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82c1a8780 con 0x7fc82c108cf0 2024-09-21T05:57:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc8320b3640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc82c102a60 0x7fc82c0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:57:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.054+0000 7fc8328b4640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc82c108cf0 0x7fc82c1000f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc82400d950 tx=0x7fc82400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.055+0000 7fc82b7fe640 1 -- 172.21.15.7:0/2255194259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824017030 con 0x7fc82c108cf0 2024-09-21T05:57:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.055+0000 7fc82b7fe640 1 -- 172.21.15.7:0/2255194259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc824004020 con 0x7fc82c108cf0 2024-09-21T05:57:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.055+0000 7fc82b7fe640 1 -- 172.21.15.7:0/2255194259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824003b50 con 0x7fc82c108cf0 2024-09-21T05:57:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.055+0000 7fc834317640 1 -- 172.21.15.7:0/2255194259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82c1a8a70 con 0x7fc82c108cf0 2024-09-21T05:57:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.055+0000 7fc834317640 1 -- 172.21.15.7:0/2255194259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc82c1a8f30 con 0x7fc82c108cf0 2024-09-21T05:57:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.057+0000 7fc83a88b740 1 Processor -- start 2024-09-21T05:57:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.057+0000 7fc82b7fe640 1 -- 172.21.15.7:0/2255194259 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fc82401a070 con 0x7fc82c108cf0 2024-09-21T05:57:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc83a88b740 1 -- start start 2024-09-21T05:57:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc83a88b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730a4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc83a88b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc83a88b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc83a88b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56027301ae50 con 0x560272cfd070 2024-09-21T05:57:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc83a88b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56027300a280 con 0x560272cdc390 2024-09-21T05:57:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc83a88b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56027300e090 con 0x560272cd41b0 2024-09-21T05:57:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc8318b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc8318b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730a4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37874/0 (socket says 172.21.15.7:37874) 2024-09-21T05:57:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc8318b2640 1 -- 172.21.15.7:0/2658238259 learned_addr learned my addr 172.21.15.7:0/2658238259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc8320b3640 1 --2- 172.21.15.7:0/2658238259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc8318b2640 1 --2- 172.21.15.7:0/2658238259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc82b7fe640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc8140b6680 0x7fc8140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc8318b2640 1 -- 172.21.15.7:0/2658238259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 msgr2=0x5602730a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.058+0000 7fc8318b2640 1 --2- 172.21.15.7:0/2658238259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.059+0000 7fc8318b2640 1 -- 172.21.15.7:0/2658238259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 msgr2=0x5602730a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.059+0000 7fc8318b2640 1 --2- 172.21.15.7:0/2658238259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730a4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.059+0000 7fc8318b2640 1 -- 172.21.15.7:0/2658238259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560272d68650 con 0x560272cfd070 2024-09-21T05:57:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.059+0000 7fc8328b4640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc8140b6680 0x7fc8140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.059+0000 7fc8318b2640 1 --2- 172.21.15.7:0/2658238259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730a4270 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc820005f70 tx=0x7fc820005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6705f02cd19fe448 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.059+0000 7fc82b7fe640 1 -- 172.21.15.7:0/2255194259 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fc8240e6ef0 con 0x7fc82c108cf0 2024-09-21T05:57:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.059+0000 7fc828d9a640 1 -- 172.21.15.7:0/2658238259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820044020 con 0x560272cfd070 2024-09-21T05:57:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.059+0000 7fc828d9a640 1 -- 172.21.15.7:0/2658238259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8200317a0 con 0x560272cfd070 2024-09-21T05:57:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.059+0000 7fc828d9a640 1 -- 172.21.15.7:0/2658238259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820035040 con 0x560272cfd070 2024-09-21T05:57:58.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.060+0000 7fc83a88b740 1 -- 172.21.15.7:0/2658238259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 msgr2=0x5602730a4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:58.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.060+0000 7fc8328b4640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc8140b6680 0x7fc8140b8b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc8240e4770 tx=0x7fc824094040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:58.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.060+0000 7fc83a88b740 1 --2- 172.21.15.7:0/2658238259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730a4270 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc820005f70 tx=0x7fc820005e50 comp rx=0 tx=0).stop 2024-09-21T05:57:58.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.060+0000 7fc83a88b740 1 -- 172.21.15.7:0/2658238259 shutdown_connections 2024-09-21T05:57:58.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.060+0000 7fc83a88b740 1 --2- 172.21.15.7:0/2658238259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.060+0000 7fc83a88b740 1 --2- 172.21.15.7:0/2658238259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.060+0000 7fc83a88b740 1 --2- 172.21.15.7:0/2658238259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730a4270 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.060+0000 7fc83a88b740 1 -- 172.21.15.7:0/2658238259 >> 172.21.15.7:0/2658238259 conn(0x560272cf1460 msgr2=0x5602730a2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:58.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.060+0000 7fc83a88b740 1 -- 172.21.15.7:0/2658238259 shutdown_connections 2024-09-21T05:57:58.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.060+0000 7fc83a88b740 1 -- 172.21.15.7:0/2658238259 wait complete. 2024-09-21T05:57:58.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc83a88b740 1 -- start start 2024-09-21T05:57:58.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc83a88b740 1 Processor -- start 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc83a88b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc83a88b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730afe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc83a88b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc83a88b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560272e6b700 con 0x560272cfd070 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc83a88b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560272fa5110 con 0x560272cdc390 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc83a88b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5602730b29f0 con 0x560272cd41b0 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc83a88b740 10 client.0 _ll_register_callbacks cb 0x560272fbe990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc8318b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc8318b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37880/0 (socket says 172.21.15.7:37880) 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc8318b2640 1 -- 172.21.15.7:0/1351255242 learned_addr learned my addr 172.21.15.7:0/1351255242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc8318b2640 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.061+0000 7fc8320b3640 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc8318b2640 1 -- 172.21.15.7:0/1351255242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 msgr2=0x5602730af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:58.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc8318b2640 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc8318b2640 1 -- 172.21.15.7:0/1351255242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 msgr2=0x5602730afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc8318b2640 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc8318b2640 1 -- 172.21.15.7:0/1351255242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560272fd2c40 con 0x560272cfd070 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc8320b3640 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc8318b2640 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730b0340 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc820000c00 tx=0x7fc820005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17514babd7393d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc811ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc811ffb640 1 -- 172.21.15.7:0/1351255242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820044070 con 0x560272cfd070 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc83a88b740 1 -- 172.21.15.7:0/1351255242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8200317a0 con 0x560272cfd070 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc811ffb640 1 -- 172.21.15.7:0/1351255242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fc820004050 con 0x560272cfd070 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc811ffb640 1 -- 172.21.15.7:0/1351255242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc820035040 con 0x560272cfd070 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc83a88b740 10 client.16350 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc83a88b740 1 -- 172.21.15.7:0/1351255242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5602730be670 con 0x560272cfd070 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.062+0000 7fc811ffb640 1 -- 172.21.15.7:0/1351255242 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8200317a0 con 0x560272cfd070 2024-09-21T05:57:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.063+0000 7fc811ffb640 1 -- 172.21.15.7:0/1351255242 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc8200035f0 con 0x560272cfd070 2024-09-21T05:57:58.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.063+0000 7fc83a88b740 10 client.16350 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:58.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.063+0000 7fc83a88b740 10 client.16350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:58.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.063+0000 7fc83a88b740 20 client.16350 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:58.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.063+0000 7fc83a88b740 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560272cbb9f0 0x5602730c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.063+0000 7fc83a88b740 4 client.16350 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:57:58.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.063+0000 7fc83a88b740 1 -- 172.21.15.7:0/1351255242 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56027301cda0 con 0x560272cbb9f0 2024-09-21T05:57:58.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.063+0000 7fc8320b3640 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560272cbb9f0 0x5602730c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.064+0000 7fc8320b3640 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560272cbb9f0 0x5602730c19d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40c5e0a87b2a3199 server_cookie=a9033f8b047739bc in_seq=0 out_seq=0 2024-09-21T05:57:58.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.064+0000 7fc811ffb640 10 client.16350 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:58.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.064+0000 7fc811ffb640 1 -- 172.21.15.7:0/1351255242 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56027301cda0 con 0x560272cbb9f0 2024-09-21T05:57:58.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.064+0000 7fc811ffb640 10 client.16350 handle_command_reply: tid=0 2024-09-21T05:57:58.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.064+0000 7fc83a88b740 1 client.16350 shutdown 2024-09-21T05:57:58.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.065+0000 7fc83a88b740 1 -- 172.21.15.7:0/1351255242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 msgr2=0x5602730b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:58.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.065+0000 7fc83a88b740 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730b0340 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc820000c00 tx=0x7fc820005db0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.065+0000 7fc83a88b740 1 -- 172.21.15.7:0/1351255242 shutdown_connections 2024-09-21T05:57:58.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.065+0000 7fc83a88b740 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560272cbb9f0 0x5602730c19d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.065+0000 7fc83a88b740 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730b0340 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.065+0000 7fc83a88b740 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.065+0000 7fc83a88b740 1 --2- 172.21.15.7:0/1351255242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.065+0000 7fc83a88b740 1 -- 172.21.15.7:0/1351255242 >> 172.21.15.7:0/1351255242 conn(0x560272cf1460 msgr2=0x5602730a7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:58.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.065+0000 7fc811ffb640 0 client.16350 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:58.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.065+0000 7fc83a88b740 1 -- 172.21.15.7:0/1351255242 shutdown_connections 2024-09-21T05:57:58.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.065+0000 7fc83a88b740 1 -- 172.21.15.7:0/1351255242 wait complete. 2024-09-21T05:57:58.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.065+0000 7fc83a88b740 20 client.16350 trim_cache size 0 max 16384 2024-09-21T05:57:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc83a88b740 1 Processor -- start 2024-09-21T05:57:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc83a88b740 1 -- start start 2024-09-21T05:57:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc83a88b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc83a88b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc83a88b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730a1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc83a88b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c1b3f40 con 0x560272cfd070 2024-09-21T05:57:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc83a88b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c1b1810 con 0x560272cdc390 2024-09-21T05:57:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc83a88b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c1af660 con 0x560272cd41b0 2024-09-21T05:57:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc8318b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc8318b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37890/0 (socket says 172.21.15.7:37890) 2024-09-21T05:57:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc8318b2640 1 -- 172.21.15.7:0/4172741919 learned_addr learned my addr 172.21.15.7:0/4172741919 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc8320b3640 1 --2- 172.21.15.7:0/4172741919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc8318b2640 1 --2- 172.21.15.7:0/4172741919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc8318b2640 1 -- 172.21.15.7:0/4172741919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 msgr2=0x5602730a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc8318b2640 1 --2- 172.21.15.7:0/4172741919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730a5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc8318b2640 1 -- 172.21.15.7:0/4172741919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 msgr2=0x5602730b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc8318b2640 1 --2- 172.21.15.7:0/4172741919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.083+0000 7fc8318b2640 1 -- 172.21.15.7:0/4172741919 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602730a6790 con 0x560272cfd070 2024-09-21T05:57:58.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.084+0000 7fc8318b2640 1 --2- 172.21.15.7:0/4172741919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730a1710 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc820009850 tx=0x7fc820031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debfe56815e03eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:58.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.084+0000 7fc813fff640 1 -- 172.21.15.7:0/4172741919 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820044040 con 0x560272cfd070 2024-09-21T05:57:58.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.084+0000 7fc813fff640 1 -- 172.21.15.7:0/4172741919 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8200035f0 con 0x560272cfd070 2024-09-21T05:57:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.084+0000 7fc813fff640 1 -- 172.21.15.7:0/4172741919 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820004900 con 0x560272cfd070 2024-09-21T05:57:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.084+0000 7fc83a88b740 1 -- 172.21.15.7:0/4172741919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 msgr2=0x5602730a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.084+0000 7fc83a88b740 1 --2- 172.21.15.7:0/4172741919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730a1710 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc820009850 tx=0x7fc820031400 comp rx=0 tx=0).stop 2024-09-21T05:57:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 -- 172.21.15.7:0/4172741919 shutdown_connections 2024-09-21T05:57:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 --2- 172.21.15.7:0/4172741919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730a1710 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 --2- 172.21.15.7:0/4172741919 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 --2- 172.21.15.7:0/4172741919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 -- 172.21.15.7:0/4172741919 >> 172.21.15.7:0/4172741919 conn(0x560272cf1460 msgr2=0x5602730b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 -- 172.21.15.7:0/4172741919 shutdown_connections 2024-09-21T05:57:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 -- 172.21.15.7:0/4172741919 wait complete. 2024-09-21T05:57:58.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 -- start start 2024-09-21T05:57:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 Processor -- start 2024-09-21T05:57:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730c5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c1afcd0 con 0x560272cfd070 2024-09-21T05:57:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c1b1140 con 0x560272cdc390 2024-09-21T05:57:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c1b03a0 con 0x560272cd41b0 2024-09-21T05:57:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.085+0000 7fc83a88b740 10 client.0 _ll_register_callbacks cb 0x7fc81c009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:57:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc8318b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc8318b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730c2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37902/0 (socket says 172.21.15.7:37902) 2024-09-21T05:57:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc8318b2640 1 -- 172.21.15.7:0/3196560855 learned_addr learned my addr 172.21.15.7:0/3196560855 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc8318b2640 1 --2- 172.21.15.7:0/3196560855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc8320b3640 1 --2- 172.21.15.7:0/3196560855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc8318b2640 1 -- 172.21.15.7:0/3196560855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 msgr2=0x5602730c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc8318b2640 1 --2- 172.21.15.7:0/3196560855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc8318b2640 1 -- 172.21.15.7:0/3196560855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 msgr2=0x5602730c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:57:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc8318b2640 1 --2- 172.21.15.7:0/3196560855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc8318b2640 1 -- 172.21.15.7:0/3196560855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602730c30b0 con 0x560272cfd070 2024-09-21T05:57:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc8318b2640 1 --2- 172.21.15.7:0/3196560855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730c2a70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x5602730c7e30 tx=0x7fc820004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae98c6d6a5ebfdc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc811ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:57:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc811ffb640 1 -- 172.21.15.7:0/3196560855 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820044040 con 0x560272cfd070 2024-09-21T05:57:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc811ffb640 1 -- 172.21.15.7:0/3196560855 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fc820004110 con 0x560272cfd070 2024-09-21T05:57:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.086+0000 7fc83a88b740 1 -- 172.21.15.7:0/3196560855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8200035f0 con 0x560272cfd070 2024-09-21T05:57:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.087+0000 7fc811ffb640 1 -- 172.21.15.7:0/3196560855 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc820003810 con 0x560272cfd070 2024-09-21T05:57:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.087+0000 7fc83a88b740 10 client.16356 fetch_fsmap learned FSMap version 25 2024-09-21T05:57:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.087+0000 7fc83a88b740 1 -- 172.21.15.7:0/3196560855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56027312bf10 con 0x560272cfd070 2024-09-21T05:57:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.087+0000 7fc811ffb640 1 -- 172.21.15.7:0/3196560855 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8200035f0 con 0x560272cfd070 2024-09-21T05:57:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.087+0000 7fc811ffb640 1 -- 172.21.15.7:0/3196560855 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc820061040 con 0x560272cfd070 2024-09-21T05:57:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.087+0000 7fc83a88b740 10 client.16356 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:57:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.087+0000 7fc83a88b740 10 client.16356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:57:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.087+0000 7fc83a88b740 20 client.16356 populate_metadata read hostname 'smithi007' 2024-09-21T05:57:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.087+0000 7fc83a88b740 1 --2- 172.21.15.7:0/3196560855 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560272c90da0 0x56027312e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.087+0000 7fc83a88b740 4 client.16356 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:57:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.087+0000 7fc83a88b740 1 -- 172.21.15.7:0/3196560855 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560273018850 con 0x560272c90da0 2024-09-21T05:57:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.087+0000 7fc8320b3640 1 --2- 172.21.15.7:0/3196560855 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560272c90da0 0x56027312e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:58.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:57 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T05:57:58.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:57 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:57:58.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:57 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T05:57:58.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:57 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:57:58.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:57 smithi119 ceph-mon[34833]: pgmap v440: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:57:58.094 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:57 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T05:57:58.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc8320b3640 1 --2- 172.21.15.7:0/3196560855 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560272c90da0 0x56027312e5d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2455842ac35a9c5a server_cookie=162eac284b9a6cc in_seq=0 out_seq=0 2024-09-21T05:57:58.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc811ffb640 10 client.16356 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:58.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc811ffb640 1 -- 172.21.15.7:0/3196560855 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x560273018850 con 0x560272c90da0 2024-09-21T05:57:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc811ffb640 10 client.16356 handle_command_reply: tid=0 2024-09-21T05:57:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc83a88b740 1 client.16356 shutdown 2024-09-21T05:57:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc83a88b740 1 -- 172.21.15.7:0/3196560855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 msgr2=0x5602730c2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc83a88b740 1 --2- 172.21.15.7:0/3196560855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730c2a70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x5602730c7e30 tx=0x7fc820004410 comp rx=0 tx=0).stop 2024-09-21T05:57:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc83a88b740 1 -- 172.21.15.7:0/3196560855 shutdown_connections 2024-09-21T05:57:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc83a88b740 1 --2- 172.21.15.7:0/3196560855 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560272c90da0 0x56027312e5d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc83a88b740 1 --2- 172.21.15.7:0/3196560855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560272cfd070 0x5602730c2a70 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc83a88b740 1 --2- 172.21.15.7:0/3196560855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560272cdc390 0x5602730c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc811ffb640 0 client.16356 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:57:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc83a88b740 1 --2- 172.21.15.7:0/3196560855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560272cd41b0 0x5602730c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc83a88b740 1 -- 172.21.15.7:0/3196560855 >> 172.21.15.7:0/3196560855 conn(0x560272cf1460 msgr2=0x5602730a5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc83a88b740 1 -- 172.21.15.7:0/3196560855 shutdown_connections 2024-09-21T05:57:58.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.088+0000 7fc83a88b740 1 -- 172.21.15.7:0/3196560855 wait complete. 2024-09-21T05:57:58.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.089+0000 7fc83a88b740 20 client.16356 trim_cache size 0 max 16384 2024-09-21T05:57:58.097 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:57:58.097 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T05:57:58.097 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T05:57:58.097 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:57:58.097 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T05:57:58.097 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T05:57:58.097 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:58.097 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:58.097 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:58.097 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:58.098 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:58.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:58.098 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T05:57:58.098 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T05:57:58.098 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:58.098 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:58.098 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:58.098 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:58.098 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:58.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:58.098 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T05:57:58.098 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T05:57:58.098 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:57:58.099 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:57:58.100 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:58.100 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:58.100 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:58.100 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:58.100 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:58.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:58.100 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:57:58.100 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:57:58.100 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:58.100 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:58.100 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:58.100 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:58.100 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:58.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:57:58.101 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:57:58.101 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:57:58.101 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:57:58.101 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:57:58.101 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:57:58.101 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:57:58.101 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:57:58.101 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:57:58.101 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:57:58.101 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:57:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.089+0000 7fc834317640 1 -- 172.21.15.7:0/2255194259 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc8140b6680 msgr2=0x7fc8140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.089+0000 7fc834317640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc8140b6680 0x7fc8140b8b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc8240e4770 tx=0x7fc824094040 comp rx=0 tx=0).stop 2024-09-21T05:57:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.089+0000 7fc834317640 1 -- 172.21.15.7:0/2255194259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc82c108cf0 msgr2=0x7fc82c1000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.089+0000 7fc834317640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc82c108cf0 0x7fc82c1000f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc82400d950 tx=0x7fc82400de10 comp rx=0 tx=0).stop 2024-09-21T05:57:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.089+0000 7fc834317640 1 -- 172.21.15.7:0/2255194259 shutdown_connections 2024-09-21T05:57:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.089+0000 7fc834317640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc8140b6680 0x7fc8140b8b90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.089+0000 7fc834317640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc82c108cf0 0x7fc82c1000f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.089+0000 7fc834317640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc82c1083a0 0x7fc82c0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.089+0000 7fc834317640 1 --2- 172.21.15.7:0/2255194259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc82c102a60 0x7fc82c0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:58.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.089+0000 7fc834317640 1 -- 172.21.15.7:0/2255194259 >> 172.21.15.7:0/2255194259 conn(0x7fc82c079730 msgr2=0x7fc82c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:58.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.089+0000 7fc834317640 1 -- 172.21.15.7:0/2255194259 shutdown_connections 2024-09-21T05:57:58.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:58.089+0000 7fc834317640 1 -- 172.21.15.7:0/2255194259 wait complete. 2024-09-21T05:57:58.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:58 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:57:59.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:57:59.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:58 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:57:59.102 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T05:57:59.103 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:57:59.368 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:57:59.795 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:59 smithi007 ceph-mon[30983]: pgmap v441: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T05:57:59.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:57:59.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:57:59.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:57:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:57:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.887+0000 7fa11013e640 1 -- 172.21.15.7:0/3095137712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1081083a0 msgr2=0x7fa1081087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.887+0000 7fa11013e640 1 --2- 172.21.15.7:0/3095137712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1081083a0 0x7fa1081087b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009900 tx=0x7fa0f802a410 comp rx=0 tx=0).stop 2024-09-21T05:57:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.887+0000 7fa11013e640 1 -- 172.21.15.7:0/3095137712 shutdown_connections 2024-09-21T05:57:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.887+0000 7fa11013e640 1 --2- 172.21.15.7:0/3095137712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1081083a0 0x7fa1081087b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.887+0000 7fa11013e640 1 --2- 172.21.15.7:0/3095137712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa108108cf0 0x7fa10810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.887+0000 7fa11013e640 1 --2- 172.21.15.7:0/3095137712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa108102a60 0x7fa108102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.887+0000 7fa11013e640 1 -- 172.21.15.7:0/3095137712 >> 172.21.15.7:0/3095137712 conn(0x7fa108079730 msgr2=0x7fa108079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:57:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.887+0000 7fa11013e640 1 -- 172.21.15.7:0/3095137712 shutdown_connections 2024-09-21T05:57:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.887+0000 7fa11013e640 1 -- 172.21.15.7:0/3095137712 wait complete. 2024-09-21T05:57:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.888+0000 7fa11013e640 1 Processor -- start 2024-09-21T05:57:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.888+0000 7fa11013e640 1 -- start start 2024-09-21T05:57:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa11013e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa108102a60 0x7fa10819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa11013e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1081083a0 0x7fa10819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa11013e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa108108cf0 0x7fa10819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa11013e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa108113a80 con 0x7fa1081083a0 2024-09-21T05:57:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa11013e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa108113900 con 0x7fa108108cf0 2024-09-21T05:57:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa11013e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa108113c00 con 0x7fa108102a60 2024-09-21T05:57:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa10d6d9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1081083a0 0x7fa10819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa10d6d9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1081083a0 0x7fa10819aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51630/0 (socket says 172.21.15.7:51630) 2024-09-21T05:57:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa10d6d9640 1 -- 172.21.15.7:0/1722495382 learned_addr learned my addr 172.21.15.7:0/1722495382 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:57:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa10deda640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa108102a60 0x7fa10819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa10d6d9640 1 -- 172.21.15.7:0/1722495382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa108102a60 msgr2=0x7fa10819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa10d6d9640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa108102a60 0x7fa10819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa10d6d9640 1 -- 172.21.15.7:0/1722495382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa108108cf0 msgr2=0x7fa10819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa10e6db640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa108108cf0 0x7fa10819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa10d6d9640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa108108cf0 0x7fa10819fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa10d6d9640 1 -- 172.21.15.7:0/1722495382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1081a0420 con 0x7fa1081083a0 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa10deda640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa108102a60 0x7fa10819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.889+0000 7fa10d6d9640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1081083a0 0x7fa10819aa50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8032fd0 tx=0x7fa0f8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.890+0000 7fa0feffd640 1 -- 172.21.15.7:0/1722495382 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f803f030 con 0x7fa1081083a0 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.890+0000 7fa11013e640 1 -- 172.21.15.7:0/1722495382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1081a06b0 con 0x7fa1081083a0 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.890+0000 7fa0feffd640 1 -- 172.21.15.7:0/1722495382 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0f8004490 con 0x7fa1081083a0 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.890+0000 7fa0feffd640 1 -- 172.21.15.7:0/1722495382 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8035070 con 0x7fa1081083a0 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.890+0000 7fa11013e640 1 -- 172.21.15.7:0/1722495382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1081a6e70 con 0x7fa1081083a0 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.891+0000 7fa11013e640 1 -- 172.21.15.7:0/1722495382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa108103ce0 con 0x7fa1081083a0 2024-09-21T05:57:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.892+0000 7fa0feffd640 1 -- 172.21.15.7:0/1722495382 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa0f8042030 con 0x7fa1081083a0 2024-09-21T05:57:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.893+0000 7fa0feffd640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa0f40b6680 0x7fa0f40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:57:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.893+0000 7fa10deda640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa0f40b6680 0x7fa0f40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:57:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.893+0000 7fa0feffd640 1 -- 172.21.15.7:0/1722495382 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa0f8107cc0 con 0x7fa1081083a0 2024-09-21T05:57:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.894+0000 7fa10deda640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa0f40b6680 0x7fa0f40b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa1040058c0 tx=0x7fa104005d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:57:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:57:59.898+0000 7fa0feffd640 1 -- 172.21.15.7:0/1722495382 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0f80ce290 con 0x7fa1081083a0 2024-09-21T05:57:59.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:59 smithi027 ceph-mon[34364]: pgmap v441: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T05:57:59.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:59 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:57:59.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:59 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:57:59.977 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:57:59 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:58:00.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:59 smithi119 ceph-mon[34833]: pgmap v441: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T05:58:00.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:59 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:58:00.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:59 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:58:00.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:57:59 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:58:00.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.122+0000 7fa11013e640 1 -- 172.21.15.7:0/1722495382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa10810aac0 con 0x7fa1081083a0 2024-09-21T05:58:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.123+0000 7fa0feffd640 1 -- 172.21.15.7:0/1722495382 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7fa0f80d2670 con 0x7fa1081083a0 2024-09-21T05:58:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:58:00.125 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:58:00.125 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:58:00.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.125+0000 7fa11013e640 1 -- 172.21.15.7:0/1722495382 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa0f40b6680 msgr2=0x7fa0f40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:00.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.125+0000 7fa11013e640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa0f40b6680 0x7fa0f40b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa1040058c0 tx=0x7fa104005d30 comp rx=0 tx=0).stop 2024-09-21T05:58:00.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.125+0000 7fa11013e640 1 -- 172.21.15.7:0/1722495382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1081083a0 msgr2=0x7fa10819aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:00.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.125+0000 7fa11013e640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1081083a0 0x7fa10819aa50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8032fd0 tx=0x7fa0f8004270 comp rx=0 tx=0).stop 2024-09-21T05:58:00.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.125+0000 7fa11013e640 1 -- 172.21.15.7:0/1722495382 shutdown_connections 2024-09-21T05:58:00.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.125+0000 7fa11013e640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa0f40b6680 0x7fa0f40b8b90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:00.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.125+0000 7fa11013e640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1081083a0 0x7fa10819aa50 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:00.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.125+0000 7fa11013e640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa108108cf0 0x7fa10819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:00.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.125+0000 7fa11013e640 1 --2- 172.21.15.7:0/1722495382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa108102a60 0x7fa10819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:00.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.125+0000 7fa11013e640 1 -- 172.21.15.7:0/1722495382 >> 172.21.15.7:0/1722495382 conn(0x7fa108079730 msgr2=0x7fa108104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:00.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.125+0000 7fa11013e640 1 -- 172.21.15.7:0/1722495382 shutdown_connections 2024-09-21T05:58:00.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:00.125+0000 7fa11013e640 1 -- 172.21.15.7:0/1722495382 wait complete. 2024-09-21T05:58:00.919 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T05:58:00.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:00 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1722495382' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:58:01.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1722495382' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:58:01.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:00 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1722495382' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:58:01.186 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:01.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.642+0000 7f3ed4a29640 1 -- 172.21.15.7:0/1287512118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed0103bb0 msgr2=0x7f3ed0103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:01.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.642+0000 7f3ed4a29640 1 --2- 172.21.15.7:0/1287512118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed0103bb0 0x7f3ed0103fc0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009900 tx=0x7f3ec002a410 comp rx=0 tx=0).stop 2024-09-21T05:58:01.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.642+0000 7f3ed4a29640 1 -- 172.21.15.7:0/1287512118 shutdown_connections 2024-09-21T05:58:01.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.642+0000 7f3ed4a29640 1 --2- 172.21.15.7:0/1287512118 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ed0109e40 0x7f3ed0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.642+0000 7f3ed4a29640 1 --2- 172.21.15.7:0/1287512118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ed01094f0 0x7f3ed0109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.642+0000 7f3ed4a29640 1 --2- 172.21.15.7:0/1287512118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed0103bb0 0x7f3ed0103fc0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.642+0000 7f3ed4a29640 1 -- 172.21.15.7:0/1287512118 >> 172.21.15.7:0/1287512118 conn(0x7f3ed00ff600 msgr2=0x7f3ed0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:01.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.642+0000 7f3ed4a29640 1 -- 172.21.15.7:0/1287512118 shutdown_connections 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.642+0000 7f3ed4a29640 1 -- 172.21.15.7:0/1287512118 wait complete. 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3ed4a29640 1 Processor -- start 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3ed4a29640 1 -- start start 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3ed4a29640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ed0103bb0 0x7f3ed019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3ed4a29640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ed01094f0 0x7f3ed019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3ed4a29640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed0109e40 0x7f3ed019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3ed4a29640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed0113b00 con 0x7f3ed0109e40 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3ed4a29640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed0113980 con 0x7f3ed01094f0 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3ed4a29640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed0113c80 con 0x7f3ed0103bb0 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3eced9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed0109e40 0x7f3ed019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3eced9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed0109e40 0x7f3ed019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51648/0 (socket says 172.21.15.7:51648) 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3eced9d640 1 -- 172.21.15.7:0/371353892 learned_addr learned my addr 172.21.15.7:0/371353892 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3ece59c640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ed0103bb0 0x7f3ed019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ed01094f0 0x7f3ed019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3eced9d640 1 -- 172.21.15.7:0/371353892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ed0103bb0 msgr2=0x7f3ed019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:01.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3eced9d640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ed0103bb0 0x7f3ed019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3eced9d640 1 -- 172.21.15.7:0/371353892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ed01094f0 msgr2=0x7f3ed019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:01.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3eced9d640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ed01094f0 0x7f3ed019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.643+0000 7f3eced9d640 1 -- 172.21.15.7:0/371353892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed01a0480 con 0x7f3ed0109e40 2024-09-21T05:58:01.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.644+0000 7f3eced9d640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed0109e40 0x7f3ed019fd50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009fd0 tx=0x7f3ec800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:01.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.644+0000 7f3ebf7fe640 1 -- 172.21.15.7:0/371353892 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8017070 con 0x7f3ed0109e40 2024-09-21T05:58:01.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.644+0000 7f3ebf7fe640 1 -- 172.21.15.7:0/371353892 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ec8003e20 con 0x7f3ed0109e40 2024-09-21T05:58:01.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.644+0000 7f3ed4a29640 1 -- 172.21.15.7:0/371353892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed01a0770 con 0x7f3ed0109e40 2024-09-21T05:58:01.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.644+0000 7f3ebf7fe640 1 -- 172.21.15.7:0/371353892 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8010460 con 0x7f3ed0109e40 2024-09-21T05:58:01.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.644+0000 7f3ed4a29640 1 -- 172.21.15.7:0/371353892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed01a6ed0 con 0x7f3ed0109e40 2024-09-21T05:58:01.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.647+0000 7f3edaf9d740 1 Processor -- start 2024-09-21T05:58:01.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.647+0000 7f3ebf7fe640 1 -- 172.21.15.7:0/371353892 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3ec8003970 con 0x7f3ed0109e40 2024-09-21T05:58:01.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.648+0000 7f3edaf9d740 1 -- start start 2024-09-21T05:58:01.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.648+0000 7f3edaf9d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617292070 0x5596176396a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.648+0000 7f3edaf9d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 0x559617639be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.648+0000 7f3edaf9d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559617271390 0x55961763a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.648+0000 7f3edaf9d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5596175afea0 con 0x5596172691b0 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.648+0000 7f3edaf9d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55961759f2d0 con 0x559617292070 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.648+0000 7f3edaf9d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5596175a30e0 con 0x559617271390 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.648+0000 7f3ece59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 0x559617639be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.648+0000 7f3ece59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 0x559617639be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51658/0 (socket says 172.21.15.7:51658) 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.648+0000 7f3ece59c640 1 -- 172.21.15.7:0/2891636773 learned_addr learned my addr 172.21.15.7:0/2891636773 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.648+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/2891636773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617292070 0x5596176396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.648+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/2891636773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559617271390 0x55961763a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.649+0000 7f3ebf7fe640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3eb80b6680 0x7f3eb80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.649+0000 7f3ece59c640 1 -- 172.21.15.7:0/2891636773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559617271390 msgr2=0x55961763a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.649+0000 7f3ece59c640 1 --2- 172.21.15.7:0/2891636773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559617271390 0x55961763a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.649+0000 7f3ece59c640 1 -- 172.21.15.7:0/2891636773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617292070 msgr2=0x5596176396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:01.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.649+0000 7f3ece59c640 1 --2- 172.21.15.7:0/2891636773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617292070 0x5596176396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.649+0000 7f3ece59c640 1 -- 172.21.15.7:0/2891636773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596172fd650 con 0x5596172691b0 2024-09-21T05:58:01.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.649+0000 7f3eced9d640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3eb80b6680 0x7f3eb80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.649+0000 7f3ebf7fe640 1 -- 172.21.15.7:0/371353892 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f3ec80e73c0 con 0x7f3ed0109e40 2024-09-21T05:58:01.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.649+0000 7f3ece59c640 1 --2- 172.21.15.7:0/2891636773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 0x559617639be0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009900 tx=0x7f3ec0032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1c3ef6a8660cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:01.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.649+0000 7f3ebcff9640 1 -- 172.21.15.7:0/2891636773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0040070 con 0x5596172691b0 2024-09-21T05:58:01.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.649+0000 7f3ebcff9640 1 -- 172.21.15.7:0/2891636773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ec0004030 con 0x5596172691b0 2024-09-21T05:58:01.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.649+0000 7f3ebcff9640 1 -- 172.21.15.7:0/2891636773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0035040 con 0x5596172691b0 2024-09-21T05:58:01.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.650+0000 7f3edaf9d740 1 -- 172.21.15.7:0/2891636773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 msgr2=0x559617639be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:01.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.650+0000 7f3eced9d640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3eb80b6680 0x7f3eb80b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80acfe0 tx=0x7f3ec8075e00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:01.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.650+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/2891636773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 0x559617639be0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009900 tx=0x7f3ec0032cd0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.650+0000 7f3edaf9d740 1 -- 172.21.15.7:0/2891636773 shutdown_connections 2024-09-21T05:58:01.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.650+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/2891636773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 0x559617639be0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.650+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/2891636773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559617271390 0x55961763a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.650+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/2891636773 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617292070 0x5596176396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.650+0000 7f3edaf9d740 1 -- 172.21.15.7:0/2891636773 >> 172.21.15.7:0/2891636773 conn(0x559617286460 msgr2=0x559617637590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:01.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.650+0000 7f3edaf9d740 1 -- 172.21.15.7:0/2891636773 shutdown_connections 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.650+0000 7f3edaf9d740 1 -- 172.21.15.7:0/2891636773 wait complete. 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.651+0000 7f3edaf9d740 1 -- start start 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.651+0000 7f3edaf9d740 1 Processor -- start 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.651+0000 7f3edaf9d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596172691b0 0x559617649140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.651+0000 7f3edaf9d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 0x559617649680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.651+0000 7f3edaf9d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 0x5596176554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.651+0000 7f3edaf9d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559617400700 con 0x559617292070 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.651+0000 7f3edaf9d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55961753a160 con 0x559617271390 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.651+0000 7f3edaf9d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55961764c180 con 0x5596172691b0 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.651+0000 7f3edaf9d740 10 client.0 _ll_register_callbacks cb 0x5596175539e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.651+0000 7f3ecdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 0x5596176554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.651+0000 7f3ecdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 0x5596176554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51672/0 (socket says 172.21.15.7:51672) 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.651+0000 7f3ecdd9b640 1 -- 172.21.15.7:0/48233591 learned_addr learned my addr 172.21.15.7:0/48233591 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.651+0000 7f3ece59c640 1 --2- 172.21.15.7:0/48233591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 0x559617649680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/48233591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596172691b0 0x559617649140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3ecdd9b640 1 -- 172.21.15.7:0/48233591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596172691b0 msgr2=0x559617649140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/48233591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596172691b0 0x559617649140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3ecdd9b640 1 -- 172.21.15.7:0/48233591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 msgr2=0x559617649680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/48233591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 0x559617649680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3ecdd9b640 1 -- 172.21.15.7:0/48233591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559617567c90 con 0x559617292070 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/48233591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 0x5596176554e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3ed006c930 tx=0x7f3ec4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e590ec89850eaf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3eb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3eb5ffb640 1 -- 172.21.15.7:0/48233591 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4012990 con 0x559617292070 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3edaf9d740 1 -- 172.21.15.7:0/48233591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ec0004030 con 0x559617292070 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3eb5ffb640 1 -- 172.21.15.7:0/48233591 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f3ec4012b30 con 0x559617292070 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3eb5ffb640 1 -- 172.21.15.7:0/48233591 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3ec4012d30 con 0x559617292070 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3edaf9d740 10 client.16374 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.652+0000 7f3edaf9d740 1 -- 172.21.15.7:0/48233591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559617657f50 con 0x559617292070 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.653+0000 7f3eb5ffb640 1 -- 172.21.15.7:0/48233591 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ec0004030 con 0x559617292070 2024-09-21T05:58:01.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.653+0000 7f3eb5ffb640 1 -- 172.21.15.7:0/48233591 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3ec402a400 con 0x559617292070 2024-09-21T05:58:01.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.653+0000 7f3edaf9d740 10 client.16374 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:01.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.653+0000 7f3edaf9d740 10 client.16374 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:58:01.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.653+0000 7f3edaf9d740 20 client.16374 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:01.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.653+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/48233591 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5596172509f0 0x55961765b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.653+0000 7f3edaf9d740 4 client.16374 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:58:01.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.653+0000 7f3edaf9d740 1 -- 172.21.15.7:0/48233591 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596175b1df0 con 0x5596172509f0 2024-09-21T05:58:01.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.653+0000 7f3ece59c640 1 --2- 172.21.15.7:0/48233591 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5596172509f0 0x55961765b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.654+0000 7f3eb5ffb640 10 client.16374 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:58:01.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.654+0000 7f3ece59c640 1 --2- 172.21.15.7:0/48233591 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5596172509f0 0x55961765b400 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ce3ddf96c7504ab1 server_cookie=ea0f5b10040d44d9 in_seq=0 out_seq=0 2024-09-21T05:58:01.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.654+0000 7f3eb5ffb640 1 -- 172.21.15.7:0/48233591 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596175b1df0 con 0x5596172509f0 2024-09-21T05:58:01.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.654+0000 7f3eb5ffb640 10 client.16374 handle_command_reply: tid=0 2024-09-21T05:58:01.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.654+0000 7f3edaf9d740 1 client.16374 shutdown 2024-09-21T05:58:01.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.655+0000 7f3edaf9d740 1 -- 172.21.15.7:0/48233591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 msgr2=0x5596176554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:01.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.655+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/48233591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 0x5596176554e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3ed006c930 tx=0x7f3ec4014040 comp rx=0 tx=0).stop 2024-09-21T05:58:01.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.655+0000 7f3edaf9d740 1 -- 172.21.15.7:0/48233591 shutdown_connections 2024-09-21T05:58:01.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.655+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/48233591 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5596172509f0 0x55961765b400 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.655+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/48233591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 0x5596176554e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.655+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/48233591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 0x559617649680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.655+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/48233591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596172691b0 0x559617649140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.655+0000 7f3eb5ffb640 0 client.16374 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:58:01.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.655+0000 7f3edaf9d740 1 -- 172.21.15.7:0/48233591 >> 172.21.15.7:0/48233591 conn(0x559617286460 msgr2=0x55961763b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:01.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.655+0000 7f3edaf9d740 1 -- 172.21.15.7:0/48233591 shutdown_connections 2024-09-21T05:58:01.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.655+0000 7f3edaf9d740 1 -- 172.21.15.7:0/48233591 wait complete. 2024-09-21T05:58:01.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.655+0000 7f3edaf9d740 20 client.16374 trim_cache size 0 max 16384 2024-09-21T05:58:01.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.668+0000 7f3edaf9d740 1 Processor -- start 2024-09-21T05:58:01.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.668+0000 7f3edaf9d740 1 -- start start 2024-09-21T05:58:01.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.668+0000 7f3edaf9d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 0x559617648ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.668+0000 7f3edaf9d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 0x559617649430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.668+0000 7f3edaf9d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559617292070 0x559617646330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.668+0000 7f3edaf9d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed01afba0 con 0x5596172691b0 2024-09-21T05:58:01.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.668+0000 7f3edaf9d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed01ad470 con 0x559617271390 2024-09-21T05:58:01.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.668+0000 7f3edaf9d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed01ab2e0 con 0x559617292070 2024-09-21T05:58:01.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.668+0000 7f3ecdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 0x559617648ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.668+0000 7f3ecdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 0x559617648ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51676/0 (socket says 172.21.15.7:51676) 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.668+0000 7f3ecdd9b640 1 -- 172.21.15.7:0/3295413573 learned_addr learned my addr 172.21.15.7:0/3295413573 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.669+0000 7f3ece59c640 1 --2- 172.21.15.7:0/3295413573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 0x559617649430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.669+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/3295413573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559617292070 0x559617646330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.669+0000 7f3ecdd9b640 1 -- 172.21.15.7:0/3295413573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559617292070 msgr2=0x559617646330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.669+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/3295413573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559617292070 0x559617646330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.669+0000 7f3ecdd9b640 1 -- 172.21.15.7:0/3295413573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 msgr2=0x559617649430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.669+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/3295413573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 0x559617649430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.669+0000 7f3ecdd9b640 1 -- 172.21.15.7:0/3295413573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559617649fe0 con 0x5596172691b0 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.669+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/3295413573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 0x559617648ef0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400c010 tx=0x7f3ec40123f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb140889f4438b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.669+0000 7f3eb7fff640 1 -- 172.21.15.7:0/3295413573 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4030020 con 0x5596172691b0 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.669+0000 7f3eb7fff640 1 -- 172.21.15.7:0/3295413573 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ec400b390 con 0x5596172691b0 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.669+0000 7f3eb7fff640 1 -- 172.21.15.7:0/3295413573 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec402a9a0 con 0x5596172691b0 2024-09-21T05:58:01.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.670+0000 7f3edaf9d740 1 -- 172.21.15.7:0/3295413573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 msgr2=0x559617648ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:01.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.670+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/3295413573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 0x559617648ef0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400c010 tx=0x7f3ec40123f0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.670+0000 7f3edaf9d740 1 -- 172.21.15.7:0/3295413573 shutdown_connections 2024-09-21T05:58:01.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.670+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/3295413573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559617292070 0x559617646330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.670+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/3295413573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 0x559617649430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.670+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/3295413573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596172691b0 0x559617648ef0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.670+0000 7f3edaf9d740 1 -- 172.21.15.7:0/3295413573 >> 172.21.15.7:0/3295413573 conn(0x559617286460 msgr2=0x5596176479c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:01.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.670+0000 7f3edaf9d740 1 -- 172.21.15.7:0/3295413573 shutdown_connections 2024-09-21T05:58:01.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.670+0000 7f3edaf9d740 1 -- 172.21.15.7:0/3295413573 wait complete. 2024-09-21T05:58:01.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.670+0000 7f3edaf9d740 1 -- start start 2024-09-21T05:58:01.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.670+0000 7f3edaf9d740 1 Processor -- start 2024-09-21T05:58:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3edaf9d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596172691b0 0x55961764d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3edaf9d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 0x55961764dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3edaf9d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 0x5596176c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3edaf9d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed01ab930 con 0x559617292070 2024-09-21T05:58:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3edaf9d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed01acda0 con 0x559617271390 2024-09-21T05:58:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3edaf9d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed01ac000 con 0x5596172691b0 2024-09-21T05:58:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3edaf9d740 10 client.0 _ll_register_callbacks cb 0x7f3ec400bd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3ecdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 0x5596176c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3ecdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 0x5596176c4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51684/0 (socket says 172.21.15.7:51684) 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3ecdd9b640 1 -- 172.21.15.7:0/2200245175 learned_addr learned my addr 172.21.15.7:0/2200245175 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3ece59c640 1 --2- 172.21.15.7:0/2200245175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 0x55961764dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3ecdd9b640 1 -- 172.21.15.7:0/2200245175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596172691b0 msgr2=0x55961764d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/2200245175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596172691b0 0x55961764d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3ecdd9b640 1 -- 172.21.15.7:0/2200245175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 msgr2=0x55961764dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/2200245175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 0x55961764dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3ecdd9b640 1 -- 172.21.15.7:0/2200245175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55961764e470 con 0x559617292070 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3ecdd9b640 1 --2- 172.21.15.7:0/2200245175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 0x5596176c4e00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3ec402a850 tx=0x7f3ec4005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7f62c5f861a1e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3eb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.671+0000 7f3eb5ffb640 1 -- 172.21.15.7:0/2200245175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec403a020 con 0x559617292070 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.672+0000 7f3eb5ffb640 1 -- 172.21.15.7:0/2200245175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f3ec402a9a0 con 0x559617292070 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.672+0000 7f3edaf9d740 1 -- 172.21.15.7:0/2200245175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ec400b390 con 0x559617292070 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.672+0000 7f3eb5ffb640 1 -- 172.21.15.7:0/2200245175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3ec4030030 con 0x559617292070 2024-09-21T05:58:01.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.672+0000 7f3edaf9d740 10 client.16380 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.672+0000 7f3edaf9d740 1 -- 172.21.15.7:0/2200245175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5596176c62c0 con 0x559617292070 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.672+0000 7f3eb5ffb640 1 -- 172.21.15.7:0/2200245175 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ec400b390 con 0x559617292070 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.672+0000 7f3eb5ffb640 1 -- 172.21.15.7:0/2200245175 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3ec4035070 con 0x559617292070 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.672+0000 7f3edaf9d740 10 client.16380 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.672+0000 7f3edaf9d740 10 client.16380 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.672+0000 7f3edaf9d740 20 client.16380 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.672+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/2200245175 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x559617225da0 0x5596176c8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.672+0000 7f3edaf9d740 4 client.16380 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.672+0000 7f3edaf9d740 1 -- 172.21.15.7:0/2200245175 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5596175ad8a0 con 0x559617225da0 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.673+0000 7f3ece59c640 1 --2- 172.21.15.7:0/2200245175 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x559617225da0 0x5596176c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.673+0000 7f3ece59c640 1 --2- 172.21.15.7:0/2200245175 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x559617225da0 0x5596176c8930 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=14017cba8b41d395 server_cookie=d5708989c8eccb51 in_seq=0 out_seq=0 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.673+0000 7f3eb5ffb640 10 client.16380 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.673+0000 7f3eb5ffb640 1 -- 172.21.15.7:0/2200245175 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5596175ad8a0 con 0x559617225da0 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.673+0000 7f3eb5ffb640 10 client.16380 handle_command_reply: tid=0 2024-09-21T05:58:01.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.673+0000 7f3edaf9d740 1 client.16380 shutdown 2024-09-21T05:58:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.673+0000 7f3edaf9d740 1 -- 172.21.15.7:0/2200245175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 msgr2=0x5596176c4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.673+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/2200245175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 0x5596176c4e00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3ec402a850 tx=0x7f3ec4005630 comp rx=0 tx=0).stop 2024-09-21T05:58:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3edaf9d740 1 -- 172.21.15.7:0/2200245175 shutdown_connections 2024-09-21T05:58:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/2200245175 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x559617225da0 0x5596176c8930 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/2200245175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559617292070 0x5596176c4e00 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/2200245175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559617271390 0x55961764dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3edaf9d740 1 --2- 172.21.15.7:0/2200245175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5596172691b0 0x55961764d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3eb5ffb640 0 client.16380 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:58:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3edaf9d740 1 -- 172.21.15.7:0/2200245175 >> 172.21.15.7:0/2200245175 conn(0x559617286460 msgr2=0x5596176475c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3edaf9d740 1 -- 172.21.15.7:0/2200245175 shutdown_connections 2024-09-21T05:58:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3edaf9d740 1 -- 172.21.15.7:0/2200245175 wait complete. 2024-09-21T05:58:01.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3edaf9d740 20 client.16380 trim_cache size 0 max 16384 2024-09-21T05:58:01.680 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:58:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3ed4a29640 1 -- 172.21.15.7:0/371353892 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3eb80b6680 msgr2=0x7f3eb80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3ed4a29640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3eb80b6680 0x7f3eb80b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80acfe0 tx=0x7f3ec8075e00 comp rx=0 tx=0).stop 2024-09-21T05:58:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3ed4a29640 1 -- 172.21.15.7:0/371353892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed0109e40 msgr2=0x7f3ed019fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3ed4a29640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed0109e40 0x7f3ed019fd50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009fd0 tx=0x7f3ec800b260 comp rx=0 tx=0).stop 2024-09-21T05:58:01.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3ed4a29640 1 -- 172.21.15.7:0/371353892 shutdown_connections 2024-09-21T05:58:01.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3ed4a29640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3eb80b6680 0x7f3eb80b8b90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3ed4a29640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed0109e40 0x7f3ed019fd50 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3ed4a29640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ed01094f0 0x7f3ed019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3ed4a29640 1 --2- 172.21.15.7:0/371353892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ed0103bb0 0x7f3ed019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:01.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.674+0000 7f3ed4a29640 1 -- 172.21.15.7:0/371353892 >> 172.21.15.7:0/371353892 conn(0x7f3ed00ff600 msgr2=0x7f3ed0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:01.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.675+0000 7f3ed4a29640 1 -- 172.21.15.7:0/371353892 shutdown_connections 2024-09-21T05:58:01.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:01.675+0000 7f3ed4a29640 1 -- 172.21.15.7:0/371353892 wait complete. 2024-09-21T05:58:01.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:01 smithi027 ceph-mon[34364]: pgmap v442: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T05:58:02.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:01 smithi007 ceph-mon[30983]: pgmap v442: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T05:58:02.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:01 smithi119 ceph-mon[34833]: pgmap v442: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T05:58:02.519 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T05:58:02.781 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:03.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.324+0000 7fd0c3a34640 1 -- 172.21.15.7:0/3690667875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0bc110200 msgr2=0x7fd0bc112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:03.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.324+0000 7fd0c3a34640 1 --2- 172.21.15.7:0/3690667875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0bc110200 0x7fd0bc112620 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009ca0 tx=0x7fd0b402a950 comp rx=0 tx=0).stop 2024-09-21T05:58:03.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.324+0000 7fd0c3a34640 1 -- 172.21.15.7:0/3690667875 shutdown_connections 2024-09-21T05:58:03.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.324+0000 7fd0c3a34640 1 --2- 172.21.15.7:0/3690667875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0bc110200 0x7fd0bc112620 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.324+0000 7fd0c3a34640 1 --2- 172.21.15.7:0/3690667875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0bc102fa0 0x7fd0bc10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.324+0000 7fd0c3a34640 1 --2- 172.21.15.7:0/3690667875 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0bc102650 0x7fd0bc102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.324+0000 7fd0c3a34640 1 -- 172.21.15.7:0/3690667875 >> 172.21.15.7:0/3690667875 conn(0x7fd0bc079760 msgr2=0x7fd0bc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:03.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.324+0000 7fd0c3a34640 1 -- 172.21.15.7:0/3690667875 shutdown_connections 2024-09-21T05:58:03.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.324+0000 7fd0c3a34640 1 -- 172.21.15.7:0/3690667875 wait complete. 2024-09-21T05:58:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.325+0000 7fd0c3a34640 1 Processor -- start 2024-09-21T05:58:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.325+0000 7fd0c3a34640 1 -- start start 2024-09-21T05:58:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.325+0000 7fd0c3a34640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0bc102650 0x7fd0bc19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.325+0000 7fd0c3a34640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0bc102fa0 0x7fd0bc19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.325+0000 7fd0c3a34640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0bc110200 0x7fd0bc1a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.325+0000 7fd0c3a34640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc115ca0 con 0x7fd0bc110200 2024-09-21T05:58:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.325+0000 7fd0c3a34640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc115b20 con 0x7fd0bc102650 2024-09-21T05:58:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.325+0000 7fd0c3a34640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc115e20 con 0x7fd0bc102fa0 2024-09-21T05:58:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.325+0000 7fd0c1fd1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0bc110200 0x7fd0bc1a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.325+0000 7fd0c17d0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0bc102650 0x7fd0bc19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.325+0000 7fd0c1fd1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0bc110200 0x7fd0bc1a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51696/0 (socket says 172.21.15.7:51696) 2024-09-21T05:58:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.325+0000 7fd0c1fd1640 1 -- 172.21.15.7:0/3205280562 learned_addr learned my addr 172.21.15.7:0/3205280562 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:03.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.325+0000 7fd0c0fcf640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0bc102fa0 0x7fd0bc19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.326+0000 7fd0c1fd1640 1 -- 172.21.15.7:0/3205280562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0bc102fa0 msgr2=0x7fd0bc19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.326+0000 7fd0c1fd1640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0bc102fa0 0x7fd0bc19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.326+0000 7fd0c1fd1640 1 -- 172.21.15.7:0/3205280562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0bc102650 msgr2=0x7fd0bc19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.326+0000 7fd0c1fd1640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0bc102650 0x7fd0bc19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.326+0000 7fd0c1fd1640 1 -- 172.21.15.7:0/3205280562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0bc1a2580 con 0x7fd0bc110200 2024-09-21T05:58:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.326+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0bc102650 0x7fd0bc19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:58:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.326+0000 7fd0c1fd1640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0bc110200 0x7fd0bc1a1e50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd0b402ae70 tx=0x7fd0b402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.326+0000 7fd0b27fc640 1 -- 172.21.15.7:0/3205280562 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4034040 con 0x7fd0bc110200 2024-09-21T05:58:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.326+0000 7fd0b27fc640 1 -- 172.21.15.7:0/3205280562 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0b40308f0 con 0x7fd0bc110200 2024-09-21T05:58:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.326+0000 7fd0c3a34640 1 -- 172.21.15.7:0/3205280562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0bc1a2810 con 0x7fd0bc110200 2024-09-21T05:58:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.326+0000 7fd0b27fc640 1 -- 172.21.15.7:0/3205280562 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b40047f0 con 0x7fd0bc110200 2024-09-21T05:58:03.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.326+0000 7fd0c3a34640 1 -- 172.21.15.7:0/3205280562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0bc1a8fd0 con 0x7fd0bc110200 2024-09-21T05:58:03.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.329+0000 7fd0c9fa8740 1 Processor -- start 2024-09-21T05:58:03.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.329+0000 7fd0b27fc640 1 -- 172.21.15.7:0/3205280562 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd0b4037020 con 0x7fd0bc110200 2024-09-21T05:58:03.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.330+0000 7fd0c9fa8740 1 -- start start 2024-09-21T05:58:03.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.330+0000 7fd0c9fa8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a67070 0x55a505e0e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.330+0000 7fd0c9fa8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 0x55a505e0e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.330+0000 7fd0c9fa8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e0ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.330+0000 7fd0c9fa8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a505d84ea0 con 0x55a505a46390 2024-09-21T05:58:03.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.330+0000 7fd0c9fa8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a505d742d0 con 0x55a505a3e1b0 2024-09-21T05:58:03.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.330+0000 7fd0c9fa8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a505d780e0 con 0x55a505a67070 2024-09-21T05:58:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.330+0000 7fd0c0fcf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e0ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.330+0000 7fd0c0fcf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e0ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51710/0 (socket says 172.21.15.7:51710) 2024-09-21T05:58:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.330+0000 7fd0c0fcf640 1 -- 172.21.15.7:0/3779783208 learned_addr learned my addr 172.21.15.7:0/3779783208 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.330+0000 7fd0c0fcf640 1 --2- 172.21.15.7:0/3779783208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a67070 0x55a505e0e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.330+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/3779783208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 0x55a505e0e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.330+0000 7fd0b27fc640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd0a80b6700 0x7fd0a80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.331+0000 7fd0c17d0640 1 -- 172.21.15.7:0/3779783208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a67070 msgr2=0x55a505e0e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.331+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/3779783208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a67070 0x55a505e0e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.331+0000 7fd0c17d0640 1 -- 172.21.15.7:0/3779783208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 msgr2=0x55a505e0ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.331+0000 7fd0c1fd1640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd0a80b6700 0x7fd0a80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.331+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/3779783208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e0ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.331+0000 7fd0c17d0640 1 -- 172.21.15.7:0/3779783208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a505ad2650 con 0x55a505a3e1b0 2024-09-21T05:58:03.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.331+0000 7fd0c0fcf640 1 --2- 172.21.15.7:0/3779783208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e0ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:58:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.331+0000 7fd0b27fc640 1 -- 172.21.15.7:0/3205280562 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fd0b41084d0 con 0x7fd0bc110200 2024-09-21T05:58:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.331+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/3779783208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 0x55a505e0e800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80103d0 tx=0x7fd0b8010890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7220bde53ea51227 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.331+0000 7fd0c1fd1640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd0a80b6700 0x7fd0a80b8c10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40ce0a0 tx=0x7fd0b4043750 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.331+0000 7fd0a77fe640 1 -- 172.21.15.7:0/3779783208 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8004220 con 0x55a505a3e1b0 2024-09-21T05:58:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.331+0000 7fd0a77fe640 1 -- 172.21.15.7:0/3779783208 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0b80043c0 con 0x55a505a3e1b0 2024-09-21T05:58:03.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.331+0000 7fd0a77fe640 1 -- 172.21.15.7:0/3779783208 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80119c0 con 0x55a505a3e1b0 2024-09-21T05:58:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.332+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/3779783208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 msgr2=0x55a505e0e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.332+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/3779783208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 0x55a505e0e800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80103d0 tx=0x7fd0b8010890 comp rx=0 tx=0).stop 2024-09-21T05:58:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.332+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/3779783208 shutdown_connections 2024-09-21T05:58:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.332+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/3779783208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e0ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.332+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/3779783208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 0x55a505e0e800 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.332+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/3779783208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a67070 0x55a505e0e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.332+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/3779783208 >> 172.21.15.7:0/3779783208 conn(0x55a505a5b460 msgr2=0x55a505e0c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.332+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/3779783208 shutdown_connections 2024-09-21T05:58:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.332+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/3779783208 wait complete. 2024-09-21T05:58:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.333+0000 7fd0c9fa8740 1 -- start start 2024-09-21T05:58:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.333+0000 7fd0c9fa8740 1 Processor -- start 2024-09-21T05:58:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.333+0000 7fd0c9fa8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 0x55a505e19930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.333+0000 7fd0c9fa8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a46390 0x55a505e19e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.333+0000 7fd0c9fa8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a67070 0x55a505e25dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.333+0000 7fd0c9fa8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a505bd5700 con 0x55a505a67070 2024-09-21T05:58:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.333+0000 7fd0c9fa8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a505d0f160 con 0x55a505a3e1b0 2024-09-21T05:58:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.333+0000 7fd0c9fa8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a505e1caa0 con 0x55a505a46390 2024-09-21T05:58:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0c9fa8740 10 client.0 _ll_register_callbacks cb 0x55a505d289e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0c0fcf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a67070 0x55a505e25dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0c0fcf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a67070 0x55a505e25dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51720/0 (socket says 172.21.15.7:51720) 2024-09-21T05:58:03.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0c0fcf640 1 -- 172.21.15.7:0/3095383646 learned_addr learned my addr 172.21.15.7:0/3095383646 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/3095383646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a46390 0x55a505e19e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0c0fcf640 1 --2- 172.21.15.7:0/3095383646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 0x55a505e19930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0c0fcf640 1 -- 172.21.15.7:0/3095383646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a46390 msgr2=0x55a505e19e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0c0fcf640 1 --2- 172.21.15.7:0/3095383646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a46390 0x55a505e19e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0c0fcf640 1 -- 172.21.15.7:0/3095383646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 msgr2=0x55a505e19930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0c0fcf640 1 --2- 172.21.15.7:0/3095383646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 0x55a505e19930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0c0fcf640 1 -- 172.21.15.7:0/3095383646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a505d3cc90 con 0x55a505a67070 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0c0fcf640 1 --2- 172.21.15.7:0/3095383646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a67070 0x55a505e25dc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac005af0 tx=0x7fd0ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883c1e4324df5fa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.334+0000 7fd0a4ff9640 1 -- 172.21.15.7:0/3095383646 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac00d550 con 0x55a505a67070 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.335+0000 7fd0a4ff9640 1 -- 172.21.15.7:0/3095383646 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fd0ac019070 con 0x55a505a67070 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.335+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/3095383646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0b80043c0 con 0x55a505a67070 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.335+0000 7fd0a4ff9640 1 -- 172.21.15.7:0/3095383646 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd0ac00d6f0 con 0x55a505a67070 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.335+0000 7fd0c9fa8740 10 client.16392 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.335+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/3095383646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a505e28800 con 0x55a505a67070 2024-09-21T05:58:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.335+0000 7fd0a4ff9640 1 -- 172.21.15.7:0/3095383646 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0b80043c0 con 0x55a505a67070 2024-09-21T05:58:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.335+0000 7fd0a4ff9640 1 -- 172.21.15.7:0/3095383646 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd0ac0257f0 con 0x55a505a67070 2024-09-21T05:58:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.335+0000 7fd0c9fa8740 10 client.16392 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.335+0000 7fd0c9fa8740 10 client.16392 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:58:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.335+0000 7fd0c9fa8740 20 client.16392 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.335+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/3095383646 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a505a259f0 0x55a505e2bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.335+0000 7fd0c9fa8740 4 client.16392 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:58:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.335+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/3095383646 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a505d86df0 con 0x55a505a259f0 2024-09-21T05:58:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.336+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/3095383646 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a505a259f0 0x55a505e2bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.336+0000 7fd0a4ff9640 10 client.16392 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:58:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.336+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/3095383646 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a505a259f0 0x55a505e2bc60 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=77b9336260d60506 server_cookie=145c1ae60463cf05 in_seq=0 out_seq=0 2024-09-21T05:58:03.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0a4ff9640 1 -- 172.21.15.7:0/3095383646 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a505d86df0 con 0x55a505a259f0 2024-09-21T05:58:03.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0a4ff9640 10 client.16392 handle_command_reply: tid=0 2024-09-21T05:58:03.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0c9fa8740 1 client.16392 shutdown 2024-09-21T05:58:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/3095383646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a67070 msgr2=0x55a505e25dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/3095383646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a67070 0x55a505e25dc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac005af0 tx=0x7fd0ac004730 comp rx=0 tx=0).stop 2024-09-21T05:58:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/3095383646 shutdown_connections 2024-09-21T05:58:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/3095383646 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a505a259f0 0x55a505e2bc60 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/3095383646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a67070 0x55a505e25dc0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/3095383646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a46390 0x55a505e19e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/3095383646 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 0x55a505e19930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/3095383646 >> 172.21.15.7:0/3095383646 conn(0x55a505a5b460 msgr2=0x55a505e11450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0a4ff9640 0 client.16392 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:58:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/3095383646 shutdown_connections 2024-09-21T05:58:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.337+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/3095383646 wait complete. 2024-09-21T05:58:03.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.338+0000 7fd0c9fa8740 20 client.16392 trim_cache size 0 max 16384 2024-09-21T05:58:03.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.351+0000 7fd0c9fa8740 1 Processor -- start 2024-09-21T05:58:03.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.351+0000 7fd0c9fa8740 1 -- start start 2024-09-21T05:58:03.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.351+0000 7fd0c9fa8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 0x55a505e1b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.351+0000 7fd0c9fa8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e0b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.351+0000 7fd0c9fa8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a67070 0x55a505e0bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.351+0000 7fd0c9fa8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc1b3f60 con 0x55a505a46390 2024-09-21T05:58:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.351+0000 7fd0c9fa8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc1b1830 con 0x55a505a3e1b0 2024-09-21T05:58:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.351+0000 7fd0c9fa8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc1af680 con 0x55a505a67070 2024-09-21T05:58:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0c17d0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e0b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0c17d0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e0b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51730/0 (socket says 172.21.15.7:51730) 2024-09-21T05:58:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0c17d0640 1 -- 172.21.15.7:0/136110781 learned_addr learned my addr 172.21.15.7:0/136110781 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0c0fcf640 1 --2- 172.21.15.7:0/136110781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 0x55a505e1b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0c0fcf640 1 --2- 172.21.15.7:0/136110781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a67070 0x55a505e0bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0c17d0640 1 -- 172.21.15.7:0/136110781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a67070 msgr2=0x55a505e0bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/136110781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a67070 0x55a505e0bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0c17d0640 1 -- 172.21.15.7:0/136110781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 msgr2=0x55a505e1b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:03.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/136110781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 0x55a505e1b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0c17d0640 1 -- 172.21.15.7:0/136110781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a505e1c070 con 0x55a505a46390 2024-09-21T05:58:03.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/136110781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e0b760 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8010d90 tx=0x7fd0b800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99091572629c331e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:03.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0a6ffd640 1 -- 172.21.15.7:0/136110781 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80053e0 con 0x55a505a46390 2024-09-21T05:58:03.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0a6ffd640 1 -- 172.21.15.7:0/136110781 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0b8005580 con 0x55a505a46390 2024-09-21T05:58:03.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.352+0000 7fd0a6ffd640 1 -- 172.21.15.7:0/136110781 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8011e00 con 0x55a505a46390 2024-09-21T05:58:03.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.353+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/136110781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 msgr2=0x55a505e0b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:03.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.353+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/136110781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e0b760 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8010d90 tx=0x7fd0b800b390 comp rx=0 tx=0).stop 2024-09-21T05:58:03.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.353+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/136110781 shutdown_connections 2024-09-21T05:58:03.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.353+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/136110781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e0b760 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.353+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/136110781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a67070 0x55a505e0bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.353+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/136110781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a3e1b0 0x55a505e1b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.353+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/136110781 >> 172.21.15.7:0/136110781 conn(0x55a505a5b460 msgr2=0x55a505e1ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.353+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/136110781 shutdown_connections 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.353+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/136110781 wait complete. 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.354+0000 7fd0c9fa8740 1 -- start start 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.354+0000 7fd0c9fa8740 1 Processor -- start 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.354+0000 7fd0c9fa8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a3e1b0 0x55a505e1ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.354+0000 7fd0c9fa8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e1e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.354+0000 7fd0c9fa8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a67070 0x55a505e1e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.354+0000 7fd0c9fa8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc1afcf0 con 0x55a505a46390 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.354+0000 7fd0c9fa8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc1b1160 con 0x55a505a67070 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.354+0000 7fd0c9fa8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc1b03c0 con 0x55a505a3e1b0 2024-09-21T05:58:03.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.354+0000 7fd0c9fa8740 10 client.0 _ll_register_callbacks cb 0x7fd0ac00ac90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.354+0000 7fd0c17d0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e1e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0c17d0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e1e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51738/0 (socket says 172.21.15.7:51738) 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0c17d0640 1 -- 172.21.15.7:0/1242919184 learned_addr learned my addr 172.21.15.7:0/1242919184 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0c0fcf640 1 --2- 172.21.15.7:0/1242919184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a3e1b0 0x55a505e1ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0c0fcf640 1 --2- 172.21.15.7:0/1242919184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a67070 0x55a505e1e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0c17d0640 1 -- 172.21.15.7:0/1242919184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a3e1b0 msgr2=0x55a505e1ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/1242919184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a3e1b0 0x55a505e1ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0c17d0640 1 -- 172.21.15.7:0/1242919184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a67070 msgr2=0x55a505e1e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/1242919184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a67070 0x55a505e1e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0c17d0640 1 -- 172.21.15.7:0/1242919184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a505e95780 con 0x55a505a46390 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0c17d0640 1 --2- 172.21.15.7:0/1242919184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e1e310 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80119e0 tx=0x7fd0b800bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73661ada9b6bd5c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0a4ff9640 1 -- 172.21.15.7:0/1242919184 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8037070 con 0x55a505a46390 2024-09-21T05:58:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0a4ff9640 1 -- 172.21.15.7:0/1242919184 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fd0b80115c0 con 0x55a505a46390 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.355+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/1242919184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0b8005580 con 0x55a505a46390 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.356+0000 7fd0a4ff9640 1 -- 172.21.15.7:0/1242919184 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd0b8042050 con 0x55a505a46390 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.356+0000 7fd0c9fa8740 10 client.16398 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.356+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/1242919184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a505e96a00 con 0x55a505a46390 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.356+0000 7fd0a4ff9640 1 -- 172.21.15.7:0/1242919184 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0b8005580 con 0x55a505a46390 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.356+0000 7fd0a4ff9640 1 -- 172.21.15.7:0/1242919184 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd0b802d020 con 0x55a505a46390 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.356+0000 7fd0c9fa8740 10 client.16398 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.356+0000 7fd0c9fa8740 10 client.16398 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.356+0000 7fd0c9fa8740 20 client.16398 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.356+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/1242919184 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a5059fada0 0x55a505e98f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.356+0000 7fd0c9fa8740 4 client.16398 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.356+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/1242919184 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a505d828a0 con 0x55a5059fada0 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.356+0000 7fd0c0fcf640 1 --2- 172.21.15.7:0/1242919184 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a5059fada0 0x55a505e98f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:03.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0c0fcf640 1 --2- 172.21.15.7:0/1242919184 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a5059fada0 0x55a505e98f40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d3f780a46c62c6f7 server_cookie=de4d76b56626a57b in_seq=0 out_seq=0 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0a4ff9640 10 client.16398 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0a4ff9640 1 -- 172.21.15.7:0/1242919184 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a505d828a0 con 0x55a5059fada0 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0a4ff9640 10 client.16398 handle_command_reply: tid=0 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0c9fa8740 1 client.16398 shutdown 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/1242919184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 msgr2=0x55a505e1e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/1242919184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e1e310 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80119e0 tx=0x7fd0b800bee0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/1242919184 shutdown_connections 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/1242919184 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a5059fada0 0x55a505e98f40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/1242919184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a505a46390 0x55a505e1e310 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/1242919184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a505a67070 0x55a505e1e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0c9fa8740 1 --2- 172.21.15.7:0/1242919184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a505a3e1b0 0x55a505e1ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/1242919184 >> 172.21.15.7:0/1242919184 conn(0x55a505a5b460 msgr2=0x55a505e1ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.357+0000 7fd0a4ff9640 0 client.16398 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.358+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/1242919184 shutdown_connections 2024-09-21T05:58:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.358+0000 7fd0c9fa8740 1 -- 172.21.15.7:0/1242919184 wait complete. 2024-09-21T05:58:03.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.358+0000 7fd0c9fa8740 20 client.16398 trim_cache size 0 max 16384 2024-09-21T05:58:03.365 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:58:03.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.358+0000 7fd0c3a34640 1 -- 172.21.15.7:0/3205280562 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd0a80b6700 msgr2=0x7fd0a80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:03.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.358+0000 7fd0c3a34640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd0a80b6700 0x7fd0a80b8c10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40ce0a0 tx=0x7fd0b4043750 comp rx=0 tx=0).stop 2024-09-21T05:58:03.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.358+0000 7fd0c3a34640 1 -- 172.21.15.7:0/3205280562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0bc110200 msgr2=0x7fd0bc1a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:03.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.358+0000 7fd0c3a34640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0bc110200 0x7fd0bc1a1e50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd0b402ae70 tx=0x7fd0b402f5d0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.358+0000 7fd0c3a34640 1 -- 172.21.15.7:0/3205280562 shutdown_connections 2024-09-21T05:58:03.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.358+0000 7fd0c3a34640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd0a80b6700 0x7fd0a80b8c10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.358+0000 7fd0c3a34640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0bc110200 0x7fd0bc1a1e50 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.358+0000 7fd0c3a34640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0bc102fa0 0x7fd0bc19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.358+0000 7fd0c3a34640 1 --2- 172.21.15.7:0/3205280562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0bc102650 0x7fd0bc19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:03.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.358+0000 7fd0c3a34640 1 -- 172.21.15.7:0/3205280562 >> 172.21.15.7:0/3205280562 conn(0x7fd0bc079760 msgr2=0x7fd0bc109da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:03.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.359+0000 7fd0c3a34640 1 -- 172.21.15.7:0/3205280562 shutdown_connections 2024-09-21T05:58:03.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:03.359+0000 7fd0c3a34640 1 -- 172.21.15.7:0/3205280562 wait complete. 2024-09-21T05:58:03.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T05:58:03.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:03 smithi007 ceph-mon[30983]: pgmap v443: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T05:58:03.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:03 smithi027 ceph-mon[34364]: pgmap v443: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T05:58:04.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:03 smithi119 ceph-mon[34833]: pgmap v443: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T05:58:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:04.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.708+0000 7effee033640 1 -- 172.21.15.7:0/111009962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe81094a0 msgr2=0x7effe81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:04.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.708+0000 7effee033640 1 --2- 172.21.15.7:0/111009962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe81094a0 0x7effe81098b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7effdc009900 tx=0x7effdc02a410 comp rx=0 tx=0).stop 2024-09-21T05:58:04.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.708+0000 7effee033640 1 -- 172.21.15.7:0/111009962 shutdown_connections 2024-09-21T05:58:04.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.708+0000 7effee033640 1 --2- 172.21.15.7:0/111009962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe81094a0 0x7effe81098b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.708+0000 7effee033640 1 --2- 172.21.15.7:0/111009962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe8109df0 0x7effe8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.708+0000 7effee033640 1 --2- 172.21.15.7:0/111009962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe8103b60 0x7effe8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.708+0000 7effee033640 1 -- 172.21.15.7:0/111009962 >> 172.21.15.7:0/111009962 conn(0x7effe807b850 msgr2=0x7effe807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:04.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.708+0000 7effee033640 1 -- 172.21.15.7:0/111009962 shutdown_connections 2024-09-21T05:58:04.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.708+0000 7effee033640 1 -- 172.21.15.7:0/111009962 wait complete. 2024-09-21T05:58:04.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.709+0000 7effee033640 1 Processor -- start 2024-09-21T05:58:04.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.709+0000 7effee033640 1 -- start start 2024-09-21T05:58:04.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.709+0000 7effee033640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe8103b60 0x7effe8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.709+0000 7effee033640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe81094a0 0x7effe8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.709+0000 7effee033640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe8109df0 0x7effe8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.709+0000 7effee033640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7effe8113ab0 con 0x7effe8103b60 2024-09-21T05:58:04.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.709+0000 7effee033640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7effe8113930 con 0x7effe81094a0 2024-09-21T05:58:04.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.709+0000 7effee033640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7effe8113c30 con 0x7effe8109df0 2024-09-21T05:58:04.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.709+0000 7effe77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe8103b60 0x7effe8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.709+0000 7effe77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe8103b60 0x7effe8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51764/0 (socket says 172.21.15.7:51764) 2024-09-21T05:58:04.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.709+0000 7effe77fe640 1 -- 172.21.15.7:0/3323907779 learned_addr learned my addr 172.21.15.7:0/3323907779 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:04.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.709+0000 7effe6ffd640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe81094a0 0x7effe8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.709+0000 7effe7fff640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe8109df0 0x7effe8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.710+0000 7effe77fe640 1 -- 172.21.15.7:0/3323907779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe8109df0 msgr2=0x7effe8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:04.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.710+0000 7effe77fe640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe8109df0 0x7effe8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.710+0000 7effe77fe640 1 -- 172.21.15.7:0/3323907779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe81094a0 msgr2=0x7effe8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:04.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.710+0000 7effe77fe640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe81094a0 0x7effe8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.710+0000 7effe77fe640 1 -- 172.21.15.7:0/3323907779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe81a8740 con 0x7effe8103b60 2024-09-21T05:58:04.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.710+0000 7effe6ffd640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe81094a0 0x7effe8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:58:04.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.710+0000 7effe77fe640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe8103b60 0x7effe8075710 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7effd800e9f0 tx=0x7effd800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:04.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.710+0000 7effe4ff9640 1 -- 172.21.15.7:0/3323907779 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd800cd80 con 0x7effe8103b60 2024-09-21T05:58:04.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.710+0000 7effe4ff9640 1 -- 172.21.15.7:0/3323907779 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effd80108e0 con 0x7effe8103b60 2024-09-21T05:58:04.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.710+0000 7effee033640 1 -- 172.21.15.7:0/3323907779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe81a8a30 con 0x7effe8103b60 2024-09-21T05:58:04.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.710+0000 7effe4ff9640 1 -- 172.21.15.7:0/3323907779 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8018980 con 0x7effe8103b60 2024-09-21T05:58:04.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.710+0000 7effee033640 1 -- 172.21.15.7:0/3323907779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe81a8f90 con 0x7effe8103b60 2024-09-21T05:58:04.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7efff45a7740 1 Processor -- start 2024-09-21T05:58:04.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7efff45a7740 1 -- start start 2024-09-21T05:58:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7effe4ff9640 1 -- 172.21.15.7:0/3323907779 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7effd8010430 con 0x7effe8103b60 2024-09-21T05:58:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7efff45a7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d533070 0x55f01d8da2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7efff45a7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 0x55f01d8da800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7efff45a7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 0x55f01d8dad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7efff45a7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f01d850ea0 con 0x55f01d533070 2024-09-21T05:58:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7efff45a7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f01d8402d0 con 0x55f01d50a1b0 2024-09-21T05:58:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7efff45a7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f01d8440e0 con 0x55f01d512390 2024-09-21T05:58:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7effe7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d533070 0x55f01d8da2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7effe77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 0x55f01d8da800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7effe7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d533070 0x55f01d8da2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51780/0 (socket says 172.21.15.7:51780) 2024-09-21T05:58:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7effe7fff640 1 -- 172.21.15.7:0/2287497102 learned_addr learned my addr 172.21.15.7:0/2287497102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.713+0000 7effe6ffd640 1 --2- 172.21.15.7:0/2287497102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 0x55f01d8dad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.714+0000 7effe7fff640 1 -- 172.21.15.7:0/2287497102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 msgr2=0x55f01d8dad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:04.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.714+0000 7effe7fff640 1 --2- 172.21.15.7:0/2287497102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 0x55f01d8dad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.714+0000 7effe7fff640 1 -- 172.21.15.7:0/2287497102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 msgr2=0x55f01d8da800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:04.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.714+0000 7effe7fff640 1 --2- 172.21.15.7:0/2287497102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 0x55f01d8da800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.714+0000 7effe7fff640 1 -- 172.21.15.7:0/2287497102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f01d59e650 con 0x55f01d533070 2024-09-21T05:58:04.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.714+0000 7effe77fe640 1 --2- 172.21.15.7:0/2287497102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 0x55f01d8da800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:58:04.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.714+0000 7effe4ff9640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7effd00b6700 0x7effd00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.714+0000 7effe7fff640 1 --2- 172.21.15.7:0/2287497102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d533070 0x55f01d8da2c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7effe0009fd0 tx=0x7effe00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df146819ed2edad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:04.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.714+0000 7effe77fe640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7effd00b6700 0x7effd00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.714+0000 7effe4ff9640 1 -- 172.21.15.7:0/3323907779 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7effd80e7950 con 0x7effe8103b60 2024-09-21T05:58:04.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.714+0000 7effcdffb640 1 -- 172.21.15.7:0/2287497102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0004d20 con 0x55f01d533070 2024-09-21T05:58:04.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.714+0000 7effcdffb640 1 -- 172.21.15.7:0/2287497102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe0004050 con 0x55f01d533070 2024-09-21T05:58:04.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.714+0000 7effcdffb640 1 -- 172.21.15.7:0/2287497102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0005280 con 0x55f01d533070 2024-09-21T05:58:04.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.715+0000 7efff45a7740 1 -- 172.21.15.7:0/2287497102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d533070 msgr2=0x55f01d8da2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:04.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.715+0000 7effe77fe640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7effd00b6700 0x7effd00b8c10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7effd80e51d0 tx=0x7effd80ed550 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:04.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.715+0000 7efff45a7740 1 --2- 172.21.15.7:0/2287497102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d533070 0x55f01d8da2c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7effe0009fd0 tx=0x7effe00118d0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.715+0000 7efff45a7740 1 -- 172.21.15.7:0/2287497102 shutdown_connections 2024-09-21T05:58:04.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.715+0000 7efff45a7740 1 --2- 172.21.15.7:0/2287497102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 0x55f01d8dad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.715+0000 7efff45a7740 1 --2- 172.21.15.7:0/2287497102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 0x55f01d8da800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.715+0000 7efff45a7740 1 --2- 172.21.15.7:0/2287497102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d533070 0x55f01d8da2c0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.715+0000 7efff45a7740 1 -- 172.21.15.7:0/2287497102 >> 172.21.15.7:0/2287497102 conn(0x55f01d527460 msgr2=0x55f01d8d81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.715+0000 7efff45a7740 1 -- 172.21.15.7:0/2287497102 shutdown_connections 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.715+0000 7efff45a7740 1 -- 172.21.15.7:0/2287497102 wait complete. 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.716+0000 7efff45a7740 1 -- start start 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.716+0000 7efff45a7740 1 Processor -- start 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.716+0000 7efff45a7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 0x55f01d8e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.716+0000 7efff45a7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d512390 0x55f01d8e5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.716+0000 7efff45a7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d533070 0x55f01d8f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.716+0000 7efff45a7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f01d6a1700 con 0x55f01d512390 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.716+0000 7efff45a7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f01d7db160 con 0x55f01d50a1b0 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.716+0000 7efff45a7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f01d8e8aa0 con 0x55f01d533070 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.716+0000 7efff45a7740 10 client.0 _ll_register_callbacks cb 0x55f01d7f49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.717+0000 7effe6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d512390 0x55f01d8e5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.717+0000 7effe6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d512390 0x55f01d8e5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51792/0 (socket says 172.21.15.7:51792) 2024-09-21T05:58:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.717+0000 7effe6ffd640 1 -- 172.21.15.7:0/1047279536 learned_addr learned my addr 172.21.15.7:0/1047279536 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.717+0000 7effe7fff640 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 0x55f01d8e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.717+0000 7effe7fff640 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d533070 0x55f01d8f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.717+0000 7effe6ffd640 1 -- 172.21.15.7:0/1047279536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d533070 msgr2=0x55f01d8f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.717+0000 7effe6ffd640 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d533070 0x55f01d8f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.717+0000 7effe6ffd640 1 -- 172.21.15.7:0/1047279536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 msgr2=0x55f01d8e5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.717+0000 7effe6ffd640 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 0x55f01d8e5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.717+0000 7effe6ffd640 1 -- 172.21.15.7:0/1047279536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f01d808c90 con 0x55f01d512390 2024-09-21T05:58:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.717+0000 7effe7fff640 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d533070 0x55f01d8f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:58:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.717+0000 7effe6ffd640 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d512390 0x55f01d8e5f90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7effdc009900 tx=0x7effdc0316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2944c4f11ea8ee4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.717+0000 7effc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:04.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.720+0000 7effc6ffd640 1 -- 172.21.15.7:0/1047279536 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc035040 con 0x55f01d512390 2024-09-21T05:58:04.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.720+0000 7effc6ffd640 1 -- 172.21.15.7:0/1047279536 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7effdc004240 con 0x55f01d512390 2024-09-21T05:58:04.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.720+0000 7efff45a7740 1 -- 172.21.15.7:0/1047279536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effe0004050 con 0x55f01d512390 2024-09-21T05:58:04.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.720+0000 7effc6ffd640 1 -- 172.21.15.7:0/1047279536 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7effdc031900 con 0x55f01d512390 2024-09-21T05:58:04.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.720+0000 7efff45a7740 10 client.16410 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:04.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.720+0000 7efff45a7740 1 -- 172.21.15.7:0/1047279536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f01d8f4830 con 0x55f01d512390 2024-09-21T05:58:04.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.721+0000 7effc6ffd640 1 -- 172.21.15.7:0/1047279536 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe0004050 con 0x55f01d512390 2024-09-21T05:58:04.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.721+0000 7effc6ffd640 1 -- 172.21.15.7:0/1047279536 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7effdc004ad0 con 0x55f01d512390 2024-09-21T05:58:04.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.721+0000 7efff45a7740 10 client.16410 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:04.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.721+0000 7efff45a7740 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:04.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.721+0000 7efff45a7740 20 client.16410 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:04.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.721+0000 7efff45a7740 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f01d4f19f0 0x55f01d8f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.721+0000 7efff45a7740 4 client.16410 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:58:04.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.721+0000 7efff45a7740 1 -- 172.21.15.7:0/1047279536 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f01d852df0 con 0x55f01d4f19f0 2024-09-21T05:58:04.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.721+0000 7effe7fff640 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f01d4f19f0 0x55f01d8f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.722+0000 7effe7fff640 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f01d4f19f0 0x55f01d8f7c70 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=731447a12485d5d3 server_cookie=d50530a13b661e2e in_seq=0 out_seq=0 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.722+0000 7effc6ffd640 10 client.16410 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.722+0000 7effc6ffd640 1 -- 172.21.15.7:0/1047279536 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f01d852df0 con 0x55f01d4f19f0 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.722+0000 7effc6ffd640 10 client.16410 handle_command_reply: tid=0 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.722+0000 7efff45a7740 1 client.16410 shutdown 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.723+0000 7efff45a7740 1 -- 172.21.15.7:0/1047279536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d512390 msgr2=0x55f01d8e5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.723+0000 7efff45a7740 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d512390 0x55f01d8e5f90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7effdc009900 tx=0x7effdc0316d0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.723+0000 7efff45a7740 1 -- 172.21.15.7:0/1047279536 shutdown_connections 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.723+0000 7efff45a7740 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f01d4f19f0 0x55f01d8f7c70 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.723+0000 7efff45a7740 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d512390 0x55f01d8e5f90 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.723+0000 7efff45a7740 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d533070 0x55f01d8f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.723+0000 7effc6ffd640 0 client.16410 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.723+0000 7efff45a7740 1 --2- 172.21.15.7:0/1047279536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 0x55f01d8e5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.723+0000 7efff45a7740 1 -- 172.21.15.7:0/1047279536 >> 172.21.15.7:0/1047279536 conn(0x55f01d527460 msgr2=0x55f01d8dd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:04.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.723+0000 7efff45a7740 1 -- 172.21.15.7:0/1047279536 shutdown_connections 2024-09-21T05:58:04.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.723+0000 7efff45a7740 1 -- 172.21.15.7:0/1047279536 wait complete. 2024-09-21T05:58:04.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.723+0000 7efff45a7740 20 client.16410 trim_cache size 0 max 16384 2024-09-21T05:58:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.736+0000 7efff45a7740 1 Processor -- start 2024-09-21T05:58:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.736+0000 7efff45a7740 1 -- start start 2024-09-21T05:58:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7efff45a7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d4f19f0 0x55f01d8e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7efff45a7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 0x55f01d8dd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7efff45a7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 0x55f01d8dd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7efff45a7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7effe81b4040 con 0x55f01d4f19f0 2024-09-21T05:58:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7efff45a7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7effe81b1910 con 0x55f01d50a1b0 2024-09-21T05:58:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7efff45a7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7effe81af760 con 0x55f01d512390 2024-09-21T05:58:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7effe7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d4f19f0 0x55f01d8e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7effe7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d4f19f0 0x55f01d8e5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51802/0 (socket says 172.21.15.7:51802) 2024-09-21T05:58:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7effe7fff640 1 -- 172.21.15.7:0/3541351705 learned_addr learned my addr 172.21.15.7:0/3541351705 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7effe6ffd640 1 --2- 172.21.15.7:0/3541351705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 0x55f01d8dd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7effe7fff640 1 -- 172.21.15.7:0/3541351705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 msgr2=0x55f01d8dd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7effe7fff640 1 --2- 172.21.15.7:0/3541351705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 0x55f01d8dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7effe7fff640 1 -- 172.21.15.7:0/3541351705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 msgr2=0x55f01d8dd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7effe7fff640 1 --2- 172.21.15.7:0/3541351705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 0x55f01d8dd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7effe7fff640 1 -- 172.21.15.7:0/3541351705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f01d8dc8a0 con 0x55f01d4f19f0 2024-09-21T05:58:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7effe7fff640 1 --2- 172.21.15.7:0/3541351705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d4f19f0 0x55f01d8e5f10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7effe0014040 tx=0x7effe00048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e0cc0adb65fade server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.737+0000 7effcd7fa640 1 -- 172.21.15.7:0/3541351705 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0004940 con 0x55f01d4f19f0 2024-09-21T05:58:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.738+0000 7effcd7fa640 1 -- 172.21.15.7:0/3541351705 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe0033070 con 0x55f01d4f19f0 2024-09-21T05:58:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.738+0000 7effcd7fa640 1 -- 172.21.15.7:0/3541351705 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0004700 con 0x55f01d4f19f0 2024-09-21T05:58:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.738+0000 7efff45a7740 1 -- 172.21.15.7:0/3541351705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d4f19f0 msgr2=0x55f01d8e5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.738+0000 7efff45a7740 1 --2- 172.21.15.7:0/3541351705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d4f19f0 0x55f01d8e5f10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7effe0014040 tx=0x7effe00048d0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.738+0000 7efff45a7740 1 -- 172.21.15.7:0/3541351705 shutdown_connections 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.738+0000 7efff45a7740 1 --2- 172.21.15.7:0/3541351705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 0x55f01d8dd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.738+0000 7efff45a7740 1 --2- 172.21.15.7:0/3541351705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d50a1b0 0x55f01d8dd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.738+0000 7efff45a7740 1 --2- 172.21.15.7:0/3541351705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d4f19f0 0x55f01d8e5f10 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.738+0000 7efff45a7740 1 -- 172.21.15.7:0/3541351705 >> 172.21.15.7:0/3541351705 conn(0x55f01d527460 msgr2=0x55f01d8e5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.738+0000 7efff45a7740 1 -- 172.21.15.7:0/3541351705 shutdown_connections 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.738+0000 7efff45a7740 1 -- 172.21.15.7:0/3541351705 wait complete. 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.739+0000 7efff45a7740 1 -- start start 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.739+0000 7efff45a7740 1 Processor -- start 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.739+0000 7efff45a7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d4f19f0 0x55f01d8e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.739+0000 7efff45a7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d50a1b0 0x55f01d8ea220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.739+0000 7efff45a7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 0x55f01d8ea760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.739+0000 7efff45a7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7effe81afdd0 con 0x55f01d50a1b0 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.739+0000 7efff45a7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7effe81b1240 con 0x55f01d4f19f0 2024-09-21T05:58:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.739+0000 7efff45a7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7effe81b04a0 con 0x55f01d512390 2024-09-21T05:58:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.739+0000 7efff45a7740 10 client.0 _ll_register_callbacks cb 0x7effdc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.739+0000 7effe6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d50a1b0 0x55f01d8ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effe6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d50a1b0 0x55f01d8ea220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51812/0 (socket says 172.21.15.7:51812) 2024-09-21T05:58:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effe7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d4f19f0 0x55f01d8e9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effe6ffd640 1 -- 172.21.15.7:0/396250278 learned_addr learned my addr 172.21.15.7:0/396250278 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effe7fff640 1 --2- 172.21.15.7:0/396250278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 0x55f01d8ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effe6ffd640 1 -- 172.21.15.7:0/396250278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 msgr2=0x55f01d8ea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effe6ffd640 1 --2- 172.21.15.7:0/396250278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 0x55f01d8ea760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effe6ffd640 1 -- 172.21.15.7:0/396250278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d4f19f0 msgr2=0x55f01d8e9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effe6ffd640 1 --2- 172.21.15.7:0/396250278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d4f19f0 0x55f01d8e9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effe6ffd640 1 -- 172.21.15.7:0/396250278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f01d9616c0 con 0x55f01d50a1b0 2024-09-21T05:58:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effe7fff640 1 --2- 172.21.15.7:0/396250278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 0x55f01d8ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:58:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effe6ffd640 1 --2- 172.21.15.7:0/396250278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d50a1b0 0x55f01d8ea220 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7effdc02a450 tx=0x7effdc003770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5dd562175122aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effc6ffd640 1 -- 172.21.15.7:0/396250278 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc035070 con 0x55f01d50a1b0 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7effc6ffd640 1 -- 172.21.15.7:0/396250278 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7effdc004b80 con 0x55f01d50a1b0 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.740+0000 7efff45a7740 1 -- 172.21.15.7:0/396250278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effe0033070 con 0x55f01d50a1b0 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.741+0000 7effc6ffd640 1 -- 172.21.15.7:0/396250278 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7effdc004fa0 con 0x55f01d50a1b0 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.741+0000 7efff45a7740 10 client.16416 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.741+0000 7efff45a7740 1 -- 172.21.15.7:0/396250278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f01d9628b0 con 0x55f01d50a1b0 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.741+0000 7effc6ffd640 1 -- 172.21.15.7:0/396250278 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe0033070 con 0x55f01d50a1b0 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.741+0000 7effc6ffd640 1 -- 172.21.15.7:0/396250278 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7effdc046980 con 0x55f01d50a1b0 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.741+0000 7efff45a7740 10 client.16416 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.741+0000 7efff45a7740 10 client.16416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.741+0000 7efff45a7740 20 client.16416 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.741+0000 7efff45a7740 1 --2- 172.21.15.7:0/396250278 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f01d533070 0x55f01d964ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.741+0000 7efff45a7740 4 client.16416 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.741+0000 7efff45a7740 1 -- 172.21.15.7:0/396250278 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f01d84e8a0 con 0x55f01d533070 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.741+0000 7effe7fff640 1 --2- 172.21.15.7:0/396250278 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f01d533070 0x55f01d964ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7effe7fff640 1 --2- 172.21.15.7:0/396250278 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f01d533070 0x55f01d964ff0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b669c848dc1bb9e server_cookie=a6112caf4ad72f1e in_seq=0 out_seq=0 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7effc6ffd640 10 client.16416 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7effc6ffd640 1 -- 172.21.15.7:0/396250278 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f01d84e8a0 con 0x55f01d533070 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7effc6ffd640 10 client.16416 handle_command_reply: tid=0 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7efff45a7740 1 client.16416 shutdown 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7efff45a7740 1 -- 172.21.15.7:0/396250278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d50a1b0 msgr2=0x55f01d8ea220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7efff45a7740 1 --2- 172.21.15.7:0/396250278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d50a1b0 0x55f01d8ea220 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7effdc02a450 tx=0x7effdc003770 comp rx=0 tx=0).stop 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7efff45a7740 1 -- 172.21.15.7:0/396250278 shutdown_connections 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7efff45a7740 1 --2- 172.21.15.7:0/396250278 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f01d533070 0x55f01d964ff0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7effc6ffd640 0 client.16416 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7efff45a7740 1 --2- 172.21.15.7:0/396250278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f01d50a1b0 0x55f01d8ea220 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7efff45a7740 1 --2- 172.21.15.7:0/396250278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f01d512390 0x55f01d8ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7efff45a7740 1 --2- 172.21.15.7:0/396250278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f01d4f19f0 0x55f01d8e9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7efff45a7740 1 -- 172.21.15.7:0/396250278 >> 172.21.15.7:0/396250278 conn(0x55f01d527460 msgr2=0x55f01d8e6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7efff45a7740 1 -- 172.21.15.7:0/396250278 shutdown_connections 2024-09-21T05:58:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7efff45a7740 1 -- 172.21.15.7:0/396250278 wait complete. 2024-09-21T05:58:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.742+0000 7efff45a7740 20 client.16416 trim_cache size 0 max 16384 2024-09-21T05:58:04.749 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:58:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.743+0000 7effee033640 1 -- 172.21.15.7:0/3323907779 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7effd00b6700 msgr2=0x7effd00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.743+0000 7effee033640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7effd00b6700 0x7effd00b8c10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7effd80e51d0 tx=0x7effd80ed550 comp rx=0 tx=0).stop 2024-09-21T05:58:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.743+0000 7effee033640 1 -- 172.21.15.7:0/3323907779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe8103b60 msgr2=0x7effe8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.743+0000 7effee033640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe8103b60 0x7effe8075710 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7effd800e9f0 tx=0x7effd800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.743+0000 7effee033640 1 -- 172.21.15.7:0/3323907779 shutdown_connections 2024-09-21T05:58:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.743+0000 7effee033640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7effd00b6700 0x7effd00b8c10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.743+0000 7effee033640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effe8109df0 0x7effe8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.743+0000 7effee033640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe81094a0 0x7effe8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.743+0000 7effee033640 1 --2- 172.21.15.7:0/3323907779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe8103b60 0x7effe8075710 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.743+0000 7effee033640 1 -- 172.21.15.7:0/3323907779 >> 172.21.15.7:0/3323907779 conn(0x7effe807b850 msgr2=0x7effe8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.743+0000 7effee033640 1 -- 172.21.15.7:0/3323907779 shutdown_connections 2024-09-21T05:58:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:04.743+0000 7effee033640 1 -- 172.21.15.7:0/3323907779 wait complete. 2024-09-21T05:58:05.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:05 smithi007 ceph-mon[30983]: pgmap v444: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 21 op/s 2024-09-21T05:58:05.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:05 smithi027 ceph-mon[34364]: pgmap v444: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 21 op/s 2024-09-21T05:58:06.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:05 smithi119 ceph-mon[34833]: pgmap v444: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 21 op/s 2024-09-21T05:58:06.544 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T05:58:06.544 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T05:58:06.820 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.311+0000 7f0d7cac8640 1 -- 172.21.15.7:0/3663615416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d78102a80 msgr2=0x7f0d78102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.311+0000 7f0d7cac8640 1 --2- 172.21.15.7:0/3663615416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d78102a80 0x7f0d78102e90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009900 tx=0x7f0d6802a410 comp rx=0 tx=0).stop 2024-09-21T05:58:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.311+0000 7f0d7cac8640 1 -- 172.21.15.7:0/3663615416 shutdown_connections 2024-09-21T05:58:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.311+0000 7f0d7cac8640 1 --2- 172.21.15.7:0/3663615416 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d78108d10 0x7f0d7810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.311+0000 7f0d7cac8640 1 --2- 172.21.15.7:0/3663615416 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d781083c0 0x7f0d781087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.311+0000 7f0d7cac8640 1 --2- 172.21.15.7:0/3663615416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d78102a80 0x7f0d78102e90 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.311+0000 7f0d7cac8640 1 -- 172.21.15.7:0/3663615416 >> 172.21.15.7:0/3663615416 conn(0x7f0d78079740 msgr2=0x7f0d78079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.311+0000 7f0d7cac8640 1 -- 172.21.15.7:0/3663615416 shutdown_connections 2024-09-21T05:58:07.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.311+0000 7f0d7cac8640 1 -- 172.21.15.7:0/3663615416 wait complete. 2024-09-21T05:58:07.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.312+0000 7f0d7cac8640 1 Processor -- start 2024-09-21T05:58:07.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.312+0000 7f0d7cac8640 1 -- start start 2024-09-21T05:58:07.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.312+0000 7f0d7cac8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d78102a80 0x7f0d7819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.312+0000 7f0d7cac8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d781083c0 0x7f0d7819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.312+0000 7f0d7cac8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d78108d10 0x7f0d7819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.312+0000 7f0d7cac8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78112980 con 0x7f0d781083c0 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.312+0000 7f0d7cac8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78112800 con 0x7f0d78102a80 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.312+0000 7f0d7cac8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78112b00 con 0x7f0d78108d10 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.312+0000 7f0d75d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d781083c0 0x7f0d7819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.312+0000 7f0d75d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d781083c0 0x7f0d7819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51844/0 (socket says 172.21.15.7:51844) 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.312+0000 7f0d75d9b640 1 -- 172.21.15.7:0/1536922997 learned_addr learned my addr 172.21.15.7:0/1536922997 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.312+0000 7f0d76d9d640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d78108d10 0x7f0d7819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.313+0000 7f0d7659c640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d78102a80 0x7f0d7819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.313+0000 7f0d75d9b640 1 -- 172.21.15.7:0/1536922997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d78108d10 msgr2=0x7f0d7819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.313+0000 7f0d75d9b640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d78108d10 0x7f0d7819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.313+0000 7f0d75d9b640 1 -- 172.21.15.7:0/1536922997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d78102a80 msgr2=0x7f0d7819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.313+0000 7f0d75d9b640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d78102a80 0x7f0d7819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.313+0000 7f0d75d9b640 1 -- 172.21.15.7:0/1536922997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d781a03f0 con 0x7f0d781083c0 2024-09-21T05:58:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.313+0000 7f0d75d9b640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d781083c0 0x7f0d7819aa20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00e9f0 tx=0x7f0d6c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.313+0000 7f0d677fe640 1 -- 172.21.15.7:0/1536922997 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00ccc0 con 0x7f0d781083c0 2024-09-21T05:58:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.313+0000 7f0d677fe640 1 -- 172.21.15.7:0/1536922997 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d6c0054d0 con 0x7f0d781083c0 2024-09-21T05:58:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.313+0000 7f0d677fe640 1 -- 172.21.15.7:0/1536922997 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c010430 con 0x7f0d781083c0 2024-09-21T05:58:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.313+0000 7f0d7cac8640 1 -- 172.21.15.7:0/1536922997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d781a06e0 con 0x7f0d781083c0 2024-09-21T05:58:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.313+0000 7f0d7cac8640 1 -- 172.21.15.7:0/1536922997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d781a6e40 con 0x7f0d781083c0 2024-09-21T05:58:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.316+0000 7f0d8303c740 1 Processor -- start 2024-09-21T05:58:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.316+0000 7f0d677fe640 1 -- 172.21.15.7:0/1536922997 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0d6c0046c0 con 0x7f0d781083c0 2024-09-21T05:58:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.316+0000 7f0d8303c740 1 -- start start 2024-09-21T05:58:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d8303c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d50350 0x55fb640f7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d8303c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d27490 0x55fb640f7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d8303c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 0x55fb640f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d8303c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fb6406de60 con 0x55fb63d27490 2024-09-21T05:58:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d8303c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55fb6405d290 con 0x55fb63d50350 2024-09-21T05:58:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d8303c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55fb640610a0 con 0x55fb63d2f670 2024-09-21T05:58:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d7659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d27490 0x55fb640f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d7659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d27490 0x55fb640f7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51852/0 (socket says 172.21.15.7:51852) 2024-09-21T05:58:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d7659c640 1 -- 172.21.15.7:0/4223442321 learned_addr learned my addr 172.21.15.7:0/4223442321 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d75d9b640 1 --2- 172.21.15.7:0/4223442321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 0x55fb640f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d76d9d640 1 --2- 172.21.15.7:0/4223442321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d50350 0x55fb640f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d7659c640 1 -- 172.21.15.7:0/4223442321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 msgr2=0x55fb640f7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:07.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d7659c640 1 --2- 172.21.15.7:0/4223442321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 0x55fb640f7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d7659c640 1 -- 172.21.15.7:0/4223442321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d50350 msgr2=0x55fb640f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d7659c640 1 --2- 172.21.15.7:0/4223442321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d50350 0x55fb640f7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d7659c640 1 -- 172.21.15.7:0/4223442321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb63dbb930 con 0x55fb63d27490 2024-09-21T05:58:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d75d9b640 1 --2- 172.21.15.7:0/4223442321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 0x55fb640f7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:58:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d677fe640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d600b6700 0x7f0d600b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.317+0000 7f0d7659c640 1 --2- 172.21.15.7:0/4223442321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d27490 0x55fb640f7970 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009900 tx=0x7f0d68032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7c338f3649b2cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.318+0000 7f0d76d9d640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d600b6700 0x7f0d600b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.318+0000 7f0d677fe640 1 -- 172.21.15.7:0/1536922997 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f0d6c0e7980 con 0x7f0d781083c0 2024-09-21T05:58:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.318+0000 7f0d64ff9640 1 -- 172.21.15.7:0/4223442321 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68040070 con 0x55fb63d27490 2024-09-21T05:58:07.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.318+0000 7f0d64ff9640 1 -- 172.21.15.7:0/4223442321 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d68004030 con 0x55fb63d27490 2024-09-21T05:58:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.318+0000 7f0d64ff9640 1 -- 172.21.15.7:0/4223442321 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68035040 con 0x55fb63d27490 2024-09-21T05:58:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.319+0000 7f0d8303c740 1 -- 172.21.15.7:0/4223442321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d27490 msgr2=0x55fb640f7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.319+0000 7f0d76d9d640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d600b6700 0x7f0d600b8c10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0d70005fd0 tx=0x7f0d70009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.319+0000 7f0d8303c740 1 --2- 172.21.15.7:0/4223442321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d27490 0x55fb640f7970 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009900 tx=0x7f0d68032c40 comp rx=0 tx=0).stop 2024-09-21T05:58:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.319+0000 7f0d8303c740 1 -- 172.21.15.7:0/4223442321 shutdown_connections 2024-09-21T05:58:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.319+0000 7f0d8303c740 1 --2- 172.21.15.7:0/4223442321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d27490 0x55fb640f7970 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.319+0000 7f0d8303c740 1 --2- 172.21.15.7:0/4223442321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 0x55fb640f7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.319+0000 7f0d8303c740 1 --2- 172.21.15.7:0/4223442321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d50350 0x55fb640f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.319+0000 7f0d8303c740 1 -- 172.21.15.7:0/4223442321 >> 172.21.15.7:0/4223442321 conn(0x55fb63d44740 msgr2=0x55fb640f5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.319+0000 7f0d8303c740 1 -- 172.21.15.7:0/4223442321 shutdown_connections 2024-09-21T05:58:07.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.319+0000 7f0d8303c740 1 -- 172.21.15.7:0/4223442321 wait complete. 2024-09-21T05:58:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.319+0000 7f0d8303c740 1 -- start start 2024-09-21T05:58:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.319+0000 7f0d8303c740 1 Processor -- start 2024-09-21T05:58:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d8303c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 0x55fb641073b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d8303c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 0x55fb641078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d8303c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 0x55fb641132c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d8303c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fb63ebe890 con 0x55fb63d50350 2024-09-21T05:58:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d8303c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55fb63ff7d40 con 0x55fb63d27490 2024-09-21T05:58:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d8303c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55fb64109f60 con 0x55fb63d2f670 2024-09-21T05:58:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d8303c740 10 client.0 _ll_register_callbacks cb 0x55fb6405bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d76d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 0x55fb641132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d76d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 0x55fb641132c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51858/0 (socket says 172.21.15.7:51858) 2024-09-21T05:58:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d76d9d640 1 -- 172.21.15.7:0/4196891021 learned_addr learned my addr 172.21.15.7:0/4196891021 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d75d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 0x55fb641078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d7659c640 1 --2- 172.21.15.7:0/4196891021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 0x55fb641073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d76d9d640 1 -- 172.21.15.7:0/4196891021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 msgr2=0x55fb641078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d76d9d640 1 --2- 172.21.15.7:0/4196891021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 0x55fb641078f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d76d9d640 1 -- 172.21.15.7:0/4196891021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 msgr2=0x55fb641073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d76d9d640 1 --2- 172.21.15.7:0/4196891021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 0x55fb641073b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.320+0000 7f0d76d9d640 1 -- 172.21.15.7:0/4196891021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb64113800 con 0x55fb63d50350 2024-09-21T05:58:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d76d9d640 1 --2- 172.21.15.7:0/4196891021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 0x55fb641132c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0d70005c40 tx=0x7f0d70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1fe2e8f05899c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d5dffb640 1 -- 172.21.15.7:0/4196891021 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70020620 con 0x55fb63d50350 2024-09-21T05:58:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d5dffb640 1 -- 172.21.15.7:0/4196891021 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f0d700207c0 con 0x55fb63d50350 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d8303c740 1 -- 172.21.15.7:0/4196891021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d68004030 con 0x55fb63d50350 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d5dffb640 1 -- 172.21.15.7:0/4196891021 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0d70020a00 con 0x55fb63d50350 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d8303c740 10 client.16428 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d8303c740 1 -- 172.21.15.7:0/4196891021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fb64116190 con 0x55fb63d50350 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d5dffb640 1 -- 172.21.15.7:0/4196891021 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d68004030 con 0x55fb63d50350 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d5dffb640 1 -- 172.21.15.7:0/4196891021 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0d7000f040 con 0x55fb63d50350 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d8303c740 10 client.16428 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d8303c740 10 client.16428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d8303c740 20 client.16428 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d8303c740 1 --2- 172.21.15.7:0/4196891021 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fb63d0ecd0 0x55fb64119830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d8303c740 4 client.16428 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.321+0000 7f0d8303c740 1 -- 172.21.15.7:0/4196891021 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb6406fdb0 con 0x55fb63d0ecd0 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.322+0000 7f0d7659c640 1 --2- 172.21.15.7:0/4196891021 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fb63d0ecd0 0x55fb64119830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.322+0000 7f0d5dffb640 10 client.16428 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.322+0000 7f0d7659c640 1 --2- 172.21.15.7:0/4196891021 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fb63d0ecd0 0x55fb64119830 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f01d7ed78072b93a server_cookie=a007560b8329732a in_seq=0 out_seq=0 2024-09-21T05:58:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d5dffb640 1 -- 172.21.15.7:0/4196891021 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb6406fdb0 con 0x55fb63d0ecd0 2024-09-21T05:58:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d5dffb640 10 client.16428 handle_command_reply: tid=0 2024-09-21T05:58:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d8303c740 1 client.16428 shutdown 2024-09-21T05:58:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d8303c740 1 -- 172.21.15.7:0/4196891021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 msgr2=0x55fb641132c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d8303c740 1 --2- 172.21.15.7:0/4196891021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 0x55fb641132c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0d70005c40 tx=0x7f0d70004a40 comp rx=0 tx=0).stop 2024-09-21T05:58:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d8303c740 1 -- 172.21.15.7:0/4196891021 shutdown_connections 2024-09-21T05:58:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d8303c740 1 --2- 172.21.15.7:0/4196891021 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fb63d0ecd0 0x55fb64119830 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d8303c740 1 --2- 172.21.15.7:0/4196891021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 0x55fb641132c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d8303c740 1 --2- 172.21.15.7:0/4196891021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 0x55fb641078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d8303c740 1 --2- 172.21.15.7:0/4196891021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 0x55fb641073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d8303c740 1 -- 172.21.15.7:0/4196891021 >> 172.21.15.7:0/4196891021 conn(0x55fb63d44740 msgr2=0x55fb640f8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d5dffb640 0 client.16428 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:07.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d8303c740 1 -- 172.21.15.7:0/4196891021 shutdown_connections 2024-09-21T05:58:07.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d8303c740 1 -- 172.21.15.7:0/4196891021 wait complete. 2024-09-21T05:58:07.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.323+0000 7f0d8303c740 20 client.16428 trim_cache size 0 max 16384 2024-09-21T05:58:07.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d8303c740 1 Processor -- start 2024-09-21T05:58:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d8303c740 1 -- start start 2024-09-21T05:58:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d8303c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 0x55fb64105a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d8303c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 0x55fb64105f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d8303c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 0x55fb640f4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d8303c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0d781afba0 con 0x55fb63d50350 2024-09-21T05:58:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d8303c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0d781ad470 con 0x55fb63d27490 2024-09-21T05:58:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d8303c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d781ab2c0 con 0x55fb63d2f670 2024-09-21T05:58:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d76d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 0x55fb640f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d76d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 0x55fb640f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51874/0 (socket says 172.21.15.7:51874) 2024-09-21T05:58:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d76d9d640 1 -- 172.21.15.7:0/108365910 learned_addr learned my addr 172.21.15.7:0/108365910 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d7659c640 1 --2- 172.21.15.7:0/108365910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 0x55fb64105a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d76d9d640 1 -- 172.21.15.7:0/108365910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 msgr2=0x55fb64105f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d76d9d640 1 --2- 172.21.15.7:0/108365910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 0x55fb64105f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d76d9d640 1 -- 172.21.15.7:0/108365910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 msgr2=0x55fb64105a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d76d9d640 1 --2- 172.21.15.7:0/108365910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 0x55fb64105a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d76d9d640 1 -- 172.21.15.7:0/108365910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb64107d70 con 0x55fb63d50350 2024-09-21T05:58:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.342+0000 7f0d7659c640 1 --2- 172.21.15.7:0/108365910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 0x55fb64105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.343+0000 7f0d76d9d640 1 --2- 172.21.15.7:0/108365910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 0x55fb640f4860 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009ec0 tx=0x7f0d70009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141b2b2e36f39d38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.343+0000 7f0d5ffff640 1 -- 172.21.15.7:0/108365910 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d700119b0 con 0x55fb63d50350 2024-09-21T05:58:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.343+0000 7f0d5ffff640 1 -- 172.21.15.7:0/108365910 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d7001fe80 con 0x55fb63d50350 2024-09-21T05:58:07.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.343+0000 7f0d5ffff640 1 -- 172.21.15.7:0/108365910 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d700328a0 con 0x55fb63d50350 2024-09-21T05:58:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.343+0000 7f0d8303c740 1 -- 172.21.15.7:0/108365910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 msgr2=0x55fb640f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.343+0000 7f0d8303c740 1 --2- 172.21.15.7:0/108365910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 0x55fb640f4860 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009ec0 tx=0x7f0d70009b30 comp rx=0 tx=0).stop 2024-09-21T05:58:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 -- 172.21.15.7:0/108365910 shutdown_connections 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 --2- 172.21.15.7:0/108365910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d50350 0x55fb640f4860 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 --2- 172.21.15.7:0/108365910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d2f670 0x55fb64105f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 --2- 172.21.15.7:0/108365910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 0x55fb64105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 -- 172.21.15.7:0/108365910 >> 172.21.15.7:0/108365910 conn(0x55fb63d44740 msgr2=0x55fb641022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 -- 172.21.15.7:0/108365910 shutdown_connections 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 -- 172.21.15.7:0/108365910 wait complete. 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 -- start start 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 Processor -- start 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 0x55fb6410f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d2f670 0x55fb6410bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d50350 0x55fb6410c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0d781ab930 con 0x55fb63d2f670 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0d781acda0 con 0x55fb63d27490 2024-09-21T05:58:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d781ac000 con 0x55fb63d50350 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.344+0000 7f0d8303c740 10 client.0 _ll_register_callbacks cb 0x7f0d70009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d75d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d2f670 0x55fb6410bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d75d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d2f670 0x55fb6410bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51880/0 (socket says 172.21.15.7:51880) 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d75d9b640 1 -- 172.21.15.7:0/1796412123 learned_addr learned my addr 172.21.15.7:0/1796412123 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d7659c640 1 --2- 172.21.15.7:0/1796412123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 0x55fb6410f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d76d9d640 1 --2- 172.21.15.7:0/1796412123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d50350 0x55fb6410c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d75d9b640 1 -- 172.21.15.7:0/1796412123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d50350 msgr2=0x55fb6410c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d75d9b640 1 --2- 172.21.15.7:0/1796412123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d50350 0x55fb6410c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d75d9b640 1 -- 172.21.15.7:0/1796412123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 msgr2=0x55fb6410f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d75d9b640 1 --2- 172.21.15.7:0/1796412123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 0x55fb6410f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d75d9b640 1 -- 172.21.15.7:0/1796412123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb6410c8a0 con 0x55fb63d2f670 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d75d9b640 1 --2- 172.21.15.7:0/1796412123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d2f670 0x55fb6410bd50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0e5750 tx=0x7f0d6c0b7120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86280ce5c62f7ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d5dffb640 1 -- 172.21.15.7:0/1796412123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0a96f0 con 0x55fb63d2f670 2024-09-21T05:58:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d5dffb640 1 -- 172.21.15.7:0/1796412123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f0d6c0a91a0 con 0x55fb63d2f670 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d8303c740 1 -- 172.21.15.7:0/1796412123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fb6406b860 con 0x55fb63d2f670 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d5dffb640 1 -- 172.21.15.7:0/1796412123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0d6c0acfc0 con 0x55fb63d2f670 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d8303c740 10 client.16434 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.345+0000 7f0d8303c740 1 -- 172.21.15.7:0/1796412123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fb64184f30 con 0x55fb63d2f670 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.346+0000 7f0d5dffb640 1 -- 172.21.15.7:0/1796412123 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fb6406b860 con 0x55fb63d2f670 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.346+0000 7f0d5dffb640 1 -- 172.21.15.7:0/1796412123 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0d6c0a93a0 con 0x55fb63d2f670 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.346+0000 7f0d8303c740 10 client.16434 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.346+0000 7f0d8303c740 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.346+0000 7f0d8303c740 20 client.16434 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.346+0000 7f0d8303c740 1 --2- 172.21.15.7:0/1796412123 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fb63ce4080 0x55fb64187710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.346+0000 7f0d8303c740 4 client.16434 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.346+0000 7f0d8303c740 1 -- 172.21.15.7:0/1796412123 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fb64068c90 con 0x55fb63ce4080 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.346+0000 7f0d7659c640 1 --2- 172.21.15.7:0/1796412123 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fb63ce4080 0x55fb64187710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:07.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.347+0000 7f0d5dffb640 10 client.16434 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:07.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.347+0000 7f0d7659c640 1 --2- 172.21.15.7:0/1796412123 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fb63ce4080 0x55fb64187710 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fddb6458a5d991c server_cookie=620a00437508092c in_seq=0 out_seq=0 2024-09-21T05:58:07.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.348+0000 7f0d5dffb640 1 -- 172.21.15.7:0/1796412123 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fb64068c90 con 0x55fb63ce4080 2024-09-21T05:58:07.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.348+0000 7f0d5dffb640 10 client.16434 handle_command_reply: tid=0 2024-09-21T05:58:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.348+0000 7f0d8303c740 1 client.16434 shutdown 2024-09-21T05:58:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.348+0000 7f0d8303c740 1 -- 172.21.15.7:0/1796412123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d2f670 msgr2=0x55fb6410bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.348+0000 7f0d8303c740 1 --2- 172.21.15.7:0/1796412123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d2f670 0x55fb6410bd50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0e5750 tx=0x7f0d6c0b7120 comp rx=0 tx=0).stop 2024-09-21T05:58:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.348+0000 7f0d8303c740 1 -- 172.21.15.7:0/1796412123 shutdown_connections 2024-09-21T05:58:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.348+0000 7f0d8303c740 1 --2- 172.21.15.7:0/1796412123 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fb63ce4080 0x55fb64187710 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.348+0000 7f0d8303c740 1 --2- 172.21.15.7:0/1796412123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb63d2f670 0x55fb6410bd50 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.348+0000 7f0d8303c740 1 --2- 172.21.15.7:0/1796412123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fb63d50350 0x55fb6410c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.348+0000 7f0d8303c740 1 --2- 172.21.15.7:0/1796412123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb63d27490 0x55fb6410f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.348+0000 7f0d8303c740 1 -- 172.21.15.7:0/1796412123 >> 172.21.15.7:0/1796412123 conn(0x55fb63d44740 msgr2=0x55fb641022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.348+0000 7f0d5dffb640 0 client.16434 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d8303c740 1 -- 172.21.15.7:0/1796412123 shutdown_connections 2024-09-21T05:58:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d8303c740 1 -- 172.21.15.7:0/1796412123 wait complete. 2024-09-21T05:58:07.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d8303c740 20 client.16434 trim_cache size 0 max 16384 2024-09-21T05:58:07.355 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:58:07.355 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T05:58:07.355 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "1c540995-232b-4bec-918f-a55f2761d274", 2024-09-21T05:58:07.355 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T05:58:07.355 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:58:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d7cac8640 1 -- 172.21.15.7:0/1536922997 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d600b6700 msgr2=0x7f0d600b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d7cac8640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d600b6700 0x7f0d600b8c10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0d70005fd0 tx=0x7f0d70009600 comp rx=0 tx=0).stop 2024-09-21T05:58:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d7cac8640 1 -- 172.21.15.7:0/1536922997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d781083c0 msgr2=0x7f0d7819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d7cac8640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d781083c0 0x7f0d7819aa20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00e9f0 tx=0x7f0d6c00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d7cac8640 1 -- 172.21.15.7:0/1536922997 shutdown_connections 2024-09-21T05:58:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d7cac8640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d600b6700 0x7f0d600b8c10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d7cac8640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d781083c0 0x7f0d7819aa20 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d7cac8640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d78108d10 0x7f0d7819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d7cac8640 1 --2- 172.21.15.7:0/1536922997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d78102a80 0x7f0d7819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:07.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d7cac8640 1 -- 172.21.15.7:0/1536922997 >> 172.21.15.7:0/1536922997 conn(0x7f0d78079740 msgr2=0x7f0d78101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:07.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.349+0000 7f0d7cac8640 1 -- 172.21.15.7:0/1536922997 shutdown_connections 2024-09-21T05:58:07.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:07.350+0000 7f0d7cac8640 1 -- 172.21.15.7:0/1536922997 wait complete. 2024-09-21T05:58:07.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:07 smithi027 ceph-mon[34364]: pgmap v445: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:58:08.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:07 smithi007 ceph-mon[30983]: pgmap v445: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:58:08.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:07 smithi119 ceph-mon[34833]: pgmap v445: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:58:08.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:58:08.389 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:08.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:08 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T05:58:08.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:08 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:58:08.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:08 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T05:58:08.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:08 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:58:08.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.859+0000 7f8d2a774640 1 -- 172.21.15.7:0/2679335613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d241083a0 msgr2=0x7f8d241087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.859+0000 7f8d2a774640 1 --2- 172.21.15.7:0/2679335613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d241083a0 0x7f8d241087b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009900 tx=0x7f8d0c02a410 comp rx=0 tx=0).stop 2024-09-21T05:58:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.859+0000 7f8d2a774640 1 -- 172.21.15.7:0/2679335613 shutdown_connections 2024-09-21T05:58:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.859+0000 7f8d2a774640 1 --2- 172.21.15.7:0/2679335613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d241083a0 0x7f8d241087b0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.859+0000 7f8d2a774640 1 --2- 172.21.15.7:0/2679335613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d24108cf0 0x7f8d2410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.859+0000 7f8d2a774640 1 --2- 172.21.15.7:0/2679335613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d24102a60 0x7f8d24102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.859+0000 7f8d2a774640 1 -- 172.21.15.7:0/2679335613 >> 172.21.15.7:0/2679335613 conn(0x7f8d24079730 msgr2=0x7f8d24079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.859+0000 7f8d2a774640 1 -- 172.21.15.7:0/2679335613 shutdown_connections 2024-09-21T05:58:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.859+0000 7f8d2a774640 1 -- 172.21.15.7:0/2679335613 wait complete. 2024-09-21T05:58:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.860+0000 7f8d2a774640 1 Processor -- start 2024-09-21T05:58:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.860+0000 7f8d2a774640 1 -- start start 2024-09-21T05:58:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d2a774640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d24102a60 0x7f8d2419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d2a774640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d241083a0 0x7f8d2419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d2a774640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d24108cf0 0x7f8d2419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d2a774640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8d24112960 con 0x7f8d241083a0 2024-09-21T05:58:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d2a774640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8d241127e0 con 0x7f8d24102a60 2024-09-21T05:58:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d2a774640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8d24112ae0 con 0x7f8d24108cf0 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d1bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d241083a0 0x7f8d2419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d1bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d241083a0 0x7f8d2419aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48404/0 (socket says 172.21.15.7:48404) 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d1bfff640 1 -- 172.21.15.7:0/1231450095 learned_addr learned my addr 172.21.15.7:0/1231450095 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d28d11640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d24108cf0 0x7f8d2419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d23fff640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d24102a60 0x7f8d2419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d1bfff640 1 -- 172.21.15.7:0/1231450095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d24108cf0 msgr2=0x7f8d2419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d1bfff640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d24108cf0 0x7f8d2419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d1bfff640 1 -- 172.21.15.7:0/1231450095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d24102a60 msgr2=0x7f8d2419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d1bfff640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d24102a60 0x7f8d2419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.861+0000 7f8d1bfff640 1 -- 172.21.15.7:0/1231450095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d241a03d0 con 0x7f8d241083a0 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.862+0000 7f8d1bfff640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d241083a0 0x7f8d2419aa00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c006010 tx=0x7f8d0c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.862+0000 7f8d21ffb640 1 -- 172.21.15.7:0/1231450095 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c03f030 con 0x7f8d241083a0 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.862+0000 7f8d21ffb640 1 -- 172.21.15.7:0/1231450095 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d0c003aa0 con 0x7f8d241083a0 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.862+0000 7f8d2a774640 1 -- 172.21.15.7:0/1231450095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d241a0660 con 0x7f8d241083a0 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.862+0000 7f8d21ffb640 1 -- 172.21.15.7:0/1231450095 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c035070 con 0x7f8d241083a0 2024-09-21T05:58:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.862+0000 7f8d2a774640 1 -- 172.21.15.7:0/1231450095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d241a6e20 con 0x7f8d241083a0 2024-09-21T05:58:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.864+0000 7f8d30ce8740 1 Processor -- start 2024-09-21T05:58:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d30ce8740 1 -- start start 2024-09-21T05:58:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d21ffb640 1 -- 172.21.15.7:0/1231450095 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8d0c042030 con 0x7f8d241083a0 2024-09-21T05:58:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d30ce8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4ebb8070 0x563f4ef5f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d30ce8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb8f1b0 0x563f4ef5fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d30ce8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb97390 0x563f4ef600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d30ce8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563f4eed5e50 con 0x563f4eb8f1b0 2024-09-21T05:58:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d30ce8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x563f4eec5280 con 0x563f4eb97390 2024-09-21T05:58:08.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d30ce8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563f4eec9090 con 0x563f4ebb8070 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb8f1b0 0x563f4ef5fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb8f1b0 0x563f4ef5fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48408/0 (socket says 172.21.15.7:48408) 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d23fff640 1 -- 172.21.15.7:0/2049787584 learned_addr learned my addr 172.21.15.7:0/2049787584 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d28d11640 1 --2- 172.21.15.7:0/2049787584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4ebb8070 0x563f4ef5f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d23fff640 1 -- 172.21.15.7:0/2049787584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4ebb8070 msgr2=0x563f4ef5f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d23fff640 1 --2- 172.21.15.7:0/2049787584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4ebb8070 0x563f4ef5f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d23fff640 1 -- 172.21.15.7:0/2049787584 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb97390 msgr2=0x563f4ef600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d23fff640 1 --2- 172.21.15.7:0/2049787584 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb97390 0x563f4ef600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d23fff640 1 -- 172.21.15.7:0/2049787584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f4ec23650 con 0x563f4eb8f1b0 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.865+0000 7f8d28d11640 1 --2- 172.21.15.7:0/2049787584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4ebb8070 0x563f4ef5f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.866+0000 7f8d23fff640 1 --2- 172.21.15.7:0/2049787584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb8f1b0 0x563f4ef5fb90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400bcb0 tx=0x7f8d1400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841b306c99a5d7ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.866+0000 7f8d1a7fc640 1 -- 172.21.15.7:0/2049787584 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14015070 con 0x563f4eb8f1b0 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.866+0000 7f8d21ffb640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d100b6700 0x7f8d100b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.866+0000 7f8d1a7fc640 1 -- 172.21.15.7:0/2049787584 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d1401a910 con 0x563f4eb8f1b0 2024-09-21T05:58:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.866+0000 7f8d1a7fc640 1 -- 172.21.15.7:0/2049787584 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14011920 con 0x563f4eb8f1b0 2024-09-21T05:58:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.866+0000 7f8d28d11640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d100b6700 0x7f8d100b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.866+0000 7f8d21ffb640 1 -- 172.21.15.7:0/1231450095 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f8d0c107780 con 0x7f8d241083a0 2024-09-21T05:58:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.867+0000 7f8d30ce8740 1 -- 172.21.15.7:0/2049787584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb8f1b0 msgr2=0x563f4ef5fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.867+0000 7f8d28d11640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d100b6700 0x7f8d100b8c10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c005fd0 tx=0x7f8d1c009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.867+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/2049787584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb8f1b0 0x563f4ef5fb90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400bcb0 tx=0x7f8d1400f730 comp rx=0 tx=0).stop 2024-09-21T05:58:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.867+0000 7f8d30ce8740 1 -- 172.21.15.7:0/2049787584 shutdown_connections 2024-09-21T05:58:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.867+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/2049787584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb8f1b0 0x563f4ef5fb90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.867+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/2049787584 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb97390 0x563f4ef600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.867+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/2049787584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4ebb8070 0x563f4ef5f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.867+0000 7f8d30ce8740 1 -- 172.21.15.7:0/2049787584 >> 172.21.15.7:0/2049787584 conn(0x563f4ebac460 msgr2=0x563f4ef5d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.867+0000 7f8d30ce8740 1 -- 172.21.15.7:0/2049787584 shutdown_connections 2024-09-21T05:58:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.867+0000 7f8d30ce8740 1 -- 172.21.15.7:0/2049787584 wait complete. 2024-09-21T05:58:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.867+0000 7f8d30ce8740 1 -- start start 2024-09-21T05:58:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.868+0000 7f8d30ce8740 1 Processor -- start 2024-09-21T05:58:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.868+0000 7f8d30ce8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4eb8f1b0 0x563f4ef6adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.868+0000 7f8d30ce8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 0x563f4ef6b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.868+0000 7f8d30ce8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4ebb8070 0x563f4ef77150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.868+0000 7f8d30ce8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563f4ed26700 con 0x563f4eb97390 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.868+0000 7f8d30ce8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x563f4ee60110 con 0x563f4ebb8070 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.868+0000 7f8d30ce8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563f4ef6de30 con 0x563f4eb8f1b0 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.868+0000 7f8d30ce8740 10 client.0 _ll_register_callbacks cb 0x563f4ee79990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.868+0000 7f8d1bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 0x563f4ef6b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d1bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 0x563f4ef6b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48414/0 (socket says 172.21.15.7:48414) 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d23fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4eb8f1b0 0x563f4ef6adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d1bfff640 1 -- 172.21.15.7:0/657273455 learned_addr learned my addr 172.21.15.7:0/657273455 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d28d11640 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4ebb8070 0x563f4ef77150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d1bfff640 1 -- 172.21.15.7:0/657273455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4eb8f1b0 msgr2=0x563f4ef6adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d1bfff640 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4eb8f1b0 0x563f4ef6adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d1bfff640 1 -- 172.21.15.7:0/657273455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4ebb8070 msgr2=0x563f4ef77150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d1bfff640 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4ebb8070 0x563f4ef77150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d1bfff640 1 -- 172.21.15.7:0/657273455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f4ee8dc40 con 0x563f4eb97390 2024-09-21T05:58:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d23fff640 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4eb8f1b0 0x563f4ef6adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:58:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d28d11640 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4ebb8070 0x563f4ef77150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:58:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d1bfff640 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 0x563f4ef6b330 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c104fb0 tx=0x7f8d0c105450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10468eb14f6a6628 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d037fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d037fe640 1 -- 172.21.15.7:0/657273455 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c049040 con 0x563f4eb97390 2024-09-21T05:58:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d037fe640 1 -- 172.21.15.7:0/657273455 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f8d0c0d6de0 con 0x563f4eb97390 2024-09-21T05:58:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.869+0000 7f8d30ce8740 1 -- 172.21.15.7:0/657273455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d1401a910 con 0x563f4eb97390 2024-09-21T05:58:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.870+0000 7f8d037fe640 1 -- 172.21.15.7:0/657273455 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8d0c0ccfa0 con 0x563f4eb97390 2024-09-21T05:58:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.870+0000 7f8d30ce8740 10 client.16446 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.870+0000 7f8d30ce8740 1 -- 172.21.15.7:0/657273455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563f4ef79b60 con 0x563f4eb97390 2024-09-21T05:58:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.870+0000 7f8d037fe640 1 -- 172.21.15.7:0/657273455 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d1401a910 con 0x563f4eb97390 2024-09-21T05:58:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.870+0000 7f8d037fe640 1 -- 172.21.15.7:0/657273455 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8d0c04c060 con 0x563f4eb97390 2024-09-21T05:58:08.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.870+0000 7f8d30ce8740 10 client.16446 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:08.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.870+0000 7f8d30ce8740 10 client.16446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:08.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.870+0000 7f8d30ce8740 20 client.16446 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:08.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.870+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563f4eb769f0 0x563f4ef7cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.870+0000 7f8d30ce8740 4 client.16446 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:58:08.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.870+0000 7f8d30ce8740 1 -- 172.21.15.7:0/657273455 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f4eed7da0 con 0x563f4eb769f0 2024-09-21T05:58:08.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.870+0000 7f8d23fff640 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563f4eb769f0 0x563f4ef7cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.871+0000 7f8d23fff640 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563f4eb769f0 0x563f4ef7cf10 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c0a3d28d8430ddc server_cookie=de6b9bc75bd592ce in_seq=0 out_seq=0 2024-09-21T05:58:08.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.871+0000 7f8d037fe640 10 client.16446 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d037fe640 1 -- 172.21.15.7:0/657273455 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f4eed7da0 con 0x563f4eb769f0 2024-09-21T05:58:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d037fe640 10 client.16446 handle_command_reply: tid=0 2024-09-21T05:58:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d30ce8740 1 client.16446 shutdown 2024-09-21T05:58:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d30ce8740 1 -- 172.21.15.7:0/657273455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 msgr2=0x563f4ef6b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 0x563f4ef6b330 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c104fb0 tx=0x7f8d0c105450 comp rx=0 tx=0).stop 2024-09-21T05:58:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d30ce8740 1 -- 172.21.15.7:0/657273455 shutdown_connections 2024-09-21T05:58:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563f4eb769f0 0x563f4ef7cf10 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 0x563f4ef6b330 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4ebb8070 0x563f4ef77150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/657273455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4eb8f1b0 0x563f4ef6adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d30ce8740 1 -- 172.21.15.7:0/657273455 >> 172.21.15.7:0/657273455 conn(0x563f4ebac460 msgr2=0x563f4ef627e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d037fe640 0 client.16446 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d30ce8740 1 -- 172.21.15.7:0/657273455 shutdown_connections 2024-09-21T05:58:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d30ce8740 1 -- 172.21.15.7:0/657273455 wait complete. 2024-09-21T05:58:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.872+0000 7f8d30ce8740 20 client.16446 trim_cache size 0 max 16384 2024-09-21T05:58:08.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.890+0000 7f8d30ce8740 1 Processor -- start 2024-09-21T05:58:08.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.890+0000 7f8d30ce8740 1 -- start start 2024-09-21T05:58:08.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.890+0000 7f8d30ce8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb8f1b0 0x563f4ef6ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.890+0000 7f8d30ce8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 0x563f4ef60d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.890+0000 7f8d30ce8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4ebb8070 0x563f4ef77050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.890+0000 7f8d30ce8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8d241b1de0 con 0x563f4eb97390 2024-09-21T05:58:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.890+0000 7f8d30ce8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8d241af6b0 con 0x563f4eb8f1b0 2024-09-21T05:58:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.890+0000 7f8d30ce8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8d241ad4e0 con 0x563f4ebb8070 2024-09-21T05:58:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.890+0000 7f8d1bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 0x563f4ef60d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.890+0000 7f8d1bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 0x563f4ef60d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48424/0 (socket says 172.21.15.7:48424) 2024-09-21T05:58:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.890+0000 7f8d1bfff640 1 -- 172.21.15.7:0/481695690 learned_addr learned my addr 172.21.15.7:0/481695690 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.890+0000 7f8d23fff640 1 --2- 172.21.15.7:0/481695690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb8f1b0 0x563f4ef6ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.891+0000 7f8d1bfff640 1 -- 172.21.15.7:0/481695690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4ebb8070 msgr2=0x563f4ef77050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.891+0000 7f8d1bfff640 1 --2- 172.21.15.7:0/481695690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4ebb8070 0x563f4ef77050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.891+0000 7f8d1bfff640 1 -- 172.21.15.7:0/481695690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb8f1b0 msgr2=0x563f4ef6ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.891+0000 7f8d1bfff640 1 --2- 172.21.15.7:0/481695690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb8f1b0 0x563f4ef6ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.891+0000 7f8d1bfff640 1 -- 172.21.15.7:0/481695690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f4ef6c0b0 con 0x563f4eb97390 2024-09-21T05:58:08.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.891+0000 7f8d1bfff640 1 --2- 172.21.15.7:0/481695690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 0x563f4ef60d40 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c031440 tx=0x7f8d0c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b22724f987fb19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:08.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.891+0000 7f8d19ffb640 1 -- 172.21.15.7:0/481695690 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0f4030 con 0x563f4eb97390 2024-09-21T05:58:08.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.891+0000 7f8d19ffb640 1 -- 172.21.15.7:0/481695690 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d0c03b460 con 0x563f4eb97390 2024-09-21T05:58:08.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.891+0000 7f8d19ffb640 1 -- 172.21.15.7:0/481695690 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c049070 con 0x563f4eb97390 2024-09-21T05:58:08.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.892+0000 7f8d30ce8740 1 -- 172.21.15.7:0/481695690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 msgr2=0x563f4ef60d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:08.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.892+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/481695690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 0x563f4ef60d40 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c031440 tx=0x7f8d0c000bc0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.892+0000 7f8d30ce8740 1 -- 172.21.15.7:0/481695690 shutdown_connections 2024-09-21T05:58:08.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.892+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/481695690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4eb97390 0x563f4ef60d40 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.892+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/481695690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4ebb8070 0x563f4ef77050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.892+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/481695690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb8f1b0 0x563f4ef6ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.892+0000 7f8d30ce8740 1 -- 172.21.15.7:0/481695690 >> 172.21.15.7:0/481695690 conn(0x563f4ebac460 msgr2=0x563f4ef60630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:08.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.892+0000 7f8d30ce8740 1 -- 172.21.15.7:0/481695690 shutdown_connections 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.892+0000 7f8d30ce8740 1 -- 172.21.15.7:0/481695690 wait complete. 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.892+0000 7f8d30ce8740 1 -- start start 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d30ce8740 1 Processor -- start 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d30ce8740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4eb8f1b0 0x563f4ef73a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d30ce8740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb97390 0x563f4ef70f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d30ce8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4ebb8070 0x563f4ef71690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d30ce8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8d241adb70 con 0x563f4ebb8070 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d30ce8740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8d241aefe0 con 0x563f4eb97390 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d30ce8740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8d241ae240 con 0x563f4eb8f1b0 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d30ce8740 10 client.0 _ll_register_callbacks cb 0x7f8d0c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d28d11640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4ebb8070 0x563f4ef71690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d28d11640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4ebb8070 0x563f4ef71690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48440/0 (socket says 172.21.15.7:48440) 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d28d11640 1 -- 172.21.15.7:0/3384235259 learned_addr learned my addr 172.21.15.7:0/3384235259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d1bfff640 1 --2- 172.21.15.7:0/3384235259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb97390 0x563f4ef70f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d23fff640 1 --2- 172.21.15.7:0/3384235259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4eb8f1b0 0x563f4ef73a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d28d11640 1 -- 172.21.15.7:0/3384235259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4eb8f1b0 msgr2=0x563f4ef73a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d28d11640 1 --2- 172.21.15.7:0/3384235259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4eb8f1b0 0x563f4ef73a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d28d11640 1 -- 172.21.15.7:0/3384235259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb97390 msgr2=0x563f4ef70f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d28d11640 1 --2- 172.21.15.7:0/3384235259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb97390 0x563f4ef70f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.893+0000 7f8d28d11640 1 -- 172.21.15.7:0/3384235259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f4efe6870 con 0x563f4ebb8070 2024-09-21T05:58:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d28d11640 1 --2- 172.21.15.7:0/3384235259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4ebb8070 0x563f4ef71690 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c004620 tx=0x7f8d1c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700f29eba6d75bc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d037fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d037fe640 1 -- 172.21.15.7:0/3384235259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c004850 con 0x563f4ebb8070 2024-09-21T05:58:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d037fe640 1 -- 172.21.15.7:0/3384235259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f8d1c020430 con 0x563f4ebb8070 2024-09-21T05:58:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d30ce8740 1 -- 172.21.15.7:0/3384235259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563f4eed3850 con 0x563f4ebb8070 2024-09-21T05:58:08.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d037fe640 1 -- 172.21.15.7:0/3384235259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8d1c020630 con 0x563f4ebb8070 2024-09-21T05:58:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d30ce8740 10 client.16452 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d30ce8740 1 -- 172.21.15.7:0/3384235259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563f4efe7a00 con 0x563f4ebb8070 2024-09-21T05:58:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d037fe640 1 -- 172.21.15.7:0/3384235259 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563f4eed3850 con 0x563f4ebb8070 2024-09-21T05:58:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d037fe640 1 -- 172.21.15.7:0/3384235259 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8d1c028070 con 0x563f4ebb8070 2024-09-21T05:58:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d30ce8740 10 client.16452 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d30ce8740 10 client.16452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d30ce8740 20 client.16452 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/3384235259 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563f4eb4bda0 0x563f4efea240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.894+0000 7f8d30ce8740 4 client.16452 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:58:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.895+0000 7f8d30ce8740 1 -- 172.21.15.7:0/3384235259 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563f4eed0c80 con 0x563f4eb4bda0 2024-09-21T05:58:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.895+0000 7f8d23fff640 1 --2- 172.21.15.7:0/3384235259 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563f4eb4bda0 0x563f4efea240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.895+0000 7f8d037fe640 10 client.16452 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.895+0000 7f8d23fff640 1 --2- 172.21.15.7:0/3384235259 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563f4eb4bda0 0x563f4efea240 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=783fa5c2d43a76f5 server_cookie=cd23d55f228ead5f in_seq=0 out_seq=0 2024-09-21T05:58:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.895+0000 7f8d037fe640 1 -- 172.21.15.7:0/3384235259 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x563f4eed0c80 con 0x563f4eb4bda0 2024-09-21T05:58:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.895+0000 7f8d037fe640 10 client.16452 handle_command_reply: tid=0 2024-09-21T05:58:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.896+0000 7f8d30ce8740 1 client.16452 shutdown 2024-09-21T05:58:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.896+0000 7f8d30ce8740 1 -- 172.21.15.7:0/3384235259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4ebb8070 msgr2=0x563f4ef71690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.896+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/3384235259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4ebb8070 0x563f4ef71690 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c004620 tx=0x7f8d1c004ab0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.896+0000 7f8d30ce8740 1 -- 172.21.15.7:0/3384235259 shutdown_connections 2024-09-21T05:58:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.896+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/3384235259 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563f4eb4bda0 0x563f4efea240 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.896+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/3384235259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f4ebb8070 0x563f4ef71690 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.896+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/3384235259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563f4eb97390 0x563f4ef70f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.896+0000 7f8d30ce8740 1 --2- 172.21.15.7:0/3384235259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563f4eb8f1b0 0x563f4ef73a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.896+0000 7f8d30ce8740 1 -- 172.21.15.7:0/3384235259 >> 172.21.15.7:0/3384235259 conn(0x563f4ebac460 msgr2=0x563f4ef6ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.896+0000 7f8d037fe640 0 client.16452 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.896+0000 7f8d30ce8740 1 -- 172.21.15.7:0/3384235259 shutdown_connections 2024-09-21T05:58:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.896+0000 7f8d30ce8740 1 -- 172.21.15.7:0/3384235259 wait complete. 2024-09-21T05:58:08.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.896+0000 7f8d30ce8740 20 client.16452 trim_cache size 0 max 16384 2024-09-21T05:58:08.902 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:58:08.903 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T05:58:08.903 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T05:58:08.903 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T05:58:08.903 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:08.903 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "1c540995-232b-4bec-918f-a55f2761d274", 2024-09-21T05:58:08.903 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T05:58:08.903 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:58:08.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:08.903 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:58:08.903 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T05:58:08.903 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T05:58:08.903 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:08.904 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:08.904 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:08.904 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:08.904 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:08.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:08.904 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T05:58:08.904 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T05:58:08.904 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:08.904 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:08.904 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:08.904 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:08.904 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:08.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:08.905 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:08.906 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:08.907 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:08.908 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:08.908 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:08.908 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:08.908 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:58:08.908 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:58:08.908 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:58:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.897+0000 7f8d2a774640 1 -- 172.21.15.7:0/1231450095 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d100b6700 msgr2=0x7f8d100b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.897+0000 7f8d2a774640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d100b6700 0x7f8d100b8c10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c005fd0 tx=0x7f8d1c009500 comp rx=0 tx=0).stop 2024-09-21T05:58:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.897+0000 7f8d2a774640 1 -- 172.21.15.7:0/1231450095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d241083a0 msgr2=0x7f8d2419aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.897+0000 7f8d2a774640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d241083a0 0x7f8d2419aa00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c006010 tx=0x7f8d0c004060 comp rx=0 tx=0).stop 2024-09-21T05:58:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.897+0000 7f8d2a774640 1 -- 172.21.15.7:0/1231450095 shutdown_connections 2024-09-21T05:58:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.897+0000 7f8d2a774640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8d100b6700 0x7f8d100b8c10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.897+0000 7f8d2a774640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d241083a0 0x7f8d2419aa00 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.897+0000 7f8d2a774640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d24108cf0 0x7f8d2419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.897+0000 7f8d2a774640 1 --2- 172.21.15.7:0/1231450095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d24102a60 0x7f8d2419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.897+0000 7f8d2a774640 1 -- 172.21.15.7:0/1231450095 >> 172.21.15.7:0/1231450095 conn(0x7f8d24079730 msgr2=0x7f8d2406b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.897+0000 7f8d2a774640 1 -- 172.21.15.7:0/1231450095 shutdown_connections 2024-09-21T05:58:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:08.897+0000 7f8d2a774640 1 -- 172.21.15.7:0/1231450095 wait complete. 2024-09-21T05:58:09.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:08 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T05:58:09.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:08 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:58:09.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:08 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T05:58:09.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:08 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:58:09.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:08 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T05:58:09.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:08 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:58:09.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:08 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T05:58:09.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:08 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:58:09.577 INFO:tasks.cephfs.filesystem:scrub status for tag:1c540995-232b-4bec-918f-a55f2761d274 - {'path': '/', 'tag': '1c540995-232b-4bec-918f-a55f2761d274', 'options': 'recursive,force'} 2024-09-21T05:58:09.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:09 smithi007 ceph-mon[30983]: pgmap v446: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T05:58:10.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:09 smithi119 ceph-mon[34833]: pgmap v446: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T05:58:10.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:09 smithi027 ceph-mon[34364]: pgmap v446: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T05:58:11.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:11 smithi007 ceph-mon[30983]: pgmap v447: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T05:58:12.028 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:11 smithi027 ceph-mon[34364]: pgmap v447: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T05:58:12.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:11 smithi119 ceph-mon[34833]: pgmap v447: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T05:58:13.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:12 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T05:58:13.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:12 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T05:58:13.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:12 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T05:58:14.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:13 smithi007 ceph-mon[30983]: pgmap v448: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:58:14.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:13 smithi119 ceph-mon[34833]: pgmap v448: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:58:14.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:13 smithi027 ceph-mon[34364]: pgmap v448: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:58:16.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:15 smithi007 ceph-mon[30983]: pgmap v449: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T05:58:16.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:15 smithi119 ceph-mon[34833]: pgmap v449: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T05:58:16.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:15 smithi027 ceph-mon[34364]: pgmap v449: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T05:58:18.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:17 smithi007 ceph-mon[30983]: pgmap v450: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T05:58:18.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:17 smithi119 ceph-mon[34833]: pgmap v450: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T05:58:18.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:17 smithi027 ceph-mon[34364]: pgmap v450: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T05:58:20.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:19 smithi007 ceph-mon[30983]: pgmap v451: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T05:58:20.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:19 smithi119 ceph-mon[34833]: pgmap v451: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T05:58:20.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:19 smithi027 ceph-mon[34364]: pgmap v451: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T05:58:22.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:21 smithi007 ceph-mon[30983]: pgmap v452: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T05:58:22.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:21 smithi119 ceph-mon[34833]: pgmap v452: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T05:58:22.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:21 smithi027 ceph-mon[34364]: pgmap v452: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T05:58:24.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:23 smithi007 ceph-mon[30983]: pgmap v453: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T05:58:24.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:23 smithi119 ceph-mon[34833]: pgmap v453: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T05:58:24.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:23 smithi027 ceph-mon[34364]: pgmap v453: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T05:58:26.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:25 smithi007 ceph-mon[30983]: pgmap v454: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:58:26.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:25 smithi119 ceph-mon[34833]: pgmap v454: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:58:26.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:25 smithi027 ceph-mon[34364]: pgmap v454: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:58:28.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:27 smithi007 ceph-mon[30983]: pgmap v455: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:58:28.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:27 smithi119 ceph-mon[34833]: pgmap v455: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:58:28.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:27 smithi027 ceph-mon[34364]: pgmap v455: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:58:30.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:29 smithi007 ceph-mon[30983]: pgmap v456: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:58:30.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:29 smithi119 ceph-mon[34833]: pgmap v456: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:58:30.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:29 smithi027 ceph-mon[34364]: pgmap v456: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:58:32.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:31 smithi007 ceph-mon[30983]: pgmap v457: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:58:32.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:31 smithi119 ceph-mon[34833]: pgmap v457: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:58:32.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:31 smithi027 ceph-mon[34364]: pgmap v457: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:58:34.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:33 smithi007 ceph-mon[30983]: pgmap v458: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:58:34.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:33 smithi119 ceph-mon[34833]: pgmap v458: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:58:34.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:33 smithi027 ceph-mon[34364]: pgmap v458: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:58:36.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:35 smithi007 ceph-mon[30983]: pgmap v459: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:58:36.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:35 smithi119 ceph-mon[34833]: pgmap v459: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:58:36.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:35 smithi027 ceph-mon[34364]: pgmap v459: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:58:38.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:37 smithi007 ceph-mon[30983]: pgmap v460: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:58:38.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:37 smithi119 ceph-mon[34833]: pgmap v460: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:58:38.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:37 smithi027 ceph-mon[34364]: pgmap v460: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:58:39.577 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:58:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:39.977 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:39 smithi007 ceph-mon[30983]: pgmap v461: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:58:40.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:39 smithi119 ceph-mon[34833]: pgmap v461: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:58:40.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:39 smithi027 ceph-mon[34364]: pgmap v461: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:58:40.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.335+0000 7f112ab43640 1 -- 172.21.15.7:0/2293938899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1124103b60 msgr2=0x7f1124103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.335+0000 7f112ab43640 1 --2- 172.21.15.7:0/2293938899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1124103b60 0x7f1124103f70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1114009900 tx=0x7f111402a410 comp rx=0 tx=0).stop 2024-09-21T05:58:40.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.335+0000 7f112ab43640 1 -- 172.21.15.7:0/2293938899 shutdown_connections 2024-09-21T05:58:40.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.335+0000 7f112ab43640 1 --2- 172.21.15.7:0/2293938899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1124109df0 0x7f1124110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.335+0000 7f112ab43640 1 --2- 172.21.15.7:0/2293938899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11241094a0 0x7f11241098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.335+0000 7f112ab43640 1 --2- 172.21.15.7:0/2293938899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1124103b60 0x7f1124103f70 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.335+0000 7f112ab43640 1 -- 172.21.15.7:0/2293938899 >> 172.21.15.7:0/2293938899 conn(0x7f112407b850 msgr2=0x7f112407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:40.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.335+0000 7f112ab43640 1 -- 172.21.15.7:0/2293938899 shutdown_connections 2024-09-21T05:58:40.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.335+0000 7f112ab43640 1 -- 172.21.15.7:0/2293938899 wait complete. 2024-09-21T05:58:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.336+0000 7f112ab43640 1 Processor -- start 2024-09-21T05:58:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.336+0000 7f112ab43640 1 -- start start 2024-09-21T05:58:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.336+0000 7f112ab43640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1124103b60 0x7f112419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.336+0000 7f112ab43640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11241094a0 0x7f112419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.336+0000 7f112ab43640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1124109df0 0x7f112419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.336+0000 7f112ab43640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1124113af0 con 0x7f1124109df0 2024-09-21T05:58:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.336+0000 7f112ab43640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1124113970 con 0x7f11241094a0 2024-09-21T05:58:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.336+0000 7f112ab43640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1124113c70 con 0x7f1124103b60 2024-09-21T05:58:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.336+0000 7f11290e0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1124109df0 0x7f112419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.336+0000 7f11290e0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1124109df0 0x7f112419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33920/0 (socket says 172.21.15.7:33920) 2024-09-21T05:58:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.336+0000 7f11290e0640 1 -- 172.21.15.7:0/2831589397 learned_addr learned my addr 172.21.15.7:0/2831589397 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.336+0000 7f1123fff640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11241094a0 0x7f112419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.336+0000 7f11288df640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1124103b60 0x7f112419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.337+0000 7f11290e0640 1 -- 172.21.15.7:0/2831589397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1124103b60 msgr2=0x7f112419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.337+0000 7f11290e0640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1124103b60 0x7f112419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.337+0000 7f11290e0640 1 -- 172.21.15.7:0/2831589397 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11241094a0 msgr2=0x7f112419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.337+0000 7f11290e0640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11241094a0 0x7f112419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.337+0000 7f11290e0640 1 -- 172.21.15.7:0/2831589397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11241a0450 con 0x7f1124109df0 2024-09-21T05:58:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.337+0000 7f11290e0640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1124109df0 0x7f112419fd20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f111c00eaa0 tx=0x7f111c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.337+0000 7f1121ffb640 1 -- 172.21.15.7:0/2831589397 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c004d20 con 0x7f1124109df0 2024-09-21T05:58:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.337+0000 7f1121ffb640 1 -- 172.21.15.7:0/2831589397 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f111c005020 con 0x7f1124109df0 2024-09-21T05:58:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.337+0000 7f112ab43640 1 -- 172.21.15.7:0/2831589397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11241a0740 con 0x7f1124109df0 2024-09-21T05:58:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.337+0000 7f1121ffb640 1 -- 172.21.15.7:0/2831589397 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c0116b0 con 0x7f1124109df0 2024-09-21T05:58:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.337+0000 7f112ab43640 1 -- 172.21.15.7:0/2831589397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11241a6ea0 con 0x7f1124109df0 2024-09-21T05:58:40.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.340+0000 7f11310b7740 1 Processor -- start 2024-09-21T05:58:40.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.340+0000 7f1121ffb640 1 -- 172.21.15.7:0/2831589397 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f111c0051d0 con 0x7f1124109df0 2024-09-21T05:58:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.340+0000 7f11310b7740 1 -- start start 2024-09-21T05:58:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.340+0000 7f11310b7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8c4070 0x556f8ec6b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.340+0000 7f11310b7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e89b1b0 0x556f8ec6b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.340+0000 7f11310b7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8a3390 0x556f8ec6bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.340+0000 7f11310b7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556f8ebe1e50 con 0x556f8e8a3390 2024-09-21T05:58:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.340+0000 7f11310b7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556f8ebd1280 con 0x556f8e8c4070 2024-09-21T05:58:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.340+0000 7f11310b7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556f8ebd5090 con 0x556f8e89b1b0 2024-09-21T05:58:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.340+0000 7f1123fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8a3390 0x556f8ec6bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.340+0000 7f1123fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8a3390 0x556f8ec6bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33928/0 (socket says 172.21.15.7:33928) 2024-09-21T05:58:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.340+0000 7f1123fff640 1 -- 172.21.15.7:0/406077828 learned_addr learned my addr 172.21.15.7:0/406077828 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.340+0000 7f11288df640 1 --2- 172.21.15.7:0/406077828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e89b1b0 0x556f8ec6b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.341+0000 7f1123fff640 1 --2- 172.21.15.7:0/406077828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8c4070 0x556f8ec6b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.341+0000 7f1121ffb640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f110c0b6680 0x7f110c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.341+0000 7f1123fff640 1 -- 172.21.15.7:0/406077828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e89b1b0 msgr2=0x556f8ec6b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.341+0000 7f1123fff640 1 --2- 172.21.15.7:0/406077828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e89b1b0 0x556f8ec6b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.341+0000 7f1123fff640 1 -- 172.21.15.7:0/406077828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8c4070 msgr2=0x556f8ec6b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.341+0000 7f1123fff640 1 --2- 172.21.15.7:0/406077828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8c4070 0x556f8ec6b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.341+0000 7f11290e0640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f110c0b6680 0x7f110c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.341+0000 7f1123fff640 1 -- 172.21.15.7:0/406077828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f8e92f650 con 0x556f8e8a3390 2024-09-21T05:58:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.341+0000 7f1121ffb640 1 -- 172.21.15.7:0/2831589397 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f111c0e7910 con 0x7f1124109df0 2024-09-21T05:58:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.341+0000 7f1123fff640 1 --2- 172.21.15.7:0/406077828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8a3390 0x556f8ec6bcf0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1118009330 tx=0x7f11180094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6d2671103cb764 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.341+0000 7f110affd640 1 -- 172.21.15.7:0/406077828 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118017e60 con 0x556f8e8a3390 2024-09-21T05:58:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.341+0000 7f110affd640 1 -- 172.21.15.7:0/406077828 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f111801d070 con 0x556f8e8a3390 2024-09-21T05:58:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.341+0000 7f110affd640 1 -- 172.21.15.7:0/406077828 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11180188d0 con 0x556f8e8a3390 2024-09-21T05:58:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.342+0000 7f11310b7740 1 -- 172.21.15.7:0/406077828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8a3390 msgr2=0x556f8ec6bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.342+0000 7f11290e0640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f110c0b6680 0x7f110c0b8b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f111c020000 tx=0x7f111c076300 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.342+0000 7f11310b7740 1 --2- 172.21.15.7:0/406077828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8a3390 0x556f8ec6bcf0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1118009330 tx=0x7f11180094d0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.342+0000 7f11310b7740 1 -- 172.21.15.7:0/406077828 shutdown_connections 2024-09-21T05:58:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.342+0000 7f11310b7740 1 --2- 172.21.15.7:0/406077828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8a3390 0x556f8ec6bcf0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.342+0000 7f11310b7740 1 --2- 172.21.15.7:0/406077828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e89b1b0 0x556f8ec6b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.342+0000 7f11310b7740 1 --2- 172.21.15.7:0/406077828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8c4070 0x556f8ec6b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.342+0000 7f11310b7740 1 -- 172.21.15.7:0/406077828 >> 172.21.15.7:0/406077828 conn(0x556f8e8b8460 msgr2=0x556f8ec69160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.342+0000 7f11310b7740 1 -- 172.21.15.7:0/406077828 shutdown_connections 2024-09-21T05:58:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.342+0000 7f11310b7740 1 -- 172.21.15.7:0/406077828 wait complete. 2024-09-21T05:58:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.343+0000 7f11310b7740 1 -- start start 2024-09-21T05:58:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.343+0000 7f11310b7740 1 Processor -- start 2024-09-21T05:58:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.343+0000 7f11310b7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e89b1b0 0x556f8ec7acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.343+0000 7f11310b7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8a3390 0x556f8ec7b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.343+0000 7f11310b7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e8c4070 0x556f8ec7b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.343+0000 7f11310b7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556f8ea32700 con 0x556f8e89b1b0 2024-09-21T05:58:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.343+0000 7f11310b7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556f8eb6c110 con 0x556f8e8a3390 2024-09-21T05:58:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.343+0000 7f11310b7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556f8ec7dd50 con 0x556f8e8c4070 2024-09-21T05:58:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.343+0000 7f11310b7740 10 client.0 _ll_register_callbacks cb 0x556f8eb85990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.343+0000 7f1123fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e89b1b0 0x556f8ec7acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.343+0000 7f1123fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e89b1b0 0x556f8ec7acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33932/0 (socket says 172.21.15.7:33932) 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.343+0000 7f1123fff640 1 -- 172.21.15.7:0/580296566 learned_addr learned my addr 172.21.15.7:0/580296566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f11288df640 1 --2- 172.21.15.7:0/580296566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8a3390 0x556f8ec7b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f1123fff640 1 --2- 172.21.15.7:0/580296566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e8c4070 0x556f8ec7b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f1123fff640 1 -- 172.21.15.7:0/580296566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e8c4070 msgr2=0x556f8ec7b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f1123fff640 1 --2- 172.21.15.7:0/580296566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e8c4070 0x556f8ec7b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f1123fff640 1 -- 172.21.15.7:0/580296566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8a3390 msgr2=0x556f8ec7b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f1123fff640 1 --2- 172.21.15.7:0/580296566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8a3390 0x556f8ec7b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f1123fff640 1 -- 172.21.15.7:0/580296566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f8eb99c40 con 0x556f8e89b1b0 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f1123fff640 1 --2- 172.21.15.7:0/580296566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e89b1b0 0x556f8ec7acd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f1118009aa0 tx=0x7f1118018590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13aa8517f19c32a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f1103fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f1103fff640 1 -- 172.21.15.7:0/580296566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118015d80 con 0x556f8e89b1b0 2024-09-21T05:58:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f11310b7740 1 -- 172.21.15.7:0/580296566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f111801d070 con 0x556f8e89b1b0 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f1103fff640 1 -- 172.21.15.7:0/580296566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f1118018670 con 0x556f8e89b1b0 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f1103fff640 1 -- 172.21.15.7:0/580296566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1118017e60 con 0x556f8e89b1b0 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f11310b7740 10 client.16464 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.344+0000 7f11310b7740 1 -- 172.21.15.7:0/580296566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556f8ec89a10 con 0x556f8e89b1b0 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.345+0000 7f1103fff640 1 -- 172.21.15.7:0/580296566 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f111801d070 con 0x556f8e89b1b0 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.345+0000 7f1103fff640 1 -- 172.21.15.7:0/580296566 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1118023830 con 0x556f8e89b1b0 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.345+0000 7f11310b7740 10 client.16464 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.345+0000 7f11310b7740 10 client.16464 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.345+0000 7f11310b7740 20 client.16464 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.345+0000 7f11310b7740 1 --2- 172.21.15.7:0/580296566 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556f8e8829f0 0x556f8ec8cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.345+0000 7f11310b7740 4 client.16464 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.345+0000 7f11310b7740 1 -- 172.21.15.7:0/580296566 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f8ebe3da0 con 0x556f8e8829f0 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.345+0000 7f11288df640 1 --2- 172.21.15.7:0/580296566 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556f8e8829f0 0x556f8ec8cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.346+0000 7f1103fff640 10 client.16464 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.346+0000 7f11288df640 1 --2- 172.21.15.7:0/580296566 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556f8e8829f0 0x556f8ec8cd70 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de229196e681cefe server_cookie=83341ab096ba5aa5 in_seq=0 out_seq=0 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f1103fff640 1 -- 172.21.15.7:0/580296566 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f8ebe3da0 con 0x556f8e8829f0 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f1103fff640 10 client.16464 handle_command_reply: tid=0 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f11310b7740 1 client.16464 shutdown 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f11310b7740 1 -- 172.21.15.7:0/580296566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e89b1b0 msgr2=0x556f8ec7acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f11310b7740 1 --2- 172.21.15.7:0/580296566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e89b1b0 0x556f8ec7acd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f1118009aa0 tx=0x7f1118018590 comp rx=0 tx=0).stop 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f11310b7740 1 -- 172.21.15.7:0/580296566 shutdown_connections 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f11310b7740 1 --2- 172.21.15.7:0/580296566 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556f8e8829f0 0x556f8ec8cd70 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f1103fff640 0 client.16464 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f11310b7740 1 --2- 172.21.15.7:0/580296566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e8c4070 0x556f8ec7b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f11310b7740 1 --2- 172.21.15.7:0/580296566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8a3390 0x556f8ec7b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f11310b7740 1 --2- 172.21.15.7:0/580296566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e89b1b0 0x556f8ec7acd0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f11310b7740 1 -- 172.21.15.7:0/580296566 >> 172.21.15.7:0/580296566 conn(0x556f8e8b8460 msgr2=0x556f8ec67700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f11310b7740 1 -- 172.21.15.7:0/580296566 shutdown_connections 2024-09-21T05:58:40.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f11310b7740 1 -- 172.21.15.7:0/580296566 wait complete. 2024-09-21T05:58:40.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.347+0000 7f11310b7740 20 client.16464 trim_cache size 0 max 16384 2024-09-21T05:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f11310b7740 1 Processor -- start 2024-09-21T05:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f11310b7740 1 -- start start 2024-09-21T05:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f11310b7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 0x556f8ec6c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f11310b7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e89b1b0 0x556f8ec77ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f11310b7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8a3390 0x556f8ec78400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f11310b7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f11241afce0 con 0x556f8e8829f0 2024-09-21T05:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f11310b7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f11241ad5b0 con 0x556f8e8a3390 2024-09-21T05:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f11310b7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f11241ab420 con 0x556f8e89b1b0 2024-09-21T05:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f1123fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 0x556f8ec6c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f1123fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 0x556f8ec6c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33948/0 (socket says 172.21.15.7:33948) 2024-09-21T05:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f1123fff640 1 -- 172.21.15.7:0/2025237620 learned_addr learned my addr 172.21.15.7:0/2025237620 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f1123fff640 1 --2- 172.21.15.7:0/2025237620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8a3390 0x556f8ec78400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f11288df640 1 --2- 172.21.15.7:0/2025237620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e89b1b0 0x556f8ec77ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f1123fff640 1 -- 172.21.15.7:0/2025237620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e89b1b0 msgr2=0x556f8ec77ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f1123fff640 1 --2- 172.21.15.7:0/2025237620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e89b1b0 0x556f8ec77ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f1123fff640 1 -- 172.21.15.7:0/2025237620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8a3390 msgr2=0x556f8ec78400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f1123fff640 1 --2- 172.21.15.7:0/2025237620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8a3390 0x556f8ec78400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.365+0000 7f1123fff640 1 -- 172.21.15.7:0/2025237620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f8ec6cef0 con 0x556f8e8829f0 2024-09-21T05:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.366+0000 7f1123fff640 1 --2- 172.21.15.7:0/2025237620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 0x556f8ec6c9b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f1118018560 tx=0x7f1118006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da885cadf2db44f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.366+0000 7f110a7fc640 1 -- 172.21.15.7:0/2025237620 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111803f070 con 0x556f8e8829f0 2024-09-21T05:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.366+0000 7f110a7fc640 1 -- 172.21.15.7:0/2025237620 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f111801d040 con 0x556f8e8829f0 2024-09-21T05:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.366+0000 7f110a7fc640 1 -- 172.21.15.7:0/2025237620 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11180228c0 con 0x556f8e8829f0 2024-09-21T05:58:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.367+0000 7f11310b7740 1 -- 172.21.15.7:0/2025237620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 msgr2=0x556f8ec6c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.367+0000 7f11310b7740 1 --2- 172.21.15.7:0/2025237620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 0x556f8ec6c9b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f1118018560 tx=0x7f1118006a30 comp rx=0 tx=0).stop 2024-09-21T05:58:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.367+0000 7f11310b7740 1 -- 172.21.15.7:0/2025237620 shutdown_connections 2024-09-21T05:58:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.367+0000 7f11310b7740 1 --2- 172.21.15.7:0/2025237620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e8a3390 0x556f8ec78400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.367+0000 7f11310b7740 1 --2- 172.21.15.7:0/2025237620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e89b1b0 0x556f8ec77ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.367+0000 7f11310b7740 1 --2- 172.21.15.7:0/2025237620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 0x556f8ec6c9b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.367+0000 7f11310b7740 1 -- 172.21.15.7:0/2025237620 >> 172.21.15.7:0/2025237620 conn(0x556f8e8b8460 msgr2=0x556f8ec6c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.367+0000 7f11310b7740 1 -- 172.21.15.7:0/2025237620 shutdown_connections 2024-09-21T05:58:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.367+0000 7f11310b7740 1 -- 172.21.15.7:0/2025237620 wait complete. 2024-09-21T05:58:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.367+0000 7f11310b7740 1 -- start start 2024-09-21T05:58:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.367+0000 7f11310b7740 1 Processor -- start 2024-09-21T05:58:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f11310b7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 0x556f8ec8fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f11310b7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e89b1b0 0x556f8ec90160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f11310b7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e8a3390 0x556f8ecec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f11310b7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f11241aba70 con 0x556f8e8829f0 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f11310b7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f11241acee0 con 0x556f8e89b1b0 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f11310b7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f11241ac140 con 0x556f8e8a3390 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f11310b7740 10 client.0 _ll_register_callbacks cb 0x7f1118009c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f1123fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 0x556f8ec8fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f1123fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 0x556f8ec8fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33954/0 (socket says 172.21.15.7:33954) 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f1123fff640 1 -- 172.21.15.7:0/1772853081 learned_addr learned my addr 172.21.15.7:0/1772853081 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f11288df640 1 --2- 172.21.15.7:0/1772853081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e89b1b0 0x556f8ec90160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f1123fff640 1 --2- 172.21.15.7:0/1772853081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e8a3390 0x556f8ecec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f1123fff640 1 -- 172.21.15.7:0/1772853081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e8a3390 msgr2=0x556f8ecec6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f1123fff640 1 --2- 172.21.15.7:0/1772853081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e8a3390 0x556f8ecec6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f1123fff640 1 -- 172.21.15.7:0/1772853081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e89b1b0 msgr2=0x556f8ec90160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f1123fff640 1 --2- 172.21.15.7:0/1772853081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e89b1b0 0x556f8ec90160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f1123fff640 1 -- 172.21.15.7:0/1772853081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f8ececd30 con 0x556f8e8829f0 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f1123fff640 1 --2- 172.21.15.7:0/1772853081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 0x556f8ec8fb80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f111803d040 tx=0x7f1118004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9846202fe6f3d10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.368+0000 7f1103fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f1103fff640 1 -- 172.21.15.7:0/1772853081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111804b060 con 0x556f8e8829f0 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f1103fff640 1 -- 172.21.15.7:0/1772853081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f1118023610 con 0x556f8e8829f0 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f11310b7740 1 -- 172.21.15.7:0/1772853081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f111801d040 con 0x556f8e8829f0 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f1103fff640 1 -- 172.21.15.7:0/1772853081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f111803f040 con 0x556f8e8829f0 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f11310b7740 10 client.16470 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f11310b7740 1 -- 172.21.15.7:0/1772853081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556f8ecf7350 con 0x556f8e8829f0 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f1103fff640 1 -- 172.21.15.7:0/1772853081 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f111801d040 con 0x556f8e8829f0 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f1103fff640 1 -- 172.21.15.7:0/1772853081 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1118045070 con 0x556f8e8829f0 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f11310b7740 10 client.16470 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f11310b7740 10 client.16470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f11310b7740 20 client.16470 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f11310b7740 1 --2- 172.21.15.7:0/1772853081 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556f8e8c4070 0x556f8ecf9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f11310b7740 4 client.16470 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:58:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.369+0000 7f11310b7740 1 -- 172.21.15.7:0/1772853081 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556f8ebdf850 con 0x556f8e8c4070 2024-09-21T05:58:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.370+0000 7f11288df640 1 --2- 172.21.15.7:0/1772853081 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556f8e8c4070 0x556f8ecf9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.370+0000 7f11288df640 1 --2- 172.21.15.7:0/1772853081 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556f8e8c4070 0x556f8ecf9a80 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=254c0f0633ad134a server_cookie=91e6df9f512da3cf in_seq=0 out_seq=0 2024-09-21T05:58:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.370+0000 7f1103fff640 10 client.16470 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.370+0000 7f1103fff640 1 -- 172.21.15.7:0/1772853081 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x556f8ebdf850 con 0x556f8e8c4070 2024-09-21T05:58:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.370+0000 7f1103fff640 10 client.16470 handle_command_reply: tid=0 2024-09-21T05:58:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.370+0000 7f11310b7740 1 client.16470 shutdown 2024-09-21T05:58:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.370+0000 7f11310b7740 1 -- 172.21.15.7:0/1772853081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 msgr2=0x556f8ec8fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.370+0000 7f11310b7740 1 --2- 172.21.15.7:0/1772853081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 0x556f8ec8fb80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f111803d040 tx=0x7f1118004640 comp rx=0 tx=0).stop 2024-09-21T05:58:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.370+0000 7f11310b7740 1 -- 172.21.15.7:0/1772853081 shutdown_connections 2024-09-21T05:58:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.370+0000 7f11310b7740 1 --2- 172.21.15.7:0/1772853081 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556f8e8c4070 0x556f8ecf9a80 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f1103fff640 0 client.16470 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f11310b7740 1 --2- 172.21.15.7:0/1772853081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556f8e8a3390 0x556f8ecec6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f11310b7740 1 --2- 172.21.15.7:0/1772853081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556f8e89b1b0 0x556f8ec90160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f11310b7740 1 --2- 172.21.15.7:0/1772853081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f8e8829f0 0x556f8ec8fb80 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f11310b7740 1 -- 172.21.15.7:0/1772853081 >> 172.21.15.7:0/1772853081 conn(0x556f8e8b8460 msgr2=0x556f8ec7c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f11310b7740 1 -- 172.21.15.7:0/1772853081 shutdown_connections 2024-09-21T05:58:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f11310b7740 1 -- 172.21.15.7:0/1772853081 wait complete. 2024-09-21T05:58:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f11310b7740 20 client.16470 trim_cache size 0 max 16384 2024-09-21T05:58:40.377 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:58:40.377 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T05:58:40.377 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T05:58:40.377 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:58:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:58:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:58:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:58:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:58:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:58:40.382 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:58:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f112ab43640 1 -- 172.21.15.7:0/2831589397 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f110c0b6680 msgr2=0x7f110c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f112ab43640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f110c0b6680 0x7f110c0b8b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f111c020000 tx=0x7f111c076300 comp rx=0 tx=0).stop 2024-09-21T05:58:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f112ab43640 1 -- 172.21.15.7:0/2831589397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1124109df0 msgr2=0x7f112419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f112ab43640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1124109df0 0x7f112419fd20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f111c00eaa0 tx=0x7f111c00eea0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f112ab43640 1 -- 172.21.15.7:0/2831589397 shutdown_connections 2024-09-21T05:58:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f112ab43640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f110c0b6680 0x7f110c0b8b90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f112ab43640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1124109df0 0x7f112419fd20 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f112ab43640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11241094a0 0x7f112419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f112ab43640 1 --2- 172.21.15.7:0/2831589397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1124103b60 0x7f112419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.371+0000 7f112ab43640 1 -- 172.21.15.7:0/2831589397 >> 172.21.15.7:0/2831589397 conn(0x7f112407b850 msgr2=0x7f1124107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.372+0000 7f112ab43640 1 -- 172.21.15.7:0/2831589397 shutdown_connections 2024-09-21T05:58:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:40.372+0000 7f112ab43640 1 -- 172.21.15.7:0/2831589397 wait complete. 2024-09-21T05:58:41.135 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T05:58:41.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:58:41.397 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:41.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.975+0000 7fdb0f044640 1 -- 172.21.15.7:0/3317389653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb081083c0 msgr2=0x7fdb081087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:41.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.975+0000 7fdb0f044640 1 --2- 172.21.15.7:0/3317389653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb081083c0 0x7fdb081087d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009900 tx=0x7fdaf402a410 comp rx=0 tx=0).stop 2024-09-21T05:58:41.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.975+0000 7fdb0f044640 1 -- 172.21.15.7:0/3317389653 shutdown_connections 2024-09-21T05:58:41.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.975+0000 7fdb0f044640 1 --2- 172.21.15.7:0/3317389653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb081083c0 0x7fdb081087d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:41.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.975+0000 7fdb0f044640 1 --2- 172.21.15.7:0/3317389653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb08108d10 0x7fdb0810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:41.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.975+0000 7fdb0f044640 1 --2- 172.21.15.7:0/3317389653 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb08102a80 0x7fdb08102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:41.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.975+0000 7fdb0f044640 1 -- 172.21.15.7:0/3317389653 >> 172.21.15.7:0/3317389653 conn(0x7fdb08079740 msgr2=0x7fdb08079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:41.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.975+0000 7fdb0f044640 1 -- 172.21.15.7:0/3317389653 shutdown_connections 2024-09-21T05:58:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.975+0000 7fdb0f044640 1 -- 172.21.15.7:0/3317389653 wait complete. 2024-09-21T05:58:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0f044640 1 Processor -- start 2024-09-21T05:58:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0f044640 1 -- start start 2024-09-21T05:58:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0f044640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb08102a80 0x7fdb0819b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0f044640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb081083c0 0x7fdb0819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0f044640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb08108d10 0x7fdb0819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0f044640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb08112980 con 0x7fdb08108d10 2024-09-21T05:58:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0f044640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fdb08112800 con 0x7fdb081083c0 2024-09-21T05:58:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0f044640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdb08112b00 con 0x7fdb08102a80 2024-09-21T05:58:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0d5e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb08108d10 0x7fdb0819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0d5e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb08108d10 0x7fdb0819bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33982/0 (socket says 172.21.15.7:33982) 2024-09-21T05:58:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0d5e1640 1 -- 172.21.15.7:0/1567620096 learned_addr learned my addr 172.21.15.7:0/1567620096 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb07fff640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb081083c0 0x7fdb0819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0cde0640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb08102a80 0x7fdb0819b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0d5e1640 1 -- 172.21.15.7:0/1567620096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb08102a80 msgr2=0x7fdb0819b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0d5e1640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb08102a80 0x7fdb0819b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0d5e1640 1 -- 172.21.15.7:0/1567620096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb081083c0 msgr2=0x7fdb0819b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0d5e1640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb081083c0 0x7fdb0819b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.976+0000 7fdb0d5e1640 1 -- 172.21.15.7:0/1567620096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb081a6510 con 0x7fdb08108d10 2024-09-21T05:58:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.977+0000 7fdb0d5e1640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb08108d10 0x7fdb0819bd90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000cce0 tx=0x7fdb0000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.977+0000 7fdb05ffb640 1 -- 172.21.15.7:0/1567620096 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000f450 con 0x7fdb08108d10 2024-09-21T05:58:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.977+0000 7fdb0f044640 1 -- 172.21.15.7:0/1567620096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb081a6800 con 0x7fdb08108d10 2024-09-21T05:58:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.977+0000 7fdb05ffb640 1 -- 172.21.15.7:0/1567620096 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb0000faa0 con 0x7fdb08108d10 2024-09-21T05:58:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.977+0000 7fdb05ffb640 1 -- 172.21.15.7:0/1567620096 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb00018b70 con 0x7fdb08108d10 2024-09-21T05:58:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.977+0000 7fdb0f044640 1 -- 172.21.15.7:0/1567620096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb081a6cc0 con 0x7fdb08108d10 2024-09-21T05:58:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.978+0000 7fdb0f044640 1 -- 172.21.15.7:0/1567620096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb08103d00 con 0x7fdb08108d10 2024-09-21T05:58:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.980+0000 7fdb05ffb640 1 -- 172.21.15.7:0/1567620096 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fdb00018d10 con 0x7fdb08108d10 2024-09-21T05:58:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.980+0000 7fdb05ffb640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdaf80b66b0 0x7fdaf80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.981+0000 7fdb0cde0640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdaf80b66b0 0x7fdaf80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.981+0000 7fdb05ffb640 1 -- 172.21.15.7:0/1567620096 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fdb000e7b30 con 0x7fdb08108d10 2024-09-21T05:58:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.981+0000 7fdb0cde0640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdaf80b66b0 0x7fdaf80b8bc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdb0806c6a0 tx=0x7fdafc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:41.984+0000 7fdb05ffb640 1 -- 172.21.15.7:0/1567620096 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb00014030 con 0x7fdb08108d10 2024-09-21T05:58:42.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:41 smithi007 ceph-mon[30983]: pgmap v462: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:58:42.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:41 smithi119 ceph-mon[34833]: pgmap v462: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:58:42.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.214+0000 7fdb0f044640 1 -- 172.21.15.7:0/1567620096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb0806bf50 con 0x7fdb08108d10 2024-09-21T05:58:42.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.215+0000 7fdb05ffb640 1 -- 172.21.15.7:0/1567620096 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7fdb0806bf50 con 0x7fdb08108d10 2024-09-21T05:58:42.217 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:58:42.217 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:58:42.217 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:58:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.217+0000 7fdb0f044640 1 -- 172.21.15.7:0/1567620096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdaf80b66b0 msgr2=0x7fdaf80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.217+0000 7fdb0f044640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdaf80b66b0 0x7fdaf80b8bc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdb0806c6a0 tx=0x7fdafc005f90 comp rx=0 tx=0).stop 2024-09-21T05:58:42.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.217+0000 7fdb0f044640 1 -- 172.21.15.7:0/1567620096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb08108d10 msgr2=0x7fdb0819bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:42.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.217+0000 7fdb0f044640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb08108d10 0x7fdb0819bd90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000cce0 tx=0x7fdb0000a620 comp rx=0 tx=0).stop 2024-09-21T05:58:42.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.217+0000 7fdb0f044640 1 -- 172.21.15.7:0/1567620096 shutdown_connections 2024-09-21T05:58:42.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.217+0000 7fdb0f044640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdaf80b66b0 0x7fdaf80b8bc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:42.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.217+0000 7fdb0f044640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb08108d10 0x7fdb0819bd90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:42.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.217+0000 7fdb0f044640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb081083c0 0x7fdb0819b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:42.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.217+0000 7fdb0f044640 1 --2- 172.21.15.7:0/1567620096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb08102a80 0x7fdb0819b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:42.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.217+0000 7fdb0f044640 1 -- 172.21.15.7:0/1567620096 >> 172.21.15.7:0/1567620096 conn(0x7fdb08079740 msgr2=0x7fdb081044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:42.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.218+0000 7fdb0f044640 1 -- 172.21.15.7:0/1567620096 shutdown_connections 2024-09-21T05:58:42.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:42.218+0000 7fdb0f044640 1 -- 172.21.15.7:0/1567620096 wait complete. 2024-09-21T05:58:42.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:41 smithi027 ceph-mon[34364]: pgmap v462: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:58:42.909 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T05:58:43.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:42 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1567620096' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:58:43.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:42 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1567620096' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:58:43.169 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:43.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:42 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1567620096' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:58:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.642+0000 7f5c4cd3d640 1 -- 172.21.15.7:0/2634622854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c48102fa0 msgr2=0x7f5c4810fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.642+0000 7f5c4cd3d640 1 --2- 172.21.15.7:0/2634622854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c48102fa0 0x7f5c4810fcc0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009900 tx=0x7f5c3c02a480 comp rx=0 tx=0).stop 2024-09-21T05:58:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.642+0000 7f5c4cd3d640 1 -- 172.21.15.7:0/2634622854 shutdown_connections 2024-09-21T05:58:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.642+0000 7f5c4cd3d640 1 --2- 172.21.15.7:0/2634622854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c48102fa0 0x7f5c4810fcc0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.642+0000 7f5c4cd3d640 1 --2- 172.21.15.7:0/2634622854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c48110200 0x7f5c48112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.642+0000 7f5c4cd3d640 1 --2- 172.21.15.7:0/2634622854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c48102650 0x7f5c48102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.642+0000 7f5c4cd3d640 1 -- 172.21.15.7:0/2634622854 >> 172.21.15.7:0/2634622854 conn(0x7f5c48079740 msgr2=0x7f5c48079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.642+0000 7f5c4cd3d640 1 -- 172.21.15.7:0/2634622854 shutdown_connections 2024-09-21T05:58:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.642+0000 7f5c4cd3d640 1 -- 172.21.15.7:0/2634622854 wait complete. 2024-09-21T05:58:43.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.643+0000 7f5c4cd3d640 1 Processor -- start 2024-09-21T05:58:43.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.643+0000 7f5c4cd3d640 1 -- start start 2024-09-21T05:58:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c4cd3d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c48102650 0x7f5c4819c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c4cd3d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c48102fa0 0x7f5c4819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c4cd3d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c48110200 0x7f5c481a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c4cd3d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5c48115c70 con 0x7f5c48102fa0 2024-09-21T05:58:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c4cd3d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5c48115af0 con 0x7f5c48110200 2024-09-21T05:58:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c4cd3d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5c48115df0 con 0x7f5c48102650 2024-09-21T05:58:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c45d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c48102fa0 0x7f5c4819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c45d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c48102fa0 0x7f5c4819cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34002/0 (socket says 172.21.15.7:34002) 2024-09-21T05:58:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c45d9b640 1 -- 172.21.15.7:0/4134842451 learned_addr learned my addr 172.21.15.7:0/4134842451 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c4659c640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c48102650 0x7f5c4819c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c46d9d640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c48110200 0x7f5c481a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c45d9b640 1 -- 172.21.15.7:0/4134842451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c48102650 msgr2=0x7f5c4819c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c45d9b640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c48102650 0x7f5c4819c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c45d9b640 1 -- 172.21.15.7:0/4134842451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c48110200 msgr2=0x7f5c481a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c45d9b640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c48110200 0x7f5c481a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c45d9b640 1 -- 172.21.15.7:0/4134842451 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c481a25f0 con 0x7f5c48102fa0 2024-09-21T05:58:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.644+0000 7f5c45d9b640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c48102fa0 0x7f5c4819cc20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c005940 tx=0x7f5c3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.645+0000 7f5c377fe640 1 -- 172.21.15.7:0/4134842451 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c03f030 con 0x7f5c48102fa0 2024-09-21T05:58:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.645+0000 7f5c377fe640 1 -- 172.21.15.7:0/4134842451 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c3c003cb0 con 0x7f5c48102fa0 2024-09-21T05:58:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.645+0000 7f5c4cd3d640 1 -- 172.21.15.7:0/4134842451 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c481a2880 con 0x7f5c48102fa0 2024-09-21T05:58:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.645+0000 7f5c377fe640 1 -- 172.21.15.7:0/4134842451 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c035070 con 0x7f5c48102fa0 2024-09-21T05:58:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.645+0000 7f5c4cd3d640 1 -- 172.21.15.7:0/4134842451 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c481a9040 con 0x7f5c48102fa0 2024-09-21T05:58:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.647+0000 7f5c532b1740 1 Processor -- start 2024-09-21T05:58:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.648+0000 7f5c532b1740 1 -- start start 2024-09-21T05:58:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.648+0000 7f5c377fe640 1 -- 172.21.15.7:0/4134842451 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f5c3c042030 con 0x7f5c48102fa0 2024-09-21T05:58:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.648+0000 7f5c532b1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x55574075b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.648+0000 7f5c532b1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 0x55574075bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.648+0000 7f5c532b1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 0x55574075c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.648+0000 7f5c532b1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5557406d1ea0 con 0x55574038b1b0 2024-09-21T05:58:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.648+0000 7f5c532b1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5557406c12d0 con 0x5557403b4070 2024-09-21T05:58:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.648+0000 7f5c532b1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5557406c50e0 con 0x555740393390 2024-09-21T05:58:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.648+0000 7f5c4659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 0x55574075bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.648+0000 7f5c4659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 0x55574075bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34012/0 (socket says 172.21.15.7:34012) 2024-09-21T05:58:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.648+0000 7f5c4659c640 1 -- 172.21.15.7:0/255527849 learned_addr learned my addr 172.21.15.7:0/255527849 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.648+0000 7f5c46d9d640 1 --2- 172.21.15.7:0/255527849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x55574075b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.648+0000 7f5c45d9b640 1 --2- 172.21.15.7:0/255527849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 0x55574075c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.649+0000 7f5c4659c640 1 -- 172.21.15.7:0/255527849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 msgr2=0x55574075c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.649+0000 7f5c4659c640 1 --2- 172.21.15.7:0/255527849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 0x55574075c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.649+0000 7f5c4659c640 1 -- 172.21.15.7:0/255527849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 msgr2=0x55574075b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.649+0000 7f5c4659c640 1 --2- 172.21.15.7:0/255527849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x55574075b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.649+0000 7f5c4659c640 1 -- 172.21.15.7:0/255527849 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55574041f650 con 0x55574038b1b0 2024-09-21T05:58:43.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.649+0000 7f5c46d9d640 1 --2- 172.21.15.7:0/255527849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x55574075b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:58:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.649+0000 7f5c4659c640 1 --2- 172.21.15.7:0/255527849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 0x55574075bbe0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800bd50 tx=0x7f5c380107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833fac4f8599603 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.649+0000 7f5c377fe640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5c300b6700 0x7f5c300b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.649+0000 7f5c34ff9640 1 -- 172.21.15.7:0/255527849 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c38005220 con 0x55574038b1b0 2024-09-21T05:58:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.649+0000 7f5c34ff9640 1 -- 172.21.15.7:0/255527849 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c3800be40 con 0x55574038b1b0 2024-09-21T05:58:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.649+0000 7f5c34ff9640 1 -- 172.21.15.7:0/255527849 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c380117c0 con 0x55574038b1b0 2024-09-21T05:58:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.649+0000 7f5c46d9d640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5c300b6700 0x7f5c300b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.649+0000 7f5c377fe640 1 -- 172.21.15.7:0/4134842451 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f5c3c107e50 con 0x7f5c48102fa0 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.650+0000 7f5c46d9d640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5c300b6700 0x7f5c300b8c10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5c40005fd0 tx=0x7f5c40009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.650+0000 7f5c532b1740 1 -- 172.21.15.7:0/255527849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 msgr2=0x55574075bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.650+0000 7f5c532b1740 1 --2- 172.21.15.7:0/255527849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 0x55574075bbe0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800bd50 tx=0x7f5c380107a0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.650+0000 7f5c532b1740 1 -- 172.21.15.7:0/255527849 shutdown_connections 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.650+0000 7f5c532b1740 1 --2- 172.21.15.7:0/255527849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 0x55574075bbe0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.650+0000 7f5c532b1740 1 --2- 172.21.15.7:0/255527849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 0x55574075c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.650+0000 7f5c532b1740 1 --2- 172.21.15.7:0/255527849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x55574075b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.650+0000 7f5c532b1740 1 -- 172.21.15.7:0/255527849 >> 172.21.15.7:0/255527849 conn(0x5557403a8460 msgr2=0x555740759590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.650+0000 7f5c532b1740 1 -- 172.21.15.7:0/255527849 shutdown_connections 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.650+0000 7f5c532b1740 1 -- 172.21.15.7:0/255527849 wait complete. 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c532b1740 1 -- start start 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c532b1740 1 Processor -- start 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c532b1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55574038b1b0 0x555740766d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c532b1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555740393390 0x555740767280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c532b1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x555740767800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c532b1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555740522700 con 0x555740393390 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c532b1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55574065c160 con 0x5557403b4070 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c532b1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555740769e80 con 0x55574038b1b0 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c532b1740 10 client.0 _ll_register_callbacks cb 0x5557406759e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c45d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555740393390 0x555740767280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c45d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555740393390 0x555740767280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34022/0 (socket says 172.21.15.7:34022) 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c45d9b640 1 -- 172.21.15.7:0/300254442 learned_addr learned my addr 172.21.15.7:0/300254442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c46d9d640 1 --2- 172.21.15.7:0/300254442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x555740767800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.651+0000 7f5c4659c640 1 --2- 172.21.15.7:0/300254442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55574038b1b0 0x555740766d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c45d9b640 1 -- 172.21.15.7:0/300254442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55574038b1b0 msgr2=0x555740766d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c45d9b640 1 --2- 172.21.15.7:0/300254442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55574038b1b0 0x555740766d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c45d9b640 1 -- 172.21.15.7:0/300254442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 msgr2=0x555740767800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c45d9b640 1 --2- 172.21.15.7:0/300254442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x555740767800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c45d9b640 1 -- 172.21.15.7:0/300254442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555740689c90 con 0x555740393390 2024-09-21T05:58:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c45d9b640 1 --2- 172.21.15.7:0/300254442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555740393390 0x555740767280 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c105680 tx=0x7f5c3c10b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d814564edf811b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c2dffb640 1 -- 172.21.15.7:0/300254442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c049070 con 0x555740393390 2024-09-21T05:58:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c532b1740 1 -- 172.21.15.7:0/300254442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5557406d3df0 con 0x555740393390 2024-09-21T05:58:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c2dffb640 1 -- 172.21.15.7:0/300254442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f5c3c0ca040 con 0x555740393390 2024-09-21T05:58:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c2dffb640 1 -- 172.21.15.7:0/300254442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5c3c0cd720 con 0x555740393390 2024-09-21T05:58:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c532b1740 10 client.16488 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c532b1740 1 -- 172.21.15.7:0/300254442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555740775b50 con 0x555740393390 2024-09-21T05:58:43.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.652+0000 7f5c2dffb640 1 -- 172.21.15.7:0/300254442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5557406d3df0 con 0x555740393390 2024-09-21T05:58:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.653+0000 7f5c2dffb640 1 -- 172.21.15.7:0/300254442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5c3c03bbf0 con 0x555740393390 2024-09-21T05:58:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.653+0000 7f5c532b1740 10 client.16488 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.653+0000 7f5c532b1740 10 client.16488 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:58:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.653+0000 7f5c532b1740 20 client.16488 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.653+0000 7f5c532b1740 1 --2- 172.21.15.7:0/300254442 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5557403729f0 0x555740779080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.653+0000 7f5c532b1740 4 client.16488 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:58:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.653+0000 7f5c532b1740 1 -- 172.21.15.7:0/300254442 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557406cf8a0 con 0x5557403729f0 2024-09-21T05:58:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.653+0000 7f5c4659c640 1 --2- 172.21.15.7:0/300254442 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5557403729f0 0x555740779080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.653+0000 7f5c4659c640 1 --2- 172.21.15.7:0/300254442 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5557403729f0 0x555740779080 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=28a0db930edc5e77 server_cookie=5790c3c4640784b8 in_seq=0 out_seq=0 2024-09-21T05:58:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.653+0000 7f5c2dffb640 10 client.16488 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:58:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.654+0000 7f5c2dffb640 1 -- 172.21.15.7:0/300254442 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557406cf8a0 con 0x5557403729f0 2024-09-21T05:58:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.654+0000 7f5c2dffb640 10 client.16488 handle_command_reply: tid=0 2024-09-21T05:58:43.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.654+0000 7f5c532b1740 1 client.16488 shutdown 2024-09-21T05:58:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.654+0000 7f5c532b1740 1 -- 172.21.15.7:0/300254442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555740393390 msgr2=0x555740767280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.654+0000 7f5c532b1740 1 --2- 172.21.15.7:0/300254442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555740393390 0x555740767280 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c105680 tx=0x7f5c3c10b590 comp rx=0 tx=0).stop 2024-09-21T05:58:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.654+0000 7f5c532b1740 1 -- 172.21.15.7:0/300254442 shutdown_connections 2024-09-21T05:58:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.654+0000 7f5c532b1740 1 --2- 172.21.15.7:0/300254442 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5557403729f0 0x555740779080 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.654+0000 7f5c532b1740 1 --2- 172.21.15.7:0/300254442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555740393390 0x555740767280 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.654+0000 7f5c532b1740 1 --2- 172.21.15.7:0/300254442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x555740767800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.654+0000 7f5c532b1740 1 --2- 172.21.15.7:0/300254442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55574038b1b0 0x555740766d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.654+0000 7f5c2dffb640 0 client.16488 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:58:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.654+0000 7f5c532b1740 1 -- 172.21.15.7:0/300254442 >> 172.21.15.7:0/300254442 conn(0x5557403a8460 msgr2=0x55574075e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.655+0000 7f5c532b1740 1 -- 172.21.15.7:0/300254442 shutdown_connections 2024-09-21T05:58:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.655+0000 7f5c532b1740 1 -- 172.21.15.7:0/300254442 wait complete. 2024-09-21T05:58:43.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.655+0000 7f5c532b1740 20 client.16488 trim_cache size 0 max 16384 2024-09-21T05:58:43.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.668+0000 7f5c532b1740 1 Processor -- start 2024-09-21T05:58:43.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.668+0000 7f5c532b1740 1 -- start start 2024-09-21T05:58:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.668+0000 7f5c532b1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55574038b1b0 0x555740766af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.668+0000 7f5c532b1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 0x555740767030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.668+0000 7f5c532b1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557403b4070 0x555740763f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.668+0000 7f5c532b1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5c481b3fc0 con 0x5557403b4070 2024-09-21T05:58:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.668+0000 7f5c532b1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5c481b1890 con 0x55574038b1b0 2024-09-21T05:58:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.668+0000 7f5c532b1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5c481af6e0 con 0x555740393390 2024-09-21T05:58:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.668+0000 7f5c46d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557403b4070 0x555740763f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.668+0000 7f5c46d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557403b4070 0x555740763f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34038/0 (socket says 172.21.15.7:34038) 2024-09-21T05:58:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.668+0000 7f5c46d9d640 1 -- 172.21.15.7:0/1261543614 learned_addr learned my addr 172.21.15.7:0/1261543614 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.668+0000 7f5c4659c640 1 --2- 172.21.15.7:0/1261543614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55574038b1b0 0x555740766af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.668+0000 7f5c45d9b640 1 --2- 172.21.15.7:0/1261543614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 0x555740767030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.669+0000 7f5c46d9d640 1 -- 172.21.15.7:0/1261543614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 msgr2=0x555740767030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:43.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.669+0000 7f5c46d9d640 1 --2- 172.21.15.7:0/1261543614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 0x555740767030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.669+0000 7f5c46d9d640 1 -- 172.21.15.7:0/1261543614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55574038b1b0 msgr2=0x555740766af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:43.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.669+0000 7f5c46d9d640 1 --2- 172.21.15.7:0/1261543614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55574038b1b0 0x555740766af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.669+0000 7f5c46d9d640 1 -- 172.21.15.7:0/1261543614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55574075a350 con 0x5557403b4070 2024-09-21T05:58:43.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.669+0000 7f5c46d9d640 1 --2- 172.21.15.7:0/1261543614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557403b4070 0x555740763f30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f5c40011870 tx=0x7f5c40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f40325d625c391 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:43.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.669+0000 7f5c2ffff640 1 -- 172.21.15.7:0/1261543614 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c40003970 con 0x5557403b4070 2024-09-21T05:58:43.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.669+0000 7f5c2ffff640 1 -- 172.21.15.7:0/1261543614 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c40004020 con 0x5557403b4070 2024-09-21T05:58:43.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.669+0000 7f5c2ffff640 1 -- 172.21.15.7:0/1261543614 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c40028650 con 0x5557403b4070 2024-09-21T05:58:43.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.670+0000 7f5c532b1740 1 -- 172.21.15.7:0/1261543614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557403b4070 msgr2=0x555740763f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.670+0000 7f5c532b1740 1 --2- 172.21.15.7:0/1261543614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557403b4070 0x555740763f30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f5c40011870 tx=0x7f5c40016000 comp rx=0 tx=0).stop 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.670+0000 7f5c532b1740 1 -- 172.21.15.7:0/1261543614 shutdown_connections 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.670+0000 7f5c532b1740 1 --2- 172.21.15.7:0/1261543614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557403b4070 0x555740763f30 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.670+0000 7f5c532b1740 1 --2- 172.21.15.7:0/1261543614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 0x555740767030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.670+0000 7f5c532b1740 1 --2- 172.21.15.7:0/1261543614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55574038b1b0 0x555740766af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.670+0000 7f5c532b1740 1 -- 172.21.15.7:0/1261543614 >> 172.21.15.7:0/1261543614 conn(0x5557403a8460 msgr2=0x5557407655c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.670+0000 7f5c532b1740 1 -- 172.21.15.7:0/1261543614 shutdown_connections 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.670+0000 7f5c532b1740 1 -- 172.21.15.7:0/1261543614 wait complete. 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.670+0000 7f5c532b1740 1 -- start start 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.670+0000 7f5c532b1740 1 Processor -- start 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c532b1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 0x55574076f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c532b1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 0x55574076ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c532b1740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x55574076b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c532b1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5c481afd50 con 0x55574038b1b0 2024-09-21T05:58:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c532b1740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5c481b11c0 con 0x5557403b4070 2024-09-21T05:58:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c532b1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5c481b0420 con 0x555740393390 2024-09-21T05:58:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c532b1740 10 client.0 _ll_register_callbacks cb 0x7f5c3c10b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c4659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 0x55574076f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c4659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 0x55574076f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34042/0 (socket says 172.21.15.7:34042) 2024-09-21T05:58:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c4659c640 1 -- 172.21.15.7:0/732468285 learned_addr learned my addr 172.21.15.7:0/732468285 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c46d9d640 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x55574076b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c45d9b640 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 0x55574076ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c4659c640 1 -- 172.21.15.7:0/732468285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 msgr2=0x55574076ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c4659c640 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 0x55574076ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c4659c640 1 -- 172.21.15.7:0/732468285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 msgr2=0x55574076b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c4659c640 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x55574076b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c4659c640 1 -- 172.21.15.7:0/732468285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55574076baf0 con 0x55574038b1b0 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c45d9b640 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 0x55574076ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c46d9d640 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x55574076b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c4659c640 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 0x55574076f930 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5c38010ca0 tx=0x7f5c3800b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1704f0a32e919307 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c2dffb640 1 -- 172.21.15.7:0/732468285 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c38032060 con 0x55574038b1b0 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c532b1740 1 -- 172.21.15.7:0/732468285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c40004020 con 0x55574038b1b0 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.671+0000 7f5c2dffb640 1 -- 172.21.15.7:0/732468285 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f5c38004660 con 0x55574038b1b0 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.672+0000 7f5c2dffb640 1 -- 172.21.15.7:0/732468285 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5c38005590 con 0x55574038b1b0 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.672+0000 7f5c532b1740 10 client.16494 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.672+0000 7f5c532b1740 1 -- 172.21.15.7:0/732468285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5557407e3990 con 0x55574038b1b0 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.672+0000 7f5c2dffb640 1 -- 172.21.15.7:0/732468285 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c40004020 con 0x55574038b1b0 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.672+0000 7f5c2dffb640 1 -- 172.21.15.7:0/732468285 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5c38011a70 con 0x55574038b1b0 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.672+0000 7f5c532b1740 10 client.16494 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.672+0000 7f5c532b1740 10 client.16494 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.672+0000 7f5c532b1740 20 client.16494 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.672+0000 7f5c532b1740 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x555740347da0 0x5557407e5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.672+0000 7f5c532b1740 4 client.16494 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.672+0000 7f5c532b1740 1 -- 172.21.15.7:0/732468285 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5557406cccd0 con 0x555740347da0 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.672+0000 7f5c45d9b640 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x555740347da0 0x5557407e5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c45d9b640 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x555740347da0 0x5557407e5fc0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e13f8b7a20c17873 server_cookie=624f0b4bdda29368 in_seq=0 out_seq=0 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c2dffb640 10 client.16494 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c2dffb640 1 -- 172.21.15.7:0/732468285 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5557406cccd0 con 0x555740347da0 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c2dffb640 10 client.16494 handle_command_reply: tid=0 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c532b1740 1 client.16494 shutdown 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c532b1740 1 -- 172.21.15.7:0/732468285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 msgr2=0x55574076f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c532b1740 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 0x55574076f930 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5c38010ca0 tx=0x7f5c3800b410 comp rx=0 tx=0).stop 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c532b1740 1 -- 172.21.15.7:0/732468285 shutdown_connections 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c532b1740 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x555740347da0 0x5557407e5fc0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c532b1740 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5557403b4070 0x55574076b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c532b1740 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555740393390 0x55574076ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c532b1740 1 --2- 172.21.15.7:0/732468285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55574038b1b0 0x55574076f930 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c532b1740 1 -- 172.21.15.7:0/732468285 >> 172.21.15.7:0/732468285 conn(0x5557403a8460 msgr2=0x555740766af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:43.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c2dffb640 0 client.16494 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:58:43.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c532b1740 1 -- 172.21.15.7:0/732468285 shutdown_connections 2024-09-21T05:58:43.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.673+0000 7f5c532b1740 1 -- 172.21.15.7:0/732468285 wait complete. 2024-09-21T05:58:43.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.674+0000 7f5c532b1740 20 client.16494 trim_cache size 0 max 16384 2024-09-21T05:58:43.680 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:58:43.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.674+0000 7f5c4cd3d640 1 -- 172.21.15.7:0/4134842451 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5c300b6700 msgr2=0x7f5c300b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:43.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.674+0000 7f5c4cd3d640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5c300b6700 0x7f5c300b8c10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5c40005fd0 tx=0x7f5c40009600 comp rx=0 tx=0).stop 2024-09-21T05:58:43.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.674+0000 7f5c4cd3d640 1 -- 172.21.15.7:0/4134842451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c48102fa0 msgr2=0x7f5c4819cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:43.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.674+0000 7f5c4cd3d640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c48102fa0 0x7f5c4819cc20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c005940 tx=0x7f5c3c0042f0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.674+0000 7f5c4cd3d640 1 -- 172.21.15.7:0/4134842451 shutdown_connections 2024-09-21T05:58:43.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.674+0000 7f5c4cd3d640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5c300b6700 0x7f5c300b8c10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.674+0000 7f5c4cd3d640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c48102fa0 0x7f5c4819cc20 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.674+0000 7f5c4cd3d640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c48110200 0x7f5c481a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.674+0000 7f5c4cd3d640 1 --2- 172.21.15.7:0/4134842451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c48102650 0x7f5c4819c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:43.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.674+0000 7f5c4cd3d640 1 -- 172.21.15.7:0/4134842451 >> 172.21.15.7:0/4134842451 conn(0x7f5c48079740 msgr2=0x7f5c48111680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:43.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.674+0000 7f5c4cd3d640 1 -- 172.21.15.7:0/4134842451 shutdown_connections 2024-09-21T05:58:43.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:43.674+0000 7f5c4cd3d640 1 -- 172.21.15.7:0/4134842451 wait complete. 2024-09-21T05:58:43.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:43 smithi007 ceph-mon[30983]: pgmap v463: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:58:44.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:43 smithi119 ceph-mon[34833]: pgmap v463: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:58:44.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:43 smithi027 ceph-mon[34364]: pgmap v463: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:58:44.455 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T05:58:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.202+0000 7f367871d640 1 -- 172.21.15.7:0/4220870241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3670109e40 msgr2=0x7f3670110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.202+0000 7f367871d640 1 --2- 172.21.15.7:0/4220870241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3670109e40 0x7f3670110670 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3668009ca0 tx=0x7f366802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.202+0000 7f367871d640 1 -- 172.21.15.7:0/4220870241 shutdown_connections 2024-09-21T05:58:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.202+0000 7f367871d640 1 --2- 172.21.15.7:0/4220870241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3670109e40 0x7f3670110670 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.202+0000 7f367871d640 1 --2- 172.21.15.7:0/4220870241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36701094f0 0x7f3670109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.202+0000 7f367871d640 1 --2- 172.21.15.7:0/4220870241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3670103bb0 0x7f3670103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.202+0000 7f367871d640 1 -- 172.21.15.7:0/4220870241 >> 172.21.15.7:0/4220870241 conn(0x7f36700ff600 msgr2=0x7f3670101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.202+0000 7f367871d640 1 -- 172.21.15.7:0/4220870241 shutdown_connections 2024-09-21T05:58:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.202+0000 7f367871d640 1 -- 172.21.15.7:0/4220870241 wait complete. 2024-09-21T05:58:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.203+0000 7f367871d640 1 Processor -- start 2024-09-21T05:58:45.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.203+0000 7f367871d640 1 -- start start 2024-09-21T05:58:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.203+0000 7f367871d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3670103bb0 0x7f367019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.203+0000 7f367871d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36701094f0 0x7f367019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.203+0000 7f367871d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3670109e40 0x7f367019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.203+0000 7f367871d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3670113b00 con 0x7f36701094f0 2024-09-21T05:58:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.203+0000 7f367871d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3670113980 con 0x7f3670103bb0 2024-09-21T05:58:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.203+0000 7f367871d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3670113c80 con 0x7f3670109e40 2024-09-21T05:58:45.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.203+0000 7f3675cb8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36701094f0 0x7f367019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.203+0000 7f3675cb8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36701094f0 0x7f367019a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34056/0 (socket says 172.21.15.7:34056) 2024-09-21T05:58:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.203+0000 7f3675cb8640 1 -- 172.21.15.7:0/273625036 learned_addr learned my addr 172.21.15.7:0/273625036 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f36764b9640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3670103bb0 0x7f367019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f3676cba640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3670109e40 0x7f367019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f3675cb8640 1 -- 172.21.15.7:0/273625036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3670109e40 msgr2=0x7f367019fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f3675cb8640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3670109e40 0x7f367019fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f3675cb8640 1 -- 172.21.15.7:0/273625036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3670103bb0 msgr2=0x7f367019a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f3675cb8640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3670103bb0 0x7f367019a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f3675cb8640 1 -- 172.21.15.7:0/273625036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36701a02e0 con 0x7f36701094f0 2024-09-21T05:58:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f3676cba640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3670109e40 0x7f367019fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:58:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f36764b9640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3670103bb0 0x7f367019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:58:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f3675cb8640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36701094f0 0x7f367019a9d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f366000e9f0 tx=0x7f366000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:45.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f36677fe640 1 -- 172.21.15.7:0/273625036 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366000ccc0 con 0x7f36701094f0 2024-09-21T05:58:45.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f367871d640 1 -- 172.21.15.7:0/273625036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36701a05d0 con 0x7f36701094f0 2024-09-21T05:58:45.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f36677fe640 1 -- 172.21.15.7:0/273625036 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36600108e0 con 0x7f36701094f0 2024-09-21T05:58:45.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f36677fe640 1 -- 172.21.15.7:0/273625036 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660018860 con 0x7f36701094f0 2024-09-21T05:58:45.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.204+0000 7f367871d640 1 -- 172.21.15.7:0/273625036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36701a6df0 con 0x7f36701094f0 2024-09-21T05:58:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.207+0000 7f367ec91740 1 Processor -- start 2024-09-21T05:58:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.207+0000 7f367ec91740 1 -- start start 2024-09-21T05:58:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.207+0000 7f36677fe640 1 -- 172.21.15.7:0/273625036 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3660010430 con 0x7f36701094f0 2024-09-21T05:58:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.207+0000 7f367ec91740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 0x55c1eaba92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.207+0000 7f367ec91740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eaba9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.207+0000 7f367ec91740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7e1390 0x55c1eaba9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.207+0000 7f367ec91740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c1eab1fea0 con 0x55c1ea802070 2024-09-21T05:58:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.207+0000 7f367ec91740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c1eab0f2d0 con 0x55c1ea7e1390 2024-09-21T05:58:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.207+0000 7f367ec91740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c1eab130e0 con 0x55c1ea7d91b0 2024-09-21T05:58:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f3676cba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 0x55c1eaba92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f3676cba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 0x55c1eaba92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34072/0 (socket says 172.21.15.7:34072) 2024-09-21T05:58:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f3676cba640 1 -- 172.21.15.7:0/4120676564 learned_addr learned my addr 172.21.15.7:0/4120676564 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f36764b9640 1 --2- 172.21.15.7:0/4120676564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eaba9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f3675cb8640 1 --2- 172.21.15.7:0/4120676564 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7e1390 0x55c1eaba9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f3676cba640 1 -- 172.21.15.7:0/4120676564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 msgr2=0x55c1eaba9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f3676cba640 1 --2- 172.21.15.7:0/4120676564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eaba9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f3676cba640 1 -- 172.21.15.7:0/4120676564 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7e1390 msgr2=0x55c1eaba9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f3676cba640 1 --2- 172.21.15.7:0/4120676564 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7e1390 0x55c1eaba9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f3676cba640 1 -- 172.21.15.7:0/4120676564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1ea86d650 con 0x55c1ea802070 2024-09-21T05:58:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f3675cb8640 1 --2- 172.21.15.7:0/4120676564 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7e1390 0x55c1eaba9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f3676cba640 1 --2- 172.21.15.7:0/4120676564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 0x55c1eaba92c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f366802f500 tx=0x7f3668009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d234e92c56a09479 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f36677fe640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f365c0b66b0 0x7f365c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.208+0000 7f3664ff9640 1 -- 172.21.15.7:0/4120676564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668031450 con 0x55c1ea802070 2024-09-21T05:58:45.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.209+0000 7f3664ff9640 1 -- 172.21.15.7:0/4120676564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3668036040 con 0x55c1ea802070 2024-09-21T05:58:45.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.209+0000 7f3664ff9640 1 -- 172.21.15.7:0/4120676564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668004390 con 0x55c1ea802070 2024-09-21T05:58:45.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.209+0000 7f36764b9640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f365c0b66b0 0x7f365c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.209+0000 7f36677fe640 1 -- 172.21.15.7:0/273625036 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f36600e7aa0 con 0x7f36701094f0 2024-09-21T05:58:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.210+0000 7f367ec91740 1 -- 172.21.15.7:0/4120676564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 msgr2=0x55c1eaba92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.210+0000 7f36764b9640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f365c0b66b0 0x7f365c0b8bc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f366c005fd0 tx=0x7f366c005f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.210+0000 7f367ec91740 1 --2- 172.21.15.7:0/4120676564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 0x55c1eaba92c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f366802f500 tx=0x7f3668009910 comp rx=0 tx=0).stop 2024-09-21T05:58:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.210+0000 7f367ec91740 1 -- 172.21.15.7:0/4120676564 shutdown_connections 2024-09-21T05:58:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.210+0000 7f367ec91740 1 --2- 172.21.15.7:0/4120676564 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7e1390 0x55c1eaba9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.210+0000 7f367ec91740 1 --2- 172.21.15.7:0/4120676564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eaba9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.210+0000 7f367ec91740 1 --2- 172.21.15.7:0/4120676564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 0x55c1eaba92c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.210+0000 7f367ec91740 1 -- 172.21.15.7:0/4120676564 >> 172.21.15.7:0/4120676564 conn(0x55c1ea7f6460 msgr2=0x55c1eaba71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:45.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.210+0000 7f367ec91740 1 -- 172.21.15.7:0/4120676564 shutdown_connections 2024-09-21T05:58:45.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.210+0000 7f367ec91740 1 -- 172.21.15.7:0/4120676564 wait complete. 2024-09-21T05:58:45.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.210+0000 7f367ec91740 1 -- start start 2024-09-21T05:58:45.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.210+0000 7f367ec91740 1 Processor -- start 2024-09-21T05:58:45.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f367ec91740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eabb49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f367ec91740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 0x55c1eabb4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f367ec91740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea802070 0x55c1eabc5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f367ec91740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c1ea970700 con 0x55c1ea7e1390 2024-09-21T05:58:45.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f367ec91740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c1eaaaa160 con 0x55c1ea802070 2024-09-21T05:58:45.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f367ec91740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c1eabbbe50 con 0x55c1ea7d91b0 2024-09-21T05:58:45.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f367ec91740 10 client.0 _ll_register_callbacks cb 0x55c1eaac39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:45.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f3675cb8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 0x55c1eabb4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f3675cb8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 0x55c1eabb4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34080/0 (socket says 172.21.15.7:34080) 2024-09-21T05:58:45.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f3675cb8640 1 -- 172.21.15.7:0/1102744036 learned_addr learned my addr 172.21.15.7:0/1102744036 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:45.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f36764b9640 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eabb49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f3676cba640 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea802070 0x55c1eabc5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f3675cb8640 1 -- 172.21.15.7:0/1102744036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 msgr2=0x55c1eabb49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:45.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f3675cb8640 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eabb49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f3675cb8640 1 -- 172.21.15.7:0/1102744036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea802070 msgr2=0x55c1eabc5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:45.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f3675cb8640 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea802070 0x55c1eabc5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f3675cb8640 1 -- 172.21.15.7:0/1102744036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1eaad7c90 con 0x55c1ea7e1390 2024-09-21T05:58:45.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f3676cba640 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea802070 0x55c1eabc5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:45.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f36764b9640 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eabb49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:45.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f3675cb8640 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 0x55c1eabb4f20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f366000e9c0 tx=0x7f36600ad2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac0fbf27cb74f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:45.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.211+0000 7f3659ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:45.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f3659ffb640 1 -- 172.21.15.7:0/1102744036 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36600a90e0 con 0x55c1ea7e1390 2024-09-21T05:58:45.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f3659ffb640 1 -- 172.21.15.7:0/1102744036 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f36600a94c0 con 0x55c1ea7e1390 2024-09-21T05:58:45.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f367ec91740 1 -- 172.21.15.7:0/1102744036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3668036040 con 0x55c1ea7e1390 2024-09-21T05:58:45.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f3659ffb640 1 -- 172.21.15.7:0/1102744036 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3660010720 con 0x55c1ea7e1390 2024-09-21T05:58:45.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f367ec91740 10 client.16506 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:45.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f367ec91740 1 -- 172.21.15.7:0/1102744036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c1eabc7b60 con 0x55c1ea7e1390 2024-09-21T05:58:45.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f3659ffb640 1 -- 172.21.15.7:0/1102744036 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3668036040 con 0x55c1ea7e1390 2024-09-21T05:58:45.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f3659ffb640 1 -- 172.21.15.7:0/1102744036 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f36600d2020 con 0x55c1ea7e1390 2024-09-21T05:58:45.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f367ec91740 10 client.16506 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:45.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f367ec91740 10 client.16506 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:58:45.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f367ec91740 20 client.16506 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:45.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f367ec91740 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c1ea7c09f0 0x55c1eabcb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f367ec91740 4 client.16506 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:58:45.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.212+0000 7f367ec91740 1 -- 172.21.15.7:0/1102744036 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1eab21df0 con 0x55c1ea7c09f0 2024-09-21T05:58:45.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.213+0000 7f36764b9640 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c1ea7c09f0 0x55c1eabcb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.213+0000 7f36764b9640 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c1ea7c09f0 0x55c1eabcb080 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf54ea6e6285b49a server_cookie=72b98a111b4a59d6 in_seq=0 out_seq=0 2024-09-21T05:58:45.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.213+0000 7f3659ffb640 10 client.16506 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:58:45.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f3659ffb640 1 -- 172.21.15.7:0/1102744036 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c1eab21df0 con 0x55c1ea7c09f0 2024-09-21T05:58:45.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f3659ffb640 10 client.16506 handle_command_reply: tid=0 2024-09-21T05:58:45.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f367ec91740 1 client.16506 shutdown 2024-09-21T05:58:45.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f367ec91740 1 -- 172.21.15.7:0/1102744036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 msgr2=0x55c1eabb4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:45.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f367ec91740 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 0x55c1eabb4f20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f366000e9c0 tx=0x7f36600ad2c0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f367ec91740 1 -- 172.21.15.7:0/1102744036 shutdown_connections 2024-09-21T05:58:45.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f367ec91740 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c1ea7c09f0 0x55c1eabcb080 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f367ec91740 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 0x55c1eabb4f20 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f367ec91740 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea802070 0x55c1eabc5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f367ec91740 1 --2- 172.21.15.7:0/1102744036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eabb49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f367ec91740 1 -- 172.21.15.7:0/1102744036 >> 172.21.15.7:0/1102744036 conn(0x55c1ea7f6460 msgr2=0x55c1eabac470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:45.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f3659ffb640 0 client.16506 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:58:45.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f367ec91740 1 -- 172.21.15.7:0/1102744036 shutdown_connections 2024-09-21T05:58:45.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f367ec91740 1 -- 172.21.15.7:0/1102744036 wait complete. 2024-09-21T05:58:45.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.214+0000 7f367ec91740 20 client.16506 trim_cache size 0 max 16384 2024-09-21T05:58:45.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.227+0000 7f367ec91740 1 Processor -- start 2024-09-21T05:58:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f367ec91740 1 -- start start 2024-09-21T05:58:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f367ec91740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7d91b0 0x55c1eabacad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f367ec91740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 0x55c1eabc5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f367ec91740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea802070 0x55c1eabb1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f367ec91740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36701afc20 con 0x55c1ea7e1390 2024-09-21T05:58:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f367ec91740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f36701ad4f0 con 0x55c1ea7d91b0 2024-09-21T05:58:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f367ec91740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f36701ab340 con 0x55c1ea802070 2024-09-21T05:58:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f3675cb8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 0x55c1eabc5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f3675cb8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 0x55c1eabc5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34090/0 (socket says 172.21.15.7:34090) 2024-09-21T05:58:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f3675cb8640 1 -- 172.21.15.7:0/90101572 learned_addr learned my addr 172.21.15.7:0/90101572 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f3675cb8640 1 -- 172.21.15.7:0/90101572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea802070 msgr2=0x55c1eabb1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f3675cb8640 1 --2- 172.21.15.7:0/90101572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea802070 0x55c1eabb1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f3675cb8640 1 -- 172.21.15.7:0/90101572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7d91b0 msgr2=0x55c1eabacad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f3675cb8640 1 --2- 172.21.15.7:0/90101572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7d91b0 0x55c1eabacad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f3675cb8640 1 -- 172.21.15.7:0/90101572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1eaba25d0 con 0x55c1ea7e1390 2024-09-21T05:58:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.228+0000 7f3675cb8640 1 --2- 172.21.15.7:0/90101572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 0x55c1eabc5070 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f36600ad670 tx=0x7f3660009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ed1f46378ee6b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.229+0000 7f365bfff640 1 -- 172.21.15.7:0/90101572 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36600a90e0 con 0x55c1ea7e1390 2024-09-21T05:58:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.229+0000 7f365bfff640 1 -- 172.21.15.7:0/90101572 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36600ad480 con 0x55c1ea7e1390 2024-09-21T05:58:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.229+0000 7f365bfff640 1 -- 172.21.15.7:0/90101572 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36600a9810 con 0x55c1ea7e1390 2024-09-21T05:58:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.229+0000 7f367ec91740 1 -- 172.21.15.7:0/90101572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 msgr2=0x55c1eabc5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.229+0000 7f367ec91740 1 --2- 172.21.15.7:0/90101572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 0x55c1eabc5070 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f36600ad670 tx=0x7f3660009740 comp rx=0 tx=0).stop 2024-09-21T05:58:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.229+0000 7f367ec91740 1 -- 172.21.15.7:0/90101572 shutdown_connections 2024-09-21T05:58:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.229+0000 7f367ec91740 1 --2- 172.21.15.7:0/90101572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea7e1390 0x55c1eabc5070 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.229+0000 7f367ec91740 1 --2- 172.21.15.7:0/90101572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea802070 0x55c1eabb1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.229+0000 7f367ec91740 1 --2- 172.21.15.7:0/90101572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7d91b0 0x55c1eabacad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.229+0000 7f367ec91740 1 -- 172.21.15.7:0/90101572 >> 172.21.15.7:0/90101572 conn(0x55c1ea7f6460 msgr2=0x55c1eabac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.230+0000 7f367ec91740 1 -- 172.21.15.7:0/90101572 shutdown_connections 2024-09-21T05:58:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.230+0000 7f367ec91740 1 -- 172.21.15.7:0/90101572 wait complete. 2024-09-21T05:58:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.230+0000 7f367ec91740 1 -- start start 2024-09-21T05:58:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.230+0000 7f367ec91740 1 Processor -- start 2024-09-21T05:58:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.230+0000 7f367ec91740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eabc15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.230+0000 7f367ec91740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7e1390 0x55c1eabbca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.230+0000 7f367ec91740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 0x55c1eabbcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.230+0000 7f367ec91740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36701ab9b0 con 0x55c1ea802070 2024-09-21T05:58:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.230+0000 7f367ec91740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f36701ace20 con 0x55c1ea7e1390 2024-09-21T05:58:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.230+0000 7f367ec91740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f36701ac080 con 0x55c1ea7d91b0 2024-09-21T05:58:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.230+0000 7f367ec91740 10 client.0 _ll_register_callbacks cb 0x7f366000c7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.230+0000 7f3676cba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 0x55c1eabbcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f36764b9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eabc15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f3676cba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 0x55c1eabbcf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34096/0 (socket says 172.21.15.7:34096) 2024-09-21T05:58:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f36764b9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eabc15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:45060/0 (socket says 172.21.15.7:45060) 2024-09-21T05:58:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f3676cba640 1 -- 172.21.15.7:0/3833871988 learned_addr learned my addr 172.21.15.7:0/3833871988 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f3675cb8640 1 --2- 172.21.15.7:0/3833871988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7e1390 0x55c1eabbca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f3676cba640 1 -- 172.21.15.7:0/3833871988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 msgr2=0x55c1eabc15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f3676cba640 1 --2- 172.21.15.7:0/3833871988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eabc15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f3676cba640 1 -- 172.21.15.7:0/3833871988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7e1390 msgr2=0x55c1eabbca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f3676cba640 1 --2- 172.21.15.7:0/3833871988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7e1390 0x55c1eabbca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f3676cba640 1 -- 172.21.15.7:0/3833871988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1eabbd4d0 con 0x55c1ea802070 2024-09-21T05:58:45.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f3676cba640 1 --2- 172.21.15.7:0/3833871988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 0x55c1eabbcf90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f366802ade0 tx=0x7f366802afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171a2a741149fae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:45.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f3659ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:45.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f3659ffb640 1 -- 172.21.15.7:0/3833871988 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668031660 con 0x55c1ea802070 2024-09-21T05:58:45.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f367ec91740 1 -- 172.21.15.7:0/3833871988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36600ad480 con 0x55c1ea802070 2024-09-21T05:58:45.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.231+0000 7f3659ffb640 1 -- 172.21.15.7:0/3833871988 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f3668031800 con 0x55c1ea802070 2024-09-21T05:58:45.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.232+0000 7f3659ffb640 1 -- 172.21.15.7:0/3833871988 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3668003970 con 0x55c1ea802070 2024-09-21T05:58:45.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.232+0000 7f367ec91740 10 client.16512 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:45.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.232+0000 7f367ec91740 1 -- 172.21.15.7:0/3833871988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c1eac35690 con 0x55c1ea802070 2024-09-21T05:58:45.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.232+0000 7f3659ffb640 1 -- 172.21.15.7:0/3833871988 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36600ad480 con 0x55c1ea802070 2024-09-21T05:58:45.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.232+0000 7f3659ffb640 1 -- 172.21.15.7:0/3833871988 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f366802f660 con 0x55c1ea802070 2024-09-21T05:58:45.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.232+0000 7f367ec91740 10 client.16512 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:45.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.232+0000 7f367ec91740 10 client.16512 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:58:45.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.232+0000 7f367ec91740 20 client.16512 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:45.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.232+0000 7f367ec91740 1 --2- 172.21.15.7:0/3833871988 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c1ea795da0 0x55c1eac379d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:45.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.232+0000 7f367ec91740 4 client.16512 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:58:45.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.232+0000 7f367ec91740 1 -- 172.21.15.7:0/3833871988 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c1eab1d8a0 con 0x55c1ea795da0 2024-09-21T05:58:45.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.232+0000 7f36764b9640 1 --2- 172.21.15.7:0/3833871988 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c1ea795da0 0x55c1eac379d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:45.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f36764b9640 1 --2- 172.21.15.7:0/3833871988 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c1ea795da0 0x55c1eac379d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=859039b6693b2527 server_cookie=3cc6af40bd1dad6e in_seq=0 out_seq=0 2024-09-21T05:58:45.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f3659ffb640 10 client.16512 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:58:45.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f3659ffb640 1 -- 172.21.15.7:0/3833871988 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c1eab1d8a0 con 0x55c1ea795da0 2024-09-21T05:58:45.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f3659ffb640 10 client.16512 handle_command_reply: tid=0 2024-09-21T05:58:45.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f367ec91740 1 client.16512 shutdown 2024-09-21T05:58:45.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f367ec91740 1 -- 172.21.15.7:0/3833871988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 msgr2=0x55c1eabbcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:45.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f367ec91740 1 --2- 172.21.15.7:0/3833871988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 0x55c1eabbcf90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f366802ade0 tx=0x7f366802afa0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f367ec91740 1 -- 172.21.15.7:0/3833871988 shutdown_connections 2024-09-21T05:58:45.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f367ec91740 1 --2- 172.21.15.7:0/3833871988 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55c1ea795da0 0x55c1eac379d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f367ec91740 1 --2- 172.21.15.7:0/3833871988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c1ea802070 0x55c1eabbcf90 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f367ec91740 1 --2- 172.21.15.7:0/3833871988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c1ea7e1390 0x55c1eabbca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f367ec91740 1 --2- 172.21.15.7:0/3833871988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c1ea7d91b0 0x55c1eabc15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f367ec91740 1 -- 172.21.15.7:0/3833871988 >> 172.21.15.7:0/3833871988 conn(0x55c1ea7f6460 msgr2=0x55c1eabaa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:45.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.233+0000 7f3659ffb640 0 client.16512 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:58:45.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367ec91740 1 -- 172.21.15.7:0/3833871988 shutdown_connections 2024-09-21T05:58:45.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367ec91740 1 -- 172.21.15.7:0/3833871988 wait complete. 2024-09-21T05:58:45.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367ec91740 20 client.16512 trim_cache size 0 max 16384 2024-09-21T05:58:45.248 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:58:45.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367871d640 1 -- 172.21.15.7:0/273625036 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f365c0b66b0 msgr2=0x7f365c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:45.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367871d640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f365c0b66b0 0x7f365c0b8bc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f366c005fd0 tx=0x7f366c005f40 comp rx=0 tx=0).stop 2024-09-21T05:58:45.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367871d640 1 -- 172.21.15.7:0/273625036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36701094f0 msgr2=0x7f367019a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:45.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367871d640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36701094f0 0x7f367019a9d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f366000e9f0 tx=0x7f366000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367871d640 1 -- 172.21.15.7:0/273625036 shutdown_connections 2024-09-21T05:58:45.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367871d640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f365c0b66b0 0x7f365c0b8bc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367871d640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36701094f0 0x7f367019a9d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367871d640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3670109e40 0x7f367019fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367871d640 1 --2- 172.21.15.7:0/273625036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3670103bb0 0x7f367019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367871d640 1 -- 172.21.15.7:0/273625036 >> 172.21.15.7:0/273625036 conn(0x7f36700ff600 msgr2=0x7f3670101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367871d640 1 -- 172.21.15.7:0/273625036 shutdown_connections 2024-09-21T05:58:45.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:45.234+0000 7f367871d640 1 -- 172.21.15.7:0/273625036 wait complete. 2024-09-21T05:58:45.923 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T05:58:46.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:45 smithi007 ceph-mon[30983]: pgmap v464: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:58:46.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:45 smithi119 ceph-mon[34833]: pgmap v464: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:58:46.185 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:46.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:45 smithi027 ceph-mon[34364]: pgmap v464: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:58:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.671+0000 7f165a48b640 1 -- 172.21.15.7:0/1067045364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1654103b80 msgr2=0x7f1654103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.671+0000 7f165a48b640 1 --2- 172.21.15.7:0/1067045364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1654103b80 0x7f1654103f90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1644009900 tx=0x7f164402a410 comp rx=0 tx=0).stop 2024-09-21T05:58:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.671+0000 7f165a48b640 1 -- 172.21.15.7:0/1067045364 shutdown_connections 2024-09-21T05:58:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.671+0000 7f165a48b640 1 --2- 172.21.15.7:0/1067045364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1654109e10 0x7f1654110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.671+0000 7f165a48b640 1 --2- 172.21.15.7:0/1067045364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16541094c0 0x7f16541098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.671+0000 7f165a48b640 1 --2- 172.21.15.7:0/1067045364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1654103b80 0x7f1654103f90 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.671+0000 7f165a48b640 1 -- 172.21.15.7:0/1067045364 >> 172.21.15.7:0/1067045364 conn(0x7f16540ff5d0 msgr2=0x7f1654101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.671+0000 7f165a48b640 1 -- 172.21.15.7:0/1067045364 shutdown_connections 2024-09-21T05:58:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.671+0000 7f165a48b640 1 -- 172.21.15.7:0/1067045364 wait complete. 2024-09-21T05:58:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.671+0000 7f165a48b640 1 Processor -- start 2024-09-21T05:58:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.671+0000 7f165a48b640 1 -- start start 2024-09-21T05:58:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f165a48b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1654103b80 0x7f165419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f165a48b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16541094c0 0x7f165419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f165a48b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1654109e10 0x7f165419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f165a48b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1654113ad0 con 0x7f16541094c0 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f165a48b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1654113950 con 0x7f1654109e10 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f165a48b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1654113c50 con 0x7f1654103b80 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f16537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16541094c0 0x7f165419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f16537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16541094c0 0x7f165419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34110/0 (socket says 172.21.15.7:34110) 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f16537fe640 1 -- 172.21.15.7:0/3710543971 learned_addr learned my addr 172.21.15.7:0/3710543971 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f1658a28640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1654109e10 0x7f165419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f1653fff640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1654103b80 0x7f165419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f16537fe640 1 -- 172.21.15.7:0/3710543971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1654103b80 msgr2=0x7f165419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f16537fe640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1654103b80 0x7f165419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f16537fe640 1 -- 172.21.15.7:0/3710543971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1654109e10 msgr2=0x7f165419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f16537fe640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1654109e10 0x7f165419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.672+0000 7f16537fe640 1 -- 172.21.15.7:0/3710543971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16541a0410 con 0x7f16541094c0 2024-09-21T05:58:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.673+0000 7f16537fe640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16541094c0 0x7f165419aa40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f164800d750 tx=0x7f164800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:46.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.673+0000 7f16517fa640 1 -- 172.21.15.7:0/3710543971 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648017070 con 0x7f16541094c0 2024-09-21T05:58:46.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.673+0000 7f165a48b640 1 -- 172.21.15.7:0/3710543971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16541a0700 con 0x7f16541094c0 2024-09-21T05:58:46.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.673+0000 7f16517fa640 1 -- 172.21.15.7:0/3710543971 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16480054d0 con 0x7f16541094c0 2024-09-21T05:58:46.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.673+0000 7f16517fa640 1 -- 172.21.15.7:0/3710543971 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648004c30 con 0x7f16541094c0 2024-09-21T05:58:46.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.673+0000 7f165a48b640 1 -- 172.21.15.7:0/3710543971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16541a6e60 con 0x7f16541094c0 2024-09-21T05:58:46.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f16517fa640 1 -- 172.21.15.7:0/3710543971 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f1648010460 con 0x7f16541094c0 2024-09-21T05:58:46.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f16609ff740 1 Processor -- start 2024-09-21T05:58:46.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f16609ff740 1 -- start start 2024-09-21T05:58:46.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f16609ff740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf24c6070 0x561bf286d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f16609ff740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf249d1b0 0x561bf286d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f16609ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24a5390 0x561bf286dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f16609ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561bf27e3ea0 con 0x561bf24a5390 2024-09-21T05:58:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f16609ff740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561bf27d32d0 con 0x561bf249d1b0 2024-09-21T05:58:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f16609ff740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561bf27d70e0 con 0x561bf24c6070 2024-09-21T05:58:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f16537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24a5390 0x561bf286dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f1653fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf249d1b0 0x561bf286d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f16537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24a5390 0x561bf286dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34118/0 (socket says 172.21.15.7:34118) 2024-09-21T05:58:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f16537fe640 1 -- 172.21.15.7:0/276703607 learned_addr learned my addr 172.21.15.7:0/276703607 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.676+0000 7f1658a28640 1 --2- 172.21.15.7:0/276703607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf24c6070 0x561bf286d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.677+0000 7f16517fa640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f163c0b6680 0x7f163c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.677+0000 7f1653fff640 1 -- 172.21.15.7:0/276703607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf24c6070 msgr2=0x561bf286d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.677+0000 7f1653fff640 1 --2- 172.21.15.7:0/276703607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf24c6070 0x561bf286d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.677+0000 7f1653fff640 1 -- 172.21.15.7:0/276703607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24a5390 msgr2=0x561bf286dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.677+0000 7f1653fff640 1 --2- 172.21.15.7:0/276703607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24a5390 0x561bf286dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.677+0000 7f1653fff640 1 -- 172.21.15.7:0/276703607 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bf2531650 con 0x561bf249d1b0 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.677+0000 7f1658a28640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f163c0b6680 0x7f163c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.677+0000 7f16517fa640 1 -- 172.21.15.7:0/3710543971 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f16480e7110 con 0x7f16541094c0 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.677+0000 7f1653fff640 1 --2- 172.21.15.7:0/276703607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf249d1b0 0x561bf286d800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1644009230 tx=0x7f1644032ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9557bb4f106c054 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.677+0000 7f163a7fc640 1 -- 172.21.15.7:0/276703607 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164403f070 con 0x561bf249d1b0 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.677+0000 7f163a7fc640 1 -- 172.21.15.7:0/276703607 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1644004030 con 0x561bf249d1b0 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.677+0000 7f163a7fc640 1 -- 172.21.15.7:0/276703607 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644035070 con 0x561bf249d1b0 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.677+0000 7f1658a28640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f163c0b6680 0x7f163c0b8b90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f164c009fd0 tx=0x7f164c004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.678+0000 7f16609ff740 1 -- 172.21.15.7:0/276703607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf249d1b0 msgr2=0x561bf286d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.678+0000 7f16609ff740 1 --2- 172.21.15.7:0/276703607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf249d1b0 0x561bf286d800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1644009230 tx=0x7f1644032ba0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.678+0000 7f16609ff740 1 -- 172.21.15.7:0/276703607 shutdown_connections 2024-09-21T05:58:46.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.678+0000 7f16609ff740 1 --2- 172.21.15.7:0/276703607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24a5390 0x561bf286dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.678+0000 7f16609ff740 1 --2- 172.21.15.7:0/276703607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf249d1b0 0x561bf286d800 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.678+0000 7f16609ff740 1 --2- 172.21.15.7:0/276703607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf24c6070 0x561bf286d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.678+0000 7f16609ff740 1 -- 172.21.15.7:0/276703607 >> 172.21.15.7:0/276703607 conn(0x561bf24ba460 msgr2=0x561bf286b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:46.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.678+0000 7f16609ff740 1 -- 172.21.15.7:0/276703607 shutdown_connections 2024-09-21T05:58:46.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.678+0000 7f16609ff740 1 -- 172.21.15.7:0/276703607 wait complete. 2024-09-21T05:58:46.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.679+0000 7f16609ff740 1 -- start start 2024-09-21T05:58:46.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.679+0000 7f16609ff740 1 Processor -- start 2024-09-21T05:58:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.679+0000 7f16609ff740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf249d1b0 0x561bf2878940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.679+0000 7f16609ff740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf24a5390 0x561bf2878e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.679+0000 7f16609ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf2884d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.679+0000 7f16609ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561bf2634700 con 0x561bf24c6070 2024-09-21T05:58:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.679+0000 7f16609ff740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561bf276e160 con 0x561bf24a5390 2024-09-21T05:58:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.679+0000 7f16609ff740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561bf287ba40 con 0x561bf249d1b0 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f16609ff740 10 client.0 _ll_register_callbacks cb 0x561bf27879e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f1658a28640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf2884d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f16537fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf24a5390 0x561bf2878e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f1658a28640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf2884d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34132/0 (socket says 172.21.15.7:34132) 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f1658a28640 1 -- 172.21.15.7:0/733872991 learned_addr learned my addr 172.21.15.7:0/733872991 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f1653fff640 1 --2- 172.21.15.7:0/733872991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf249d1b0 0x561bf2878940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f1658a28640 1 -- 172.21.15.7:0/733872991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf249d1b0 msgr2=0x561bf2878940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f1658a28640 1 --2- 172.21.15.7:0/733872991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf249d1b0 0x561bf2878940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f1658a28640 1 -- 172.21.15.7:0/733872991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf24a5390 msgr2=0x561bf2878e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f1658a28640 1 --2- 172.21.15.7:0/733872991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf24a5390 0x561bf2878e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f1658a28640 1 -- 172.21.15.7:0/733872991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bf279bc90 con 0x561bf24c6070 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f16537fe640 1 --2- 172.21.15.7:0/733872991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf24a5390 0x561bf2878e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f1658a28640 1 --2- 172.21.15.7:0/733872991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf2884d60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f164c009d20 tx=0x7f164c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2692d3f148e64187 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f16337fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f16337fe640 1 -- 172.21.15.7:0/733872991 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c01ea00 con 0x561bf24c6070 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f16337fe640 1 -- 172.21.15.7:0/733872991 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f164c01eba0 con 0x561bf24c6070 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.680+0000 7f16609ff740 1 -- 172.21.15.7:0/733872991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1644004030 con 0x561bf24c6070 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.681+0000 7f16337fe640 1 -- 172.21.15.7:0/733872991 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f164c01eda0 con 0x561bf24c6070 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.681+0000 7f16609ff740 10 client.16524 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.681+0000 7f16609ff740 1 -- 172.21.15.7:0/733872991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561bf28877a0 con 0x561bf24c6070 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.681+0000 7f16337fe640 1 -- 172.21.15.7:0/733872991 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1644004030 con 0x561bf24c6070 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.681+0000 7f16337fe640 1 -- 172.21.15.7:0/733872991 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f164c028420 con 0x561bf24c6070 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.681+0000 7f16609ff740 10 client.16524 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.681+0000 7f16609ff740 10 client.16524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.681+0000 7f16609ff740 20 client.16524 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.681+0000 7f16609ff740 1 --2- 172.21.15.7:0/733872991 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561bf24849f0 0x561bf288add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.681+0000 7f16609ff740 4 client.16524 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.681+0000 7f16609ff740 1 -- 172.21.15.7:0/733872991 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bf27e5df0 con 0x561bf24849f0 2024-09-21T05:58:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.681+0000 7f1653fff640 1 --2- 172.21.15.7:0/733872991 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561bf24849f0 0x561bf288add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.682+0000 7f1653fff640 1 --2- 172.21.15.7:0/733872991 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561bf24849f0 0x561bf288add0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8096887eb35e7f82 server_cookie=b6b899f9c82a38e2 in_seq=0 out_seq=0 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.682+0000 7f16337fe640 10 client.16524 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16337fe640 1 -- 172.21.15.7:0/733872991 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561bf27e5df0 con 0x561bf24849f0 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16337fe640 10 client.16524 handle_command_reply: tid=0 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16609ff740 1 client.16524 shutdown 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16609ff740 1 -- 172.21.15.7:0/733872991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 msgr2=0x561bf2884d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16609ff740 1 --2- 172.21.15.7:0/733872991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf2884d60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f164c009d20 tx=0x7f164c004ab0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16609ff740 1 -- 172.21.15.7:0/733872991 shutdown_connections 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16609ff740 1 --2- 172.21.15.7:0/733872991 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561bf24849f0 0x561bf288add0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16609ff740 1 --2- 172.21.15.7:0/733872991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf2884d60 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16609ff740 1 --2- 172.21.15.7:0/733872991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf24a5390 0x561bf2878e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16337fe640 0 client.16524 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16609ff740 1 --2- 172.21.15.7:0/733872991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf249d1b0 0x561bf2878940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16609ff740 1 -- 172.21.15.7:0/733872991 >> 172.21.15.7:0/733872991 conn(0x561bf24ba460 msgr2=0x561bf2870450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16609ff740 1 -- 172.21.15.7:0/733872991 shutdown_connections 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16609ff740 1 -- 172.21.15.7:0/733872991 wait complete. 2024-09-21T05:58:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.683+0000 7f16609ff740 20 client.16524 trim_cache size 0 max 16384 2024-09-21T05:58:46.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.696+0000 7f16609ff740 1 Processor -- start 2024-09-21T05:58:46.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.696+0000 7f16609ff740 1 -- start start 2024-09-21T05:58:46.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f16609ff740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf249d1b0 0x561bf2878e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f16609ff740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf24a5390 0x561bf2884c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f16609ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf2875b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f16609ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16541b1dd0 con 0x561bf24c6070 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f16609ff740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f16541af6a0 con 0x561bf24a5390 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f16609ff740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f16541ad510 con 0x561bf249d1b0 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f1658a28640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf2875b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f1658a28640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf2875b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34136/0 (socket says 172.21.15.7:34136) 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f1658a28640 1 -- 172.21.15.7:0/1176760382 learned_addr learned my addr 172.21.15.7:0/1176760382 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f1653fff640 1 --2- 172.21.15.7:0/1176760382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf249d1b0 0x561bf2878e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f16537fe640 1 --2- 172.21.15.7:0/1176760382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf24a5390 0x561bf2884c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f1658a28640 1 -- 172.21.15.7:0/1176760382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf249d1b0 msgr2=0x561bf2878e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f1658a28640 1 --2- 172.21.15.7:0/1176760382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf249d1b0 0x561bf2878e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f1658a28640 1 -- 172.21.15.7:0/1176760382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf24a5390 msgr2=0x561bf2884c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f1658a28640 1 --2- 172.21.15.7:0/1176760382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf24a5390 0x561bf2884c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f1658a28640 1 -- 172.21.15.7:0/1176760382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bf2870120 con 0x561bf24c6070 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f16537fe640 1 --2- 172.21.15.7:0/1176760382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf24a5390 0x561bf2884c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f1653fff640 1 --2- 172.21.15.7:0/1176760382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf249d1b0 0x561bf2878e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:46.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f1658a28640 1 --2- 172.21.15.7:0/1176760382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf2875b30 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f164c028910 tx=0x7f164c004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccb78319153caa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:46.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.697+0000 7f1639ffb640 1 -- 172.21.15.7:0/1176760382 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c035070 con 0x561bf24c6070 2024-09-21T05:58:46.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.698+0000 7f1639ffb640 1 -- 172.21.15.7:0/1176760382 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f164c01ea00 con 0x561bf24c6070 2024-09-21T05:58:46.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.698+0000 7f1639ffb640 1 -- 172.21.15.7:0/1176760382 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c028660 con 0x561bf24c6070 2024-09-21T05:58:46.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.698+0000 7f16609ff740 1 -- 172.21.15.7:0/1176760382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 msgr2=0x561bf2875b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:46.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.698+0000 7f16609ff740 1 --2- 172.21.15.7:0/1176760382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf2875b30 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f164c028910 tx=0x7f164c004980 comp rx=0 tx=0).stop 2024-09-21T05:58:46.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.698+0000 7f16609ff740 1 -- 172.21.15.7:0/1176760382 shutdown_connections 2024-09-21T05:58:46.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.698+0000 7f16609ff740 1 --2- 172.21.15.7:0/1176760382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf2875b30 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.698+0000 7f16609ff740 1 --2- 172.21.15.7:0/1176760382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf24a5390 0x561bf2884c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.698+0000 7f16609ff740 1 --2- 172.21.15.7:0/1176760382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf249d1b0 0x561bf2878e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.698+0000 7f16609ff740 1 -- 172.21.15.7:0/1176760382 >> 172.21.15.7:0/1176760382 conn(0x561bf24ba460 msgr2=0x561bf28786f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.698+0000 7f16609ff740 1 -- 172.21.15.7:0/1176760382 shutdown_connections 2024-09-21T05:58:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.698+0000 7f16609ff740 1 -- 172.21.15.7:0/1176760382 wait complete. 2024-09-21T05:58:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.699+0000 7f16609ff740 1 -- start start 2024-09-21T05:58:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.699+0000 7f16609ff740 1 Processor -- start 2024-09-21T05:58:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.699+0000 7f16609ff740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf249d1b0 0x561bf2881580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.699+0000 7f16609ff740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf24a5390 0x561bf287ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.699+0000 7f16609ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf287d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f16609ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16541adb60 con 0x561bf24c6070 2024-09-21T05:58:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f16609ff740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f16541aefd0 con 0x561bf249d1b0 2024-09-21T05:58:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f16609ff740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f16541ae230 con 0x561bf24a5390 2024-09-21T05:58:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f1658a28640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf287d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f16609ff740 10 client.0 _ll_register_callbacks cb 0x7f164c009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f1658a28640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf287d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34140/0 (socket says 172.21.15.7:34140) 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f1658a28640 1 -- 172.21.15.7:0/2836062287 learned_addr learned my addr 172.21.15.7:0/2836062287 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f1653fff640 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf249d1b0 0x561bf2881580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f16537fe640 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf24a5390 0x561bf287ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f1658a28640 1 -- 172.21.15.7:0/2836062287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf24a5390 msgr2=0x561bf287ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f1658a28640 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf24a5390 0x561bf287ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f1658a28640 1 -- 172.21.15.7:0/2836062287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf249d1b0 msgr2=0x561bf2881580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f1658a28640 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf249d1b0 0x561bf2881580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f1658a28640 1 -- 172.21.15.7:0/2836062287 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bf287d7f0 con 0x561bf24c6070 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f1653fff640 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf249d1b0 0x561bf2881580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f1658a28640 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf287d080 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f164c0095e0 tx=0x7f164c01e360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1489b74c6c8833 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f16337fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f16337fe640 1 -- 172.21.15.7:0/2836062287 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c035040 con 0x561bf24c6070 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f16337fe640 1 -- 172.21.15.7:0/2836062287 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f164c024040 con 0x561bf24c6070 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.700+0000 7f16609ff740 1 -- 172.21.15.7:0/2836062287 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f164c01ea00 con 0x561bf24c6070 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.701+0000 7f16337fe640 1 -- 172.21.15.7:0/2836062287 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f164c004cc0 con 0x561bf24c6070 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.701+0000 7f16609ff740 10 client.16530 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.701+0000 7f16609ff740 1 -- 172.21.15.7:0/2836062287 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561bf28f5680 con 0x561bf24c6070 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.701+0000 7f16337fe640 1 -- 172.21.15.7:0/2836062287 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f164c01ea00 con 0x561bf24c6070 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.701+0000 7f16337fe640 1 -- 172.21.15.7:0/2836062287 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f164c01c420 con 0x561bf24c6070 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.701+0000 7f16609ff740 10 client.16530 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.701+0000 7f16609ff740 10 client.16530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.701+0000 7f16609ff740 20 client.16530 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.701+0000 7f16609ff740 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561bf2459da0 0x561bf28f7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.701+0000 7f16609ff740 4 client.16530 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.701+0000 7f16609ff740 1 -- 172.21.15.7:0/2836062287 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561bf286b420 con 0x561bf2459da0 2024-09-21T05:58:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.701+0000 7f1653fff640 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561bf2459da0 0x561bf28f7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:46.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.702+0000 7f16337fe640 10 client.16530 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:46.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.702+0000 7f1653fff640 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561bf2459da0 0x561bf28f7cf0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0e1cf2f8e4de472 server_cookie=893d677217b2dd9 in_seq=0 out_seq=0 2024-09-21T05:58:46.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.702+0000 7f16337fe640 1 -- 172.21.15.7:0/2836062287 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561bf286b420 con 0x561bf2459da0 2024-09-21T05:58:46.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.702+0000 7f16337fe640 10 client.16530 handle_command_reply: tid=0 2024-09-21T05:58:46.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.702+0000 7f16609ff740 1 client.16530 shutdown 2024-09-21T05:58:46.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.702+0000 7f16609ff740 1 -- 172.21.15.7:0/2836062287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 msgr2=0x561bf287d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:46.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.702+0000 7f16609ff740 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf287d080 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f164c0095e0 tx=0x7f164c01e360 comp rx=0 tx=0).stop 2024-09-21T05:58:46.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.702+0000 7f16609ff740 1 -- 172.21.15.7:0/2836062287 shutdown_connections 2024-09-21T05:58:46.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.702+0000 7f16609ff740 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561bf2459da0 0x561bf28f7cf0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f16609ff740 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bf24c6070 0x561bf287d080 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f16609ff740 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561bf24a5390 0x561bf287ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f16609ff740 1 --2- 172.21.15.7:0/2836062287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561bf249d1b0 0x561bf2881580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f16609ff740 1 -- 172.21.15.7:0/2836062287 >> 172.21.15.7:0/2836062287 conn(0x561bf24ba460 msgr2=0x561bf2876d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:46.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f16337fe640 0 client.16530 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:46.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f16609ff740 1 -- 172.21.15.7:0/2836062287 shutdown_connections 2024-09-21T05:58:46.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f16609ff740 1 -- 172.21.15.7:0/2836062287 wait complete. 2024-09-21T05:58:46.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f16609ff740 20 client.16530 trim_cache size 0 max 16384 2024-09-21T05:58:46.709 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:58:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f165a48b640 1 -- 172.21.15.7:0/3710543971 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f163c0b6680 msgr2=0x7f163c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f165a48b640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f163c0b6680 0x7f163c0b8b90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f164c009fd0 tx=0x7f164c004a40 comp rx=0 tx=0).stop 2024-09-21T05:58:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f165a48b640 1 -- 172.21.15.7:0/3710543971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16541094c0 msgr2=0x7f165419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f165a48b640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16541094c0 0x7f165419aa40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f164800d750 tx=0x7f164800dc10 comp rx=0 tx=0).stop 2024-09-21T05:58:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f165a48b640 1 -- 172.21.15.7:0/3710543971 shutdown_connections 2024-09-21T05:58:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f165a48b640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f163c0b6680 0x7f163c0b8b90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f165a48b640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16541094c0 0x7f165419aa40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f165a48b640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1654109e10 0x7f165419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f165a48b640 1 --2- 172.21.15.7:0/3710543971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1654103b80 0x7f165419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f165a48b640 1 -- 172.21.15.7:0/3710543971 >> 172.21.15.7:0/3710543971 conn(0x7f16540ff5d0 msgr2=0x7f16541019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.703+0000 7f165a48b640 1 -- 172.21.15.7:0/3710543971 shutdown_connections 2024-09-21T05:58:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:46.704+0000 7f165a48b640 1 -- 172.21.15.7:0/3710543971 wait complete. 2024-09-21T05:58:48.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:47 smithi007 ceph-mon[30983]: pgmap v465: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:58:48.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:47 smithi119 ceph-mon[34833]: pgmap v465: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:58:48.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:47 smithi027 ceph-mon[34364]: pgmap v465: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:58:48.404 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T05:58:48.405 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T05:58:48.678 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:49.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.157+0000 7f3fa57d8640 1 -- 172.21.15.7:0/4092777213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa01083d0 msgr2=0x7f3fa01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.157+0000 7f3fa57d8640 1 --2- 172.21.15.7:0/4092777213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa01083d0 0x7f3fa01087e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009900 tx=0x7f3f8802a410 comp rx=0 tx=0).stop 2024-09-21T05:58:49.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.158+0000 7f3fa57d8640 1 -- 172.21.15.7:0/4092777213 shutdown_connections 2024-09-21T05:58:49.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.158+0000 7f3fa57d8640 1 --2- 172.21.15.7:0/4092777213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa01083d0 0x7f3fa01087e0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.158+0000 7f3fa57d8640 1 --2- 172.21.15.7:0/4092777213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fa0108d20 0x7f3fa010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.158+0000 7f3fa57d8640 1 --2- 172.21.15.7:0/4092777213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0102ae0 0x7f3fa0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.158+0000 7f3fa57d8640 1 -- 172.21.15.7:0/4092777213 >> 172.21.15.7:0/4092777213 conn(0x7f3fa0079760 msgr2=0x7f3fa0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:49.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.158+0000 7f3fa57d8640 1 -- 172.21.15.7:0/4092777213 shutdown_connections 2024-09-21T05:58:49.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.158+0000 7f3fa57d8640 1 -- 172.21.15.7:0/4092777213 wait complete. 2024-09-21T05:58:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.158+0000 7f3fa57d8640 1 Processor -- start 2024-09-21T05:58:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.158+0000 7f3fa57d8640 1 -- start start 2024-09-21T05:58:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3fa57d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa0102ae0 0x7f3fa0199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3fa57d8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fa01083d0 0x7f3fa01998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3fa57d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0108d20 0x7f3fa019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3fa57d8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa0112990 con 0x7f3fa0102ae0 2024-09-21T05:58:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3fa57d8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa0112810 con 0x7f3fa01083d0 2024-09-21T05:58:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3fa57d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa0112b10 con 0x7f3fa0108d20 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3f9effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa0102ae0 0x7f3fa0199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3f9effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa0102ae0 0x7f3fa0199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38742/0 (socket says 172.21.15.7:38742) 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3f9effd640 1 -- 172.21.15.7:0/836867059 learned_addr learned my addr 172.21.15.7:0/836867059 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3f967fc640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fa01083d0 0x7f3fa01998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3f9f7fe640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0108d20 0x7f3fa019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3f9effd640 1 -- 172.21.15.7:0/836867059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0108d20 msgr2=0x7f3fa019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3f9effd640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0108d20 0x7f3fa019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3f9effd640 1 -- 172.21.15.7:0/836867059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fa01083d0 msgr2=0x7f3fa01998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3f9effd640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fa01083d0 0x7f3fa01998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3f9effd640 1 -- 172.21.15.7:0/836867059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa019f2b0 con 0x7f3fa0102ae0 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3f9f7fe640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0108d20 0x7f3fa019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.159+0000 7f3f9effd640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa0102ae0 0x7f3fa0199340 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000c890 tx=0x7f3f9000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.160+0000 7f3f9cff9640 1 -- 172.21.15.7:0/836867059 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90004220 con 0x7f3fa0102ae0 2024-09-21T05:58:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.160+0000 7f3f9cff9640 1 -- 172.21.15.7:0/836867059 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f900043c0 con 0x7f3fa0102ae0 2024-09-21T05:58:49.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.160+0000 7f3fa57d8640 1 -- 172.21.15.7:0/836867059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa019f5a0 con 0x7f3fa0102ae0 2024-09-21T05:58:49.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.160+0000 7f3f9cff9640 1 -- 172.21.15.7:0/836867059 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90004a00 con 0x7f3fa0102ae0 2024-09-21T05:58:49.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.160+0000 7f3fa57d8640 1 -- 172.21.15.7:0/836867059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa006bb40 con 0x7f3fa0102ae0 2024-09-21T05:58:49.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.163+0000 7f3fabd4c740 1 Processor -- start 2024-09-21T05:58:49.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.163+0000 7f3fabd4c740 1 -- start start 2024-09-21T05:58:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3fabd4c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e3f350 0x55a9f11e6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3fabd4c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 0x55a9f11e6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3fabd4c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e1e670 0x55a9f11e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3f9cff9640 1 -- 172.21.15.7:0/836867059 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3f900079b0 con 0x7f3fa0102ae0 2024-09-21T05:58:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3fabd4c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a9f115ce60 con 0x55a9f0e16490 2024-09-21T05:58:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3fabd4c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a9f114c290 con 0x55a9f0e1e670 2024-09-21T05:58:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3fabd4c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a9f11500a0 con 0x55a9f0e3f350 2024-09-21T05:58:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3f9effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 0x55a9f11e6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3f9effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 0x55a9f11e6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38754/0 (socket says 172.21.15.7:38754) 2024-09-21T05:58:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3f9effd640 1 -- 172.21.15.7:0/4015524262 learned_addr learned my addr 172.21.15.7:0/4015524262 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:49.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3f967fc640 1 --2- 172.21.15.7:0/4015524262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e1e670 0x55a9f11e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3f9f7fe640 1 --2- 172.21.15.7:0/4015524262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e3f350 0x55a9f11e6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3f9effd640 1 -- 172.21.15.7:0/4015524262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e3f350 msgr2=0x55a9f11e6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3f9effd640 1 --2- 172.21.15.7:0/4015524262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e3f350 0x55a9f11e6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3f9effd640 1 -- 172.21.15.7:0/4015524262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e1e670 msgr2=0x55a9f11e6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3f9effd640 1 --2- 172.21.15.7:0/4015524262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e1e670 0x55a9f11e6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3f9effd640 1 -- 172.21.15.7:0/4015524262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9f0eaa930 con 0x55a9f0e16490 2024-09-21T05:58:49.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.164+0000 7f3f9effd640 1 --2- 172.21.15.7:0/4015524262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 0x55a9f11e6970 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3f900e4ae0 tx=0x7f3f900eda10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460c457c871c19f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:49.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.165+0000 7f3f9cff9640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3f8c0b6700 0x7f3f8c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.165+0000 7f3f9f7fe640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3f8c0b6700 0x7f3f8c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.165+0000 7f3f957fa640 1 -- 172.21.15.7:0/4015524262 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f900fa070 con 0x55a9f0e16490 2024-09-21T05:58:49.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.165+0000 7f3f957fa640 1 -- 172.21.15.7:0/4015524262 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f90005290 con 0x55a9f0e16490 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.165+0000 7f3f957fa640 1 -- 172.21.15.7:0/4015524262 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f900ad040 con 0x55a9f0e16490 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.165+0000 7f3f9cff9640 1 -- 172.21.15.7:0/836867059 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f3f900e73a0 con 0x7f3fa0102ae0 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.166+0000 7f3fabd4c740 1 -- 172.21.15.7:0/4015524262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 msgr2=0x55a9f11e6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.166+0000 7f3f9f7fe640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3f8c0b6700 0x7f3f8c0b8c10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3f98005fd0 tx=0x7f3f98009700 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.166+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/4015524262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 0x55a9f11e6970 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3f900e4ae0 tx=0x7f3f900eda10 comp rx=0 tx=0).stop 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.166+0000 7f3fabd4c740 1 -- 172.21.15.7:0/4015524262 shutdown_connections 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.166+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/4015524262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 0x55a9f11e6970 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.166+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/4015524262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e1e670 0x55a9f11e6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.166+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/4015524262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e3f350 0x55a9f11e6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.166+0000 7f3fabd4c740 1 -- 172.21.15.7:0/4015524262 >> 172.21.15.7:0/4015524262 conn(0x55a9f0e33740 msgr2=0x55a9f11e4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.166+0000 7f3fabd4c740 1 -- 172.21.15.7:0/4015524262 shutdown_connections 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.166+0000 7f3fabd4c740 1 -- 172.21.15.7:0/4015524262 wait complete. 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.166+0000 7f3fabd4c740 1 -- start start 2024-09-21T05:58:49.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.166+0000 7f3fabd4c740 1 Processor -- start 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3fabd4c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 0x55a9f11f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3fabd4c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e1e670 0x55a9f11f2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3fabd4c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e3f350 0x55a9f11fdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3fabd4c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a9f0fad890 con 0x55a9f0e16490 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3fabd4c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a9f10e6d40 con 0x55a9f0e1e670 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3fabd4c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a9f11f4c10 con 0x55a9f0e3f350 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3f9effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 0x55a9f11f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3fabd4c740 10 client.0 _ll_register_callbacks cb 0x55a9f114ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3f9effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 0x55a9f11f1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38764/0 (socket says 172.21.15.7:38764) 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3f9effd640 1 -- 172.21.15.7:0/3705784634 learned_addr learned my addr 172.21.15.7:0/3705784634 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3f967fc640 1 --2- 172.21.15.7:0/3705784634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e1e670 0x55a9f11f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3f9f7fe640 1 --2- 172.21.15.7:0/3705784634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e3f350 0x55a9f11fdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3f9effd640 1 -- 172.21.15.7:0/3705784634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e3f350 msgr2=0x55a9f11fdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3f9effd640 1 --2- 172.21.15.7:0/3705784634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e3f350 0x55a9f11fdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3f9effd640 1 -- 172.21.15.7:0/3705784634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e1e670 msgr2=0x55a9f11f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3f9effd640 1 --2- 172.21.15.7:0/3705784634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e1e670 0x55a9f11f2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.167+0000 7f3f9effd640 1 -- 172.21.15.7:0/3705784634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9f11fe4a0 con 0x55a9f0e16490 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3f9effd640 1 --2- 172.21.15.7:0/3705784634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 0x55a9f11f1ff0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3f900f8040 tx=0x7f3f90004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3117350311009fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3f867fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3f867fc640 1 -- 172.21.15.7:0/3705784634 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9001d070 con 0x55a9f0e16490 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3f867fc640 1 -- 172.21.15.7:0/3705784634 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f3f900b6800 con 0x55a9f0e16490 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3fabd4c740 1 -- 172.21.15.7:0/3705784634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a9f115edb0 con 0x55a9f0e16490 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3f867fc640 1 -- 172.21.15.7:0/3705784634 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3f90064f80 con 0x55a9f0e16490 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3fabd4c740 10 client.16542 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3fabd4c740 1 -- 172.21.15.7:0/3705784634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a9f1200dd0 con 0x55a9f0e16490 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3f867fc640 1 -- 172.21.15.7:0/3705784634 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a9f115edb0 con 0x55a9f0e16490 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3f867fc640 1 -- 172.21.15.7:0/3705784634 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3f900ac4d0 con 0x55a9f0e16490 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3fabd4c740 10 client.16542 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3fabd4c740 10 client.16542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:49.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3fabd4c740 20 client.16542 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:49.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/3705784634 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a9f0dfdcd0 0x55a9f1204130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3fabd4c740 4 client.16542 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:58:49.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.168+0000 7f3fabd4c740 1 -- 172.21.15.7:0/3705784634 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9f115a860 con 0x55a9f0dfdcd0 2024-09-21T05:58:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.169+0000 7f3f967fc640 1 --2- 172.21.15.7:0/3705784634 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a9f0dfdcd0 0x55a9f1204130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.169+0000 7f3f867fc640 10 client.16542 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.169+0000 7f3f967fc640 1 --2- 172.21.15.7:0/3705784634 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a9f0dfdcd0 0x55a9f1204130 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7933f1889da1001 server_cookie=7f50c5132233bcfa in_seq=0 out_seq=0 2024-09-21T05:58:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3f867fc640 1 -- 172.21.15.7:0/3705784634 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a9f115a860 con 0x55a9f0dfdcd0 2024-09-21T05:58:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3f867fc640 10 client.16542 handle_command_reply: tid=0 2024-09-21T05:58:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3fabd4c740 1 client.16542 shutdown 2024-09-21T05:58:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3fabd4c740 1 -- 172.21.15.7:0/3705784634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 msgr2=0x55a9f11f1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/3705784634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 0x55a9f11f1ff0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3f900f8040 tx=0x7f3f90004570 comp rx=0 tx=0).stop 2024-09-21T05:58:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3fabd4c740 1 -- 172.21.15.7:0/3705784634 shutdown_connections 2024-09-21T05:58:49.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/3705784634 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a9f0dfdcd0 0x55a9f1204130 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/3705784634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e3f350 0x55a9f11fdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/3705784634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e1e670 0x55a9f11f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3f867fc640 0 client.16542 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:49.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/3705784634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e16490 0x55a9f11f1ff0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3fabd4c740 1 -- 172.21.15.7:0/3705784634 >> 172.21.15.7:0/3705784634 conn(0x55a9f0e33740 msgr2=0x55a9f11e95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:49.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3fabd4c740 1 -- 172.21.15.7:0/3705784634 shutdown_connections 2024-09-21T05:58:49.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3fabd4c740 1 -- 172.21.15.7:0/3705784634 wait complete. 2024-09-21T05:58:49.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.170+0000 7f3fabd4c740 20 client.16542 trim_cache size 0 max 16384 2024-09-21T05:58:49.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.188+0000 7f3fabd4c740 1 Processor -- start 2024-09-21T05:58:49.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.188+0000 7f3fabd4c740 1 -- start start 2024-09-21T05:58:49.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.188+0000 7f3fabd4c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0dfdcd0 0x55a9f11ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.188+0000 7f3fabd4c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e16490 0x55a9f11e7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.188+0000 7f3fabd4c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 0x55a9f11ec550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.188+0000 7f3fabd4c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa01b1d20 con 0x55a9f0e1e670 2024-09-21T05:58:49.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.188+0000 7f3fabd4c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa01af5f0 con 0x55a9f0e16490 2024-09-21T05:58:49.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.188+0000 7f3fabd4c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa01ad440 con 0x55a9f0dfdcd0 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f9f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 0x55a9f11ec550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f9f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 0x55a9f11ec550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38778/0 (socket says 172.21.15.7:38778) 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f9f7fe640 1 -- 172.21.15.7:0/2870223560 learned_addr learned my addr 172.21.15.7:0/2870223560 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f967fc640 1 --2- 172.21.15.7:0/2870223560 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e16490 0x55a9f11e7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f9effd640 1 --2- 172.21.15.7:0/2870223560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0dfdcd0 0x55a9f11ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f9f7fe640 1 -- 172.21.15.7:0/2870223560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0dfdcd0 msgr2=0x55a9f11ed5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f9f7fe640 1 --2- 172.21.15.7:0/2870223560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0dfdcd0 0x55a9f11ed5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f9f7fe640 1 -- 172.21.15.7:0/2870223560 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e16490 msgr2=0x55a9f11e7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f9f7fe640 1 --2- 172.21.15.7:0/2870223560 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e16490 0x55a9f11e7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f9f7fe640 1 -- 172.21.15.7:0/2870223560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9f11ff0f0 con 0x55a9f0e1e670 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f9f7fe640 1 --2- 172.21.15.7:0/2870223560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 0x55a9f11ec550 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009de0 tx=0x7f3f98015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973e171efdc9f2a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f94ff9640 1 -- 172.21.15.7:0/2870223560 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98010e90 con 0x55a9f0e1e670 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f94ff9640 1 -- 172.21.15.7:0/2870223560 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f98005020 con 0x55a9f0e1e670 2024-09-21T05:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.189+0000 7f3f94ff9640 1 -- 172.21.15.7:0/2870223560 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9801e670 con 0x55a9f0e1e670 2024-09-21T05:58:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.190+0000 7f3fabd4c740 1 -- 172.21.15.7:0/2870223560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 msgr2=0x55a9f11ec550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.190+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/2870223560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 0x55a9f11ec550 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009de0 tx=0x7f3f98015000 comp rx=0 tx=0).stop 2024-09-21T05:58:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.190+0000 7f3fabd4c740 1 -- 172.21.15.7:0/2870223560 shutdown_connections 2024-09-21T05:58:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.190+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/2870223560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 0x55a9f11ec550 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.190+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/2870223560 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0e16490 0x55a9f11e7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.190+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/2870223560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0dfdcd0 0x55a9f11ed5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.190+0000 7f3fabd4c740 1 -- 172.21.15.7:0/2870223560 >> 172.21.15.7:0/2870223560 conn(0x55a9f0e33740 msgr2=0x55a9f11f3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.190+0000 7f3fabd4c740 1 -- 172.21.15.7:0/2870223560 shutdown_connections 2024-09-21T05:58:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.190+0000 7f3fabd4c740 1 -- 172.21.15.7:0/2870223560 wait complete. 2024-09-21T05:58:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.191+0000 7f3fabd4c740 1 -- start start 2024-09-21T05:58:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.191+0000 7f3fabd4c740 1 Processor -- start 2024-09-21T05:58:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.191+0000 7f3fabd4c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0dfdcd0 0x55a9f1205340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.191+0000 7f3fabd4c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e16490 0x55a9f1205880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.191+0000 7f3fabd4c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 0x55a9f1205dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.191+0000 7f3fabd4c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa01adab0 con 0x55a9f0e1e670 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.191+0000 7f3fabd4c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa01aef20 con 0x55a9f0dfdcd0 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.191+0000 7f3fabd4c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa01ae180 con 0x55a9f0e16490 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.191+0000 7f3fabd4c740 10 client.0 _ll_register_callbacks cb 0x7f3f900f8070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.191+0000 7f3f9f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 0x55a9f1205dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3f9f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 0x55a9f1205dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38790/0 (socket says 172.21.15.7:38790) 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3f9f7fe640 1 -- 172.21.15.7:0/626943581 learned_addr learned my addr 172.21.15.7:0/626943581 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3f967fc640 1 --2- 172.21.15.7:0/626943581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e16490 0x55a9f1205880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3f9effd640 1 --2- 172.21.15.7:0/626943581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0dfdcd0 0x55a9f1205340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3f9f7fe640 1 -- 172.21.15.7:0/626943581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e16490 msgr2=0x55a9f1205880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3f9f7fe640 1 --2- 172.21.15.7:0/626943581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e16490 0x55a9f1205880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3f9f7fe640 1 -- 172.21.15.7:0/626943581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0dfdcd0 msgr2=0x55a9f1205340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3f9f7fe640 1 --2- 172.21.15.7:0/626943581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0dfdcd0 0x55a9f1205340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3f9f7fe640 1 -- 172.21.15.7:0/626943581 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9f126dab0 con 0x55a9f0e1e670 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3f9f7fe640 1 --2- 172.21.15.7:0/626943581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 0x55a9f1205dc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3f980059c0 tx=0x7f3f98010de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a22226b457cbb19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3f867fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3f867fc640 1 -- 172.21.15.7:0/626943581 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98035020 con 0x55a9f0e1e670 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3f867fc640 1 -- 172.21.15.7:0/626943581 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f3f98004d10 con 0x55a9f0e1e670 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.192+0000 7f3fabd4c740 1 -- 172.21.15.7:0/626943581 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f98005020 con 0x55a9f0e1e670 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.193+0000 7f3f867fc640 1 -- 172.21.15.7:0/626943581 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3f98040050 con 0x55a9f0e1e670 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.193+0000 7f3fabd4c740 10 client.16548 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.193+0000 7f3fabd4c740 1 -- 172.21.15.7:0/626943581 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a9f126ed50 con 0x55a9f0e1e670 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.193+0000 7f3f867fc640 1 -- 172.21.15.7:0/626943581 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f98005020 con 0x55a9f0e1e670 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.193+0000 7f3f867fc640 1 -- 172.21.15.7:0/626943581 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3f98026070 con 0x55a9f0e1e670 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.193+0000 7f3fabd4c740 10 client.16548 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.193+0000 7f3fabd4c740 10 client.16548 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.193+0000 7f3fabd4c740 20 client.16548 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.193+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/626943581 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a9f0e3f350 0x55a9f1271500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.193+0000 7f3fabd4c740 4 client.16548 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T05:58:49.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.193+0000 7f3fabd4c740 1 -- 172.21.15.7:0/626943581 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a9f1157c90 con 0x55a9f0e3f350 2024-09-21T05:58:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.193+0000 7f3f9effd640 1 --2- 172.21.15.7:0/626943581 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a9f0e3f350 0x55a9f1271500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.194+0000 7f3f9effd640 1 --2- 172.21.15.7:0/626943581 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a9f0e3f350 0x55a9f1271500 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc1d89b2fe0334e4 server_cookie=72cf1cda2ba3a306 in_seq=0 out_seq=0 2024-09-21T05:58:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.194+0000 7f3f867fc640 10 client.16548 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.195+0000 7f3f867fc640 1 -- 172.21.15.7:0/626943581 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a9f1157c90 con 0x55a9f0e3f350 2024-09-21T05:58:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.195+0000 7f3f867fc640 10 client.16548 handle_command_reply: tid=0 2024-09-21T05:58:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.195+0000 7f3fabd4c740 1 client.16548 shutdown 2024-09-21T05:58:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.196+0000 7f3fabd4c740 1 -- 172.21.15.7:0/626943581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 msgr2=0x55a9f1205dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.196+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/626943581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 0x55a9f1205dc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3f980059c0 tx=0x7f3f98010de0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.196+0000 7f3fabd4c740 1 -- 172.21.15.7:0/626943581 shutdown_connections 2024-09-21T05:58:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.196+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/626943581 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a9f0e3f350 0x55a9f1271500 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.196+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/626943581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9f0e1e670 0x55a9f1205dc0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.196+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/626943581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a9f0e16490 0x55a9f1205880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.196+0000 7f3fabd4c740 1 --2- 172.21.15.7:0/626943581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a9f0dfdcd0 0x55a9f1205340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.196+0000 7f3fabd4c740 1 -- 172.21.15.7:0/626943581 >> 172.21.15.7:0/626943581 conn(0x55a9f0e33740 msgr2=0x55a9f11f3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:49.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.196+0000 7f3f867fc640 0 client.16548 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:49.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.196+0000 7f3fabd4c740 1 -- 172.21.15.7:0/626943581 shutdown_connections 2024-09-21T05:58:49.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.196+0000 7f3fabd4c740 1 -- 172.21.15.7:0/626943581 wait complete. 2024-09-21T05:58:49.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.196+0000 7f3fabd4c740 20 client.16548 trim_cache size 0 max 16384 2024-09-21T05:58:49.200 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:58:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T05:58:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea", 2024-09-21T05:58:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T05:58:49.201 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:58:49.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.197+0000 7f3fa57d8640 1 -- 172.21.15.7:0/836867059 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3f8c0b6700 msgr2=0x7f3f8c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.197+0000 7f3fa57d8640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3f8c0b6700 0x7f3f8c0b8c10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3f98005fd0 tx=0x7f3f98009700 comp rx=0 tx=0).stop 2024-09-21T05:58:49.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.197+0000 7f3fa57d8640 1 -- 172.21.15.7:0/836867059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa0102ae0 msgr2=0x7f3fa0199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.197+0000 7f3fa57d8640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa0102ae0 0x7f3fa0199340 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000c890 tx=0x7f3f9000cd50 comp rx=0 tx=0).stop 2024-09-21T05:58:49.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.197+0000 7f3fa57d8640 1 -- 172.21.15.7:0/836867059 shutdown_connections 2024-09-21T05:58:49.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.197+0000 7f3fa57d8640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3f8c0b6700 0x7f3f8c0b8c10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.197+0000 7f3fa57d8640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3fa0108d20 0x7f3fa019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.197+0000 7f3fa57d8640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fa01083d0 0x7f3fa01998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.197+0000 7f3fa57d8640 1 --2- 172.21.15.7:0/836867059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fa0102ae0 0x7f3fa0199340 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.197+0000 7f3fa57d8640 1 -- 172.21.15.7:0/836867059 >> 172.21.15.7:0/836867059 conn(0x7f3fa0079760 msgr2=0x7f3fa0104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:49.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.197+0000 7f3fa57d8640 1 -- 172.21.15.7:0/836867059 shutdown_connections 2024-09-21T05:58:49.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:49.197+0000 7f3fa57d8640 1 -- 172.21.15.7:0/836867059 wait complete. 2024-09-21T05:58:49.941 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:58:50.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:49 smithi007 ceph-mon[30983]: pgmap v466: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:58:50.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:49 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T05:58:50.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:49 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:58:50.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:49 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T05:58:50.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:49 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:58:50.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:49 smithi119 ceph-mon[34833]: pgmap v466: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:58:50.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:49 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T05:58:50.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:49 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:58:50.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:49 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T05:58:50.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:49 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:58:50.202 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:50.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:49 smithi027 ceph-mon[34364]: pgmap v466: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:58:50.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:49 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T05:58:50.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:49 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:58:50.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:49 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T05:58:50.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:49 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:58:50.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.685+0000 7fa6cad4c640 1 -- 172.21.15.7:0/975163338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6c4108d20 msgr2=0x7fa6c410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.685+0000 7fa6cad4c640 1 --2- 172.21.15.7:0/975163338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6c4108d20 0x7fa6c410f550 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009ca0 tx=0x7fa6bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.685+0000 7fa6cad4c640 1 -- 172.21.15.7:0/975163338 shutdown_connections 2024-09-21T05:58:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.685+0000 7fa6cad4c640 1 --2- 172.21.15.7:0/975163338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6c4108d20 0x7fa6c410f550 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.685+0000 7fa6cad4c640 1 --2- 172.21.15.7:0/975163338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6c41083d0 0x7fa6c41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.685+0000 7fa6cad4c640 1 --2- 172.21.15.7:0/975163338 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6c4102a90 0x7fa6c4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.685+0000 7fa6cad4c640 1 -- 172.21.15.7:0/975163338 >> 172.21.15.7:0/975163338 conn(0x7fa6c4079750 msgr2=0x7fa6c4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.686+0000 7fa6cad4c640 1 -- 172.21.15.7:0/975163338 shutdown_connections 2024-09-21T05:58:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.686+0000 7fa6cad4c640 1 -- 172.21.15.7:0/975163338 wait complete. 2024-09-21T05:58:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.686+0000 7fa6cad4c640 1 Processor -- start 2024-09-21T05:58:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.686+0000 7fa6cad4c640 1 -- start start 2024-09-21T05:58:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6cad4c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6c4102a90 0x7fa6c419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6cad4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6c41083d0 0x7fa6c419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6cad4c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6c4108d20 0x7fa6c41a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6cad4c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c4112990 con 0x7fa6c41083d0 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6cad4c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c4112810 con 0x7fa6c4108d20 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6cad4c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c4112b10 con 0x7fa6c4102a90 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6c3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6c41083d0 0x7fa6c419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6c3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6c41083d0 0x7fa6c419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38802/0 (socket says 172.21.15.7:38802) 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6c3fff640 1 -- 172.21.15.7:0/169913592 learned_addr learned my addr 172.21.15.7:0/169913592 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6c8ae8640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6c4102a90 0x7fa6c419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6c92e9640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6c4108d20 0x7fa6c41a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6c3fff640 1 -- 172.21.15.7:0/169913592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6c4102a90 msgr2=0x7fa6c419c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6c3fff640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6c4102a90 0x7fa6c419c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6c3fff640 1 -- 172.21.15.7:0/169913592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6c4108d20 msgr2=0x7fa6c41a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6c3fff640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6c4108d20 0x7fa6c41a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6c3fff640 1 -- 172.21.15.7:0/169913592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c41a25e0 con 0x7fa6c41083d0 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6c92e9640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6c4108d20 0x7fa6c41a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6c3fff640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6c41083d0 0x7fa6c419cc10 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa6b800d770 tx=0x7fa6b800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.687+0000 7fa6c1ffb640 1 -- 172.21.15.7:0/169913592 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8017070 con 0x7fa6c41083d0 2024-09-21T05:58:50.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.688+0000 7fa6c1ffb640 1 -- 172.21.15.7:0/169913592 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6b8009c30 con 0x7fa6c41083d0 2024-09-21T05:58:50.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.688+0000 7fa6c1ffb640 1 -- 172.21.15.7:0/169913592 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b800f620 con 0x7fa6c41083d0 2024-09-21T05:58:50.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.688+0000 7fa6cad4c640 1 -- 172.21.15.7:0/169913592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c41a28d0 con 0x7fa6c41083d0 2024-09-21T05:58:50.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.688+0000 7fa6cad4c640 1 -- 172.21.15.7:0/169913592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c41a9030 con 0x7fa6c41083d0 2024-09-21T05:58:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.690+0000 7fa6d12c0740 1 Processor -- start 2024-09-21T05:58:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.690+0000 7fa6d12c0740 1 -- start start 2024-09-21T05:58:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6d12c0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabd8070 0x55f2daf7f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6c1ffb640 1 -- 172.21.15.7:0/169913592 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa6b801a070 con 0x7fa6c41083d0 2024-09-21T05:58:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6d12c0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 0x55f2daf7f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6d12c0740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabb7390 0x55f2daf7fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6d12c0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f2daef5e50 con 0x55f2dabaf1b0 2024-09-21T05:58:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6d12c0740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f2daee5280 con 0x55f2dabb7390 2024-09-21T05:58:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6d12c0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f2daee9090 con 0x55f2dabd8070 2024-09-21T05:58:50.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6c8ae8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 0x55f2daf7f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6c92e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabd8070 0x55f2daf7f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6c8ae8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 0x55f2daf7f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38808/0 (socket says 172.21.15.7:38808) 2024-09-21T05:58:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6c8ae8640 1 -- 172.21.15.7:0/961956656 learned_addr learned my addr 172.21.15.7:0/961956656 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6c3fff640 1 --2- 172.21.15.7:0/961956656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabb7390 0x55f2daf7fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6c8ae8640 1 -- 172.21.15.7:0/961956656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabd8070 msgr2=0x55f2daf7f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6c8ae8640 1 --2- 172.21.15.7:0/961956656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabd8070 0x55f2daf7f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6c8ae8640 1 -- 172.21.15.7:0/961956656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabb7390 msgr2=0x55f2daf7fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6c8ae8640 1 --2- 172.21.15.7:0/961956656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabb7390 0x55f2daf7fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6c8ae8640 1 -- 172.21.15.7:0/961956656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2dac43650 con 0x55f2dabaf1b0 2024-09-21T05:58:50.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.691+0000 7fa6c92e9640 1 --2- 172.21.15.7:0/961956656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabd8070 0x55f2daf7f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:58:50.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.692+0000 7fa6c8ae8640 1 --2- 172.21.15.7:0/961956656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 0x55f2daf7f7b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400bcd0 tx=0x7fa6b40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8917c238c977b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:50.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.692+0000 7fa6c1ffb640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa6ac0b6680 0x7fa6ac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.692+0000 7fa6aaffd640 1 -- 172.21.15.7:0/961956656 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4005220 con 0x55f2dabaf1b0 2024-09-21T05:58:50.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.692+0000 7fa6aaffd640 1 -- 172.21.15.7:0/961956656 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6b4004c50 con 0x55f2dabaf1b0 2024-09-21T05:58:50.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.692+0000 7fa6aaffd640 1 -- 172.21.15.7:0/961956656 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40116a0 con 0x55f2dabaf1b0 2024-09-21T05:58:50.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.692+0000 7fa6c1ffb640 1 -- 172.21.15.7:0/169913592 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa6b80e7180 con 0x7fa6c41083d0 2024-09-21T05:58:50.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.692+0000 7fa6c92e9640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa6ac0b6680 0x7fa6ac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.693+0000 7fa6d12c0740 1 -- 172.21.15.7:0/961956656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 msgr2=0x55f2daf7f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:50.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.693+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/961956656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 0x55f2daf7f7b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400bcd0 tx=0x7fa6b40107a0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.693+0000 7fa6c92e9640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa6ac0b6680 0x7fa6ac0b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009a60 tx=0x7fa6bc005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:50.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.693+0000 7fa6d12c0740 1 -- 172.21.15.7:0/961956656 shutdown_connections 2024-09-21T05:58:50.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.693+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/961956656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 0x55f2daf7f7b0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.693+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/961956656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabb7390 0x55f2daf7fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.693+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/961956656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabd8070 0x55f2daf7f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.693+0000 7fa6d12c0740 1 -- 172.21.15.7:0/961956656 >> 172.21.15.7:0/961956656 conn(0x55f2dabcc460 msgr2=0x55f2daf7d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:50.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.693+0000 7fa6d12c0740 1 -- 172.21.15.7:0/961956656 shutdown_connections 2024-09-21T05:58:50.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.693+0000 7fa6d12c0740 1 -- 172.21.15.7:0/961956656 wait complete. 2024-09-21T05:58:50.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.693+0000 7fa6d12c0740 1 -- start start 2024-09-21T05:58:50.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.694+0000 7fa6d12c0740 1 Processor -- start 2024-09-21T05:58:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.694+0000 7fa6d12c0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 0x55f2daf8a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.694+0000 7fa6d12c0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabb7390 0x55f2daf8aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.694+0000 7fa6d12c0740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabd8070 0x55f2daf96d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.694+0000 7fa6d12c0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f2dad46700 con 0x55f2dabaf1b0 2024-09-21T05:58:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.694+0000 7fa6d12c0740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f2dae80110 con 0x55f2dabd8070 2024-09-21T05:58:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.694+0000 7fa6d12c0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f2daf8da50 con 0x55f2dabb7390 2024-09-21T05:58:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.694+0000 7fa6d12c0740 10 client.0 _ll_register_callbacks cb 0x55f2dae99990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.694+0000 7fa6c8ae8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 0x55f2daf8a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.694+0000 7fa6c8ae8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 0x55f2daf8a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38810/0 (socket says 172.21.15.7:38810) 2024-09-21T05:58:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.694+0000 7fa6c8ae8640 1 -- 172.21.15.7:0/2516136915 learned_addr learned my addr 172.21.15.7:0/2516136915 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.694+0000 7fa6c92e9640 1 --2- 172.21.15.7:0/2516136915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabd8070 0x55f2daf96d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6c3fff640 1 --2- 172.21.15.7:0/2516136915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabb7390 0x55f2daf8aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6c8ae8640 1 -- 172.21.15.7:0/2516136915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabb7390 msgr2=0x55f2daf8aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6c8ae8640 1 --2- 172.21.15.7:0/2516136915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabb7390 0x55f2daf8aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6c8ae8640 1 -- 172.21.15.7:0/2516136915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabd8070 msgr2=0x55f2daf96d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6c8ae8640 1 --2- 172.21.15.7:0/2516136915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabd8070 0x55f2daf96d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6c8ae8640 1 -- 172.21.15.7:0/2516136915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2daeadc40 con 0x55f2dabaf1b0 2024-09-21T05:58:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6c8ae8640 1 --2- 172.21.15.7:0/2516136915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 0x55f2daf8a9a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4000c00 tx=0x7fa6b40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc1e8c2402c41a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6a3fff640 1 -- 172.21.15.7:0/2516136915 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b402a060 con 0x55f2dabaf1b0 2024-09-21T05:58:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6a3fff640 1 -- 172.21.15.7:0/2516136915 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa6b4005010 con 0x55f2dabaf1b0 2024-09-21T05:58:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2516136915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6b4004c50 con 0x55f2dabaf1b0 2024-09-21T05:58:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6a3fff640 1 -- 172.21.15.7:0/2516136915 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa6b400b8c0 con 0x55f2dabaf1b0 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6d12c0740 10 client.16560 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.695+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2516136915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f2daf997a0 con 0x55f2dabaf1b0 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.696+0000 7fa6a3fff640 1 -- 172.21.15.7:0/2516136915 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6b4004c50 con 0x55f2dabaf1b0 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.696+0000 7fa6a3fff640 1 -- 172.21.15.7:0/2516136915 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa6b402f430 con 0x55f2dabaf1b0 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.696+0000 7fa6d12c0740 10 client.16560 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.696+0000 7fa6d12c0740 10 client.16560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.696+0000 7fa6d12c0740 20 client.16560 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.696+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/2516136915 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f2dab969f0 0x55f2daf9cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.696+0000 7fa6d12c0740 4 client.16560 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.696+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2516136915 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2daef7da0 con 0x55f2dab969f0 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.696+0000 7fa6c3fff640 1 --2- 172.21.15.7:0/2516136915 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f2dab969f0 0x55f2daf9cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.697+0000 7fa6a3fff640 10 client.16560 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.697+0000 7fa6c3fff640 1 --2- 172.21.15.7:0/2516136915 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f2dab969f0 0x55f2daf9cbb0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68559c8877dacc39 server_cookie=b02d66ab28abf055 in_seq=0 out_seq=0 2024-09-21T05:58:50.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6a3fff640 1 -- 172.21.15.7:0/2516136915 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2daef7da0 con 0x55f2dab969f0 2024-09-21T05:58:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6a3fff640 10 client.16560 handle_command_reply: tid=0 2024-09-21T05:58:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6d12c0740 1 client.16560 shutdown 2024-09-21T05:58:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2516136915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 msgr2=0x55f2daf8a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/2516136915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 0x55f2daf8a9a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4000c00 tx=0x7fa6b40048f0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2516136915 shutdown_connections 2024-09-21T05:58:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/2516136915 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f2dab969f0 0x55f2daf9cbb0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/2516136915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabd8070 0x55f2daf96d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/2516136915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabb7390 0x55f2daf8aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6a3fff640 0 client.16560 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/2516136915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabaf1b0 0x55f2daf8a9a0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2516136915 >> 172.21.15.7:0/2516136915 conn(0x55f2dabcc460 msgr2=0x55f2daf82400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2516136915 shutdown_connections 2024-09-21T05:58:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2516136915 wait complete. 2024-09-21T05:58:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.698+0000 7fa6d12c0740 20 client.16560 trim_cache size 0 max 16384 2024-09-21T05:58:50.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.715+0000 7fa6d12c0740 1 Processor -- start 2024-09-21T05:58:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6d12c0740 1 -- start start 2024-09-21T05:58:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6d12c0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dab969f0 0x55f2daf809b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6d12c0740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabaf1b0 0x55f2daf96ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6d12c0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabb7390 0x55f2daf87b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6d12c0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c41b40f0 con 0x55f2dab969f0 2024-09-21T05:58:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6d12c0740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c41b19c0 con 0x55f2dabaf1b0 2024-09-21T05:58:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6d12c0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c41af830 con 0x55f2dabb7390 2024-09-21T05:58:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6c8ae8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dab969f0 0x55f2daf809b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6c8ae8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dab969f0 0x55f2daf809b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38822/0 (socket says 172.21.15.7:38822) 2024-09-21T05:58:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6c8ae8640 1 -- 172.21.15.7:0/1791390689 learned_addr learned my addr 172.21.15.7:0/1791390689 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6c3fff640 1 --2- 172.21.15.7:0/1791390689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabaf1b0 0x55f2daf96ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6c92e9640 1 --2- 172.21.15.7:0/1791390689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabb7390 0x55f2daf87b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6c8ae8640 1 -- 172.21.15.7:0/1791390689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabb7390 msgr2=0x55f2daf87b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:50.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6c8ae8640 1 --2- 172.21.15.7:0/1791390689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabb7390 0x55f2daf87b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6c8ae8640 1 -- 172.21.15.7:0/1791390689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabaf1b0 msgr2=0x55f2daf96ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:50.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6c8ae8640 1 --2- 172.21.15.7:0/1791390689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabaf1b0 0x55f2daf96ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6c8ae8640 1 -- 172.21.15.7:0/1791390689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2daf88ea0 con 0x55f2dab969f0 2024-09-21T05:58:50.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6c3fff640 1 --2- 172.21.15.7:0/1791390689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabaf1b0 0x55f2daf96ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:58:50.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.716+0000 7fa6c92e9640 1 --2- 172.21.15.7:0/1791390689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabb7390 0x55f2daf87b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:50.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.717+0000 7fa6c8ae8640 1 --2- 172.21.15.7:0/1791390689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dab969f0 0x55f2daf809b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4011010 tx=0x7fa6b40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caac003a99d960ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:50.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.717+0000 7fa6aa7fc640 1 -- 172.21.15.7:0/1791390689 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b402a070 con 0x55f2dab969f0 2024-09-21T05:58:50.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.717+0000 7fa6aa7fc640 1 -- 172.21.15.7:0/1791390689 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6b402fba0 con 0x55f2dab969f0 2024-09-21T05:58:50.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.717+0000 7fa6aa7fc640 1 -- 172.21.15.7:0/1791390689 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4026450 con 0x55f2dab969f0 2024-09-21T05:58:50.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.717+0000 7fa6d12c0740 1 -- 172.21.15.7:0/1791390689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dab969f0 msgr2=0x55f2daf809b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:50.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.717+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/1791390689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dab969f0 0x55f2daf809b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4011010 tx=0x7fa6b40107a0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.718+0000 7fa6d12c0740 1 -- 172.21.15.7:0/1791390689 shutdown_connections 2024-09-21T05:58:50.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.718+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/1791390689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabb7390 0x55f2daf87b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.718+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/1791390689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dabaf1b0 0x55f2daf96ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.718+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/1791390689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dab969f0 0x55f2daf809b0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.718+0000 7fa6d12c0740 1 -- 172.21.15.7:0/1791390689 >> 172.21.15.7:0/1791390689 conn(0x55f2dabcc460 msgr2=0x55f2daf802a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:50.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.718+0000 7fa6d12c0740 1 -- 172.21.15.7:0/1791390689 shutdown_connections 2024-09-21T05:58:50.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.718+0000 7fa6d12c0740 1 -- 172.21.15.7:0/1791390689 wait complete. 2024-09-21T05:58:50.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.718+0000 7fa6d12c0740 1 -- start start 2024-09-21T05:58:50.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.718+0000 7fa6d12c0740 1 Processor -- start 2024-09-21T05:58:50.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6d12c0740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dab969f0 0x55f2daf9de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6d12c0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabaf1b0 0x55f2daf9e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6d12c0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabb7390 0x55f2db006330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6d12c0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c41afe80 con 0x55f2dabb7390 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6d12c0740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c41b12f0 con 0x55f2dab969f0 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6d12c0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c41b0550 con 0x55f2dabaf1b0 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6d12c0740 10 client.0 _ll_register_callbacks cb 0x7fa6bc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6c92e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabb7390 0x55f2db006330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6c92e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabb7390 0x55f2db006330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38836/0 (socket says 172.21.15.7:38836) 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6c92e9640 1 -- 172.21.15.7:0/2492268721 learned_addr learned my addr 172.21.15.7:0/2492268721 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6c3fff640 1 --2- 172.21.15.7:0/2492268721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabaf1b0 0x55f2daf9e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6c8ae8640 1 --2- 172.21.15.7:0/2492268721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dab969f0 0x55f2daf9de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6c92e9640 1 -- 172.21.15.7:0/2492268721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabaf1b0 msgr2=0x55f2daf9e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6c92e9640 1 --2- 172.21.15.7:0/2492268721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabaf1b0 0x55f2daf9e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6c92e9640 1 -- 172.21.15.7:0/2492268721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dab969f0 msgr2=0x55f2daf9de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:50.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6c92e9640 1 --2- 172.21.15.7:0/2492268721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dab969f0 0x55f2daf9de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6c92e9640 1 -- 172.21.15.7:0/2492268721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2daf9eb60 con 0x55f2dabb7390 2024-09-21T05:58:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6c92e9640 1 --2- 172.21.15.7:0/2492268721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabb7390 0x55f2db006330 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc035000 tx=0x7fa6bc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8711ecbb37d780 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:58:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.719+0000 7fa6a3fff640 1 -- 172.21.15.7:0/2492268721 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc031bc0 con 0x55f2dabb7390 2024-09-21T05:58:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.720+0000 7fa6a3fff640 1 -- 172.21.15.7:0/2492268721 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa6bc031d60 con 0x55f2dabb7390 2024-09-21T05:58:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.720+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2492268721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6b402fba0 con 0x55f2dabb7390 2024-09-21T05:58:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.720+0000 7fa6a3fff640 1 -- 172.21.15.7:0/2492268721 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa6bc004440 con 0x55f2dabb7390 2024-09-21T05:58:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.720+0000 7fa6d12c0740 10 client.16566 fetch_fsmap learned FSMap version 25 2024-09-21T05:58:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.720+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2492268721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f2db0077d0 con 0x55f2dabb7390 2024-09-21T05:58:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.720+0000 7fa6a3fff640 1 -- 172.21.15.7:0/2492268721 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6b402fba0 con 0x55f2dabb7390 2024-09-21T05:58:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.720+0000 7fa6a3fff640 1 -- 172.21.15.7:0/2492268721 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa6bc051070 con 0x55f2dabb7390 2024-09-21T05:58:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.720+0000 7fa6d12c0740 10 client.16566 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:58:50.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.720+0000 7fa6d12c0740 10 client.16566 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:58:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.720+0000 7fa6d12c0740 20 client.16566 populate_metadata read hostname 'smithi007' 2024-09-21T05:58:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.720+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/2492268721 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f2dabd8070 0x55f2db009ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.720+0000 7fa6d12c0740 4 client.16566 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:58:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.720+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2492268721 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f2daef3850 con 0x55f2dabd8070 2024-09-21T05:58:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.721+0000 7fa6c8ae8640 1 --2- 172.21.15.7:0/2492268721 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f2dabd8070 0x55f2db009ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.721+0000 7fa6c8ae8640 1 --2- 172.21.15.7:0/2492268721 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f2dabd8070 0x55f2db009ff0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa0e32300bcce481 server_cookie=23b17a2aa2d1b7b2 in_seq=0 out_seq=0 2024-09-21T05:58:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.721+0000 7fa6a3fff640 10 client.16566 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.721+0000 7fa6a3fff640 1 -- 172.21.15.7:0/2492268721 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x55f2daef3850 con 0x55f2dabd8070 2024-09-21T05:58:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.721+0000 7fa6a3fff640 10 client.16566 handle_command_reply: tid=0 2024-09-21T05:58:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.721+0000 7fa6d12c0740 1 client.16566 shutdown 2024-09-21T05:58:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.721+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2492268721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabb7390 msgr2=0x55f2db006330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.721+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/2492268721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabb7390 0x55f2db006330 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc035000 tx=0x7fa6bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2492268721 shutdown_connections 2024-09-21T05:58:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/2492268721 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f2dabd8070 0x55f2db009ff0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/2492268721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dabb7390 0x55f2db006330 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/2492268721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dabaf1b0 0x55f2daf9e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6d12c0740 1 --2- 172.21.15.7:0/2492268721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dab969f0 0x55f2daf9de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2492268721 >> 172.21.15.7:0/2492268721 conn(0x55f2dabcc460 msgr2=0x55f2daf84380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6a3fff640 0 client.16566 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:58:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2492268721 shutdown_connections 2024-09-21T05:58:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6d12c0740 1 -- 172.21.15.7:0/2492268721 wait complete. 2024-09-21T05:58:50.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6d12c0740 20 client.16566 trim_cache size 0 max 16384 2024-09-21T05:58:50.728 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:58:50.728 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T05:58:50.728 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea", 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:50.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:50.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:50.731 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:50.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:50.731 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T05:58:50.731 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T05:58:50.731 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:50.731 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:50.731 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:50.731 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:50.731 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:50.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:50.731 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:58:50.731 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:58:50.732 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:50.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:58:50.734 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:58:50.734 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:58:50.734 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:58:50.734 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:58:50.734 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:58:50.734 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:58:50.734 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:58:50.734 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:58:50.734 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:58:50.734 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:58:50.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6cad4c640 1 -- 172.21.15.7:0/169913592 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa6ac0b6680 msgr2=0x7fa6ac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:50.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6cad4c640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa6ac0b6680 0x7fa6ac0b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009a60 tx=0x7fa6bc005d80 comp rx=0 tx=0).stop 2024-09-21T05:58:50.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6cad4c640 1 -- 172.21.15.7:0/169913592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6c41083d0 msgr2=0x7fa6c419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:50.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.722+0000 7fa6cad4c640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6c41083d0 0x7fa6c419cc10 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa6b800d770 tx=0x7fa6b800dc30 comp rx=0 tx=0).stop 2024-09-21T05:58:50.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.723+0000 7fa6cad4c640 1 -- 172.21.15.7:0/169913592 shutdown_connections 2024-09-21T05:58:50.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.723+0000 7fa6cad4c640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa6ac0b6680 0x7fa6ac0b8b90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.723+0000 7fa6cad4c640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6c41083d0 0x7fa6c419cc10 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.723+0000 7fa6cad4c640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6c4108d20 0x7fa6c41a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.723+0000 7fa6cad4c640 1 --2- 172.21.15.7:0/169913592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6c4102a90 0x7fa6c419c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.723+0000 7fa6cad4c640 1 -- 172.21.15.7:0/169913592 >> 172.21.15.7:0/169913592 conn(0x7fa6c4079750 msgr2=0x7fa6c406be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:50.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.723+0000 7fa6cad4c640 1 -- 172.21.15.7:0/169913592 shutdown_connections 2024-09-21T05:58:50.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:58:50.723+0000 7fa6cad4c640 1 -- 172.21.15.7:0/169913592 wait complete. 2024-09-21T05:58:51.481 INFO:tasks.cephfs.filesystem:scrub status for tag:8b32a028-2f13-4c77-ae0f-9f6b2c5403ea - {'path': '/', 'tag': '8b32a028-2f13-4c77-ae0f-9f6b2c5403ea', 'options': 'recursive,force'} 2024-09-21T05:58:52.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:51 smithi007 ceph-mon[30983]: pgmap v467: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T05:58:52.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:51 smithi119 ceph-mon[34833]: pgmap v467: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T05:58:52.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:51 smithi027 ceph-mon[34364]: pgmap v467: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T05:58:53.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:52 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T05:58:53.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:52 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T05:58:53.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:52 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T05:58:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:53 smithi007 ceph-mon[30983]: pgmap v468: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T05:58:54.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:53 smithi119 ceph-mon[34833]: pgmap v468: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T05:58:54.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:53 smithi027 ceph-mon[34364]: pgmap v468: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T05:58:56.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:55 smithi119 ceph-mon[34833]: pgmap v469: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T05:58:56.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:55 smithi027 ceph-mon[34364]: pgmap v469: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T05:58:56.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:55 smithi007 ceph-mon[30983]: pgmap v469: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T05:58:58.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:57 smithi119 ceph-mon[34833]: pgmap v470: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T05:58:58.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:57 smithi027 ceph-mon[34364]: pgmap v470: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T05:58:58.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:57 smithi007 ceph-mon[30983]: pgmap v470: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T05:59:00.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:59 smithi119 ceph-mon[34833]: pgmap v471: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:59:00.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:59 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:59:00.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:59 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:59:00.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:59 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:59:00.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:58:59 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:59:00.121 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:59 smithi007 ceph-mon[30983]: pgmap v471: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:59:00.121 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:59:00.121 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:59:00.121 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:59:00.121 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:58:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:59:00.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:59 smithi027 ceph-mon[34364]: pgmap v471: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:59:00.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:59 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:59:00.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:59 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:59:00.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:59 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:59:00.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:58:59 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T05:59:02.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:01 smithi119 ceph-mon[34833]: pgmap v472: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:59:02.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:01 smithi027 ceph-mon[34364]: pgmap v472: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:59:02.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:01 smithi007 ceph-mon[30983]: pgmap v472: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:59:04.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:03 smithi119 ceph-mon[34833]: pgmap v473: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T05:59:04.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:03 smithi027 ceph-mon[34364]: pgmap v473: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T05:59:04.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:03 smithi007 ceph-mon[30983]: pgmap v473: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T05:59:06.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:05 smithi119 ceph-mon[34833]: pgmap v474: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T05:59:06.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:05 smithi027 ceph-mon[34364]: pgmap v474: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T05:59:06.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:05 smithi007 ceph-mon[30983]: pgmap v474: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T05:59:08.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:07 smithi119 ceph-mon[34833]: pgmap v475: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T05:59:08.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:07 smithi027 ceph-mon[34364]: pgmap v475: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T05:59:08.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:07 smithi007 ceph-mon[30983]: pgmap v475: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T05:59:10.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:09 smithi027 ceph-mon[34364]: pgmap v476: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:59:10.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:09 smithi007 ceph-mon[30983]: pgmap v476: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:59:10.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:09 smithi119 ceph-mon[34833]: pgmap v476: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:59:12.144 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:11 smithi119 ceph-mon[34833]: pgmap v477: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:59:12.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:11 smithi027 ceph-mon[34364]: pgmap v477: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:59:12.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:11 smithi007 ceph-mon[30983]: pgmap v477: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T05:59:14.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:13 smithi027 ceph-mon[34364]: pgmap v478: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T05:59:14.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:13 smithi007 ceph-mon[30983]: pgmap v478: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T05:59:14.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:13 smithi119 ceph-mon[34833]: pgmap v478: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T05:59:16.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:15 smithi027 ceph-mon[34364]: pgmap v479: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T05:59:16.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:15 smithi007 ceph-mon[30983]: pgmap v479: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T05:59:16.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:15 smithi119 ceph-mon[34833]: pgmap v479: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T05:59:18.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:17 smithi027 ceph-mon[34364]: pgmap v480: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-21T05:59:18.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:17 smithi007 ceph-mon[30983]: pgmap v480: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-21T05:59:18.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:17 smithi119 ceph-mon[34833]: pgmap v480: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-21T05:59:20.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:19 smithi027 ceph-mon[34364]: pgmap v481: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T05:59:20.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:19 smithi007 ceph-mon[30983]: pgmap v481: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T05:59:20.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:19 smithi119 ceph-mon[34833]: pgmap v481: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T05:59:21.482 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:59:21.760 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:22.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:21 smithi007 ceph-mon[30983]: pgmap v482: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:59:22.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:21 smithi027 ceph-mon[34364]: pgmap v482: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:59:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.249+0000 7f434e4b3640 1 -- 172.21.15.7:0/1291059842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43481094d0 msgr2=0x7f43481098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.249+0000 7f434e4b3640 1 --2- 172.21.15.7:0/1291059842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43481094d0 0x7f43481098e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f433c009900 tx=0x7f433c02a410 comp rx=0 tx=0).stop 2024-09-21T05:59:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.249+0000 7f434e4b3640 1 -- 172.21.15.7:0/1291059842 shutdown_connections 2024-09-21T05:59:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.249+0000 7f434e4b3640 1 --2- 172.21.15.7:0/1291059842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43481094d0 0x7f43481098e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.249+0000 7f434e4b3640 1 --2- 172.21.15.7:0/1291059842 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4348109e20 0x7f4348110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.249+0000 7f434e4b3640 1 --2- 172.21.15.7:0/1291059842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4348103b90 0x7f4348103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.249+0000 7f434e4b3640 1 -- 172.21.15.7:0/1291059842 >> 172.21.15.7:0/1291059842 conn(0x7f43480ff600 msgr2=0x7f4348101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.249+0000 7f434e4b3640 1 -- 172.21.15.7:0/1291059842 shutdown_connections 2024-09-21T05:59:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.249+0000 7f434e4b3640 1 -- 172.21.15.7:0/1291059842 wait complete. 2024-09-21T05:59:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.250+0000 7f434e4b3640 1 Processor -- start 2024-09-21T05:59:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.250+0000 7f434e4b3640 1 -- start start 2024-09-21T05:59:22.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.250+0000 7f434e4b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4348103b90 0x7f434819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434e4b3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43481094d0 0x7f434819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434e4b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4348109e20 0x7f43481a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434e4b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4348113ae0 con 0x7f4348109e20 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434e4b3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4348113960 con 0x7f43481094d0 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434e4b3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4348113c60 con 0x7f4348103b90 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434ca50640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4348109e20 0x7f43481a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434ca50640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4348109e20 0x7f43481a1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47980/0 (socket says 172.21.15.7:47980) 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434ca50640 1 -- 172.21.15.7:0/759880141 learned_addr learned my addr 172.21.15.7:0/759880141 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f4347fff640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4348103b90 0x7f434819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f43477fe640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43481094d0 0x7f434819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434ca50640 1 -- 172.21.15.7:0/759880141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4348103b90 msgr2=0x7f434819c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434ca50640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4348103b90 0x7f434819c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434ca50640 1 -- 172.21.15.7:0/759880141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43481094d0 msgr2=0x7f434819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434ca50640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43481094d0 0x7f434819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434ca50640 1 -- 172.21.15.7:0/759880141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43481a2640 con 0x7f4348109e20 2024-09-21T05:59:22.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.251+0000 7f434ca50640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4348109e20 0x7f43481a1f10 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f434000eb10 tx=0x7f434000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:22.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.252+0000 7f43457fa640 1 -- 172.21.15.7:0/759880141 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4340004b20 con 0x7f4348109e20 2024-09-21T05:59:22.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.252+0000 7f43457fa640 1 -- 172.21.15.7:0/759880141 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4340004cc0 con 0x7f4348109e20 2024-09-21T05:59:22.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.252+0000 7f434e4b3640 1 -- 172.21.15.7:0/759880141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43481a2930 con 0x7f4348109e20 2024-09-21T05:59:22.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.252+0000 7f43457fa640 1 -- 172.21.15.7:0/759880141 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4340010670 con 0x7f4348109e20 2024-09-21T05:59:22.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.252+0000 7f434e4b3640 1 -- 172.21.15.7:0/759880141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43481a9090 con 0x7f4348109e20 2024-09-21T05:59:22.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.255+0000 7f43457fa640 1 -- 172.21.15.7:0/759880141 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f4340005020 con 0x7f4348109e20 2024-09-21T05:59:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.255+0000 7f4354a27740 1 Processor -- start 2024-09-21T05:59:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.255+0000 7f4354a27740 1 -- start start 2024-09-21T05:59:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f43457fa640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f43300b6700 0x7f43300b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4354a27740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8de3070 0x55a2c918a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4354a27740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dba1b0 0x55a2c918a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4354a27740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dc2390 0x55a2c918acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4354a27740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a2c9100e50 con 0x55a2c8de3070 2024-09-21T05:59:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4354a27740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a2c90f0280 con 0x55a2c8dba1b0 2024-09-21T05:59:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4354a27740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a2c90f4090 con 0x55a2c8dc2390 2024-09-21T05:59:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4347fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8de3070 0x55a2c918a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f43477fe640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f43300b6700 0x7f43300b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4347fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8de3070 0x55a2c918a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47984/0 (socket says 172.21.15.7:47984) 2024-09-21T05:59:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4347fff640 1 -- 172.21.15.7:0/453146984 learned_addr learned my addr 172.21.15.7:0/453146984 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f43457fa640 1 -- 172.21.15.7:0/759880141 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f43400e7c10 con 0x7f4348109e20 2024-09-21T05:59:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f43477fe640 1 --2- 172.21.15.7:0/453146984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dba1b0 0x55a2c918a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f434ca50640 1 --2- 172.21.15.7:0/453146984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dc2390 0x55a2c918acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4347fff640 1 -- 172.21.15.7:0/453146984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dc2390 msgr2=0x55a2c918acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4347fff640 1 --2- 172.21.15.7:0/453146984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dc2390 0x55a2c918acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4347fff640 1 -- 172.21.15.7:0/453146984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dba1b0 msgr2=0x55a2c918a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4347fff640 1 --2- 172.21.15.7:0/453146984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dba1b0 0x55a2c918a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4347fff640 1 -- 172.21.15.7:0/453146984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2c8e4e650 con 0x55a2c8de3070 2024-09-21T05:59:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f434ca50640 1 --2- 172.21.15.7:0/453146984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dc2390 0x55a2c918acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.256+0000 7f4347fff640 1 --2- 172.21.15.7:0/453146984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8de3070 0x55a2c918a270 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f433800b760 tx=0x7f433800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0e38a84d1e5f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.257+0000 7f43477fe640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f43300b6700 0x7f43300b8c10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f433c009230 tx=0x7f433c032ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.257+0000 7f432e7fc640 1 -- 172.21.15.7:0/453146984 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338003dd0 con 0x55a2c8de3070 2024-09-21T05:59:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.257+0000 7f432e7fc640 1 -- 172.21.15.7:0/453146984 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4338015070 con 0x55a2c8de3070 2024-09-21T05:59:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.257+0000 7f432e7fc640 1 -- 172.21.15.7:0/453146984 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338004d20 con 0x55a2c8de3070 2024-09-21T05:59:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.258+0000 7f4354a27740 1 -- 172.21.15.7:0/453146984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8de3070 msgr2=0x55a2c918a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.258+0000 7f4354a27740 1 --2- 172.21.15.7:0/453146984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8de3070 0x55a2c918a270 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f433800b760 tx=0x7f433800bc20 comp rx=0 tx=0).stop 2024-09-21T05:59:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.258+0000 7f4354a27740 1 -- 172.21.15.7:0/453146984 shutdown_connections 2024-09-21T05:59:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.258+0000 7f4354a27740 1 --2- 172.21.15.7:0/453146984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dc2390 0x55a2c918acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.258+0000 7f4354a27740 1 --2- 172.21.15.7:0/453146984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dba1b0 0x55a2c918a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.258+0000 7f4354a27740 1 --2- 172.21.15.7:0/453146984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8de3070 0x55a2c918a270 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.258+0000 7f4354a27740 1 -- 172.21.15.7:0/453146984 >> 172.21.15.7:0/453146984 conn(0x55a2c8dd7460 msgr2=0x55a2c9188160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.258+0000 7f4354a27740 1 -- 172.21.15.7:0/453146984 shutdown_connections 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.258+0000 7f4354a27740 1 -- 172.21.15.7:0/453146984 wait complete. 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.258+0000 7f4354a27740 1 -- start start 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.258+0000 7f4354a27740 1 Processor -- start 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f4354a27740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dba1b0 0x55a2c9195900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f4354a27740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 0x55a2c9195e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f4354a27740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8de3070 0x55a2c91963c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f4354a27740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a2c8f51700 con 0x55a2c8dc2390 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f4354a27740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a2c908b110 con 0x55a2c8de3070 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f4354a27740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a2c9198a50 con 0x55a2c8dba1b0 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f4354a27740 10 client.0 _ll_register_callbacks cb 0x55a2c90a4990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f43477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 0x55a2c9195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f43477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 0x55a2c9195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47998/0 (socket says 172.21.15.7:47998) 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f43477fe640 1 -- 172.21.15.7:0/624862652 learned_addr learned my addr 172.21.15.7:0/624862652 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f434ca50640 1 --2- 172.21.15.7:0/624862652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8de3070 0x55a2c91963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f4347fff640 1 --2- 172.21.15.7:0/624862652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dba1b0 0x55a2c9195900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f43477fe640 1 -- 172.21.15.7:0/624862652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dba1b0 msgr2=0x55a2c9195900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:22.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f43477fe640 1 --2- 172.21.15.7:0/624862652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dba1b0 0x55a2c9195900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f43477fe640 1 -- 172.21.15.7:0/624862652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8de3070 msgr2=0x55a2c91963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:22.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f43477fe640 1 --2- 172.21.15.7:0/624862652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8de3070 0x55a2c91963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.259+0000 7f43477fe640 1 -- 172.21.15.7:0/624862652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2c90b8c40 con 0x55a2c8dc2390 2024-09-21T05:59:22.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.260+0000 7f43477fe640 1 --2- 172.21.15.7:0/624862652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 0x55a2c9195e40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f433c009900 tx=0x7f433c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15be94524efd6f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:22.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.260+0000 7f43277fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:22.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.260+0000 7f43277fe640 1 -- 172.21.15.7:0/624862652 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c04e070 con 0x55a2c8dc2390 2024-09-21T05:59:22.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.260+0000 7f43277fe640 1 -- 172.21.15.7:0/624862652 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f433c004450 con 0x55a2c8dc2390 2024-09-21T05:59:22.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.260+0000 7f4354a27740 1 -- 172.21.15.7:0/624862652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4338015070 con 0x55a2c8dc2390 2024-09-21T05:59:22.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.260+0000 7f43277fe640 1 -- 172.21.15.7:0/624862652 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f433c05a050 con 0x55a2c8dc2390 2024-09-21T05:59:22.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.260+0000 7f4354a27740 10 client.16578 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:22.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.260+0000 7f4354a27740 1 -- 172.21.15.7:0/624862652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a2c91a46c0 con 0x55a2c8dc2390 2024-09-21T05:59:22.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.260+0000 7f43277fe640 1 -- 172.21.15.7:0/624862652 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4338015070 con 0x55a2c8dc2390 2024-09-21T05:59:22.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.261+0000 7f43277fe640 1 -- 172.21.15.7:0/624862652 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f433c004b10 con 0x55a2c8dc2390 2024-09-21T05:59:22.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.261+0000 7f4354a27740 10 client.16578 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:22.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.261+0000 7f4354a27740 10 client.16578 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:22.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.261+0000 7f4354a27740 20 client.16578 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:22.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.261+0000 7f4354a27740 1 --2- 172.21.15.7:0/624862652 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a2c8da19f0 0x55a2c91a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.261+0000 7f4354a27740 4 client.16578 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:22.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.261+0000 7f4354a27740 1 -- 172.21.15.7:0/624862652 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2c9102da0 con 0x55a2c8da19f0 2024-09-21T05:59:22.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.261+0000 7f4347fff640 1 --2- 172.21.15.7:0/624862652 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a2c8da19f0 0x55a2c91a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.262+0000 7f4347fff640 1 --2- 172.21.15.7:0/624862652 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a2c8da19f0 0x55a2c91a7c10 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36a3c8729aeb43f1 server_cookie=ff969c6873968803 in_seq=0 out_seq=0 2024-09-21T05:59:22.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.262+0000 7f43277fe640 10 client.16578 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.262+0000 7f43277fe640 1 -- 172.21.15.7:0/624862652 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a2c9102da0 con 0x55a2c8da19f0 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.262+0000 7f43277fe640 10 client.16578 handle_command_reply: tid=0 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.262+0000 7f4354a27740 1 client.16578 shutdown 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.262+0000 7f4354a27740 1 -- 172.21.15.7:0/624862652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 msgr2=0x55a2c9195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.262+0000 7f4354a27740 1 --2- 172.21.15.7:0/624862652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 0x55a2c9195e40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f433c009900 tx=0x7f433c02a410 comp rx=0 tx=0).stop 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.263+0000 7f4354a27740 1 -- 172.21.15.7:0/624862652 shutdown_connections 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.263+0000 7f4354a27740 1 --2- 172.21.15.7:0/624862652 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a2c8da19f0 0x55a2c91a7c10 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.263+0000 7f43277fe640 0 client.16578 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.263+0000 7f4354a27740 1 --2- 172.21.15.7:0/624862652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 0x55a2c9195e40 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.263+0000 7f4354a27740 1 --2- 172.21.15.7:0/624862652 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8de3070 0x55a2c91963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.263+0000 7f4354a27740 1 --2- 172.21.15.7:0/624862652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dba1b0 0x55a2c9195900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.263+0000 7f4354a27740 1 -- 172.21.15.7:0/624862652 >> 172.21.15.7:0/624862652 conn(0x55a2c8dd7460 msgr2=0x55a2c918d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.263+0000 7f4354a27740 1 -- 172.21.15.7:0/624862652 shutdown_connections 2024-09-21T05:59:22.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.263+0000 7f4354a27740 1 -- 172.21.15.7:0/624862652 wait complete. 2024-09-21T05:59:22.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.263+0000 7f4354a27740 20 client.16578 trim_cache size 0 max 16384 2024-09-21T05:59:22.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.280+0000 7f4354a27740 1 Processor -- start 2024-09-21T05:59:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.280+0000 7f4354a27740 1 -- start start 2024-09-21T05:59:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f4354a27740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8da19f0 0x55a2c9195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f4354a27740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dba1b0 0x55a2c9187710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f4354a27740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 0x55a2c9187c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f4354a27740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f43481b4050 con 0x55a2c8dc2390 2024-09-21T05:59:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f4354a27740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f43481b1920 con 0x55a2c8dba1b0 2024-09-21T05:59:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f4354a27740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f43481af770 con 0x55a2c8da19f0 2024-09-21T05:59:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f434ca50640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 0x55a2c9187c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f434ca50640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 0x55a2c9187c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48002/0 (socket says 172.21.15.7:48002) 2024-09-21T05:59:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f434ca50640 1 -- 172.21.15.7:0/3680950867 learned_addr learned my addr 172.21.15.7:0/3680950867 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f4347fff640 1 --2- 172.21.15.7:0/3680950867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8da19f0 0x55a2c9195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f43477fe640 1 --2- 172.21.15.7:0/3680950867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dba1b0 0x55a2c9187710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f434ca50640 1 -- 172.21.15.7:0/3680950867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8da19f0 msgr2=0x55a2c9195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f434ca50640 1 --2- 172.21.15.7:0/3680950867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8da19f0 0x55a2c9195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f434ca50640 1 -- 172.21.15.7:0/3680950867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dba1b0 msgr2=0x55a2c9187710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f434ca50640 1 --2- 172.21.15.7:0/3680950867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dba1b0 0x55a2c9187710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f434ca50640 1 -- 172.21.15.7:0/3680950867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2c918c830 con 0x55a2c8dc2390 2024-09-21T05:59:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.281+0000 7f4347fff640 1 --2- 172.21.15.7:0/3680950867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8da19f0 0x55a2c9195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.282+0000 7f434ca50640 1 --2- 172.21.15.7:0/3680950867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 0x55a2c9187c50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f43400ada70 tx=0x7f43400ad970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570c3731e9c7ea57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.282+0000 7f432dffb640 1 -- 172.21.15.7:0/3680950867 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43400ad5f0 con 0x55a2c8dc2390 2024-09-21T05:59:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.282+0000 7f432dffb640 1 -- 172.21.15.7:0/3680950867 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43400ae1e0 con 0x55a2c8dc2390 2024-09-21T05:59:22.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.282+0000 7f432dffb640 1 -- 172.21.15.7:0/3680950867 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43400b21d0 con 0x55a2c8dc2390 2024-09-21T05:59:22.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.283+0000 7f4354a27740 1 -- 172.21.15.7:0/3680950867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 msgr2=0x55a2c9187c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.283+0000 7f4354a27740 1 --2- 172.21.15.7:0/3680950867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 0x55a2c9187c50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f43400ada70 tx=0x7f43400ad970 comp rx=0 tx=0).stop 2024-09-21T05:59:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.283+0000 7f4354a27740 1 -- 172.21.15.7:0/3680950867 shutdown_connections 2024-09-21T05:59:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.283+0000 7f4354a27740 1 --2- 172.21.15.7:0/3680950867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8dc2390 0x55a2c9187c50 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.283+0000 7f4354a27740 1 --2- 172.21.15.7:0/3680950867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dba1b0 0x55a2c9187710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.283+0000 7f4354a27740 1 --2- 172.21.15.7:0/3680950867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8da19f0 0x55a2c9195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.283+0000 7f4354a27740 1 -- 172.21.15.7:0/3680950867 >> 172.21.15.7:0/3680950867 conn(0x55a2c8dd7460 msgr2=0x55a2c91956b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.283+0000 7f4354a27740 1 -- 172.21.15.7:0/3680950867 shutdown_connections 2024-09-21T05:59:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.283+0000 7f4354a27740 1 -- 172.21.15.7:0/3680950867 wait complete. 2024-09-21T05:59:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.283+0000 7f4354a27740 1 -- start start 2024-09-21T05:59:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.284+0000 7f4354a27740 1 Processor -- start 2024-09-21T05:59:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.284+0000 7f4354a27740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8da19f0 0x55a2c9199d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.284+0000 7f4354a27740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dba1b0 0x55a2c919a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.284+0000 7f4354a27740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dc2390 0x55a2c919a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.284+0000 7f4354a27740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f43481afde0 con 0x55a2c8da19f0 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.284+0000 7f4354a27740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f43481b1250 con 0x55a2c8dc2390 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.284+0000 7f4354a27740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f43481b04b0 con 0x55a2c8dba1b0 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.284+0000 7f4347fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8da19f0 0x55a2c9199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.284+0000 7f4354a27740 10 client.0 _ll_register_callbacks cb 0x7f433c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.284+0000 7f4347fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8da19f0 0x55a2c9199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48008/0 (socket says 172.21.15.7:48008) 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.284+0000 7f4347fff640 1 -- 172.21.15.7:0/1619066834 learned_addr learned my addr 172.21.15.7:0/1619066834 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.284+0000 7f43477fe640 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dba1b0 0x55a2c919a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.284+0000 7f434ca50640 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dc2390 0x55a2c919a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.285+0000 7f4347fff640 1 -- 172.21.15.7:0/1619066834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dba1b0 msgr2=0x55a2c919a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.285+0000 7f4347fff640 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dba1b0 0x55a2c919a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.285+0000 7f4347fff640 1 -- 172.21.15.7:0/1619066834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dc2390 msgr2=0x55a2c919a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.285+0000 7f4347fff640 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dc2390 0x55a2c919a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.285+0000 7f4347fff640 1 -- 172.21.15.7:0/1619066834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2c9211650 con 0x55a2c8da19f0 2024-09-21T05:59:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.285+0000 7f434ca50640 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dc2390 0x55a2c919a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.285+0000 7f4347fff640 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8da19f0 0x55a2c9199d50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f433800b760 tx=0x7f4338004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f6420bc4fd00d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.285+0000 7f43277fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.285+0000 7f43277fe640 1 -- 172.21.15.7:0/1619066834 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338003ea0 con 0x55a2c8da19f0 2024-09-21T05:59:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.285+0000 7f4354a27740 1 -- 172.21.15.7:0/1619066834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43400ae1e0 con 0x55a2c8da19f0 2024-09-21T05:59:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.285+0000 7f43277fe640 1 -- 172.21.15.7:0/1619066834 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f433802c660 con 0x55a2c8da19f0 2024-09-21T05:59:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.285+0000 7f43277fe640 1 -- 172.21.15.7:0/1619066834 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f433802c860 con 0x55a2c8da19f0 2024-09-21T05:59:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.286+0000 7f4354a27740 10 client.16584 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.286+0000 7f4354a27740 1 -- 172.21.15.7:0/1619066834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a2c9212940 con 0x55a2c8da19f0 2024-09-21T05:59:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.286+0000 7f43277fe640 1 -- 172.21.15.7:0/1619066834 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43400ae1e0 con 0x55a2c8da19f0 2024-09-21T05:59:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.286+0000 7f43277fe640 1 -- 172.21.15.7:0/1619066834 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4338036aa0 con 0x55a2c8da19f0 2024-09-21T05:59:22.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.286+0000 7f4354a27740 10 client.16584 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:22.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.286+0000 7f4354a27740 10 client.16584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:22.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.286+0000 7f4354a27740 20 client.16584 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:22.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.286+0000 7f4354a27740 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a2c8de3070 0x55a2c9214e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:22.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.286+0000 7f4354a27740 4 client.16584 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:59:22.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.286+0000 7f4354a27740 1 -- 172.21.15.7:0/1619066834 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a2c90fe850 con 0x55a2c8de3070 2024-09-21T05:59:22.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.286+0000 7f43477fe640 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a2c8de3070 0x55a2c9214e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:22.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f43277fe640 10 client.16584 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f43477fe640 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a2c8de3070 0x55a2c9214e00 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19e76962e7d27bd7 server_cookie=2b86390843fc4441 in_seq=0 out_seq=0 2024-09-21T05:59:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f43277fe640 1 -- 172.21.15.7:0/1619066834 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55a2c90fe850 con 0x55a2c8de3070 2024-09-21T05:59:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f43277fe640 10 client.16584 handle_command_reply: tid=0 2024-09-21T05:59:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f4354a27740 1 client.16584 shutdown 2024-09-21T05:59:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f4354a27740 1 -- 172.21.15.7:0/1619066834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8da19f0 msgr2=0x55a2c9199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f4354a27740 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8da19f0 0x55a2c9199d50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f433800b760 tx=0x7f4338004860 comp rx=0 tx=0).stop 2024-09-21T05:59:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f4354a27740 1 -- 172.21.15.7:0/1619066834 shutdown_connections 2024-09-21T05:59:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f4354a27740 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55a2c8de3070 0x55a2c9214e00 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f4354a27740 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a2c8dc2390 0x55a2c919a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f4354a27740 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a2c8dba1b0 0x55a2c919a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f4354a27740 1 --2- 172.21.15.7:0/1619066834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a2c8da19f0 0x55a2c9199d50 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f4354a27740 1 -- 172.21.15.7:0/1619066834 >> 172.21.15.7:0/1619066834 conn(0x55a2c8dd7460 msgr2=0x55a2c91a0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f43277fe640 0 client.16584 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f4354a27740 1 -- 172.21.15.7:0/1619066834 shutdown_connections 2024-09-21T05:59:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.287+0000 7f4354a27740 1 -- 172.21.15.7:0/1619066834 wait complete. 2024-09-21T05:59:22.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.288+0000 7f4354a27740 20 client.16584 trim_cache size 0 max 16384 2024-09-21T05:59:22.296 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:59:22.296 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T05:59:22.296 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T05:59:22.296 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:59:22.296 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T05:59:22.296 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T05:59:22.296 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:22.296 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T05:59:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T05:59:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:59:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:59:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:59:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:59:22.301 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:59:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.288+0000 7f434e4b3640 1 -- 172.21.15.7:0/759880141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f43300b6700 msgr2=0x7f43300b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.288+0000 7f434e4b3640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f43300b6700 0x7f43300b8c10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f433c009230 tx=0x7f433c032ed0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.288+0000 7f434e4b3640 1 -- 172.21.15.7:0/759880141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4348109e20 msgr2=0x7f43481a1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.288+0000 7f434e4b3640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4348109e20 0x7f43481a1f10 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f434000eb10 tx=0x7f434000c2d0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.288+0000 7f434e4b3640 1 -- 172.21.15.7:0/759880141 shutdown_connections 2024-09-21T05:59:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.288+0000 7f434e4b3640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f43300b6700 0x7f43300b8c10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.288+0000 7f434e4b3640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4348109e20 0x7f43481a1f10 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.288+0000 7f434e4b3640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43481094d0 0x7f434819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.288+0000 7f434e4b3640 1 --2- 172.21.15.7:0/759880141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4348103b90 0x7f434819c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.288+0000 7f434e4b3640 1 -- 172.21.15.7:0/759880141 >> 172.21.15.7:0/759880141 conn(0x7f43480ff600 msgr2=0x7f4348108b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.289+0000 7f434e4b3640 1 -- 172.21.15.7:0/759880141 shutdown_connections 2024-09-21T05:59:22.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:22.289+0000 7f434e4b3640 1 -- 172.21.15.7:0/759880141 wait complete. 2024-09-21T05:59:22.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:21 smithi119 ceph-mon[34833]: pgmap v482: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:59:23.099 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T05:59:23.100 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:59:23.365 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.847+0000 7f002bbc2640 1 -- 172.21.15.7:0/3574414382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00241083c0 msgr2=0x7f00241087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.847+0000 7f002bbc2640 1 --2- 172.21.15.7:0/3574414382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00241083c0 0x7f00241087d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0014009900 tx=0x7f001402a410 comp rx=0 tx=0).stop 2024-09-21T05:59:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.847+0000 7f002bbc2640 1 -- 172.21.15.7:0/3574414382 shutdown_connections 2024-09-21T05:59:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.847+0000 7f002bbc2640 1 --2- 172.21.15.7:0/3574414382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00241083c0 0x7f00241087d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.847+0000 7f002bbc2640 1 --2- 172.21.15.7:0/3574414382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0024108d10 0x7f002410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.847+0000 7f002bbc2640 1 --2- 172.21.15.7:0/3574414382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0024102a80 0x7f0024102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.847+0000 7f002bbc2640 1 -- 172.21.15.7:0/3574414382 >> 172.21.15.7:0/3574414382 conn(0x7f0024079740 msgr2=0x7f0024079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.848+0000 7f002bbc2640 1 -- 172.21.15.7:0/3574414382 shutdown_connections 2024-09-21T05:59:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.848+0000 7f002bbc2640 1 -- 172.21.15.7:0/3574414382 wait complete. 2024-09-21T05:59:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.848+0000 7f002bbc2640 1 Processor -- start 2024-09-21T05:59:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.848+0000 7f002bbc2640 1 -- start start 2024-09-21T05:59:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002bbc2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0024102a80 0x7f002419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002bbc2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00241083c0 0x7f002419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002bbc2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0024108d10 0x7f002419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002bbc2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0024112980 con 0x7f0024108d10 2024-09-21T05:59:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002bbc2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0024112800 con 0x7f0024102a80 2024-09-21T05:59:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002bbc2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0024112b00 con 0x7f00241083c0 2024-09-21T05:59:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002a15f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0024108d10 0x7f002419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002a15f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0024108d10 0x7f002419fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48026/0 (socket says 172.21.15.7:48026) 2024-09-21T05:59:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002a15f640 1 -- 172.21.15.7:0/4155585867 learned_addr learned my addr 172.21.15.7:0/4155585867 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002995e640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0024102a80 0x7f002419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002915d640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00241083c0 0x7f002419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002a15f640 1 -- 172.21.15.7:0/4155585867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00241083c0 msgr2=0x7f002419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002a15f640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00241083c0 0x7f002419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002a15f640 1 -- 172.21.15.7:0/4155585867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0024102a80 msgr2=0x7f002419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002a15f640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0024102a80 0x7f002419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002a15f640 1 -- 172.21.15.7:0/4155585867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00241a04f0 con 0x7f0024108d10 2024-09-21T05:59:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f002a15f640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0024108d10 0x7f002419fdc0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f001c00eaa0 tx=0x7f001c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.849+0000 7f001affd640 1 -- 172.21.15.7:0/4155585867 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c00cdb0 con 0x7f0024108d10 2024-09-21T05:59:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.850+0000 7f001affd640 1 -- 172.21.15.7:0/4155585867 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f001c005020 con 0x7f0024108d10 2024-09-21T05:59:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.850+0000 7f001affd640 1 -- 172.21.15.7:0/4155585867 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c0116d0 con 0x7f0024108d10 2024-09-21T05:59:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.850+0000 7f002bbc2640 1 -- 172.21.15.7:0/4155585867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00241a07e0 con 0x7f0024108d10 2024-09-21T05:59:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.850+0000 7f002bbc2640 1 -- 172.21.15.7:0/4155585867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00241a6f40 con 0x7f0024108d10 2024-09-21T05:59:23.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.851+0000 7f002bbc2640 1 -- 172.21.15.7:0/4155585867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0024103d00 con 0x7f0024108d10 2024-09-21T05:59:23.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.852+0000 7f001affd640 1 -- 172.21.15.7:0/4155585867 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f001c0051d0 con 0x7f0024108d10 2024-09-21T05:59:23.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.853+0000 7f001affd640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00100b6680 0x7f00100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:23.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.853+0000 7f002995e640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00100b6680 0x7f00100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:23.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.853+0000 7f001affd640 1 -- 172.21.15.7:0/4155585867 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f001c0e7c70 con 0x7f0024108d10 2024-09-21T05:59:23.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.854+0000 7f002995e640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00100b6680 0x7f00100b8b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0020005d00 tx=0x7f002000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:23.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:23.856+0000 7f001affd640 1 -- 172.21.15.7:0/4155585867 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f001c016030 con 0x7f0024108d10 2024-09-21T05:59:24.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:23 smithi007 ceph-mon[30983]: pgmap v483: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:59:24.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.083+0000 7f002bbc2640 1 -- 172.21.15.7:0/4155585867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0024102e90 con 0x7f0024108d10 2024-09-21T05:59:24.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.084+0000 7f001affd640 1 -- 172.21.15.7:0/4155585867 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f001c0ae1e0 con 0x7f0024108d10 2024-09-21T05:59:24.087 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:59:24.087 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:59:24.087 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:59:24.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.086+0000 7f002bbc2640 1 -- 172.21.15.7:0/4155585867 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00100b6680 msgr2=0x7f00100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:24.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.086+0000 7f002bbc2640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00100b6680 0x7f00100b8b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0020005d00 tx=0x7f002000b410 comp rx=0 tx=0).stop 2024-09-21T05:59:24.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.086+0000 7f002bbc2640 1 -- 172.21.15.7:0/4155585867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0024108d10 msgr2=0x7f002419fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:24.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.086+0000 7f002bbc2640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0024108d10 0x7f002419fdc0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f001c00eaa0 tx=0x7f001c00ef60 comp rx=0 tx=0).stop 2024-09-21T05:59:24.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.086+0000 7f002bbc2640 1 -- 172.21.15.7:0/4155585867 shutdown_connections 2024-09-21T05:59:24.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.086+0000 7f002bbc2640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00100b6680 0x7f00100b8b90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:24.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.086+0000 7f002bbc2640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0024108d10 0x7f002419fdc0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:24.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.086+0000 7f002bbc2640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00241083c0 0x7f002419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:24.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.086+0000 7f002bbc2640 1 --2- 172.21.15.7:0/4155585867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0024102a80 0x7f002419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:24.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.086+0000 7f002bbc2640 1 -- 172.21.15.7:0/4155585867 >> 172.21.15.7:0/4155585867 conn(0x7f0024079740 msgr2=0x7f002406c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:24.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.086+0000 7f002bbc2640 1 -- 172.21.15.7:0/4155585867 shutdown_connections 2024-09-21T05:59:24.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:24.086+0000 7f002bbc2640 1 -- 172.21.15.7:0/4155585867 wait complete. 2024-09-21T05:59:24.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:23 smithi027 ceph-mon[34364]: pgmap v483: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:59:24.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:23 smithi119 ceph-mon[34833]: pgmap v483: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T05:59:24.768 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T05:59:25.031 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:25.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:24 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4155585867' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:25.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:24 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/4155585867' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:25.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:24 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/4155585867' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:25.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.505+0000 7f6745d7b640 1 -- 172.21.15.7:0/3391621725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f674010de70 msgr2=0x7f6740110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.505+0000 7f6745d7b640 1 --2- 172.21.15.7:0/3391621725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f674010de70 0x7f6740110310 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6738009ca0 tx=0x7f673802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.505+0000 7f6745d7b640 1 -- 172.21.15.7:0/3391621725 shutdown_connections 2024-09-21T05:59:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.505+0000 7f6745d7b640 1 --2- 172.21.15.7:0/3391621725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f674010de70 0x7f6740110310 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.505+0000 7f6745d7b640 1 --2- 172.21.15.7:0/3391621725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67401052f0 0x7f674010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.505+0000 7f6745d7b640 1 --2- 172.21.15.7:0/3391621725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67401048c0 0x7f6740104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.505+0000 7f6745d7b640 1 -- 172.21.15.7:0/3391621725 >> 172.21.15.7:0/3391621725 conn(0x7f6740079740 msgr2=0x7f6740079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.505+0000 7f6745d7b640 1 -- 172.21.15.7:0/3391621725 shutdown_connections 2024-09-21T05:59:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.505+0000 7f6745d7b640 1 -- 172.21.15.7:0/3391621725 wait complete. 2024-09-21T05:59:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.505+0000 7f6745d7b640 1 Processor -- start 2024-09-21T05:59:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.506+0000 7f6745d7b640 1 -- start start 2024-09-21T05:59:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.506+0000 7f6745d7b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67401048c0 0x7f674019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.506+0000 7f6745d7b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67401052f0 0x7f674019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.506+0000 7f6745d7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f674010de70 0x7f674019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.506+0000 7f6745d7b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6740113a80 con 0x7f67401052f0 2024-09-21T05:59:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.506+0000 7f6745d7b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6740113900 con 0x7f67401048c0 2024-09-21T05:59:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.506+0000 7f6745d7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6740113c00 con 0x7f674010de70 2024-09-21T05:59:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.506+0000 7f673effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67401052f0 0x7f674019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.506+0000 7f673effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67401052f0 0x7f674019a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48052/0 (socket says 172.21.15.7:48052) 2024-09-21T05:59:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.506+0000 7f673f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67401048c0 0x7f674019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.506+0000 7f673effd640 1 -- 172.21.15.7:0/33250391 learned_addr learned my addr 172.21.15.7:0/33250391 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.506+0000 7f673f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67401048c0 0x7f674019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:34078/0 (socket says 172.21.15.7:34078) 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.506+0000 7f673ffff640 1 --2- 172.21.15.7:0/33250391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f674010de70 0x7f674019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.507+0000 7f673effd640 1 -- 172.21.15.7:0/33250391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f674010de70 msgr2=0x7f674019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.507+0000 7f673effd640 1 --2- 172.21.15.7:0/33250391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f674010de70 0x7f674019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.507+0000 7f673effd640 1 -- 172.21.15.7:0/33250391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67401048c0 msgr2=0x7f674019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.507+0000 7f673effd640 1 --2- 172.21.15.7:0/33250391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67401048c0 0x7f674019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.507+0000 7f673effd640 1 -- 172.21.15.7:0/33250391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67401a0300 con 0x7f67401052f0 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.507+0000 7f673effd640 1 --2- 172.21.15.7:0/33250391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67401052f0 0x7f674019a9f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f673400c970 tx=0x7f673400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.507+0000 7f673cff9640 1 -- 172.21.15.7:0/33250391 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734014070 con 0x7f67401052f0 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.507+0000 7f6745d7b640 1 -- 172.21.15.7:0/33250391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67401a05f0 con 0x7f67401052f0 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.507+0000 7f673cff9640 1 -- 172.21.15.7:0/33250391 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6734004440 con 0x7f67401052f0 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.507+0000 7f673cff9640 1 -- 172.21.15.7:0/33250391 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734003e50 con 0x7f67401052f0 2024-09-21T05:59:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.507+0000 7f6745d7b640 1 -- 172.21.15.7:0/33250391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67401a6e10 con 0x7f67401052f0 2024-09-21T05:59:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.510+0000 7f674c2ef740 1 Processor -- start 2024-09-21T05:59:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.510+0000 7f674c2ef740 1 -- start start 2024-09-21T05:59:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.510+0000 7f673cff9640 1 -- 172.21.15.7:0/33250391 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6734017070 con 0x7f67401052f0 2024-09-21T05:59:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.510+0000 7f674c2ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20d3070 0x560fe247a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.510+0000 7f674c2ef740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20aa1b0 0x560fe247a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.510+0000 7f674c2ef740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20b2390 0x560fe247ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.510+0000 7f674c2ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560fe23f0ea0 con 0x560fe20d3070 2024-09-21T05:59:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.510+0000 7f674c2ef740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560fe23e02d0 con 0x560fe20b2390 2024-09-21T05:59:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.510+0000 7f674c2ef740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560fe23e40e0 con 0x560fe20aa1b0 2024-09-21T05:59:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.510+0000 7f673ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20d3070 0x560fe247a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.511+0000 7f673ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20d3070 0x560fe247a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48060/0 (socket says 172.21.15.7:48060) 2024-09-21T05:59:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.511+0000 7f673ffff640 1 -- 172.21.15.7:0/1321415716 learned_addr learned my addr 172.21.15.7:0/1321415716 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.511+0000 7f673f7fe640 1 --2- 172.21.15.7:0/1321415716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20aa1b0 0x560fe247a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.511+0000 7f673effd640 1 --2- 172.21.15.7:0/1321415716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20b2390 0x560fe247ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.511+0000 7f673ffff640 1 -- 172.21.15.7:0/1321415716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20aa1b0 msgr2=0x560fe247a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.511+0000 7f673ffff640 1 --2- 172.21.15.7:0/1321415716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20aa1b0 0x560fe247a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.511+0000 7f673ffff640 1 -- 172.21.15.7:0/1321415716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20b2390 msgr2=0x560fe247ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.511+0000 7f673ffff640 1 --2- 172.21.15.7:0/1321415716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20b2390 0x560fe247ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.511+0000 7f673ffff640 1 -- 172.21.15.7:0/1321415716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fe213e650 con 0x560fe20d3070 2024-09-21T05:59:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.511+0000 7f673ffff640 1 --2- 172.21.15.7:0/1321415716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20d3070 0x560fe247a2c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6738009930 tx=0x7f6738009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a390a8354de67349 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.511+0000 7f673cff9640 1 --2- 172.21.15.7:0/33250391 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f67280b6850 0x7f67280b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.511+0000 7f6725ffb640 1 -- 172.21.15.7:0/1321415716 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6738031df0 con 0x560fe20d3070 2024-09-21T05:59:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.512+0000 7f673f7fe640 1 --2- 172.21.15.7:0/33250391 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f67280b6850 0x7f67280b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.512+0000 7f6725ffb640 1 -- 172.21.15.7:0/1321415716 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6738036040 con 0x560fe20d3070 2024-09-21T05:59:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.512+0000 7f6725ffb640 1 -- 172.21.15.7:0/1321415716 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67380042d0 con 0x560fe20d3070 2024-09-21T05:59:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.512+0000 7f673cff9640 1 -- 172.21.15.7:0/33250391 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f67340e71e0 con 0x7f67401052f0 2024-09-21T05:59:25.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.512+0000 7f674c2ef740 1 -- 172.21.15.7:0/1321415716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20d3070 msgr2=0x560fe247a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:25.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.512+0000 7f673f7fe640 1 --2- 172.21.15.7:0/33250391 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f67280b6850 0x7f67280b8d60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x560fe2478f40 tx=0x7f673000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:25.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.512+0000 7f674c2ef740 1 --2- 172.21.15.7:0/1321415716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20d3070 0x560fe247a2c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6738009930 tx=0x7f6738009960 comp rx=0 tx=0).stop 2024-09-21T05:59:25.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.513+0000 7f674c2ef740 1 -- 172.21.15.7:0/1321415716 shutdown_connections 2024-09-21T05:59:25.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.513+0000 7f674c2ef740 1 --2- 172.21.15.7:0/1321415716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20b2390 0x560fe247ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.513+0000 7f674c2ef740 1 --2- 172.21.15.7:0/1321415716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20aa1b0 0x560fe247a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.513+0000 7f674c2ef740 1 --2- 172.21.15.7:0/1321415716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20d3070 0x560fe247a2c0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.513+0000 7f674c2ef740 1 -- 172.21.15.7:0/1321415716 >> 172.21.15.7:0/1321415716 conn(0x560fe20c7460 msgr2=0x560fe24781b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:25.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.513+0000 7f674c2ef740 1 -- 172.21.15.7:0/1321415716 shutdown_connections 2024-09-21T05:59:25.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.513+0000 7f674c2ef740 1 -- 172.21.15.7:0/1321415716 wait complete. 2024-09-21T05:59:25.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.513+0000 7f674c2ef740 1 -- start start 2024-09-21T05:59:25.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.513+0000 7f674c2ef740 1 Processor -- start 2024-09-21T05:59:25.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f674c2ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 0x560fe2485990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f674c2ef740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20b2390 0x560fe2485ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f674c2ef740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 0x560fe2491d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f674c2ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560fe2241700 con 0x560fe20aa1b0 2024-09-21T05:59:25.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f674c2ef740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560fe237b160 con 0x560fe20d3070 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f674c2ef740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560fe2488a40 con 0x560fe20b2390 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f674c2ef740 10 client.0 _ll_register_callbacks cb 0x560fe23949e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f673f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 0x560fe2485990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f673f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 0x560fe2485990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48076/0 (socket says 172.21.15.7:48076) 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f673f7fe640 1 -- 172.21.15.7:0/2761035412 learned_addr learned my addr 172.21.15.7:0/2761035412 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f673ffff640 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 0x560fe2491d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f673effd640 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20b2390 0x560fe2485ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f673f7fe640 1 -- 172.21.15.7:0/2761035412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20b2390 msgr2=0x560fe2485ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f673f7fe640 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20b2390 0x560fe2485ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f673f7fe640 1 -- 172.21.15.7:0/2761035412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 msgr2=0x560fe2491d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f673f7fe640 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 0x560fe2491d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f673f7fe640 1 -- 172.21.15.7:0/2761035412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fe23a8c90 con 0x560fe20aa1b0 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.514+0000 7f673effd640 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20b2390 0x560fe2485ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f673f7fe640 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 0x560fe2485990 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6730003c80 tx=0x7f67300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de1854eaa68668d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:25.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f671effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f671effd640 1 -- 172.21.15.7:0/2761035412 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673002c060 con 0x560fe20aa1b0 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f671effd640 1 -- 172.21.15.7:0/2761035412 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f6730017030 con 0x560fe20aa1b0 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f674c2ef740 1 -- 172.21.15.7:0/2761035412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6738036040 con 0x560fe20aa1b0 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f671effd640 1 -- 172.21.15.7:0/2761035412 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6730031430 con 0x560fe20aa1b0 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f674c2ef740 10 client.16602 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f674c2ef740 1 -- 172.21.15.7:0/2761035412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560fe2498bb0 con 0x560fe20aa1b0 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f671effd640 1 -- 172.21.15.7:0/2761035412 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6738036040 con 0x560fe20aa1b0 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f671effd640 1 -- 172.21.15.7:0/2761035412 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f673001c3f0 con 0x560fe20aa1b0 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f674c2ef740 10 client.16602 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f674c2ef740 10 client.16602 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f674c2ef740 20 client.16602 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f674c2ef740 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560fe20919f0 0x560fe249c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f674c2ef740 4 client.16602 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:25.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.515+0000 7f674c2ef740 1 -- 172.21.15.7:0/2761035412 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fe23f2df0 con 0x560fe20919f0 2024-09-21T05:59:25.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.516+0000 7f673effd640 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560fe20919f0 0x560fe249c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.516+0000 7f673effd640 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560fe20919f0 0x560fe249c0c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a6ed907ed19f387b server_cookie=4fa357599aeb64a8 in_seq=0 out_seq=0 2024-09-21T05:59:25.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.516+0000 7f671effd640 10 client.16602 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.517+0000 7f671effd640 1 -- 172.21.15.7:0/2761035412 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560fe23f2df0 con 0x560fe20919f0 2024-09-21T05:59:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.517+0000 7f671effd640 10 client.16602 handle_command_reply: tid=0 2024-09-21T05:59:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.517+0000 7f674c2ef740 1 client.16602 shutdown 2024-09-21T05:59:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.517+0000 7f674c2ef740 1 -- 172.21.15.7:0/2761035412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 msgr2=0x560fe2485990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.517+0000 7f674c2ef740 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 0x560fe2485990 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6730003c80 tx=0x7f67300046c0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.517+0000 7f674c2ef740 1 -- 172.21.15.7:0/2761035412 shutdown_connections 2024-09-21T05:59:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.517+0000 7f674c2ef740 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560fe20919f0 0x560fe249c0c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.517+0000 7f674c2ef740 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 0x560fe2491d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.517+0000 7f674c2ef740 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20b2390 0x560fe2485ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.517+0000 7f674c2ef740 1 --2- 172.21.15.7:0/2761035412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 0x560fe2485990 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.517+0000 7f674c2ef740 1 -- 172.21.15.7:0/2761035412 >> 172.21.15.7:0/2761035412 conn(0x560fe20c7460 msgr2=0x560fe247d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.517+0000 7f671effd640 0 client.16602 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.517+0000 7f674c2ef740 1 -- 172.21.15.7:0/2761035412 shutdown_connections 2024-09-21T05:59:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.518+0000 7f674c2ef740 1 -- 172.21.15.7:0/2761035412 wait complete. 2024-09-21T05:59:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.518+0000 7f674c2ef740 20 client.16602 trim_cache size 0 max 16384 2024-09-21T05:59:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f674c2ef740 1 Processor -- start 2024-09-21T05:59:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f674c2ef740 1 -- start start 2024-09-21T05:59:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f674c2ef740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20aa1b0 0x560fe247dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f674c2ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20b2390 0x560fe2482b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f674c2ef740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 0x560fe24830c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f674c2ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67401afc70 con 0x560fe20b2390 2024-09-21T05:59:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f674c2ef740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f67401ad540 con 0x560fe20d3070 2024-09-21T05:59:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f674c2ef740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f67401ab3b0 con 0x560fe20aa1b0 2024-09-21T05:59:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f673effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20b2390 0x560fe2482b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f673effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20b2390 0x560fe2482b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48078/0 (socket says 172.21.15.7:48078) 2024-09-21T05:59:25.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f673effd640 1 -- 172.21.15.7:0/3837379453 learned_addr learned my addr 172.21.15.7:0/3837379453 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f673ffff640 1 --2- 172.21.15.7:0/3837379453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 0x560fe24830c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f673f7fe640 1 --2- 172.21.15.7:0/3837379453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20aa1b0 0x560fe247dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f673effd640 1 -- 172.21.15.7:0/3837379453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20aa1b0 msgr2=0x560fe247dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f673effd640 1 --2- 172.21.15.7:0/3837379453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20aa1b0 0x560fe247dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f673effd640 1 -- 172.21.15.7:0/3837379453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 msgr2=0x560fe24830c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f673effd640 1 --2- 172.21.15.7:0/3837379453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 0x560fe24830c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.531+0000 7f673effd640 1 -- 172.21.15.7:0/3837379453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fe247c8a0 con 0x560fe20b2390 2024-09-21T05:59:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.532+0000 7f673ffff640 1 --2- 172.21.15.7:0/3837379453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 0x560fe24830c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.532+0000 7f673effd640 1 --2- 172.21.15.7:0/3837379453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20b2390 0x560fe2482b80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f67340a9680 tx=0x7f67340ead30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443ef047ef2aad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.532+0000 7f67257fa640 1 -- 172.21.15.7:0/3837379453 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67340aca00 con 0x560fe20b2390 2024-09-21T05:59:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.532+0000 7f67257fa640 1 -- 172.21.15.7:0/3837379453 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67340acbc0 con 0x560fe20b2390 2024-09-21T05:59:25.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.532+0000 7f67257fa640 1 -- 172.21.15.7:0/3837379453 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67340ac820 con 0x560fe20b2390 2024-09-21T05:59:25.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.533+0000 7f674c2ef740 1 -- 172.21.15.7:0/3837379453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20b2390 msgr2=0x560fe2482b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:25.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.533+0000 7f674c2ef740 1 --2- 172.21.15.7:0/3837379453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20b2390 0x560fe2482b80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f67340a9680 tx=0x7f67340ead30 comp rx=0 tx=0).stop 2024-09-21T05:59:25.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.533+0000 7f674c2ef740 1 -- 172.21.15.7:0/3837379453 shutdown_connections 2024-09-21T05:59:25.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.533+0000 7f674c2ef740 1 --2- 172.21.15.7:0/3837379453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20b2390 0x560fe2482b80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.533+0000 7f674c2ef740 1 --2- 172.21.15.7:0/3837379453 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 0x560fe24830c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.533+0000 7f674c2ef740 1 --2- 172.21.15.7:0/3837379453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20aa1b0 0x560fe247dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.533+0000 7f674c2ef740 1 -- 172.21.15.7:0/3837379453 >> 172.21.15.7:0/3837379453 conn(0x560fe20c7460 msgr2=0x560fe247d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:25.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.533+0000 7f674c2ef740 1 -- 172.21.15.7:0/3837379453 shutdown_connections 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.533+0000 7f674c2ef740 1 -- 172.21.15.7:0/3837379453 wait complete. 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.533+0000 7f674c2ef740 1 -- start start 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.533+0000 7f674c2ef740 1 Processor -- start 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f674c2ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 0x560fe2489e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f674c2ef740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20b2390 0x560fe248a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f674c2ef740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 0x560fe248a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f674c2ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67401aba00 con 0x560fe20aa1b0 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f674c2ef740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f67401ace70 con 0x560fe20d3070 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f674c2ef740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f67401ac0d0 con 0x560fe20b2390 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f674c2ef740 10 client.0 _ll_register_callbacks cb 0x7f6730005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f673f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 0x560fe2489e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f673f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 0x560fe2489e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48084/0 (socket says 172.21.15.7:48084) 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f673f7fe640 1 -- 172.21.15.7:0/3654693759 learned_addr learned my addr 172.21.15.7:0/3654693759 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:25.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f673effd640 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20b2390 0x560fe248a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f673ffff640 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 0x560fe248a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f673f7fe640 1 -- 172.21.15.7:0/3654693759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20b2390 msgr2=0x560fe248a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f673f7fe640 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20b2390 0x560fe248a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f673f7fe640 1 -- 172.21.15.7:0/3654693759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 msgr2=0x560fe248a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f673f7fe640 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 0x560fe248a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f673f7fe640 1 -- 172.21.15.7:0/3654693759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fe2505bd0 con 0x560fe20aa1b0 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f673effd640 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20b2390 0x560fe248a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f673f7fe640 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 0x560fe2489e40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6730018040 tx=0x7f673001c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b52eff716c9dea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f671effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.534+0000 7f671effd640 1 -- 172.21.15.7:0/3654693759 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673001cc40 con 0x560fe20aa1b0 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.535+0000 7f671effd640 1 -- 172.21.15.7:0/3654693759 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f6730005040 con 0x560fe20aa1b0 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.535+0000 7f674c2ef740 1 -- 172.21.15.7:0/3654693759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67340acbc0 con 0x560fe20aa1b0 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.535+0000 7f671effd640 1 -- 172.21.15.7:0/3654693759 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f673002c020 con 0x560fe20aa1b0 2024-09-21T05:59:25.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.535+0000 7f674c2ef740 10 client.16608 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.535+0000 7f674c2ef740 1 -- 172.21.15.7:0/3654693759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560fe2506e50 con 0x560fe20aa1b0 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.535+0000 7f671effd640 1 -- 172.21.15.7:0/3654693759 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67340acbc0 con 0x560fe20aa1b0 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.535+0000 7f671effd640 1 -- 172.21.15.7:0/3654693759 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f67300315d0 con 0x560fe20aa1b0 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.535+0000 7f674c2ef740 10 client.16608 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.535+0000 7f674c2ef740 10 client.16608 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.535+0000 7f674c2ef740 20 client.16608 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.535+0000 7f674c2ef740 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560fe2066da0 0x560fe2509640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.535+0000 7f674c2ef740 4 client.16608 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.535+0000 7f674c2ef740 1 -- 172.21.15.7:0/3654693759 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560fe23ee8a0 con 0x560fe2066da0 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f673effd640 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560fe2066da0 0x560fe2509640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f673effd640 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560fe2066da0 0x560fe2509640 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f9096281ca61a6 server_cookie=3ebbcf243d4a51b3 in_seq=0 out_seq=0 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f671effd640 10 client.16608 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f671effd640 1 -- 172.21.15.7:0/3654693759 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560fe23ee8a0 con 0x560fe2066da0 2024-09-21T05:59:25.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f671effd640 10 client.16608 handle_command_reply: tid=0 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f674c2ef740 1 client.16608 shutdown 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f674c2ef740 1 -- 172.21.15.7:0/3654693759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 msgr2=0x560fe2489e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f674c2ef740 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 0x560fe2489e40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6730018040 tx=0x7f673001c680 comp rx=0 tx=0).stop 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f674c2ef740 1 -- 172.21.15.7:0/3654693759 shutdown_connections 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f674c2ef740 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560fe2066da0 0x560fe2509640 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f674c2ef740 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fe20d3070 0x560fe248a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f674c2ef740 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fe20b2390 0x560fe248a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f674c2ef740 1 --2- 172.21.15.7:0/3654693759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fe20aa1b0 0x560fe2489e40 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f674c2ef740 1 -- 172.21.15.7:0/3654693759 >> 172.21.15.7:0/3654693759 conn(0x560fe20c7460 msgr2=0x560fe247b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.536+0000 7f671effd640 0 client.16608 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.537+0000 7f674c2ef740 1 -- 172.21.15.7:0/3654693759 shutdown_connections 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.537+0000 7f674c2ef740 1 -- 172.21.15.7:0/3654693759 wait complete. 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.537+0000 7f674c2ef740 20 client.16608 trim_cache size 0 max 16384 2024-09-21T05:59:25.545 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:59:25.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.537+0000 7f6745d7b640 1 -- 172.21.15.7:0/33250391 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f67280b6850 msgr2=0x7f67280b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:25.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.537+0000 7f6745d7b640 1 --2- 172.21.15.7:0/33250391 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f67280b6850 0x7f67280b8d60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x560fe2478f40 tx=0x7f673000b390 comp rx=0 tx=0).stop 2024-09-21T05:59:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.537+0000 7f6745d7b640 1 -- 172.21.15.7:0/33250391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67401052f0 msgr2=0x7f674019a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.537+0000 7f6745d7b640 1 --2- 172.21.15.7:0/33250391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67401052f0 0x7f674019a9f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f673400c970 tx=0x7f673400ce30 comp rx=0 tx=0).stop 2024-09-21T05:59:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.537+0000 7f6745d7b640 1 -- 172.21.15.7:0/33250391 shutdown_connections 2024-09-21T05:59:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.537+0000 7f6745d7b640 1 --2- 172.21.15.7:0/33250391 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f67280b6850 0x7f67280b8d60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.537+0000 7f6745d7b640 1 --2- 172.21.15.7:0/33250391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67401052f0 0x7f674019a9f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.537+0000 7f6745d7b640 1 --2- 172.21.15.7:0/33250391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f674010de70 0x7f674019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.537+0000 7f6745d7b640 1 --2- 172.21.15.7:0/33250391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67401048c0 0x7f674019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.537+0000 7f6745d7b640 1 -- 172.21.15.7:0/33250391 >> 172.21.15.7:0/33250391 conn(0x7f6740079740 msgr2=0x7f6740107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.538+0000 7f6745d7b640 1 -- 172.21.15.7:0/33250391 shutdown_connections 2024-09-21T05:59:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:25.538+0000 7f6745d7b640 1 -- 172.21.15.7:0/33250391 wait complete. 2024-09-21T05:59:26.173 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:25 smithi007 ceph-mon[30983]: pgmap v484: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:59:26.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:25 smithi027 ceph-mon[34364]: pgmap v484: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:59:26.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:25 smithi119 ceph-mon[34833]: pgmap v484: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T05:59:26.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T05:59:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.107+0000 7fabad8aa640 1 -- 172.21.15.7:0/2899299767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faba8102ae0 msgr2=0x7faba8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.107+0000 7fabad8aa640 1 --2- 172.21.15.7:0/2899299767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faba8102ae0 0x7faba8102ef0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fab98009900 tx=0x7fab9802a410 comp rx=0 tx=0).stop 2024-09-21T05:59:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.107+0000 7fabad8aa640 1 -- 172.21.15.7:0/2899299767 shutdown_connections 2024-09-21T05:59:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.107+0000 7fabad8aa640 1 --2- 172.21.15.7:0/2899299767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba8108d20 0x7faba810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.107+0000 7fabad8aa640 1 --2- 172.21.15.7:0/2899299767 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faba81083d0 0x7faba81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.107+0000 7fabad8aa640 1 --2- 172.21.15.7:0/2899299767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faba8102ae0 0x7faba8102ef0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.107+0000 7fabad8aa640 1 -- 172.21.15.7:0/2899299767 >> 172.21.15.7:0/2899299767 conn(0x7faba8079760 msgr2=0x7faba8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.107+0000 7fabad8aa640 1 -- 172.21.15.7:0/2899299767 shutdown_connections 2024-09-21T05:59:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.107+0000 7fabad8aa640 1 -- 172.21.15.7:0/2899299767 wait complete. 2024-09-21T05:59:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.108+0000 7fabad8aa640 1 Processor -- start 2024-09-21T05:59:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.108+0000 7fabad8aa640 1 -- start start 2024-09-21T05:59:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fabad8aa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faba8102ae0 0x7faba810ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fabad8aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faba81083d0 0x7faba8110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fabad8aa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba8108d20 0x7faba8110a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fabad8aa640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faba8113b40 con 0x7faba81083d0 2024-09-21T05:59:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fabad8aa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faba81139c0 con 0x7faba8102ae0 2024-09-21T05:59:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fabad8aa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faba8113cc0 con 0x7faba8108d20 2024-09-21T05:59:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fab9e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faba81083d0 0x7faba8110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fab9e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faba81083d0 0x7faba8110520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48104/0 (socket says 172.21.15.7:48104) 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fab9e7fc640 1 -- 172.21.15.7:0/681189970 learned_addr learned my addr 172.21.15.7:0/681189970 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7faba6ffd640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faba8102ae0 0x7faba810ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7faba77fe640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba8108d20 0x7faba8110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fab9e7fc640 1 -- 172.21.15.7:0/681189970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba8108d20 msgr2=0x7faba8110a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba8108d20 0x7faba8110a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fab9e7fc640 1 -- 172.21.15.7:0/681189970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faba8102ae0 msgr2=0x7faba810ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faba8102ae0 0x7faba810ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fab9e7fc640 1 -- 172.21.15.7:0/681189970 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba81a87d0 con 0x7faba81083d0 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7faba77fe640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba8108d20 0x7faba8110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.109+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faba81083d0 0x7faba8110520 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fab9000c970 tx=0x7fab9000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.110+0000 7fabac8a8640 1 -- 172.21.15.7:0/681189970 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab90007bb0 con 0x7faba81083d0 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.110+0000 7fabac8a8640 1 -- 172.21.15.7:0/681189970 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab90007d50 con 0x7faba81083d0 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.110+0000 7fabad8aa640 1 -- 172.21.15.7:0/681189970 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba81a8ac0 con 0x7faba81083d0 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.110+0000 7fabac8a8640 1 -- 172.21.15.7:0/681189970 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9000f450 con 0x7faba81083d0 2024-09-21T05:59:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.110+0000 7fabad8aa640 1 -- 172.21.15.7:0/681189970 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba81a8fd0 con 0x7faba81083d0 2024-09-21T05:59:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.112+0000 7fabac8a8640 1 -- 172.21.15.7:0/681189970 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fab90004f20 con 0x7faba81083d0 2024-09-21T05:59:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.112+0000 7fabb3e1e740 1 Processor -- start 2024-09-21T05:59:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fabb3e1e740 1 -- start start 2024-09-21T05:59:27.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fabb3e1e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a901a070 0x5605a93c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fabb3e1e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff11b0 0x5605a93c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fabb3e1e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 0x5605a93c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fabb3e1e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5605a9337ea0 con 0x5605a8ff9390 2024-09-21T05:59:27.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fabb3e1e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5605a93272d0 con 0x5605a8ff11b0 2024-09-21T05:59:27.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fabb3e1e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5605a932b0e0 con 0x5605a901a070 2024-09-21T05:59:27.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fab9e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 0x5605a93c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fab9e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 0x5605a93c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48118/0 (socket says 172.21.15.7:48118) 2024-09-21T05:59:27.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fab9e7fc640 1 -- 172.21.15.7:0/3674428234 learned_addr learned my addr 172.21.15.7:0/3674428234 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:27.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7faba77fe640 1 --2- 172.21.15.7:0/3674428234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a901a070 0x5605a93c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7faba6ffd640 1 --2- 172.21.15.7:0/3674428234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff11b0 0x5605a93c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fab9e7fc640 1 -- 172.21.15.7:0/3674428234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a901a070 msgr2=0x5605a93c12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:27.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/3674428234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a901a070 0x5605a93c12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fabac8a8640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab940b6680 0x7fab940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fab9e7fc640 1 -- 172.21.15.7:0/3674428234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff11b0 msgr2=0x5605a93c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:27.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.113+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/3674428234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff11b0 0x5605a93c1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.114+0000 7fab9e7fc640 1 -- 172.21.15.7:0/3674428234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605a9085650 con 0x5605a8ff9390 2024-09-21T05:59:27.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.114+0000 7faba77fe640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab940b6680 0x7fab940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.114+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/3674428234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 0x5605a93c1d40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fab900e4e50 tx=0x7fab900ad7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3a4886cff7d5bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:27.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.114+0000 7fabac8a8640 1 -- 172.21.15.7:0/681189970 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fab900e7710 con 0x7faba81083d0 2024-09-21T05:59:27.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.114+0000 7fab9dffb640 1 -- 172.21.15.7:0/3674428234 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9001d020 con 0x5605a8ff9390 2024-09-21T05:59:27.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.114+0000 7fab9dffb640 1 -- 172.21.15.7:0/3674428234 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab900ad0f0 con 0x5605a8ff9390 2024-09-21T05:59:27.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.114+0000 7fab9dffb640 1 -- 172.21.15.7:0/3674428234 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab900acd50 con 0x5605a8ff9390 2024-09-21T05:59:27.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.115+0000 7fabb3e1e740 1 -- 172.21.15.7:0/3674428234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 msgr2=0x5605a93c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:27.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.115+0000 7faba77fe640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab940b6680 0x7fab940b8b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faba000c5c0 tx=0x7faba000e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:27.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.115+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/3674428234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 0x5605a93c1d40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fab900e4e50 tx=0x7fab900ad7d0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.115+0000 7fabb3e1e740 1 -- 172.21.15.7:0/3674428234 shutdown_connections 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.115+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/3674428234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 0x5605a93c1d40 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.115+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/3674428234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff11b0 0x5605a93c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.115+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/3674428234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a901a070 0x5605a93c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.115+0000 7fabb3e1e740 1 -- 172.21.15.7:0/3674428234 >> 172.21.15.7:0/3674428234 conn(0x5605a900e460 msgr2=0x5605a93bf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.115+0000 7fabb3e1e740 1 -- 172.21.15.7:0/3674428234 shutdown_connections 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.115+0000 7fabb3e1e740 1 -- 172.21.15.7:0/3674428234 wait complete. 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.116+0000 7fabb3e1e740 1 -- start start 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.116+0000 7fabb3e1e740 1 Processor -- start 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.116+0000 7fabb3e1e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff11b0 0x5605a93cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.116+0000 7fabb3e1e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8ff9390 0x5605a93cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.116+0000 7fabb3e1e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a901a070 0x5605a93d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.116+0000 7fabb3e1e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5605a9188700 con 0x5605a8ff11b0 2024-09-21T05:59:27.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.116+0000 7fabb3e1e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5605a92c2160 con 0x5605a901a070 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.116+0000 7fabb3e1e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5605a93cfaa0 con 0x5605a8ff9390 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.116+0000 7fabb3e1e740 10 client.0 _ll_register_callbacks cb 0x5605a92db9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.116+0000 7faba6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff11b0 0x5605a93cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.116+0000 7faba6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff11b0 0x5605a93cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48132/0 (socket says 172.21.15.7:48132) 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.116+0000 7faba6ffd640 1 -- 172.21.15.7:0/215746975 learned_addr learned my addr 172.21.15.7:0/215746975 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8ff9390 0x5605a93cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7faba77fe640 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a901a070 0x5605a93d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7faba6ffd640 1 -- 172.21.15.7:0/215746975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8ff9390 msgr2=0x5605a93cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7faba6ffd640 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8ff9390 0x5605a93cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7faba6ffd640 1 -- 172.21.15.7:0/215746975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a901a070 msgr2=0x5605a93d8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7faba6ffd640 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a901a070 0x5605a93d8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7faba6ffd640 1 -- 172.21.15.7:0/215746975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605a92efc90 con 0x5605a8ff11b0 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8ff9390 0x5605a93cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:27.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7faba77fe640 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a901a070 0x5605a93d8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7faba6ffd640 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff11b0 0x5605a93cc920 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fab98009900 tx=0x7fab980035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c2d94c178670e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7fab86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7fab86ffd640 1 -- 172.21.15.7:0/215746975 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98035040 con 0x5605a8ff11b0 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7fab86ffd640 1 -- 172.21.15.7:0/215746975 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fab98003cb0 con 0x5605a8ff11b0 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7fabb3e1e740 1 -- 172.21.15.7:0/215746975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab900ad0f0 con 0x5605a8ff11b0 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7fab86ffd640 1 -- 172.21.15.7:0/215746975 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fab98003eb0 con 0x5605a8ff11b0 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7fabb3e1e740 10 client.16620 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.117+0000 7fabb3e1e740 1 -- 172.21.15.7:0/215746975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5605a93db750 con 0x5605a8ff11b0 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.118+0000 7fab86ffd640 1 -- 172.21.15.7:0/215746975 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab900ad0f0 con 0x5605a8ff11b0 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.118+0000 7fab86ffd640 1 -- 172.21.15.7:0/215746975 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fab9804f6f0 con 0x5605a8ff11b0 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.118+0000 7fabb3e1e740 10 client.16620 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.118+0000 7fabb3e1e740 10 client.16620 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.118+0000 7fabb3e1e740 20 client.16620 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.118+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5605a8fd89f0 0x5605a93dec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.118+0000 7fabb3e1e740 4 client.16620 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:27.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.118+0000 7fabb3e1e740 1 -- 172.21.15.7:0/215746975 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605a9339df0 con 0x5605a8fd89f0 2024-09-21T05:59:27.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.118+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5605a8fd89f0 0x5605a93dec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.119+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5605a8fd89f0 0x5605a93dec10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=71cf36b9eee8bcc0 server_cookie=b845207ea39f2beb in_seq=0 out_seq=0 2024-09-21T05:59:27.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.119+0000 7fab86ffd640 10 client.16620 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:27.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.119+0000 7fab86ffd640 1 -- 172.21.15.7:0/215746975 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605a9339df0 con 0x5605a8fd89f0 2024-09-21T05:59:27.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.119+0000 7fab86ffd640 10 client.16620 handle_command_reply: tid=0 2024-09-21T05:59:27.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.120+0000 7fabb3e1e740 1 client.16620 shutdown 2024-09-21T05:59:27.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.120+0000 7fabb3e1e740 1 -- 172.21.15.7:0/215746975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff11b0 msgr2=0x5605a93cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:27.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.120+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff11b0 0x5605a93cc920 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fab98009900 tx=0x7fab980035f0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.120+0000 7fabb3e1e740 1 -- 172.21.15.7:0/215746975 shutdown_connections 2024-09-21T05:59:27.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.120+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5605a8fd89f0 0x5605a93dec10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.120+0000 7fab86ffd640 0 client.16620 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:27.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.120+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a901a070 0x5605a93d8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.120+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8ff9390 0x5605a93cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.120+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/215746975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff11b0 0x5605a93cc920 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.120+0000 7fabb3e1e740 1 -- 172.21.15.7:0/215746975 >> 172.21.15.7:0/215746975 conn(0x5605a900e460 msgr2=0x5605a93c22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:27.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.120+0000 7fabb3e1e740 1 -- 172.21.15.7:0/215746975 shutdown_connections 2024-09-21T05:59:27.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.120+0000 7fabb3e1e740 1 -- 172.21.15.7:0/215746975 wait complete. 2024-09-21T05:59:27.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.120+0000 7fabb3e1e740 20 client.16620 trim_cache size 0 max 16384 2024-09-21T05:59:27.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.133+0000 7fabb3e1e740 1 Processor -- start 2024-09-21T05:59:27.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.133+0000 7fabb3e1e740 1 -- start start 2024-09-21T05:59:27.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.133+0000 7fabb3e1e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8fd89f0 0x5605a93c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.133+0000 7fabb3e1e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff11b0 0x5605a93d8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.133+0000 7fabb3e1e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 0x5605a93c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.133+0000 7fabb3e1e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faba81b4040 con 0x5605a8ff9390 2024-09-21T05:59:27.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7fabb3e1e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faba81b1910 con 0x5605a8ff11b0 2024-09-21T05:59:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7fabb3e1e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faba81af760 con 0x5605a8fd89f0 2024-09-21T05:59:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7faba77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 0x5605a93c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7faba77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 0x5605a93c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48142/0 (socket says 172.21.15.7:48142) 2024-09-21T05:59:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7faba77fe640 1 -- 172.21.15.7:0/51210720 learned_addr learned my addr 172.21.15.7:0/51210720 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/51210720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff11b0 0x5605a93d8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7faba6ffd640 1 --2- 172.21.15.7:0/51210720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8fd89f0 0x5605a93c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7faba77fe640 1 -- 172.21.15.7:0/51210720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8fd89f0 msgr2=0x5605a93c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7faba77fe640 1 --2- 172.21.15.7:0/51210720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8fd89f0 0x5605a93c2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7faba77fe640 1 -- 172.21.15.7:0/51210720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff11b0 msgr2=0x5605a93d8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:27.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7faba77fe640 1 --2- 172.21.15.7:0/51210720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff11b0 0x5605a93d8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7faba77fe640 1 -- 172.21.15.7:0/51210720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605a93b9460 con 0x5605a8ff9390 2024-09-21T05:59:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7faba77fe640 1 --2- 172.21.15.7:0/51210720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 0x5605a93c9b10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7faba0018920 tx=0x7faba0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2b9fda816cda7c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7fab9d7fa640 1 -- 172.21.15.7:0/51210720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0029070 con 0x5605a8ff9390 2024-09-21T05:59:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7fab9d7fa640 1 -- 172.21.15.7:0/51210720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faba0007d60 con 0x5605a8ff9390 2024-09-21T05:59:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.134+0000 7fab9d7fa640 1 -- 172.21.15.7:0/51210720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0022680 con 0x5605a8ff9390 2024-09-21T05:59:27.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.135+0000 7fabb3e1e740 1 -- 172.21.15.7:0/51210720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 msgr2=0x5605a93c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.135+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/51210720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 0x5605a93c9b10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7faba0018920 tx=0x7faba0014000 comp rx=0 tx=0).stop 2024-09-21T05:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.135+0000 7fabb3e1e740 1 -- 172.21.15.7:0/51210720 shutdown_connections 2024-09-21T05:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.135+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/51210720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8ff9390 0x5605a93c9b10 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.135+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/51210720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff11b0 0x5605a93d8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.135+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/51210720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8fd89f0 0x5605a93c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.135+0000 7fabb3e1e740 1 -- 172.21.15.7:0/51210720 >> 172.21.15.7:0/51210720 conn(0x5605a900e460 msgr2=0x5605a93c22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.135+0000 7fabb3e1e740 1 -- 172.21.15.7:0/51210720 shutdown_connections 2024-09-21T05:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.135+0000 7fabb3e1e740 1 -- 172.21.15.7:0/51210720 wait complete. 2024-09-21T05:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.136+0000 7fabb3e1e740 1 -- start start 2024-09-21T05:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.136+0000 7fabb3e1e740 1 Processor -- start 2024-09-21T05:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.136+0000 7fabb3e1e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8fd89f0 0x5605a93d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.136+0000 7fabb3e1e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8ff11b0 0x5605a93d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.136+0000 7fabb3e1e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff9390 0x5605a94485d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.136+0000 7fabb3e1e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faba81afdd0 con 0x5605a8fd89f0 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.136+0000 7fabb3e1e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faba81b1240 con 0x5605a8ff9390 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.136+0000 7fabb3e1e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faba81b04a0 con 0x5605a8ff11b0 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.136+0000 7fabb3e1e740 10 client.0 _ll_register_callbacks cb 0x7fab980040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.136+0000 7faba6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8fd89f0 0x5605a93d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.136+0000 7faba6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8fd89f0 0x5605a93d0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48156/0 (socket says 172.21.15.7:48156) 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.136+0000 7faba6ffd640 1 -- 172.21.15.7:0/1685756922 learned_addr learned my addr 172.21.15.7:0/1685756922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7faba77fe640 1 --2- 172.21.15.7:0/1685756922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff9390 0x5605a94485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/1685756922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8ff11b0 0x5605a93d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7faba6ffd640 1 -- 172.21.15.7:0/1685756922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8ff11b0 msgr2=0x5605a93d14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7faba6ffd640 1 --2- 172.21.15.7:0/1685756922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8ff11b0 0x5605a93d14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7faba6ffd640 1 -- 172.21.15.7:0/1685756922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff9390 msgr2=0x5605a94485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7faba6ffd640 1 --2- 172.21.15.7:0/1685756922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff9390 0x5605a94485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7faba6ffd640 1 -- 172.21.15.7:0/1685756922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605a93d1d60 con 0x5605a8fd89f0 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7faba6ffd640 1 --2- 172.21.15.7:0/1685756922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8fd89f0 0x5605a93d0f80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fab98005ab0 tx=0x7fab98005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86a57d859b44a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7fab86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7fab86ffd640 1 -- 172.21.15.7:0/1685756922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98003ec0 con 0x5605a8fd89f0 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7fab86ffd640 1 -- 172.21.15.7:0/1685756922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fab9804f450 con 0x5605a8fd89f0 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7fabb3e1e740 1 -- 172.21.15.7:0/1685756922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faba0007d60 con 0x5605a8fd89f0 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7fab86ffd640 1 -- 172.21.15.7:0/1685756922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fab98060050 con 0x5605a8fd89f0 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7fabb3e1e740 10 client.16626 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.137+0000 7fabb3e1e740 1 -- 172.21.15.7:0/1685756922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5605a9449b30 con 0x5605a8fd89f0 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.138+0000 7fab86ffd640 1 -- 172.21.15.7:0/1685756922 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faba0007d60 con 0x5605a8fd89f0 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.138+0000 7fab86ffd640 1 -- 172.21.15.7:0/1685756922 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fab9804fce0 con 0x5605a8fd89f0 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.138+0000 7fabb3e1e740 10 client.16626 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.138+0000 7fabb3e1e740 10 client.16626 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.138+0000 7fabb3e1e740 20 client.16626 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.138+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/1685756922 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5605a901a070 0x5605a944c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.138+0000 7fabb3e1e740 4 client.16626 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.138+0000 7fabb3e1e740 1 -- 172.21.15.7:0/1685756922 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5605a93358a0 con 0x5605a901a070 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.138+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/1685756922 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5605a901a070 0x5605a944c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fab9e7fc640 1 --2- 172.21.15.7:0/1685756922 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5605a901a070 0x5605a944c2c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2d0e2e0d47e20c6 server_cookie=4d51d715bab9829f in_seq=0 out_seq=0 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fab86ffd640 10 client.16626 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fab86ffd640 1 -- 172.21.15.7:0/1685756922 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5605a93358a0 con 0x5605a901a070 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fab86ffd640 10 client.16626 handle_command_reply: tid=0 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fabb3e1e740 1 client.16626 shutdown 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fabb3e1e740 1 -- 172.21.15.7:0/1685756922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8fd89f0 msgr2=0x5605a93d0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/1685756922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8fd89f0 0x5605a93d0f80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fab98005ab0 tx=0x7fab98005df0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fabb3e1e740 1 -- 172.21.15.7:0/1685756922 shutdown_connections 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/1685756922 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5605a901a070 0x5605a944c2c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fab86ffd640 0 client.16626 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/1685756922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605a8ff9390 0x5605a94485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/1685756922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605a8ff11b0 0x5605a93d14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fabb3e1e740 1 --2- 172.21.15.7:0/1685756922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605a8fd89f0 0x5605a93d0f80 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fabb3e1e740 1 -- 172.21.15.7:0/1685756922 >> 172.21.15.7:0/1685756922 conn(0x5605a900e460 msgr2=0x5605a93cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fabb3e1e740 1 -- 172.21.15.7:0/1685756922 shutdown_connections 2024-09-21T05:59:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fabb3e1e740 1 -- 172.21.15.7:0/1685756922 wait complete. 2024-09-21T05:59:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.139+0000 7fabb3e1e740 20 client.16626 trim_cache size 0 max 16384 2024-09-21T05:59:27.147 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:59:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.140+0000 7fabad8aa640 1 -- 172.21.15.7:0/681189970 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab940b6680 msgr2=0x7fab940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.140+0000 7fabad8aa640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab940b6680 0x7fab940b8b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faba000c5c0 tx=0x7faba000e040 comp rx=0 tx=0).stop 2024-09-21T05:59:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.140+0000 7fabad8aa640 1 -- 172.21.15.7:0/681189970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faba81083d0 msgr2=0x7faba8110520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.140+0000 7fabad8aa640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faba81083d0 0x7faba8110520 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fab9000c970 tx=0x7fab9000ce30 comp rx=0 tx=0).stop 2024-09-21T05:59:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.140+0000 7fabad8aa640 1 -- 172.21.15.7:0/681189970 shutdown_connections 2024-09-21T05:59:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.140+0000 7fabad8aa640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fab940b6680 0x7fab940b8b90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.140+0000 7fabad8aa640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faba81083d0 0x7faba8110520 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.140+0000 7fabad8aa640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba8108d20 0x7faba8110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.140+0000 7fabad8aa640 1 --2- 172.21.15.7:0/681189970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faba8102ae0 0x7faba810ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:27.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.140+0000 7fabad8aa640 1 -- 172.21.15.7:0/681189970 >> 172.21.15.7:0/681189970 conn(0x7faba8079760 msgr2=0x7faba81014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:27.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.140+0000 7fabad8aa640 1 -- 172.21.15.7:0/681189970 shutdown_connections 2024-09-21T05:59:27.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:27.140+0000 7fabad8aa640 1 -- 172.21.15.7:0/681189970 wait complete. 2024-09-21T05:59:27.861 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T05:59:28.122 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:28.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:27 smithi027 ceph-mon[34364]: pgmap v485: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:59:28.239 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:27 smithi007 ceph-mon[30983]: pgmap v485: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:59:28.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:27 smithi119 ceph-mon[34833]: pgmap v485: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T05:59:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.552+0000 7f5562385640 1 -- 172.21.15.7:0/3584354628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c1052d0 msgr2=0x7f555c10d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.552+0000 7f5562385640 1 --2- 172.21.15.7:0/3584354628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c1052d0 0x7f555c10d910 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5550009900 tx=0x7f555002a410 comp rx=0 tx=0).stop 2024-09-21T05:59:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.552+0000 7f5562385640 1 -- 172.21.15.7:0/3584354628 shutdown_connections 2024-09-21T05:59:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.552+0000 7f5562385640 1 --2- 172.21.15.7:0/3584354628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c1052d0 0x7f555c10d910 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.552+0000 7f5562385640 1 --2- 172.21.15.7:0/3584354628 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f555c10de50 0x7f555c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.552+0000 7f5562385640 1 --2- 172.21.15.7:0/3584354628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f555c1048a0 0x7f555c104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.552+0000 7f5562385640 1 -- 172.21.15.7:0/3584354628 >> 172.21.15.7:0/3584354628 conn(0x7f555c079740 msgr2=0x7f555c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.552+0000 7f5562385640 1 -- 172.21.15.7:0/3584354628 shutdown_connections 2024-09-21T05:59:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.552+0000 7f5562385640 1 -- 172.21.15.7:0/3584354628 wait complete. 2024-09-21T05:59:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.553+0000 7f5562385640 1 Processor -- start 2024-09-21T05:59:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.553+0000 7f5562385640 1 -- start start 2024-09-21T05:59:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.553+0000 7f5562385640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c1048a0 0x7f555c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.553+0000 7f5562385640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f555c1052d0 0x7f555c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.553+0000 7f5562385640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f555c10de50 0x7f555c19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.553+0000 7f5562385640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f555c113a90 con 0x7f555c1048a0 2024-09-21T05:59:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.553+0000 7f5562385640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f555c113910 con 0x7f555c10de50 2024-09-21T05:59:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.553+0000 7f5562385640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f555c113c10 con 0x7f555c1052d0 2024-09-21T05:59:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.553+0000 7f555bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c1048a0 0x7f555c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.553+0000 7f555bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c1048a0 0x7f555c19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43620/0 (socket says 172.21.15.7:43620) 2024-09-21T05:59:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.553+0000 7f555bfff640 1 -- 172.21.15.7:0/610706770 learned_addr learned my addr 172.21.15.7:0/610706770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.553+0000 7f5560922640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f555c10de50 0x7f555c19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.554+0000 7f555b7fe640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f555c1052d0 0x7f555c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.554+0000 7f555bfff640 1 -- 172.21.15.7:0/610706770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f555c1052d0 msgr2=0x7f555c19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.554+0000 7f555bfff640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f555c1052d0 0x7f555c19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.554+0000 7f555bfff640 1 -- 172.21.15.7:0/610706770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f555c10de50 msgr2=0x7f555c19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.554+0000 7f555bfff640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f555c10de50 0x7f555c19fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.554+0000 7f555bfff640 1 -- 172.21.15.7:0/610706770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555c1a03b0 con 0x7f555c1048a0 2024-09-21T05:59:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.554+0000 7f5560922640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f555c10de50 0x7f555c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.554+0000 7f555bfff640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c1048a0 0x7f555c19a440 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f554c00c970 tx=0x7f554c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.554+0000 7f55597fa640 1 -- 172.21.15.7:0/610706770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c004220 con 0x7f555c1048a0 2024-09-21T05:59:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.554+0000 7f5562385640 1 -- 172.21.15.7:0/610706770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555c1a06a0 con 0x7f555c1048a0 2024-09-21T05:59:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.554+0000 7f55597fa640 1 -- 172.21.15.7:0/610706770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f554c0043c0 con 0x7f555c1048a0 2024-09-21T05:59:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.554+0000 7f55597fa640 1 -- 172.21.15.7:0/610706770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c00f450 con 0x7f555c1048a0 2024-09-21T05:59:28.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.554+0000 7f5562385640 1 -- 172.21.15.7:0/610706770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555c1a6e00 con 0x7f555c1048a0 2024-09-21T05:59:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.557+0000 7f55688f9740 1 Processor -- start 2024-09-21T05:59:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.557+0000 7f55688f9740 1 -- start start 2024-09-21T05:59:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.557+0000 7f55597fa640 1 -- 172.21.15.7:0/610706770 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f554c003610 con 0x7f555c1048a0 2024-09-21T05:59:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.557+0000 7f55688f9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40de1070 0x555b411886a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.557+0000 7f55688f9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40db81b0 0x555b41188be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.557+0000 7f55688f9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 0x555b41189120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.557+0000 7f55688f9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555b410feea0 con 0x555b40dc0390 2024-09-21T05:59:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.557+0000 7f55688f9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555b410ee2d0 con 0x555b40db81b0 2024-09-21T05:59:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.557+0000 7f55688f9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555b410f20e0 con 0x555b40de1070 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.557+0000 7f555b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 0x555b41189120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f5560922640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40de1070 0x555b411886a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f555b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 0x555b41189120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43630/0 (socket says 172.21.15.7:43630) 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f555b7fe640 1 -- 172.21.15.7:0/121077400 learned_addr learned my addr 172.21.15.7:0/121077400 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f555bfff640 1 --2- 172.21.15.7:0/121077400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40db81b0 0x555b41188be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f555b7fe640 1 -- 172.21.15.7:0/121077400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40de1070 msgr2=0x555b411886a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f555b7fe640 1 --2- 172.21.15.7:0/121077400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40de1070 0x555b411886a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f555b7fe640 1 -- 172.21.15.7:0/121077400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40db81b0 msgr2=0x555b41188be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f555b7fe640 1 --2- 172.21.15.7:0/121077400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40db81b0 0x555b41188be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f555b7fe640 1 -- 172.21.15.7:0/121077400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b40e4c650 con 0x555b40dc0390 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f555b7fe640 1 --2- 172.21.15.7:0/121077400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 0x555b41189120 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5550009900 tx=0x7f5550032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e17ac32301951c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f55427fc640 1 -- 172.21.15.7:0/121077400 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550035030 con 0x555b40dc0390 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f55427fc640 1 -- 172.21.15.7:0/121077400 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55500316a0 con 0x555b40dc0390 2024-09-21T05:59:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f55427fc640 1 -- 172.21.15.7:0/121077400 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55500046c0 con 0x555b40dc0390 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.558+0000 7f55597fa640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f55440b6680 0x7f55440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.559+0000 7f5560922640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f55440b6680 0x7f55440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.559+0000 7f55597fa640 1 -- 172.21.15.7:0/610706770 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f554c0e7510 con 0x7f555c1048a0 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.559+0000 7f55688f9740 1 -- 172.21.15.7:0/121077400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 msgr2=0x555b41189120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.559+0000 7f5560922640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f55440b6680 0x7f55440b8b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5554005fd0 tx=0x7f5554009800 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.559+0000 7f55688f9740 1 --2- 172.21.15.7:0/121077400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 0x555b41189120 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5550009900 tx=0x7f5550032ce0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.560+0000 7f55688f9740 1 -- 172.21.15.7:0/121077400 shutdown_connections 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.560+0000 7f55688f9740 1 --2- 172.21.15.7:0/121077400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 0x555b41189120 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.560+0000 7f55688f9740 1 --2- 172.21.15.7:0/121077400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40db81b0 0x555b41188be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.560+0000 7f55688f9740 1 --2- 172.21.15.7:0/121077400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40de1070 0x555b411886a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.560+0000 7f55688f9740 1 -- 172.21.15.7:0/121077400 >> 172.21.15.7:0/121077400 conn(0x555b40dd5460 msgr2=0x555b41186590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.560+0000 7f55688f9740 1 -- 172.21.15.7:0/121077400 shutdown_connections 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.560+0000 7f55688f9740 1 -- 172.21.15.7:0/121077400 wait complete. 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.560+0000 7f55688f9740 1 -- start start 2024-09-21T05:59:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.560+0000 7f55688f9740 1 Processor -- start 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f55688f9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40db81b0 0x555b411980e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f55688f9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40dc0390 0x555b41198620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f55688f9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40de1070 0x555b41198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f55688f9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555b40f4f700 con 0x555b40db81b0 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f55688f9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555b41089160 con 0x555b40de1070 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f55688f9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555b4119b150 con 0x555b40dc0390 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f55688f9740 10 client.0 _ll_register_callbacks cb 0x555b410a29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f555bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40db81b0 0x555b411980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f555bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40db81b0 0x555b411980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43644/0 (socket says 172.21.15.7:43644) 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f555bfff640 1 -- 172.21.15.7:0/556332282 learned_addr learned my addr 172.21.15.7:0/556332282 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f555b7fe640 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40dc0390 0x555b41198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f5560922640 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40de1070 0x555b41198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f555bfff640 1 -- 172.21.15.7:0/556332282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40dc0390 msgr2=0x555b41198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f555bfff640 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40dc0390 0x555b41198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f555bfff640 1 -- 172.21.15.7:0/556332282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40de1070 msgr2=0x555b41198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f555bfff640 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40de1070 0x555b41198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f555bfff640 1 -- 172.21.15.7:0/556332282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b410b6c90 con 0x555b40db81b0 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f5560922640 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40de1070 0x555b41198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f555bfff640 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40db81b0 0x555b411980e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f554c00c940 tx=0x7f554c0aca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e95242648c24a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f553b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f553b7fe640 1 -- 172.21.15.7:0/556332282 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c01d040 con 0x555b40db81b0 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.561+0000 7f553b7fe640 1 -- 172.21.15.7:0/556332282 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f554c0e70d0 con 0x555b40db81b0 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.562+0000 7f55688f9740 1 -- 172.21.15.7:0/556332282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55500316a0 con 0x555b40db81b0 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.562+0000 7f553b7fe640 1 -- 172.21.15.7:0/556332282 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f554c0a9a30 con 0x555b40db81b0 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.562+0000 7f55688f9740 10 client.16638 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.562+0000 7f55688f9740 1 -- 172.21.15.7:0/556332282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555b411a6e30 con 0x555b40db81b0 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.562+0000 7f553b7fe640 1 -- 172.21.15.7:0/556332282 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55500316a0 con 0x555b40db81b0 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.562+0000 7f553b7fe640 1 -- 172.21.15.7:0/556332282 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f554c0e9b00 con 0x555b40db81b0 2024-09-21T05:59:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.562+0000 7f55688f9740 10 client.16638 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.562+0000 7f55688f9740 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.562+0000 7f55688f9740 20 client.16638 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.562+0000 7f55688f9740 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555b40d9f9f0 0x555b411aa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.562+0000 7f55688f9740 4 client.16638 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.562+0000 7f55688f9740 1 -- 172.21.15.7:0/556332282 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b41100df0 con 0x555b40d9f9f0 2024-09-21T05:59:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.562+0000 7f555b7fe640 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555b40d9f9f0 0x555b411aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.563+0000 7f553b7fe640 10 client.16638 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.563+0000 7f555b7fe640 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555b40d9f9f0 0x555b411aa390 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12e5fcbea6d0df9a server_cookie=996a840eda60423f in_seq=0 out_seq=0 2024-09-21T05:59:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f553b7fe640 1 -- 172.21.15.7:0/556332282 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b41100df0 con 0x555b40d9f9f0 2024-09-21T05:59:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f553b7fe640 10 client.16638 handle_command_reply: tid=0 2024-09-21T05:59:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f55688f9740 1 client.16638 shutdown 2024-09-21T05:59:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f55688f9740 1 -- 172.21.15.7:0/556332282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40db81b0 msgr2=0x555b411980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f55688f9740 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40db81b0 0x555b411980e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f554c00c940 tx=0x7f554c0aca10 comp rx=0 tx=0).stop 2024-09-21T05:59:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f55688f9740 1 -- 172.21.15.7:0/556332282 shutdown_connections 2024-09-21T05:59:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f55688f9740 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555b40d9f9f0 0x555b411aa390 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f55688f9740 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40de1070 0x555b41198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f55688f9740 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40dc0390 0x555b41198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f55688f9740 1 --2- 172.21.15.7:0/556332282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40db81b0 0x555b411980e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f553b7fe640 0 client.16638 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:28.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f55688f9740 1 -- 172.21.15.7:0/556332282 >> 172.21.15.7:0/556332282 conn(0x555b40dd5460 msgr2=0x555b4118b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:28.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f55688f9740 1 -- 172.21.15.7:0/556332282 shutdown_connections 2024-09-21T05:59:28.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f55688f9740 1 -- 172.21.15.7:0/556332282 wait complete. 2024-09-21T05:59:28.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.564+0000 7f55688f9740 20 client.16638 trim_cache size 0 max 16384 2024-09-21T05:59:28.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.577+0000 7f55688f9740 1 Processor -- start 2024-09-21T05:59:28.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.577+0000 7f55688f9740 1 -- start start 2024-09-21T05:59:28.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f55688f9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40db81b0 0x555b41199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f55688f9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 0x555b41189de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f55688f9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40de1070 0x555b41185bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f55688f9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f555c1afb70 con 0x555b40dc0390 2024-09-21T05:59:28.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f55688f9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f555c1ad440 con 0x555b40de1070 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f55688f9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f555c1ab290 con 0x555b40db81b0 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f555b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 0x555b41189de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f555b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 0x555b41189de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43654/0 (socket says 172.21.15.7:43654) 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f555b7fe640 1 -- 172.21.15.7:0/4125943408 learned_addr learned my addr 172.21.15.7:0/4125943408 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f555bfff640 1 --2- 172.21.15.7:0/4125943408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40db81b0 0x555b41199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f5560922640 1 --2- 172.21.15.7:0/4125943408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40de1070 0x555b41185bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f555b7fe640 1 -- 172.21.15.7:0/4125943408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40db81b0 msgr2=0x555b41199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f555b7fe640 1 --2- 172.21.15.7:0/4125943408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40db81b0 0x555b41199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f555b7fe640 1 -- 172.21.15.7:0/4125943408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40de1070 msgr2=0x555b41185bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f555b7fe640 1 --2- 172.21.15.7:0/4125943408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40de1070 0x555b41185bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f555b7fe640 1 -- 172.21.15.7:0/4125943408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b411819c0 con 0x555b40dc0390 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f5560922640 1 --2- 172.21.15.7:0/4125943408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40de1070 0x555b41185bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f555b7fe640 1 --2- 172.21.15.7:0/4125943408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 0x555b41189de0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5550033000 tx=0x7f5550009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1856d8f97a5e3db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:28.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.578+0000 7f5541ffb640 1 -- 172.21.15.7:0/4125943408 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550035040 con 0x555b40dc0390 2024-09-21T05:59:28.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.579+0000 7f5541ffb640 1 -- 172.21.15.7:0/4125943408 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5550031e00 con 0x555b40dc0390 2024-09-21T05:59:28.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.579+0000 7f5541ffb640 1 -- 172.21.15.7:0/4125943408 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550005450 con 0x555b40dc0390 2024-09-21T05:59:28.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.579+0000 7f55688f9740 1 -- 172.21.15.7:0/4125943408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 msgr2=0x555b41189de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:28.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.579+0000 7f55688f9740 1 --2- 172.21.15.7:0/4125943408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 0x555b41189de0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5550033000 tx=0x7f5550009640 comp rx=0 tx=0).stop 2024-09-21T05:59:28.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.579+0000 7f55688f9740 1 -- 172.21.15.7:0/4125943408 shutdown_connections 2024-09-21T05:59:28.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.579+0000 7f55688f9740 1 --2- 172.21.15.7:0/4125943408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40dc0390 0x555b41189de0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.579+0000 7f55688f9740 1 --2- 172.21.15.7:0/4125943408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40de1070 0x555b41185bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.579+0000 7f55688f9740 1 --2- 172.21.15.7:0/4125943408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40db81b0 0x555b41199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.579+0000 7f55688f9740 1 -- 172.21.15.7:0/4125943408 >> 172.21.15.7:0/4125943408 conn(0x555b40dd5460 msgr2=0x555b411896d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.579+0000 7f55688f9740 1 -- 172.21.15.7:0/4125943408 shutdown_connections 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.579+0000 7f55688f9740 1 -- 172.21.15.7:0/4125943408 wait complete. 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.580+0000 7f55688f9740 1 -- start start 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.580+0000 7f55688f9740 1 Processor -- start 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.580+0000 7f55688f9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40db81b0 0x555b411a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.580+0000 7f55688f9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40dc0390 0x555b4119c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.580+0000 7f55688f9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40de1070 0x555b4119c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.580+0000 7f55688f9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f555c1ab900 con 0x555b40de1070 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.580+0000 7f55688f9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f555c1acd70 con 0x555b40db81b0 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.580+0000 7f55688f9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f555c1abfd0 con 0x555b40dc0390 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.580+0000 7f55688f9740 10 client.0 _ll_register_callbacks cb 0x7f554c0ead50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.580+0000 7f555b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40dc0390 0x555b4119c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.581+0000 7f555b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40dc0390 0x555b4119c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:49338/0 (socket says 172.21.15.7:49338) 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.581+0000 7f555b7fe640 1 -- 172.21.15.7:0/2443604777 learned_addr learned my addr 172.21.15.7:0/2443604777 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.581+0000 7f5560922640 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40de1070 0x555b4119c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.581+0000 7f555bfff640 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40db81b0 0x555b411a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.581+0000 7f555b7fe640 1 -- 172.21.15.7:0/2443604777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40db81b0 msgr2=0x555b411a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.581+0000 7f555b7fe640 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40db81b0 0x555b411a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.581+0000 7f555b7fe640 1 -- 172.21.15.7:0/2443604777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40de1070 msgr2=0x555b4119c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.581+0000 7f555b7fe640 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40de1070 0x555b4119c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.581+0000 7f555b7fe640 1 -- 172.21.15.7:0/2443604777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b41213d50 con 0x555b40dc0390 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.581+0000 7f5560922640 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40de1070 0x555b4119c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.581+0000 7f555b7fe640 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40dc0390 0x555b4119c200 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5550005df0 tx=0x7f5550032dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61ee9d6fe98b3d6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.581+0000 7f553b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.581+0000 7f553b7fe640 1 -- 172.21.15.7:0/2443604777 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555005a070 con 0x555b40dc0390 2024-09-21T05:59:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.582+0000 7f55688f9740 1 -- 172.21.15.7:0/2443604777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5550031e00 con 0x555b40dc0390 2024-09-21T05:59:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.582+0000 7f553b7fe640 1 -- 172.21.15.7:0/2443604777 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f55500051d0 con 0x555b40dc0390 2024-09-21T05:59:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.582+0000 7f553b7fe640 1 -- 172.21.15.7:0/2443604777 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5550066050 con 0x555b40dc0390 2024-09-21T05:59:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.582+0000 7f55688f9740 10 client.26152 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.582+0000 7f55688f9740 1 -- 172.21.15.7:0/2443604777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555b41214d90 con 0x555b40dc0390 2024-09-21T05:59:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.582+0000 7f553b7fe640 1 -- 172.21.15.7:0/2443604777 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5550031e00 con 0x555b40dc0390 2024-09-21T05:59:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.582+0000 7f553b7fe640 1 -- 172.21.15.7:0/2443604777 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5550003820 con 0x555b40dc0390 2024-09-21T05:59:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.582+0000 7f55688f9740 10 client.26152 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.582+0000 7f55688f9740 10 client.26152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.582+0000 7f55688f9740 20 client.26152 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.582+0000 7f55688f9740 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555b40d74da0 0x555b41216f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.582+0000 7f55688f9740 4 client.26152 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:59:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.582+0000 7f55688f9740 1 -- 172.21.15.7:0/2443604777 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555b410fc8a0 con 0x555b40d74da0 2024-09-21T05:59:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f555bfff640 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555b40d74da0 0x555b41216f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:28.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f555bfff640 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555b40d74da0 0x555b41216f70 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9862630e6557c5e server_cookie=e92bea29df88ef74 in_seq=0 out_seq=0 2024-09-21T05:59:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f553b7fe640 10 client.26152 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f553b7fe640 1 -- 172.21.15.7:0/2443604777 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555b410fc8a0 con 0x555b40d74da0 2024-09-21T05:59:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f553b7fe640 10 client.26152 handle_command_reply: tid=0 2024-09-21T05:59:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f55688f9740 1 client.26152 shutdown 2024-09-21T05:59:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f55688f9740 1 -- 172.21.15.7:0/2443604777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40dc0390 msgr2=0x555b4119c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f55688f9740 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40dc0390 0x555b4119c200 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5550005df0 tx=0x7f5550032dd0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f55688f9740 1 -- 172.21.15.7:0/2443604777 shutdown_connections 2024-09-21T05:59:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f55688f9740 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555b40d74da0 0x555b41216f70 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f55688f9740 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b40de1070 0x555b4119c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f55688f9740 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555b40dc0390 0x555b4119c200 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f55688f9740 1 --2- 172.21.15.7:0/2443604777 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555b40db81b0 0x555b411a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f553b7fe640 0 client.26152 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.583+0000 7f55688f9740 1 -- 172.21.15.7:0/2443604777 >> 172.21.15.7:0/2443604777 conn(0x555b40dd5460 msgr2=0x555b4118bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f55688f9740 1 -- 172.21.15.7:0/2443604777 shutdown_connections 2024-09-21T05:59:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f55688f9740 1 -- 172.21.15.7:0/2443604777 wait complete. 2024-09-21T05:59:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f55688f9740 20 client.26152 trim_cache size 0 max 16384 2024-09-21T05:59:28.591 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:59:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f5562385640 1 -- 172.21.15.7:0/610706770 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f55440b6680 msgr2=0x7f55440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f5562385640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f55440b6680 0x7f55440b8b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5554005fd0 tx=0x7f5554009800 comp rx=0 tx=0).stop 2024-09-21T05:59:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f5562385640 1 -- 172.21.15.7:0/610706770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c1048a0 msgr2=0x7f555c19a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f5562385640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c1048a0 0x7f555c19a440 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f554c00c970 tx=0x7f554c00ce30 comp rx=0 tx=0).stop 2024-09-21T05:59:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f5562385640 1 -- 172.21.15.7:0/610706770 shutdown_connections 2024-09-21T05:59:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f5562385640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f55440b6680 0x7f55440b8b90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f5562385640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f555c10de50 0x7f555c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f5562385640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f555c1052d0 0x7f555c19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f5562385640 1 --2- 172.21.15.7:0/610706770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f555c1048a0 0x7f555c19a440 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f5562385640 1 -- 172.21.15.7:0/610706770 >> 172.21.15.7:0/610706770 conn(0x7f555c079740 msgr2=0x7f555c100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f5562385640 1 -- 172.21.15.7:0/610706770 shutdown_connections 2024-09-21T05:59:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:28.584+0000 7f5562385640 1 -- 172.21.15.7:0/610706770 wait complete. 2024-09-21T05:59:30.211 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T05:59:30.211 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T05:59:30.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:29 smithi027 ceph-mon[34364]: pgmap v486: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:59:30.240 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:29 smithi007 ceph-mon[30983]: pgmap v486: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:59:30.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:29 smithi119 ceph-mon[34833]: pgmap v486: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T05:59:30.484 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.954+0000 7ff5e3bac640 1 -- 172.21.15.7:0/2287607958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc1083d0 msgr2=0x7ff5dc1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.954+0000 7ff5e3bac640 1 --2- 172.21.15.7:0/2287607958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc1083d0 0x7ff5dc1087e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009900 tx=0x7ff5cc02a410 comp rx=0 tx=0).stop 2024-09-21T05:59:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.954+0000 7ff5e3bac640 1 -- 172.21.15.7:0/2287607958 shutdown_connections 2024-09-21T05:59:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.954+0000 7ff5e3bac640 1 --2- 172.21.15.7:0/2287607958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc1083d0 0x7ff5dc1087e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.954+0000 7ff5e3bac640 1 --2- 172.21.15.7:0/2287607958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5dc108d20 0x7ff5dc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.954+0000 7ff5e3bac640 1 --2- 172.21.15.7:0/2287607958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5dc102ae0 0x7ff5dc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.954+0000 7ff5e3bac640 1 -- 172.21.15.7:0/2287607958 >> 172.21.15.7:0/2287607958 conn(0x7ff5dc079760 msgr2=0x7ff5dc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.954+0000 7ff5e3bac640 1 -- 172.21.15.7:0/2287607958 shutdown_connections 2024-09-21T05:59:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.955+0000 7ff5e3bac640 1 -- 172.21.15.7:0/2287607958 wait complete. 2024-09-21T05:59:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.955+0000 7ff5e3bac640 1 Processor -- start 2024-09-21T05:59:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.955+0000 7ff5e3bac640 1 -- start start 2024-09-21T05:59:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e3bac640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5dc102ae0 0x7ff5dc19b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e3bac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc1083d0 0x7ff5dc19b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e3bac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5dc108d20 0x7ff5dc19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e3bac640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc112990 con 0x7ff5dc1083d0 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e3bac640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc112810 con 0x7ff5dc102ae0 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e3bac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc112b10 con 0x7ff5dc108d20 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e1147640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc1083d0 0x7ff5dc19b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e1147640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc1083d0 0x7ff5dc19b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43678/0 (socket says 172.21.15.7:43678) 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e1147640 1 -- 172.21.15.7:0/3493698437 learned_addr learned my addr 172.21.15.7:0/3493698437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e2149640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5dc108d20 0x7ff5dc19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e1948640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5dc102ae0 0x7ff5dc19b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e1147640 1 -- 172.21.15.7:0/3493698437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5dc108d20 msgr2=0x7ff5dc19bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e1147640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5dc108d20 0x7ff5dc19bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e1147640 1 -- 172.21.15.7:0/3493698437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5dc102ae0 msgr2=0x7ff5dc19b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:30.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e1147640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5dc102ae0 0x7ff5dc19b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e1147640 1 -- 172.21.15.7:0/3493698437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc1a64d0 con 0x7ff5dc1083d0 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e1948640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5dc102ae0 0x7ff5dc19b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e2149640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5dc108d20 0x7ff5dc19bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5e1147640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc1083d0 0x7ff5dc19b7e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc032fd0 tx=0x7ff5cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.956+0000 7ff5d2ffd640 1 -- 172.21.15.7:0/3493698437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc03f030 con 0x7ff5dc1083d0 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.957+0000 7ff5e3bac640 1 -- 172.21.15.7:0/3493698437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5dc1a6760 con 0x7ff5dc1083d0 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.957+0000 7ff5d2ffd640 1 -- 172.21.15.7:0/3493698437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5cc004490 con 0x7ff5dc1083d0 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.957+0000 7ff5d2ffd640 1 -- 172.21.15.7:0/3493698437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc035070 con 0x7ff5dc1083d0 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.957+0000 7ff5e3bac640 1 -- 172.21.15.7:0/3493698437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5dc1a6c40 con 0x7ff5dc1083d0 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.959+0000 7ff5ea120740 1 Processor -- start 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5ea120740 1 -- start start 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5ea120740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 0x563ff38a4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5ea120740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38a4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5ea120740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34dc670 0x563ff38a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5ea120740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563ff381ae60 con 0x563ff34fd350 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5ea120740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x563ff380a290 con 0x563ff34d4490 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5ea120740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563ff380e0a0 con 0x563ff34dc670 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5e2149640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 0x563ff38a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5e2149640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 0x563ff38a4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43682/0 (socket says 172.21.15.7:43682) 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5e2149640 1 -- 172.21.15.7:0/1174982255 learned_addr learned my addr 172.21.15.7:0/1174982255 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5d2ffd640 1 -- 172.21.15.7:0/3493698437 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff5cc042030 con 0x7ff5dc1083d0 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5e1948640 1 --2- 172.21.15.7:0/1174982255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5e2149640 1 -- 172.21.15.7:0/1174982255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34dc670 msgr2=0x563ff38a4eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5e2149640 1 --2- 172.21.15.7:0/1174982255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34dc670 0x563ff38a4eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5e2149640 1 -- 172.21.15.7:0/1174982255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 msgr2=0x563ff38a4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5e2149640 1 --2- 172.21.15.7:0/1174982255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38a4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5e2149640 1 -- 172.21.15.7:0/1174982255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff3568930 con 0x563ff34fd350 2024-09-21T05:59:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.960+0000 7ff5e1948640 1 --2- 172.21.15.7:0/1174982255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38a4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.961+0000 7ff5e2149640 1 --2- 172.21.15.7:0/1174982255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 0x563ff38a4430 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4010370 tx=0x7ff5d4010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0be62f663b035c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.961+0000 7ff5c7fff640 1 -- 172.21.15.7:0/1174982255 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4016070 con 0x563ff34fd350 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.961+0000 7ff5c7fff640 1 -- 172.21.15.7:0/1174982255 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5d4012bc0 con 0x563ff34fd350 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.961+0000 7ff5c7fff640 1 -- 172.21.15.7:0/1174982255 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4011bc0 con 0x563ff34fd350 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.961+0000 7ff5d2ffd640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5c80b6680 0x7ff5c80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.961+0000 7ff5e1948640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5c80b6680 0x7ff5c80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.961+0000 7ff5d2ffd640 1 -- 172.21.15.7:0/3493698437 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7ff5cc107c60 con 0x7ff5dc1083d0 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.962+0000 7ff5ea120740 1 -- 172.21.15.7:0/1174982255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 msgr2=0x563ff38a4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.962+0000 7ff5e1948640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5c80b6680 0x7ff5c80b8b90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8005fd0 tx=0x7ff5d8005f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.962+0000 7ff5ea120740 1 --2- 172.21.15.7:0/1174982255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 0x563ff38a4430 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4010370 tx=0x7ff5d4010830 comp rx=0 tx=0).stop 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.962+0000 7ff5ea120740 1 -- 172.21.15.7:0/1174982255 shutdown_connections 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.962+0000 7ff5ea120740 1 --2- 172.21.15.7:0/1174982255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34dc670 0x563ff38a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.962+0000 7ff5ea120740 1 --2- 172.21.15.7:0/1174982255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38a4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.962+0000 7ff5ea120740 1 --2- 172.21.15.7:0/1174982255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 0x563ff38a4430 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.962+0000 7ff5ea120740 1 -- 172.21.15.7:0/1174982255 >> 172.21.15.7:0/1174982255 conn(0x563ff34f1740 msgr2=0x563ff38a2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.962+0000 7ff5ea120740 1 -- 172.21.15.7:0/1174982255 shutdown_connections 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.962+0000 7ff5ea120740 1 -- 172.21.15.7:0/1174982255 wait complete. 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.962+0000 7ff5ea120740 1 -- start start 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.963+0000 7ff5ea120740 1 Processor -- start 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.963+0000 7ff5ea120740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.963+0000 7ff5ea120740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 0x563ff38b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.963+0000 7ff5ea120740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34fd350 0x563ff38ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.963+0000 7ff5ea120740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563ff366b890 con 0x563ff34dc670 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.963+0000 7ff5ea120740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x563ff37a4d40 con 0x563ff34d4490 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.963+0000 7ff5ea120740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563ff38b6f40 con 0x563ff34fd350 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.963+0000 7ff5ea120740 10 client.0 _ll_register_callbacks cb 0x563ff3808c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.963+0000 7ff5e1147640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 0x563ff38b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.963+0000 7ff5e1147640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 0x563ff38b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43686/0 (socket says 172.21.15.7:43686) 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.963+0000 7ff5e1147640 1 -- 172.21.15.7:0/3831641657 learned_addr learned my addr 172.21.15.7:0/3831641657 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.963+0000 7ff5e1948640 1 --2- 172.21.15.7:0/3831641657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.963+0000 7ff5e2149640 1 --2- 172.21.15.7:0/3831641657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34fd350 0x563ff38ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5e1147640 1 -- 172.21.15.7:0/3831641657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34fd350 msgr2=0x563ff38ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5e1147640 1 --2- 172.21.15.7:0/3831641657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34fd350 0x563ff38ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5e1147640 1 -- 172.21.15.7:0/3831641657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 msgr2=0x563ff38b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5e1147640 1 --2- 172.21.15.7:0/3831641657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5e1147640 1 -- 172.21.15.7:0/3831641657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff38ba8b0 con 0x563ff34dc670 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5e1147640 1 --2- 172.21.15.7:0/3831641657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 0x563ff38b4ab0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc105490 tx=0x7ff5cc009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91f094584ba9d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5c57fa640 1 -- 172.21.15.7:0/3831641657 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0cee60 con 0x563ff34dc670 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5c57fa640 1 -- 172.21.15.7:0/3831641657 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7ff5cc0c9da0 con 0x563ff34dc670 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5ea120740 1 -- 172.21.15.7:0/3831641657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5d4012bc0 con 0x563ff34dc670 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5c57fa640 1 -- 172.21.15.7:0/3831641657 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff5cc049030 con 0x563ff34dc670 2024-09-21T05:59:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5ea120740 10 client.16656 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5ea120740 1 -- 172.21.15.7:0/3831641657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563ff38c3260 con 0x563ff34dc670 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5c57fa640 1 -- 172.21.15.7:0/3831641657 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5d4012bc0 con 0x563ff34dc670 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.964+0000 7ff5c57fa640 1 -- 172.21.15.7:0/3831641657 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff5cc0d70c0 con 0x563ff34dc670 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.965+0000 7ff5ea120740 10 client.16656 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.965+0000 7ff5ea120740 10 client.16656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.965+0000 7ff5ea120740 20 client.16656 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.965+0000 7ff5ea120740 1 --2- 172.21.15.7:0/3831641657 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563ff34bbcd0 0x563ff38c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.965+0000 7ff5ea120740 4 client.16656 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.965+0000 7ff5ea120740 1 -- 172.21.15.7:0/3831641657 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ff381cdb0 con 0x563ff34bbcd0 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.965+0000 7ff5e1948640 1 --2- 172.21.15.7:0/3831641657 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563ff34bbcd0 0x563ff38c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.965+0000 7ff5c57fa640 10 client.16656 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.965+0000 7ff5e1948640 1 --2- 172.21.15.7:0/3831641657 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563ff34bbcd0 0x563ff38c66a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e8aa4804642b638 server_cookie=4fb5738ce495e61e in_seq=0 out_seq=0 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5c57fa640 1 -- 172.21.15.7:0/3831641657 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ff381cdb0 con 0x563ff34bbcd0 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5c57fa640 10 client.16656 handle_command_reply: tid=0 2024-09-21T05:59:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5ea120740 1 client.16656 shutdown 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5ea120740 1 -- 172.21.15.7:0/3831641657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 msgr2=0x563ff38b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5ea120740 1 --2- 172.21.15.7:0/3831641657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 0x563ff38b4ab0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc105490 tx=0x7ff5cc009650 comp rx=0 tx=0).stop 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5ea120740 1 -- 172.21.15.7:0/3831641657 shutdown_connections 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5ea120740 1 --2- 172.21.15.7:0/3831641657 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563ff34bbcd0 0x563ff38c66a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5ea120740 1 --2- 172.21.15.7:0/3831641657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 0x563ff38b4ab0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5ea120740 1 --2- 172.21.15.7:0/3831641657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34fd350 0x563ff38ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5ea120740 1 --2- 172.21.15.7:0/3831641657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5c57fa640 0 client.16656 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5ea120740 1 -- 172.21.15.7:0/3831641657 >> 172.21.15.7:0/3831641657 conn(0x563ff34f1740 msgr2=0x563ff38a75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5ea120740 1 -- 172.21.15.7:0/3831641657 shutdown_connections 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.966+0000 7ff5ea120740 1 -- 172.21.15.7:0/3831641657 wait complete. 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.967+0000 7ff5ea120740 20 client.16656 trim_cache size 0 max 16384 2024-09-21T05:59:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.984+0000 7ff5ea120740 1 Processor -- start 2024-09-21T05:59:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.984+0000 7ff5ea120740 1 -- start start 2024-09-21T05:59:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.984+0000 7ff5ea120740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34d4490 0x563ff38ba1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.984+0000 7ff5ea120740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34dc670 0x563ff38a2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.984+0000 7ff5ea120740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 0x563ff38a9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.984+0000 7ff5ea120740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1afb40 con 0x563ff34fd350 2024-09-21T05:59:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.984+0000 7ff5ea120740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1ad410 con 0x563ff34dc670 2024-09-21T05:59:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.984+0000 7ff5ea120740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1ab280 con 0x563ff34d4490 2024-09-21T05:59:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5e2149640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 0x563ff38a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5e2149640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 0x563ff38a9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43694/0 (socket says 172.21.15.7:43694) 2024-09-21T05:59:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5e2149640 1 -- 172.21.15.7:0/3090907925 learned_addr learned my addr 172.21.15.7:0/3090907925 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5e1948640 1 --2- 172.21.15.7:0/3090907925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34d4490 0x563ff38ba1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5e1147640 1 --2- 172.21.15.7:0/3090907925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34dc670 0x563ff38a2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5e2149640 1 -- 172.21.15.7:0/3090907925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34d4490 msgr2=0x563ff38ba1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5e2149640 1 --2- 172.21.15.7:0/3090907925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34d4490 0x563ff38ba1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5e2149640 1 -- 172.21.15.7:0/3090907925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34dc670 msgr2=0x563ff38a2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5e2149640 1 --2- 172.21.15.7:0/3090907925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34dc670 0x563ff38a2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5e2149640 1 -- 172.21.15.7:0/3090907925 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff38b55b0 con 0x563ff34fd350 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5e2149640 1 --2- 172.21.15.7:0/3090907925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 0x563ff38a9720 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4010d30 tx=0x7ff5d4009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa222e2bcb85af6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5c77fe640 1 -- 172.21.15.7:0/3090907925 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d402a070 con 0x563ff34fd350 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5c77fe640 1 -- 172.21.15.7:0/3090907925 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5d4004d80 con 0x563ff34fd350 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.985+0000 7ff5c77fe640 1 -- 172.21.15.7:0/3090907925 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4016050 con 0x563ff34fd350 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.986+0000 7ff5ea120740 1 -- 172.21.15.7:0/3090907925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 msgr2=0x563ff38a9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.986+0000 7ff5ea120740 1 --2- 172.21.15.7:0/3090907925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 0x563ff38a9720 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4010d30 tx=0x7ff5d4009d00 comp rx=0 tx=0).stop 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.986+0000 7ff5ea120740 1 -- 172.21.15.7:0/3090907925 shutdown_connections 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.986+0000 7ff5ea120740 1 --2- 172.21.15.7:0/3090907925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34fd350 0x563ff38a9720 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.986+0000 7ff5ea120740 1 --2- 172.21.15.7:0/3090907925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34dc670 0x563ff38a2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.986+0000 7ff5ea120740 1 --2- 172.21.15.7:0/3090907925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34d4490 0x563ff38ba1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.986+0000 7ff5ea120740 1 -- 172.21.15.7:0/3090907925 >> 172.21.15.7:0/3090907925 conn(0x563ff34f1740 msgr2=0x563ff38a1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.986+0000 7ff5ea120740 1 -- 172.21.15.7:0/3090907925 shutdown_connections 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.986+0000 7ff5ea120740 1 -- 172.21.15.7:0/3090907925 wait complete. 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.987+0000 7ff5ea120740 1 -- start start 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.987+0000 7ff5ea120740 1 Processor -- start 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.987+0000 7ff5ea120740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.987+0000 7ff5ea120740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 0x563ff38c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.987+0000 7ff5ea120740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34fd350 0x563ff38bb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.987+0000 7ff5ea120740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1ab8d0 con 0x563ff34dc670 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.987+0000 7ff5ea120740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1acd40 con 0x563ff34d4490 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.987+0000 7ff5ea120740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1abfa0 con 0x563ff34fd350 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.987+0000 7ff5ea120740 10 client.0 _ll_register_callbacks cb 0x7ff5cc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5e1147640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 0x563ff38c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5e1147640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 0x563ff38c10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43708/0 (socket says 172.21.15.7:43708) 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5e1948640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5e1147640 1 -- 172.21.15.7:0/500681634 learned_addr learned my addr 172.21.15.7:0/500681634 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5e2149640 1 --2- 172.21.15.7:0/500681634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34fd350 0x563ff38bb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5e1147640 1 -- 172.21.15.7:0/500681634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34fd350 msgr2=0x563ff38bb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5e1147640 1 --2- 172.21.15.7:0/500681634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34fd350 0x563ff38bb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5e1147640 1 -- 172.21.15.7:0/500681634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 msgr2=0x563ff38c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5e1147640 1 --2- 172.21.15.7:0/500681634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5e1147640 1 -- 172.21.15.7:0/500681634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff38bb7b0 con 0x563ff34dc670 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5e1948640 1 --2- 172.21.15.7:0/500681634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5e1147640 1 --2- 172.21.15.7:0/500681634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 0x563ff38c10a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc1054e0 tx=0x7ff5cc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f1427160beaa1d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5c57fa640 1 -- 172.21.15.7:0/500681634 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0cee60 con 0x563ff34dc670 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5c57fa640 1 -- 172.21.15.7:0/500681634 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7ff5cc105b80 con 0x563ff34dc670 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.988+0000 7ff5ea120740 1 -- 172.21.15.7:0/500681634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5d4004d80 con 0x563ff34dc670 2024-09-21T05:59:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.989+0000 7ff5c57fa640 1 -- 172.21.15.7:0/500681634 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff5cc08f050 con 0x563ff34dc670 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.989+0000 7ff5ea120740 10 client.16662 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.989+0000 7ff5ea120740 1 -- 172.21.15.7:0/500681634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563ff3931ab0 con 0x563ff34dc670 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.989+0000 7ff5c57fa640 1 -- 172.21.15.7:0/500681634 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5cc0ea080 con 0x563ff34dc670 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.989+0000 7ff5c57fa640 1 -- 172.21.15.7:0/500681634 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff5cc0e3ce0 con 0x563ff34dc670 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.989+0000 7ff5ea120740 10 client.16662 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.989+0000 7ff5ea120740 10 client.16662 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.989+0000 7ff5ea120740 20 client.16662 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.989+0000 7ff5ea120740 1 --2- 172.21.15.7:0/500681634 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563ff3491080 0x563ff3933ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.989+0000 7ff5ea120740 4 client.16662 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.989+0000 7ff5ea120740 1 -- 172.21.15.7:0/500681634 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563ff3818860 con 0x563ff3491080 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.989+0000 7ff5e1948640 1 --2- 172.21.15.7:0/500681634 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563ff3491080 0x563ff3933ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.990+0000 7ff5e1948640 1 --2- 172.21.15.7:0/500681634 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563ff3491080 0x563ff3933ff0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffbd8efaecf99e04 server_cookie=749642bb9796fc88 in_seq=0 out_seq=0 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.990+0000 7ff5c57fa640 10 client.16662 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5c57fa640 1 -- 172.21.15.7:0/500681634 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563ff3818860 con 0x563ff3491080 2024-09-21T05:59:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5c57fa640 10 client.16662 handle_command_reply: tid=0 2024-09-21T05:59:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5ea120740 1 client.16662 shutdown 2024-09-21T05:59:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5ea120740 1 -- 172.21.15.7:0/500681634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 msgr2=0x563ff38c10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5ea120740 1 --2- 172.21.15.7:0/500681634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 0x563ff38c10a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc1054e0 tx=0x7ff5cc009260 comp rx=0 tx=0).stop 2024-09-21T05:59:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5ea120740 1 -- 172.21.15.7:0/500681634 shutdown_connections 2024-09-21T05:59:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5ea120740 1 --2- 172.21.15.7:0/500681634 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563ff3491080 0x563ff3933ff0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5ea120740 1 --2- 172.21.15.7:0/500681634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563ff34dc670 0x563ff38c10a0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5c57fa640 0 client.16662 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5ea120740 1 --2- 172.21.15.7:0/500681634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x563ff34fd350 0x563ff38bb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5ea120740 1 --2- 172.21.15.7:0/500681634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x563ff34d4490 0x563ff38c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5ea120740 1 -- 172.21.15.7:0/500681634 >> 172.21.15.7:0/500681634 conn(0x563ff34f1740 msgr2=0x563ff38b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5ea120740 1 -- 172.21.15.7:0/500681634 shutdown_connections 2024-09-21T05:59:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5ea120740 1 -- 172.21.15.7:0/500681634 wait complete. 2024-09-21T05:59:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5ea120740 20 client.16662 trim_cache size 0 max 16384 2024-09-21T05:59:31.005 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:59:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T05:59:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "12e61c0d-1a70-41a3-866b-f7684d2cfdf0", 2024-09-21T05:59:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T05:59:31.005 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:59:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5e3bac640 1 -- 172.21.15.7:0/3493698437 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5c80b6680 msgr2=0x7ff5c80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5e3bac640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5c80b6680 0x7ff5c80b8b90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8005fd0 tx=0x7ff5d8005f40 comp rx=0 tx=0).stop 2024-09-21T05:59:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5e3bac640 1 -- 172.21.15.7:0/3493698437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc1083d0 msgr2=0x7ff5dc19b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5e3bac640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc1083d0 0x7ff5dc19b7e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc032fd0 tx=0x7ff5cc004270 comp rx=0 tx=0).stop 2024-09-21T05:59:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5e3bac640 1 -- 172.21.15.7:0/3493698437 shutdown_connections 2024-09-21T05:59:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5e3bac640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5c80b6680 0x7ff5c80b8b90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5e3bac640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc1083d0 0x7ff5dc19b7e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5e3bac640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5dc108d20 0x7ff5dc19bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5e3bac640 1 --2- 172.21.15.7:0/3493698437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5dc102ae0 0x7ff5dc19b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5e3bac640 1 -- 172.21.15.7:0/3493698437 >> 172.21.15.7:0/3493698437 conn(0x7ff5dc079760 msgr2=0x7ff5dc104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5e3bac640 1 -- 172.21.15.7:0/3493698437 shutdown_connections 2024-09-21T05:59:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:30.993+0000 7ff5e3bac640 1 -- 172.21.15.7:0/3493698437 wait complete. 2024-09-21T05:59:31.679 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:59:31.982 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:32.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:31 smithi027 ceph-mon[34364]: pgmap v487: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:59:32.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:31 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T05:59:32.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:31 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:32.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:31 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T05:59:32.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:31 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:32.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:31 smithi007 ceph-mon[30983]: pgmap v487: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:59:32.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:31 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T05:59:32.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:31 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:32.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:31 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T05:59:32.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:31 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:32.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:31 smithi119 ceph-mon[34833]: pgmap v487: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T05:59:32.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:31 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T05:59:32.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:31 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:32.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:31 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T05:59:32.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:31 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:32.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.471+0000 7f73371ba640 1 -- 172.21.15.7:0/4106960596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330109df0 msgr2=0x7f7330110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.471+0000 7f73371ba640 1 --2- 172.21.15.7:0/4106960596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330109df0 0x7f7330110620 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7328009ca0 tx=0x7f732802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.471+0000 7f73371ba640 1 -- 172.21.15.7:0/4106960596 shutdown_connections 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.471+0000 7f73371ba640 1 --2- 172.21.15.7:0/4106960596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330109df0 0x7f7330110620 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.472+0000 7f73371ba640 1 --2- 172.21.15.7:0/4106960596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73301094a0 0x7f73301098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.472+0000 7f73371ba640 1 --2- 172.21.15.7:0/4106960596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7330103b60 0x7f7330103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.472+0000 7f73371ba640 1 -- 172.21.15.7:0/4106960596 >> 172.21.15.7:0/4106960596 conn(0x7f733007b850 msgr2=0x7f733007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.472+0000 7f73371ba640 1 -- 172.21.15.7:0/4106960596 shutdown_connections 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.472+0000 7f73371ba640 1 -- 172.21.15.7:0/4106960596 wait complete. 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.472+0000 7f73371ba640 1 Processor -- start 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.472+0000 7f73371ba640 1 -- start start 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f73371ba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330103b60 0x7f733019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f73371ba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73301094a0 0x7f733019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f73371ba640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7330109df0 0x7f733019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f73371ba640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7330113ab0 con 0x7f7330103b60 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f73371ba640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7330113930 con 0x7f7330109df0 2024-09-21T05:59:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f73371ba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7330113c30 con 0x7f73301094a0 2024-09-21T05:59:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f7334f56640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330103b60 0x7f733019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f7334f56640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330103b60 0x7f733019a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43724/0 (socket says 172.21.15.7:43724) 2024-09-21T05:59:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f7334f56640 1 -- 172.21.15.7:0/2396741489 learned_addr learned my addr 172.21.15.7:0/2396741489 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f732ffff640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73301094a0 0x7f733019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f7335757640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7330109df0 0x7f733019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f7334f56640 1 -- 172.21.15.7:0/2396741489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73301094a0 msgr2=0x7f733019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f7334f56640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73301094a0 0x7f733019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f7334f56640 1 -- 172.21.15.7:0/2396741489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7330109df0 msgr2=0x7f733019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f7334f56640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7330109df0 0x7f733019fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f7334f56640 1 -- 172.21.15.7:0/2396741489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73301a03b0 con 0x7f7330103b60 2024-09-21T05:59:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f7334f56640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330103b60 0x7f733019a440 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f732400d950 tx=0x7f732400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f732dffb640 1 -- 172.21.15.7:0/2396741489 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7324017030 con 0x7f7330103b60 2024-09-21T05:59:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f732dffb640 1 -- 172.21.15.7:0/2396741489 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7324004020 con 0x7f7330103b60 2024-09-21T05:59:32.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f73371ba640 1 -- 172.21.15.7:0/2396741489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73301a06a0 con 0x7f7330103b60 2024-09-21T05:59:32.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.473+0000 7f732dffb640 1 -- 172.21.15.7:0/2396741489 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73240047a0 con 0x7f7330103b60 2024-09-21T05:59:32.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.474+0000 7f73371ba640 1 -- 172.21.15.7:0/2396741489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73301a6e00 con 0x7f7330103b60 2024-09-21T05:59:32.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.476+0000 7f733d72e740 1 Processor -- start 2024-09-21T05:59:32.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.476+0000 7f732dffb640 1 -- 172.21.15.7:0/2396741489 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7324009a30 con 0x7f7330103b60 2024-09-21T05:59:32.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.476+0000 7f733d72e740 1 -- start start 2024-09-21T05:59:32.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f733d72e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 0x55d29ddb6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f733d72e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 0x55d29ddb67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f733d72e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddb6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f733d72e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d29dd2ce50 con 0x55d29d9ee390 2024-09-21T05:59:32.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f733d72e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d29dd1c280 con 0x55d29da0f070 2024-09-21T05:59:32.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f733d72e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d29dd20090 con 0x55d29d9e61b0 2024-09-21T05:59:32.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f732ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddb6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f732ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddb6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43730/0 (socket says 172.21.15.7:43730) 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f732ffff640 1 -- 172.21.15.7:0/1399759759 learned_addr learned my addr 172.21.15.7:0/1399759759 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f7335757640 1 --2- 172.21.15.7:0/1399759759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 0x55d29ddb6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f7334f56640 1 --2- 172.21.15.7:0/1399759759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 0x55d29ddb67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f732ffff640 1 -- 172.21.15.7:0/1399759759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 msgr2=0x55d29ddb67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f732ffff640 1 --2- 172.21.15.7:0/1399759759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 0x55d29ddb67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f732ffff640 1 -- 172.21.15.7:0/1399759759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 msgr2=0x55d29ddb6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f732ffff640 1 --2- 172.21.15.7:0/1399759759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 0x55d29ddb6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f732ffff640 1 -- 172.21.15.7:0/1399759759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d29da7a650 con 0x55d29d9ee390 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.477+0000 7f732dffb640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f73200b6680 0x7f73200b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.478+0000 7f7335757640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f73200b6680 0x7f73200b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.478+0000 7f732ffff640 1 --2- 172.21.15.7:0/1399759759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddb6cf0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f731c009a80 tx=0x7f731c009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66aa75a5e77ba58a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.478+0000 7f732dffb640 1 -- 172.21.15.7:0/2396741489 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f73240e7220 con 0x7f7330103b60 2024-09-21T05:59:32.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.478+0000 7f731affd640 1 -- 172.21.15.7:0/1399759759 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c016070 con 0x55d29d9ee390 2024-09-21T05:59:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.478+0000 7f731affd640 1 -- 172.21.15.7:0/1399759759 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f731c0054d0 con 0x55d29d9ee390 2024-09-21T05:59:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.478+0000 7f731affd640 1 -- 172.21.15.7:0/1399759759 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c004e40 con 0x55d29d9ee390 2024-09-21T05:59:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.479+0000 7f733d72e740 1 -- 172.21.15.7:0/1399759759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 msgr2=0x55d29ddb6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.479+0000 7f7335757640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f73200b6680 0x7f73200b8b90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7328006010 tx=0x7f7328009440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.479+0000 7f733d72e740 1 --2- 172.21.15.7:0/1399759759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddb6cf0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f731c009a80 tx=0x7f731c009f40 comp rx=0 tx=0).stop 2024-09-21T05:59:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.479+0000 7f733d72e740 1 -- 172.21.15.7:0/1399759759 shutdown_connections 2024-09-21T05:59:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.479+0000 7f733d72e740 1 --2- 172.21.15.7:0/1399759759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddb6cf0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.479+0000 7f733d72e740 1 --2- 172.21.15.7:0/1399759759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 0x55d29ddb67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.479+0000 7f733d72e740 1 --2- 172.21.15.7:0/1399759759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 0x55d29ddb6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.479+0000 7f733d72e740 1 -- 172.21.15.7:0/1399759759 >> 172.21.15.7:0/1399759759 conn(0x55d29da03460 msgr2=0x55d29ddb4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.479+0000 7f733d72e740 1 -- 172.21.15.7:0/1399759759 shutdown_connections 2024-09-21T05:59:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.479+0000 7f733d72e740 1 -- 172.21.15.7:0/1399759759 wait complete. 2024-09-21T05:59:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.479+0000 7f733d72e740 1 -- start start 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.479+0000 7f733d72e740 1 Processor -- start 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.480+0000 7f733d72e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29d9e61b0 0x55d29ddc18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.480+0000 7f733d72e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9ee390 0x55d29ddc1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.480+0000 7f733d72e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29da0f070 0x55d29ddcdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.480+0000 7f733d72e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d29db7d700 con 0x55d29da0f070 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.480+0000 7f733d72e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d29dcb7110 con 0x55d29d9e61b0 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.480+0000 7f733d72e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d29ddc4a50 con 0x55d29d9ee390 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.480+0000 7f733d72e740 10 client.0 _ll_register_callbacks cb 0x55d29dcd0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.480+0000 7f7335757640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29da0f070 0x55d29ddcdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.480+0000 7f7335757640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29da0f070 0x55d29ddcdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43742/0 (socket says 172.21.15.7:43742) 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.480+0000 7f7335757640 1 -- 172.21.15.7:0/1203766298 learned_addr learned my addr 172.21.15.7:0/1203766298 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.480+0000 7f7334f56640 1 --2- 172.21.15.7:0/1203766298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29d9e61b0 0x55d29ddc18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.480+0000 7f732ffff640 1 --2- 172.21.15.7:0/1203766298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9ee390 0x55d29ddc1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f7335757640 1 -- 172.21.15.7:0/1203766298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9ee390 msgr2=0x55d29ddc1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f7335757640 1 --2- 172.21.15.7:0/1203766298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9ee390 0x55d29ddc1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f7335757640 1 -- 172.21.15.7:0/1203766298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29d9e61b0 msgr2=0x55d29ddc18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f7335757640 1 --2- 172.21.15.7:0/1203766298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29d9e61b0 0x55d29ddc18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f7335757640 1 -- 172.21.15.7:0/1203766298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d29dce4c40 con 0x55d29da0f070 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f7335757640 1 --2- 172.21.15.7:0/1203766298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29da0f070 0x55d29ddcdd40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f73280098b0 tx=0x7f732802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e8bdbea462bf72 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f730ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f730ffff640 1 -- 172.21.15.7:0/1203766298 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73280318e0 con 0x55d29da0f070 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f730ffff640 1 -- 172.21.15.7:0/1203766298 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f7328004250 con 0x55d29da0f070 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f733d72e740 1 -- 172.21.15.7:0/1203766298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f731c0054d0 con 0x55d29da0f070 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f730ffff640 1 -- 172.21.15.7:0/1203766298 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7328004450 con 0x55d29da0f070 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f733d72e740 10 client.16674 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f733d72e740 1 -- 172.21.15.7:0/1203766298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d29ddd0700 con 0x55d29da0f070 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.481+0000 7f730ffff640 1 -- 172.21.15.7:0/1203766298 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f731c0054d0 con 0x55d29da0f070 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.482+0000 7f730ffff640 1 -- 172.21.15.7:0/1203766298 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7328050070 con 0x55d29da0f070 2024-09-21T05:59:32.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.482+0000 7f733d72e740 10 client.16674 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.482+0000 7f733d72e740 10 client.16674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.482+0000 7f733d72e740 20 client.16674 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.482+0000 7f733d72e740 1 --2- 172.21.15.7:0/1203766298 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d29d9cd9f0 0x55d29ddd3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.482+0000 7f733d72e740 4 client.16674 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.482+0000 7f733d72e740 1 -- 172.21.15.7:0/1203766298 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d29dd2eda0 con 0x55d29d9cd9f0 2024-09-21T05:59:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.482+0000 7f7334f56640 1 --2- 172.21.15.7:0/1203766298 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d29d9cd9f0 0x55d29ddd3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.483+0000 7f730ffff640 10 client.16674 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.483+0000 7f7334f56640 1 --2- 172.21.15.7:0/1203766298 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d29d9cd9f0 0x55d29ddd3c40 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a88d3e42ffc9104 server_cookie=1620395f62accc74 in_seq=0 out_seq=0 2024-09-21T05:59:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.483+0000 7f730ffff640 1 -- 172.21.15.7:0/1203766298 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d29dd2eda0 con 0x55d29d9cd9f0 2024-09-21T05:59:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.483+0000 7f730ffff640 10 client.16674 handle_command_reply: tid=0 2024-09-21T05:59:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.483+0000 7f733d72e740 1 client.16674 shutdown 2024-09-21T05:59:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.484+0000 7f733d72e740 1 -- 172.21.15.7:0/1203766298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29da0f070 msgr2=0x55d29ddcdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.484+0000 7f733d72e740 1 --2- 172.21.15.7:0/1203766298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29da0f070 0x55d29ddcdd40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f73280098b0 tx=0x7f732802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.484+0000 7f733d72e740 1 -- 172.21.15.7:0/1203766298 shutdown_connections 2024-09-21T05:59:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.484+0000 7f733d72e740 1 --2- 172.21.15.7:0/1203766298 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d29d9cd9f0 0x55d29ddd3c40 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.484+0000 7f733d72e740 1 --2- 172.21.15.7:0/1203766298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29da0f070 0x55d29ddcdd40 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.484+0000 7f733d72e740 1 --2- 172.21.15.7:0/1203766298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9ee390 0x55d29ddc1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.484+0000 7f733d72e740 1 --2- 172.21.15.7:0/1203766298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29d9e61b0 0x55d29ddc18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.484+0000 7f733d72e740 1 -- 172.21.15.7:0/1203766298 >> 172.21.15.7:0/1203766298 conn(0x55d29da03460 msgr2=0x55d29ddb9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:32.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.484+0000 7f730ffff640 0 client.16674 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:32.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.484+0000 7f733d72e740 1 -- 172.21.15.7:0/1203766298 shutdown_connections 2024-09-21T05:59:32.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.484+0000 7f733d72e740 1 -- 172.21.15.7:0/1203766298 wait complete. 2024-09-21T05:59:32.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.484+0000 7f733d72e740 20 client.16674 trim_cache size 0 max 16384 2024-09-21T05:59:32.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.501+0000 7f733d72e740 1 Processor -- start 2024-09-21T05:59:32.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.501+0000 7f733d72e740 1 -- start start 2024-09-21T05:59:32.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f733d72e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 0x55d29ddc1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f733d72e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddcdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f733d72e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 0x55d29ddbeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f733d72e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f73301b1e00 con 0x55d29d9ee390 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f733d72e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f73301af6d0 con 0x55d29da0f070 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f733d72e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f73301ad520 con 0x55d29d9e61b0 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f732ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddcdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f732ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddcdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43758/0 (socket says 172.21.15.7:43758) 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f732ffff640 1 -- 172.21.15.7:0/1915038224 learned_addr learned my addr 172.21.15.7:0/1915038224 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f7334f56640 1 --2- 172.21.15.7:0/1915038224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 0x55d29ddc1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f7335757640 1 --2- 172.21.15.7:0/1915038224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 0x55d29ddbeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f732ffff640 1 -- 172.21.15.7:0/1915038224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 msgr2=0x55d29ddc1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f732ffff640 1 --2- 172.21.15.7:0/1915038224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 0x55d29ddc1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f732ffff640 1 -- 172.21.15.7:0/1915038224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 msgr2=0x55d29ddbeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f732ffff640 1 --2- 172.21.15.7:0/1915038224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 0x55d29ddbeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f732ffff640 1 -- 172.21.15.7:0/1915038224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d29ddc0830 con 0x55d29d9ee390 2024-09-21T05:59:32.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.502+0000 7f732ffff640 1 --2- 172.21.15.7:0/1915038224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddcdc40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f731c00e780 tx=0x7f731c0049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6c48c21e8b0f35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:32.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.503+0000 7f731a7fc640 1 -- 172.21.15.7:0/1915038224 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c028020 con 0x55d29d9ee390 2024-09-21T05:59:32.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.503+0000 7f731a7fc640 1 -- 172.21.15.7:0/1915038224 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f731c011470 con 0x55d29d9ee390 2024-09-21T05:59:32.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.503+0000 7f731a7fc640 1 -- 172.21.15.7:0/1915038224 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c016040 con 0x55d29d9ee390 2024-09-21T05:59:32.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.504+0000 7f733d72e740 1 -- 172.21.15.7:0/1915038224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 msgr2=0x55d29ddcdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.504+0000 7f733d72e740 1 --2- 172.21.15.7:0/1915038224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddcdc40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f731c00e780 tx=0x7f731c0049e0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.504+0000 7f733d72e740 1 -- 172.21.15.7:0/1915038224 shutdown_connections 2024-09-21T05:59:32.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.504+0000 7f733d72e740 1 --2- 172.21.15.7:0/1915038224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddcdc40 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.504+0000 7f733d72e740 1 --2- 172.21.15.7:0/1915038224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 0x55d29ddbeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.504+0000 7f733d72e740 1 --2- 172.21.15.7:0/1915038224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 0x55d29ddc1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.504+0000 7f733d72e740 1 -- 172.21.15.7:0/1915038224 >> 172.21.15.7:0/1915038224 conn(0x55d29da03460 msgr2=0x55d29ddc1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:32.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.504+0000 7f733d72e740 1 -- 172.21.15.7:0/1915038224 shutdown_connections 2024-09-21T05:59:32.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.504+0000 7f733d72e740 1 -- 172.21.15.7:0/1915038224 wait complete. 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.504+0000 7f733d72e740 1 -- start start 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.504+0000 7f733d72e740 1 Processor -- start 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f733d72e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 0x55d29de3a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f733d72e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddc9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f733d72e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 0x55d29ddca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f733d72e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f73301adb90 con 0x55d29d9ee390 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f733d72e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f73301af000 con 0x55d29da0f070 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f733d72e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f73301ae260 con 0x55d29d9e61b0 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f733d72e740 10 client.0 _ll_register_callbacks cb 0x7f732802f430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f732ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddc9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f732ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddc9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43774/0 (socket says 172.21.15.7:43774) 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f732ffff640 1 -- 172.21.15.7:0/2746088894 learned_addr learned my addr 172.21.15.7:0/2746088894 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f7335757640 1 --2- 172.21.15.7:0/2746088894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 0x55d29ddca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f7334f56640 1 --2- 172.21.15.7:0/2746088894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 0x55d29de3a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f732ffff640 1 -- 172.21.15.7:0/2746088894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 msgr2=0x55d29de3a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f732ffff640 1 --2- 172.21.15.7:0/2746088894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 0x55d29de3a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f732ffff640 1 -- 172.21.15.7:0/2746088894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 msgr2=0x55d29ddca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f732ffff640 1 --2- 172.21.15.7:0/2746088894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 0x55d29ddca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.505+0000 7f732ffff640 1 -- 172.21.15.7:0/2746088894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d29ddca990 con 0x55d29d9ee390 2024-09-21T05:59:32.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.506+0000 7f732ffff640 1 --2- 172.21.15.7:0/2746088894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddc9ca0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f731c004910 tx=0x7f731c004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81846fd53584a2f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:32.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.506+0000 7f730ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:32.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.506+0000 7f730ffff640 1 -- 172.21.15.7:0/2746088894 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c028030 con 0x55d29d9ee390 2024-09-21T05:59:32.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.506+0000 7f730ffff640 1 -- 172.21.15.7:0/2746088894 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f731c011a30 con 0x55d29d9ee390 2024-09-21T05:59:32.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.506+0000 7f733d72e740 1 -- 172.21.15.7:0/2746088894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f731c011470 con 0x55d29d9ee390 2024-09-21T05:59:32.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.506+0000 7f730ffff640 1 -- 172.21.15.7:0/2746088894 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f731c03e050 con 0x55d29d9ee390 2024-09-21T05:59:32.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.506+0000 7f733d72e740 10 client.16680 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:32.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.506+0000 7f733d72e740 1 -- 172.21.15.7:0/2746088894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d29de47200 con 0x55d29d9ee390 2024-09-21T05:59:32.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.507+0000 7f730ffff640 1 -- 172.21.15.7:0/2746088894 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f731c011470 con 0x55d29d9ee390 2024-09-21T05:59:32.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.507+0000 7f730ffff640 1 -- 172.21.15.7:0/2746088894 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f731c00f040 con 0x55d29d9ee390 2024-09-21T05:59:32.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.507+0000 7f733d72e740 10 client.16680 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:32.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.507+0000 7f733d72e740 10 client.16680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:32.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.507+0000 7f733d72e740 20 client.16680 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.507+0000 7f733d72e740 1 --2- 172.21.15.7:0/2746088894 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d29d9a2da0 0x55d29de49730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.507+0000 7f733d72e740 4 client.16680 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.507+0000 7f733d72e740 1 -- 172.21.15.7:0/2746088894 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d29dd2a850 con 0x55d29d9a2da0 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.507+0000 7f7334f56640 1 --2- 172.21.15.7:0/2746088894 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d29d9a2da0 0x55d29de49730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.507+0000 7f730ffff640 10 client.16680 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f7334f56640 1 --2- 172.21.15.7:0/2746088894 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d29d9a2da0 0x55d29de49730 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a102365dac7841df server_cookie=bc350d558d2b6975 in_seq=0 out_seq=0 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f730ffff640 1 -- 172.21.15.7:0/2746088894 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x55d29dd2a850 con 0x55d29d9a2da0 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f730ffff640 10 client.16680 handle_command_reply: tid=0 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f733d72e740 1 client.16680 shutdown 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f733d72e740 1 -- 172.21.15.7:0/2746088894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 msgr2=0x55d29ddc9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f733d72e740 1 --2- 172.21.15.7:0/2746088894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddc9ca0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f731c004910 tx=0x7f731c004940 comp rx=0 tx=0).stop 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f733d72e740 1 -- 172.21.15.7:0/2746088894 shutdown_connections 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f733d72e740 1 --2- 172.21.15.7:0/2746088894 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d29d9a2da0 0x55d29de49730 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f730ffff640 0 client.16680 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f733d72e740 1 --2- 172.21.15.7:0/2746088894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d29d9ee390 0x55d29ddc9ca0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f733d72e740 1 --2- 172.21.15.7:0/2746088894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d29da0f070 0x55d29ddca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f733d72e740 1 --2- 172.21.15.7:0/2746088894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d29d9e61b0 0x55d29de3a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f733d72e740 1 -- 172.21.15.7:0/2746088894 >> 172.21.15.7:0/2746088894 conn(0x55d29da03460 msgr2=0x55d29ddb72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f733d72e740 1 -- 172.21.15.7:0/2746088894 shutdown_connections 2024-09-21T05:59:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f733d72e740 1 -- 172.21.15.7:0/2746088894 wait complete. 2024-09-21T05:59:32.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.508+0000 7f733d72e740 20 client.16680 trim_cache size 0 max 16384 2024-09-21T05:59:32.514 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:59:32.514 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T05:59:32.514 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T05:59:32.514 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:32.515 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:32.516 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:32.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:32.516 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T05:59:32.516 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T05:59:32.516 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:32.516 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:32.516 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:32.516 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:32.516 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:32.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:32.516 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T05:59:32.517 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T05:59:32.517 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:32.517 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:32.517 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:32.517 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:32.517 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:32.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:32.518 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T05:59:32.518 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T05:59:32.518 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:32.518 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:32.518 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:32.518 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:32.518 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:32.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:32.518 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:59:32.518 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:59:32.518 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:32.518 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:32.518 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:59:32.519 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:32.520 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:59:32.521 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:59:32.521 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:32.521 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:32.521 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:32.521 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:32.521 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:32.521 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:59:32.521 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:59:32.521 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.509+0000 7f73371ba640 1 -- 172.21.15.7:0/2396741489 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f73200b6680 msgr2=0x7f73200b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.509+0000 7f73371ba640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f73200b6680 0x7f73200b8b90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7328006010 tx=0x7f7328009440 comp rx=0 tx=0).stop 2024-09-21T05:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.509+0000 7f73371ba640 1 -- 172.21.15.7:0/2396741489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330103b60 msgr2=0x7f733019a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.509+0000 7f73371ba640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330103b60 0x7f733019a440 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f732400d950 tx=0x7f732400de10 comp rx=0 tx=0).stop 2024-09-21T05:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.509+0000 7f73371ba640 1 -- 172.21.15.7:0/2396741489 shutdown_connections 2024-09-21T05:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.509+0000 7f73371ba640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f73200b6680 0x7f73200b8b90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.509+0000 7f73371ba640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7330109df0 0x7f733019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.509+0000 7f73371ba640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73301094a0 0x7f733019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.509+0000 7f73371ba640 1 --2- 172.21.15.7:0/2396741489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330103b60 0x7f733019a440 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.509+0000 7f73371ba640 1 -- 172.21.15.7:0/2396741489 >> 172.21.15.7:0/2396741489 conn(0x7f733007b850 msgr2=0x7f73301074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:32.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.509+0000 7f73371ba640 1 -- 172.21.15.7:0/2396741489 shutdown_connections 2024-09-21T05:59:32.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:32.509+0000 7f73371ba640 1 -- 172.21.15.7:0/2396741489 wait complete. 2024-09-21T05:59:33.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:32 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T05:59:33.115 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T05:59:33.115 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:59:33.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:32 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T05:59:33.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:32 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T05:59:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:33.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.869+0000 7f85c15af640 1 -- 172.21.15.7:0/1970251560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85bc10de10 msgr2=0x7f85bc110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:33.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.869+0000 7f85c15af640 1 --2- 172.21.15.7:0/1970251560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85bc10de10 0x7f85bc110300 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009ca0 tx=0x7f85b402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.869+0000 7f85c15af640 1 -- 172.21.15.7:0/1970251560 shutdown_connections 2024-09-21T05:59:33.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.869+0000 7f85c15af640 1 --2- 172.21.15.7:0/1970251560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85bc10de10 0x7f85bc110300 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.869+0000 7f85c15af640 1 --2- 172.21.15.7:0/1970251560 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85bc105300 0x7f85bc10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.869+0000 7f85c15af640 1 --2- 172.21.15.7:0/1970251560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85bc1049b0 0x7f85bc104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.869+0000 7f85c15af640 1 -- 172.21.15.7:0/1970251560 >> 172.21.15.7:0/1970251560 conn(0x7f85bc079730 msgr2=0x7f85bc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:33.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.869+0000 7f85c15af640 1 -- 172.21.15.7:0/1970251560 shutdown_connections 2024-09-21T05:59:33.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.869+0000 7f85c15af640 1 -- 172.21.15.7:0/1970251560 wait complete. 2024-09-21T05:59:33.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.870+0000 7f85c15af640 1 Processor -- start 2024-09-21T05:59:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.870+0000 7f85c15af640 1 -- start start 2024-09-21T05:59:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.870+0000 7f85c15af640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85bc1049b0 0x7f85bc19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.870+0000 7f85c15af640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85bc105300 0x7f85bc19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.870+0000 7f85c15af640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85bc10de10 0x7f85bc19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.870+0000 7f85c15af640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc113a90 con 0x7f85bc10de10 2024-09-21T05:59:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.870+0000 7f85c15af640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc113910 con 0x7f85bc1049b0 2024-09-21T05:59:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.870+0000 7f85c15af640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc113c10 con 0x7f85bc105300 2024-09-21T05:59:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.870+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85bc10de10 0x7f85bc19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.870+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85bc10de10 0x7f85bc19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43796/0 (socket says 172.21.15.7:43796) 2024-09-21T05:59:33.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.870+0000 7f85bb7fe640 1 -- 172.21.15.7:0/3194184994 learned_addr learned my addr 172.21.15.7:0/3194184994 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.870+0000 7f85baffd640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85bc1049b0 0x7f85bc19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.871+0000 7f85ba7fc640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85bc105300 0x7f85bc19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.871+0000 7f85bb7fe640 1 -- 172.21.15.7:0/3194184994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85bc105300 msgr2=0x7f85bc19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.871+0000 7f85bb7fe640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85bc105300 0x7f85bc19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.871+0000 7f85bb7fe640 1 -- 172.21.15.7:0/3194184994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85bc1049b0 msgr2=0x7f85bc19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.871+0000 7f85bb7fe640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85bc1049b0 0x7f85bc19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.871+0000 7f85bb7fe640 1 -- 172.21.15.7:0/3194184994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85bc1a0470 con 0x7f85bc10de10 2024-09-21T05:59:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.871+0000 7f85bb7fe640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85bc10de10 0x7f85bc19fd40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f85b4005cc0 tx=0x7f85b402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.871+0000 7f85a3fff640 1 -- 172.21.15.7:0/3194184994 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4003bf0 con 0x7f85bc10de10 2024-09-21T05:59:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.871+0000 7f85a3fff640 1 -- 172.21.15.7:0/3194184994 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85b4003d90 con 0x7f85bc10de10 2024-09-21T05:59:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.871+0000 7f85c15af640 1 -- 172.21.15.7:0/3194184994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85bc1a0700 con 0x7f85bc10de10 2024-09-21T05:59:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.871+0000 7f85a3fff640 1 -- 172.21.15.7:0/3194184994 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b402fbc0 con 0x7f85bc10de10 2024-09-21T05:59:33.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.871+0000 7f85c15af640 1 -- 172.21.15.7:0/3194184994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85bc1a6ec0 con 0x7f85bc10de10 2024-09-21T05:59:33.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.873+0000 7f85c15af640 1 -- 172.21.15.7:0/3194184994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85bc06b560 con 0x7f85bc10de10 2024-09-21T05:59:33.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.874+0000 7f85a3fff640 1 -- 172.21.15.7:0/3194184994 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f85b402fd60 con 0x7f85bc10de10 2024-09-21T05:59:33.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.875+0000 7f85a3fff640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f85a40b6680 0x7f85a40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:33.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.875+0000 7f85baffd640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f85a40b6680 0x7f85a40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:33.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.875+0000 7f85a3fff640 1 -- 172.21.15.7:0/3194184994 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f85b4108ce0 con 0x7f85bc10de10 2024-09-21T05:59:33.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.876+0000 7f85baffd640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f85a40b6680 0x7f85a40b8b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0058c0 tx=0x7f85ac00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:33.878+0000 7f85a3fff640 1 -- 172.21.15.7:0/3194184994 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f85b40cf250 con 0x7f85bc10de10 2024-09-21T05:59:34.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:33 smithi007 ceph-mon[30983]: pgmap v488: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T05:59:34.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.103+0000 7f85c15af640 1 -- 172.21.15.7:0/3194184994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85bc104dc0 con 0x7f85bc10de10 2024-09-21T05:59:34.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.104+0000 7f85a3fff640 1 -- 172.21.15.7:0/3194184994 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f85bc104dc0 con 0x7f85bc10de10 2024-09-21T05:59:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:59:34.106 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:59:34.106 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:59:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.106+0000 7f85c15af640 1 -- 172.21.15.7:0/3194184994 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f85a40b6680 msgr2=0x7f85a40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.106+0000 7f85c15af640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f85a40b6680 0x7f85a40b8b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0058c0 tx=0x7f85ac00a2d0 comp rx=0 tx=0).stop 2024-09-21T05:59:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.106+0000 7f85c15af640 1 -- 172.21.15.7:0/3194184994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85bc10de10 msgr2=0x7f85bc19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.106+0000 7f85c15af640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85bc10de10 0x7f85bc19fd40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f85b4005cc0 tx=0x7f85b402f380 comp rx=0 tx=0).stop 2024-09-21T05:59:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.106+0000 7f85c15af640 1 -- 172.21.15.7:0/3194184994 shutdown_connections 2024-09-21T05:59:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.106+0000 7f85c15af640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f85a40b6680 0x7f85a40b8b90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.106+0000 7f85c15af640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85bc10de10 0x7f85bc19fd40 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.106+0000 7f85c15af640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85bc105300 0x7f85bc19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.106+0000 7f85c15af640 1 --2- 172.21.15.7:0/3194184994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85bc1049b0 0x7f85bc19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:34.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.106+0000 7f85c15af640 1 -- 172.21.15.7:0/3194184994 >> 172.21.15.7:0/3194184994 conn(0x7f85bc079730 msgr2=0x7f85bc100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.106+0000 7f85c15af640 1 -- 172.21.15.7:0/3194184994 shutdown_connections 2024-09-21T05:59:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:34.106+0000 7f85c15af640 1 -- 172.21.15.7:0/3194184994 wait complete. 2024-09-21T05:59:34.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:33 smithi027 ceph-mon[34364]: pgmap v488: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T05:59:34.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:33 smithi119 ceph-mon[34833]: pgmap v488: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T05:59:34.766 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T05:59:35.030 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:35.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:34 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3194184994' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:35.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:34 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3194184994' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:35.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:34 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3194184994' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:35.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.494+0000 7fba8fc46640 1 -- 172.21.15.7:0/3511930597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88103bc0 msgr2=0x7fba88103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:35.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.494+0000 7fba8fc46640 1 --2- 172.21.15.7:0/3511930597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88103bc0 0x7fba88103fd0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fba80009900 tx=0x7fba8002a3f0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.494+0000 7fba8fc46640 1 -- 172.21.15.7:0/3511930597 shutdown_connections 2024-09-21T05:59:35.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.494+0000 7fba8fc46640 1 --2- 172.21.15.7:0/3511930597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba88109e00 0x7fba88110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.494+0000 7fba8fc46640 1 --2- 172.21.15.7:0/3511930597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba881094b0 0x7fba881098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.494+0000 7fba8fc46640 1 --2- 172.21.15.7:0/3511930597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88103bc0 0x7fba88103fd0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.494+0000 7fba8fc46640 1 -- 172.21.15.7:0/3511930597 >> 172.21.15.7:0/3511930597 conn(0x7fba8807b910 msgr2=0x7fba8807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:35.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.494+0000 7fba8fc46640 1 -- 172.21.15.7:0/3511930597 shutdown_connections 2024-09-21T05:59:35.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.494+0000 7fba8fc46640 1 -- 172.21.15.7:0/3511930597 wait complete. 2024-09-21T05:59:35.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.495+0000 7fba8fc46640 1 Processor -- start 2024-09-21T05:59:35.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.495+0000 7fba8fc46640 1 -- start start 2024-09-21T05:59:35.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.495+0000 7fba8fc46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88103bc0 0x7fba8819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.495+0000 7fba8fc46640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba881094b0 0x7fba8819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.495+0000 7fba8fc46640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba88109e00 0x7fba8819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.495+0000 7fba8fc46640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba88113ac0 con 0x7fba88103bc0 2024-09-21T05:59:35.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.495+0000 7fba8fc46640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fba88113940 con 0x7fba88109e00 2024-09-21T05:59:35.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.495+0000 7fba8fc46640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fba88113c40 con 0x7fba881094b0 2024-09-21T05:59:35.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba8d9e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88103bc0 0x7fba8819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba8e1e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba88109e00 0x7fba8819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba8d9e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88103bc0 0x7fba8819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43818/0 (socket says 172.21.15.7:43818) 2024-09-21T05:59:35.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba8e1e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba88109e00 0x7fba8819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:60720/0 (socket says 172.21.15.7:60720) 2024-09-21T05:59:35.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba8d9e2640 1 -- 172.21.15.7:0/34126180 learned_addr learned my addr 172.21.15.7:0/34126180 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:35.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba8d1e1640 1 --2- 172.21.15.7:0/34126180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba881094b0 0x7fba8819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba8d9e2640 1 -- 172.21.15.7:0/34126180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba881094b0 msgr2=0x7fba8819aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:35.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba8d9e2640 1 --2- 172.21.15.7:0/34126180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba881094b0 0x7fba8819aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba8d9e2640 1 -- 172.21.15.7:0/34126180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba88109e00 msgr2=0x7fba8819fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:35.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba8d9e2640 1 --2- 172.21.15.7:0/34126180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba88109e00 0x7fba8819fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba8d9e2640 1 -- 172.21.15.7:0/34126180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba881a03a0 con 0x7fba88103bc0 2024-09-21T05:59:35.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba8d9e2640 1 --2- 172.21.15.7:0/34126180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88103bc0 0x7fba8819a4f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fba80005940 tx=0x7fba800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:35.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba86ffd640 1 -- 172.21.15.7:0/34126180 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8003f030 con 0x7fba88103bc0 2024-09-21T05:59:35.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba86ffd640 1 -- 172.21.15.7:0/34126180 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba80003cb0 con 0x7fba88103bc0 2024-09-21T05:59:35.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.496+0000 7fba8fc46640 1 -- 172.21.15.7:0/34126180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba881a0630 con 0x7fba88103bc0 2024-09-21T05:59:35.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.497+0000 7fba86ffd640 1 -- 172.21.15.7:0/34126180 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80035070 con 0x7fba88103bc0 2024-09-21T05:59:35.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.497+0000 7fba8fc46640 1 -- 172.21.15.7:0/34126180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba881a0b10 con 0x7fba88103bc0 2024-09-21T05:59:35.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.499+0000 7fba961ba740 1 Processor -- start 2024-09-21T05:59:35.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.499+0000 7fba961ba740 1 -- start start 2024-09-21T05:59:35.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba86ffd640 1 -- 172.21.15.7:0/34126180 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fba80042030 con 0x7fba88103bc0 2024-09-21T05:59:35.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba961ba740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3012b070 0x55dc304d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba961ba740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc301021b0 0x55dc304d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba961ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 0x55dc304d3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba961ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dc30448ea0 con 0x55dc3010a390 2024-09-21T05:59:35.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba961ba740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55dc304382d0 con 0x55dc3012b070 2024-09-21T05:59:35.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba961ba740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55dc3043c0e0 con 0x55dc301021b0 2024-09-21T05:59:35.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba8d1e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 0x55dc304d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba8d1e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 0x55dc304d3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43830/0 (socket says 172.21.15.7:43830) 2024-09-21T05:59:35.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba8d1e1640 1 -- 172.21.15.7:0/766746956 learned_addr learned my addr 172.21.15.7:0/766746956 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:35.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba8e1e3640 1 --2- 172.21.15.7:0/766746956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3012b070 0x55dc304d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba8d9e2640 1 --2- 172.21.15.7:0/766746956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc301021b0 0x55dc304d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba8d1e1640 1 -- 172.21.15.7:0/766746956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc301021b0 msgr2=0x55dc304d2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba8d1e1640 1 --2- 172.21.15.7:0/766746956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc301021b0 0x55dc304d2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba8d1e1640 1 -- 172.21.15.7:0/766746956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3012b070 msgr2=0x55dc304d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba8d1e1640 1 --2- 172.21.15.7:0/766746956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3012b070 0x55dc304d26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba8d1e1640 1 -- 172.21.15.7:0/766746956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc30196650 con 0x55dc3010a390 2024-09-21T05:59:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.500+0000 7fba8d9e2640 1 --2- 172.21.15.7:0/766746956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc301021b0 0x55dc304d2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.501+0000 7fba8d1e1640 1 --2- 172.21.15.7:0/766746956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 0x55dc304d3120 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00cbd0 tx=0x7fba7c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e92faff2ceec460 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.501+0000 7fba86ffd640 1 --2- 172.21.15.7:0/34126180 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba700b66b0 0x7fba700b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.501+0000 7fba6ffff640 1 -- 172.21.15.7:0/766746956 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c005220 con 0x55dc3010a390 2024-09-21T05:59:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.501+0000 7fba8e1e3640 1 --2- 172.21.15.7:0/34126180 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba700b66b0 0x7fba700b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.501+0000 7fba6ffff640 1 -- 172.21.15.7:0/766746956 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba7c004c50 con 0x55dc3010a390 2024-09-21T05:59:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.501+0000 7fba6ffff640 1 -- 172.21.15.7:0/766746956 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0107b0 con 0x55dc3010a390 2024-09-21T05:59:35.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.501+0000 7fba86ffd640 1 -- 172.21.15.7:0/34126180 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fba80107bc0 con 0x7fba88103bc0 2024-09-21T05:59:35.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.502+0000 7fba961ba740 1 -- 172.21.15.7:0/766746956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 msgr2=0x55dc304d3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.502+0000 7fba961ba740 1 --2- 172.21.15.7:0/766746956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 0x55dc304d3120 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00cbd0 tx=0x7fba7c00e720 comp rx=0 tx=0).stop 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.502+0000 7fba8e1e3640 1 --2- 172.21.15.7:0/34126180 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba700b66b0 0x7fba700b8bc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fba78005fd0 tx=0x7fba78009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.502+0000 7fba961ba740 1 -- 172.21.15.7:0/766746956 shutdown_connections 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.502+0000 7fba961ba740 1 --2- 172.21.15.7:0/766746956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 0x55dc304d3120 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.502+0000 7fba961ba740 1 --2- 172.21.15.7:0/766746956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc301021b0 0x55dc304d2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.502+0000 7fba961ba740 1 --2- 172.21.15.7:0/766746956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3012b070 0x55dc304d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.502+0000 7fba961ba740 1 -- 172.21.15.7:0/766746956 >> 172.21.15.7:0/766746956 conn(0x55dc3011f460 msgr2=0x55dc304d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.502+0000 7fba961ba740 1 -- 172.21.15.7:0/766746956 shutdown_connections 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.502+0000 7fba961ba740 1 -- 172.21.15.7:0/766746956 wait complete. 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.502+0000 7fba961ba740 1 -- start start 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.503+0000 7fba961ba740 1 Processor -- start 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.503+0000 7fba961ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc301021b0 0x55dc304ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.503+0000 7fba961ba740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3010a390 0x55dc304de240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.503+0000 7fba961ba740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc3012b070 0x55dc304ea170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.503+0000 7fba961ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dc30299700 con 0x55dc301021b0 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.503+0000 7fba961ba740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55dc303d3160 con 0x55dc3010a390 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.503+0000 7fba961ba740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55dc304e0e80 con 0x55dc3012b070 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.503+0000 7fba961ba740 10 client.0 _ll_register_callbacks cb 0x55dc303ec9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.503+0000 7fba8d9e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc301021b0 0x55dc304ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.503+0000 7fba8d9e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc301021b0 0x55dc304ddd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43842/0 (socket says 172.21.15.7:43842) 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.503+0000 7fba8d1e1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3010a390 0x55dc304de240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.503+0000 7fba8d9e2640 1 -- 172.21.15.7:0/4096479208 learned_addr learned my addr 172.21.15.7:0/4096479208 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.503+0000 7fba8e1e3640 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc3012b070 0x55dc304ea170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba8d9e2640 1 -- 172.21.15.7:0/4096479208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc3012b070 msgr2=0x55dc304ea170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba8d9e2640 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc3012b070 0x55dc304ea170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba8d9e2640 1 -- 172.21.15.7:0/4096479208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3010a390 msgr2=0x55dc304de240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba8d9e2640 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3010a390 0x55dc304de240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba8d9e2640 1 -- 172.21.15.7:0/4096479208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc30400c90 con 0x55dc301021b0 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba8d1e1640 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3010a390 0x55dc304de240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba8e1e3640 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc3012b070 0x55dc304ea170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba8d9e2640 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc301021b0 0x55dc304ddd00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fba80006010 tx=0x7fba800045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7119301214e2d775 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba6d7fa640 1 -- 172.21.15.7:0/4096479208 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80049070 con 0x55dc301021b0 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba6d7fa640 1 -- 172.21.15.7:0/4096479208 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fba800c9d00 con 0x55dc301021b0 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba961ba740 1 -- 172.21.15.7:0/4096479208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba7c004c50 con 0x55dc301021b0 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba6d7fa640 1 -- 172.21.15.7:0/4096479208 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba800cd200 con 0x55dc301021b0 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba961ba740 10 client.16698 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba961ba740 1 -- 172.21.15.7:0/4096479208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dc304ecb30 con 0x55dc301021b0 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.504+0000 7fba6d7fa640 1 -- 172.21.15.7:0/4096479208 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba7c004c50 con 0x55dc301021b0 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.505+0000 7fba6d7fa640 1 -- 172.21.15.7:0/4096479208 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba800d2190 con 0x55dc301021b0 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.505+0000 7fba961ba740 10 client.16698 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.505+0000 7fba961ba740 10 client.16698 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.505+0000 7fba961ba740 20 client.16698 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.505+0000 7fba961ba740 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55dc300e99f0 0x55dc304f0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.505+0000 7fba961ba740 4 client.16698 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.505+0000 7fba961ba740 1 -- 172.21.15.7:0/4096479208 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc3044adf0 con 0x55dc300e99f0 2024-09-21T05:59:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.505+0000 7fba8d1e1640 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55dc300e99f0 0x55dc304f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.505+0000 7fba6d7fa640 10 client.16698 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.505+0000 7fba8d1e1640 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55dc300e99f0 0x55dc304f0030 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b0d272f1cda9d285 server_cookie=af952959954981aa in_seq=0 out_seq=0 2024-09-21T05:59:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.506+0000 7fba6d7fa640 1 -- 172.21.15.7:0/4096479208 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dc3044adf0 con 0x55dc300e99f0 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.506+0000 7fba6d7fa640 10 client.16698 handle_command_reply: tid=0 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.506+0000 7fba961ba740 1 client.16698 shutdown 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.506+0000 7fba961ba740 1 -- 172.21.15.7:0/4096479208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc301021b0 msgr2=0x55dc304ddd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.506+0000 7fba961ba740 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc301021b0 0x55dc304ddd00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fba80006010 tx=0x7fba800045a0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.507+0000 7fba961ba740 1 -- 172.21.15.7:0/4096479208 shutdown_connections 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.507+0000 7fba961ba740 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55dc300e99f0 0x55dc304f0030 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.507+0000 7fba961ba740 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc3012b070 0x55dc304ea170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.507+0000 7fba961ba740 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3010a390 0x55dc304de240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.507+0000 7fba961ba740 1 --2- 172.21.15.7:0/4096479208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc301021b0 0x55dc304ddd00 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.507+0000 7fba6d7fa640 0 client.16698 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.507+0000 7fba961ba740 1 -- 172.21.15.7:0/4096479208 >> 172.21.15.7:0/4096479208 conn(0x55dc3011f460 msgr2=0x55dc304d5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.507+0000 7fba961ba740 1 -- 172.21.15.7:0/4096479208 shutdown_connections 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.507+0000 7fba961ba740 1 -- 172.21.15.7:0/4096479208 wait complete. 2024-09-21T05:59:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.507+0000 7fba961ba740 20 client.16698 trim_cache size 0 max 16384 2024-09-21T05:59:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.520+0000 7fba961ba740 1 Processor -- start 2024-09-21T05:59:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.520+0000 7fba961ba740 1 -- start start 2024-09-21T05:59:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.520+0000 7fba961ba740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc301021b0 0x55dc304de1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.520+0000 7fba961ba740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc3010a390 0x55dc304cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.520+0000 7fba961ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3012b070 0x55dc304d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.520+0000 7fba961ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba881b1d90 con 0x55dc3012b070 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.520+0000 7fba961ba740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fba881af660 con 0x55dc301021b0 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.520+0000 7fba961ba740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fba881ad4b0 con 0x55dc3010a390 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.520+0000 7fba8e1e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3012b070 0x55dc304d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.520+0000 7fba8e1e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3012b070 0x55dc304d0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43858/0 (socket says 172.21.15.7:43858) 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.521+0000 7fba8e1e3640 1 -- 172.21.15.7:0/3777060115 learned_addr learned my addr 172.21.15.7:0/3777060115 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.521+0000 7fba8d9e2640 1 --2- 172.21.15.7:0/3777060115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc301021b0 0x55dc304de1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.521+0000 7fba8d1e1640 1 --2- 172.21.15.7:0/3777060115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc3010a390 0x55dc304cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.521+0000 7fba8e1e3640 1 -- 172.21.15.7:0/3777060115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc3010a390 msgr2=0x55dc304cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.521+0000 7fba8e1e3640 1 --2- 172.21.15.7:0/3777060115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc3010a390 0x55dc304cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.521+0000 7fba8e1e3640 1 -- 172.21.15.7:0/3777060115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc301021b0 msgr2=0x55dc304de1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.521+0000 7fba8e1e3640 1 --2- 172.21.15.7:0/3777060115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc301021b0 0x55dc304de1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.521+0000 7fba8e1e3640 1 -- 172.21.15.7:0/3777060115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc304d4c60 con 0x55dc3012b070 2024-09-21T05:59:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.521+0000 7fba8e1e3640 1 --2- 172.21.15.7:0/3777060115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3012b070 0x55dc304d0100 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fba780092f0 tx=0x7fba78016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c434354f6e74a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.521+0000 7fba6f7fe640 1 -- 172.21.15.7:0/3777060115 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba780219b0 con 0x55dc3012b070 2024-09-21T05:59:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.521+0000 7fba6f7fe640 1 -- 172.21.15.7:0/3777060115 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba7801d420 con 0x55dc3012b070 2024-09-21T05:59:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.521+0000 7fba6f7fe640 1 -- 172.21.15.7:0/3777060115 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78029640 con 0x55dc3012b070 2024-09-21T05:59:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.522+0000 7fba961ba740 1 -- 172.21.15.7:0/3777060115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3012b070 msgr2=0x55dc304d0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.522+0000 7fba961ba740 1 --2- 172.21.15.7:0/3777060115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3012b070 0x55dc304d0100 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fba780092f0 tx=0x7fba78016000 comp rx=0 tx=0).stop 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.522+0000 7fba961ba740 1 -- 172.21.15.7:0/3777060115 shutdown_connections 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.522+0000 7fba961ba740 1 --2- 172.21.15.7:0/3777060115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3012b070 0x55dc304d0100 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.522+0000 7fba961ba740 1 --2- 172.21.15.7:0/3777060115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc3010a390 0x55dc304cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.522+0000 7fba961ba740 1 --2- 172.21.15.7:0/3777060115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc301021b0 0x55dc304de1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.522+0000 7fba961ba740 1 -- 172.21.15.7:0/3777060115 >> 172.21.15.7:0/3777060115 conn(0x55dc3011f460 msgr2=0x55dc304ddab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.522+0000 7fba961ba740 1 -- 172.21.15.7:0/3777060115 shutdown_connections 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.522+0000 7fba961ba740 1 -- 172.21.15.7:0/3777060115 wait complete. 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.522+0000 7fba961ba740 1 -- start start 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.522+0000 7fba961ba740 1 Processor -- start 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.523+0000 7fba961ba740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc301021b0 0x55dc304e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.523+0000 7fba961ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 0x55dc304e1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.523+0000 7fba961ba740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3012b070 0x55dc304e26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.523+0000 7fba961ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba881adb20 con 0x55dc3010a390 2024-09-21T05:59:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.523+0000 7fba961ba740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fba881aef90 con 0x55dc3012b070 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.523+0000 7fba961ba740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fba881ae1f0 con 0x55dc301021b0 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.523+0000 7fba961ba740 10 client.0 _ll_register_callbacks cb 0x7fba80003e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.523+0000 7fba8d1e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 0x55dc304e1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.523+0000 7fba8d1e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 0x55dc304e1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43862/0 (socket says 172.21.15.7:43862) 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.523+0000 7fba8d1e1640 1 -- 172.21.15.7:0/3363195066 learned_addr learned my addr 172.21.15.7:0/3363195066 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.523+0000 7fba8e1e3640 1 --2- 172.21.15.7:0/3363195066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3012b070 0x55dc304e26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.523+0000 7fba8d9e2640 1 --2- 172.21.15.7:0/3363195066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc301021b0 0x55dc304e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba8d1e1640 1 -- 172.21.15.7:0/3363195066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc301021b0 msgr2=0x55dc304e6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba8d1e1640 1 --2- 172.21.15.7:0/3363195066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc301021b0 0x55dc304e6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba8d1e1640 1 -- 172.21.15.7:0/3363195066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3012b070 msgr2=0x55dc304e26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba8d1e1640 1 --2- 172.21.15.7:0/3363195066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3012b070 0x55dc304e26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba8d1e1640 1 -- 172.21.15.7:0/3363195066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc305599f0 con 0x55dc3010a390 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba8d1e1640 1 --2- 172.21.15.7:0/3363195066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 0x55dc304e1fc0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fba7c005780 tx=0x7fba7c00cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4681eb60dd048c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:35.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba6d7fa640 1 -- 172.21.15.7:0/3363195066 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c032060 con 0x55dc3010a390 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba6d7fa640 1 -- 172.21.15.7:0/3363195066 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fba7c004bf0 con 0x55dc3010a390 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba961ba740 1 -- 172.21.15.7:0/3363195066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba7801d420 con 0x55dc3010a390 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba6d7fa640 1 -- 172.21.15.7:0/3363195066 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba7c004e10 con 0x55dc3010a390 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba961ba740 10 client.16704 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba961ba740 1 -- 172.21.15.7:0/3363195066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dc3055ab40 con 0x55dc3010a390 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.524+0000 7fba6d7fa640 1 -- 172.21.15.7:0/3363195066 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba7801d420 con 0x55dc3010a390 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.525+0000 7fba6d7fa640 1 -- 172.21.15.7:0/3363195066 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba7c0289b0 con 0x55dc3010a390 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.525+0000 7fba961ba740 10 client.16704 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.525+0000 7fba961ba740 10 client.16704 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.525+0000 7fba961ba740 20 client.16704 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.525+0000 7fba961ba740 1 --2- 172.21.15.7:0/3363195066 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55dc300beda0 0x55dc3055cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.525+0000 7fba961ba740 4 client.16704 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.525+0000 7fba961ba740 1 -- 172.21.15.7:0/3363195066 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dc304468a0 con 0x55dc300beda0 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.525+0000 7fba8d9e2640 1 --2- 172.21.15.7:0/3363195066 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55dc300beda0 0x55dc3055cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.525+0000 7fba8d9e2640 1 --2- 172.21.15.7:0/3363195066 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55dc300beda0 0x55dc3055cff0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d52353b5b00fbfba server_cookie=b3bd359e472460e0 in_seq=0 out_seq=0 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.525+0000 7fba6d7fa640 10 client.16704 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba6d7fa640 1 -- 172.21.15.7:0/3363195066 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dc304468a0 con 0x55dc300beda0 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba6d7fa640 10 client.16704 handle_command_reply: tid=0 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba961ba740 1 client.16704 shutdown 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba961ba740 1 -- 172.21.15.7:0/3363195066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 msgr2=0x55dc304e1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba961ba740 1 --2- 172.21.15.7:0/3363195066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 0x55dc304e1fc0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fba7c005780 tx=0x7fba7c00cfc0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba961ba740 1 -- 172.21.15.7:0/3363195066 shutdown_connections 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba961ba740 1 --2- 172.21.15.7:0/3363195066 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55dc300beda0 0x55dc3055cff0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba961ba740 1 --2- 172.21.15.7:0/3363195066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc3010a390 0x55dc304e1fc0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba961ba740 1 --2- 172.21.15.7:0/3363195066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dc3012b070 0x55dc304e26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba961ba740 1 --2- 172.21.15.7:0/3363195066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55dc301021b0 0x55dc304e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba6d7fa640 0 client.16704 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba961ba740 1 -- 172.21.15.7:0/3363195066 >> 172.21.15.7:0/3363195066 conn(0x55dc3011f460 msgr2=0x55dc304d36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba961ba740 1 -- 172.21.15.7:0/3363195066 shutdown_connections 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba961ba740 1 -- 172.21.15.7:0/3363195066 wait complete. 2024-09-21T05:59:35.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.526+0000 7fba961ba740 20 client.16704 trim_cache size 0 max 16384 2024-09-21T05:59:35.533 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:59:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.527+0000 7fba8fc46640 1 -- 172.21.15.7:0/34126180 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba700b66b0 msgr2=0x7fba700b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.527+0000 7fba8fc46640 1 --2- 172.21.15.7:0/34126180 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba700b66b0 0x7fba700b8bc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fba78005fd0 tx=0x7fba78009600 comp rx=0 tx=0).stop 2024-09-21T05:59:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.527+0000 7fba8fc46640 1 -- 172.21.15.7:0/34126180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88103bc0 msgr2=0x7fba8819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.527+0000 7fba8fc46640 1 --2- 172.21.15.7:0/34126180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88103bc0 0x7fba8819a4f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fba80005940 tx=0x7fba800042f0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.527+0000 7fba8fc46640 1 -- 172.21.15.7:0/34126180 shutdown_connections 2024-09-21T05:59:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.527+0000 7fba8fc46640 1 --2- 172.21.15.7:0/34126180 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba700b66b0 0x7fba700b8bc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.527+0000 7fba8fc46640 1 --2- 172.21.15.7:0/34126180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba88109e00 0x7fba8819fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.527+0000 7fba8fc46640 1 --2- 172.21.15.7:0/34126180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba881094b0 0x7fba8819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.527+0000 7fba8fc46640 1 --2- 172.21.15.7:0/34126180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88103bc0 0x7fba8819a4f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.527+0000 7fba8fc46640 1 -- 172.21.15.7:0/34126180 >> 172.21.15.7:0/34126180 conn(0x7fba8807b910 msgr2=0x7fba881075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:35.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.527+0000 7fba8fc46640 1 -- 172.21.15.7:0/34126180 shutdown_connections 2024-09-21T05:59:35.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:35.527+0000 7fba8fc46640 1 -- 172.21.15.7:0/34126180 wait complete. 2024-09-21T05:59:36.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:35 smithi007 ceph-mon[30983]: pgmap v489: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-09-21T05:59:36.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:35 smithi027 ceph-mon[34364]: pgmap v489: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-09-21T05:59:36.248 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T05:59:36.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:35 smithi119 ceph-mon[34833]: pgmap v489: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-09-21T05:59:36.505 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:36.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.979+0000 7f7255343640 1 -- 172.21.15.7:0/766202111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7250102a80 msgr2=0x7f7250102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:36.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.979+0000 7f7255343640 1 --2- 172.21.15.7:0/766202111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7250102a80 0x7f7250102e90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7240009900 tx=0x7f724002a410 comp rx=0 tx=0).stop 2024-09-21T05:59:36.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.980+0000 7f7255343640 1 -- 172.21.15.7:0/766202111 shutdown_connections 2024-09-21T05:59:36.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.980+0000 7f7255343640 1 --2- 172.21.15.7:0/766202111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7250108d10 0x7f725010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.980+0000 7f7255343640 1 --2- 172.21.15.7:0/766202111 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72501083c0 0x7f72501087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.980+0000 7f7255343640 1 --2- 172.21.15.7:0/766202111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7250102a80 0x7f7250102e90 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.980+0000 7f7255343640 1 -- 172.21.15.7:0/766202111 >> 172.21.15.7:0/766202111 conn(0x7f7250079740 msgr2=0x7f7250079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:36.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.980+0000 7f7255343640 1 -- 172.21.15.7:0/766202111 shutdown_connections 2024-09-21T05:59:36.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.980+0000 7f7255343640 1 -- 172.21.15.7:0/766202111 wait complete. 2024-09-21T05:59:36.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.980+0000 7f7255343640 1 Processor -- start 2024-09-21T05:59:36.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f7255343640 1 -- start start 2024-09-21T05:59:36.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f7255343640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7250102a80 0x7f725019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:36.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f7255343640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72501083c0 0x7f725019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:36.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f7255343640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7250108d10 0x7f725019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:36.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f7255343640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7250112980 con 0x7f72501083c0 2024-09-21T05:59:36.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f7255343640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7250112800 con 0x7f7250108d10 2024-09-21T05:59:36.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f7255343640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7250112b00 con 0x7f7250102a80 2024-09-21T05:59:36.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f724e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72501083c0 0x7f725019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:36.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f724e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72501083c0 0x7f725019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43880/0 (socket says 172.21.15.7:43880) 2024-09-21T05:59:36.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f724e7fc640 1 -- 172.21.15.7:0/843137279 learned_addr learned my addr 172.21.15.7:0/843137279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:36.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f724effd640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7250102a80 0x7f725019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:36.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f724f7fe640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7250108d10 0x7f725019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:36.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f724e7fc640 1 -- 172.21.15.7:0/843137279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7250102a80 msgr2=0x7f725019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:36.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f724e7fc640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7250102a80 0x7f725019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f724e7fc640 1 -- 172.21.15.7:0/843137279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7250108d10 msgr2=0x7f725019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:36.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f724e7fc640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7250108d10 0x7f725019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.981+0000 7f724e7fc640 1 -- 172.21.15.7:0/843137279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72501a0450 con 0x7f72501083c0 2024-09-21T05:59:36.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.982+0000 7f724e7fc640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72501083c0 0x7f725019aa80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f724400d770 tx=0x7f724400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:36.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.982+0000 7f7237fff640 1 -- 172.21.15.7:0/843137279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7244017070 con 0x7f72501083c0 2024-09-21T05:59:36.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.982+0000 7f7255343640 1 -- 172.21.15.7:0/843137279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72501a0740 con 0x7f72501083c0 2024-09-21T05:59:36.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.982+0000 7f7237fff640 1 -- 172.21.15.7:0/843137279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7244009c30 con 0x7f72501083c0 2024-09-21T05:59:36.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.982+0000 7f7237fff640 1 -- 172.21.15.7:0/843137279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724400f620 con 0x7f72501083c0 2024-09-21T05:59:36.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.982+0000 7f7255343640 1 -- 172.21.15.7:0/843137279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7250104150 con 0x7f72501083c0 2024-09-21T05:59:36.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f725b8b7740 1 Processor -- start 2024-09-21T05:59:36.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f7237fff640 1 -- 172.21.15.7:0/843137279 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f724401a070 con 0x7f72501083c0 2024-09-21T05:59:36.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f725b8b7740 1 -- start start 2024-09-21T05:59:36.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f725b8b7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c23e070 0x55cc2c5e56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f725b8b7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c2151b0 0x55cc2c5e5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f725b8b7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c21d390 0x55cc2c5e6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f725b8b7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cc2c55bea0 con 0x55cc2c21d390 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f725b8b7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55cc2c54b2d0 con 0x55cc2c2151b0 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f725b8b7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55cc2c54f0e0 con 0x55cc2c23e070 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f724e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c21d390 0x55cc2c5e6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f724effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c2151b0 0x55cc2c5e5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f724effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c2151b0 0x55cc2c5e5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:60780/0 (socket says 172.21.15.7:60780) 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f724effd640 1 -- 172.21.15.7:0/3382670153 learned_addr learned my addr 172.21.15.7:0/3382670153 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f724e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c21d390 0x55cc2c5e6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43886/0 (socket says 172.21.15.7:43886) 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.985+0000 7f724f7fe640 1 --2- 172.21.15.7:0/3382670153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c23e070 0x55cc2c5e56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.986+0000 7f724e7fc640 1 -- 172.21.15.7:0/3382670153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c23e070 msgr2=0x55cc2c5e56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.986+0000 7f724e7fc640 1 --2- 172.21.15.7:0/3382670153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c23e070 0x55cc2c5e56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.986+0000 7f724e7fc640 1 -- 172.21.15.7:0/3382670153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c2151b0 msgr2=0x55cc2c5e5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:36.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.986+0000 7f724e7fc640 1 --2- 172.21.15.7:0/3382670153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c2151b0 0x55cc2c5e5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.986+0000 7f724e7fc640 1 -- 172.21.15.7:0/3382670153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc2c2a9650 con 0x55cc2c21d390 2024-09-21T05:59:36.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.986+0000 7f724effd640 1 --2- 172.21.15.7:0/3382670153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c2151b0 0x55cc2c5e5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:36.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.986+0000 7f7237fff640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f72380b6680 0x7f72380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:36.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.986+0000 7f724f7fe640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f72380b6680 0x7f72380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:36.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.986+0000 7f724e7fc640 1 --2- 172.21.15.7:0/3382670153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c21d390 0x55cc2c5e6120 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f72440e4a40 tx=0x7f72440ef970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f12a182040ae5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:36.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.986+0000 7f7237fff640 1 -- 172.21.15.7:0/843137279 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f72440e7270 con 0x7f72501083c0 2024-09-21T05:59:36.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.986+0000 7f72357fa640 1 -- 172.21.15.7:0/3382670153 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7244021070 con 0x55cc2c21d390 2024-09-21T05:59:36.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.986+0000 7f72357fa640 1 -- 172.21.15.7:0/3382670153 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72440acc50 con 0x55cc2c21d390 2024-09-21T05:59:36.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.986+0000 7f72357fa640 1 -- 172.21.15.7:0/3382670153 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72440a8fe0 con 0x55cc2c21d390 2024-09-21T05:59:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.987+0000 7f725b8b7740 1 -- 172.21.15.7:0/3382670153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c21d390 msgr2=0x55cc2c5e6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.987+0000 7f724f7fe640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f72380b6680 0x7f72380b8b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7248005fd0 tx=0x7f72480096e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.987+0000 7f725b8b7740 1 --2- 172.21.15.7:0/3382670153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c21d390 0x55cc2c5e6120 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f72440e4a40 tx=0x7f72440ef970 comp rx=0 tx=0).stop 2024-09-21T05:59:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.987+0000 7f725b8b7740 1 -- 172.21.15.7:0/3382670153 shutdown_connections 2024-09-21T05:59:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.987+0000 7f725b8b7740 1 --2- 172.21.15.7:0/3382670153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c21d390 0x55cc2c5e6120 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.987+0000 7f725b8b7740 1 --2- 172.21.15.7:0/3382670153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c2151b0 0x55cc2c5e5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.987+0000 7f725b8b7740 1 --2- 172.21.15.7:0/3382670153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c23e070 0x55cc2c5e56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.987+0000 7f725b8b7740 1 -- 172.21.15.7:0/3382670153 >> 172.21.15.7:0/3382670153 conn(0x55cc2c232460 msgr2=0x55cc2c5e3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.987+0000 7f725b8b7740 1 -- 172.21.15.7:0/3382670153 shutdown_connections 2024-09-21T05:59:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.987+0000 7f725b8b7740 1 -- 172.21.15.7:0/3382670153 wait complete. 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.988+0000 7f725b8b7740 1 -- start start 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.988+0000 7f725b8b7740 1 Processor -- start 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.988+0000 7f725b8b7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c2151b0 0x55cc2c5f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.988+0000 7f725b8b7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c21d390 0x55cc2c5f1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.988+0000 7f725b8b7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c23e070 0x55cc2c5fd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.988+0000 7f725b8b7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cc2c3ac700 con 0x55cc2c23e070 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.988+0000 7f725b8b7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55cc2c4e6160 con 0x55cc2c21d390 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.988+0000 7f725b8b7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55cc2c5f3e80 con 0x55cc2c2151b0 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.988+0000 7f725b8b7740 10 client.0 _ll_register_callbacks cb 0x55cc2c4ff9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.988+0000 7f724f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c23e070 0x55cc2c5fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.988+0000 7f724effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c2151b0 0x55cc2c5f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.988+0000 7f724f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c23e070 0x55cc2c5fd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43900/0 (socket says 172.21.15.7:43900) 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f724f7fe640 1 -- 172.21.15.7:0/1080200407 learned_addr learned my addr 172.21.15.7:0/1080200407 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f724e7fc640 1 --2- 172.21.15.7:0/1080200407 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c21d390 0x55cc2c5f1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f724f7fe640 1 -- 172.21.15.7:0/1080200407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c2151b0 msgr2=0x55cc2c5f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f724f7fe640 1 --2- 172.21.15.7:0/1080200407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c2151b0 0x55cc2c5f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f724f7fe640 1 -- 172.21.15.7:0/1080200407 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c21d390 msgr2=0x55cc2c5f1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f724f7fe640 1 --2- 172.21.15.7:0/1080200407 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c21d390 0x55cc2c5f1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f724f7fe640 1 -- 172.21.15.7:0/1080200407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc2c513c90 con 0x55cc2c23e070 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f724f7fe640 1 --2- 172.21.15.7:0/1080200407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c23e070 0x55cc2c5fd170 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f724801d850 tx=0x7f7248004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489356c8e0014225 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f7232ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f7232ff5640 1 -- 172.21.15.7:0/1080200407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724801e820 con 0x55cc2c23e070 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f7232ff5640 1 -- 172.21.15.7:0/1080200407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f724801e9c0 con 0x55cc2c23e070 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f725b8b7740 1 -- 172.21.15.7:0/1080200407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72440acc50 con 0x55cc2c23e070 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f7232ff5640 1 -- 172.21.15.7:0/1080200407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f724801ebc0 con 0x55cc2c23e070 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f725b8b7740 10 client.16716 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.989+0000 7f725b8b7740 1 -- 172.21.15.7:0/1080200407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc2c5ffb90 con 0x55cc2c23e070 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.990+0000 7f7232ff5640 1 -- 172.21.15.7:0/1080200407 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72440acc50 con 0x55cc2c23e070 2024-09-21T05:59:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.990+0000 7f7232ff5640 1 -- 172.21.15.7:0/1080200407 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f724800f040 con 0x55cc2c23e070 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.990+0000 7f725b8b7740 10 client.16716 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.990+0000 7f725b8b7740 10 client.16716 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.990+0000 7f725b8b7740 20 client.16716 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.990+0000 7f725b8b7740 1 --2- 172.21.15.7:0/1080200407 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55cc2c1fc9f0 0x55cc2c603000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.990+0000 7f725b8b7740 4 client.16716 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.990+0000 7f725b8b7740 1 -- 172.21.15.7:0/1080200407 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc2c55ddf0 con 0x55cc2c1fc9f0 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.990+0000 7f724effd640 1 --2- 172.21.15.7:0/1080200407 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55cc2c1fc9f0 0x55cc2c603000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.991+0000 7f724effd640 1 --2- 172.21.15.7:0/1080200407 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55cc2c1fc9f0 0x55cc2c603000 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57f82b1eebceb4cb server_cookie=931bf1a352bce634 in_seq=0 out_seq=0 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.991+0000 7f7232ff5640 10 client.16716 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f7232ff5640 1 -- 172.21.15.7:0/1080200407 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc2c55ddf0 con 0x55cc2c1fc9f0 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f7232ff5640 10 client.16716 handle_command_reply: tid=0 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f725b8b7740 1 client.16716 shutdown 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f725b8b7740 1 -- 172.21.15.7:0/1080200407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c23e070 msgr2=0x55cc2c5fd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:36.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f725b8b7740 1 --2- 172.21.15.7:0/1080200407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c23e070 0x55cc2c5fd170 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f724801d850 tx=0x7f7248004a40 comp rx=0 tx=0).stop 2024-09-21T05:59:36.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f725b8b7740 1 -- 172.21.15.7:0/1080200407 shutdown_connections 2024-09-21T05:59:36.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f725b8b7740 1 --2- 172.21.15.7:0/1080200407 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55cc2c1fc9f0 0x55cc2c603000 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f725b8b7740 1 --2- 172.21.15.7:0/1080200407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c23e070 0x55cc2c5fd170 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f7232ff5640 0 client.16716 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:36.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f725b8b7740 1 --2- 172.21.15.7:0/1080200407 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c21d390 0x55cc2c5f1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f725b8b7740 1 --2- 172.21.15.7:0/1080200407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c2151b0 0x55cc2c5f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f725b8b7740 1 -- 172.21.15.7:0/1080200407 >> 172.21.15.7:0/1080200407 conn(0x55cc2c232460 msgr2=0x55cc2c5e8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:36.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f725b8b7740 1 -- 172.21.15.7:0/1080200407 shutdown_connections 2024-09-21T05:59:36.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f725b8b7740 1 -- 172.21.15.7:0/1080200407 wait complete. 2024-09-21T05:59:36.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:36.992+0000 7f725b8b7740 20 client.16716 trim_cache size 0 max 16384 2024-09-21T05:59:37.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.005+0000 7f725b8b7740 1 Processor -- start 2024-09-21T05:59:37.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.005+0000 7f725b8b7740 1 -- start start 2024-09-21T05:59:37.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f725b8b7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c1fc9f0 0x55cc2c5f1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:37.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f725b8b7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c2151b0 0x55cc2c5fd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:37.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f725b8b7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c21d390 0x55cc2c5edf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:37.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f725b8b7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f72501b41d0 con 0x55cc2c2151b0 2024-09-21T05:59:37.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f725b8b7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f72501b1aa0 con 0x55cc2c21d390 2024-09-21T05:59:37.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f725b8b7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f72501af910 con 0x55cc2c1fc9f0 2024-09-21T05:59:37.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f724e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c2151b0 0x55cc2c5fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:37.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f724e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c2151b0 0x55cc2c5fd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43914/0 (socket says 172.21.15.7:43914) 2024-09-21T05:59:37.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f724e7fc640 1 -- 172.21.15.7:0/3204662791 learned_addr learned my addr 172.21.15.7:0/3204662791 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:37.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f724effd640 1 --2- 172.21.15.7:0/3204662791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c1fc9f0 0x55cc2c5f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:37.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f724e7fc640 1 -- 172.21.15.7:0/3204662791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c1fc9f0 msgr2=0x55cc2c5f1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:37.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f724e7fc640 1 --2- 172.21.15.7:0/3204662791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c1fc9f0 0x55cc2c5f1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f724e7fc640 1 -- 172.21.15.7:0/3204662791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c21d390 msgr2=0x55cc2c5edf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:37.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f724e7fc640 1 --2- 172.21.15.7:0/3204662791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c21d390 0x55cc2c5edf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f724e7fc640 1 -- 172.21.15.7:0/3204662791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc2c5e7990 con 0x55cc2c2151b0 2024-09-21T05:59:37.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f724e7fc640 1 --2- 172.21.15.7:0/3204662791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c2151b0 0x55cc2c5fd070 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f72440e4af0 tx=0x7f72440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b68d9a053acca22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:37.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f7234ff9640 1 -- 172.21.15.7:0/3204662791 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7244021040 con 0x55cc2c2151b0 2024-09-21T05:59:37.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f7234ff9640 1 -- 172.21.15.7:0/3204662791 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72440eab90 con 0x55cc2c2151b0 2024-09-21T05:59:37.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.006+0000 7f7234ff9640 1 -- 172.21.15.7:0/3204662791 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72440ac8b0 con 0x55cc2c2151b0 2024-09-21T05:59:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.007+0000 7f725b8b7740 1 -- 172.21.15.7:0/3204662791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c2151b0 msgr2=0x55cc2c5fd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.007+0000 7f725b8b7740 1 --2- 172.21.15.7:0/3204662791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c2151b0 0x55cc2c5fd070 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f72440e4af0 tx=0x7f72440057f0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.007+0000 7f725b8b7740 1 -- 172.21.15.7:0/3204662791 shutdown_connections 2024-09-21T05:59:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.007+0000 7f725b8b7740 1 --2- 172.21.15.7:0/3204662791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c2151b0 0x55cc2c5fd070 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.007+0000 7f725b8b7740 1 --2- 172.21.15.7:0/3204662791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c21d390 0x55cc2c5edf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.007+0000 7f725b8b7740 1 --2- 172.21.15.7:0/3204662791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c1fc9f0 0x55cc2c5f1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.007+0000 7f725b8b7740 1 -- 172.21.15.7:0/3204662791 >> 172.21.15.7:0/3204662791 conn(0x55cc2c232460 msgr2=0x55cc2c5f0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:37.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.007+0000 7f725b8b7740 1 -- 172.21.15.7:0/3204662791 shutdown_connections 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.007+0000 7f725b8b7740 1 -- 172.21.15.7:0/3204662791 wait complete. 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f725b8b7740 1 -- start start 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f725b8b7740 1 Processor -- start 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f725b8b7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c1fc9f0 0x55cc2c5f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f725b8b7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c2151b0 0x55cc2c5f6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f725b8b7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c21d390 0x55cc2c666a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f725b8b7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f72501aff60 con 0x55cc2c1fc9f0 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f725b8b7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f72501b13d0 con 0x55cc2c2151b0 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f725b8b7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f72501b0630 con 0x55cc2c21d390 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f725b8b7740 10 client.0 _ll_register_callbacks cb 0x7f724801d500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f724effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c1fc9f0 0x55cc2c5f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f724effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c1fc9f0 0x55cc2c5f5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43918/0 (socket says 172.21.15.7:43918) 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f724effd640 1 -- 172.21.15.7:0/828734555 learned_addr learned my addr 172.21.15.7:0/828734555 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f724e7fc640 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c2151b0 0x55cc2c5f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f724f7fe640 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c21d390 0x55cc2c666a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f724effd640 1 -- 172.21.15.7:0/828734555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c21d390 msgr2=0x55cc2c666a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f724effd640 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c21d390 0x55cc2c666a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f724effd640 1 -- 172.21.15.7:0/828734555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c2151b0 msgr2=0x55cc2c5f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f724effd640 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c2151b0 0x55cc2c5f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f724effd640 1 -- 172.21.15.7:0/828734555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc2c667070 con 0x55cc2c1fc9f0 2024-09-21T05:59:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.008+0000 7f724e7fc640 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c2151b0 0x55cc2c5f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.009+0000 7f724effd640 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c1fc9f0 0x55cc2c5f5ae0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7240006010 tx=0x7f7240004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fc19928ff60829 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.009+0000 7f7232ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.009+0000 7f7232ff5640 1 -- 172.21.15.7:0/828734555 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240035040 con 0x55cc2c1fc9f0 2024-09-21T05:59:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.009+0000 7f7232ff5640 1 -- 172.21.15.7:0/828734555 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f7240005240 con 0x55cc2c1fc9f0 2024-09-21T05:59:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.009+0000 7f725b8b7740 1 -- 172.21.15.7:0/828734555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72440eab90 con 0x55cc2c1fc9f0 2024-09-21T05:59:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.009+0000 7f7232ff5640 1 -- 172.21.15.7:0/828734555 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f72400044d0 con 0x55cc2c1fc9f0 2024-09-21T05:59:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.009+0000 7f725b8b7740 10 client.16722 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.009+0000 7f725b8b7740 1 -- 172.21.15.7:0/828734555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc2c66e4f0 con 0x55cc2c1fc9f0 2024-09-21T05:59:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.009+0000 7f7232ff5640 1 -- 172.21.15.7:0/828734555 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72440eab90 con 0x55cc2c1fc9f0 2024-09-21T05:59:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.009+0000 7f7232ff5640 1 -- 172.21.15.7:0/828734555 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7240003680 con 0x55cc2c1fc9f0 2024-09-21T05:59:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.009+0000 7f725b8b7740 10 client.16722 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.009+0000 7f725b8b7740 10 client.16722 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:59:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.009+0000 7f725b8b7740 20 client.16722 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.010+0000 7f725b8b7740 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55cc2c23e070 0x55cc2c670d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.010+0000 7f725b8b7740 4 client.16722 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:59:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.010+0000 7f725b8b7740 1 -- 172.21.15.7:0/828734555 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cc2c5598a0 con 0x55cc2c23e070 2024-09-21T05:59:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.010+0000 7f724e7fc640 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55cc2c23e070 0x55cc2c670d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.010+0000 7f724e7fc640 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55cc2c23e070 0x55cc2c670d00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=152233dc1c6ce8ec server_cookie=4695186532960b31 in_seq=0 out_seq=0 2024-09-21T05:59:37.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.010+0000 7f7232ff5640 10 client.16722 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.010+0000 7f7232ff5640 1 -- 172.21.15.7:0/828734555 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cc2c5598a0 con 0x55cc2c23e070 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.010+0000 7f7232ff5640 10 client.16722 handle_command_reply: tid=0 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.010+0000 7f725b8b7740 1 client.16722 shutdown 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f725b8b7740 1 -- 172.21.15.7:0/828734555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c1fc9f0 msgr2=0x55cc2c5f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f725b8b7740 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c1fc9f0 0x55cc2c5f5ae0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7240006010 tx=0x7f7240004090 comp rx=0 tx=0).stop 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f725b8b7740 1 -- 172.21.15.7:0/828734555 shutdown_connections 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f725b8b7740 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55cc2c23e070 0x55cc2c670d00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f725b8b7740 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cc2c21d390 0x55cc2c666a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f725b8b7740 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55cc2c2151b0 0x55cc2c5f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f725b8b7740 1 --2- 172.21.15.7:0/828734555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc2c1fc9f0 0x55cc2c5f5ae0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f725b8b7740 1 -- 172.21.15.7:0/828734555 >> 172.21.15.7:0/828734555 conn(0x55cc2c232460 msgr2=0x55cc2c5ef1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f7232ff5640 0 client.16722 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f725b8b7740 1 -- 172.21.15.7:0/828734555 shutdown_connections 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f725b8b7740 1 -- 172.21.15.7:0/828734555 wait complete. 2024-09-21T05:59:37.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f725b8b7740 20 client.16722 trim_cache size 0 max 16384 2024-09-21T05:59:37.018 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:59:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f7255343640 1 -- 172.21.15.7:0/843137279 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f72380b6680 msgr2=0x7f72380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f7255343640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f72380b6680 0x7f72380b8b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7248005fd0 tx=0x7f72480096e0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f7255343640 1 -- 172.21.15.7:0/843137279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72501083c0 msgr2=0x7f725019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f7255343640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72501083c0 0x7f725019aa80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f724400d770 tx=0x7f724400dc30 comp rx=0 tx=0).stop 2024-09-21T05:59:37.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f7255343640 1 -- 172.21.15.7:0/843137279 shutdown_connections 2024-09-21T05:59:37.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f7255343640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f72380b6680 0x7f72380b8b90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f7255343640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72501083c0 0x7f725019aa80 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f7255343640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7250108d10 0x7f725019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f7255343640 1 --2- 172.21.15.7:0/843137279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7250102a80 0x7f725019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:37.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.011+0000 7f7255343640 1 -- 172.21.15.7:0/843137279 >> 172.21.15.7:0/843137279 conn(0x7f7250079740 msgr2=0x7f7250101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:37.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.012+0000 7f7255343640 1 -- 172.21.15.7:0/843137279 shutdown_connections 2024-09-21T05:59:37.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:37.012+0000 7f7255343640 1 -- 172.21.15.7:0/843137279 wait complete. 2024-09-21T05:59:37.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T05:59:37.961 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:38.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:37 smithi007 ceph-mon[30983]: pgmap v490: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T05:59:38.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:37 smithi027 ceph-mon[34364]: pgmap v490: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T05:59:38.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:37 smithi119 ceph-mon[34833]: pgmap v490: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T05:59:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.448+0000 7f7f364c6640 1 -- 172.21.15.7:0/2842947210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f30107c50 msgr2=0x7f7f30110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.448+0000 7f7f364c6640 1 --2- 172.21.15.7:0/2842947210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f30107c50 0x7f7f30110670 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009ca0 tx=0x7f7f2802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.448+0000 7f7f364c6640 1 -- 172.21.15.7:0/2842947210 shutdown_connections 2024-09-21T05:59:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.448+0000 7f7f364c6640 1 --2- 172.21.15.7:0/2842947210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f30107c50 0x7f7f30110670 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.448+0000 7f7f364c6640 1 --2- 172.21.15.7:0/2842947210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f30107300 0x7f7f30107710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.448+0000 7f7f364c6640 1 --2- 172.21.15.7:0/2842947210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f30102100 0x7f7f30102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.448+0000 7f7f364c6640 1 -- 172.21.15.7:0/2842947210 >> 172.21.15.7:0/2842947210 conn(0x7f7f30079e40 msgr2=0x7f7f3007a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.448+0000 7f7f364c6640 1 -- 172.21.15.7:0/2842947210 shutdown_connections 2024-09-21T05:59:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.448+0000 7f7f364c6640 1 -- 172.21.15.7:0/2842947210 wait complete. 2024-09-21T05:59:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.448+0000 7f7f364c6640 1 Processor -- start 2024-09-21T05:59:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.448+0000 7f7f364c6640 1 -- start start 2024-09-21T05:59:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f364c6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f30102100 0x7f7f3019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f364c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f30107300 0x7f7f3019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f364c6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f30107c50 0x7f7f301a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f364c6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7f30113b00 con 0x7f7f30107300 2024-09-21T05:59:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f364c6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7f30113980 con 0x7f7f30107c50 2024-09-21T05:59:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f364c6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7f30113c80 con 0x7f7f30102100 2024-09-21T05:59:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f2f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f30107300 0x7f7f3019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f2f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f30107300 0x7f7f3019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43938/0 (socket says 172.21.15.7:43938) 2024-09-21T05:59:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f2f7fe640 1 -- 172.21.15.7:0/2225087617 learned_addr learned my addr 172.21.15.7:0/2225087617 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f2ffff640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f30102100 0x7f7f3019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f34a63640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f30107c50 0x7f7f301a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f2f7fe640 1 -- 172.21.15.7:0/2225087617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f30102100 msgr2=0x7f7f3019c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f30102100 0x7f7f3019c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f2f7fe640 1 -- 172.21.15.7:0/2225087617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f30107c50 msgr2=0x7f7f301a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f30107c50 0x7f7f301a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f2f7fe640 1 -- 172.21.15.7:0/2225087617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f301a25c0 con 0x7f7f30107300 2024-09-21T05:59:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.449+0000 7f7f34a63640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f30107c50 0x7f7f301a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.450+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f30107300 0x7f7f3019cbf0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400d740 tx=0x7f7f2400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.450+0000 7f7f2d7fa640 1 -- 172.21.15.7:0/2225087617 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24017070 con 0x7f7f30107300 2024-09-21T05:59:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.450+0000 7f7f2d7fa640 1 -- 172.21.15.7:0/2225087617 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f2400de50 con 0x7f7f30107300 2024-09-21T05:59:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.450+0000 7f7f2d7fa640 1 -- 172.21.15.7:0/2225087617 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2400f620 con 0x7f7f30107300 2024-09-21T05:59:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.450+0000 7f7f364c6640 1 -- 172.21.15.7:0/2225087617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f301a28b0 con 0x7f7f30107300 2024-09-21T05:59:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.450+0000 7f7f364c6640 1 -- 172.21.15.7:0/2225087617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f301a9010 con 0x7f7f30107300 2024-09-21T05:59:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f3ca3a740 1 Processor -- start 2024-09-21T05:59:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f3ca3a740 1 -- start start 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f2d7fa640 1 -- 172.21.15.7:0/2225087617 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7f2401a070 con 0x7f7f30107300 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f3ca3a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba3d070 0x55f3cbde46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f3ca3a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba141b0 0x55f3cbde4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f3ca3a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba1c390 0x55f3cbde5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f3ca3a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f3cbd5aea0 con 0x55f3cba1c390 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f3ca3a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f3cbd4a2d0 con 0x55f3cba3d070 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f3ca3a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f3cbd4e0e0 con 0x55f3cba141b0 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f2f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba1c390 0x55f3cbde5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f2f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba1c390 0x55f3cbde5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43944/0 (socket says 172.21.15.7:43944) 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f2f7fe640 1 -- 172.21.15.7:0/4081614756 learned_addr learned my addr 172.21.15.7:0/4081614756 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f34a63640 1 --2- 172.21.15.7:0/4081614756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba3d070 0x55f3cbde46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.453+0000 7f7f2ffff640 1 --2- 172.21.15.7:0/4081614756 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba141b0 0x55f3cbde4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f2f7fe640 1 -- 172.21.15.7:0/4081614756 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba141b0 msgr2=0x55f3cbde4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/4081614756 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba141b0 0x55f3cbde4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f2f7fe640 1 -- 172.21.15.7:0/4081614756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba3d070 msgr2=0x55f3cbde46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/4081614756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba3d070 0x55f3cbde46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f2f7fe640 1 -- 172.21.15.7:0/4081614756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3cbaa8650 con 0x55f3cba1c390 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f34a63640 1 --2- 172.21.15.7:0/4081614756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba3d070 0x55f3cbde46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f2ffff640 1 --2- 172.21.15.7:0/4081614756 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba141b0 0x55f3cbde4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f2d7fa640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7f180b6680 0x7f7f180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/4081614756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba1c390 0x55f3cbde5120 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7f240e47f0 tx=0x7f7f240ef910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67a4f05b5cd600b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f34a63640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7f180b6680 0x7f7f180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f2d7fa640 1 -- 172.21.15.7:0/2225087617 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f7f240e70b0 con 0x7f7f30107300 2024-09-21T05:59:38.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f167fc640 1 -- 172.21.15.7:0/4081614756 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f240a95d0 con 0x55f3cba1c390 2024-09-21T05:59:38.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f167fc640 1 -- 172.21.15.7:0/4081614756 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f240aca90 con 0x55f3cba1c390 2024-09-21T05:59:38.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.454+0000 7f7f167fc640 1 -- 172.21.15.7:0/4081614756 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f240ac6f0 con 0x55f3cba1c390 2024-09-21T05:59:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.455+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/4081614756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba1c390 msgr2=0x55f3cbde5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.455+0000 7f7f34a63640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7f180b6680 0x7f7f180b8b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7f28004af0 tx=0x7f7f28005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.455+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/4081614756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba1c390 0x55f3cbde5120 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7f240e47f0 tx=0x7f7f240ef910 comp rx=0 tx=0).stop 2024-09-21T05:59:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.455+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/4081614756 shutdown_connections 2024-09-21T05:59:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.455+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/4081614756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba1c390 0x55f3cbde5120 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.455+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/4081614756 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba141b0 0x55f3cbde4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.455+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/4081614756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba3d070 0x55f3cbde46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.455+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/4081614756 >> 172.21.15.7:0/4081614756 conn(0x55f3cba31460 msgr2=0x55f3cbde2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.455+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/4081614756 shutdown_connections 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.455+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/4081614756 wait complete. 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.456+0000 7f7f3ca3a740 1 -- start start 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.456+0000 7f7f3ca3a740 1 Processor -- start 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f3ca3a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba141b0 0x55f3cbdefd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f3ca3a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba1c390 0x55f3cbdf02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f3ca3a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba3d070 0x55f3cbdfc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f3ca3a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f3cbbab700 con 0x55f3cba3d070 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f3ca3a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f3cbce5160 con 0x55f3cba141b0 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f3ca3a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f3cbdf2e80 con 0x55f3cba1c390 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f34a63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba3d070 0x55f3cbdfc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f3ca3a740 10 client.0 _ll_register_callbacks cb 0x55f3cbcfe9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f34a63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba3d070 0x55f3cbdfc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43950/0 (socket says 172.21.15.7:43950) 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f34a63640 1 -- 172.21.15.7:0/3733484840 learned_addr learned my addr 172.21.15.7:0/3733484840 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f2ffff640 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba141b0 0x55f3cbdefd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba1c390 0x55f3cbdf02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f34a63640 1 -- 172.21.15.7:0/3733484840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba1c390 msgr2=0x55f3cbdf02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f34a63640 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba1c390 0x55f3cbdf02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f34a63640 1 -- 172.21.15.7:0/3733484840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba141b0 msgr2=0x55f3cbdefd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f34a63640 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba141b0 0x55f3cbdefd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f34a63640 1 -- 172.21.15.7:0/3733484840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3cbd12c90 con 0x55f3cba3d070 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba1c390 0x55f3cbdf02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f34a63640 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba3d070 0x55f3cbdfc1a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7f28035000 tx=0x7f7f2802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b0c2873aa49b07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.457+0000 7f7f0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f0f7fe640 1 -- 172.21.15.7:0/3733484840 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f28003d00 con 0x55f3cba3d070 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f0f7fe640 1 -- 172.21.15.7:0/3733484840 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f7f28004040 con 0x55f3cba3d070 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/3733484840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f240aca90 con 0x55f3cba3d070 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f0f7fe640 1 -- 172.21.15.7:0/3733484840 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7f28004240 con 0x55f3cba3d070 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f3ca3a740 10 client.16734 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/3733484840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f3cbdfeb00 con 0x55f3cba3d070 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f0f7fe640 1 -- 172.21.15.7:0/3733484840 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f240aca90 con 0x55f3cba3d070 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f0f7fe640 1 -- 172.21.15.7:0/3733484840 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7f28051070 con 0x55f3cba3d070 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f3ca3a740 10 client.16734 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f3ca3a740 10 client.16734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f3ca3a740 20 client.16734 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3cb9fb9f0 0x55f3cbe01ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f3ca3a740 4 client.16734 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.458+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/3733484840 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3cbd5cdf0 con 0x55f3cb9fb9f0 2024-09-21T05:59:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.459+0000 7f7f2ffff640 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3cb9fb9f0 0x55f3cbe01ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.459+0000 7f7f2ffff640 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3cb9fb9f0 0x55f3cbe01ff0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=969ca7bdb3211cf5 server_cookie=1720cee0795907c5 in_seq=0 out_seq=0 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.459+0000 7f7f0f7fe640 10 client.16734 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f0f7fe640 1 -- 172.21.15.7:0/3733484840 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f3cbd5cdf0 con 0x55f3cb9fb9f0 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f0f7fe640 10 client.16734 handle_command_reply: tid=0 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f3ca3a740 1 client.16734 shutdown 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/3733484840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba3d070 msgr2=0x55f3cbdfc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba3d070 0x55f3cbdfc1a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7f28035000 tx=0x7f7f2802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/3733484840 shutdown_connections 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3cb9fb9f0 0x55f3cbe01ff0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba3d070 0x55f3cbdfc1a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba1c390 0x55f3cbdf02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/3733484840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba141b0 0x55f3cbdefd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/3733484840 >> 172.21.15.7:0/3733484840 conn(0x55f3cba31460 msgr2=0x55f3cbde7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:38.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f0f7fe640 0 client.16734 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:38.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/3733484840 shutdown_connections 2024-09-21T05:59:38.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/3733484840 wait complete. 2024-09-21T05:59:38.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.460+0000 7f7f3ca3a740 20 client.16734 trim_cache size 0 max 16384 2024-09-21T05:59:38.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.473+0000 7f7f3ca3a740 1 Processor -- start 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.473+0000 7f7f3ca3a740 1 -- start start 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f3ca3a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 0x55f3cbdf0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f3ca3a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba1c390 0x55f3cbdfc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f3ca3a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba3d070 0x55f3cbdecf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f3ca3a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7f301b40a0 con 0x55f3cba141b0 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f3ca3a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7f301b1970 con 0x55f3cba1c390 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f3ca3a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7f301af7c0 con 0x55f3cba3d070 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 0x55f3cbdf0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 0x55f3cbdf0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43962/0 (socket says 172.21.15.7:43962) 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f2ffff640 1 -- 172.21.15.7:0/272330001 learned_addr learned my addr 172.21.15.7:0/272330001 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/272330001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba1c390 0x55f3cbdfc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f2ffff640 1 -- 172.21.15.7:0/272330001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba3d070 msgr2=0x55f3cbdecf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f34a63640 1 --2- 172.21.15.7:0/272330001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba3d070 0x55f3cbdecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f2ffff640 1 --2- 172.21.15.7:0/272330001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba3d070 0x55f3cbdecf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f2ffff640 1 -- 172.21.15.7:0/272330001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba1c390 msgr2=0x55f3cbdfc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f2ffff640 1 --2- 172.21.15.7:0/272330001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba1c390 0x55f3cbdfc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f2ffff640 1 -- 172.21.15.7:0/272330001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3cbdf24a0 con 0x55f3cba141b0 2024-09-21T05:59:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f34a63640 1 --2- 172.21.15.7:0/272330001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba3d070 0x55f3cbdecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/272330001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba1c390 0x55f3cbdfc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.474+0000 7f7f2ffff640 1 --2- 172.21.15.7:0/272330001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 0x55f3cbdf0220 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7f20004700 tx=0x7f7f20014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac12ba3f52bd617 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.475+0000 7f7f15ffb640 1 -- 172.21.15.7:0/272330001 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f200140d0 con 0x55f3cba141b0 2024-09-21T05:59:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.475+0000 7f7f15ffb640 1 -- 172.21.15.7:0/272330001 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f20014270 con 0x55f3cba141b0 2024-09-21T05:59:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.475+0000 7f7f15ffb640 1 -- 172.21.15.7:0/272330001 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2001d460 con 0x55f3cba141b0 2024-09-21T05:59:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.475+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/272330001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 msgr2=0x55f3cbdf0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.475+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/272330001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 0x55f3cbdf0220 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7f20004700 tx=0x7f7f20014840 comp rx=0 tx=0).stop 2024-09-21T05:59:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.475+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/272330001 shutdown_connections 2024-09-21T05:59:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.475+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/272330001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba3d070 0x55f3cbdecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.475+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/272330001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba1c390 0x55f3cbdfc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.475+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/272330001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 0x55f3cbdf0220 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.475+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/272330001 >> 172.21.15.7:0/272330001 conn(0x55f3cba31460 msgr2=0x55f3cbdefb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.476+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/272330001 shutdown_connections 2024-09-21T05:59:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.476+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/272330001 wait complete. 2024-09-21T05:59:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.476+0000 7f7f3ca3a740 1 -- start start 2024-09-21T05:59:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.476+0000 7f7f3ca3a740 1 Processor -- start 2024-09-21T05:59:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.476+0000 7f7f3ca3a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 0x55f3cbdf87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.476+0000 7f7f3ca3a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba1c390 0x55f3cbdf3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.476+0000 7f7f3ca3a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba3d070 0x55f3cbdf41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f3ca3a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7f301afe30 con 0x55f3cba141b0 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f3ca3a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7f301b12a0 con 0x55f3cba3d070 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f3ca3a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7f301b0500 con 0x55f3cba1c390 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f3ca3a740 10 client.0 _ll_register_callbacks cb 0x7f7f28009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 0x55f3cbdf87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 0x55f3cbdf87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43978/0 (socket says 172.21.15.7:43978) 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f2ffff640 1 -- 172.21.15.7:0/2944735229 learned_addr learned my addr 172.21.15.7:0/2944735229 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba1c390 0x55f3cbdf3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f34a63640 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba3d070 0x55f3cbdf41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f2ffff640 1 -- 172.21.15.7:0/2944735229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba1c390 msgr2=0x55f3cbdf3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f2ffff640 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba1c390 0x55f3cbdf3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f2ffff640 1 -- 172.21.15.7:0/2944735229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba3d070 msgr2=0x55f3cbdf41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f2ffff640 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba3d070 0x55f3cbdf41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f2ffff640 1 -- 172.21.15.7:0/2944735229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3cbdf4880 con 0x55f3cba141b0 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba1c390 0x55f3cbdf3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f2ffff640 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 0x55f3cbdf87f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7f20009fd0 tx=0x7f7f20015f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4a027aacac24d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f0f7fe640 1 -- 172.21.15.7:0/2944735229 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f20021040 con 0x55f3cba141b0 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f0f7fe640 1 -- 172.21.15.7:0/2944735229 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f7f20004250 con 0x55f3cba141b0 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.477+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/2944735229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f20014270 con 0x55f3cba141b0 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.478+0000 7f7f0f7fe640 1 -- 172.21.15.7:0/2944735229 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7f20004450 con 0x55f3cba141b0 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.478+0000 7f7f3ca3a740 10 client.16740 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.478+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/2944735229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f3cbe6c750 con 0x55f3cba141b0 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.478+0000 7f7f0f7fe640 1 -- 172.21.15.7:0/2944735229 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f20014270 con 0x55f3cba141b0 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.478+0000 7f7f0f7fe640 1 -- 172.21.15.7:0/2944735229 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7f20005190 con 0x55f3cba141b0 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.478+0000 7f7f3ca3a740 10 client.16740 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.478+0000 7f7f3ca3a740 10 client.16740 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.478+0000 7f7f3ca3a740 20 client.16740 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.478+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3cb9d0da0 0x55f3cbe6ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.478+0000 7f7f3ca3a740 4 client.16740 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:59:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.478+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/2944735229 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3cbd588a0 con 0x55f3cb9d0da0 2024-09-21T05:59:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.478+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3cb9d0da0 0x55f3cbe6ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f2f7fe640 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3cb9d0da0 0x55f3cbe6ee90 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d85c7ffa603d9c55 server_cookie=9bef4edc888a0cbb in_seq=0 out_seq=0 2024-09-21T05:59:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f0f7fe640 10 client.16740 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f0f7fe640 1 -- 172.21.15.7:0/2944735229 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3cbd588a0 con 0x55f3cb9d0da0 2024-09-21T05:59:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f0f7fe640 10 client.16740 handle_command_reply: tid=0 2024-09-21T05:59:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f3ca3a740 1 client.16740 shutdown 2024-09-21T05:59:38.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/2944735229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 msgr2=0x55f3cbdf87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 0x55f3cbdf87f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7f20009fd0 tx=0x7f7f20015f60 comp rx=0 tx=0).stop 2024-09-21T05:59:38.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/2944735229 shutdown_connections 2024-09-21T05:59:38.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3cb9d0da0 0x55f3cbe6ee90 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3cba3d070 0x55f3cbdf41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3cba1c390 0x55f3cbdf3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f3ca3a740 1 --2- 172.21.15.7:0/2944735229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3cba141b0 0x55f3cbdf87f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/2944735229 >> 172.21.15.7:0/2944735229 conn(0x55f3cba31460 msgr2=0x55f3cbde56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:38.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.479+0000 7f7f0f7fe640 0 client.16740 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:38.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/2944735229 shutdown_connections 2024-09-21T05:59:38.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f3ca3a740 1 -- 172.21.15.7:0/2944735229 wait complete. 2024-09-21T05:59:38.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f3ca3a740 20 client.16740 trim_cache size 0 max 16384 2024-09-21T05:59:38.486 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:59:38.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f364c6640 1 -- 172.21.15.7:0/2225087617 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7f180b6680 msgr2=0x7f7f180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f364c6640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7f180b6680 0x7f7f180b8b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7f28004af0 tx=0x7f7f28005c30 comp rx=0 tx=0).stop 2024-09-21T05:59:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f364c6640 1 -- 172.21.15.7:0/2225087617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f30107300 msgr2=0x7f7f3019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f364c6640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f30107300 0x7f7f3019cbf0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400d740 tx=0x7f7f2400dc00 comp rx=0 tx=0).stop 2024-09-21T05:59:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f364c6640 1 -- 172.21.15.7:0/2225087617 shutdown_connections 2024-09-21T05:59:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f364c6640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7f180b6680 0x7f7f180b8b90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f364c6640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f30107300 0x7f7f3019cbf0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f364c6640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f30107c50 0x7f7f301a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f364c6640 1 --2- 172.21.15.7:0/2225087617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f30102100 0x7f7f3019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f364c6640 1 -- 172.21.15.7:0/2225087617 >> 172.21.15.7:0/2225087617 conn(0x7f7f30079e40 msgr2=0x7f7f301052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.480+0000 7f7f364c6640 1 -- 172.21.15.7:0/2225087617 shutdown_connections 2024-09-21T05:59:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:38.481+0000 7f7f364c6640 1 -- 172.21.15.7:0/2225087617 wait complete. 2024-09-21T05:59:40.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:39 smithi027 ceph-mon[34364]: pgmap v491: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:59:40.250 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T05:59:40.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T05:59:40.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:39 smithi007 ceph-mon[30983]: pgmap v491: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:59:40.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:39 smithi119 ceph-mon[34833]: pgmap v491: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:59:40.525 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:41.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.017+0000 7f21c9370640 1 -- 172.21.15.7:0/2370040464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4108d20 msgr2=0x7f21c410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:41.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.017+0000 7f21c9370640 1 --2- 172.21.15.7:0/2370040464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4108d20 0x7f21c410f550 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009ca0 tx=0x7f21bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.017+0000 7f21c9370640 1 -- 172.21.15.7:0/2370040464 shutdown_connections 2024-09-21T05:59:41.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.017+0000 7f21c9370640 1 --2- 172.21.15.7:0/2370040464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4108d20 0x7f21c410f550 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.017+0000 7f21c9370640 1 --2- 172.21.15.7:0/2370040464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21c41083d0 0x7f21c41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.017+0000 7f21c9370640 1 --2- 172.21.15.7:0/2370040464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21c4102ae0 0x7f21c4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.017+0000 7f21c9370640 1 -- 172.21.15.7:0/2370040464 >> 172.21.15.7:0/2370040464 conn(0x7f21c4079760 msgr2=0x7f21c4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.017+0000 7f21c9370640 1 -- 172.21.15.7:0/2370040464 shutdown_connections 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.017+0000 7f21c9370640 1 -- 172.21.15.7:0/2370040464 wait complete. 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.017+0000 7f21c9370640 1 Processor -- start 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c9370640 1 -- start start 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c9370640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21c4102ae0 0x7f21c419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c9370640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21c41083d0 0x7f21c419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c9370640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4108d20 0x7f21c419fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c9370640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21c4113ab0 con 0x7f21c4108d20 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c9370640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f21c4113930 con 0x7f21c4102ae0 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c9370640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f21c4113c30 con 0x7f21c41083d0 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4108d20 0x7f21c419fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4108d20 0x7f21c419fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39854/0 (socket says 172.21.15.7:39854) 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c37fe640 1 -- 172.21.15.7:0/1846691696 learned_addr learned my addr 172.21.15.7:0/1846691696 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c27fc640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21c41083d0 0x7f21c419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21c4102ae0 0x7f21c419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c37fe640 1 -- 172.21.15.7:0/1846691696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21c41083d0 msgr2=0x7f21c419a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c37fe640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21c41083d0 0x7f21c419a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c37fe640 1 -- 172.21.15.7:0/1846691696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21c4102ae0 msgr2=0x7f21c419a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c37fe640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21c4102ae0 0x7f21c419a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.018+0000 7f21c37fe640 1 -- 172.21.15.7:0/1846691696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c41a0290 con 0x7f21c4108d20 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.019+0000 7f21c37fe640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4108d20 0x7f21c419fc20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0098d0 tx=0x7f21bc0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.019+0000 7f21bbfff640 1 -- 172.21.15.7:0/1846691696 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc003b70 con 0x7f21c4108d20 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.019+0000 7f21bbfff640 1 -- 172.21.15.7:0/1846691696 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21bc003d10 con 0x7f21c4108d20 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.019+0000 7f21c9370640 1 -- 172.21.15.7:0/1846691696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c41a0520 con 0x7f21c4108d20 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.019+0000 7f21bbfff640 1 -- 172.21.15.7:0/1846691696 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc02f9d0 con 0x7f21c4108d20 2024-09-21T05:59:41.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.019+0000 7f21c9370640 1 -- 172.21.15.7:0/1846691696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c41a0a60 con 0x7f21c4108d20 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.022+0000 7f21cf8e4740 1 Processor -- start 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.022+0000 7f21bbfff640 1 -- 172.21.15.7:0/1846691696 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f21bc02fb70 con 0x7f21c4108d20 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.022+0000 7f21cf8e4740 1 -- start start 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.022+0000 7f21cf8e4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a98d350 0x55d45ad34430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.022+0000 7f21cf8e4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a964490 0x55d45ad34970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.022+0000 7f21cf8e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a96c670 0x55d45ad34eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.022+0000 7f21cf8e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d45acaae60 con 0x55d45a96c670 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.022+0000 7f21cf8e4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d45ac9a290 con 0x55d45a98d350 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.022+0000 7f21cf8e4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d45ac9e0a0 con 0x55d45a964490 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a96c670 0x55d45ad34eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21c2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a964490 0x55d45ad34970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a96c670 0x55d45ad34eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39858/0 (socket says 172.21.15.7:39858) 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21c27fc640 1 -- 172.21.15.7:0/2635270012 learned_addr learned my addr 172.21.15.7:0/2635270012 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:41.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21c27fc640 1 --2- 172.21.15.7:0/2635270012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a98d350 0x55d45ad34430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21bbfff640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f21b00b66b0 0x7f21b00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21c2ffd640 1 -- 172.21.15.7:0/2635270012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a98d350 msgr2=0x55d45ad34430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/2635270012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a98d350 0x55d45ad34430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21c2ffd640 1 -- 172.21.15.7:0/2635270012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a96c670 msgr2=0x55d45ad34eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/2635270012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a96c670 0x55d45ad34eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21c2ffd640 1 -- 172.21.15.7:0/2635270012 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d45a9f8930 con 0x55d45a964490 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21c27fc640 1 --2- 172.21.15.7:0/2635270012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a96c670 0x55d45ad34eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21c37fe640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f21b00b66b0 0x7f21b00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21bbfff640 1 -- 172.21.15.7:0/1846691696 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f21bc108820 con 0x7f21c4108d20 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.023+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/2635270012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a964490 0x55d45ad34970 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009c00 tx=0x7f21b4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf45c6457ea3b1fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.024+0000 7f21b97fa640 1 -- 172.21.15.7:0/2635270012 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4004230 con 0x55d45a964490 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.024+0000 7f21c37fe640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f21b00b66b0 0x7f21b00b8bc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0ce3f0 tx=0x7f21bc0095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.024+0000 7f21b97fa640 1 -- 172.21.15.7:0/2635270012 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21b40043d0 con 0x55d45a964490 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.024+0000 7f21b97fa640 1 -- 172.21.15.7:0/2635270012 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4004c60 con 0x55d45a964490 2024-09-21T05:59:41.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.024+0000 7f21cf8e4740 1 -- 172.21.15.7:0/2635270012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a964490 msgr2=0x55d45ad34970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:41.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.024+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/2635270012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a964490 0x55d45ad34970 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009c00 tx=0x7f21b4011810 comp rx=0 tx=0).stop 2024-09-21T05:59:41.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 -- 172.21.15.7:0/2635270012 shutdown_connections 2024-09-21T05:59:41.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/2635270012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a96c670 0x55d45ad34eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/2635270012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a964490 0x55d45ad34970 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/2635270012 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a98d350 0x55d45ad34430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 -- 172.21.15.7:0/2635270012 >> 172.21.15.7:0/2635270012 conn(0x55d45a981740 msgr2=0x55d45ad32320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:41.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 -- 172.21.15.7:0/2635270012 shutdown_connections 2024-09-21T05:59:41.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 -- 172.21.15.7:0/2635270012 wait complete. 2024-09-21T05:59:41.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 -- start start 2024-09-21T05:59:41.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 Processor -- start 2024-09-21T05:59:41.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 0x55d45ad40050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a96c670 0x55d45ad405f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a98d350 0x55d45ad4bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d45aafb890 con 0x55d45a964490 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d45ac34d40 con 0x55d45a98d350 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d45ad42c10 con 0x55d45a96c670 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21cf8e4740 10 client.0 _ll_register_callbacks cb 0x55d45ac98c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.025+0000 7f21c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 0x55d45ad40050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 0x55d45ad40050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39868/0 (socket says 172.21.15.7:39868) 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21c27fc640 1 -- 172.21.15.7:0/1353805915 learned_addr learned my addr 172.21.15.7:0/1353805915 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21c27fc640 1 --2- 172.21.15.7:0/1353805915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a98d350 0x55d45ad4bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/1353805915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a96c670 0x55d45ad405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21c27fc640 1 -- 172.21.15.7:0/1353805915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a96c670 msgr2=0x55d45ad405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21c27fc640 1 --2- 172.21.15.7:0/1353805915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a96c670 0x55d45ad405f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21c27fc640 1 -- 172.21.15.7:0/1353805915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a98d350 msgr2=0x55d45ad4bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:41.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21c27fc640 1 --2- 172.21.15.7:0/1353805915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a98d350 0x55d45ad4bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21c27fc640 1 -- 172.21.15.7:0/1353805915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d45ad4c540 con 0x55d45a964490 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21c27fc640 1 --2- 172.21.15.7:0/1353805915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 0x55d45ad40050 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f21ac005bd0 tx=0x7f21ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186c1037db89b2e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21aa7fc640 1 -- 172.21.15.7:0/1353805915 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00e5c0 con 0x55d45a964490 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21aa7fc640 1 -- 172.21.15.7:0/1353805915 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f21ac00e760 con 0x55d45a964490 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1353805915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21b40043d0 con 0x55d45a964490 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21aa7fc640 1 -- 172.21.15.7:0/1353805915 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21ac02a050 con 0x55d45a964490 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21cf8e4740 10 client.16752 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.026+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1353805915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d45ad4ee70 con 0x55d45a964490 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.027+0000 7f21aa7fc640 1 -- 172.21.15.7:0/1353805915 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21b40043d0 con 0x55d45a964490 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.027+0000 7f21aa7fc640 1 -- 172.21.15.7:0/1353805915 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f21ac023060 con 0x55d45a964490 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.027+0000 7f21cf8e4740 10 client.16752 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.027+0000 7f21cf8e4740 10 client.16752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.027+0000 7f21cf8e4740 20 client.16752 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.027+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/1353805915 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d45a94bcd0 0x55d45ad52400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.027+0000 7f21cf8e4740 4 client.16752 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.027+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1353805915 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d45acacdb0 con 0x55d45a94bcd0 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.027+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/1353805915 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d45a94bcd0 0x55d45ad52400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.028+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/1353805915 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d45a94bcd0 0x55d45ad52400 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=626fc30e25203943 server_cookie=ecb99bcf6867876 in_seq=0 out_seq=0 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.028+0000 7f21aa7fc640 10 client.16752 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21aa7fc640 1 -- 172.21.15.7:0/1353805915 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d45acacdb0 con 0x55d45a94bcd0 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21aa7fc640 10 client.16752 handle_command_reply: tid=0 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21cf8e4740 1 client.16752 shutdown 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1353805915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 msgr2=0x55d45ad40050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/1353805915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 0x55d45ad40050 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f21ac005bd0 tx=0x7f21ac004730 comp rx=0 tx=0).stop 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1353805915 shutdown_connections 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/1353805915 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d45a94bcd0 0x55d45ad52400 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/1353805915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a98d350 0x55d45ad4bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/1353805915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a96c670 0x55d45ad405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/1353805915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 0x55d45ad40050 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1353805915 >> 172.21.15.7:0/1353805915 conn(0x55d45a981740 msgr2=0x55d45ad37610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:41.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21aa7fc640 0 client.16752 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:41.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1353805915 shutdown_connections 2024-09-21T05:59:41.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1353805915 wait complete. 2024-09-21T05:59:41.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.029+0000 7f21cf8e4740 20 client.16752 trim_cache size 0 max 16384 2024-09-21T05:59:41.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.047+0000 7f21cf8e4740 1 Processor -- start 2024-09-21T05:59:41.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.047+0000 7f21cf8e4740 1 -- start start 2024-09-21T05:59:41.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.047+0000 7f21cf8e4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a964490 0x55d45ad3e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.047+0000 7f21cf8e4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a96c670 0x55d45ad3ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.047+0000 7f21cf8e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a98d350 0x55d45ad39540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.047+0000 7f21cf8e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21c41b1c50 con 0x55d45a98d350 2024-09-21T05:59:41.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.047+0000 7f21cf8e4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f21c41af520 con 0x55d45a964490 2024-09-21T05:59:41.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.047+0000 7f21cf8e4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f21c41ad370 con 0x55d45a96c670 2024-09-21T05:59:41.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a98d350 0x55d45ad39540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a98d350 0x55d45ad39540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39870/0 (socket says 172.21.15.7:39870) 2024-09-21T05:59:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21c27fc640 1 -- 172.21.15.7:0/2708555656 learned_addr learned my addr 172.21.15.7:0/2708555656 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21c27fc640 1 --2- 172.21.15.7:0/2708555656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a964490 0x55d45ad3e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/2708555656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a96c670 0x55d45ad3ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21c27fc640 1 -- 172.21.15.7:0/2708555656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a96c670 msgr2=0x55d45ad3ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21c27fc640 1 --2- 172.21.15.7:0/2708555656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a96c670 0x55d45ad3ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21c27fc640 1 -- 172.21.15.7:0/2708555656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a964490 msgr2=0x55d45ad3e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21c27fc640 1 --2- 172.21.15.7:0/2708555656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a964490 0x55d45ad3e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21c27fc640 1 -- 172.21.15.7:0/2708555656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d45ad3e350 con 0x55d45a98d350 2024-09-21T05:59:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21c27fc640 1 --2- 172.21.15.7:0/2708555656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a98d350 0x55d45ad39540 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f21ac025fd0 tx=0x7f21ac025430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7b1f575ca28d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21b8ff9640 1 -- 172.21.15.7:0/2708555656 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac015020 con 0x55d45a98d350 2024-09-21T05:59:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21b8ff9640 1 -- 172.21.15.7:0/2708555656 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21ac0254e0 con 0x55d45a98d350 2024-09-21T05:59:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.048+0000 7f21b8ff9640 1 -- 172.21.15.7:0/2708555656 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00ecb0 con 0x55d45a98d350 2024-09-21T05:59:41.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.049+0000 7f21cf8e4740 1 -- 172.21.15.7:0/2708555656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a98d350 msgr2=0x55d45ad39540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:41.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.049+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/2708555656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a98d350 0x55d45ad39540 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f21ac025fd0 tx=0x7f21ac025430 comp rx=0 tx=0).stop 2024-09-21T05:59:41.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.049+0000 7f21cf8e4740 1 -- 172.21.15.7:0/2708555656 shutdown_connections 2024-09-21T05:59:41.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.049+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/2708555656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a98d350 0x55d45ad39540 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.049+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/2708555656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a96c670 0x55d45ad3ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.049+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/2708555656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a964490 0x55d45ad3e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.049+0000 7f21cf8e4740 1 -- 172.21.15.7:0/2708555656 >> 172.21.15.7:0/2708555656 conn(0x55d45a981740 msgr2=0x55d45ad3af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:41.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.049+0000 7f21cf8e4740 1 -- 172.21.15.7:0/2708555656 shutdown_connections 2024-09-21T05:59:41.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.049+0000 7f21cf8e4740 1 -- 172.21.15.7:0/2708555656 wait complete. 2024-09-21T05:59:41.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.050+0000 7f21cf8e4740 1 -- start start 2024-09-21T05:59:41.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.050+0000 7f21cf8e4740 1 Processor -- start 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.050+0000 7f21cf8e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 0x55d45ad445a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.050+0000 7f21cf8e4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a96c670 0x55d45ad44ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.050+0000 7f21cf8e4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a98d350 0x55d45adbbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.050+0000 7f21cf8e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21c41ad9e0 con 0x55d45a964490 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.050+0000 7f21cf8e4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f21c41aee50 con 0x55d45a96c670 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.050+0000 7f21cf8e4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f21c41ae0b0 con 0x55d45a98d350 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.050+0000 7f21cf8e4740 10 client.0 _ll_register_callbacks cb 0x7f21ac00ad10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.050+0000 7f21c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 0x55d45ad445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.050+0000 7f21c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 0x55d45ad445a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39876/0 (socket says 172.21.15.7:39876) 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.050+0000 7f21c27fc640 1 -- 172.21.15.7:0/1768240268 learned_addr learned my addr 172.21.15.7:0/1768240268 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.050+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/1768240268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a96c670 0x55d45ad44ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21c27fc640 1 -- 172.21.15.7:0/1768240268 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a98d350 msgr2=0x55d45adbbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21c27fc640 1 --2- 172.21.15.7:0/1768240268 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a98d350 0x55d45adbbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21c27fc640 1 -- 172.21.15.7:0/1768240268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a96c670 msgr2=0x55d45ad44ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21c27fc640 1 --2- 172.21.15.7:0/1768240268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a96c670 0x55d45ad44ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21c27fc640 1 -- 172.21.15.7:0/1768240268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d45adbc330 con 0x55d45a964490 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/1768240268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a96c670 0x55d45ad44ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21c27fc640 1 --2- 172.21.15.7:0/1768240268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 0x55d45ad445a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f21ac005bd0 tx=0x7f21ac00a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476a1b18708aae6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21aa7fc640 1 -- 172.21.15.7:0/1768240268 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac03e060 con 0x55d45a964490 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21aa7fc640 1 -- 172.21.15.7:0/1768240268 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f21ac005240 con 0x55d45a964490 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1768240268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21ac0254e0 con 0x55d45a964490 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21aa7fc640 1 -- 172.21.15.7:0/1768240268 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21ac015030 con 0x55d45a964490 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21cf8e4740 10 client.16758 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1768240268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d45adbd620 con 0x55d45a964490 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.051+0000 7f21aa7fc640 1 -- 172.21.15.7:0/1768240268 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21ac0254e0 con 0x55d45a964490 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.052+0000 7f21aa7fc640 1 -- 172.21.15.7:0/1768240268 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f21ac023050 con 0x55d45a964490 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.052+0000 7f21cf8e4740 10 client.16758 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:41.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.052+0000 7f21cf8e4740 10 client.16758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:41.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.052+0000 7f21cf8e4740 20 client.16758 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:41.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.052+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/1768240268 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d45a921080 0x55d45adbfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:41.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.052+0000 7f21cf8e4740 4 client.16758 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T05:59:41.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.052+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1768240268 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d45aca8860 con 0x55d45a921080 2024-09-21T05:59:41.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.052+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/1768240268 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d45a921080 0x55d45adbfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:41.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.053+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/1768240268 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d45a921080 0x55d45adbfdb0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=495d2a0a6172d863 server_cookie=d78511f964ad4c2e in_seq=0 out_seq=0 2024-09-21T05:59:41.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.053+0000 7f21aa7fc640 10 client.16758 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:41.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.054+0000 7f21aa7fc640 1 -- 172.21.15.7:0/1768240268 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d45aca8860 con 0x55d45a921080 2024-09-21T05:59:41.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.054+0000 7f21aa7fc640 10 client.16758 handle_command_reply: tid=0 2024-09-21T05:59:41.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.054+0000 7f21cf8e4740 1 client.16758 shutdown 2024-09-21T05:59:41.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.055+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1768240268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 msgr2=0x55d45ad445a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:41.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.055+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/1768240268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 0x55d45ad445a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f21ac005bd0 tx=0x7f21ac00a510 comp rx=0 tx=0).stop 2024-09-21T05:59:41.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.055+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1768240268 shutdown_connections 2024-09-21T05:59:41.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.055+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/1768240268 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d45a921080 0x55d45adbfdb0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.055+0000 7f21aa7fc640 0 client.16758 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:41.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.055+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/1768240268 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d45a98d350 0x55d45adbbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.055+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/1768240268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d45a96c670 0x55d45ad44ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.055+0000 7f21cf8e4740 1 --2- 172.21.15.7:0/1768240268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d45a964490 0x55d45ad445a0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.055+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1768240268 >> 172.21.15.7:0/1768240268 conn(0x55d45a981740 msgr2=0x55d45ad3af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:41.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.055+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1768240268 shutdown_connections 2024-09-21T05:59:41.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.055+0000 7f21cf8e4740 1 -- 172.21.15.7:0/1768240268 wait complete. 2024-09-21T05:59:41.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.055+0000 7f21cf8e4740 20 client.16758 trim_cache size 0 max 16384 2024-09-21T05:59:41.060 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:59:41.060 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T05:59:41.060 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "92761daf-6b32-43df-8c0e-72651e531a59", 2024-09-21T05:59:41.060 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T05:59:41.060 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:59:41.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.056+0000 7f21c9370640 1 -- 172.21.15.7:0/1846691696 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f21b00b66b0 msgr2=0x7f21b00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:41.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.056+0000 7f21c9370640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f21b00b66b0 0x7f21b00b8bc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0ce3f0 tx=0x7f21bc0095c0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.056+0000 7f21c9370640 1 -- 172.21.15.7:0/1846691696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4108d20 msgr2=0x7f21c419fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:41.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.056+0000 7f21c9370640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4108d20 0x7f21c419fc20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0098d0 tx=0x7f21bc0317b0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.056+0000 7f21c9370640 1 -- 172.21.15.7:0/1846691696 shutdown_connections 2024-09-21T05:59:41.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.056+0000 7f21c9370640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f21b00b66b0 0x7f21b00b8bc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.056+0000 7f21c9370640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c4108d20 0x7f21c419fc20 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.056+0000 7f21c9370640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21c41083d0 0x7f21c419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.056+0000 7f21c9370640 1 --2- 172.21.15.7:0/1846691696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21c4102ae0 0x7f21c419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:41.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.056+0000 7f21c9370640 1 -- 172.21.15.7:0/1846691696 >> 172.21.15.7:0/1846691696 conn(0x7f21c4079760 msgr2=0x7f21c41043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:41.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.056+0000 7f21c9370640 1 -- 172.21.15.7:0/1846691696 shutdown_connections 2024-09-21T05:59:41.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:41.056+0000 7f21c9370640 1 -- 172.21.15.7:0/1846691696 wait complete. 2024-09-21T05:59:41.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:59:42.033 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:42.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:41 smithi007 ceph-mon[30983]: pgmap v492: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:59:42.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:41 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T05:59:42.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:41 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:42.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:41 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T05:59:42.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:41 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:42.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:41 smithi027 ceph-mon[34364]: pgmap v492: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:59:42.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:41 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T05:59:42.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:41 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:42.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:41 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T05:59:42.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:41 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:42.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:41 smithi119 ceph-mon[34833]: pgmap v492: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:59:42.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:41 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T05:59:42.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:41 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:42.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:41 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T05:59:42.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:41 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:42.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.547+0000 7f3d2efd2640 1 -- 172.21.15.7:0/3837305172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d281083a0 msgr2=0x7f3d281087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.547+0000 7f3d2efd2640 1 --2- 172.21.15.7:0/3837305172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d281083a0 0x7f3d281087b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009ca0 tx=0x7f3d1802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.547+0000 7f3d2efd2640 1 -- 172.21.15.7:0/3837305172 shutdown_connections 2024-09-21T05:59:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.547+0000 7f3d2efd2640 1 --2- 172.21.15.7:0/3837305172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d281083a0 0x7f3d281087b0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.547+0000 7f3d2efd2640 1 --2- 172.21.15.7:0/3837305172 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d28108cf0 0x7f3d2810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.547+0000 7f3d2efd2640 1 --2- 172.21.15.7:0/3837305172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d28102a60 0x7f3d28102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.547+0000 7f3d2efd2640 1 -- 172.21.15.7:0/3837305172 >> 172.21.15.7:0/3837305172 conn(0x7f3d28079730 msgr2=0x7f3d28079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.547+0000 7f3d2efd2640 1 -- 172.21.15.7:0/3837305172 shutdown_connections 2024-09-21T05:59:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.547+0000 7f3d2efd2640 1 -- 172.21.15.7:0/3837305172 wait complete. 2024-09-21T05:59:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.548+0000 7f3d2efd2640 1 Processor -- start 2024-09-21T05:59:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.548+0000 7f3d2efd2640 1 -- start start 2024-09-21T05:59:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.548+0000 7f3d2efd2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d28102a60 0x7f3d2819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.548+0000 7f3d2efd2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d281083a0 0x7f3d2819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.548+0000 7f3d2efd2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d28108cf0 0x7f3d281a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.548+0000 7f3d2efd2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d28112960 con 0x7f3d28108cf0 2024-09-21T05:59:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.548+0000 7f3d2efd2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281127e0 con 0x7f3d281083a0 2024-09-21T05:59:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.548+0000 7f3d2efd2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3d28112ae0 con 0x7f3d28102a60 2024-09-21T05:59:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.548+0000 7f3d2d56f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d28108cf0 0x7f3d281a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.548+0000 7f3d2d56f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d28108cf0 0x7f3d281a1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39884/0 (socket says 172.21.15.7:39884) 2024-09-21T05:59:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.548+0000 7f3d2d56f640 1 -- 172.21.15.7:0/582511135 learned_addr learned my addr 172.21.15.7:0/582511135 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.548+0000 7f3d27fff640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d281083a0 0x7f3d2819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.548+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d28102a60 0x7f3d2819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.549+0000 7f3d2d56f640 1 -- 172.21.15.7:0/582511135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d28102a60 msgr2=0x7f3d2819c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.549+0000 7f3d2d56f640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d28102a60 0x7f3d2819c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.549+0000 7f3d2d56f640 1 -- 172.21.15.7:0/582511135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d281083a0 msgr2=0x7f3d2819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.549+0000 7f3d2d56f640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d281083a0 0x7f3d2819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.549+0000 7f3d2d56f640 1 -- 172.21.15.7:0/582511135 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d281a25e0 con 0x7f3d28108cf0 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.549+0000 7f3d2d56f640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d28108cf0 0x7f3d281a1eb0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000e970 tx=0x7f3d1000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.549+0000 7f3d25ffb640 1 -- 172.21.15.7:0/582511135 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1000ccc0 con 0x7f3d28108cf0 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.549+0000 7f3d2efd2640 1 -- 172.21.15.7:0/582511135 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d281a28d0 con 0x7f3d28108cf0 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.549+0000 7f3d25ffb640 1 -- 172.21.15.7:0/582511135 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d1000ce60 con 0x7f3d28108cf0 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.549+0000 7f3d25ffb640 1 -- 172.21.15.7:0/582511135 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10010430 con 0x7f3d28108cf0 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.549+0000 7f3d2efd2640 1 -- 172.21.15.7:0/582511135 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d281a9030 con 0x7f3d28108cf0 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.552+0000 7f3d35546740 1 Processor -- start 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.552+0000 7f3d25ffb640 1 -- 172.21.15.7:0/582511135 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3d10004ff0 con 0x7f3d28108cf0 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.552+0000 7f3d35546740 1 -- start start 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.552+0000 7f3d35546740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6d17070 0x55acf70be650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.552+0000 7f3d35546740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cee1b0 0x55acf70beb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.552+0000 7f3d35546740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cf6390 0x55acf70bf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.552+0000 7f3d35546740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55acf7034e50 con 0x55acf6d17070 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.552+0000 7f3d35546740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55acf7024280 con 0x55acf6cf6390 2024-09-21T05:59:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.552+0000 7f3d35546740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55acf7028090 con 0x55acf6cee1b0 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.552+0000 7f3d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6d17070 0x55acf70be650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.552+0000 7f3d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6d17070 0x55acf70be650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39890/0 (socket says 172.21.15.7:39890) 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.552+0000 7f3d27fff640 1 -- 172.21.15.7:0/105067211 learned_addr learned my addr 172.21.15.7:0/105067211 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.552+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/105067211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cee1b0 0x55acf70beb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.553+0000 7f3d27fff640 1 --2- 172.21.15.7:0/105067211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cf6390 0x55acf70bf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.553+0000 7f3d27fff640 1 -- 172.21.15.7:0/105067211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cee1b0 msgr2=0x55acf70beb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.553+0000 7f3d27fff640 1 --2- 172.21.15.7:0/105067211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cee1b0 0x55acf70beb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.553+0000 7f3d27fff640 1 -- 172.21.15.7:0/105067211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cf6390 msgr2=0x55acf70bf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.553+0000 7f3d27fff640 1 --2- 172.21.15.7:0/105067211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cf6390 0x55acf70bf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.553+0000 7f3d27fff640 1 -- 172.21.15.7:0/105067211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf6d82650 con 0x55acf6d17070 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.553+0000 7f3d25ffb640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3d140b6680 0x7f3d140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.553+0000 7f3d27fff640 1 --2- 172.21.15.7:0/105067211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6d17070 0x55acf70be650 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009ca0 tx=0x7f3d180093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c4ddea28799ade server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.553+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3d140b6680 0x7f3d140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.553+0000 7f3d25ffb640 1 -- 172.21.15.7:0/582511135 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f3d100e7a90 con 0x7f3d28108cf0 2024-09-21T05:59:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.553+0000 7f3d1effd640 1 -- 172.21.15.7:0/105067211 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18031e30 con 0x55acf6d17070 2024-09-21T05:59:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.553+0000 7f3d1effd640 1 -- 172.21.15.7:0/105067211 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d18036040 con 0x55acf6d17070 2024-09-21T05:59:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.553+0000 7f3d1effd640 1 -- 172.21.15.7:0/105067211 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18004290 con 0x55acf6d17070 2024-09-21T05:59:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.554+0000 7f3d35546740 1 -- 172.21.15.7:0/105067211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6d17070 msgr2=0x55acf70be650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.554+0000 7f3d35546740 1 --2- 172.21.15.7:0/105067211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6d17070 0x55acf70be650 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009ca0 tx=0x7f3d180093d0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.554+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3d140b6680 0x7f3d140b8b90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55acf70bd2d0 tx=0x7f3d2000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.554+0000 7f3d35546740 1 -- 172.21.15.7:0/105067211 shutdown_connections 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.554+0000 7f3d35546740 1 --2- 172.21.15.7:0/105067211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cf6390 0x55acf70bf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.554+0000 7f3d35546740 1 --2- 172.21.15.7:0/105067211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cee1b0 0x55acf70beb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.554+0000 7f3d35546740 1 --2- 172.21.15.7:0/105067211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6d17070 0x55acf70be650 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.554+0000 7f3d35546740 1 -- 172.21.15.7:0/105067211 >> 172.21.15.7:0/105067211 conn(0x55acf6d0b460 msgr2=0x55acf70bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.554+0000 7f3d35546740 1 -- 172.21.15.7:0/105067211 shutdown_connections 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.554+0000 7f3d35546740 1 -- 172.21.15.7:0/105067211 wait complete. 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.555+0000 7f3d35546740 1 -- start start 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.555+0000 7f3d35546740 1 Processor -- start 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.555+0000 7f3d35546740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cee1b0 0x55acf70c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.555+0000 7f3d35546740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cf6390 0x55acf70ca260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.555+0000 7f3d35546740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6d17070 0x55acf70d60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.555+0000 7f3d35546740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55acf6e85700 con 0x55acf6cee1b0 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.555+0000 7f3d35546740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55acf6fbf110 con 0x55acf6d17070 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.555+0000 7f3d35546740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55acf70ccdd0 con 0x55acf6cf6390 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.555+0000 7f3d35546740 10 client.0 _ll_register_callbacks cb 0x55acf6fd8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.555+0000 7f3d2cd6e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cee1b0 0x55acf70c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.555+0000 7f3d2cd6e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cee1b0 0x55acf70c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39900/0 (socket says 172.21.15.7:39900) 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.555+0000 7f3d2cd6e640 1 -- 172.21.15.7:0/2665701583 learned_addr learned my addr 172.21.15.7:0/2665701583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.556+0000 7f3d27fff640 1 --2- 172.21.15.7:0/2665701583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cf6390 0x55acf70ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.556+0000 7f3d2d56f640 1 --2- 172.21.15.7:0/2665701583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6d17070 0x55acf70d60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.556+0000 7f3d2cd6e640 1 -- 172.21.15.7:0/2665701583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cf6390 msgr2=0x55acf70ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.556+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/2665701583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cf6390 0x55acf70ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.556+0000 7f3d2cd6e640 1 -- 172.21.15.7:0/2665701583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6d17070 msgr2=0x55acf70d60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.556+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/2665701583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6d17070 0x55acf70d60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.556+0000 7f3d2cd6e640 1 -- 172.21.15.7:0/2665701583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acf6fecc40 con 0x55acf6cee1b0 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.556+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/2665701583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cee1b0 0x55acf70c9d20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3d20003d30 tx=0x7f3d200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3b4be214fb44d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.556+0000 7f3d07fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.556+0000 7f3d07fff640 1 -- 172.21.15.7:0/2665701583 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2002c060 con 0x55acf6cee1b0 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.556+0000 7f3d07fff640 1 -- 172.21.15.7:0/2665701583 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f3d20017030 con 0x55acf6cee1b0 2024-09-21T05:59:42.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.556+0000 7f3d35546740 1 -- 172.21.15.7:0/2665701583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d18036040 con 0x55acf6cee1b0 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.557+0000 7f3d07fff640 1 -- 172.21.15.7:0/2665701583 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3d20031430 con 0x55acf6cee1b0 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.557+0000 7f3d35546740 10 client.16770 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.557+0000 7f3d35546740 1 -- 172.21.15.7:0/2665701583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55acf70d8b50 con 0x55acf6cee1b0 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.557+0000 7f3d07fff640 1 -- 172.21.15.7:0/2665701583 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d18036040 con 0x55acf6cee1b0 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.557+0000 7f3d07fff640 1 -- 172.21.15.7:0/2665701583 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3d2001c410 con 0x55acf6cee1b0 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.557+0000 7f3d35546740 10 client.16770 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.557+0000 7f3d35546740 10 client.16770 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.557+0000 7f3d35546740 20 client.16770 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.557+0000 7f3d35546740 1 --2- 172.21.15.7:0/2665701583 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55acf6cd59f0 0x55acf70dc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.557+0000 7f3d35546740 4 client.16770 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.557+0000 7f3d35546740 1 -- 172.21.15.7:0/2665701583 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acf7036da0 con 0x55acf6cd59f0 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.557+0000 7f3d27fff640 1 --2- 172.21.15.7:0/2665701583 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55acf6cd59f0 0x55acf70dc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.558+0000 7f3d27fff640 1 --2- 172.21.15.7:0/2665701583 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55acf6cd59f0 0x55acf70dc080 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f907465eb52291a server_cookie=47a9cf801c45cb1b in_seq=0 out_seq=0 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.558+0000 7f3d07fff640 10 client.16770 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d07fff640 1 -- 172.21.15.7:0/2665701583 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55acf7036da0 con 0x55acf6cd59f0 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d07fff640 10 client.16770 handle_command_reply: tid=0 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d35546740 1 client.16770 shutdown 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d35546740 1 -- 172.21.15.7:0/2665701583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cee1b0 msgr2=0x55acf70c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d35546740 1 --2- 172.21.15.7:0/2665701583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cee1b0 0x55acf70c9d20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3d20003d30 tx=0x7f3d200046c0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d35546740 1 -- 172.21.15.7:0/2665701583 shutdown_connections 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d35546740 1 --2- 172.21.15.7:0/2665701583 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55acf6cd59f0 0x55acf70dc080 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d35546740 1 --2- 172.21.15.7:0/2665701583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6d17070 0x55acf70d60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d35546740 1 --2- 172.21.15.7:0/2665701583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cf6390 0x55acf70ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d35546740 1 --2- 172.21.15.7:0/2665701583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cee1b0 0x55acf70c9d20 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d07fff640 0 client.16770 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d35546740 1 -- 172.21.15.7:0/2665701583 >> 172.21.15.7:0/2665701583 conn(0x55acf6d0b460 msgr2=0x55acf70c1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d35546740 1 -- 172.21.15.7:0/2665701583 shutdown_connections 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d35546740 1 -- 172.21.15.7:0/2665701583 wait complete. 2024-09-21T05:59:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.559+0000 7f3d35546740 20 client.16770 trim_cache size 0 max 16384 2024-09-21T05:59:42.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.577+0000 7f3d35546740 1 Processor -- start 2024-09-21T05:59:42.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.577+0000 7f3d35546740 1 -- start start 2024-09-21T05:59:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.577+0000 7f3d35546740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cd59f0 0x55acf70bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.577+0000 7f3d35546740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cee1b0 0x55acf70d5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.577+0000 7f3d35546740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cf6390 0x55acf70c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.577+0000 7f3d35546740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281b3f50 con 0x55acf6cd59f0 2024-09-21T05:59:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.577+0000 7f3d35546740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281b1820 con 0x55acf6cee1b0 2024-09-21T05:59:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.577+0000 7f3d35546740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281af670 con 0x55acf6cf6390 2024-09-21T05:59:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.578+0000 7f3d2cd6e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cd59f0 0x55acf70bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.578+0000 7f3d2cd6e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cd59f0 0x55acf70bfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39916/0 (socket says 172.21.15.7:39916) 2024-09-21T05:59:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.578+0000 7f3d2cd6e640 1 -- 172.21.15.7:0/4219575970 learned_addr learned my addr 172.21.15.7:0/4219575970 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.578+0000 7f3d2cd6e640 1 -- 172.21.15.7:0/4219575970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cf6390 msgr2=0x55acf70c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.578+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/4219575970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cf6390 0x55acf70c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.578+0000 7f3d2cd6e640 1 -- 172.21.15.7:0/4219575970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cee1b0 msgr2=0x55acf70d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:42.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.578+0000 7f3d27fff640 1 --2- 172.21.15.7:0/4219575970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cee1b0 0x55acf70d5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.578+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/4219575970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cee1b0 0x55acf70d5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.578+0000 7f3d2cd6e640 1 -- 172.21.15.7:0/4219575970 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf70c0940 con 0x55acf6cd59f0 2024-09-21T05:59:42.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.578+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/4219575970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cd59f0 0x55acf70bfd90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f3d20003a60 tx=0x7f3d20003c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefe997ede2822ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:42.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.578+0000 7f3d1e7fc640 1 -- 172.21.15.7:0/4219575970 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2001c5f0 con 0x55acf6cd59f0 2024-09-21T05:59:42.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.578+0000 7f3d1e7fc640 1 -- 172.21.15.7:0/4219575970 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d20005040 con 0x55acf6cd59f0 2024-09-21T05:59:42.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.578+0000 7f3d1e7fc640 1 -- 172.21.15.7:0/4219575970 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20004ab0 con 0x55acf6cd59f0 2024-09-21T05:59:42.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.579+0000 7f3d35546740 1 -- 172.21.15.7:0/4219575970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cd59f0 msgr2=0x55acf70bfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.579+0000 7f3d35546740 1 --2- 172.21.15.7:0/4219575970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cd59f0 0x55acf70bfd90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f3d20003a60 tx=0x7f3d20003c70 comp rx=0 tx=0).stop 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.579+0000 7f3d35546740 1 -- 172.21.15.7:0/4219575970 shutdown_connections 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.579+0000 7f3d35546740 1 --2- 172.21.15.7:0/4219575970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cf6390 0x55acf70c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.579+0000 7f3d35546740 1 --2- 172.21.15.7:0/4219575970 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cee1b0 0x55acf70d5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.579+0000 7f3d35546740 1 --2- 172.21.15.7:0/4219575970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cd59f0 0x55acf70bfd90 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.579+0000 7f3d35546740 1 -- 172.21.15.7:0/4219575970 >> 172.21.15.7:0/4219575970 conn(0x55acf6d0b460 msgr2=0x55acf70bf680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.579+0000 7f3d35546740 1 -- 172.21.15.7:0/4219575970 shutdown_connections 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.579+0000 7f3d35546740 1 -- 172.21.15.7:0/4219575970 wait complete. 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d35546740 1 -- start start 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d35546740 1 Processor -- start 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d35546740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cd59f0 0x55acf70d26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d35546740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cee1b0 0x55acf70cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d35546740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cf6390 0x55acf70cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d35546740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281afce0 con 0x55acf6cf6390 2024-09-21T05:59:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d35546740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281b1150 con 0x55acf6cd59f0 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d35546740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281b03b0 con 0x55acf6cee1b0 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d35546740 10 client.0 _ll_register_callbacks cb 0x7f3d20004300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d2d56f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cf6390 0x55acf70cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d2d56f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cf6390 0x55acf70cf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39922/0 (socket says 172.21.15.7:39922) 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d2d56f640 1 -- 172.21.15.7:0/2777613945 learned_addr learned my addr 172.21.15.7:0/2777613945 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cd59f0 0x55acf70d26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.580+0000 7f3d27fff640 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cee1b0 0x55acf70cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d2d56f640 1 -- 172.21.15.7:0/2777613945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cee1b0 msgr2=0x55acf70cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d2d56f640 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cee1b0 0x55acf70cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d2d56f640 1 -- 172.21.15.7:0/2777613945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cd59f0 msgr2=0x55acf70d26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d2d56f640 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cd59f0 0x55acf70d26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d2d56f640 1 -- 172.21.15.7:0/2777613945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acf70cf760 con 0x55acf6cf6390 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cd59f0 0x55acf70d26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d2d56f640 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cf6390 0x55acf70cf0f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000d010 tx=0x7f3d100ad140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c61a6580c94ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d07fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d07fff640 1 -- 172.21.15.7:0/2777613945 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d100055f0 con 0x55acf6cf6390 2024-09-21T05:59:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d07fff640 1 -- 172.21.15.7:0/2777613945 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f3d100acdd0 con 0x55acf6cf6390 2024-09-21T05:59:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d35546740 1 -- 172.21.15.7:0/2777613945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d20005040 con 0x55acf6cf6390 2024-09-21T05:59:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d07fff640 1 -- 172.21.15.7:0/2777613945 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3d100046c0 con 0x55acf6cf6390 2024-09-21T05:59:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d35546740 10 client.16776 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d35546740 1 -- 172.21.15.7:0/2777613945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55acf71478a0 con 0x55acf6cf6390 2024-09-21T05:59:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.581+0000 7f3d07fff640 1 -- 172.21.15.7:0/2777613945 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d20005040 con 0x55acf6cf6390 2024-09-21T05:59:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.582+0000 7f3d07fff640 1 -- 172.21.15.7:0/2777613945 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3d100ac630 con 0x55acf6cf6390 2024-09-21T05:59:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.582+0000 7f3d35546740 10 client.16776 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.582+0000 7f3d35546740 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.582+0000 7f3d35546740 20 client.16776 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.582+0000 7f3d35546740 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55acf6d17070 0x55acf714a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.582+0000 7f3d35546740 4 client.16776 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:59:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.582+0000 7f3d35546740 1 -- 172.21.15.7:0/2777613945 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55acf7032850 con 0x55acf6d17070 2024-09-21T05:59:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.582+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55acf6d17070 0x55acf714a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:42.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.582+0000 7f3d07fff640 10 client.16776 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.582+0000 7f3d2cd6e640 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55acf6d17070 0x55acf714a060 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1124280c752a33c server_cookie=62706e5cfcfb2b1a in_seq=0 out_seq=0 2024-09-21T05:59:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d07fff640 1 -- 172.21.15.7:0/2777613945 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x55acf7032850 con 0x55acf6d17070 2024-09-21T05:59:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d07fff640 10 client.16776 handle_command_reply: tid=0 2024-09-21T05:59:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d35546740 1 client.16776 shutdown 2024-09-21T05:59:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d35546740 1 -- 172.21.15.7:0/2777613945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cf6390 msgr2=0x55acf70cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d35546740 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cf6390 0x55acf70cf0f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000d010 tx=0x7f3d100ad140 comp rx=0 tx=0).stop 2024-09-21T05:59:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d35546740 1 -- 172.21.15.7:0/2777613945 shutdown_connections 2024-09-21T05:59:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d35546740 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55acf6d17070 0x55acf714a060 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d35546740 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6cf6390 0x55acf70cf0f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d35546740 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55acf6cee1b0 0x55acf70cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d07fff640 0 client.16776 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d35546740 1 --2- 172.21.15.7:0/2777613945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55acf6cd59f0 0x55acf70d26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d35546740 1 -- 172.21.15.7:0/2777613945 >> 172.21.15.7:0/2777613945 conn(0x55acf6d0b460 msgr2=0x55acf70bf680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d35546740 1 -- 172.21.15.7:0/2777613945 shutdown_connections 2024-09-21T05:59:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d35546740 1 -- 172.21.15.7:0/2777613945 wait complete. 2024-09-21T05:59:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.583+0000 7f3d35546740 20 client.16776 trim_cache size 0 max 16384 2024-09-21T05:59:42.591 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:59:42.591 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T05:59:42.591 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T05:59:42.591 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:59:42.591 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:59:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:59:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:59:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:59:42.597 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:59:42.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.584+0000 7f3d2efd2640 1 -- 172.21.15.7:0/582511135 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3d140b6680 msgr2=0x7f3d140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:42.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.584+0000 7f3d2efd2640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3d140b6680 0x7f3d140b8b90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55acf70bd2d0 tx=0x7f3d2000b390 comp rx=0 tx=0).stop 2024-09-21T05:59:42.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.584+0000 7f3d2efd2640 1 -- 172.21.15.7:0/582511135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d28108cf0 msgr2=0x7f3d281a1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:42.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.584+0000 7f3d2efd2640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d28108cf0 0x7f3d281a1eb0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000e970 tx=0x7f3d1000ed70 comp rx=0 tx=0).stop 2024-09-21T05:59:42.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.584+0000 7f3d2efd2640 1 -- 172.21.15.7:0/582511135 shutdown_connections 2024-09-21T05:59:42.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.584+0000 7f3d2efd2640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3d140b6680 0x7f3d140b8b90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.584+0000 7f3d2efd2640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d28108cf0 0x7f3d281a1eb0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.584+0000 7f3d2efd2640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d281083a0 0x7f3d2819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.584+0000 7f3d2efd2640 1 --2- 172.21.15.7:0/582511135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d28102a60 0x7f3d2819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:42.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.584+0000 7f3d2efd2640 1 -- 172.21.15.7:0/582511135 >> 172.21.15.7:0/582511135 conn(0x7f3d28079730 msgr2=0x7f3d2806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:42.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.584+0000 7f3d2efd2640 1 -- 172.21.15.7:0/582511135 shutdown_connections 2024-09-21T05:59:42.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:42.584+0000 7f3d2efd2640 1 -- 172.21.15.7:0/582511135 wait complete. 2024-09-21T05:59:43.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:42 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T05:59:43.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:42 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T05:59:43.298 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T05:59:43.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:59:43.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:42 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T05:59:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:43.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:43 smithi007 ceph-mon[30983]: pgmap v493: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T05:59:44.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.021+0000 7f72190b4640 1 -- 172.21.15.7:0/350595261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7214102ae0 msgr2=0x7f7214102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.021+0000 7f72190b4640 1 --2- 172.21.15.7:0/350595261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7214102ae0 0x7f7214102ef0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7204009900 tx=0x7f720402a410 comp rx=0 tx=0).stop 2024-09-21T05:59:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.022+0000 7f72190b4640 1 -- 172.21.15.7:0/350595261 shutdown_connections 2024-09-21T05:59:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.022+0000 7f72190b4640 1 --2- 172.21.15.7:0/350595261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7214108d20 0x7f721410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.022+0000 7f72190b4640 1 --2- 172.21.15.7:0/350595261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72141083d0 0x7f72141087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.022+0000 7f72190b4640 1 --2- 172.21.15.7:0/350595261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7214102ae0 0x7f7214102ef0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.022+0000 7f72190b4640 1 -- 172.21.15.7:0/350595261 >> 172.21.15.7:0/350595261 conn(0x7f7214079760 msgr2=0x7f7214079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.022+0000 7f72190b4640 1 -- 172.21.15.7:0/350595261 shutdown_connections 2024-09-21T05:59:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.022+0000 7f72190b4640 1 -- 172.21.15.7:0/350595261 wait complete. 2024-09-21T05:59:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f72190b4640 1 Processor -- start 2024-09-21T05:59:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f72190b4640 1 -- start start 2024-09-21T05:59:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f72190b4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7214102ae0 0x7f7214104280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f72190b4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72141083d0 0x7f72141047c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f72190b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7214108d20 0x7f7214104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f72190b4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7214112990 con 0x7f7214102ae0 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f72190b4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7214112810 con 0x7f72141083d0 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f72190b4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7214112b10 con 0x7f7214108d20 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f7212d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7214102ae0 0x7f7214104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f7212d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7214102ae0 0x7f7214104280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39930/0 (socket says 172.21.15.7:39930) 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f7212d9d640 1 -- 172.21.15.7:0/2990051966 learned_addr learned my addr 172.21.15.7:0/2990051966 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f721259c640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72141083d0 0x7f72141047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f721359e640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7214108d20 0x7f7214104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f7212d9d640 1 -- 172.21.15.7:0/2990051966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7214108d20 msgr2=0x7f7214104d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f7212d9d640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7214108d20 0x7f7214104d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.023+0000 7f7212d9d640 1 -- 172.21.15.7:0/2990051966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72141083d0 msgr2=0x7f72141047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.024+0000 7f7212d9d640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72141083d0 0x7f72141047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.024+0000 7f7212d9d640 1 -- 172.21.15.7:0/2990051966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72141a8680 con 0x7f7214102ae0 2024-09-21T05:59:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.024+0000 7f721259c640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72141083d0 0x7f72141047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.024+0000 7f7212d9d640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7214102ae0 0x7f7214104280 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f7204005940 tx=0x7f7204004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.024+0000 7f71fbfff640 1 -- 172.21.15.7:0/2990051966 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720403f030 con 0x7f7214102ae0 2024-09-21T05:59:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.024+0000 7f71fbfff640 1 -- 172.21.15.7:0/2990051966 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7204003aa0 con 0x7f7214102ae0 2024-09-21T05:59:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.024+0000 7f72190b4640 1 -- 172.21.15.7:0/2990051966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72141a8910 con 0x7f7214102ae0 2024-09-21T05:59:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.024+0000 7f71fbfff640 1 -- 172.21.15.7:0/2990051966 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204035070 con 0x7f7214102ae0 2024-09-21T05:59:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.024+0000 7f72190b4640 1 -- 172.21.15.7:0/2990051966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72141a8e40 con 0x7f7214102ae0 2024-09-21T05:59:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.025+0000 7f72190b4640 1 -- 172.21.15.7:0/2990051966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7214103d10 con 0x7f7214102ae0 2024-09-21T05:59:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.027+0000 7f71fbfff640 1 -- 172.21.15.7:0/2990051966 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7204042030 con 0x7f7214102ae0 2024-09-21T05:59:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.027+0000 7f71fbfff640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f71fc0b6700 0x7f71fc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.028+0000 7f721259c640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f71fc0b6700 0x7f71fc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.028+0000 7f71fbfff640 1 -- 172.21.15.7:0/2990051966 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f7204107e20 con 0x7f7214102ae0 2024-09-21T05:59:44.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.028+0000 7f721259c640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f71fc0b6700 0x7f71fc0b8c10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7214100e70 tx=0x7f7208005d90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:44.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.032+0000 7f71fbfff640 1 -- 172.21.15.7:0/2990051966 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72040ce3f0 con 0x7f7214102ae0 2024-09-21T05:59:44.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:43 smithi027 ceph-mon[34364]: pgmap v493: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T05:59:44.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.259+0000 7f72190b4640 1 -- 172.21.15.7:0/2990051966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7214105580 con 0x7f7214102ae0 2024-09-21T05:59:44.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.260+0000 7f71fbfff640 1 -- 172.21.15.7:0/2990051966 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f72040d27d0 con 0x7f7214102ae0 2024-09-21T05:59:44.262 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:59:44.262 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:59:44.263 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:59:44.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.263+0000 7f72190b4640 1 -- 172.21.15.7:0/2990051966 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f71fc0b6700 msgr2=0x7f71fc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:44.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.263+0000 7f72190b4640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f71fc0b6700 0x7f71fc0b8c10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7214100e70 tx=0x7f7208005d90 comp rx=0 tx=0).stop 2024-09-21T05:59:44.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.263+0000 7f72190b4640 1 -- 172.21.15.7:0/2990051966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7214102ae0 msgr2=0x7f7214104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:44.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.263+0000 7f72190b4640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7214102ae0 0x7f7214104280 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f7204005940 tx=0x7f7204004270 comp rx=0 tx=0).stop 2024-09-21T05:59:44.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.263+0000 7f72190b4640 1 -- 172.21.15.7:0/2990051966 shutdown_connections 2024-09-21T05:59:44.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.263+0000 7f72190b4640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f71fc0b6700 0x7f71fc0b8c10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:44.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.263+0000 7f72190b4640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7214108d20 0x7f7214104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:44.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.263+0000 7f72190b4640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72141083d0 0x7f72141047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:44.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.263+0000 7f72190b4640 1 --2- 172.21.15.7:0/2990051966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7214102ae0 0x7f7214104280 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:44.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.263+0000 7f72190b4640 1 -- 172.21.15.7:0/2990051966 >> 172.21.15.7:0/2990051966 conn(0x7f7214079760 msgr2=0x7f7214101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:44.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.263+0000 7f72190b4640 1 -- 172.21.15.7:0/2990051966 shutdown_connections 2024-09-21T05:59:44.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:44.263+0000 7f72190b4640 1 -- 172.21.15.7:0/2990051966 wait complete. 2024-09-21T05:59:44.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:43 smithi119 ceph-mon[34833]: pgmap v493: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T05:59:44.899 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T05:59:45.162 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:45.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:44 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2990051966' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:45.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:44 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2990051966' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:45.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:44 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2990051966' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:45.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.624+0000 7f9d2f116640 1 -- 172.21.15.7:0/1709275582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28103b60 msgr2=0x7f9d28103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:45.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.624+0000 7f9d2f116640 1 --2- 172.21.15.7:0/1709275582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28103b60 0x7f9d28103f70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009900 tx=0x7f9d1c02a410 comp rx=0 tx=0).stop 2024-09-21T05:59:45.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.624+0000 7f9d2f116640 1 -- 172.21.15.7:0/1709275582 shutdown_connections 2024-09-21T05:59:45.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.624+0000 7f9d2f116640 1 --2- 172.21.15.7:0/1709275582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d28109df0 0x7f9d28110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.625+0000 7f9d2f116640 1 --2- 172.21.15.7:0/1709275582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d281094a0 0x7f9d281098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.625+0000 7f9d2f116640 1 --2- 172.21.15.7:0/1709275582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28103b60 0x7f9d28103f70 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.625+0000 7f9d2f116640 1 -- 172.21.15.7:0/1709275582 >> 172.21.15.7:0/1709275582 conn(0x7f9d2807b850 msgr2=0x7f9d2807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:45.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.625+0000 7f9d2f116640 1 -- 172.21.15.7:0/1709275582 shutdown_connections 2024-09-21T05:59:45.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.625+0000 7f9d2f116640 1 -- 172.21.15.7:0/1709275582 wait complete. 2024-09-21T05:59:45.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.625+0000 7f9d2f116640 1 Processor -- start 2024-09-21T05:59:45.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.625+0000 7f9d2f116640 1 -- start start 2024-09-21T05:59:45.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2f116640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d28103b60 0x7f9d2819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2f116640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d281094a0 0x7f9d2819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2f116640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28109df0 0x7f9d2819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2f116640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d28113b00 con 0x7f9d28109df0 2024-09-21T05:59:45.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2f116640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9d28113980 con 0x7f9d281094a0 2024-09-21T05:59:45.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2f116640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9d28113c80 con 0x7f9d28103b60 2024-09-21T05:59:45.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2d6b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28109df0 0x7f9d2819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2d6b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28109df0 0x7f9d2819fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39948/0 (socket says 172.21.15.7:39948) 2024-09-21T05:59:45.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2d6b3640 1 -- 172.21.15.7:0/3415351498 learned_addr learned my addr 172.21.15.7:0/3415351498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:45.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d27fff640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d281094a0 0x7f9d2819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2ceb2640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d28103b60 0x7f9d2819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2d6b3640 1 -- 172.21.15.7:0/3415351498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d28103b60 msgr2=0x7f9d2819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:45.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2d6b3640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d28103b60 0x7f9d2819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2d6b3640 1 -- 172.21.15.7:0/3415351498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d281094a0 msgr2=0x7f9d2819aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:45.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2d6b3640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d281094a0 0x7f9d2819aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2d6b3640 1 -- 172.21.15.7:0/3415351498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d281a0440 con 0x7f9d28109df0 2024-09-21T05:59:45.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d27fff640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d281094a0 0x7f9d2819aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:45.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2ceb2640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d28103b60 0x7f9d2819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:45.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d2d6b3640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28109df0 0x7f9d2819fd10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000eb10 tx=0x7f9d2000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:45.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.626+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3415351498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d20004b20 con 0x7f9d28109df0 2024-09-21T05:59:45.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.627+0000 7f9d2f116640 1 -- 172.21.15.7:0/3415351498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d281a0730 con 0x7f9d28109df0 2024-09-21T05:59:45.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.627+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3415351498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d20004cc0 con 0x7f9d28109df0 2024-09-21T05:59:45.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.627+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3415351498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d20010670 con 0x7f9d28109df0 2024-09-21T05:59:45.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.627+0000 7f9d2f116640 1 -- 172.21.15.7:0/3415351498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d281a6e90 con 0x7f9d28109df0 2024-09-21T05:59:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.629+0000 7f9d3568a740 1 Processor -- start 2024-09-21T05:59:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.629+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3415351498 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9d20005020 con 0x7f9d28109df0 2024-09-21T05:59:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.630+0000 7f9d3568a740 1 -- start start 2024-09-21T05:59:45.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.630+0000 7f9d3568a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba94c070 0x55b1bacf36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.630+0000 7f9d3568a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 0x55b1bacf3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.630+0000 7f9d3568a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 0x55b1bacf4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.630+0000 7f9d3568a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b1bac69ea0 con 0x55b1ba92b390 2024-09-21T05:59:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.630+0000 7f9d3568a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b1bac592d0 con 0x55b1ba94c070 2024-09-21T05:59:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.630+0000 7f9d3568a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b1bac5d0e0 con 0x55b1ba9231b0 2024-09-21T05:59:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.630+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 0x55b1bacf4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.630+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 0x55b1bacf4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39958/0 (socket says 172.21.15.7:39958) 2024-09-21T05:59:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.630+0000 7f9d27fff640 1 -- 172.21.15.7:0/3287763374 learned_addr learned my addr 172.21.15.7:0/3287763374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.630+0000 7f9d2ceb2640 1 --2- 172.21.15.7:0/3287763374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 0x55b1bacf3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.630+0000 7f9d27fff640 1 --2- 172.21.15.7:0/3287763374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba94c070 0x55b1bacf36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.631+0000 7f9d25ffb640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9d180b6680 0x7f9d180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.631+0000 7f9d27fff640 1 -- 172.21.15.7:0/3287763374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 msgr2=0x55b1bacf3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.631+0000 7f9d27fff640 1 --2- 172.21.15.7:0/3287763374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 0x55b1bacf3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.631+0000 7f9d27fff640 1 -- 172.21.15.7:0/3287763374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba94c070 msgr2=0x55b1bacf36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.631+0000 7f9d27fff640 1 --2- 172.21.15.7:0/3287763374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba94c070 0x55b1bacf36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.631+0000 7f9d27fff640 1 -- 172.21.15.7:0/3287763374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ba9b7650 con 0x55b1ba92b390 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.631+0000 7f9d2d6b3640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9d180b6680 0x7f9d180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.631+0000 7f9d27fff640 1 --2- 172.21.15.7:0/3287763374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 0x55b1bacf4120 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9d14013830 tx=0x7f9d1400b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cd64cca7f69049 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.631+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3415351498 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9d200e7dd0 con 0x7f9d28109df0 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.631+0000 7f9d12ffd640 1 -- 172.21.15.7:0/3287763374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400e8f0 con 0x55b1ba92b390 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.631+0000 7f9d12ffd640 1 -- 172.21.15.7:0/3287763374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d140113e0 con 0x55b1ba92b390 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.631+0000 7f9d12ffd640 1 -- 172.21.15.7:0/3287763374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14010630 con 0x55b1ba92b390 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.632+0000 7f9d3568a740 1 -- 172.21.15.7:0/3287763374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 msgr2=0x55b1bacf4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.632+0000 7f9d2d6b3640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9d180b6680 0x7f9d180b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9d200adc30 tx=0x7f9d200a2500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.632+0000 7f9d3568a740 1 --2- 172.21.15.7:0/3287763374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 0x55b1bacf4120 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9d14013830 tx=0x7f9d1400b3c0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.632+0000 7f9d3568a740 1 -- 172.21.15.7:0/3287763374 shutdown_connections 2024-09-21T05:59:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.632+0000 7f9d3568a740 1 --2- 172.21.15.7:0/3287763374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 0x55b1bacf4120 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.632+0000 7f9d3568a740 1 --2- 172.21.15.7:0/3287763374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 0x55b1bacf3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.632+0000 7f9d3568a740 1 --2- 172.21.15.7:0/3287763374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba94c070 0x55b1bacf36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.632+0000 7f9d3568a740 1 -- 172.21.15.7:0/3287763374 >> 172.21.15.7:0/3287763374 conn(0x55b1ba940460 msgr2=0x55b1bacf1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.632+0000 7f9d3568a740 1 -- 172.21.15.7:0/3287763374 shutdown_connections 2024-09-21T05:59:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.632+0000 7f9d3568a740 1 -- 172.21.15.7:0/3287763374 wait complete. 2024-09-21T05:59:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.633+0000 7f9d3568a740 1 -- start start 2024-09-21T05:59:45.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.633+0000 7f9d3568a740 1 Processor -- start 2024-09-21T05:59:45.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.633+0000 7f9d3568a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba9231b0 0x55b1bacfeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.633+0000 7f9d3568a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba92b390 0x55b1bacff2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.633+0000 7f9d3568a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba94c070 0x55b1bad0b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.633+0000 7f9d3568a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b1baaba700 con 0x55b1ba9231b0 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.633+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba9231b0 0x55b1bacfeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.633+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba9231b0 0x55b1bacfeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39968/0 (socket says 172.21.15.7:39968) 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.633+0000 7f9d27fff640 1 -- 172.21.15.7:0/2578356887 learned_addr learned my addr 172.21.15.7:0/2578356887 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.633+0000 7f9d3568a740 1 -- 172.21.15.7:0/2578356887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b1babf4160 con 0x55b1ba94c070 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.633+0000 7f9d3568a740 1 -- 172.21.15.7:0/2578356887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b1bad01e80 con 0x55b1ba92b390 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.634+0000 7f9d2ceb2640 1 --2- 172.21.15.7:0/2578356887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba92b390 0x55b1bacff2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.634+0000 7f9d3568a740 10 client.0 _ll_register_callbacks cb 0x55b1bac0d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.634+0000 7f9d2ceb2640 1 -- 172.21.15.7:0/2578356887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba94c070 msgr2=0x55b1bad0b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.634+0000 7f9d2ceb2640 1 --2- 172.21.15.7:0/2578356887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba94c070 0x55b1bad0b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.634+0000 7f9d2ceb2640 1 -- 172.21.15.7:0/2578356887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba9231b0 msgr2=0x55b1bacfeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.634+0000 7f9d2ceb2640 1 --2- 172.21.15.7:0/2578356887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba9231b0 0x55b1bacfeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.634+0000 7f9d2ceb2640 1 -- 172.21.15.7:0/2578356887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1bac21c90 con 0x55b1ba92b390 2024-09-21T05:59:45.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.634+0000 7f9d2ceb2640 1 --2- 172.21.15.7:0/2578356887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba92b390 0x55b1bacff2e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0096c0 tx=0x7f9d1c004440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e85b470bdfe69d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.634+0000 7f9d07fff640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T05:59:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.634+0000 7f9d07fff640 1 -- 172.21.15.7:0/2578356887 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c035040 con 0x55b1ba92b390 2024-09-21T05:59:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.634+0000 7f9d07fff640 1 -- 172.21.15.7:0/2578356887 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9d1c005450 con 0x55b1ba92b390 2024-09-21T05:59:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.635+0000 7f9d3568a740 1 -- 172.21.15.7:0/2578356887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d140113e0 con 0x55b1ba92b390 2024-09-21T05:59:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.635+0000 7f9d07fff640 1 -- 172.21.15.7:0/2578356887 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9d1c005650 con 0x55b1ba92b390 2024-09-21T05:59:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.635+0000 7f9d3568a740 10 client.26269 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.635+0000 7f9d3568a740 1 -- 172.21.15.7:0/2578356887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b1bad0dbb0 con 0x55b1ba92b390 2024-09-21T05:59:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.635+0000 7f9d07fff640 1 -- 172.21.15.7:0/2578356887 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d140113e0 con 0x55b1ba92b390 2024-09-21T05:59:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.635+0000 7f9d07fff640 1 -- 172.21.15.7:0/2578356887 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9d1c003990 con 0x55b1ba92b390 2024-09-21T05:59:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.635+0000 7f9d3568a740 10 client.26269 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.635+0000 7f9d3568a740 10 client.26269 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:59:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.636+0000 7f9d3568a740 20 client.26269 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:45.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.636+0000 7f9d3568a740 1 --2- 172.21.15.7:0/2578356887 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b1ba90a9f0 0x55b1bad110d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.636+0000 7f9d3568a740 4 client.26269 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.636+0000 7f9d3568a740 1 -- 172.21.15.7:0/2578356887 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1bac6bdf0 con 0x55b1ba90a9f0 2024-09-21T05:59:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.636+0000 7f9d27fff640 1 --2- 172.21.15.7:0/2578356887 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b1ba90a9f0 0x55b1bad110d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.636+0000 7f9d27fff640 1 --2- 172.21.15.7:0/2578356887 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b1ba90a9f0 0x55b1bad110d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f5a7db63e7cca02 server_cookie=ca64f82cac31e275 in_seq=0 out_seq=0 2024-09-21T05:59:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.636+0000 7f9d07fff640 10 client.26269 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.637+0000 7f9d07fff640 1 -- 172.21.15.7:0/2578356887 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1bac6bdf0 con 0x55b1ba90a9f0 2024-09-21T05:59:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.637+0000 7f9d07fff640 10 client.26269 handle_command_reply: tid=0 2024-09-21T05:59:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.637+0000 7f9d3568a740 1 client.26269 shutdown 2024-09-21T05:59:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.637+0000 7f9d3568a740 1 -- 172.21.15.7:0/2578356887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba92b390 msgr2=0x55b1bacff2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.637+0000 7f9d3568a740 1 --2- 172.21.15.7:0/2578356887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba92b390 0x55b1bacff2e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0096c0 tx=0x7f9d1c004440 comp rx=0 tx=0).stop 2024-09-21T05:59:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.637+0000 7f9d3568a740 1 -- 172.21.15.7:0/2578356887 shutdown_connections 2024-09-21T05:59:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.637+0000 7f9d3568a740 1 --2- 172.21.15.7:0/2578356887 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b1ba90a9f0 0x55b1bad110d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.637+0000 7f9d3568a740 1 --2- 172.21.15.7:0/2578356887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba94c070 0x55b1bad0b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.637+0000 7f9d3568a740 1 --2- 172.21.15.7:0/2578356887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba92b390 0x55b1bacff2e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.637+0000 7f9d07fff640 0 client.26269 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:45.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.637+0000 7f9d3568a740 1 --2- 172.21.15.7:0/2578356887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba9231b0 0x55b1bacfeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.637+0000 7f9d3568a740 1 -- 172.21.15.7:0/2578356887 >> 172.21.15.7:0/2578356887 conn(0x55b1ba940460 msgr2=0x55b1bacf6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:45.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.638+0000 7f9d3568a740 1 -- 172.21.15.7:0/2578356887 shutdown_connections 2024-09-21T05:59:45.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.638+0000 7f9d3568a740 1 -- 172.21.15.7:0/2578356887 wait complete. 2024-09-21T05:59:45.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.638+0000 7f9d3568a740 20 client.26269 trim_cache size 0 max 16384 2024-09-21T05:59:45.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.651+0000 7f9d3568a740 1 Processor -- start 2024-09-21T05:59:45.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.651+0000 7f9d3568a740 1 -- start start 2024-09-21T05:59:45.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.651+0000 7f9d3568a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba90a9f0 0x55b1bad00c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.651+0000 7f9d3568a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 0x55b1bacf4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.651+0000 7f9d3568a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 0x55b1bacf0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.651+0000 7f9d3568a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281b1ec0 con 0x55b1ba92b390 2024-09-21T05:59:45.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.651+0000 7f9d3568a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281af790 con 0x55b1ba90a9f0 2024-09-21T05:59:45.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.651+0000 7f9d3568a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281ad5e0 con 0x55b1ba9231b0 2024-09-21T05:59:45.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.651+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 0x55b1bacf0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.651+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 0x55b1bacf0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39970/0 (socket says 172.21.15.7:39970) 2024-09-21T05:59:45.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.651+0000 7f9d27fff640 1 -- 172.21.15.7:0/3335100409 learned_addr learned my addr 172.21.15.7:0/3335100409 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:45.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.651+0000 7f9d27fff640 1 --2- 172.21.15.7:0/3335100409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba90a9f0 0x55b1bad00c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.652+0000 7f9d2ceb2640 1 --2- 172.21.15.7:0/3335100409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 0x55b1bacf4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.652+0000 7f9d27fff640 1 -- 172.21.15.7:0/3335100409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 msgr2=0x55b1bacf4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:45.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.652+0000 7f9d27fff640 1 --2- 172.21.15.7:0/3335100409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 0x55b1bacf4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.652+0000 7f9d27fff640 1 -- 172.21.15.7:0/3335100409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba90a9f0 msgr2=0x55b1bad00c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.652+0000 7f9d27fff640 1 --2- 172.21.15.7:0/3335100409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba90a9f0 0x55b1bad00c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.652+0000 7f9d27fff640 1 -- 172.21.15.7:0/3335100409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1bacf5990 con 0x55b1ba92b390 2024-09-21T05:59:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.652+0000 7f9d27fff640 1 --2- 172.21.15.7:0/3335100409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 0x55b1bacf0bc0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9d14013830 tx=0x7f9d14005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e0eb1bbf5613e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.652+0000 7f9d127fc640 1 -- 172.21.15.7:0/3335100409 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14013270 con 0x55b1ba92b390 2024-09-21T05:59:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.652+0000 7f9d127fc640 1 -- 172.21.15.7:0/3335100409 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d14013410 con 0x55b1ba92b390 2024-09-21T05:59:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.652+0000 7f9d127fc640 1 -- 172.21.15.7:0/3335100409 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400e6c0 con 0x55b1ba92b390 2024-09-21T05:59:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.653+0000 7f9d3568a740 1 -- 172.21.15.7:0/3335100409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 msgr2=0x55b1bacf0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.653+0000 7f9d3568a740 1 --2- 172.21.15.7:0/3335100409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 0x55b1bacf0bc0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9d14013830 tx=0x7f9d14005850 comp rx=0 tx=0).stop 2024-09-21T05:59:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.653+0000 7f9d3568a740 1 -- 172.21.15.7:0/3335100409 shutdown_connections 2024-09-21T05:59:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.653+0000 7f9d3568a740 1 --2- 172.21.15.7:0/3335100409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba92b390 0x55b1bacf0bc0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.653+0000 7f9d3568a740 1 --2- 172.21.15.7:0/3335100409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 0x55b1bacf4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.653+0000 7f9d3568a740 1 --2- 172.21.15.7:0/3335100409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba90a9f0 0x55b1bad00c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.653+0000 7f9d3568a740 1 -- 172.21.15.7:0/3335100409 >> 172.21.15.7:0/3335100409 conn(0x55b1ba940460 msgr2=0x55b1bacf46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:45.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.653+0000 7f9d3568a740 1 -- 172.21.15.7:0/3335100409 shutdown_connections 2024-09-21T05:59:45.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.653+0000 7f9d3568a740 1 -- 172.21.15.7:0/3335100409 wait complete. 2024-09-21T05:59:45.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.653+0000 7f9d3568a740 1 -- start start 2024-09-21T05:59:45.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.653+0000 7f9d3568a740 1 Processor -- start 2024-09-21T05:59:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d3568a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba90a9f0 0x55b1bad07aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d3568a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 0x55b1bad02fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d3568a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba92b390 0x55b1bad036d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d3568a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281adc50 con 0x55b1ba90a9f0 2024-09-21T05:59:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d3568a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281af0c0 con 0x55b1ba92b390 2024-09-21T05:59:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d3568a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281ae320 con 0x55b1ba9231b0 2024-09-21T05:59:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d3568a740 10 client.0 _ll_register_callbacks cb 0x7f9d1c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba90a9f0 0x55b1bad07aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba90a9f0 0x55b1bad07aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39972/0 (socket says 172.21.15.7:39972) 2024-09-21T05:59:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d27fff640 1 -- 172.21.15.7:0/11911966 learned_addr learned my addr 172.21.15.7:0/11911966 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:45.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d2ceb2640 1 --2- 172.21.15.7:0/11911966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 0x55b1bad02fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d27fff640 1 --2- 172.21.15.7:0/11911966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba92b390 0x55b1bad036d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d27fff640 1 -- 172.21.15.7:0/11911966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 msgr2=0x55b1bad02fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d27fff640 1 --2- 172.21.15.7:0/11911966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 0x55b1bad02fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d27fff640 1 -- 172.21.15.7:0/11911966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba92b390 msgr2=0x55b1bad036d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d27fff640 1 --2- 172.21.15.7:0/11911966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba92b390 0x55b1bad036d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.654+0000 7f9d27fff640 1 -- 172.21.15.7:0/11911966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1bad7aa90 con 0x55b1ba90a9f0 2024-09-21T05:59:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d27fff640 1 --2- 172.21.15.7:0/11911966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba90a9f0 0x55b1bad07aa0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400b9e0 tx=0x7f9d140135c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e18e78871b8697 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d07fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d07fff640 1 -- 172.21.15.7:0/11911966 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d140119b0 con 0x55b1ba90a9f0 2024-09-21T05:59:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d07fff640 1 -- 172.21.15.7:0/11911966 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9d14005040 con 0x55b1ba90a9f0 2024-09-21T05:59:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d3568a740 1 -- 172.21.15.7:0/11911966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d14013410 con 0x55b1ba90a9f0 2024-09-21T05:59:45.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d07fff640 1 -- 172.21.15.7:0/11911966 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9d14005240 con 0x55b1ba90a9f0 2024-09-21T05:59:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d3568a740 10 client.16800 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d3568a740 1 -- 172.21.15.7:0/11911966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b1bad7bbc0 con 0x55b1ba90a9f0 2024-09-21T05:59:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d07fff640 1 -- 172.21.15.7:0/11911966 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d14013410 con 0x55b1ba90a9f0 2024-09-21T05:59:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d07fff640 1 -- 172.21.15.7:0/11911966 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9d1400f040 con 0x55b1ba90a9f0 2024-09-21T05:59:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d3568a740 10 client.16800 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d3568a740 10 client.16800 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:59:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d3568a740 20 client.16800 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d3568a740 1 --2- 172.21.15.7:0/11911966 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b1ba94c070 0x55b1bad7e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d3568a740 4 client.16800 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:59:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.655+0000 7f9d3568a740 1 -- 172.21.15.7:0/11911966 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b1bac678a0 con 0x55b1ba94c070 2024-09-21T05:59:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.656+0000 7f9d2ceb2640 1 --2- 172.21.15.7:0/11911966 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b1ba94c070 0x55b1bad7e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:45.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.656+0000 7f9d2ceb2640 1 --2- 172.21.15.7:0/11911966 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b1ba94c070 0x55b1bad7e100 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9b56876dae52daae server_cookie=7aa84bc2136bf223 in_seq=0 out_seq=0 2024-09-21T05:59:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.656+0000 7f9d07fff640 10 client.16800 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.656+0000 7f9d07fff640 1 -- 172.21.15.7:0/11911966 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b1bac678a0 con 0x55b1ba94c070 2024-09-21T05:59:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.656+0000 7f9d07fff640 10 client.16800 handle_command_reply: tid=0 2024-09-21T05:59:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.657+0000 7f9d3568a740 1 client.16800 shutdown 2024-09-21T05:59:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.657+0000 7f9d3568a740 1 -- 172.21.15.7:0/11911966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba90a9f0 msgr2=0x55b1bad07aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.657+0000 7f9d3568a740 1 --2- 172.21.15.7:0/11911966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba90a9f0 0x55b1bad07aa0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400b9e0 tx=0x7f9d140135c0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.657+0000 7f9d3568a740 1 -- 172.21.15.7:0/11911966 shutdown_connections 2024-09-21T05:59:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.657+0000 7f9d3568a740 1 --2- 172.21.15.7:0/11911966 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b1ba94c070 0x55b1bad7e100 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.657+0000 7f9d3568a740 1 --2- 172.21.15.7:0/11911966 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b1ba92b390 0x55b1bad036d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.657+0000 7f9d3568a740 1 --2- 172.21.15.7:0/11911966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b1ba9231b0 0x55b1bad02fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.657+0000 7f9d3568a740 1 --2- 172.21.15.7:0/11911966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1ba90a9f0 0x55b1bad07aa0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.657+0000 7f9d3568a740 1 -- 172.21.15.7:0/11911966 >> 172.21.15.7:0/11911966 conn(0x55b1ba940460 msgr2=0x55b1bad009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:45.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.657+0000 7f9d07fff640 0 client.16800 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:45.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.657+0000 7f9d3568a740 1 -- 172.21.15.7:0/11911966 shutdown_connections 2024-09-21T05:59:45.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.657+0000 7f9d3568a740 1 -- 172.21.15.7:0/11911966 wait complete. 2024-09-21T05:59:45.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.657+0000 7f9d3568a740 20 client.16800 trim_cache size 0 max 16384 2024-09-21T05:59:45.664 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:59:45.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.658+0000 7f9d2f116640 1 -- 172.21.15.7:0/3415351498 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9d180b6680 msgr2=0x7f9d180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:45.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.658+0000 7f9d2f116640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9d180b6680 0x7f9d180b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9d200adc30 tx=0x7f9d200a2500 comp rx=0 tx=0).stop 2024-09-21T05:59:45.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.658+0000 7f9d2f116640 1 -- 172.21.15.7:0/3415351498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28109df0 msgr2=0x7f9d2819fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:45.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.658+0000 7f9d2f116640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28109df0 0x7f9d2819fd10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000eb10 tx=0x7f9d2000c2d0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.658+0000 7f9d2f116640 1 -- 172.21.15.7:0/3415351498 shutdown_connections 2024-09-21T05:59:45.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.658+0000 7f9d2f116640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9d180b6680 0x7f9d180b8b90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.658+0000 7f9d2f116640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28109df0 0x7f9d2819fd10 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.658+0000 7f9d2f116640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d281094a0 0x7f9d2819aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.658+0000 7f9d2f116640 1 --2- 172.21.15.7:0/3415351498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d28103b60 0x7f9d2819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:45.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.658+0000 7f9d2f116640 1 -- 172.21.15.7:0/3415351498 >> 172.21.15.7:0/3415351498 conn(0x7f9d2807b850 msgr2=0x7f9d28107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:45.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.658+0000 7f9d2f116640 1 -- 172.21.15.7:0/3415351498 shutdown_connections 2024-09-21T05:59:45.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:45.658+0000 7f9d2f116640 1 -- 172.21.15.7:0/3415351498 wait complete. 2024-09-21T05:59:46.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:45 smithi027 ceph-mon[34364]: pgmap v494: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8 op/s 2024-09-21T05:59:46.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:45 smithi007 ceph-mon[30983]: pgmap v494: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8 op/s 2024-09-21T05:59:46.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:45 smithi119 ceph-mon[34833]: pgmap v494: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8 op/s 2024-09-21T05:59:46.463 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T05:59:46.729 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.240+0000 7f4d91e32640 1 -- 172.21.15.7:0/1925278967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d8c109df0 msgr2=0x7f4d8c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.240+0000 7f4d91e32640 1 --2- 172.21.15.7:0/1925278967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d8c109df0 0x7f4d8c110620 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009ca0 tx=0x7f4d8402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.240+0000 7f4d91e32640 1 -- 172.21.15.7:0/1925278967 shutdown_connections 2024-09-21T05:59:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.240+0000 7f4d91e32640 1 --2- 172.21.15.7:0/1925278967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d8c109df0 0x7f4d8c110620 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.240+0000 7f4d91e32640 1 --2- 172.21.15.7:0/1925278967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d8c1094a0 0x7f4d8c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.240+0000 7f4d91e32640 1 --2- 172.21.15.7:0/1925278967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d8c103b60 0x7f4d8c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.240+0000 7f4d91e32640 1 -- 172.21.15.7:0/1925278967 >> 172.21.15.7:0/1925278967 conn(0x7f4d8c07b850 msgr2=0x7f4d8c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.240+0000 7f4d91e32640 1 -- 172.21.15.7:0/1925278967 shutdown_connections 2024-09-21T05:59:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.240+0000 7f4d91e32640 1 -- 172.21.15.7:0/1925278967 wait complete. 2024-09-21T05:59:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.241+0000 7f4d91e32640 1 Processor -- start 2024-09-21T05:59:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.241+0000 7f4d91e32640 1 -- start start 2024-09-21T05:59:47.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.241+0000 7f4d91e32640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d8c103b60 0x7f4d8c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.241+0000 7f4d91e32640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d8c1094a0 0x7f4d8c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.241+0000 7f4d91e32640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d8c109df0 0x7f4d8c19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.241+0000 7f4d91e32640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c113ab0 con 0x7f4d8c109df0 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.241+0000 7f4d91e32640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c113930 con 0x7f4d8c103b60 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.241+0000 7f4d91e32640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c113c30 con 0x7f4d8c1094a0 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.242+0000 7f4d8bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d8c109df0 0x7f4d8c19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.242+0000 7f4d8bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d8c109df0 0x7f4d8c19fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39996/0 (socket says 172.21.15.7:39996) 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.242+0000 7f4d8affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d8c1094a0 0x7f4d8c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.242+0000 7f4d8bfff640 1 -- 172.21.15.7:0/80753097 learned_addr learned my addr 172.21.15.7:0/80753097 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.242+0000 7f4d8b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d8c103b60 0x7f4d8c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.242+0000 7f4d8bfff640 1 -- 172.21.15.7:0/80753097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d8c1094a0 msgr2=0x7f4d8c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.242+0000 7f4d8bfff640 1 --2- 172.21.15.7:0/80753097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d8c1094a0 0x7f4d8c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.242+0000 7f4d8bfff640 1 -- 172.21.15.7:0/80753097 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d8c103b60 msgr2=0x7f4d8c19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.242+0000 7f4d8bfff640 1 --2- 172.21.15.7:0/80753097 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d8c103b60 0x7f4d8c19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.242+0000 7f4d8bfff640 1 -- 172.21.15.7:0/80753097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c1a03d0 con 0x7f4d8c109df0 2024-09-21T05:59:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.242+0000 7f4d8bfff640 1 --2- 172.21.15.7:0/80753097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d8c109df0 0x7f4d8c19fca0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4d84005cc0 tx=0x7f4d8402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.242+0000 7f4d88ff9640 1 -- 172.21.15.7:0/80753097 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84003bf0 con 0x7f4d8c109df0 2024-09-21T05:59:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.243+0000 7f4d91e32640 1 -- 172.21.15.7:0/80753097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8c1a0660 con 0x7f4d8c109df0 2024-09-21T05:59:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.243+0000 7f4d88ff9640 1 -- 172.21.15.7:0/80753097 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d84003d90 con 0x7f4d8c109df0 2024-09-21T05:59:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.243+0000 7f4d88ff9640 1 -- 172.21.15.7:0/80753097 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8402fbc0 con 0x7f4d8c109df0 2024-09-21T05:59:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.243+0000 7f4d91e32640 1 -- 172.21.15.7:0/80753097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8c1a6e20 con 0x7f4d8c109df0 2024-09-21T05:59:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.246+0000 7f4d983a6740 1 Processor -- start 2024-09-21T05:59:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.246+0000 7f4d88ff9640 1 -- 172.21.15.7:0/80753097 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f4d8402fd60 con 0x7f4d8c109df0 2024-09-21T05:59:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.246+0000 7f4d983a6740 1 -- start start 2024-09-21T05:59:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.246+0000 7f4d983a6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5f5070 0x55a4cb99c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.246+0000 7f4d983a6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb99cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.246+0000 7f4d983a6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5d4390 0x55a4cb99d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.246+0000 7f4d983a6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a4cb912ea0 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.246+0000 7f4d983a6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a4cb9022d0 con 0x55a4cb5f5070 2024-09-21T05:59:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.246+0000 7f4d983a6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a4cb9060e0 con 0x55a4cb5d4390 2024-09-21T05:59:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d8b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb99cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d8b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb99cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40006/0 (socket says 172.21.15.7:40006) 2024-09-21T05:59:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/2000676133 learned_addr learned my addr 172.21.15.7:0/2000676133 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d8affd640 1 --2- 172.21.15.7:0/2000676133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5d4390 0x55a4cb99d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d8affd640 1 --2- 172.21.15.7:0/2000676133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5f5070 0x55a4cb99c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/2000676133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5d4390 msgr2=0x55a4cb99d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d8b7fe640 1 --2- 172.21.15.7:0/2000676133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5d4390 0x55a4cb99d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/2000676133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5f5070 msgr2=0x55a4cb99c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d8b7fe640 1 --2- 172.21.15.7:0/2000676133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5f5070 0x55a4cb99c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/2000676133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4cb660650 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d88ff9640 1 --2- 172.21.15.7:0/80753097 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4d740b6680 0x7f4d740b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d8b7fe640 1 --2- 172.21.15.7:0/2000676133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb99cbe0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00bd50 tx=0x7f4d7c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc073a820d116bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d8affd640 1 --2- 172.21.15.7:0/80753097 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4d740b6680 0x7f4d740b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d88ff9640 1 -- 172.21.15.7:0/80753097 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4d84108b70 con 0x7f4d8c109df0 2024-09-21T05:59:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.247+0000 7f4d71ffb640 1 -- 172.21.15.7:0/2000676133 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c005220 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.248+0000 7f4d71ffb640 1 -- 172.21.15.7:0/2000676133 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d7c00be40 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.248+0000 7f4d71ffb640 1 -- 172.21.15.7:0/2000676133 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0117c0 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.248+0000 7f4d983a6740 1 -- 172.21.15.7:0/2000676133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 msgr2=0x55a4cb99cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.248+0000 7f4d983a6740 1 --2- 172.21.15.7:0/2000676133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb99cbe0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00bd50 tx=0x7f4d7c0107a0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.248+0000 7f4d8affd640 1 --2- 172.21.15.7:0/80753097 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4d740b6680 0x7f4d740b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c109040 tx=0x7f4d8000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.249+0000 7f4d983a6740 1 -- 172.21.15.7:0/2000676133 shutdown_connections 2024-09-21T05:59:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.249+0000 7f4d983a6740 1 --2- 172.21.15.7:0/2000676133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb99cbe0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.249+0000 7f4d983a6740 1 --2- 172.21.15.7:0/2000676133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5d4390 0x55a4cb99d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.249+0000 7f4d983a6740 1 --2- 172.21.15.7:0/2000676133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5f5070 0x55a4cb99c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.249+0000 7f4d983a6740 1 -- 172.21.15.7:0/2000676133 >> 172.21.15.7:0/2000676133 conn(0x55a4cb5e9460 msgr2=0x55a4cb99a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.249+0000 7f4d983a6740 1 -- 172.21.15.7:0/2000676133 shutdown_connections 2024-09-21T05:59:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.249+0000 7f4d983a6740 1 -- 172.21.15.7:0/2000676133 wait complete. 2024-09-21T05:59:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.249+0000 7f4d983a6740 1 -- start start 2024-09-21T05:59:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.249+0000 7f4d983a6740 1 Processor -- start 2024-09-21T05:59:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d983a6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb9a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d983a6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5d4390 0x55a4cb9a8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d983a6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5f5070 0x55a4cb9b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d983a6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a4cb763700 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d983a6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a4cb89d160 con 0x55a4cb5d4390 2024-09-21T05:59:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d983a6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a4cb9aae80 con 0x55a4cb5f5070 2024-09-21T05:59:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d983a6740 10 client.0 _ll_register_callbacks cb 0x55a4cb8b69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d8b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb9a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d8b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb9a7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40018/0 (socket says 172.21.15.7:40018) 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/1705404597 learned_addr learned my addr 172.21.15.7:0/1705404597 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d8affd640 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5d4390 0x55a4cb9a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d8bfff640 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5f5070 0x55a4cb9b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/1705404597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5f5070 msgr2=0x55a4cb9b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d8b7fe640 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5f5070 0x55a4cb9b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/1705404597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5d4390 msgr2=0x55a4cb9a8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d8b7fe640 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5d4390 0x55a4cb9a8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/1705404597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4cb8cac90 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d8affd640 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5d4390 0x55a4cb9a8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d8bfff640 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5f5070 0x55a4cb9b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d8b7fe640 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb9a7dc0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c000c00 tx=0x7f4d7c011770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc62b71c183fa43b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.250+0000 7f4d6affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d6affd640 1 -- 172.21.15.7:0/1705404597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c02a060 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d983a6740 1 -- 172.21.15.7:0/1705404597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a4cb914df0 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d6affd640 1 -- 172.21.15.7:0/1705404597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4d7c011d70 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d6affd640 1 -- 172.21.15.7:0/1705404597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4d7c025460 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d983a6740 10 client.16812 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d983a6740 1 -- 172.21.15.7:0/1705404597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a4cb9b6bc0 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d6affd640 1 -- 172.21.15.7:0/1705404597 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a4cb914df0 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d6affd640 1 -- 172.21.15.7:0/1705404597 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4d7c02f730 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d983a6740 10 client.16812 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d983a6740 10 client.16812 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:59:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d983a6740 20 client.16812 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d983a6740 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a4cb5b39f0 0x55a4cb9b9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d983a6740 4 client.16812 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.251+0000 7f4d983a6740 1 -- 172.21.15.7:0/1705404597 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4cb9108a0 con 0x55a4cb5b39f0 2024-09-21T05:59:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.252+0000 7f4d8affd640 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a4cb5b39f0 0x55a4cb9b9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.252+0000 7f4d8affd640 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a4cb5b39f0 0x55a4cb9b9f80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=90ffc4a94b93f5c6 server_cookie=47bcfe12f2a67aad in_seq=0 out_seq=0 2024-09-21T05:59:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.252+0000 7f4d6affd640 10 client.16812 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d6affd640 1 -- 172.21.15.7:0/1705404597 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a4cb9108a0 con 0x55a4cb5b39f0 2024-09-21T05:59:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d6affd640 10 client.16812 handle_command_reply: tid=0 2024-09-21T05:59:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d983a6740 1 client.16812 shutdown 2024-09-21T05:59:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d983a6740 1 -- 172.21.15.7:0/1705404597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 msgr2=0x55a4cb9a7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d983a6740 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb9a7dc0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c000c00 tx=0x7f4d7c011770 comp rx=0 tx=0).stop 2024-09-21T05:59:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d983a6740 1 -- 172.21.15.7:0/1705404597 shutdown_connections 2024-09-21T05:59:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d983a6740 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a4cb5b39f0 0x55a4cb9b9f80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d983a6740 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5f5070 0x55a4cb9b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d983a6740 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5d4390 0x55a4cb9a8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d983a6740 1 --2- 172.21.15.7:0/1705404597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb9a7dc0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d983a6740 1 -- 172.21.15.7:0/1705404597 >> 172.21.15.7:0/1705404597 conn(0x55a4cb5e9460 msgr2=0x55a4cb99f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d6affd640 0 client.16812 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d983a6740 1 -- 172.21.15.7:0/1705404597 shutdown_connections 2024-09-21T05:59:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d983a6740 1 -- 172.21.15.7:0/1705404597 wait complete. 2024-09-21T05:59:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.253+0000 7f4d983a6740 20 client.16812 trim_cache size 0 max 16384 2024-09-21T05:59:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d983a6740 1 Processor -- start 2024-09-21T05:59:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d983a6740 1 -- start start 2024-09-21T05:59:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d983a6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb99feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d983a6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5d4390 0x55a4cb9b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d983a6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5f5070 0x55a4cb9a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d983a6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c1b1e70 con 0x55a4cb5d4390 2024-09-21T05:59:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d983a6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c1af740 con 0x55a4cb5f5070 2024-09-21T05:59:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d983a6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c1ad590 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d8affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5d4390 0x55a4cb9b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d8affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5d4390 0x55a4cb9b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40032/0 (socket says 172.21.15.7:40032) 2024-09-21T05:59:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d8affd640 1 -- 172.21.15.7:0/3554076774 learned_addr learned my addr 172.21.15.7:0/3554076774 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d8bfff640 1 --2- 172.21.15.7:0/3554076774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5f5070 0x55a4cb9a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d8b7fe640 1 --2- 172.21.15.7:0/3554076774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb99feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d8affd640 1 -- 172.21.15.7:0/3554076774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5cc1b0 msgr2=0x55a4cb99feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d8affd640 1 --2- 172.21.15.7:0/3554076774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb99feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d8affd640 1 -- 172.21.15.7:0/3554076774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5f5070 msgr2=0x55a4cb9a4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d8affd640 1 --2- 172.21.15.7:0/3554076774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5f5070 0x55a4cb9a4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d8affd640 1 -- 172.21.15.7:0/3554076774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4cb5b3c20 con 0x55a4cb5d4390 2024-09-21T05:59:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.267+0000 7f4d8bfff640 1 --2- 172.21.15.7:0/3554076774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5f5070 0x55a4cb9a4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.268+0000 7f4d8affd640 1 --2- 172.21.15.7:0/3554076774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5d4390 0x55a4cb9b40a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c06c760 tx=0x7f4d800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8adf85ae0607084a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.268+0000 7f4d717fa640 1 -- 172.21.15.7:0/3554076774 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80020e40 con 0x55a4cb5d4390 2024-09-21T05:59:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.268+0000 7f4d717fa640 1 -- 172.21.15.7:0/3554076774 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d8002b8d0 con 0x55a4cb5d4390 2024-09-21T05:59:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.268+0000 7f4d717fa640 1 -- 172.21.15.7:0/3554076774 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80012910 con 0x55a4cb5d4390 2024-09-21T05:59:47.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.269+0000 7f4d983a6740 1 -- 172.21.15.7:0/3554076774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5d4390 msgr2=0x55a4cb9b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.269+0000 7f4d983a6740 1 --2- 172.21.15.7:0/3554076774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5d4390 0x55a4cb9b40a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c06c760 tx=0x7f4d800046c0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.269+0000 7f4d983a6740 1 -- 172.21.15.7:0/3554076774 shutdown_connections 2024-09-21T05:59:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.269+0000 7f4d983a6740 1 --2- 172.21.15.7:0/3554076774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5d4390 0x55a4cb9b40a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.269+0000 7f4d983a6740 1 --2- 172.21.15.7:0/3554076774 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5f5070 0x55a4cb9a4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.269+0000 7f4d983a6740 1 --2- 172.21.15.7:0/3554076774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb99feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.269+0000 7f4d983a6740 1 -- 172.21.15.7:0/3554076774 >> 172.21.15.7:0/3554076774 conn(0x55a4cb5e9460 msgr2=0x55a4cb99f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.269+0000 7f4d983a6740 1 -- 172.21.15.7:0/3554076774 shutdown_connections 2024-09-21T05:59:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.269+0000 7f4d983a6740 1 -- 172.21.15.7:0/3554076774 wait complete. 2024-09-21T05:59:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.269+0000 7f4d983a6740 1 -- start start 2024-09-21T05:59:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.269+0000 7f4d983a6740 1 Processor -- start 2024-09-21T05:59:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d983a6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb9ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d983a6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5d4390 0x55a4cb9abe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d983a6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5f5070 0x55a4cba227d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d983a6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c1adc00 con 0x55a4cb5f5070 2024-09-21T05:59:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d983a6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c1af070 con 0x55a4cb5d4390 2024-09-21T05:59:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d983a6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c1ae2d0 con 0x55a4cb5cc1b0 2024-09-21T05:59:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d983a6740 10 client.0 _ll_register_callbacks cb 0x7f4d8000b9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d8bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5f5070 0x55a4cba227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d8b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb9ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d8bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5f5070 0x55a4cba227d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40038/0 (socket says 172.21.15.7:40038) 2024-09-21T05:59:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d8b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb9ab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:53470/0 (socket says 172.21.15.7:53470) 2024-09-21T05:59:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d8bfff640 1 -- 172.21.15.7:0/1363473954 learned_addr learned my addr 172.21.15.7:0/1363473954 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d8affd640 1 --2- 172.21.15.7:0/1363473954 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5d4390 0x55a4cb9abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d8bfff640 1 -- 172.21.15.7:0/1363473954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5cc1b0 msgr2=0x55a4cb9ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d8bfff640 1 --2- 172.21.15.7:0/1363473954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb9ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d8bfff640 1 -- 172.21.15.7:0/1363473954 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5d4390 msgr2=0x55a4cb9abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d8bfff640 1 --2- 172.21.15.7:0/1363473954 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5d4390 0x55a4cb9abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d8bfff640 1 -- 172.21.15.7:0/1363473954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4cba22d10 con 0x55a4cb5f5070 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d8bfff640 1 --2- 172.21.15.7:0/1363473954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5f5070 0x55a4cba227d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4d840ce9d0 tx=0x7f4d840ce4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35c56b319116de9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.270+0000 7f4d6affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d6affd640 1 -- 172.21.15.7:0/1363473954 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d840d3070 con 0x55a4cb5f5070 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d6affd640 1 -- 172.21.15.7:0/1363473954 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f4d84004610 con 0x55a4cb5f5070 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d983a6740 1 -- 172.21.15.7:0/1363473954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d8002b8d0 con 0x55a4cb5f5070 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d6affd640 1 -- 172.21.15.7:0/1363473954 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4d840e9050 con 0x55a4cb5f5070 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d983a6740 10 client.16818 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d983a6740 1 -- 172.21.15.7:0/1363473954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a4cba23ef0 con 0x55a4cb5f5070 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d6affd640 1 -- 172.21.15.7:0/1363473954 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d840ed080 con 0x55a4cb5f5070 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d6affd640 1 -- 172.21.15.7:0/1363473954 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4d840cdca0 con 0x55a4cb5f5070 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d983a6740 10 client.16818 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d983a6740 10 client.16818 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:59:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d983a6740 20 client.16818 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d983a6740 1 --2- 172.21.15.7:0/1363473954 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a4cb588da0 0x55a4cba26700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d983a6740 4 client.16818 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.271+0000 7f4d983a6740 1 -- 172.21.15.7:0/1363473954 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a4cb90dcd0 con 0x55a4cb588da0 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d8b7fe640 1 --2- 172.21.15.7:0/1363473954 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a4cb588da0 0x55a4cba26700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d6affd640 10 client.16818 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d8b7fe640 1 --2- 172.21.15.7:0/1363473954 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a4cb588da0 0x55a4cba26700 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5097b5ccede3cd86 server_cookie=41212b6dccd0df8e in_seq=0 out_seq=0 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d6affd640 1 -- 172.21.15.7:0/1363473954 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a4cb90dcd0 con 0x55a4cb588da0 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d6affd640 10 client.16818 handle_command_reply: tid=0 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d983a6740 1 client.16818 shutdown 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d983a6740 1 -- 172.21.15.7:0/1363473954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5f5070 msgr2=0x55a4cba227d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d983a6740 1 --2- 172.21.15.7:0/1363473954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5f5070 0x55a4cba227d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4d840ce9d0 tx=0x7f4d840ce4c0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d983a6740 1 -- 172.21.15.7:0/1363473954 shutdown_connections 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d983a6740 1 --2- 172.21.15.7:0/1363473954 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a4cb588da0 0x55a4cba26700 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d983a6740 1 --2- 172.21.15.7:0/1363473954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4cb5f5070 0x55a4cba227d0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d983a6740 1 --2- 172.21.15.7:0/1363473954 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a4cb5d4390 0x55a4cb9abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d983a6740 1 --2- 172.21.15.7:0/1363473954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a4cb5cc1b0 0x55a4cb9ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d983a6740 1 -- 172.21.15.7:0/1363473954 >> 172.21.15.7:0/1363473954 conn(0x55a4cb5e9460 msgr2=0x55a4cb99d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:47.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.272+0000 7f4d6affd640 0 client.16818 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:47.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.273+0000 7f4d983a6740 1 -- 172.21.15.7:0/1363473954 shutdown_connections 2024-09-21T05:59:47.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.273+0000 7f4d983a6740 1 -- 172.21.15.7:0/1363473954 wait complete. 2024-09-21T05:59:47.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.273+0000 7f4d983a6740 20 client.16818 trim_cache size 0 max 16384 2024-09-21T05:59:47.279 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:59:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.273+0000 7f4d91e32640 1 -- 172.21.15.7:0/80753097 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4d740b6680 msgr2=0x7f4d740b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.273+0000 7f4d91e32640 1 --2- 172.21.15.7:0/80753097 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4d740b6680 0x7f4d740b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c109040 tx=0x7f4d8000b390 comp rx=0 tx=0).stop 2024-09-21T05:59:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.273+0000 7f4d91e32640 1 -- 172.21.15.7:0/80753097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d8c109df0 msgr2=0x7f4d8c19fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.273+0000 7f4d91e32640 1 --2- 172.21.15.7:0/80753097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d8c109df0 0x7f4d8c19fca0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4d84005cc0 tx=0x7f4d8402f380 comp rx=0 tx=0).stop 2024-09-21T05:59:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.273+0000 7f4d91e32640 1 -- 172.21.15.7:0/80753097 shutdown_connections 2024-09-21T05:59:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.273+0000 7f4d91e32640 1 --2- 172.21.15.7:0/80753097 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4d740b6680 0x7f4d740b8b90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.273+0000 7f4d91e32640 1 --2- 172.21.15.7:0/80753097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d8c109df0 0x7f4d8c19fca0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.273+0000 7f4d91e32640 1 --2- 172.21.15.7:0/80753097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d8c1094a0 0x7f4d8c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.273+0000 7f4d91e32640 1 --2- 172.21.15.7:0/80753097 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d8c103b60 0x7f4d8c19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.273+0000 7f4d91e32640 1 -- 172.21.15.7:0/80753097 >> 172.21.15.7:0/80753097 conn(0x7f4d8c07b850 msgr2=0x7f4d8c1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.274+0000 7f4d91e32640 1 -- 172.21.15.7:0/80753097 shutdown_connections 2024-09-21T05:59:47.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:47.274+0000 7f4d91e32640 1 -- 172.21.15.7:0/80753097 wait complete. 2024-09-21T05:59:47.925 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T05:59:48.183 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:48.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:47 smithi027 ceph-mon[34364]: pgmap v495: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T05:59:48.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:47 smithi007 ceph-mon[30983]: pgmap v495: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T05:59:48.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:47 smithi119 ceph-mon[34833]: pgmap v495: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T05:59:48.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.684+0000 7f2c03f94640 1 -- 172.21.15.7:0/3657402336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bfc104860 msgr2=0x7f2bfc104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:48.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.684+0000 7f2c03f94640 1 --2- 172.21.15.7:0/3657402336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bfc104860 0x7f2bfc104c70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009900 tx=0x7f2bf802a410 comp rx=0 tx=0).stop 2024-09-21T05:59:48.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.684+0000 7f2c03f94640 1 -- 172.21.15.7:0/3657402336 shutdown_connections 2024-09-21T05:59:48.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.684+0000 7f2c03f94640 1 --2- 172.21.15.7:0/3657402336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bfc10de10 0x7f2bfc1102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.684+0000 7f2c03f94640 1 --2- 172.21.15.7:0/3657402336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bfc105290 0x7f2bfc10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.684+0000 7f2c03f94640 1 --2- 172.21.15.7:0/3657402336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bfc104860 0x7f2bfc104c70 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.684+0000 7f2c03f94640 1 -- 172.21.15.7:0/3657402336 >> 172.21.15.7:0/3657402336 conn(0x7f2bfc079730 msgr2=0x7f2bfc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:48.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.684+0000 7f2c03f94640 1 -- 172.21.15.7:0/3657402336 shutdown_connections 2024-09-21T05:59:48.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.684+0000 7f2c03f94640 1 -- 172.21.15.7:0/3657402336 wait complete. 2024-09-21T05:59:48.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.685+0000 7f2c03f94640 1 Processor -- start 2024-09-21T05:59:48.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.685+0000 7f2c03f94640 1 -- start start 2024-09-21T05:59:48.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.685+0000 7f2c03f94640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bfc104860 0x7f2bfc19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.685+0000 7f2c03f94640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bfc105290 0x7f2bfc19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.685+0000 7f2c03f94640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bfc10de10 0x7f2bfc19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c03f94640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc113ae0 con 0x7f2bfc104860 2024-09-21T05:59:48.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c03f94640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc113960 con 0x7f2bfc10de10 2024-09-21T05:59:48.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c03f94640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc113c60 con 0x7f2bfc105290 2024-09-21T05:59:48.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c01d30640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bfc104860 0x7f2bfc19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c01d30640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bfc104860 0x7f2bfc19a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43200/0 (socket says 172.21.15.7:43200) 2024-09-21T05:59:48.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c01d30640 1 -- 172.21.15.7:0/2005951499 learned_addr learned my addr 172.21.15.7:0/2005951499 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:48.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c0152f640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bfc105290 0x7f2bfc19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c02531640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bfc10de10 0x7f2bfc19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c01d30640 1 -- 172.21.15.7:0/2005951499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bfc105290 msgr2=0x7f2bfc19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:48.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c01d30640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bfc105290 0x7f2bfc19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c01d30640 1 -- 172.21.15.7:0/2005951499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bfc10de10 msgr2=0x7f2bfc19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:48.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c01d30640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bfc10de10 0x7f2bfc19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c01d30640 1 -- 172.21.15.7:0/2005951499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bfc1a04c0 con 0x7f2bfc104860 2024-09-21T05:59:48.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c02531640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bfc10de10 0x7f2bfc19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:48.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c01d30640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bfc104860 0x7f2bfc19a550 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8005940 tx=0x7f2bf80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:48.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2bf2ffd640 1 -- 172.21.15.7:0/2005951499 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf803f030 con 0x7f2bfc104860 2024-09-21T05:59:48.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2c03f94640 1 -- 172.21.15.7:0/2005951499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bfc1a0750 con 0x7f2bfc104860 2024-09-21T05:59:48.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2bf2ffd640 1 -- 172.21.15.7:0/2005951499 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bf8003cb0 con 0x7f2bfc104860 2024-09-21T05:59:48.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.686+0000 7f2bf2ffd640 1 -- 172.21.15.7:0/2005951499 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8035070 con 0x7f2bfc104860 2024-09-21T05:59:48.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.687+0000 7f2c03f94640 1 -- 172.21.15.7:0/2005951499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bfc1a6f10 con 0x7f2bfc104860 2024-09-21T05:59:48.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.689+0000 7f2bf2ffd640 1 -- 172.21.15.7:0/2005951499 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f2bf8042030 con 0x7f2bfc104860 2024-09-21T05:59:48.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.689+0000 7f2c0a508740 1 Processor -- start 2024-09-21T05:59:48.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.689+0000 7f2c0a508740 1 -- start start 2024-09-21T05:59:48.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0a508740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c7c070 0x5555d60236a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0a508740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c531b0 0x5555d6023be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0a508740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 0x5555d6024120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0a508740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5555d5f99ea0 con 0x5555d5c5b390 2024-09-21T05:59:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0a508740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5555d5f892d0 con 0x5555d5c531b0 2024-09-21T05:59:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0a508740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5555d5f8d0e0 con 0x5555d5c7c070 2024-09-21T05:59:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0152f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 0x5555d6024120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0152f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 0x5555d6024120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43206/0 (socket says 172.21.15.7:43206) 2024-09-21T05:59:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0152f640 1 -- 172.21.15.7:0/2661703326 learned_addr learned my addr 172.21.15.7:0/2661703326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c01d30640 1 --2- 172.21.15.7:0/2661703326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c531b0 0x5555d6023be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c02531640 1 --2- 172.21.15.7:0/2661703326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c7c070 0x5555d60236a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0152f640 1 -- 172.21.15.7:0/2661703326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c7c070 msgr2=0x5555d60236a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0152f640 1 --2- 172.21.15.7:0/2661703326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c7c070 0x5555d60236a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0152f640 1 -- 172.21.15.7:0/2661703326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c531b0 msgr2=0x5555d6023be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0152f640 1 --2- 172.21.15.7:0/2661703326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c531b0 0x5555d6023be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0152f640 1 -- 172.21.15.7:0/2661703326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555d5ce7650 con 0x5555d5c5b390 2024-09-21T05:59:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2bf2ffd640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2be80b6680 0x7f2be80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c02531640 1 --2- 172.21.15.7:0/2661703326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c7c070 0x5555d60236a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c02531640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2be80b6680 0x7f2be80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.690+0000 7f2c0152f640 1 --2- 172.21.15.7:0/2661703326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 0x5555d6024120 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00bc30 tx=0x7f2bec0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414d9ba71716bcdb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.691+0000 7f2bf2ffd640 1 -- 172.21.15.7:0/2005951499 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f2bf8107f50 con 0x7f2bfc104860 2024-09-21T05:59:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.691+0000 7f2be7fff640 1 -- 172.21.15.7:0/2661703326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec01c480 con 0x5555d5c5b390 2024-09-21T05:59:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.691+0000 7f2be7fff640 1 -- 172.21.15.7:0/2661703326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bec01cad0 con 0x5555d5c5b390 2024-09-21T05:59:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.691+0000 7f2be7fff640 1 -- 172.21.15.7:0/2661703326 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec011a70 con 0x5555d5c5b390 2024-09-21T05:59:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.692+0000 7f2c0a508740 1 -- 172.21.15.7:0/2661703326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 msgr2=0x5555d6024120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.692+0000 7f2c02531640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2be80b6680 0x7f2be80b8b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009f90 tx=0x7f2bf40095b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.692+0000 7f2c0a508740 1 --2- 172.21.15.7:0/2661703326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 0x5555d6024120 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00bc30 tx=0x7f2bec0107a0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.692+0000 7f2c0a508740 1 -- 172.21.15.7:0/2661703326 shutdown_connections 2024-09-21T05:59:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.692+0000 7f2c0a508740 1 --2- 172.21.15.7:0/2661703326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 0x5555d6024120 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.692+0000 7f2c0a508740 1 --2- 172.21.15.7:0/2661703326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c531b0 0x5555d6023be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.692+0000 7f2c0a508740 1 --2- 172.21.15.7:0/2661703326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c7c070 0x5555d60236a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.692+0000 7f2c0a508740 1 -- 172.21.15.7:0/2661703326 >> 172.21.15.7:0/2661703326 conn(0x5555d5c70460 msgr2=0x5555d6021590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.692+0000 7f2c0a508740 1 -- 172.21.15.7:0/2661703326 shutdown_connections 2024-09-21T05:59:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.692+0000 7f2c0a508740 1 -- 172.21.15.7:0/2661703326 wait complete. 2024-09-21T05:59:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.692+0000 7f2c0a508740 1 -- start start 2024-09-21T05:59:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.692+0000 7f2c0a508740 1 Processor -- start 2024-09-21T05:59:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0a508740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c531b0 0x5555d602ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0a508740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 0x5555d602f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0a508740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d602f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0a508740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5555d5dea700 con 0x5555d5c5b390 2024-09-21T05:59:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0a508740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5555d5f24160 con 0x5555d5c7c070 2024-09-21T05:59:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0a508740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5555d6031e80 con 0x5555d5c531b0 2024-09-21T05:59:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0a508740 10 client.0 _ll_register_callbacks cb 0x5555d5f3d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0152f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 0x5555d602f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0152f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 0x5555d602f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43210/0 (socket says 172.21.15.7:43210) 2024-09-21T05:59:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0152f640 1 -- 172.21.15.7:0/3642539492 learned_addr learned my addr 172.21.15.7:0/3642539492 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c01d30640 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c531b0 0x5555d602ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c02531640 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d602f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0152f640 1 -- 172.21.15.7:0/3642539492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c531b0 msgr2=0x5555d602ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0152f640 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c531b0 0x5555d602ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0152f640 1 -- 172.21.15.7:0/3642539492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 msgr2=0x5555d602f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0152f640 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d602f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c0152f640 1 -- 172.21.15.7:0/3642539492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555d5f51c90 con 0x5555d5c5b390 2024-09-21T05:59:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.693+0000 7f2c01d30640 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c531b0 0x5555d602ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.694+0000 7f2c0152f640 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 0x5555d602f200 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2bec000c00 tx=0x7f2bec011580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fb612dbd686fc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.694+0000 7f2be57fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.694+0000 7f2be57fa640 1 -- 172.21.15.7:0/3642539492 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec02b060 con 0x5555d5c5b390 2024-09-21T05:59:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.694+0000 7f2be57fa640 1 -- 172.21.15.7:0/3642539492 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f2bec01c850 con 0x5555d5c5b390 2024-09-21T05:59:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.694+0000 7f2c0a508740 1 -- 172.21.15.7:0/3642539492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bec01cad0 con 0x5555d5c5b390 2024-09-21T05:59:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.694+0000 7f2be57fa640 1 -- 172.21.15.7:0/3642539492 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2bec004020 con 0x5555d5c5b390 2024-09-21T05:59:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.694+0000 7f2c0a508740 10 client.16830 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.694+0000 7f2c0a508740 1 -- 172.21.15.7:0/3642539492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5555d603da70 con 0x5555d5c5b390 2024-09-21T05:59:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.694+0000 7f2be57fa640 1 -- 172.21.15.7:0/3642539492 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bec01cad0 con 0x5555d5c5b390 2024-09-21T05:59:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.694+0000 7f2be57fa640 1 -- 172.21.15.7:0/3642539492 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2bec011880 con 0x5555d5c5b390 2024-09-21T05:59:48.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.695+0000 7f2c0a508740 10 client.16830 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:48.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.695+0000 7f2c0a508740 10 client.16830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:48.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.695+0000 7f2c0a508740 20 client.16830 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:48.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.695+0000 7f2c0a508740 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5555d5c3a9f0 0x5555d6040e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.695+0000 7f2c0a508740 4 client.16830 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:48.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.695+0000 7f2c0a508740 1 -- 172.21.15.7:0/3642539492 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555d5f9bdf0 con 0x5555d5c3a9f0 2024-09-21T05:59:48.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.695+0000 7f2c01d30640 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5555d5c3a9f0 0x5555d6040e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.695+0000 7f2be57fa640 10 client.16830 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:48.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.695+0000 7f2c01d30640 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5555d5c3a9f0 0x5555d6040e80 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65972e02ba4044ac server_cookie=fc1bcd5f9a25527d in_seq=0 out_seq=0 2024-09-21T05:59:48.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.696+0000 7f2be57fa640 1 -- 172.21.15.7:0/3642539492 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5555d5f9bdf0 con 0x5555d5c3a9f0 2024-09-21T05:59:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.696+0000 7f2be57fa640 10 client.16830 handle_command_reply: tid=0 2024-09-21T05:59:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.696+0000 7f2c0a508740 1 client.16830 shutdown 2024-09-21T05:59:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.696+0000 7f2c0a508740 1 -- 172.21.15.7:0/3642539492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 msgr2=0x5555d602f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.696+0000 7f2c0a508740 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 0x5555d602f200 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2bec000c00 tx=0x7f2bec011580 comp rx=0 tx=0).stop 2024-09-21T05:59:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.696+0000 7f2c0a508740 1 -- 172.21.15.7:0/3642539492 shutdown_connections 2024-09-21T05:59:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.696+0000 7f2c0a508740 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5555d5c3a9f0 0x5555d6040e80 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.696+0000 7f2c0a508740 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c5b390 0x5555d602f200 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.696+0000 7f2be57fa640 0 client.16830 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.696+0000 7f2c0a508740 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d602f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.696+0000 7f2c0a508740 1 --2- 172.21.15.7:0/3642539492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c531b0 0x5555d602ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.696+0000 7f2c0a508740 1 -- 172.21.15.7:0/3642539492 >> 172.21.15.7:0/3642539492 conn(0x5555d5c70460 msgr2=0x5555d6026830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.696+0000 7f2c0a508740 1 -- 172.21.15.7:0/3642539492 shutdown_connections 2024-09-21T05:59:48.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.697+0000 7f2c0a508740 1 -- 172.21.15.7:0/3642539492 wait complete. 2024-09-21T05:59:48.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.697+0000 7f2c0a508740 20 client.16830 trim_cache size 0 max 16384 2024-09-21T05:59:48.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.710+0000 7f2c0a508740 1 Processor -- start 2024-09-21T05:59:48.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.710+0000 7f2c0a508740 1 -- start start 2024-09-21T05:59:48.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.710+0000 7f2c0a508740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 0x5555d602ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.710+0000 7f2c0a508740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c5b390 0x5555d602efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.710+0000 7f2c0a508740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d602beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.710+0000 7f2c0a508740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc1b1e40 con 0x5555d5c531b0 2024-09-21T05:59:48.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.710+0000 7f2c0a508740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc1af710 con 0x5555d5c7c070 2024-09-21T05:59:48.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.710+0000 7f2c0a508740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc1ad560 con 0x5555d5c5b390 2024-09-21T05:59:48.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.710+0000 7f2c01d30640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 0x5555d602ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.710+0000 7f2c01d30640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 0x5555d602ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43220/0 (socket says 172.21.15.7:43220) 2024-09-21T05:59:48.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.710+0000 7f2c01d30640 1 -- 172.21.15.7:0/2564045427 learned_addr learned my addr 172.21.15.7:0/2564045427 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:48.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.710+0000 7f2c0152f640 1 --2- 172.21.15.7:0/2564045427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c5b390 0x5555d602efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.711+0000 7f2c02531640 1 --2- 172.21.15.7:0/2564045427 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d602beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.711+0000 7f2c01d30640 1 -- 172.21.15.7:0/2564045427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c5b390 msgr2=0x5555d602efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:48.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.711+0000 7f2c01d30640 1 --2- 172.21.15.7:0/2564045427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c5b390 0x5555d602efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.711+0000 7f2c01d30640 1 -- 172.21.15.7:0/2564045427 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 msgr2=0x5555d602beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:48.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.711+0000 7f2c01d30640 1 --2- 172.21.15.7:0/2564045427 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d602beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.711+0000 7f2c01d30640 1 -- 172.21.15.7:0/2564045427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555d60317f0 con 0x5555d5c531b0 2024-09-21T05:59:48.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.711+0000 7f2c02531640 1 --2- 172.21.15.7:0/2564045427 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d602beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:48.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.711+0000 7f2c01d30640 1 --2- 172.21.15.7:0/2564045427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 0x5555d602ea70 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8006010 tx=0x7f2bf80045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0e31430b525267 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:48.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.711+0000 7f2be77fe640 1 -- 172.21.15.7:0/2564045427 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8049040 con 0x5555d5c531b0 2024-09-21T05:59:48.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.711+0000 7f2be77fe640 1 -- 172.21.15.7:0/2564045427 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bf80cd930 con 0x5555d5c531b0 2024-09-21T05:59:48.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.711+0000 7f2be77fe640 1 -- 172.21.15.7:0/2564045427 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80ca090 con 0x5555d5c531b0 2024-09-21T05:59:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.712+0000 7f2c0a508740 1 -- 172.21.15.7:0/2564045427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 msgr2=0x5555d602ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.712+0000 7f2c0a508740 1 --2- 172.21.15.7:0/2564045427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 0x5555d602ea70 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8006010 tx=0x7f2bf80045a0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.712+0000 7f2c0a508740 1 -- 172.21.15.7:0/2564045427 shutdown_connections 2024-09-21T05:59:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.712+0000 7f2c0a508740 1 --2- 172.21.15.7:0/2564045427 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d602beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.712+0000 7f2c0a508740 1 --2- 172.21.15.7:0/2564045427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c5b390 0x5555d602efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.712+0000 7f2c0a508740 1 --2- 172.21.15.7:0/2564045427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 0x5555d602ea70 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.712+0000 7f2c0a508740 1 -- 172.21.15.7:0/2564045427 >> 172.21.15.7:0/2564045427 conn(0x5555d5c70460 msgr2=0x5555d602d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.712+0000 7f2c0a508740 1 -- 172.21.15.7:0/2564045427 shutdown_connections 2024-09-21T05:59:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.712+0000 7f2c0a508740 1 -- 172.21.15.7:0/2564045427 wait complete. 2024-09-21T05:59:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.712+0000 7f2c0a508740 1 -- start start 2024-09-21T05:59:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.712+0000 7f2c0a508740 1 Processor -- start 2024-09-21T05:59:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c0a508740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 0x5555d6044860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c0a508740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c5b390 0x5555d6041d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c0a508740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d6042440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c0a508740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc1adbd0 con 0x5555d5c531b0 2024-09-21T05:59:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c0a508740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc1af040 con 0x5555d5c7c070 2024-09-21T05:59:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c0a508740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc1ae2a0 con 0x5555d5c5b390 2024-09-21T05:59:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c0a508740 10 client.0 _ll_register_callbacks cb 0x7f2bec00ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c01d30640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 0x5555d6044860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c01d30640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 0x5555d6044860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43224/0 (socket says 172.21.15.7:43224) 2024-09-21T05:59:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c01d30640 1 -- 172.21.15.7:0/3606436808 learned_addr learned my addr 172.21.15.7:0/3606436808 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c0152f640 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c5b390 0x5555d6041d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c02531640 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d6042440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c01d30640 1 -- 172.21.15.7:0/3606436808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c5b390 msgr2=0x5555d6041d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c01d30640 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c5b390 0x5555d6041d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c01d30640 1 -- 172.21.15.7:0/3606436808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 msgr2=0x5555d6042440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c01d30640 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d6042440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c01d30640 1 -- 172.21.15.7:0/3606436808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555d60aa600 con 0x5555d5c531b0 2024-09-21T05:59:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c02531640 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d6042440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2c01d30640 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 0x5555d6044860 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80cb090 tx=0x7f2bf802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457406ea73154d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.713+0000 7f2be57fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2be57fa640 1 -- 172.21.15.7:0/3606436808 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8049070 con 0x5555d5c531b0 2024-09-21T05:59:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2be57fa640 1 -- 172.21.15.7:0/3606436808 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f2bf80b50c0 con 0x5555d5c531b0 2024-09-21T05:59:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2c0a508740 1 -- 172.21.15.7:0/3606436808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bf80cd930 con 0x5555d5c531b0 2024-09-21T05:59:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2be57fa640 1 -- 172.21.15.7:0/3606436808 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2bf80d2900 con 0x5555d5c531b0 2024-09-21T05:59:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2c0a508740 10 client.16836 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2c0a508740 1 -- 172.21.15.7:0/3606436808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5555d60ab690 con 0x5555d5c531b0 2024-09-21T05:59:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2be57fa640 1 -- 172.21.15.7:0/3606436808 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bf80cd930 con 0x5555d5c531b0 2024-09-21T05:59:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2be57fa640 1 -- 172.21.15.7:0/3606436808 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2bf803bbf0 con 0x5555d5c531b0 2024-09-21T05:59:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2c0a508740 10 client.16836 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2c0a508740 10 client.16836 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2c0a508740 20 client.16836 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2c0a508740 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5555d5c0fda0 0x5555d60adb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2c0a508740 4 client.16836 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:59:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.714+0000 7f2c0a508740 1 -- 172.21.15.7:0/3606436808 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5555d5f978a0 con 0x5555d5c0fda0 2024-09-21T05:59:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2c0152f640 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5555d5c0fda0 0x5555d60adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2c0152f640 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5555d5c0fda0 0x5555d60adb20 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f9da0540c9d6113 server_cookie=439e6b451cb09ce7 in_seq=0 out_seq=0 2024-09-21T05:59:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2be57fa640 10 client.16836 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2be57fa640 1 -- 172.21.15.7:0/3606436808 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5555d5f978a0 con 0x5555d5c0fda0 2024-09-21T05:59:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2be57fa640 10 client.16836 handle_command_reply: tid=0 2024-09-21T05:59:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2c0a508740 1 client.16836 shutdown 2024-09-21T05:59:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2c0a508740 1 -- 172.21.15.7:0/3606436808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 msgr2=0x5555d6044860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2c0a508740 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 0x5555d6044860 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80cb090 tx=0x7f2bf802a410 comp rx=0 tx=0).stop 2024-09-21T05:59:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2c0a508740 1 -- 172.21.15.7:0/3606436808 shutdown_connections 2024-09-21T05:59:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2c0a508740 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5555d5c0fda0 0x5555d60adb20 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2c0a508740 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5555d5c7c070 0x5555d6042440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2c0a508740 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5555d5c5b390 0x5555d6041d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2c0a508740 1 --2- 172.21.15.7:0/3606436808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555d5c531b0 0x5555d6044860 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2be57fa640 0 client.16836 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.715+0000 7f2c0a508740 1 -- 172.21.15.7:0/3606436808 >> 172.21.15.7:0/3606436808 conn(0x5555d5c70460 msgr2=0x5555d602ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.716+0000 7f2c0a508740 1 -- 172.21.15.7:0/3606436808 shutdown_connections 2024-09-21T05:59:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.716+0000 7f2c0a508740 1 -- 172.21.15.7:0/3606436808 wait complete. 2024-09-21T05:59:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.716+0000 7f2c0a508740 20 client.16836 trim_cache size 0 max 16384 2024-09-21T05:59:48.724 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:59:48.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.716+0000 7f2c03f94640 1 -- 172.21.15.7:0/2005951499 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2be80b6680 msgr2=0x7f2be80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:48.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.716+0000 7f2c03f94640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2be80b6680 0x7f2be80b8b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009f90 tx=0x7f2bf40095b0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.716+0000 7f2c03f94640 1 -- 172.21.15.7:0/2005951499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bfc104860 msgr2=0x7f2bfc19a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:48.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.716+0000 7f2c03f94640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bfc104860 0x7f2bfc19a550 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8005940 tx=0x7f2bf80042f0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.716+0000 7f2c03f94640 1 -- 172.21.15.7:0/2005951499 shutdown_connections 2024-09-21T05:59:48.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.716+0000 7f2c03f94640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2be80b6680 0x7f2be80b8b90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.716+0000 7f2c03f94640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bfc10de10 0x7f2bfc19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.716+0000 7f2c03f94640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bfc105290 0x7f2bfc19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.716+0000 7f2c03f94640 1 --2- 172.21.15.7:0/2005951499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bfc104860 0x7f2bfc19a550 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:48.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.716+0000 7f2c03f94640 1 -- 172.21.15.7:0/2005951499 >> 172.21.15.7:0/2005951499 conn(0x7f2bfc079730 msgr2=0x7f2bfc1007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:48.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.717+0000 7f2c03f94640 1 -- 172.21.15.7:0/2005951499 shutdown_connections 2024-09-21T05:59:48.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:48.717+0000 7f2c03f94640 1 -- 172.21.15.7:0/2005951499 wait complete. 2024-09-21T05:59:50.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:49 smithi027 ceph-mon[34364]: pgmap v496: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:59:50.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:49 smithi007 ceph-mon[30983]: pgmap v496: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:59:50.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:49 smithi119 ceph-mon[34833]: pgmap v496: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T05:59:50.450 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T05:59:50.451 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T05:59:50.724 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:51.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.202+0000 7fee50504640 1 -- 172.21.15.7:0/4230488114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee48104a30 msgr2=0x7fee48104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:51.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.202+0000 7fee50504640 1 --2- 172.21.15.7:0/4230488114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee48104a30 0x7fee48104e40 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fee44009900 tx=0x7fee4402a410 comp rx=0 tx=0).stop 2024-09-21T05:59:51.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.203+0000 7fee50504640 1 -- 172.21.15.7:0/4230488114 shutdown_connections 2024-09-21T05:59:51.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.203+0000 7fee50504640 1 --2- 172.21.15.7:0/4230488114 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee4810de60 0x7fee48110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.203+0000 7fee50504640 1 --2- 172.21.15.7:0/4230488114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee48105380 0x7fee4810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.203+0000 7fee50504640 1 --2- 172.21.15.7:0/4230488114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee48104a30 0x7fee48104e40 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.203+0000 7fee50504640 1 -- 172.21.15.7:0/4230488114 >> 172.21.15.7:0/4230488114 conn(0x7fee48079760 msgr2=0x7fee48079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:51.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.203+0000 7fee50504640 1 -- 172.21.15.7:0/4230488114 shutdown_connections 2024-09-21T05:59:51.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.203+0000 7fee50504640 1 -- 172.21.15.7:0/4230488114 wait complete. 2024-09-21T05:59:51.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.203+0000 7fee50504640 1 Processor -- start 2024-09-21T05:59:51.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.203+0000 7fee50504640 1 -- start start 2024-09-21T05:59:51.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee50504640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee48104a30 0x7fee4819c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee50504640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee48105380 0x7fee4819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee50504640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee4810de60 0x7fee481a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee50504640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee48113b00 con 0x7fee48105380 2024-09-21T05:59:51.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee50504640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fee48113980 con 0x7fee4810de60 2024-09-21T05:59:51.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee50504640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fee48113c80 con 0x7fee48104a30 2024-09-21T05:59:51.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee4da9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee48105380 0x7fee4819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee4da9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee48105380 0x7fee4819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43246/0 (socket says 172.21.15.7:43246) 2024-09-21T05:59:51.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee4da9f640 1 -- 172.21.15.7:0/760133184 learned_addr learned my addr 172.21.15.7:0/760133184 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:51.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee4e2a0640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee48104a30 0x7fee4819c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee4eaa1640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee4810de60 0x7fee481a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee4da9f640 1 -- 172.21.15.7:0/760133184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee48104a30 msgr2=0x7fee4819c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:51.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee4da9f640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee48104a30 0x7fee4819c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee4da9f640 1 -- 172.21.15.7:0/760133184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee4810de60 msgr2=0x7fee481a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:51.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee4da9f640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee4810de60 0x7fee481a1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee4da9f640 1 -- 172.21.15.7:0/760133184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee481a26e0 con 0x7fee48105380 2024-09-21T05:59:51.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.204+0000 7fee4da9f640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee48105380 0x7fee4819cd10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fee38006fd0 tx=0x7fee3800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:51.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.205+0000 7fee3f7fe640 1 -- 172.21.15.7:0/760133184 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38011830 con 0x7fee48105380 2024-09-21T05:59:51.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.205+0000 7fee50504640 1 -- 172.21.15.7:0/760133184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee481a29d0 con 0x7fee48105380 2024-09-21T05:59:51.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.205+0000 7fee3f7fe640 1 -- 172.21.15.7:0/760133184 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee38016070 con 0x7fee48105380 2024-09-21T05:59:51.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.205+0000 7fee3f7fe640 1 -- 172.21.15.7:0/760133184 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38010e00 con 0x7fee48105380 2024-09-21T05:59:51.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.205+0000 7fee50504640 1 -- 172.21.15.7:0/760133184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee481a91b0 con 0x7fee48105380 2024-09-21T05:59:51.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.207+0000 7fee56a78740 1 Processor -- start 2024-09-21T05:59:51.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee56a78740 1 -- start start 2024-09-21T05:59:51.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee3f7fe640 1 -- 172.21.15.7:0/760133184 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fee3801b4a0 con 0x7fee48105380 2024-09-21T05:59:51.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee56a78740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ad4350 0x55f1c1e7b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee56a78740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 0x55f1c1e7b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee56a78740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 0x55f1c1e7beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee56a78740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f1c1df1e60 con 0x55f1c1aab490 2024-09-21T05:59:51.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee56a78740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f1c1de1290 con 0x55f1c1ab3670 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee56a78740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f1c1de50a0 con 0x55f1c1ad4350 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee4e2a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 0x55f1c1e7b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee4e2a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 0x55f1c1e7b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43248/0 (socket says 172.21.15.7:43248) 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee4e2a0640 1 -- 172.21.15.7:0/455329121 learned_addr learned my addr 172.21.15.7:0/455329121 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee4eaa1640 1 --2- 172.21.15.7:0/455329121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ad4350 0x55f1c1e7b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee4da9f640 1 --2- 172.21.15.7:0/455329121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 0x55f1c1e7beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee4e2a0640 1 -- 172.21.15.7:0/455329121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ad4350 msgr2=0x55f1c1e7b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee4e2a0640 1 --2- 172.21.15.7:0/455329121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ad4350 0x55f1c1e7b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee4e2a0640 1 -- 172.21.15.7:0/455329121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 msgr2=0x55f1c1e7beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee4e2a0640 1 --2- 172.21.15.7:0/455329121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 0x55f1c1e7beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee4e2a0640 1 -- 172.21.15.7:0/455329121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1c1b3f930 con 0x55f1c1aab490 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.208+0000 7fee4da9f640 1 --2- 172.21.15.7:0/455329121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 0x55f1c1e7beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.209+0000 7fee4e2a0640 1 --2- 172.21.15.7:0/455329121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 0x55f1c1e7b970 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fee4806c8f0 tx=0x7fee44032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8b94b06d721b1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.209+0000 7fee3f7fe640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fee340b6680 0x7fee340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.209+0000 7fee3cff9640 1 -- 172.21.15.7:0/455329121 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee44040070 con 0x55f1c1aab490 2024-09-21T05:59:51.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.209+0000 7fee4eaa1640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fee340b6680 0x7fee340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.209+0000 7fee3cff9640 1 -- 172.21.15.7:0/455329121 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee44005db0 con 0x55f1c1aab490 2024-09-21T05:59:51.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.209+0000 7fee3f7fe640 1 -- 172.21.15.7:0/760133184 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fee380e6b30 con 0x7fee48105380 2024-09-21T05:59:51.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.209+0000 7fee3cff9640 1 -- 172.21.15.7:0/455329121 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee44035040 con 0x55f1c1aab490 2024-09-21T05:59:51.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.210+0000 7fee56a78740 1 -- 172.21.15.7:0/455329121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 msgr2=0x55f1c1e7b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:51.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.210+0000 7fee4eaa1640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fee340b6680 0x7fee340b8b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fee40005fd0 tx=0x7fee40009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:51.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.210+0000 7fee56a78740 1 --2- 172.21.15.7:0/455329121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 0x55f1c1e7b970 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fee4806c8f0 tx=0x7fee44032df0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.210+0000 7fee56a78740 1 -- 172.21.15.7:0/455329121 shutdown_connections 2024-09-21T05:59:51.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.210+0000 7fee56a78740 1 --2- 172.21.15.7:0/455329121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 0x55f1c1e7b970 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.210+0000 7fee56a78740 1 --2- 172.21.15.7:0/455329121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 0x55f1c1e7beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.210+0000 7fee56a78740 1 --2- 172.21.15.7:0/455329121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ad4350 0x55f1c1e7b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.210+0000 7fee56a78740 1 -- 172.21.15.7:0/455329121 >> 172.21.15.7:0/455329121 conn(0x55f1c1ac8740 msgr2=0x55f1c1e79320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:51.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.210+0000 7fee56a78740 1 -- 172.21.15.7:0/455329121 shutdown_connections 2024-09-21T05:59:51.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.210+0000 7fee56a78740 1 -- 172.21.15.7:0/455329121 wait complete. 2024-09-21T05:59:51.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee56a78740 1 -- start start 2024-09-21T05:59:51.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee56a78740 1 Processor -- start 2024-09-21T05:59:51.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee56a78740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 0x55f1c1e86ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee56a78740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 0x55f1c1e87530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee56a78740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ad4350 0x55f1c1e92f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee56a78740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f1c1c42890 con 0x55f1c1aab490 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee56a78740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f1c1d7bd40 con 0x55f1c1ab3670 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee56a78740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f1c1e89bb0 con 0x55f1c1ad4350 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee56a78740 10 client.0 _ll_register_callbacks cb 0x55f1c1ddfc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee4e2a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 0x55f1c1e86ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee4e2a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 0x55f1c1e86ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43260/0 (socket says 172.21.15.7:43260) 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee4e2a0640 1 -- 172.21.15.7:0/1287441710 learned_addr learned my addr 172.21.15.7:0/1287441710 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee4da9f640 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 0x55f1c1e87530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.211+0000 7fee4eaa1640 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ad4350 0x55f1c1e92f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee4e2a0640 1 -- 172.21.15.7:0/1287441710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ad4350 msgr2=0x55f1c1e92f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee4e2a0640 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ad4350 0x55f1c1e92f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee4e2a0640 1 -- 172.21.15.7:0/1287441710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 msgr2=0x55f1c1e87530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:51.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee4e2a0640 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 0x55f1c1e87530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee4e2a0640 1 -- 172.21.15.7:0/1287441710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1c1e93470 con 0x55f1c1aab490 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee4eaa1640 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ad4350 0x55f1c1e92f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee4e2a0640 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 0x55f1c1e86ff0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fee44009900 tx=0x7fee4402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d318358a68796dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee31ffb640 1 -- 172.21.15.7:0/1287441710 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4404b070 con 0x55f1c1aab490 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee31ffb640 1 -- 172.21.15.7:0/1287441710 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fee440046c0 con 0x55f1c1aab490 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee56a78740 1 -- 172.21.15.7:0/1287441710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee44005db0 con 0x55f1c1aab490 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee31ffb640 1 -- 172.21.15.7:0/1287441710 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee44057050 con 0x55f1c1aab490 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee56a78740 10 client.16848 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.212+0000 7fee56a78740 1 -- 172.21.15.7:0/1287441710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1c1e95d10 con 0x55f1c1aab490 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.213+0000 7fee31ffb640 1 -- 172.21.15.7:0/1287441710 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee44005db0 con 0x55f1c1aab490 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.213+0000 7fee31ffb640 1 -- 172.21.15.7:0/1287441710 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fee4403c860 con 0x55f1c1aab490 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.213+0000 7fee56a78740 10 client.16848 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.213+0000 7fee56a78740 10 client.16848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.213+0000 7fee56a78740 20 client.16848 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.213+0000 7fee56a78740 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f1c1a92cd0 0x55f1c1e99070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.213+0000 7fee56a78740 4 client.16848 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.213+0000 7fee56a78740 1 -- 172.21.15.7:0/1287441710 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1c1df3db0 con 0x55f1c1a92cd0 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.213+0000 7fee4da9f640 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f1c1a92cd0 0x55f1c1e99070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.214+0000 7fee4da9f640 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f1c1a92cd0 0x55f1c1e99070 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90343ed1eb41fe2a server_cookie=c4357b6b15a0c7ae in_seq=0 out_seq=0 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.214+0000 7fee31ffb640 10 client.16848 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.214+0000 7fee31ffb640 1 -- 172.21.15.7:0/1287441710 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1c1df3db0 con 0x55f1c1a92cd0 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.214+0000 7fee31ffb640 10 client.16848 handle_command_reply: tid=0 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.215+0000 7fee56a78740 1 client.16848 shutdown 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.215+0000 7fee56a78740 1 -- 172.21.15.7:0/1287441710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 msgr2=0x55f1c1e86ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.215+0000 7fee56a78740 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 0x55f1c1e86ff0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fee44009900 tx=0x7fee4402a410 comp rx=0 tx=0).stop 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.215+0000 7fee56a78740 1 -- 172.21.15.7:0/1287441710 shutdown_connections 2024-09-21T05:59:51.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.215+0000 7fee56a78740 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f1c1a92cd0 0x55f1c1e99070 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.215+0000 7fee56a78740 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ad4350 0x55f1c1e92f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.215+0000 7fee56a78740 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 0x55f1c1e87530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.215+0000 7fee56a78740 1 --2- 172.21.15.7:0/1287441710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1aab490 0x55f1c1e86ff0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.215+0000 7fee56a78740 1 -- 172.21.15.7:0/1287441710 >> 172.21.15.7:0/1287441710 conn(0x55f1c1ac8740 msgr2=0x55f1c1e7e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:51.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.215+0000 7fee31ffb640 0 client.16848 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:51.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.215+0000 7fee56a78740 1 -- 172.21.15.7:0/1287441710 shutdown_connections 2024-09-21T05:59:51.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.215+0000 7fee56a78740 1 -- 172.21.15.7:0/1287441710 wait complete. 2024-09-21T05:59:51.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.215+0000 7fee56a78740 20 client.16848 trim_cache size 0 max 16384 2024-09-21T05:59:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.233+0000 7fee56a78740 1 Processor -- start 2024-09-21T05:59:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.233+0000 7fee56a78740 1 -- start start 2024-09-21T05:59:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.233+0000 7fee56a78740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1aab490 0x55f1c1e92e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.233+0000 7fee56a78740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ab3670 0x55f1c1e81550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.233+0000 7fee56a78740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 0x55f1c1e83fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.233+0000 7fee56a78740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee481b40e0 con 0x55f1c1ad4350 2024-09-21T05:59:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.233+0000 7fee56a78740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fee481b19b0 con 0x55f1c1aab490 2024-09-21T05:59:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.233+0000 7fee56a78740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fee481af800 con 0x55f1c1ab3670 2024-09-21T05:59:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.233+0000 7fee4eaa1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 0x55f1c1e83fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.233+0000 7fee4eaa1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 0x55f1c1e83fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43262/0 (socket says 172.21.15.7:43262) 2024-09-21T05:59:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.233+0000 7fee4eaa1640 1 -- 172.21.15.7:0/1675501076 learned_addr learned my addr 172.21.15.7:0/1675501076 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.233+0000 7fee4e2a0640 1 --2- 172.21.15.7:0/1675501076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1aab490 0x55f1c1e92e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.233+0000 7fee4da9f640 1 --2- 172.21.15.7:0/1675501076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ab3670 0x55f1c1e81550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.234+0000 7fee4eaa1640 1 -- 172.21.15.7:0/1675501076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ab3670 msgr2=0x55f1c1e81550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.234+0000 7fee4eaa1640 1 --2- 172.21.15.7:0/1675501076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ab3670 0x55f1c1e81550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.234+0000 7fee4eaa1640 1 -- 172.21.15.7:0/1675501076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1aab490 msgr2=0x55f1c1e92e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.234+0000 7fee4eaa1640 1 --2- 172.21.15.7:0/1675501076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1aab490 0x55f1c1e92e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.234+0000 7fee4eaa1640 1 -- 172.21.15.7:0/1675501076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1c1e7d720 con 0x55f1c1ad4350 2024-09-21T05:59:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.234+0000 7fee4e2a0640 1 --2- 172.21.15.7:0/1675501076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1aab490 0x55f1c1e92e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.234+0000 7fee4eaa1640 1 --2- 172.21.15.7:0/1675501076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 0x55f1c1e83fe0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fee400092f0 tx=0x7fee40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b489b368a69f1c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.234+0000 7fee33fff640 1 -- 172.21.15.7:0/1675501076 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40004b20 con 0x55f1c1ad4350 2024-09-21T05:59:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.234+0000 7fee33fff640 1 -- 172.21.15.7:0/1675501076 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee40004cc0 con 0x55f1c1ad4350 2024-09-21T05:59:51.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.234+0000 7fee33fff640 1 -- 172.21.15.7:0/1675501076 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40005840 con 0x55f1c1ad4350 2024-09-21T05:59:51.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.235+0000 7fee56a78740 1 -- 172.21.15.7:0/1675501076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 msgr2=0x55f1c1e83fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:51.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.235+0000 7fee56a78740 1 --2- 172.21.15.7:0/1675501076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 0x55f1c1e83fe0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fee400092f0 tx=0x7fee40016000 comp rx=0 tx=0).stop 2024-09-21T05:59:51.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.235+0000 7fee56a78740 1 -- 172.21.15.7:0/1675501076 shutdown_connections 2024-09-21T05:59:51.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.235+0000 7fee56a78740 1 --2- 172.21.15.7:0/1675501076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 0x55f1c1e83fe0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.235+0000 7fee56a78740 1 --2- 172.21.15.7:0/1675501076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1ab3670 0x55f1c1e81550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.235+0000 7fee56a78740 1 --2- 172.21.15.7:0/1675501076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1aab490 0x55f1c1e92e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.235+0000 7fee56a78740 1 -- 172.21.15.7:0/1675501076 >> 172.21.15.7:0/1675501076 conn(0x55f1c1ac8740 msgr2=0x55f1c1e85670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:51.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.235+0000 7fee56a78740 1 -- 172.21.15.7:0/1675501076 shutdown_connections 2024-09-21T05:59:51.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.235+0000 7fee56a78740 1 -- 172.21.15.7:0/1675501076 wait complete. 2024-09-21T05:59:51.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.235+0000 7fee56a78740 1 -- start start 2024-09-21T05:59:51.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.235+0000 7fee56a78740 1 Processor -- start 2024-09-21T05:59:51.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee56a78740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1aab490 0x55f1c1e9abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee56a78740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 0x55f1c1e9b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee56a78740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 0x55f1c1efb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee56a78740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee481afe70 con 0x55f1c1ad4350 2024-09-21T05:59:51.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee56a78740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fee481b12e0 con 0x55f1c1ab3670 2024-09-21T05:59:51.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee56a78740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fee481b0540 con 0x55f1c1aab490 2024-09-21T05:59:51.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee56a78740 10 client.0 _ll_register_callbacks cb 0x7fee40009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:51.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee4eaa1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 0x55f1c1efb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee4eaa1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 0x55f1c1efb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43274/0 (socket says 172.21.15.7:43274) 2024-09-21T05:59:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee4eaa1640 1 -- 172.21.15.7:0/1842313796 learned_addr learned my addr 172.21.15.7:0/1842313796 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee4da9f640 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 0x55f1c1e9b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee4e2a0640 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1aab490 0x55f1c1e9abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee4eaa1640 1 -- 172.21.15.7:0/1842313796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1aab490 msgr2=0x55f1c1e9abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee4eaa1640 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1aab490 0x55f1c1e9abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee4eaa1640 1 -- 172.21.15.7:0/1842313796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 msgr2=0x55f1c1e9b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee4eaa1640 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 0x55f1c1e9b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee4eaa1640 1 -- 172.21.15.7:0/1842313796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1c1efbe90 con 0x55f1c1ad4350 2024-09-21T05:59:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.236+0000 7fee4e2a0640 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1aab490 0x55f1c1e9abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.237+0000 7fee4eaa1640 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 0x55f1c1efb820 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fee4000a010 tx=0x7fee40011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8715c0672df4b79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.237+0000 7fee31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.237+0000 7fee31ffb640 1 -- 172.21.15.7:0/1842313796 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40037020 con 0x55f1c1ad4350 2024-09-21T05:59:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.237+0000 7fee31ffb640 1 -- 172.21.15.7:0/1842313796 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fee400057c0 con 0x55f1c1ad4350 2024-09-21T05:59:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.237+0000 7fee56a78740 1 -- 172.21.15.7:0/1842313796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee40004cc0 con 0x55f1c1ad4350 2024-09-21T05:59:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.237+0000 7fee31ffb640 1 -- 172.21.15.7:0/1842313796 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee40042050 con 0x55f1c1ad4350 2024-09-21T05:59:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.237+0000 7fee56a78740 10 client.16854 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.237+0000 7fee56a78740 1 -- 172.21.15.7:0/1842313796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1c1f043f0 con 0x55f1c1ad4350 2024-09-21T05:59:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.237+0000 7fee31ffb640 1 -- 172.21.15.7:0/1842313796 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee40004cc0 con 0x55f1c1ad4350 2024-09-21T05:59:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.237+0000 7fee31ffb640 1 -- 172.21.15.7:0/1842313796 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fee40028070 con 0x55f1c1ad4350 2024-09-21T05:59:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.237+0000 7fee56a78740 10 client.16854 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.237+0000 7fee56a78740 10 client.16854 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.237+0000 7fee56a78740 20 client.16854 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.238+0000 7fee56a78740 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f1c1a68080 0x55f1c1f06b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.238+0000 7fee56a78740 4 client.16854 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T05:59:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.238+0000 7fee56a78740 1 -- 172.21.15.7:0/1842313796 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f1c1def860 con 0x55f1c1a68080 2024-09-21T05:59:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.238+0000 7fee4e2a0640 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f1c1a68080 0x55f1c1f06b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.238+0000 7fee4e2a0640 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f1c1a68080 0x55f1c1f06b10 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c38fa6ac89d3cc73 server_cookie=91968beb9f205574 in_seq=0 out_seq=0 2024-09-21T05:59:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.238+0000 7fee31ffb640 10 client.16854 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:51.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee31ffb640 1 -- 172.21.15.7:0/1842313796 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f1c1def860 con 0x55f1c1a68080 2024-09-21T05:59:51.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee31ffb640 10 client.16854 handle_command_reply: tid=0 2024-09-21T05:59:51.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee56a78740 1 client.16854 shutdown 2024-09-21T05:59:51.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee56a78740 1 -- 172.21.15.7:0/1842313796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 msgr2=0x55f1c1efb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:51.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee56a78740 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 0x55f1c1efb820 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fee4000a010 tx=0x7fee40011d90 comp rx=0 tx=0).stop 2024-09-21T05:59:51.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee56a78740 1 -- 172.21.15.7:0/1842313796 shutdown_connections 2024-09-21T05:59:51.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee56a78740 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f1c1a68080 0x55f1c1f06b10 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee56a78740 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1c1ad4350 0x55f1c1efb820 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee31ffb640 0 client.16854 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:51.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee56a78740 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f1c1ab3670 0x55f1c1e9b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee56a78740 1 --2- 172.21.15.7:0/1842313796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1c1aab490 0x55f1c1e9abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee56a78740 1 -- 172.21.15.7:0/1842313796 >> 172.21.15.7:0/1842313796 conn(0x55f1c1ac8740 msgr2=0x55f1c1e7c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:51.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee56a78740 1 -- 172.21.15.7:0/1842313796 shutdown_connections 2024-09-21T05:59:51.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.240+0000 7fee56a78740 1 -- 172.21.15.7:0/1842313796 wait complete. 2024-09-21T05:59:51.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.241+0000 7fee56a78740 20 client.16854 trim_cache size 0 max 16384 2024-09-21T05:59:51.248 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:59:51.248 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T05:59:51.248 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "f7f81a98-cc78-407c-94cf-8aef91132db7", 2024-09-21T05:59:51.248 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T05:59:51.248 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:59:51.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.241+0000 7fee50504640 1 -- 172.21.15.7:0/760133184 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fee340b6680 msgr2=0x7fee340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:51.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.241+0000 7fee50504640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fee340b6680 0x7fee340b8b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fee40005fd0 tx=0x7fee40009600 comp rx=0 tx=0).stop 2024-09-21T05:59:51.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.241+0000 7fee50504640 1 -- 172.21.15.7:0/760133184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee48105380 msgr2=0x7fee4819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:51.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.241+0000 7fee50504640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee48105380 0x7fee4819cd10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fee38006fd0 tx=0x7fee3800b8e0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.241+0000 7fee50504640 1 -- 172.21.15.7:0/760133184 shutdown_connections 2024-09-21T05:59:51.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.241+0000 7fee50504640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fee340b6680 0x7fee340b8b90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.241+0000 7fee50504640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee48105380 0x7fee4819cd10 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.241+0000 7fee50504640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee4810de60 0x7fee481a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.241+0000 7fee50504640 1 --2- 172.21.15.7:0/760133184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee48104a30 0x7fee4819c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:51.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.241+0000 7fee50504640 1 -- 172.21.15.7:0/760133184 >> 172.21.15.7:0/760133184 conn(0x7fee48079760 msgr2=0x7fee480ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:51.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.241+0000 7fee50504640 1 -- 172.21.15.7:0/760133184 shutdown_connections 2024-09-21T05:59:51.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:51.241+0000 7fee50504640 1 -- 172.21.15.7:0/760133184 wait complete. 2024-09-21T05:59:51.964 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T05:59:52.225 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:52.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:51 smithi027 ceph-mon[34364]: pgmap v497: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:59:52.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:51 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T05:59:52.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:51 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:52.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:51 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T05:59:52.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:51 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:52.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:51 smithi007 ceph-mon[30983]: pgmap v497: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:59:52.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:51 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T05:59:52.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:51 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:52.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:51 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T05:59:52.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:51 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:52.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:51 smithi119 ceph-mon[34833]: pgmap v497: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T05:59:52.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:51 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T05:59:52.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:51 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:52.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:51 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T05:59:52.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:51 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T05:59:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.828+0000 7fa052673640 1 -- 172.21.15.7:0/2264447045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c108cf0 msgr2=0x7fa04c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.828+0000 7fa052673640 1 --2- 172.21.15.7:0/2264447045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c108cf0 0x7fa04c10f520 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa044009ca0 tx=0x7fa04402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.828+0000 7fa052673640 1 -- 172.21.15.7:0/2264447045 shutdown_connections 2024-09-21T05:59:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.828+0000 7fa052673640 1 --2- 172.21.15.7:0/2264447045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c108cf0 0x7fa04c10f520 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.828+0000 7fa052673640 1 --2- 172.21.15.7:0/2264447045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa04c1083a0 0x7fa04c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.828+0000 7fa052673640 1 --2- 172.21.15.7:0/2264447045 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa04c102a60 0x7fa04c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.828+0000 7fa052673640 1 -- 172.21.15.7:0/2264447045 >> 172.21.15.7:0/2264447045 conn(0x7fa04c079730 msgr2=0x7fa04c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.828+0000 7fa052673640 1 -- 172.21.15.7:0/2264447045 shutdown_connections 2024-09-21T05:59:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.828+0000 7fa052673640 1 -- 172.21.15.7:0/2264447045 wait complete. 2024-09-21T05:59:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.829+0000 7fa052673640 1 Processor -- start 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.829+0000 7fa052673640 1 -- start start 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.829+0000 7fa052673640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa04c102a60 0x7fa04c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.829+0000 7fa052673640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c1083a0 0x7fa04c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.829+0000 7fa052673640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa04c108cf0 0x7fa04c19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.829+0000 7fa052673640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c112980 con 0x7fa04c1083a0 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.829+0000 7fa052673640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c112800 con 0x7fa04c108cf0 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.829+0000 7fa052673640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c112b00 con 0x7fa04c102a60 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.829+0000 7fa043fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c1083a0 0x7fa04c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa04bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa04c102a60 0x7fa04c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa050c10640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa04c108cf0 0x7fa04c19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa043fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c1083a0 0x7fa04c19aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43294/0 (socket says 172.21.15.7:43294) 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa043fff640 1 -- 172.21.15.7:0/502933413 learned_addr learned my addr 172.21.15.7:0/502933413 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa050c10640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa04c108cf0 0x7fa04c19fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:53384/0 (socket says 172.21.15.7:53384) 2024-09-21T05:59:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa043fff640 1 -- 172.21.15.7:0/502933413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa04c102a60 msgr2=0x7fa04c19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa043fff640 1 --2- 172.21.15.7:0/502933413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa04c102a60 0x7fa04c19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa043fff640 1 -- 172.21.15.7:0/502933413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa04c108cf0 msgr2=0x7fa04c19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa043fff640 1 --2- 172.21.15.7:0/502933413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa04c108cf0 0x7fa04c19fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa043fff640 1 -- 172.21.15.7:0/502933413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04c1a03d0 con 0x7fa04c1083a0 2024-09-21T05:59:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa04bfff640 1 --2- 172.21.15.7:0/502933413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa04c102a60 0x7fa04c19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa043fff640 1 --2- 172.21.15.7:0/502933413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c1083a0 0x7fa04c19aa00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa03400c970 tx=0x7fa03400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa049ffb640 1 -- 172.21.15.7:0/502933413 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa034007bb0 con 0x7fa04c1083a0 2024-09-21T05:59:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.830+0000 7fa049ffb640 1 -- 172.21.15.7:0/502933413 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa034007d50 con 0x7fa04c1083a0 2024-09-21T05:59:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.831+0000 7fa049ffb640 1 -- 172.21.15.7:0/502933413 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa034018730 con 0x7fa04c1083a0 2024-09-21T05:59:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.831+0000 7fa052673640 1 -- 172.21.15.7:0/502933413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa04c1a06c0 con 0x7fa04c1083a0 2024-09-21T05:59:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.831+0000 7fa052673640 1 -- 172.21.15.7:0/502933413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa04c1a6e20 con 0x7fa04c1083a0 2024-09-21T05:59:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.833+0000 7fa049ffb640 1 -- 172.21.15.7:0/502933413 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa03400f990 con 0x7fa04c1083a0 2024-09-21T05:59:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.833+0000 7fa058be7740 1 Processor -- start 2024-09-21T05:59:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.833+0000 7fa058be7740 1 -- start start 2024-09-21T05:59:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa058be7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72aa070 0x562ea7651270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa058be7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 0x562ea76517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa058be7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea7289390 0x562ea7651cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa058be7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562ea75c7e50 con 0x562ea72811b0 2024-09-21T05:59:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa058be7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562ea75b7280 con 0x562ea7289390 2024-09-21T05:59:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa058be7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562ea75bb090 con 0x562ea72aa070 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa04bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 0x562ea76517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa04bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 0x562ea76517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43300/0 (socket says 172.21.15.7:43300) 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa04bfff640 1 -- 172.21.15.7:0/3648585862 learned_addr learned my addr 172.21.15.7:0/3648585862 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa050c10640 1 --2- 172.21.15.7:0/3648585862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72aa070 0x562ea7651270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa043fff640 1 --2- 172.21.15.7:0/3648585862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea7289390 0x562ea7651cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa04bfff640 1 -- 172.21.15.7:0/3648585862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72aa070 msgr2=0x562ea7651270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa04bfff640 1 --2- 172.21.15.7:0/3648585862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72aa070 0x562ea7651270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa04bfff640 1 -- 172.21.15.7:0/3648585862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea7289390 msgr2=0x562ea7651cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa04bfff640 1 --2- 172.21.15.7:0/3648585862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea7289390 0x562ea7651cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa04bfff640 1 -- 172.21.15.7:0/3648585862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ea7315650 con 0x562ea72811b0 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa043fff640 1 --2- 172.21.15.7:0/3648585862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea7289390 0x562ea7651cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.834+0000 7fa049ffb640 1 --2- 172.21.15.7:0/502933413 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa0380b6700 0x7fa0380b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.835+0000 7fa04bfff640 1 --2- 172.21.15.7:0/3648585862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 0x562ea76517b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa03c010500 tx=0x7fa03c0109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207e523a089aa7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.835+0000 7fa050c10640 1 --2- 172.21.15.7:0/502933413 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa0380b6700 0x7fa0380b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.835+0000 7fa049ffb640 1 -- 172.21.15.7:0/502933413 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa0340e7610 con 0x7fa04c1083a0 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.835+0000 7fa0427fc640 1 -- 172.21.15.7:0/3648585862 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c011760 con 0x562ea72811b0 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.835+0000 7fa0427fc640 1 -- 172.21.15.7:0/3648585862 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa03c011db0 con 0x562ea72811b0 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.835+0000 7fa0427fc640 1 -- 172.21.15.7:0/3648585862 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00e430 con 0x562ea72811b0 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.836+0000 7fa058be7740 1 -- 172.21.15.7:0/3648585862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 msgr2=0x562ea76517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.836+0000 7fa058be7740 1 --2- 172.21.15.7:0/3648585862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 0x562ea76517b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa03c010500 tx=0x7fa03c0109c0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.836+0000 7fa050c10640 1 --2- 172.21.15.7:0/502933413 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa0380b6700 0x7fa0380b8c10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa04402f500 tx=0x7fa04402f330 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.836+0000 7fa058be7740 1 -- 172.21.15.7:0/3648585862 shutdown_connections 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.836+0000 7fa058be7740 1 --2- 172.21.15.7:0/3648585862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 0x562ea76517b0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.836+0000 7fa058be7740 1 --2- 172.21.15.7:0/3648585862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea7289390 0x562ea7651cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.836+0000 7fa058be7740 1 --2- 172.21.15.7:0/3648585862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72aa070 0x562ea7651270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.836+0000 7fa058be7740 1 -- 172.21.15.7:0/3648585862 >> 172.21.15.7:0/3648585862 conn(0x562ea729e460 msgr2=0x562ea764f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.836+0000 7fa058be7740 1 -- 172.21.15.7:0/3648585862 shutdown_connections 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.836+0000 7fa058be7740 1 -- 172.21.15.7:0/3648585862 wait complete. 2024-09-21T05:59:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.836+0000 7fa058be7740 1 -- start start 2024-09-21T05:59:52.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa058be7740 1 Processor -- start 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa058be7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea72811b0 0x562ea7660c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa058be7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea7289390 0x562ea7661170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa058be7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72aa070 0x562ea76616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa058be7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562ea7418700 con 0x562ea7289390 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa058be7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562ea7552110 con 0x562ea72811b0 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa058be7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562ea7663d80 con 0x562ea72aa070 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa058be7740 10 client.0 _ll_register_callbacks cb 0x562ea756b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa043fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea7289390 0x562ea7661170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa043fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea7289390 0x562ea7661170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43312/0 (socket says 172.21.15.7:43312) 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa043fff640 1 -- 172.21.15.7:0/1124241594 learned_addr learned my addr 172.21.15.7:0/1124241594 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa04bfff640 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea72811b0 0x562ea7660c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa050c10640 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72aa070 0x562ea76616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa043fff640 1 -- 172.21.15.7:0/1124241594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72aa070 msgr2=0x562ea76616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa043fff640 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72aa070 0x562ea76616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa043fff640 1 -- 172.21.15.7:0/1124241594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea72811b0 msgr2=0x562ea7660c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa043fff640 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea72811b0 0x562ea7660c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.837+0000 7fa043fff640 1 -- 172.21.15.7:0/1124241594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ea757fc40 con 0x562ea7289390 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa050c10640 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72aa070 0x562ea76616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa043fff640 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea7289390 0x562ea7661170 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa0340aa750 tx=0x7fa0340a7f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204e8c06085c302c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa02b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa02b7fe640 1 -- 172.21.15.7:0/1124241594 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0340d0e60 con 0x562ea7289390 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa02b7fe640 1 -- 172.21.15.7:0/1124241594 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa03400f450 con 0x562ea7289390 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa058be7740 1 -- 172.21.15.7:0/1124241594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa03c011db0 con 0x562ea7289390 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa02b7fe640 1 -- 172.21.15.7:0/1124241594 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa0340ace30 con 0x562ea7289390 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa058be7740 10 client.16866 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa058be7740 1 -- 172.21.15.7:0/1124241594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ea766f960 con 0x562ea7289390 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa02b7fe640 1 -- 172.21.15.7:0/1124241594 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa03c011db0 con 0x562ea7289390 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa02b7fe640 1 -- 172.21.15.7:0/1124241594 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa034020030 con 0x562ea7289390 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa058be7740 10 client.16866 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa058be7740 10 client.16866 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:52.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa058be7740 20 client.16866 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:52.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.838+0000 7fa058be7740 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ea72689f0 0x562ea7672dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.839+0000 7fa058be7740 4 client.16866 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:52.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.839+0000 7fa058be7740 1 -- 172.21.15.7:0/1124241594 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ea75c9da0 con 0x562ea72689f0 2024-09-21T05:59:52.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.839+0000 7fa04bfff640 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ea72689f0 0x562ea7672dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.839+0000 7fa04bfff640 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ea72689f0 0x562ea7672dd0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99c813ed560ab470 server_cookie=e47c04590216893b in_seq=0 out_seq=0 2024-09-21T05:59:52.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.839+0000 7fa02b7fe640 10 client.16866 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:52.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.840+0000 7fa02b7fe640 1 -- 172.21.15.7:0/1124241594 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ea75c9da0 con 0x562ea72689f0 2024-09-21T05:59:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.840+0000 7fa02b7fe640 10 client.16866 handle_command_reply: tid=0 2024-09-21T05:59:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.840+0000 7fa058be7740 1 client.16866 shutdown 2024-09-21T05:59:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.840+0000 7fa058be7740 1 -- 172.21.15.7:0/1124241594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea7289390 msgr2=0x562ea7661170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.840+0000 7fa058be7740 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea7289390 0x562ea7661170 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa0340aa750 tx=0x7fa0340a7f80 comp rx=0 tx=0).stop 2024-09-21T05:59:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.840+0000 7fa058be7740 1 -- 172.21.15.7:0/1124241594 shutdown_connections 2024-09-21T05:59:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.840+0000 7fa058be7740 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ea72689f0 0x562ea7672dd0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.841+0000 7fa058be7740 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea7289390 0x562ea7661170 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.841+0000 7fa058be7740 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72aa070 0x562ea76616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.841+0000 7fa058be7740 1 --2- 172.21.15.7:0/1124241594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea72811b0 0x562ea7660c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.841+0000 7fa058be7740 1 -- 172.21.15.7:0/1124241594 >> 172.21.15.7:0/1124241594 conn(0x562ea729e460 msgr2=0x562ea7654400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.841+0000 7fa02b7fe640 0 client.16866 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.841+0000 7fa058be7740 1 -- 172.21.15.7:0/1124241594 shutdown_connections 2024-09-21T05:59:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.841+0000 7fa058be7740 1 -- 172.21.15.7:0/1124241594 wait complete. 2024-09-21T05:59:52.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.841+0000 7fa058be7740 20 client.16866 trim_cache size 0 max 16384 2024-09-21T05:59:52.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.858+0000 7fa058be7740 1 Processor -- start 2024-09-21T05:59:52.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.858+0000 7fa058be7740 1 -- start start 2024-09-21T05:59:52.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.858+0000 7fa058be7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea729e460 0x562ea764f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.858+0000 7fa058be7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 0x562ea765de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.858+0000 7fa058be7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea7289390 0x562ea765e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.858+0000 7fa058be7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1afb70 con 0x562ea72811b0 2024-09-21T05:59:52.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.858+0000 7fa058be7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1ad440 con 0x562ea729e460 2024-09-21T05:59:52.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.858+0000 7fa058be7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1ab290 con 0x562ea7289390 2024-09-21T05:59:52.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa043fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 0x562ea765de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa043fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 0x562ea765de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43326/0 (socket says 172.21.15.7:43326) 2024-09-21T05:59:52.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa043fff640 1 -- 172.21.15.7:0/126658235 learned_addr learned my addr 172.21.15.7:0/126658235 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:52.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa04bfff640 1 --2- 172.21.15.7:0/126658235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea729e460 0x562ea764f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa050c10640 1 --2- 172.21.15.7:0/126658235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea7289390 0x562ea765e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa043fff640 1 -- 172.21.15.7:0/126658235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea7289390 msgr2=0x562ea765e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:52.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa043fff640 1 --2- 172.21.15.7:0/126658235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea7289390 0x562ea765e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa043fff640 1 -- 172.21.15.7:0/126658235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea729e460 msgr2=0x562ea764f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:52.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa043fff640 1 --2- 172.21.15.7:0/126658235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea729e460 0x562ea764f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa043fff640 1 -- 172.21.15.7:0/126658235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ea765fb90 con 0x562ea72811b0 2024-09-21T05:59:52.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa050c10640 1 --2- 172.21.15.7:0/126658235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea7289390 0x562ea765e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:52.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa043fff640 1 --2- 172.21.15.7:0/126658235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 0x562ea765de20 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa0340e79c0 tx=0x7fa0340076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67338950b42b94df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:52.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa041ffb640 1 -- 172.21.15.7:0/126658235 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0340d0e60 con 0x562ea72811b0 2024-09-21T05:59:52.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa041ffb640 1 -- 172.21.15.7:0/126658235 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0340e7a70 con 0x562ea72811b0 2024-09-21T05:59:52.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.859+0000 7fa041ffb640 1 -- 172.21.15.7:0/126658235 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0340acc50 con 0x562ea72811b0 2024-09-21T05:59:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.860+0000 7fa058be7740 1 -- 172.21.15.7:0/126658235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 msgr2=0x562ea765de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.860+0000 7fa058be7740 1 --2- 172.21.15.7:0/126658235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 0x562ea765de20 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa0340e79c0 tx=0x7fa0340076c0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.860+0000 7fa058be7740 1 -- 172.21.15.7:0/126658235 shutdown_connections 2024-09-21T05:59:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.860+0000 7fa058be7740 1 --2- 172.21.15.7:0/126658235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea72811b0 0x562ea765de20 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.860+0000 7fa058be7740 1 --2- 172.21.15.7:0/126658235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea7289390 0x562ea765e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.860+0000 7fa058be7740 1 --2- 172.21.15.7:0/126658235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea729e460 0x562ea764f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.860+0000 7fa058be7740 1 -- 172.21.15.7:0/126658235 >> 172.21.15.7:0/126658235 conn(0x562ea7673140 msgr2=0x562ea764ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.860+0000 7fa058be7740 1 -- 172.21.15.7:0/126658235 shutdown_connections 2024-09-21T05:59:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.860+0000 7fa058be7740 1 -- 172.21.15.7:0/126658235 wait complete. 2024-09-21T05:59:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.861+0000 7fa058be7740 1 -- start start 2024-09-21T05:59:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.861+0000 7fa058be7740 1 Processor -- start 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.861+0000 7fa058be7740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72811b0 0x562ea7664ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.861+0000 7fa058be7740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea7289390 0x562ea7665530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.861+0000 7fa058be7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea729e460 0x562ea7665a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.861+0000 7fa058be7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1ab900 con 0x562ea729e460 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.861+0000 7fa058be7740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1acd70 con 0x562ea7289390 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.861+0000 7fa058be7740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1abfd0 con 0x562ea72811b0 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.861+0000 7fa058be7740 10 client.0 _ll_register_callbacks cb 0x7fa0340046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.862+0000 7fa04bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72811b0 0x562ea7664ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.862+0000 7fa050c10640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea729e460 0x562ea7665a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.862+0000 7fa043fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea7289390 0x562ea7665530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.862+0000 7fa04bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72811b0 0x562ea7664ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:38554/0 (socket says 172.21.15.7:38554) 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.862+0000 7fa04bfff640 1 -- 172.21.15.7:0/1477044889 learned_addr learned my addr 172.21.15.7:0/1477044889 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.862+0000 7fa043fff640 1 --2- 172.21.15.7:0/1477044889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea7289390 0x562ea7665530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:53418/0 (socket says 172.21.15.7:53418) 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.862+0000 7fa050c10640 1 -- 172.21.15.7:0/1477044889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72811b0 msgr2=0x562ea7664ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.862+0000 7fa050c10640 1 --2- 172.21.15.7:0/1477044889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72811b0 0x562ea7664ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.862+0000 7fa050c10640 1 -- 172.21.15.7:0/1477044889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea7289390 msgr2=0x562ea7665530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.862+0000 7fa050c10640 1 --2- 172.21.15.7:0/1477044889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea7289390 0x562ea7665530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.862+0000 7fa050c10640 1 -- 172.21.15.7:0/1477044889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ea76dc7b0 con 0x562ea729e460 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.862+0000 7fa050c10640 1 --2- 172.21.15.7:0/1477044889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea729e460 0x562ea7665a70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa044006010 tx=0x7fa04402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3ae66480edbfdd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.862+0000 7fa02b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.863+0000 7fa02b7fe640 1 -- 172.21.15.7:0/1477044889 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044057060 con 0x562ea729e460 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.863+0000 7fa02b7fe640 1 -- 172.21.15.7:0/1477044889 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa044003c40 con 0x562ea729e460 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.863+0000 7fa058be7740 1 -- 172.21.15.7:0/1477044889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0340e7a70 con 0x562ea729e460 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.863+0000 7fa02b7fe640 1 -- 172.21.15.7:0/1477044889 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa044003e40 con 0x562ea729e460 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.863+0000 7fa058be7740 10 client.16872 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.863+0000 7fa058be7740 1 -- 172.21.15.7:0/1477044889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ea76dd970 con 0x562ea729e460 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.863+0000 7fa02b7fe640 1 -- 172.21.15.7:0/1477044889 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0340e7a70 con 0x562ea729e460 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.863+0000 7fa02b7fe640 1 -- 172.21.15.7:0/1477044889 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa04402fa70 con 0x562ea729e460 2024-09-21T05:59:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.864+0000 7fa058be7740 10 client.16872 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.864+0000 7fa058be7740 10 client.16872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.864+0000 7fa058be7740 20 client.16872 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.864+0000 7fa058be7740 1 --2- 172.21.15.7:0/1477044889 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ea72aa070 0x562ea76e0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.864+0000 7fa058be7740 4 client.16872 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T05:59:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.864+0000 7fa058be7740 1 -- 172.21.15.7:0/1477044889 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562ea75c5850 con 0x562ea72aa070 2024-09-21T05:59:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.864+0000 7fa04bfff640 1 --2- 172.21.15.7:0/1477044889 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ea72aa070 0x562ea76e0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.864+0000 7fa04bfff640 1 --2- 172.21.15.7:0/1477044889 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ea72aa070 0x562ea76e0160 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47400f15603d6ac0 server_cookie=bc419335794bbc42 in_seq=0 out_seq=0 2024-09-21T05:59:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.864+0000 7fa02b7fe640 10 client.16872 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa02b7fe640 1 -- 172.21.15.7:0/1477044889 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x562ea75c5850 con 0x562ea72aa070 2024-09-21T05:59:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa02b7fe640 10 client.16872 handle_command_reply: tid=0 2024-09-21T05:59:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa058be7740 1 client.16872 shutdown 2024-09-21T05:59:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa058be7740 1 -- 172.21.15.7:0/1477044889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea729e460 msgr2=0x562ea7665a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa058be7740 1 --2- 172.21.15.7:0/1477044889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea729e460 0x562ea7665a70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa044006010 tx=0x7fa04402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa058be7740 1 -- 172.21.15.7:0/1477044889 shutdown_connections 2024-09-21T05:59:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa058be7740 1 --2- 172.21.15.7:0/1477044889 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ea72aa070 0x562ea76e0160 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa058be7740 1 --2- 172.21.15.7:0/1477044889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ea729e460 0x562ea7665a70 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa058be7740 1 --2- 172.21.15.7:0/1477044889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ea7289390 0x562ea7665530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa058be7740 1 --2- 172.21.15.7:0/1477044889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ea72811b0 0x562ea7664ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa058be7740 1 -- 172.21.15.7:0/1477044889 >> 172.21.15.7:0/1477044889 conn(0x562ea7673140 msgr2=0x562ea76522a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa02b7fe640 0 client.16872 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa058be7740 1 -- 172.21.15.7:0/1477044889 shutdown_connections 2024-09-21T05:59:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.865+0000 7fa058be7740 1 -- 172.21.15.7:0/1477044889 wait complete. 2024-09-21T05:59:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.866+0000 7fa058be7740 20 client.16872 trim_cache size 0 max 16384 2024-09-21T05:59:52.871 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T05:59:52.871 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T05:59:52.871 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T05:59:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T05:59:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T05:59:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T05:59:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T05:59:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T05:59:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T05:59:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T05:59:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T05:59:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T05:59:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T05:59:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T05:59:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T05:59:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T05:59:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T05:59:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:59:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T05:59:52.878 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T05:59:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.866+0000 7fa052673640 1 -- 172.21.15.7:0/502933413 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa0380b6700 msgr2=0x7fa0380b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.866+0000 7fa052673640 1 --2- 172.21.15.7:0/502933413 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa0380b6700 0x7fa0380b8c10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa04402f500 tx=0x7fa04402f330 comp rx=0 tx=0).stop 2024-09-21T05:59:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.866+0000 7fa052673640 1 -- 172.21.15.7:0/502933413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c1083a0 msgr2=0x7fa04c19aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.866+0000 7fa052673640 1 --2- 172.21.15.7:0/502933413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c1083a0 0x7fa04c19aa00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa03400c970 tx=0x7fa03400ce30 comp rx=0 tx=0).stop 2024-09-21T05:59:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.866+0000 7fa052673640 1 -- 172.21.15.7:0/502933413 shutdown_connections 2024-09-21T05:59:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.866+0000 7fa052673640 1 --2- 172.21.15.7:0/502933413 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa0380b6700 0x7fa0380b8c10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.866+0000 7fa052673640 1 --2- 172.21.15.7:0/502933413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa04c1083a0 0x7fa04c19aa00 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.866+0000 7fa052673640 1 --2- 172.21.15.7:0/502933413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa04c108cf0 0x7fa04c19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.866+0000 7fa052673640 1 --2- 172.21.15.7:0/502933413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa04c102a60 0x7fa04c19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:52.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.866+0000 7fa052673640 1 -- 172.21.15.7:0/502933413 >> 172.21.15.7:0/502933413 conn(0x7fa04c079730 msgr2=0x7fa04c06b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:52.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.866+0000 7fa052673640 1 -- 172.21.15.7:0/502933413 shutdown_connections 2024-09-21T05:59:52.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:52.867+0000 7fa052673640 1 -- 172.21.15.7:0/502933413 wait complete. 2024-09-21T05:59:53.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:52 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T05:59:53.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:52 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T05:59:53.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:52 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T05:59:53.594 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T05:59:53.595 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:59:53.859 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:54.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:53 smithi007 ceph-mon[30983]: pgmap v498: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T05:59:54.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:53 smithi027 ceph-mon[34364]: pgmap v498: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T05:59:54.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.302+0000 7fa3b60d4640 1 -- 172.21.15.7:0/408077118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3b0101ff0 msgr2=0x7fa3b0102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:54.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.302+0000 7fa3b60d4640 1 --2- 172.21.15.7:0/408077118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3b0101ff0 0x7fa3b0102400 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009900 tx=0x7fa3a002a410 comp rx=0 tx=0).stop 2024-09-21T05:59:54.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.302+0000 7fa3b60d4640 1 -- 172.21.15.7:0/408077118 shutdown_connections 2024-09-21T05:59:54.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.302+0000 7fa3b60d4640 1 --2- 172.21.15.7:0/408077118 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3b0106c20 0x7fa3b0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.302+0000 7fa3b60d4640 1 --2- 172.21.15.7:0/408077118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3b01062d0 0x7fa3b01066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.302+0000 7fa3b60d4640 1 --2- 172.21.15.7:0/408077118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3b0101ff0 0x7fa3b0102400 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.302+0000 7fa3b60d4640 1 -- 172.21.15.7:0/408077118 >> 172.21.15.7:0/408077118 conn(0x7fa3b0077cc0 msgr2=0x7fa3b0078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:54.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.303+0000 7fa3b60d4640 1 -- 172.21.15.7:0/408077118 shutdown_connections 2024-09-21T05:59:54.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.303+0000 7fa3b60d4640 1 -- 172.21.15.7:0/408077118 wait complete. 2024-09-21T05:59:54.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.303+0000 7fa3b60d4640 1 Processor -- start 2024-09-21T05:59:54.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.303+0000 7fa3b60d4640 1 -- start start 2024-09-21T05:59:54.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3b60d4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3b0101ff0 0x7fa3b0102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:54.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3b60d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3b01062d0 0x7fa3b01034d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:54.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3b60d4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3b0106c20 0x7fa3b0103a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:54.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3b60d4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b0113ae0 con 0x7fa3b01062d0 2024-09-21T05:59:54.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3b60d4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b0113960 con 0x7fa3b0106c20 2024-09-21T05:59:54.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3b60d4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b0113c60 con 0x7fa3b0101ff0 2024-09-21T05:59:54.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3aeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3b01062d0 0x7fa3b01034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:54.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3aeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3b01062d0 0x7fa3b01034d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43354/0 (socket says 172.21.15.7:43354) 2024-09-21T05:59:54.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3aeffd640 1 -- 172.21.15.7:0/3684222841 learned_addr learned my addr 172.21.15.7:0/3684222841 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:54.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3af7fe640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3b0101ff0 0x7fa3b0102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:54.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3affff640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3b0106c20 0x7fa3b0103a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:54.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3aeffd640 1 -- 172.21.15.7:0/3684222841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3b0101ff0 msgr2=0x7fa3b0102f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:54.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3aeffd640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3b0101ff0 0x7fa3b0102f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3aeffd640 1 -- 172.21.15.7:0/3684222841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3b0106c20 msgr2=0x7fa3b0103a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:54.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3aeffd640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3b0106c20 0x7fa3b0103a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3aeffd640 1 -- 172.21.15.7:0/3684222841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b01a87d0 con 0x7fa3b01062d0 2024-09-21T05:59:54.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.304+0000 7fa3affff640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3b0106c20 0x7fa3b0103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:54.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.305+0000 7fa3aeffd640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3b01062d0 0x7fa3b01034d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400d750 tx=0x7fa3a400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:54.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.305+0000 7fa3acff9640 1 -- 172.21.15.7:0/3684222841 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4017070 con 0x7fa3b01062d0 2024-09-21T05:59:54.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.305+0000 7fa3b60d4640 1 -- 172.21.15.7:0/3684222841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b01a8ac0 con 0x7fa3b01062d0 2024-09-21T05:59:54.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.305+0000 7fa3acff9640 1 -- 172.21.15.7:0/3684222841 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3a40054d0 con 0x7fa3b01062d0 2024-09-21T05:59:54.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.305+0000 7fa3b60d4640 1 -- 172.21.15.7:0/3684222841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b01a9000 con 0x7fa3b01062d0 2024-09-21T05:59:54.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.305+0000 7fa3acff9640 1 -- 172.21.15.7:0/3684222841 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4004c30 con 0x7fa3b01062d0 2024-09-21T05:59:54.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.306+0000 7fa3b60d4640 1 -- 172.21.15.7:0/3684222841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa39c0052c0 con 0x7fa3b01062d0 2024-09-21T05:59:54.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.307+0000 7fa3acff9640 1 -- 172.21.15.7:0/3684222841 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa3a4010460 con 0x7fa3b01062d0 2024-09-21T05:59:54.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.308+0000 7fa3acff9640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa3980b6700 0x7fa3980b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:54.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.308+0000 7fa3acff9640 1 -- 172.21.15.7:0/3684222841 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fa3a40e6ea0 con 0x7fa3b01062d0 2024-09-21T05:59:54.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.308+0000 7fa3af7fe640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa3980b6700 0x7fa3980b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:54.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.309+0000 7fa3af7fe640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa3980b6700 0x7fa3980b8c10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0000c00 tx=0x7fa3a0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:54.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.313+0000 7fa3acff9640 1 -- 172.21.15.7:0/3684222841 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3a40ad470 con 0x7fa3b01062d0 2024-09-21T05:59:54.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:53 smithi119 ceph-mon[34833]: pgmap v498: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T05:59:54.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.554+0000 7fa3b60d4640 1 -- 172.21.15.7:0/3684222841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa39c005880 con 0x7fa3b01062d0 2024-09-21T05:59:54.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.555+0000 7fa3acff9640 1 -- 172.21.15.7:0/3684222841 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7fa3a40b1850 con 0x7fa3b01062d0 2024-09-21T05:59:54.557 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T05:59:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T05:59:54.558 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T05:59:54.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.557+0000 7fa3b60d4640 1 -- 172.21.15.7:0/3684222841 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa3980b6700 msgr2=0x7fa3980b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.557+0000 7fa3b60d4640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa3980b6700 0x7fa3980b8c10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0000c00 tx=0x7fa3a0031400 comp rx=0 tx=0).stop 2024-09-21T05:59:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.557+0000 7fa3b60d4640 1 -- 172.21.15.7:0/3684222841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3b01062d0 msgr2=0x7fa3b01034d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.557+0000 7fa3b60d4640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3b01062d0 0x7fa3b01034d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400d750 tx=0x7fa3a400dc10 comp rx=0 tx=0).stop 2024-09-21T05:59:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.557+0000 7fa3b60d4640 1 -- 172.21.15.7:0/3684222841 shutdown_connections 2024-09-21T05:59:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.557+0000 7fa3b60d4640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa3980b6700 0x7fa3980b8c10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.557+0000 7fa3b60d4640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3b01062d0 0x7fa3b01034d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.557+0000 7fa3b60d4640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3b0106c20 0x7fa3b0103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.557+0000 7fa3b60d4640 1 --2- 172.21.15.7:0/3684222841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3b0101ff0 0x7fa3b0102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.558+0000 7fa3b60d4640 1 -- 172.21.15.7:0/3684222841 >> 172.21.15.7:0/3684222841 conn(0x7fa3b0077cc0 msgr2=0x7fa3b0107630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.558+0000 7fa3b60d4640 1 -- 172.21.15.7:0/3684222841 shutdown_connections 2024-09-21T05:59:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:54.558+0000 7fa3b60d4640 1 -- 172.21.15.7:0/3684222841 wait complete. 2024-09-21T05:59:55.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:54 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3684222841' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:55.185 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T05:59:55.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:54 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3684222841' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:55.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:54 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3684222841' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:55.444 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.904+0000 7f9b5ab09640 1 -- 172.21.15.7:0/3224348585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b541051e0 msgr2=0x7f9b541055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.904+0000 7f9b5ab09640 1 --2- 172.21.15.7:0/3224348585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b541051e0 0x7f9b541055f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9b48009900 tx=0x7f9b4802a410 comp rx=0 tx=0).stop 2024-09-21T05:59:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.904+0000 7f9b5ab09640 1 -- 172.21.15.7:0/3224348585 shutdown_connections 2024-09-21T05:59:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.904+0000 7f9b5ab09640 1 --2- 172.21.15.7:0/3224348585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b541051e0 0x7f9b541055f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.904+0000 7f9b5ab09640 1 --2- 172.21.15.7:0/3224348585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b54105b30 0x7f9b5410f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.904+0000 7f9b5ab09640 1 --2- 172.21.15.7:0/3224348585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b54103210 0x7f9b54103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.904+0000 7f9b5ab09640 1 -- 172.21.15.7:0/3224348585 >> 172.21.15.7:0/3224348585 conn(0x7f9b54079f90 msgr2=0x7f9b5407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.904+0000 7f9b5ab09640 1 -- 172.21.15.7:0/3224348585 shutdown_connections 2024-09-21T05:59:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.904+0000 7f9b5ab09640 1 -- 172.21.15.7:0/3224348585 wait complete. 2024-09-21T05:59:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b5ab09640 1 Processor -- start 2024-09-21T05:59:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b5ab09640 1 -- start start 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b5ab09640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b54103210 0x7f9b54199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b5ab09640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b541051e0 0x7f9b54199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b5ab09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b54105b30 0x7f9b54199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b5ab09640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541129d0 con 0x7f9b54105b30 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b5ab09640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9b54112850 con 0x7f9b54103210 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b5ab09640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9b54112b50 con 0x7f9b541051e0 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b590a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b54105b30 0x7f9b54199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b590a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b54105b30 0x7f9b54199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43366/0 (socket says 172.21.15.7:43366) 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b590a6640 1 -- 172.21.15.7:0/271368791 learned_addr learned my addr 172.21.15.7:0/271368791 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b588a5640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b54103210 0x7f9b54199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b53fff640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b541051e0 0x7f9b54199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.905+0000 7f9b590a6640 1 -- 172.21.15.7:0/271368791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b541051e0 msgr2=0x7f9b54199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.906+0000 7f9b590a6640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b541051e0 0x7f9b54199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.906+0000 7f9b590a6640 1 -- 172.21.15.7:0/271368791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b54103210 msgr2=0x7f9b54199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.906+0000 7f9b590a6640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b54103210 0x7f9b54199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.906+0000 7f9b590a6640 1 -- 172.21.15.7:0/271368791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b541a87d0 con 0x7f9b54105b30 2024-09-21T05:59:55.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.906+0000 7f9b590a6640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b54105b30 0x7f9b54199bd0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00eaa0 tx=0x7f9b4c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:55.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.906+0000 7f9b51ffb640 1 -- 172.21.15.7:0/271368791 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c004d20 con 0x7f9b54105b30 2024-09-21T05:59:55.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.906+0000 7f9b5ab09640 1 -- 172.21.15.7:0/271368791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b541a8a60 con 0x7f9b54105b30 2024-09-21T05:59:55.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.906+0000 7f9b51ffb640 1 -- 172.21.15.7:0/271368791 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b4c005020 con 0x7f9b54105b30 2024-09-21T05:59:55.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.906+0000 7f9b51ffb640 1 -- 172.21.15.7:0/271368791 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c0116b0 con 0x7f9b54105b30 2024-09-21T05:59:55.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.906+0000 7f9b5ab09640 1 -- 172.21.15.7:0/271368791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b541a8f20 con 0x7f9b54105b30 2024-09-21T05:59:55.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.909+0000 7f9b6107d740 1 Processor -- start 2024-09-21T05:59:55.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.909+0000 7f9b51ffb640 1 -- 172.21.15.7:0/271368791 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9b4c0051d0 con 0x7f9b54105b30 2024-09-21T05:59:55.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.909+0000 7f9b6107d740 1 -- start start 2024-09-21T05:59:55.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.909+0000 7f9b6107d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599e12070 0x55b59a1b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.909+0000 7f9b6107d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 0x55b59a1b9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.909+0000 7f9b6107d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599df1390 0x55b59a1b9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.909+0000 7f9b6107d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b59a12fea0 con 0x55b599de91b0 2024-09-21T05:59:55.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.909+0000 7f9b6107d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b59a11f2d0 con 0x55b599df1390 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.909+0000 7f9b6107d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b59a1230e0 con 0x55b599e12070 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.909+0000 7f9b588a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 0x55b59a1b9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.909+0000 7f9b588a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 0x55b59a1b9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43380/0 (socket says 172.21.15.7:43380) 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b588a5640 1 -- 172.21.15.7:0/1356517287 learned_addr learned my addr 172.21.15.7:0/1356517287 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b53fff640 1 --2- 172.21.15.7:0/1356517287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599df1390 0x55b59a1b9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b53fff640 1 --2- 172.21.15.7:0/1356517287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599e12070 0x55b59a1b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b588a5640 1 -- 172.21.15.7:0/1356517287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599e12070 msgr2=0x55b59a1b92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b588a5640 1 --2- 172.21.15.7:0/1356517287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599e12070 0x55b59a1b92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b588a5640 1 -- 172.21.15.7:0/1356517287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599df1390 msgr2=0x55b59a1b9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b588a5640 1 --2- 172.21.15.7:0/1356517287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599df1390 0x55b59a1b9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b588a5640 1 -- 172.21.15.7:0/1356517287 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b599e7d650 con 0x55b599de91b0 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b51ffb640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9b3c0b6680 0x7f9b3c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b53fff640 1 --2- 172.21.15.7:0/1356517287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599df1390 0x55b59a1b9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:55.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b53fff640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9b3c0b6680 0x7f9b3c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b588a5640 1 --2- 172.21.15.7:0/1356517287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 0x55b59a1b9800 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400ac80 tx=0x7f9b4400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326131c74c923125 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b51ffb640 1 -- 172.21.15.7:0/271368791 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9b4c0e7830 con 0x7f9b54105b30 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b3affd640 1 -- 172.21.15.7:0/1356517287 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4401d070 con 0x55b599de91b0 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.910+0000 7f9b3affd640 1 -- 172.21.15.7:0/1356517287 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b44018af0 con 0x55b599de91b0 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.911+0000 7f9b3affd640 1 -- 172.21.15.7:0/1356517287 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44010ae0 con 0x55b599de91b0 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.911+0000 7f9b6107d740 1 -- 172.21.15.7:0/1356517287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 msgr2=0x55b59a1b9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.911+0000 7f9b6107d740 1 --2- 172.21.15.7:0/1356517287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 0x55b59a1b9800 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400ac80 tx=0x7f9b4400f790 comp rx=0 tx=0).stop 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.911+0000 7f9b53fff640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9b3c0b6680 0x7f9b3c0b8b90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9b48000c00 tx=0x7f9b48005780 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.911+0000 7f9b6107d740 1 -- 172.21.15.7:0/1356517287 shutdown_connections 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.911+0000 7f9b6107d740 1 --2- 172.21.15.7:0/1356517287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 0x55b59a1b9800 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.911+0000 7f9b6107d740 1 --2- 172.21.15.7:0/1356517287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599df1390 0x55b59a1b9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.911+0000 7f9b6107d740 1 --2- 172.21.15.7:0/1356517287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599e12070 0x55b59a1b92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.911+0000 7f9b6107d740 1 -- 172.21.15.7:0/1356517287 >> 172.21.15.7:0/1356517287 conn(0x55b599e06460 msgr2=0x55b59a1b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:55.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.911+0000 7f9b6107d740 1 -- 172.21.15.7:0/1356517287 shutdown_connections 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.911+0000 7f9b6107d740 1 -- 172.21.15.7:0/1356517287 wait complete. 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.912+0000 7f9b6107d740 1 -- start start 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.912+0000 7f9b6107d740 1 Processor -- start 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.912+0000 7f9b6107d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599de91b0 0x55b59a1c4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.912+0000 7f9b6107d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599df1390 0x55b59a1c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.912+0000 7f9b6107d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599e12070 0x55b59a1c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.912+0000 7f9b6107d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b599f80700 con 0x55b599e12070 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.912+0000 7f9b6107d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b59a0ba160 con 0x55b599df1390 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.912+0000 7f9b6107d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b59a1c7af0 con 0x55b599de91b0 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b6107d740 10 client.0 _ll_register_callbacks cb 0x55b59a0d39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b590a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599e12070 0x55b59a1c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b590a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599e12070 0x55b59a1c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43392/0 (socket says 172.21.15.7:43392) 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b590a6640 1 -- 172.21.15.7:0/896639073 learned_addr learned my addr 172.21.15.7:0/896639073 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b53fff640 1 --2- 172.21.15.7:0/896639073 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599df1390 0x55b59a1c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b588a5640 1 --2- 172.21.15.7:0/896639073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599de91b0 0x55b59a1c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b590a6640 1 -- 172.21.15.7:0/896639073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599de91b0 msgr2=0x55b59a1c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b590a6640 1 --2- 172.21.15.7:0/896639073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599de91b0 0x55b59a1c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b590a6640 1 -- 172.21.15.7:0/896639073 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599df1390 msgr2=0x55b59a1c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b590a6640 1 --2- 172.21.15.7:0/896639073 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599df1390 0x55b59a1c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b590a6640 1 -- 172.21.15.7:0/896639073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b59a0e7c90 con 0x55b599e12070 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b590a6640 1 --2- 172.21.15.7:0/896639073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599e12070 0x55b59a1c5420 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0ad400 tx=0x7f9b4c0a9bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d68331f7288f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b33fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b33fff640 1 -- 172.21.15.7:0/896639073 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c01f030 con 0x55b599e12070 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b33fff640 1 -- 172.21.15.7:0/896639073 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9b4c00cd00 con 0x55b599e12070 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.913+0000 7f9b6107d740 1 -- 172.21.15.7:0/896639073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b44018af0 con 0x55b599e12070 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.914+0000 7f9b33fff640 1 -- 172.21.15.7:0/896639073 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9b4c0ade00 con 0x55b599e12070 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.914+0000 7f9b6107d740 10 client.16890 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.914+0000 7f9b6107d740 1 -- 172.21.15.7:0/896639073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b59a1d3820 con 0x55b599e12070 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.914+0000 7f9b33fff640 1 -- 172.21.15.7:0/896639073 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b44018af0 con 0x55b599e12070 2024-09-21T05:59:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.914+0000 7f9b33fff640 1 -- 172.21.15.7:0/896639073 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9b4c00f040 con 0x55b599e12070 2024-09-21T05:59:55.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.914+0000 7f9b6107d740 10 client.16890 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:55.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.914+0000 7f9b6107d740 10 client.16890 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:59:55.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.914+0000 7f9b6107d740 20 client.16890 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:55.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.914+0000 7f9b6107d740 1 --2- 172.21.15.7:0/896639073 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b599dd09f0 0x55b59a1d6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.914+0000 7f9b6107d740 4 client.16890 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:55.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.914+0000 7f9b6107d740 1 -- 172.21.15.7:0/896639073 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b59a131df0 con 0x55b599dd09f0 2024-09-21T05:59:55.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.914+0000 7f9b588a5640 1 --2- 172.21.15.7:0/896639073 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b599dd09f0 0x55b59a1d6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.915+0000 7f9b33fff640 10 client.16890 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:55.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.915+0000 7f9b588a5640 1 --2- 172.21.15.7:0/896639073 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b599dd09f0 0x55b59a1d6d90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=acbd64ae59472452 server_cookie=1b5faa29ddbdde1 in_seq=0 out_seq=0 2024-09-21T05:59:55.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b33fff640 1 -- 172.21.15.7:0/896639073 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b59a131df0 con 0x55b599dd09f0 2024-09-21T05:59:55.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b33fff640 10 client.16890 handle_command_reply: tid=0 2024-09-21T05:59:55.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b6107d740 1 client.16890 shutdown 2024-09-21T05:59:55.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b6107d740 1 -- 172.21.15.7:0/896639073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599e12070 msgr2=0x55b59a1c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:55.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b6107d740 1 --2- 172.21.15.7:0/896639073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599e12070 0x55b59a1c5420 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0ad400 tx=0x7f9b4c0a9bf0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b6107d740 1 -- 172.21.15.7:0/896639073 shutdown_connections 2024-09-21T05:59:55.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b6107d740 1 --2- 172.21.15.7:0/896639073 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b599dd09f0 0x55b59a1d6d90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b6107d740 1 --2- 172.21.15.7:0/896639073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599e12070 0x55b59a1c5420 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b6107d740 1 --2- 172.21.15.7:0/896639073 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599df1390 0x55b59a1c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b6107d740 1 --2- 172.21.15.7:0/896639073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599de91b0 0x55b59a1c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b33fff640 0 client.16890 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:55.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b6107d740 1 -- 172.21.15.7:0/896639073 >> 172.21.15.7:0/896639073 conn(0x55b599e06460 msgr2=0x55b59a1bacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:55.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b6107d740 1 -- 172.21.15.7:0/896639073 shutdown_connections 2024-09-21T05:59:55.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b6107d740 1 -- 172.21.15.7:0/896639073 wait complete. 2024-09-21T05:59:55.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.916+0000 7f9b6107d740 20 client.16890 trim_cache size 0 max 16384 2024-09-21T05:59:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.929+0000 7f9b6107d740 1 Processor -- start 2024-09-21T05:59:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.929+0000 7f9b6107d740 1 -- start start 2024-09-21T05:59:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.929+0000 7f9b6107d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599de91b0 0x55b59a1c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.929+0000 7f9b6107d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599df1390 0x55b59a1baa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b6107d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599e12070 0x55b59a1c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b6107d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541b4000 con 0x55b599df1390 2024-09-21T05:59:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b6107d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541b18d0 con 0x55b599e12070 2024-09-21T05:59:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b6107d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541af720 con 0x55b599de91b0 2024-09-21T05:59:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599df1390 0x55b59a1baa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599df1390 0x55b59a1baa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43402/0 (socket says 172.21.15.7:43402) 2024-09-21T05:59:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b53fff640 1 -- 172.21.15.7:0/4013205226 learned_addr learned my addr 172.21.15.7:0/4013205226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b588a5640 1 --2- 172.21.15.7:0/4013205226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599de91b0 0x55b59a1c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b590a6640 1 --2- 172.21.15.7:0/4013205226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599e12070 0x55b59a1c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b53fff640 1 -- 172.21.15.7:0/4013205226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599de91b0 msgr2=0x55b59a1c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b53fff640 1 --2- 172.21.15.7:0/4013205226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599de91b0 0x55b59a1c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b53fff640 1 -- 172.21.15.7:0/4013205226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599e12070 msgr2=0x55b59a1c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b53fff640 1 --2- 172.21.15.7:0/4013205226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599e12070 0x55b59a1c1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b53fff640 1 -- 172.21.15.7:0/4013205226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b59a1bc120 con 0x55b599df1390 2024-09-21T05:59:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b588a5640 1 --2- 172.21.15.7:0/4013205226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599de91b0 0x55b59a1c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b53fff640 1 --2- 172.21.15.7:0/4013205226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599df1390 0x55b59a1baa00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9b48009900 tx=0x7f9b4803f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f969815d1888b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b3a7fc640 1 -- 172.21.15.7:0/4013205226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b480041c0 con 0x55b599df1390 2024-09-21T05:59:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b3a7fc640 1 -- 172.21.15.7:0/4013205226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b48004360 con 0x55b599df1390 2024-09-21T05:59:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.930+0000 7f9b3a7fc640 1 -- 172.21.15.7:0/4013205226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4803d850 con 0x55b599df1390 2024-09-21T05:59:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.931+0000 7f9b6107d740 1 -- 172.21.15.7:0/4013205226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599df1390 msgr2=0x55b59a1baa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.931+0000 7f9b6107d740 1 --2- 172.21.15.7:0/4013205226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599df1390 0x55b59a1baa00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9b48009900 tx=0x7f9b4803f040 comp rx=0 tx=0).stop 2024-09-21T05:59:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.931+0000 7f9b6107d740 1 -- 172.21.15.7:0/4013205226 shutdown_connections 2024-09-21T05:59:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.931+0000 7f9b6107d740 1 --2- 172.21.15.7:0/4013205226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599df1390 0x55b59a1baa00 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.931+0000 7f9b6107d740 1 --2- 172.21.15.7:0/4013205226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599e12070 0x55b59a1c1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.931+0000 7f9b6107d740 1 --2- 172.21.15.7:0/4013205226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599de91b0 0x55b59a1c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.931+0000 7f9b6107d740 1 -- 172.21.15.7:0/4013205226 >> 172.21.15.7:0/4013205226 conn(0x55b599e06460 msgr2=0x55b59a1ba2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.931+0000 7f9b6107d740 1 -- 172.21.15.7:0/4013205226 shutdown_connections 2024-09-21T05:59:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.931+0000 7f9b6107d740 1 -- 172.21.15.7:0/4013205226 wait complete. 2024-09-21T05:59:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.932+0000 7f9b6107d740 1 -- start start 2024-09-21T05:59:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.932+0000 7f9b6107d740 1 Processor -- start 2024-09-21T05:59:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.932+0000 7f9b6107d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 0x55b59a1c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.932+0000 7f9b6107d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599df1390 0x55b59a1c9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.932+0000 7f9b6107d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599e12070 0x55b59a240750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.932+0000 7f9b6107d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541afd90 con 0x55b599de91b0 2024-09-21T05:59:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.932+0000 7f9b6107d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541b1200 con 0x55b599e12070 2024-09-21T05:59:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.932+0000 7f9b6107d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9b541b0460 con 0x55b599df1390 2024-09-21T05:59:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.932+0000 7f9b6107d740 10 client.0 _ll_register_callbacks cb 0x7f9b4c004ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.932+0000 7f9b588a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 0x55b59a1c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.932+0000 7f9b588a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 0x55b59a1c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43406/0 (socket says 172.21.15.7:43406) 2024-09-21T05:59:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.932+0000 7f9b588a5640 1 -- 172.21.15.7:0/3777976226 learned_addr learned my addr 172.21.15.7:0/3777976226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.932+0000 7f9b53fff640 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599df1390 0x55b59a1c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b590a6640 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599e12070 0x55b59a240750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b588a5640 1 -- 172.21.15.7:0/3777976226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599df1390 msgr2=0x55b59a1c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b588a5640 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599df1390 0x55b59a1c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b588a5640 1 -- 172.21.15.7:0/3777976226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599e12070 msgr2=0x55b59a240750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b588a5640 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599e12070 0x55b59a240750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b588a5640 1 -- 172.21.15.7:0/3777976226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b59a1c9d20 con 0x55b599de91b0 2024-09-21T05:59:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b590a6640 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599e12070 0x55b59a240750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b588a5640 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 0x55b59a1c8fd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400ac80 tx=0x7f9b44010720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b85a9669a84a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b33fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b33fff640 1 -- 172.21.15.7:0/3777976226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4401d040 con 0x55b599de91b0 2024-09-21T05:59:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b33fff640 1 -- 172.21.15.7:0/3777976226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9b44018440 con 0x55b599de91b0 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b6107d740 1 -- 172.21.15.7:0/3777976226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b48004360 con 0x55b599de91b0 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b33fff640 1 -- 172.21.15.7:0/3777976226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9b44018640 con 0x55b599de91b0 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b6107d740 10 client.16896 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.933+0000 7f9b6107d740 1 -- 172.21.15.7:0/3777976226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b59a241bc0 con 0x55b599de91b0 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.934+0000 7f9b33fff640 1 -- 172.21.15.7:0/3777976226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b48004360 con 0x55b599de91b0 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.934+0000 7f9b33fff640 1 -- 172.21.15.7:0/3777976226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9b44005040 con 0x55b599de91b0 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.934+0000 7f9b6107d740 10 client.16896 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.934+0000 7f9b6107d740 10 client.16896 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.934+0000 7f9b6107d740 20 client.16896 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.934+0000 7f9b6107d740 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b599da5da0 0x55b59a244070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.934+0000 7f9b6107d740 4 client.16896 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.934+0000 7f9b6107d740 1 -- 172.21.15.7:0/3777976226 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b59a12d8a0 con 0x55b599da5da0 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.934+0000 7f9b53fff640 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b599da5da0 0x55b59a244070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b53fff640 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b599da5da0 0x55b59a244070 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4f17b7087f8599af server_cookie=376e8a0d969a519 in_seq=0 out_seq=0 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b33fff640 10 client.16896 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b33fff640 1 -- 172.21.15.7:0/3777976226 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b59a12d8a0 con 0x55b599da5da0 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b33fff640 10 client.16896 handle_command_reply: tid=0 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b6107d740 1 client.16896 shutdown 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b6107d740 1 -- 172.21.15.7:0/3777976226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 msgr2=0x55b59a1c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b6107d740 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 0x55b59a1c8fd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400ac80 tx=0x7f9b44010720 comp rx=0 tx=0).stop 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b6107d740 1 -- 172.21.15.7:0/3777976226 shutdown_connections 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b6107d740 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55b599da5da0 0x55b59a244070 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b6107d740 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b599e12070 0x55b59a240750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b6107d740 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b599df1390 0x55b59a1c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b6107d740 1 --2- 172.21.15.7:0/3777976226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b599de91b0 0x55b59a1c8fd0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b33fff640 0 client.16896 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b6107d740 1 -- 172.21.15.7:0/3777976226 >> 172.21.15.7:0/3777976226 conn(0x55b599e06460 msgr2=0x55b59a1baa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b6107d740 1 -- 172.21.15.7:0/3777976226 shutdown_connections 2024-09-21T05:59:55.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b6107d740 1 -- 172.21.15.7:0/3777976226 wait complete. 2024-09-21T05:59:55.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.935+0000 7f9b6107d740 20 client.16896 trim_cache size 0 max 16384 2024-09-21T05:59:55.942 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:59:55.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.936+0000 7f9b5ab09640 1 -- 172.21.15.7:0/271368791 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9b3c0b6680 msgr2=0x7f9b3c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:55.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.936+0000 7f9b5ab09640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9b3c0b6680 0x7f9b3c0b8b90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9b48000c00 tx=0x7f9b48005780 comp rx=0 tx=0).stop 2024-09-21T05:59:55.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.936+0000 7f9b5ab09640 1 -- 172.21.15.7:0/271368791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b54105b30 msgr2=0x7f9b54199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:55.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.936+0000 7f9b5ab09640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b54105b30 0x7f9b54199bd0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00eaa0 tx=0x7f9b4c00eea0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.936+0000 7f9b5ab09640 1 -- 172.21.15.7:0/271368791 shutdown_connections 2024-09-21T05:59:55.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.936+0000 7f9b5ab09640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9b3c0b6680 0x7f9b3c0b8b90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.936+0000 7f9b5ab09640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b54105b30 0x7f9b54199bd0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.936+0000 7f9b5ab09640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b541051e0 0x7f9b54199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.936+0000 7f9b5ab09640 1 --2- 172.21.15.7:0/271368791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b54103210 0x7f9b54199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.936+0000 7f9b5ab09640 1 -- 172.21.15.7:0/271368791 >> 172.21.15.7:0/271368791 conn(0x7f9b54079f90 msgr2=0x7f9b54106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:55.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.936+0000 7f9b5ab09640 1 -- 172.21.15.7:0/271368791 shutdown_connections 2024-09-21T05:59:55.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:55.936+0000 7f9b5ab09640 1 -- 172.21.15.7:0/271368791 wait complete. 2024-09-21T05:59:56.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:55 smithi027 ceph-mon[34364]: pgmap v499: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8 op/s 2024-09-21T05:59:56.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:55 smithi007 ceph-mon[30983]: pgmap v499: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8 op/s 2024-09-21T05:59:56.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:55 smithi119 ceph-mon[34833]: pgmap v499: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8 op/s 2024-09-21T05:59:56.730 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T05:59:56.990 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:57.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.411+0000 7f907c8a7640 1 -- 172.21.15.7:0/3278997913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9078109df0 msgr2=0x7f9078110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.411+0000 7f907c8a7640 1 --2- 172.21.15.7:0/3278997913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9078109df0 0x7f9078110620 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f9070009ca0 tx=0x7f907002a8e0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.411+0000 7f907c8a7640 1 -- 172.21.15.7:0/3278997913 shutdown_connections 2024-09-21T05:59:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.411+0000 7f907c8a7640 1 --2- 172.21.15.7:0/3278997913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9078109df0 0x7f9078110620 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.411+0000 7f907c8a7640 1 --2- 172.21.15.7:0/3278997913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90781094a0 0x7f90781098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.411+0000 7f907c8a7640 1 --2- 172.21.15.7:0/3278997913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9078103b60 0x7f9078103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.411+0000 7f907c8a7640 1 -- 172.21.15.7:0/3278997913 >> 172.21.15.7:0/3278997913 conn(0x7f907807b850 msgr2=0x7f907807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.411+0000 7f907c8a7640 1 -- 172.21.15.7:0/3278997913 shutdown_connections 2024-09-21T05:59:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.411+0000 7f907c8a7640 1 -- 172.21.15.7:0/3278997913 wait complete. 2024-09-21T05:59:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.412+0000 7f907c8a7640 1 Processor -- start 2024-09-21T05:59:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.412+0000 7f907c8a7640 1 -- start start 2024-09-21T05:59:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.412+0000 7f907c8a7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9078103b60 0x7f9078075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.412+0000 7f907c8a7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90781094a0 0x7f9078075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.412+0000 7f907c8a7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9078109df0 0x7f9078076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.412+0000 7f907c8a7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9078113af0 con 0x7f90781094a0 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.412+0000 7f907c8a7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9078113970 con 0x7f9078109df0 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.412+0000 7f907c8a7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9078113c70 con 0x7f9078103b60 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.412+0000 7f9075d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90781094a0 0x7f9078075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.412+0000 7f9075d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90781094a0 0x7f9078075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43422/0 (socket says 172.21.15.7:43422) 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.412+0000 7f9075d9b640 1 -- 172.21.15.7:0/563479455 learned_addr learned my addr 172.21.15.7:0/563479455 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.412+0000 7f907659c640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9078103b60 0x7f9078075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.412+0000 7f9076d9d640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9078109df0 0x7f9078076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.413+0000 7f9075d9b640 1 -- 172.21.15.7:0/563479455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9078103b60 msgr2=0x7f9078075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.413+0000 7f9075d9b640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9078103b60 0x7f9078075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.413+0000 7f9075d9b640 1 -- 172.21.15.7:0/563479455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9078109df0 msgr2=0x7f9078076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.413+0000 7f9075d9b640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9078109df0 0x7f9078076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.413+0000 7f9075d9b640 1 -- 172.21.15.7:0/563479455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90781a86b0 con 0x7f90781094a0 2024-09-21T05:59:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.413+0000 7f9075d9b640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90781094a0 0x7f9078075c50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f906c006fd0 tx=0x7f906c00b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.413+0000 7f90677fe640 1 -- 172.21.15.7:0/563479455 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c015020 con 0x7f90781094a0 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.413+0000 7f90677fe640 1 -- 172.21.15.7:0/563479455 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f906c011ce0 con 0x7f90781094a0 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.413+0000 7f907c8a7640 1 -- 172.21.15.7:0/563479455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90781a89a0 con 0x7f90781094a0 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.413+0000 7f90677fe640 1 -- 172.21.15.7:0/563479455 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c010d90 con 0x7f90781094a0 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.413+0000 7f907c8a7640 1 -- 172.21.15.7:0/563479455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90781a8f60 con 0x7f90781094a0 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.416+0000 7f9082e1b740 1 Processor -- start 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.416+0000 7f9082e1b740 1 -- start start 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.416+0000 7f9082e1b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 0x5596393902c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.416+0000 7f9082e1b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fc01b0 0x559639390800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.416+0000 7f9082e1b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc8390 0x559639390d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.416+0000 7f9082e1b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559639306ea0 con 0x559638fe9070 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.416+0000 7f9082e1b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5596392f62d0 con 0x559638fc01b0 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.416+0000 7f9082e1b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5596392fa0e0 con 0x559638fc8390 2024-09-21T05:59:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.416+0000 7f90677fe640 1 -- 172.21.15.7:0/563479455 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f906c018020 con 0x7f90781094a0 2024-09-21T05:59:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.416+0000 7f9076d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 0x5596393902c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.416+0000 7f9076d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 0x5596393902c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43438/0 (socket says 172.21.15.7:43438) 2024-09-21T05:59:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.416+0000 7f9076d9d640 1 -- 172.21.15.7:0/1369554702 learned_addr learned my addr 172.21.15.7:0/1369554702 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.417+0000 7f907659c640 1 --2- 172.21.15.7:0/1369554702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fc01b0 0x559639390800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.417+0000 7f9075d9b640 1 --2- 172.21.15.7:0/1369554702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc8390 0x559639390d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.417+0000 7f907659c640 1 -- 172.21.15.7:0/1369554702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc8390 msgr2=0x559639390d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.417+0000 7f907659c640 1 --2- 172.21.15.7:0/1369554702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc8390 0x559639390d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.417+0000 7f907659c640 1 -- 172.21.15.7:0/1369554702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 msgr2=0x5596393902c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.417+0000 7f907659c640 1 --2- 172.21.15.7:0/1369554702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 0x5596393902c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.417+0000 7f907659c640 1 -- 172.21.15.7:0/1369554702 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559639054650 con 0x559638fc01b0 2024-09-21T05:59:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.418+0000 7f9076d9d640 1 --2- 172.21.15.7:0/1369554702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 0x5596393902c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.418+0000 7f90677fe640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f90600b6680 0x7f90600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.418+0000 7f9076d9d640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f90600b6680 0x7f90600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.418+0000 7f90677fe640 1 -- 172.21.15.7:0/563479455 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f906c0e6de0 con 0x7f90781094a0 2024-09-21T05:59:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.418+0000 7f9076d9d640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f90600b6680 0x7f90600b8b90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9070035000 tx=0x7f90700315b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.419+0000 7f907659c640 1 --2- 172.21.15.7:0/1369554702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fc01b0 0x559639390800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f906800aba0 tx=0x7f906800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4080a6e6fa997ae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.419+0000 7f9064ff9640 1 -- 172.21.15.7:0/1369554702 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068005220 con 0x559638fc01b0 2024-09-21T05:59:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.419+0000 7f9064ff9640 1 -- 172.21.15.7:0/1369554702 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90680047a0 con 0x559638fc01b0 2024-09-21T05:59:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.419+0000 7f9064ff9640 1 -- 172.21.15.7:0/1369554702 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068018660 con 0x559638fc01b0 2024-09-21T05:59:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.420+0000 7f9082e1b740 1 -- 172.21.15.7:0/1369554702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fc01b0 msgr2=0x559639390800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.420+0000 7f9082e1b740 1 --2- 172.21.15.7:0/1369554702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fc01b0 0x559639390800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f906800aba0 tx=0x7f906800f790 comp rx=0 tx=0).stop 2024-09-21T05:59:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.420+0000 7f9082e1b740 1 -- 172.21.15.7:0/1369554702 shutdown_connections 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.420+0000 7f9082e1b740 1 --2- 172.21.15.7:0/1369554702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc8390 0x559639390d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.420+0000 7f9082e1b740 1 --2- 172.21.15.7:0/1369554702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fc01b0 0x559639390800 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.420+0000 7f9082e1b740 1 --2- 172.21.15.7:0/1369554702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 0x5596393902c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.420+0000 7f9082e1b740 1 -- 172.21.15.7:0/1369554702 >> 172.21.15.7:0/1369554702 conn(0x559638fdd460 msgr2=0x55963938e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.420+0000 7f9082e1b740 1 -- 172.21.15.7:0/1369554702 shutdown_connections 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.420+0000 7f9082e1b740 1 -- 172.21.15.7:0/1369554702 wait complete. 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f9082e1b740 1 -- start start 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f9082e1b740 1 Processor -- start 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f9082e1b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc01b0 0x55963939b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f9082e1b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc8390 0x55963939be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f9082e1b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fe9070 0x55963939c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f9082e1b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559639157700 con 0x559638fc01b0 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f9082e1b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559639291160 con 0x559638fe9070 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f9082e1b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55963939eaa0 con 0x559638fc8390 2024-09-21T05:59:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f9082e1b740 10 client.0 _ll_register_callbacks cb 0x5596392aa9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f907659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc01b0 0x55963939b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f907659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc01b0 0x55963939b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43448/0 (socket says 172.21.15.7:43448) 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f907659c640 1 -- 172.21.15.7:0/2818313512 learned_addr learned my addr 172.21.15.7:0/2818313512 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f9076d9d640 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fe9070 0x55963939c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.421+0000 7f9075d9b640 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc8390 0x55963939be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.422+0000 7f9076d9d640 1 -- 172.21.15.7:0/2818313512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc8390 msgr2=0x55963939be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.422+0000 7f9076d9d640 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc8390 0x55963939be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.422+0000 7f9076d9d640 1 -- 172.21.15.7:0/2818313512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc01b0 msgr2=0x55963939b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.422+0000 7f9076d9d640 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc01b0 0x55963939b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.422+0000 7f9076d9d640 1 -- 172.21.15.7:0/2818313512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596392bec90 con 0x559638fe9070 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.422+0000 7f9075d9b640 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc8390 0x55963939be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.422+0000 7f907659c640 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc01b0 0x55963939b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.422+0000 7f9076d9d640 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fe9070 0x55963939c3b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9070009890 tx=0x7f907002a8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=314d5c1e5680f230 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.422+0000 7f905dffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.422+0000 7f905dffb640 1 -- 172.21.15.7:0/2818313512 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90700045c0 con 0x559638fe9070 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.422+0000 7f905dffb640 1 -- 172.21.15.7:0/2818313512 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9070004760 con 0x559638fe9070 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.422+0000 7f9082e1b740 1 -- 172.21.15.7:0/2818313512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90680047a0 con 0x559638fe9070 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.423+0000 7f905dffb640 1 -- 172.21.15.7:0/2818313512 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f90700305e0 con 0x559638fe9070 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.423+0000 7f9082e1b740 10 client.26438 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.423+0000 7f9082e1b740 1 -- 172.21.15.7:0/2818313512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5596393aa6b0 con 0x559638fe9070 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.423+0000 7f905dffb640 1 -- 172.21.15.7:0/2818313512 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90680047a0 con 0x559638fe9070 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.423+0000 7f905dffb640 1 -- 172.21.15.7:0/2818313512 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9070050070 con 0x559638fe9070 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.423+0000 7f9082e1b740 10 client.26438 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.423+0000 7f9082e1b740 10 client.26438 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.423+0000 7f9082e1b740 20 client.26438 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.423+0000 7f9082e1b740 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559638fa79f0 0x5596393adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.423+0000 7f9082e1b740 4 client.26438 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.423+0000 7f9082e1b740 1 -- 172.21.15.7:0/2818313512 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559639308df0 con 0x559638fa79f0 2024-09-21T05:59:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.423+0000 7f907659c640 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559638fa79f0 0x5596393adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.424+0000 7f905dffb640 10 client.26438 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.424+0000 7f907659c640 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559638fa79f0 0x5596393adbd0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a48228682852afd server_cookie=8c379171f77fbc53 in_seq=0 out_seq=0 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f905dffb640 1 -- 172.21.15.7:0/2818313512 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559639308df0 con 0x559638fa79f0 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f905dffb640 10 client.26438 handle_command_reply: tid=0 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f9082e1b740 1 client.26438 shutdown 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f9082e1b740 1 -- 172.21.15.7:0/2818313512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fe9070 msgr2=0x55963939c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f9082e1b740 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fe9070 0x55963939c3b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9070009890 tx=0x7f907002a8e0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f9082e1b740 1 -- 172.21.15.7:0/2818313512 shutdown_connections 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f9082e1b740 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559638fa79f0 0x5596393adbd0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f9082e1b740 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fe9070 0x55963939c3b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f9082e1b740 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc8390 0x55963939be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f9082e1b740 1 --2- 172.21.15.7:0/2818313512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc01b0 0x55963939b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f905dffb640 0 client.26438 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f9082e1b740 1 -- 172.21.15.7:0/2818313512 >> 172.21.15.7:0/2818313512 conn(0x559638fdd460 msgr2=0x5596393934a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f9082e1b740 1 -- 172.21.15.7:0/2818313512 shutdown_connections 2024-09-21T05:59:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f9082e1b740 1 -- 172.21.15.7:0/2818313512 wait complete. 2024-09-21T05:59:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.425+0000 7f9082e1b740 20 client.26438 trim_cache size 0 max 16384 2024-09-21T05:59:57.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.439+0000 7f9082e1b740 1 Processor -- start 2024-09-21T05:59:57.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.439+0000 7f9082e1b740 1 -- start start 2024-09-21T05:59:57.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.439+0000 7f9082e1b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc01b0 0x55963939d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.439+0000 7f9082e1b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc8390 0x559639398b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.439+0000 7f9082e1b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fe9070 0x559639399060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.439+0000 7f9082e1b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90781b4000 con 0x559638fc8390 2024-09-21T05:59:57.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.439+0000 7f9082e1b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f90781b18d0 con 0x559638fe9070 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.439+0000 7f9082e1b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90781af740 con 0x559638fc01b0 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f9075d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc8390 0x559639398b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f9075d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc8390 0x559639398b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43460/0 (socket says 172.21.15.7:43460) 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f9075d9b640 1 -- 172.21.15.7:0/4278084623 learned_addr learned my addr 172.21.15.7:0/4278084623 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f907659c640 1 --2- 172.21.15.7:0/4278084623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc01b0 0x55963939d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f9076d9d640 1 --2- 172.21.15.7:0/4278084623 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fe9070 0x559639399060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f9075d9b640 1 -- 172.21.15.7:0/4278084623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc01b0 msgr2=0x55963939d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f9075d9b640 1 --2- 172.21.15.7:0/4278084623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc01b0 0x55963939d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f9075d9b640 1 -- 172.21.15.7:0/4278084623 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fe9070 msgr2=0x559639399060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f9075d9b640 1 --2- 172.21.15.7:0/4278084623 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fe9070 0x559639399060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f9075d9b640 1 -- 172.21.15.7:0/4278084623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596393925b0 con 0x559638fc8390 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f9076d9d640 1 --2- 172.21.15.7:0/4278084623 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fe9070 0x559639399060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f9075d9b640 1 --2- 172.21.15.7:0/4278084623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc8390 0x559639398b20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f906c0e4610 tx=0x7f906c0ea540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbcb8fe8b3a11ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f905ffff640 1 -- 172.21.15.7:0/4278084623 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c0a8b50 con 0x559638fc8390 2024-09-21T05:59:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f905ffff640 1 -- 172.21.15.7:0/4278084623 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f906c0ac7c0 con 0x559638fc8390 2024-09-21T05:59:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.440+0000 7f905ffff640 1 -- 172.21.15.7:0/4278084623 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c0a8420 con 0x559638fc8390 2024-09-21T05:59:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.441+0000 7f9082e1b740 1 -- 172.21.15.7:0/4278084623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc8390 msgr2=0x559639398b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.441+0000 7f9082e1b740 1 --2- 172.21.15.7:0/4278084623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc8390 0x559639398b20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f906c0e4610 tx=0x7f906c0ea540 comp rx=0 tx=0).stop 2024-09-21T05:59:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.441+0000 7f9082e1b740 1 -- 172.21.15.7:0/4278084623 shutdown_connections 2024-09-21T05:59:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.441+0000 7f9082e1b740 1 --2- 172.21.15.7:0/4278084623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fc8390 0x559639398b20 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.441+0000 7f9082e1b740 1 --2- 172.21.15.7:0/4278084623 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fe9070 0x559639399060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.441+0000 7f9082e1b740 1 --2- 172.21.15.7:0/4278084623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc01b0 0x55963939d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.441+0000 7f9082e1b740 1 -- 172.21.15.7:0/4278084623 >> 172.21.15.7:0/4278084623 conn(0x559638fdd460 msgr2=0x55963939ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.441+0000 7f9082e1b740 1 -- 172.21.15.7:0/4278084623 shutdown_connections 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.441+0000 7f9082e1b740 1 -- 172.21.15.7:0/4278084623 wait complete. 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f9082e1b740 1 -- start start 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f9082e1b740 1 Processor -- start 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f9082e1b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc01b0 0x55963939fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f9082e1b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fc8390 0x5596393a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f9082e1b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 0x5596393a0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f9082e1b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90781afd90 con 0x559638fe9070 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f9082e1b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f90781b1200 con 0x559638fc8390 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f9082e1b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90781b0460 con 0x559638fc01b0 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f9082e1b740 10 client.0 _ll_register_callbacks cb 0x7f9070009c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f9076d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 0x5596393a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f9076d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 0x5596393a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43472/0 (socket says 172.21.15.7:43472) 2024-09-21T05:59:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f9076d9d640 1 -- 172.21.15.7:0/4020665758 learned_addr learned my addr 172.21.15.7:0/4020665758 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f9075d9b640 1 --2- 172.21.15.7:0/4020665758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fc8390 0x5596393a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.442+0000 7f907659c640 1 --2- 172.21.15.7:0/4020665758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc01b0 0x55963939fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f9076d9d640 1 -- 172.21.15.7:0/4020665758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc01b0 msgr2=0x55963939fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f9076d9d640 1 --2- 172.21.15.7:0/4020665758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc01b0 0x55963939fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f9076d9d640 1 -- 172.21.15.7:0/4020665758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fc8390 msgr2=0x5596393a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f9076d9d640 1 --2- 172.21.15.7:0/4020665758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fc8390 0x5596393a01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f9076d9d640 1 -- 172.21.15.7:0/4020665758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596394175d0 con 0x559638fe9070 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f9076d9d640 1 --2- 172.21.15.7:0/4020665758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 0x5596393a0730 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9070009a60 tx=0x7f9070052ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6b5ba172ef814e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f905dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f905dffb640 1 -- 172.21.15.7:0/4020665758 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907005f020 con 0x559638fe9070 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f905dffb640 1 -- 172.21.15.7:0/4020665758 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9070004610 con 0x559638fe9070 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f9082e1b740 1 -- 172.21.15.7:0/4020665758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f906c0ac7c0 con 0x559638fe9070 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f905dffb640 1 -- 172.21.15.7:0/4020665758 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f907006a050 con 0x559638fe9070 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f9082e1b740 10 client.16914 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f9082e1b740 1 -- 172.21.15.7:0/4020665758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559639418770 con 0x559638fe9070 2024-09-21T05:59:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.443+0000 7f905dffb640 1 -- 172.21.15.7:0/4020665758 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f906c0ac7c0 con 0x559638fe9070 2024-09-21T05:59:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.444+0000 7f905dffb640 1 -- 172.21.15.7:0/4020665758 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9070050040 con 0x559638fe9070 2024-09-21T05:59:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.444+0000 7f9082e1b740 10 client.16914 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.444+0000 7f9082e1b740 10 client.16914 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T05:59:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.444+0000 7f9082e1b740 20 client.16914 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.444+0000 7f9082e1b740 1 --2- 172.21.15.7:0/4020665758 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559638f7cda0 0x55963941afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.444+0000 7f9082e1b740 4 client.16914 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:59:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.444+0000 7f9082e1b740 1 -- 172.21.15.7:0/4020665758 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5596393048a0 con 0x559638f7cda0 2024-09-21T05:59:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.444+0000 7f907659c640 1 --2- 172.21.15.7:0/4020665758 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559638f7cda0 0x55963941afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f905dffb640 10 client.16914 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.444+0000 7f907659c640 1 --2- 172.21.15.7:0/4020665758 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559638f7cda0 0x55963941afb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a0b4c8ee771690d4 server_cookie=a5c6a0778f8a4047 in_seq=0 out_seq=0 2024-09-21T05:59:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f905dffb640 1 -- 172.21.15.7:0/4020665758 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5596393048a0 con 0x559638f7cda0 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f905dffb640 10 client.16914 handle_command_reply: tid=0 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f9082e1b740 1 client.16914 shutdown 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f9082e1b740 1 -- 172.21.15.7:0/4020665758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 msgr2=0x5596393a0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f9082e1b740 1 --2- 172.21.15.7:0/4020665758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 0x5596393a0730 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9070009a60 tx=0x7f9070052ce0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f9082e1b740 1 -- 172.21.15.7:0/4020665758 shutdown_connections 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f9082e1b740 1 --2- 172.21.15.7:0/4020665758 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559638f7cda0 0x55963941afb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f9082e1b740 1 --2- 172.21.15.7:0/4020665758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559638fe9070 0x5596393a0730 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f905dffb640 0 client.16914 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f9082e1b740 1 --2- 172.21.15.7:0/4020665758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559638fc8390 0x5596393a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f9082e1b740 1 --2- 172.21.15.7:0/4020665758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559638fc01b0 0x55963939fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f9082e1b740 1 -- 172.21.15.7:0/4020665758 >> 172.21.15.7:0/4020665758 conn(0x559638fdd460 msgr2=0x5596393a6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f9082e1b740 1 -- 172.21.15.7:0/4020665758 shutdown_connections 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f9082e1b740 1 -- 172.21.15.7:0/4020665758 wait complete. 2024-09-21T05:59:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.445+0000 7f9082e1b740 20 client.16914 trim_cache size 0 max 16384 2024-09-21T05:59:57.452 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:59:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.446+0000 7f907c8a7640 1 -- 172.21.15.7:0/563479455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f90600b6680 msgr2=0x7f90600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.446+0000 7f907c8a7640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f90600b6680 0x7f90600b8b90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9070035000 tx=0x7f90700315b0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.446+0000 7f907c8a7640 1 -- 172.21.15.7:0/563479455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90781094a0 msgr2=0x7f9078075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.446+0000 7f907c8a7640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90781094a0 0x7f9078075c50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f906c006fd0 tx=0x7f906c00b820 comp rx=0 tx=0).stop 2024-09-21T05:59:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.446+0000 7f907c8a7640 1 -- 172.21.15.7:0/563479455 shutdown_connections 2024-09-21T05:59:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.446+0000 7f907c8a7640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f90600b6680 0x7f90600b8b90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.446+0000 7f907c8a7640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90781094a0 0x7f9078075c50 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.446+0000 7f907c8a7640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9078109df0 0x7f9078076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.446+0000 7f907c8a7640 1 --2- 172.21.15.7:0/563479455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9078103b60 0x7f9078075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.446+0000 7f907c8a7640 1 -- 172.21.15.7:0/563479455 >> 172.21.15.7:0/563479455 conn(0x7f907807b850 msgr2=0x7f90781074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.446+0000 7f907c8a7640 1 -- 172.21.15.7:0/563479455 shutdown_connections 2024-09-21T05:59:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:57.446+0000 7f907c8a7640 1 -- 172.21.15.7:0/563479455 wait complete. 2024-09-21T05:59:58.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T05:59:58.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:57 smithi007 ceph-mon[30983]: pgmap v500: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T05:59:58.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:57 smithi027 ceph-mon[34364]: pgmap v500: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T05:59:58.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:57 smithi119 ceph-mon[34833]: pgmap v500: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T05:59:58.450 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:58.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.904+0000 7fd86d187640 1 -- 172.21.15.7:0/3754865600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd868102a60 msgr2=0x7fd868102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:58.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.904+0000 7fd86d187640 1 --2- 172.21.15.7:0/3754865600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd868102a60 0x7fd868102e70 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd858009900 tx=0x7fd85802a410 comp rx=0 tx=0).stop 2024-09-21T05:59:58.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.904+0000 7fd86d187640 1 -- 172.21.15.7:0/3754865600 shutdown_connections 2024-09-21T05:59:58.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.904+0000 7fd86d187640 1 --2- 172.21.15.7:0/3754865600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd868108cf0 0x7fd86810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.904+0000 7fd86d187640 1 --2- 172.21.15.7:0/3754865600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8681083a0 0x7fd8681087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.904+0000 7fd86d187640 1 --2- 172.21.15.7:0/3754865600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd868102a60 0x7fd868102e70 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.904+0000 7fd86d187640 1 -- 172.21.15.7:0/3754865600 >> 172.21.15.7:0/3754865600 conn(0x7fd868079730 msgr2=0x7fd868079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:58.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.904+0000 7fd86d187640 1 -- 172.21.15.7:0/3754865600 shutdown_connections 2024-09-21T05:59:58.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.904+0000 7fd86d187640 1 -- 172.21.15.7:0/3754865600 wait complete. 2024-09-21T05:59:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.905+0000 7fd86d187640 1 Processor -- start 2024-09-21T05:59:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.905+0000 7fd86d187640 1 -- start start 2024-09-21T05:59:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86d187640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd868102a60 0x7fd86819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86d187640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8681083a0 0x7fd86819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86d187640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd868108cf0 0x7fd86819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86d187640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd868112960 con 0x7fd868108cf0 2024-09-21T05:59:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86d187640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd8681127e0 con 0x7fd868102a60 2024-09-21T05:59:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86d187640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd868112ae0 con 0x7fd8681083a0 2024-09-21T05:59:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd868108cf0 0x7fd86819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd868108cf0 0x7fd86819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59656/0 (socket says 172.21.15.7:59656) 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86759e640 1 -- 172.21.15.7:0/2475977626 learned_addr learned my addr 172.21.15.7:0/2475977626 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86659c640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8681083a0 0x7fd86819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd866d9d640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd868102a60 0x7fd86819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86759e640 1 -- 172.21.15.7:0/2475977626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8681083a0 msgr2=0x7fd86819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86759e640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8681083a0 0x7fd86819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86759e640 1 -- 172.21.15.7:0/2475977626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd868102a60 msgr2=0x7fd86819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86759e640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd868102a60 0x7fd86819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86759e640 1 -- 172.21.15.7:0/2475977626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8681a0370 con 0x7fd868108cf0 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd866d9d640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd868102a60 0x7fd86819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.906+0000 7fd86759e640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd868108cf0 0x7fd86819fc40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd86000eaa0 tx=0x7fd86000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.907+0000 7fd85ffff640 1 -- 172.21.15.7:0/2475977626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86000cdb0 con 0x7fd868108cf0 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.907+0000 7fd86d187640 1 -- 172.21.15.7:0/2475977626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8681a0660 con 0x7fd868108cf0 2024-09-21T05:59:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.907+0000 7fd85ffff640 1 -- 172.21.15.7:0/2475977626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd860005020 con 0x7fd868108cf0 2024-09-21T05:59:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.907+0000 7fd85ffff640 1 -- 172.21.15.7:0/2475977626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8600116d0 con 0x7fd868108cf0 2024-09-21T05:59:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.907+0000 7fd86d187640 1 -- 172.21.15.7:0/2475977626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8681a6dc0 con 0x7fd868108cf0 2024-09-21T05:59:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.910+0000 7fd8736fb740 1 Processor -- start 2024-09-21T05:59:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.910+0000 7fd85ffff640 1 -- 172.21.15.7:0/2475977626 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd8600051d0 con 0x7fd868108cf0 2024-09-21T05:59:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.910+0000 7fd8736fb740 1 -- start start 2024-09-21T05:59:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.910+0000 7fd8736fb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac98070 0x5628eb03f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.910+0000 7fd8736fb740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac6f1b0 0x5628eb03f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.910+0000 7fd8736fb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac77390 0x5628eb03fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.910+0000 7fd8736fb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5628eafb5ea0 con 0x5628eac77390 2024-09-21T05:59:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.910+0000 7fd8736fb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5628eafa52d0 con 0x5628eac98070 2024-09-21T05:59:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.910+0000 7fd8736fb740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5628eafa90e0 con 0x5628eac6f1b0 2024-09-21T05:59:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.910+0000 7fd86659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac77390 0x5628eb03fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.910+0000 7fd86659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac77390 0x5628eb03fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59660/0 (socket says 172.21.15.7:59660) 2024-09-21T05:59:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.910+0000 7fd86659c640 1 -- 172.21.15.7:0/3923854432 learned_addr learned my addr 172.21.15.7:0/3923854432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd86659c640 1 --2- 172.21.15.7:0/3923854432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac98070 0x5628eb03f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd866d9d640 1 --2- 172.21.15.7:0/3923854432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac6f1b0 0x5628eb03f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd86659c640 1 -- 172.21.15.7:0/3923854432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac6f1b0 msgr2=0x5628eb03f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd86659c640 1 --2- 172.21.15.7:0/3923854432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac6f1b0 0x5628eb03f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd86659c640 1 -- 172.21.15.7:0/3923854432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac98070 msgr2=0x5628eb03f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd86659c640 1 --2- 172.21.15.7:0/3923854432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac98070 0x5628eb03f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd86659c640 1 -- 172.21.15.7:0/3923854432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628ead03650 con 0x5628eac77390 2024-09-21T05:59:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd85ffff640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd8540b6680 0x7fd8540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd866d9d640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd8540b6680 0x7fd8540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd86659c640 1 --2- 172.21.15.7:0/3923854432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac77390 0x5628eb03fd40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd850012770 tx=0x7fd850004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f0ec8602aeaee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd85ffff640 1 -- 172.21.15.7:0/2475977626 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fd8600e78a0 con 0x7fd868108cf0 2024-09-21T05:59:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd85d7fa640 1 -- 172.21.15.7:0/3923854432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850012cf0 con 0x5628eac77390 2024-09-21T05:59:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd85d7fa640 1 -- 172.21.15.7:0/3923854432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd850010770 con 0x5628eac77390 2024-09-21T05:59:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.911+0000 7fd85d7fa640 1 -- 172.21.15.7:0/3923854432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850003850 con 0x5628eac77390 2024-09-21T05:59:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.912+0000 7fd8736fb740 1 -- 172.21.15.7:0/3923854432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac77390 msgr2=0x5628eb03fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.912+0000 7fd8736fb740 1 --2- 172.21.15.7:0/3923854432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac77390 0x5628eb03fd40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd850012770 tx=0x7fd850004730 comp rx=0 tx=0).stop 2024-09-21T05:59:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.912+0000 7fd866d9d640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd8540b6680 0x7fd8540b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd858031440 tx=0x7fd8580058b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.912+0000 7fd8736fb740 1 -- 172.21.15.7:0/3923854432 shutdown_connections 2024-09-21T05:59:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.912+0000 7fd8736fb740 1 --2- 172.21.15.7:0/3923854432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac77390 0x5628eb03fd40 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.912+0000 7fd8736fb740 1 --2- 172.21.15.7:0/3923854432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac6f1b0 0x5628eb03f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.912+0000 7fd8736fb740 1 --2- 172.21.15.7:0/3923854432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac98070 0x5628eb03f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.912+0000 7fd8736fb740 1 -- 172.21.15.7:0/3923854432 >> 172.21.15.7:0/3923854432 conn(0x5628eac8c460 msgr2=0x5628eb03d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:58.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.913+0000 7fd8736fb740 1 -- 172.21.15.7:0/3923854432 shutdown_connections 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.913+0000 7fd8736fb740 1 -- 172.21.15.7:0/3923854432 wait complete. 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.913+0000 7fd8736fb740 1 -- start start 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.913+0000 7fd8736fb740 1 Processor -- start 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.913+0000 7fd8736fb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac6f1b0 0x5628eb04a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.913+0000 7fd8736fb740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac77390 0x5628eb04aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.913+0000 7fd8736fb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb056d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.913+0000 7fd8736fb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5628eae06700 con 0x5628eac98070 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.913+0000 7fd8736fb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5628eaf40160 con 0x5628eac6f1b0 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.913+0000 7fd8736fb740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5628eb04daa0 con 0x5628eac77390 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.913+0000 7fd8736fb740 10 client.0 _ll_register_callbacks cb 0x5628eaf599e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd86759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb056d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd86659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac77390 0x5628eb04aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd86759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb056d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59668/0 (socket says 172.21.15.7:59668) 2024-09-21T05:59:58.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd86759e640 1 -- 172.21.15.7:0/2299854337 learned_addr learned my addr 172.21.15.7:0/2299854337 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd866d9d640 1 --2- 172.21.15.7:0/2299854337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac6f1b0 0x5628eb04a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd86759e640 1 -- 172.21.15.7:0/2299854337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac77390 msgr2=0x5628eb04aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd86759e640 1 --2- 172.21.15.7:0/2299854337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac77390 0x5628eb04aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd86759e640 1 -- 172.21.15.7:0/2299854337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac6f1b0 msgr2=0x5628eb04a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd86759e640 1 --2- 172.21.15.7:0/2299854337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac6f1b0 0x5628eb04a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd86759e640 1 -- 172.21.15.7:0/2299854337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628eaf6dc90 con 0x5628eac98070 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd86759e640 1 --2- 172.21.15.7:0/2299854337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb056d90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd8600ad470 tx=0x7fd860005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9768ad0c550e570 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd84e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd84e7fc640 1 -- 172.21.15.7:0/2299854337 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86001f030 con 0x5628eac98070 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd84e7fc640 1 -- 172.21.15.7:0/2299854337 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fd8600ac440 con 0x5628eac98070 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.914+0000 7fd8736fb740 1 -- 172.21.15.7:0/2299854337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd850010770 con 0x5628eac98070 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.915+0000 7fd84e7fc640 1 -- 172.21.15.7:0/2299854337 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd8600b2250 con 0x5628eac98070 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.915+0000 7fd8736fb740 10 client.16926 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:58.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.915+0000 7fd8736fb740 1 -- 172.21.15.7:0/2299854337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5628eb0597d0 con 0x5628eac98070 2024-09-21T05:59:58.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.915+0000 7fd84e7fc640 1 -- 172.21.15.7:0/2299854337 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd850010770 con 0x5628eac98070 2024-09-21T05:59:58.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.915+0000 7fd84e7fc640 1 -- 172.21.15.7:0/2299854337 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd86000f040 con 0x5628eac98070 2024-09-21T05:59:58.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.915+0000 7fd8736fb740 10 client.16926 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:58.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.915+0000 7fd8736fb740 10 client.16926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:58.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.915+0000 7fd8736fb740 20 client.16926 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:58.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.915+0000 7fd8736fb740 1 --2- 172.21.15.7:0/2299854337 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5628eac569f0 0x5628eb05cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.915+0000 7fd8736fb740 4 client.16926 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:58.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.915+0000 7fd8736fb740 1 -- 172.21.15.7:0/2299854337 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628eafb7df0 con 0x5628eac569f0 2024-09-21T05:59:58.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.915+0000 7fd866d9d640 1 --2- 172.21.15.7:0/2299854337 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5628eac569f0 0x5628eb05cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.916+0000 7fd866d9d640 1 --2- 172.21.15.7:0/2299854337 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5628eac569f0 0x5628eb05cce0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7202dd4fec15a651 server_cookie=7eda401dd9e7ad09 in_seq=0 out_seq=0 2024-09-21T05:59:58.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.916+0000 7fd84e7fc640 10 client.16926 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:58.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd84e7fc640 1 -- 172.21.15.7:0/2299854337 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5628eafb7df0 con 0x5628eac569f0 2024-09-21T05:59:58.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd84e7fc640 10 client.16926 handle_command_reply: tid=0 2024-09-21T05:59:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd8736fb740 1 client.16926 shutdown 2024-09-21T05:59:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd8736fb740 1 -- 172.21.15.7:0/2299854337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 msgr2=0x5628eb056d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd8736fb740 1 --2- 172.21.15.7:0/2299854337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb056d90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd8600ad470 tx=0x7fd860005770 comp rx=0 tx=0).stop 2024-09-21T05:59:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd8736fb740 1 -- 172.21.15.7:0/2299854337 shutdown_connections 2024-09-21T05:59:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd8736fb740 1 --2- 172.21.15.7:0/2299854337 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5628eac569f0 0x5628eb05cce0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd8736fb740 1 --2- 172.21.15.7:0/2299854337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb056d90 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd8736fb740 1 --2- 172.21.15.7:0/2299854337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac77390 0x5628eb04aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd8736fb740 1 --2- 172.21.15.7:0/2299854337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac6f1b0 0x5628eb04a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd8736fb740 1 -- 172.21.15.7:0/2299854337 >> 172.21.15.7:0/2299854337 conn(0x5628eac8c460 msgr2=0x5628eb0424a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd84e7fc640 0 client.16926 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd8736fb740 1 -- 172.21.15.7:0/2299854337 shutdown_connections 2024-09-21T05:59:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd8736fb740 1 -- 172.21.15.7:0/2299854337 wait complete. 2024-09-21T05:59:58.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.917+0000 7fd8736fb740 20 client.16926 trim_cache size 0 max 16384 2024-09-21T05:59:58.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.930+0000 7fd8736fb740 1 Processor -- start 2024-09-21T05:59:58.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.930+0000 7fd8736fb740 1 -- start start 2024-09-21T05:59:58.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd8736fb740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac6f1b0 0x5628eb040a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd8736fb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac77390 0x5628eb03c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd8736fb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb03cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd8736fb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd8681b1df0 con 0x5628eac98070 2024-09-21T05:59:58.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd8736fb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd8681af6c0 con 0x5628eac77390 2024-09-21T05:59:58.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd8736fb740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd8681ad510 con 0x5628eac6f1b0 2024-09-21T05:59:58.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd86759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb03cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd86759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb03cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59682/0 (socket says 172.21.15.7:59682) 2024-09-21T05:59:58.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd86759e640 1 -- 172.21.15.7:0/93874159 learned_addr learned my addr 172.21.15.7:0/93874159 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:58.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd866d9d640 1 --2- 172.21.15.7:0/93874159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac6f1b0 0x5628eb040a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd86659c640 1 --2- 172.21.15.7:0/93874159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac77390 0x5628eb03c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd86759e640 1 -- 172.21.15.7:0/93874159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac6f1b0 msgr2=0x5628eb040a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:58.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd86759e640 1 --2- 172.21.15.7:0/93874159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac6f1b0 0x5628eb040a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd86759e640 1 -- 172.21.15.7:0/93874159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac77390 msgr2=0x5628eb03c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:58.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd86759e640 1 --2- 172.21.15.7:0/93874159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac77390 0x5628eb03c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd86759e640 1 -- 172.21.15.7:0/93874159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628eb04bc30 con 0x5628eac98070 2024-09-21T05:59:58.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.931+0000 7fd86659c640 1 --2- 172.21.15.7:0/93874159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac77390 0x5628eb03c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:58.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.932+0000 7fd86759e640 1 --2- 172.21.15.7:0/93874159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb03cca0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd860009270 tx=0x7fd8600ad010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b9d2293c425783 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:58.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.932+0000 7fd85cff9640 1 -- 172.21.15.7:0/93874159 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86001f050 con 0x5628eac98070 2024-09-21T05:59:58.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.932+0000 7fd85cff9640 1 -- 172.21.15.7:0/93874159 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8600b7190 con 0x5628eac98070 2024-09-21T05:59:58.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.932+0000 7fd85cff9640 1 -- 172.21.15.7:0/93874159 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8600ac680 con 0x5628eac98070 2024-09-21T05:59:58.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.933+0000 7fd8736fb740 1 -- 172.21.15.7:0/93874159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 msgr2=0x5628eb03cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:58.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.933+0000 7fd8736fb740 1 --2- 172.21.15.7:0/93874159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb03cca0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd860009270 tx=0x7fd8600ad010 comp rx=0 tx=0).stop 2024-09-21T05:59:58.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.933+0000 7fd8736fb740 1 -- 172.21.15.7:0/93874159 shutdown_connections 2024-09-21T05:59:58.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.933+0000 7fd8736fb740 1 --2- 172.21.15.7:0/93874159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb03cca0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.933+0000 7fd8736fb740 1 --2- 172.21.15.7:0/93874159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac77390 0x5628eb03c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.933+0000 7fd8736fb740 1 --2- 172.21.15.7:0/93874159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac6f1b0 0x5628eb040a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.933+0000 7fd8736fb740 1 -- 172.21.15.7:0/93874159 >> 172.21.15.7:0/93874159 conn(0x5628eac8c460 msgr2=0x5628eb0402f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:58.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.933+0000 7fd8736fb740 1 -- 172.21.15.7:0/93874159 shutdown_connections 2024-09-21T05:59:58.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.933+0000 7fd8736fb740 1 -- 172.21.15.7:0/93874159 wait complete. 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.933+0000 7fd8736fb740 1 -- start start 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.933+0000 7fd8736fb740 1 Processor -- start 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd8736fb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac6f1b0 0x5628eb053450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd8736fb740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac77390 0x5628eb04e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd8736fb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb04ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd8736fb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd8681adb80 con 0x5628eac98070 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd8736fb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd8681aeff0 con 0x5628eac6f1b0 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd8736fb740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd8681ae250 con 0x5628eac77390 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd8736fb740 10 client.0 _ll_register_callbacks cb 0x7fd8600a9de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd86759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb04ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd86759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb04ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59688/0 (socket says 172.21.15.7:59688) 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd86759e640 1 -- 172.21.15.7:0/3534268759 learned_addr learned my addr 172.21.15.7:0/3534268759 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd86659c640 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac77390 0x5628eb04e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd866d9d640 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac6f1b0 0x5628eb053450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd86759e640 1 -- 172.21.15.7:0/3534268759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac77390 msgr2=0x5628eb04e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd86759e640 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac77390 0x5628eb04e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd86759e640 1 -- 172.21.15.7:0/3534268759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac6f1b0 msgr2=0x5628eb053450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd86759e640 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac6f1b0 0x5628eb053450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd86759e640 1 -- 172.21.15.7:0/3534268759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628eb04f580 con 0x5628eac98070 2024-09-21T05:59:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd866d9d640 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac6f1b0 0x5628eb053450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd86659c640 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac77390 0x5628eb04e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd86759e640 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb04ee40 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd8600b2410 tx=0x7fd8600ad3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5889edbf2c891946 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd84e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T05:59:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.934+0000 7fd84e7fc640 1 -- 172.21.15.7:0/3534268759 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86001f070 con 0x5628eac98070 2024-09-21T05:59:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd84e7fc640 1 -- 172.21.15.7:0/3534268759 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fd8600aeaa0 con 0x5628eac98070 2024-09-21T05:59:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd8736fb740 1 -- 172.21.15.7:0/3534268759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8600b7190 con 0x5628eac98070 2024-09-21T05:59:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd84e7fc640 1 -- 172.21.15.7:0/3534268759 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd8600aeca0 con 0x5628eac98070 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd8736fb740 10 client.16932 fetch_fsmap learned FSMap version 25 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd8736fb740 1 -- 172.21.15.7:0/3534268759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5628eb0cb920 con 0x5628eac98070 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd84e7fc640 1 -- 172.21.15.7:0/3534268759 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8600b7190 con 0x5628eac98070 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd84e7fc640 1 -- 172.21.15.7:0/3534268759 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd8600cf2e0 con 0x5628eac98070 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd8736fb740 10 client.16932 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd8736fb740 10 client.16932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd8736fb740 20 client.16932 populate_metadata read hostname 'smithi007' 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd8736fb740 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5628eac2bda0 0x5628eb0cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd8736fb740 4 client.16932 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd8736fb740 1 -- 172.21.15.7:0/3534268759 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628eafb38a0 con 0x5628eac2bda0 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.935+0000 7fd866d9d640 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5628eac2bda0 0x5628eb0cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd866d9d640 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5628eac2bda0 0x5628eb0cdd60 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50281651af0380e0 server_cookie=512b68f72d441641 in_seq=0 out_seq=0 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd84e7fc640 10 client.16932 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd84e7fc640 1 -- 172.21.15.7:0/3534268759 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628eafb38a0 con 0x5628eac2bda0 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd84e7fc640 10 client.16932 handle_command_reply: tid=0 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd8736fb740 1 client.16932 shutdown 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd8736fb740 1 -- 172.21.15.7:0/3534268759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 msgr2=0x5628eb04ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd8736fb740 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb04ee40 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd8600b2410 tx=0x7fd8600ad3c0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd8736fb740 1 -- 172.21.15.7:0/3534268759 shutdown_connections 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd8736fb740 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5628eac2bda0 0x5628eb0cdd60 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd84e7fc640 0 client.16932 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd8736fb740 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628eac98070 0x5628eb04ee40 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd8736fb740 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5628eac77390 0x5628eb04e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd8736fb740 1 --2- 172.21.15.7:0/3534268759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5628eac6f1b0 0x5628eb053450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd8736fb740 1 -- 172.21.15.7:0/3534268759 >> 172.21.15.7:0/3534268759 conn(0x5628eac8c460 msgr2=0x5628eb0401f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd8736fb740 1 -- 172.21.15.7:0/3534268759 shutdown_connections 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.936+0000 7fd8736fb740 1 -- 172.21.15.7:0/3534268759 wait complete. 2024-09-21T05:59:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.937+0000 7fd8736fb740 20 client.16932 trim_cache size 0 max 16384 2024-09-21T05:59:58.944 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T05:59:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.937+0000 7fd86d187640 1 -- 172.21.15.7:0/2475977626 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd8540b6680 msgr2=0x7fd8540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.937+0000 7fd86d187640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd8540b6680 0x7fd8540b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd858031440 tx=0x7fd8580058b0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.937+0000 7fd86d187640 1 -- 172.21.15.7:0/2475977626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd868108cf0 msgr2=0x7fd86819fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.937+0000 7fd86d187640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd868108cf0 0x7fd86819fc40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd86000eaa0 tx=0x7fd86000ef60 comp rx=0 tx=0).stop 2024-09-21T05:59:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.937+0000 7fd86d187640 1 -- 172.21.15.7:0/2475977626 shutdown_connections 2024-09-21T05:59:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.937+0000 7fd86d187640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd8540b6680 0x7fd8540b8b90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.937+0000 7fd86d187640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd868108cf0 0x7fd86819fc40 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.937+0000 7fd86d187640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8681083a0 0x7fd86819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.937+0000 7fd86d187640 1 --2- 172.21.15.7:0/2475977626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd868102a60 0x7fd86819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.937+0000 7fd86d187640 1 -- 172.21.15.7:0/2475977626 >> 172.21.15.7:0/2475977626 conn(0x7fd868079730 msgr2=0x7fd868101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.937+0000 7fd86d187640 1 -- 172.21.15.7:0/2475977626 shutdown_connections 2024-09-21T05:59:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T05:59:58.937+0000 7fd86d187640 1 -- 172.21.15.7:0/2475977626 wait complete. 2024-09-21T06:00:00.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:59 smithi007 ceph-mon[30983]: pgmap v501: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:00:00.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 05:59:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:00:00.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:59 smithi027 ceph-mon[34364]: pgmap v501: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:00:00.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 05:59:59 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:00:00.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:59 smithi119 ceph-mon[34833]: pgmap v501: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:00:00.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 05:59:59 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:00:00.751 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:00:00.752 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:00:01.031 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:01.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:00 smithi007 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T06:00:01.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:00 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:00:01.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:00 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:00:01.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:00 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:00:01.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:00 smithi027 ceph-mon[34364]: overall HEALTH_OK 2024-09-21T06:00:01.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:00 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:00:01.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:00 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:00:01.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:00 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:00:01.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:00 smithi119 ceph-mon[34833]: overall HEALTH_OK 2024-09-21T06:00:01.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:00 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:00:01.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:00 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:00:01.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:00 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:00:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.549+0000 7f9698fad640 1 -- 172.21.15.7:0/3368190290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96941049b0 msgr2=0x7f9694104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.549+0000 7f9698fad640 1 --2- 172.21.15.7:0/3368190290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96941049b0 0x7f9694104dc0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f968c009900 tx=0x7f968c02a410 comp rx=0 tx=0).stop 2024-09-21T06:00:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.549+0000 7f9698fad640 1 -- 172.21.15.7:0/3368190290 shutdown_connections 2024-09-21T06:00:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.549+0000 7f9698fad640 1 --2- 172.21.15.7:0/3368190290 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f969410de10 0x7f9694110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.549+0000 7f9698fad640 1 --2- 172.21.15.7:0/3368190290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9694105300 0x7f969410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.549+0000 7f9698fad640 1 --2- 172.21.15.7:0/3368190290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96941049b0 0x7f9694104dc0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.549+0000 7f9698fad640 1 -- 172.21.15.7:0/3368190290 >> 172.21.15.7:0/3368190290 conn(0x7f9694079730 msgr2=0x7f9694079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.549+0000 7f9698fad640 1 -- 172.21.15.7:0/3368190290 shutdown_connections 2024-09-21T06:00:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.549+0000 7f9698fad640 1 -- 172.21.15.7:0/3368190290 wait complete. 2024-09-21T06:00:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.550+0000 7f9698fad640 1 Processor -- start 2024-09-21T06:00:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.550+0000 7f9698fad640 1 -- start start 2024-09-21T06:00:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f9698fad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96941049b0 0x7f969419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f9698fad640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9694105300 0x7f969419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f9698fad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f969410de10 0x7f969419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f9698fad640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9694113a90 con 0x7f96941049b0 2024-09-21T06:00:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f9698fad640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9694113910 con 0x7f9694105300 2024-09-21T06:00:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f9698fad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9694113c10 con 0x7f969410de10 2024-09-21T06:00:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f969259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96941049b0 0x7f969419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f969259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96941049b0 0x7f969419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59700/0 (socket says 172.21.15.7:59700) 2024-09-21T06:00:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f969259c640 1 -- 172.21.15.7:0/4247666525 learned_addr learned my addr 172.21.15.7:0/4247666525 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f9692d9d640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f969410de10 0x7f969419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f9691d9b640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9694105300 0x7f969419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f969259c640 1 -- 172.21.15.7:0/4247666525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f969410de10 msgr2=0x7f969419fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f969259c640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f969410de10 0x7f969419fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f969259c640 1 -- 172.21.15.7:0/4247666525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9694105300 msgr2=0x7f969419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f969259c640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9694105300 0x7f969419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f969259c640 1 -- 172.21.15.7:0/4247666525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96941a0530 con 0x7f96941049b0 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f9692d9d640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f969410de10 0x7f969419fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f969259c640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96941049b0 0x7f969419a5c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f968c031a90 tx=0x7f968c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.551+0000 7f968b7fe640 1 -- 172.21.15.7:0/4247666525 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c03f030 con 0x7f96941049b0 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.552+0000 7f968b7fe640 1 -- 172.21.15.7:0/4247666525 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f968c003cb0 con 0x7f96941049b0 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.552+0000 7f9698fad640 1 -- 172.21.15.7:0/4247666525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96941a07c0 con 0x7f96941049b0 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.552+0000 7f968b7fe640 1 -- 172.21.15.7:0/4247666525 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c035070 con 0x7f96941049b0 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.552+0000 7f9698fad640 1 -- 172.21.15.7:0/4247666525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96941a6f80 con 0x7f96941049b0 2024-09-21T06:00:01.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.555+0000 7f969f521740 1 Processor -- start 2024-09-21T06:00:01.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.555+0000 7f969f521740 1 -- start start 2024-09-21T06:00:01.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.555+0000 7f969f521740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6d2350 0x55d3eba79430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.555+0000 7f969f521740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb6a9490 0x55d3eba79970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.555+0000 7f969f521740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6b1670 0x55d3eba79eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.555+0000 7f969f521740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d3eb9efe60 con 0x55d3eb6d2350 2024-09-21T06:00:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.555+0000 7f969f521740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d3eb9df290 con 0x55d3eb6b1670 2024-09-21T06:00:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.555+0000 7f969f521740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d3eb9e30a0 con 0x55d3eb6a9490 2024-09-21T06:00:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f9692d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6d2350 0x55d3eba79430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f968b7fe640 1 -- 172.21.15.7:0/4247666525 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f968c042030 con 0x7f96941049b0 2024-09-21T06:00:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f9692d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6d2350 0x55d3eba79430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59714/0 (socket says 172.21.15.7:59714) 2024-09-21T06:00:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f9692d9d640 1 -- 172.21.15.7:0/3876347159 learned_addr learned my addr 172.21.15.7:0/3876347159 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f9691d9b640 1 --2- 172.21.15.7:0/3876347159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6b1670 0x55d3eba79eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f9692d9d640 1 -- 172.21.15.7:0/3876347159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb6a9490 msgr2=0x55d3eba79970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f9692d9d640 1 --2- 172.21.15.7:0/3876347159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb6a9490 0x55d3eba79970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f9692d9d640 1 -- 172.21.15.7:0/3876347159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6b1670 msgr2=0x55d3eba79eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f9692d9d640 1 --2- 172.21.15.7:0/3876347159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6b1670 0x55d3eba79eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f9692d9d640 1 -- 172.21.15.7:0/3876347159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3eb73d930 con 0x55d3eb6d2350 2024-09-21T06:00:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f9692d9d640 1 --2- 172.21.15.7:0/3876347159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6d2350 0x55d3eba79430 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f968400ae80 tx=0x7f968400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355c54d5ac1ac1e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f9688ff9640 1 -- 172.21.15.7:0/3876347159 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684003b70 con 0x55d3eb6d2350 2024-09-21T06:00:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f9688ff9640 1 -- 172.21.15.7:0/3876347159 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9684003d10 con 0x55d3eb6d2350 2024-09-21T06:00:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.556+0000 7f9688ff9640 1 -- 172.21.15.7:0/3876347159 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684010a60 con 0x55d3eb6d2350 2024-09-21T06:00:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.557+0000 7f968b7fe640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96800b6680 0x7f96800b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.557+0000 7f969259c640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96800b6680 0x7f96800b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.557+0000 7f968b7fe640 1 -- 172.21.15.7:0/4247666525 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f968c107d50 con 0x7f96941049b0 2024-09-21T06:00:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.558+0000 7f969f521740 1 -- 172.21.15.7:0/3876347159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6d2350 msgr2=0x55d3eba79430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.558+0000 7f969f521740 1 --2- 172.21.15.7:0/3876347159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6d2350 0x55d3eba79430 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f968400ae80 tx=0x7f968400e720 comp rx=0 tx=0).stop 2024-09-21T06:00:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.558+0000 7f969259c640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96800b6680 0x7f96800b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55d3eba780b0 tx=0x7f968c09a8d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.558+0000 7f969f521740 1 -- 172.21.15.7:0/3876347159 shutdown_connections 2024-09-21T06:00:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.558+0000 7f969f521740 1 --2- 172.21.15.7:0/3876347159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6b1670 0x55d3eba79eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.558+0000 7f969f521740 1 --2- 172.21.15.7:0/3876347159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb6a9490 0x55d3eba79970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.558+0000 7f969f521740 1 --2- 172.21.15.7:0/3876347159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6d2350 0x55d3eba79430 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.558+0000 7f969f521740 1 -- 172.21.15.7:0/3876347159 >> 172.21.15.7:0/3876347159 conn(0x55d3eb6c6740 msgr2=0x55d3eba77320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.558+0000 7f969f521740 1 -- 172.21.15.7:0/3876347159 shutdown_connections 2024-09-21T06:00:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.558+0000 7f969f521740 1 -- 172.21.15.7:0/3876347159 wait complete. 2024-09-21T06:00:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.558+0000 7f969f521740 1 -- start start 2024-09-21T06:00:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.558+0000 7f969f521740 1 Processor -- start 2024-09-21T06:00:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f969f521740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6a9490 0x55d3eba85090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f969f521740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6b1670 0x55d3eba85630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f969f521740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb6d2350 0x55d3eba90f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f969f521740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d3eb840890 con 0x55d3eb6a9490 2024-09-21T06:00:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f969f521740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55d3eb979d40 con 0x55d3eb6b1670 2024-09-21T06:00:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f969f521740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55d3eba87c10 con 0x55d3eb6d2350 2024-09-21T06:00:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f969f521740 10 client.0 _ll_register_callbacks cb 0x55d3eb9ddc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f9692d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6a9490 0x55d3eba85090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f9692d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6a9490 0x55d3eba85090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59718/0 (socket says 172.21.15.7:59718) 2024-09-21T06:00:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f9692d9d640 1 -- 172.21.15.7:0/4233021247 learned_addr learned my addr 172.21.15.7:0/4233021247 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f9691d9b640 1 --2- 172.21.15.7:0/4233021247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6b1670 0x55d3eba85630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f9692d9d640 1 -- 172.21.15.7:0/4233021247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb6d2350 msgr2=0x55d3eba90f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f9692d9d640 1 --2- 172.21.15.7:0/4233021247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb6d2350 0x55d3eba90f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f9692d9d640 1 -- 172.21.15.7:0/4233021247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6b1670 msgr2=0x55d3eba85630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f9692d9d640 1 --2- 172.21.15.7:0/4233021247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6b1670 0x55d3eba85630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f9692d9d640 1 -- 172.21.15.7:0/4233021247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3eba91570 con 0x55d3eb6a9490 2024-09-21T06:00:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f9692d9d640 1 --2- 172.21.15.7:0/4233021247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6a9490 0x55d3eba85090 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9684010740 tx=0x7f968400abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1a6c0ceeef48db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.559+0000 7f9679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f9679ffb640 1 -- 172.21.15.7:0/4233021247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684010cf0 con 0x55d3eb6a9490 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f9679ffb640 1 -- 172.21.15.7:0/4233021247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9684004a00 con 0x55d3eb6a9490 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f969f521740 1 -- 172.21.15.7:0/4233021247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9684003d10 con 0x55d3eb6a9490 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f9679ffb640 1 -- 172.21.15.7:0/4233021247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9684004c00 con 0x55d3eb6a9490 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f969f521740 10 client.16944 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f969f521740 1 -- 172.21.15.7:0/4233021247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d3eba93ea0 con 0x55d3eb6a9490 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f9679ffb640 1 -- 172.21.15.7:0/4233021247 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9684003d10 con 0x55d3eb6a9490 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f9679ffb640 1 -- 172.21.15.7:0/4233021247 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9684005020 con 0x55d3eb6a9490 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f969f521740 10 client.16944 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f969f521740 10 client.16944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f969f521740 20 client.16944 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f969f521740 1 --2- 172.21.15.7:0/4233021247 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d3eb690cd0 0x55d3eba97200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f969f521740 4 client.16944 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.560+0000 7f969f521740 1 -- 172.21.15.7:0/4233021247 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3eb9f1db0 con 0x55d3eb690cd0 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.561+0000 7f9691d9b640 1 --2- 172.21.15.7:0/4233021247 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d3eb690cd0 0x55d3eba97200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.561+0000 7f9679ffb640 10 client.16944 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.561+0000 7f9691d9b640 1 --2- 172.21.15.7:0/4233021247 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d3eb690cd0 0x55d3eba97200 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea4d817b63b2006 server_cookie=9fa74f7344078132 in_seq=0 out_seq=0 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f9679ffb640 1 -- 172.21.15.7:0/4233021247 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3eb9f1db0 con 0x55d3eb690cd0 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f9679ffb640 10 client.16944 handle_command_reply: tid=0 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f969f521740 1 client.16944 shutdown 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f969f521740 1 -- 172.21.15.7:0/4233021247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6a9490 msgr2=0x55d3eba85090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f969f521740 1 --2- 172.21.15.7:0/4233021247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6a9490 0x55d3eba85090 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9684010740 tx=0x7f968400abc0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f969f521740 1 -- 172.21.15.7:0/4233021247 shutdown_connections 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f969f521740 1 --2- 172.21.15.7:0/4233021247 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d3eb690cd0 0x55d3eba97200 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f9679ffb640 0 client.16944 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f969f521740 1 --2- 172.21.15.7:0/4233021247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb6d2350 0x55d3eba90f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f969f521740 1 --2- 172.21.15.7:0/4233021247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6b1670 0x55d3eba85630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f969f521740 1 --2- 172.21.15.7:0/4233021247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6a9490 0x55d3eba85090 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f969f521740 1 -- 172.21.15.7:0/4233021247 >> 172.21.15.7:0/4233021247 conn(0x55d3eb6c6740 msgr2=0x55d3eba7c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:01.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f969f521740 1 -- 172.21.15.7:0/4233021247 shutdown_connections 2024-09-21T06:00:01.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f969f521740 1 -- 172.21.15.7:0/4233021247 wait complete. 2024-09-21T06:00:01.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.562+0000 7f969f521740 20 client.16944 trim_cache size 0 max 16384 2024-09-21T06:00:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f969f521740 1 Processor -- start 2024-09-21T06:00:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f969f521740 1 -- start start 2024-09-21T06:00:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f969f521740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb690cd0 0x55d3eba806c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f969f521740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb6a9490 0x55d3eba83730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f969f521740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 0x55d3eba83c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f969f521740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96941b1f20 con 0x55d3eb6b1670 2024-09-21T06:00:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f969f521740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f96941af7f0 con 0x55d3eb690cd0 2024-09-21T06:00:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f969f521740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96941ad640 con 0x55d3eb6a9490 2024-09-21T06:00:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f9692d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 0x55d3eba83c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f9692d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 0x55d3eba83c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59724/0 (socket says 172.21.15.7:59724) 2024-09-21T06:00:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f9692d9d640 1 -- 172.21.15.7:0/2379779480 learned_addr learned my addr 172.21.15.7:0/2379779480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f9692d9d640 1 --2- 172.21.15.7:0/2379779480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb690cd0 0x55d3eba806c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f9691d9b640 1 --2- 172.21.15.7:0/2379779480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb6a9490 0x55d3eba83730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f9692d9d640 1 -- 172.21.15.7:0/2379779480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb6a9490 msgr2=0x55d3eba83730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f9692d9d640 1 --2- 172.21.15.7:0/2379779480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb6a9490 0x55d3eba83730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f9692d9d640 1 -- 172.21.15.7:0/2379779480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb690cd0 msgr2=0x55d3eba806c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f9692d9d640 1 --2- 172.21.15.7:0/2379779480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb690cd0 0x55d3eba806c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.580+0000 7f9692d9d640 1 -- 172.21.15.7:0/2379779480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3eba875d0 con 0x55d3eb6b1670 2024-09-21T06:00:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.581+0000 7f9692d9d640 1 --2- 172.21.15.7:0/2379779480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 0x55d3eba83c70 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f968400a690 tx=0x7f968400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133cac109b9683a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.581+0000 7f967bfff640 1 -- 172.21.15.7:0/2379779480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684005790 con 0x55d3eb6b1670 2024-09-21T06:00:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.581+0000 7f967bfff640 1 -- 172.21.15.7:0/2379779480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9684037020 con 0x55d3eb6b1670 2024-09-21T06:00:01.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.581+0000 7f967bfff640 1 -- 172.21.15.7:0/2379779480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96840051a0 con 0x55d3eb6b1670 2024-09-21T06:00:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.582+0000 7f969f521740 1 -- 172.21.15.7:0/2379779480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 msgr2=0x55d3eba83c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.582+0000 7f969f521740 1 --2- 172.21.15.7:0/2379779480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 0x55d3eba83c70 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f968400a690 tx=0x7f968400e720 comp rx=0 tx=0).stop 2024-09-21T06:00:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.582+0000 7f969f521740 1 -- 172.21.15.7:0/2379779480 shutdown_connections 2024-09-21T06:00:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.582+0000 7f969f521740 1 --2- 172.21.15.7:0/2379779480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 0x55d3eba83c70 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.582+0000 7f969f521740 1 --2- 172.21.15.7:0/2379779480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb6a9490 0x55d3eba83730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.582+0000 7f969f521740 1 --2- 172.21.15.7:0/2379779480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb690cd0 0x55d3eba806c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.582+0000 7f969f521740 1 -- 172.21.15.7:0/2379779480 >> 172.21.15.7:0/2379779480 conn(0x55d3eb6c6740 msgr2=0x55d3eba75ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.582+0000 7f969f521740 1 -- 172.21.15.7:0/2379779480 shutdown_connections 2024-09-21T06:00:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.582+0000 7f969f521740 1 -- 172.21.15.7:0/2379779480 wait complete. 2024-09-21T06:00:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.582+0000 7f969f521740 1 -- start start 2024-09-21T06:00:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.582+0000 7f969f521740 1 Processor -- start 2024-09-21T06:00:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f969f521740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb690cd0 0x55d3eba98460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f969f521740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6a9490 0x55d3eba989a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f969f521740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 0x55d3eba98f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f969f521740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96941adcb0 con 0x55d3eb6b1670 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f969f521740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f96941af120 con 0x55d3eb6a9490 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f969f521740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96941ae380 con 0x55d3eb690cd0 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f969f521740 10 client.0 _ll_register_callbacks cb 0x7f9684014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f9692d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 0x55d3eba98f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f9692d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 0x55d3eba98f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59730/0 (socket says 172.21.15.7:59730) 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f9692d9d640 1 -- 172.21.15.7:0/3112329534 learned_addr learned my addr 172.21.15.7:0/3112329534 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f9692d9d640 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb690cd0 0x55d3eba98460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f9691d9b640 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6a9490 0x55d3eba989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f9692d9d640 1 -- 172.21.15.7:0/3112329534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb690cd0 msgr2=0x55d3eba98460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f9692d9d640 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb690cd0 0x55d3eba98460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f9692d9d640 1 -- 172.21.15.7:0/3112329534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6a9490 msgr2=0x55d3eba989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:01.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f9692d9d640 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6a9490 0x55d3eba989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f9692d9d640 1 -- 172.21.15.7:0/3112329534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3eba79220 con 0x55d3eb6b1670 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f9691d9b640 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6a9490 0x55d3eba989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f9692d9d640 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 0x55d3eba98f20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x55d3eba91be0 tx=0x7f9684000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ac775150ec499d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.583+0000 7f9679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f9679ffb640 1 -- 172.21.15.7:0/3112329534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684004a00 con 0x55d3eb6b1670 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f9679ffb640 1 -- 172.21.15.7:0/3112329534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9684005120 con 0x55d3eb6b1670 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f969f521740 1 -- 172.21.15.7:0/3112329534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9684037020 con 0x55d3eb6b1670 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f9679ffb640 1 -- 172.21.15.7:0/3112329534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9684010af0 con 0x55d3eb6b1670 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f969f521740 10 client.16950 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f969f521740 1 -- 172.21.15.7:0/3112329534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d3ebb01cc0 con 0x55d3eb6b1670 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f9679ffb640 1 -- 172.21.15.7:0/3112329534 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9684037020 con 0x55d3eb6b1670 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f9679ffb640 1 -- 172.21.15.7:0/3112329534 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f96840042c0 con 0x55d3eb6b1670 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f969f521740 10 client.16950 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f969f521740 10 client.16950 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f969f521740 20 client.16950 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f969f521740 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d3eb6d2350 0x55d3ebb04030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f969f521740 4 client.16950 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.584+0000 7f969f521740 1 -- 172.21.15.7:0/3112329534 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d3eb9ed860 con 0x55d3eb6d2350 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.585+0000 7f9691d9b640 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d3eb6d2350 0x55d3ebb04030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.585+0000 7f9691d9b640 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d3eb6d2350 0x55d3ebb04030 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56166381576566d6 server_cookie=e4e9e43d5b6aed93 in_seq=0 out_seq=0 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.585+0000 7f9679ffb640 10 client.16950 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.586+0000 7f9679ffb640 1 -- 172.21.15.7:0/3112329534 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d3eb9ed860 con 0x55d3eb6d2350 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f9679ffb640 10 client.16950 handle_command_reply: tid=0 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f969f521740 1 client.16950 shutdown 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f969f521740 1 -- 172.21.15.7:0/3112329534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 msgr2=0x55d3eba98f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f969f521740 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 0x55d3eba98f20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x55d3eba91be0 tx=0x7f9684000f40 comp rx=0 tx=0).stop 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f969f521740 1 -- 172.21.15.7:0/3112329534 shutdown_connections 2024-09-21T06:00:01.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f969f521740 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55d3eb6d2350 0x55d3ebb04030 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f9679ffb640 0 client.16950 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f969f521740 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3eb6b1670 0x55d3eba98f20 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f969f521740 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d3eb6a9490 0x55d3eba989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f969f521740 1 --2- 172.21.15.7:0/3112329534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d3eb690cd0 0x55d3eba98460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f969f521740 1 -- 172.21.15.7:0/3112329534 >> 172.21.15.7:0/3112329534 conn(0x55d3eb6c6740 msgr2=0x55d3eba832f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f969f521740 1 -- 172.21.15.7:0/3112329534 shutdown_connections 2024-09-21T06:00:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f969f521740 1 -- 172.21.15.7:0/3112329534 wait complete. 2024-09-21T06:00:01.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.587+0000 7f969f521740 20 client.16950 trim_cache size 0 max 16384 2024-09-21T06:00:01.594 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:00:01.594 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:00:01.594 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "fdd4afdc-f082-47dc-98c6-4396302d0e88", 2024-09-21T06:00:01.595 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:00:01.595 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.588+0000 7f9698fad640 1 -- 172.21.15.7:0/4247666525 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96800b6680 msgr2=0x7f96800b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.588+0000 7f9698fad640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96800b6680 0x7f96800b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55d3eba780b0 tx=0x7f968c09a8d0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.588+0000 7f9698fad640 1 -- 172.21.15.7:0/4247666525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96941049b0 msgr2=0x7f969419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.588+0000 7f9698fad640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96941049b0 0x7f969419a5c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f968c031a90 tx=0x7f968c004270 comp rx=0 tx=0).stop 2024-09-21T06:00:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.588+0000 7f9698fad640 1 -- 172.21.15.7:0/4247666525 shutdown_connections 2024-09-21T06:00:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.588+0000 7f9698fad640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96800b6680 0x7f96800b8b90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.588+0000 7f9698fad640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f969410de10 0x7f969419fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.588+0000 7f9698fad640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9694105300 0x7f969419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.588+0000 7f9698fad640 1 --2- 172.21.15.7:0/4247666525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96941049b0 0x7f969419a5c0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.588+0000 7f9698fad640 1 -- 172.21.15.7:0/4247666525 >> 172.21.15.7:0/4247666525 conn(0x7f9694079730 msgr2=0x7f96941008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.588+0000 7f9698fad640 1 -- 172.21.15.7:0/4247666525 shutdown_connections 2024-09-21T06:00:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:01.588+0000 7f9698fad640 1 -- 172.21.15.7:0/4247666525 wait complete. 2024-09-21T06:00:02.273 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:00:02.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:02 smithi027 ceph-mon[34364]: pgmap v502: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:00:02.534 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:02.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:02 smithi007 ceph-mon[30983]: pgmap v502: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:00:02.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:02 smithi119 ceph-mon[34833]: pgmap v502: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:00:03.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.080+0000 7fbc97552640 1 -- 172.21.15.7:0/4269680308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90102ae0 msgr2=0x7fbc90102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:03.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.080+0000 7fbc97552640 1 --2- 172.21.15.7:0/4269680308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90102ae0 0x7fbc90102ef0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c009900 tx=0x7fbc8c02a410 comp rx=0 tx=0).stop 2024-09-21T06:00:03.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.080+0000 7fbc97552640 1 -- 172.21.15.7:0/4269680308 shutdown_connections 2024-09-21T06:00:03.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.081+0000 7fbc97552640 1 --2- 172.21.15.7:0/4269680308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc90108d20 0x7fbc9010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.081+0000 7fbc97552640 1 --2- 172.21.15.7:0/4269680308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc901083d0 0x7fbc901087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.081+0000 7fbc97552640 1 --2- 172.21.15.7:0/4269680308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90102ae0 0x7fbc90102ef0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.081+0000 7fbc97552640 1 -- 172.21.15.7:0/4269680308 >> 172.21.15.7:0/4269680308 conn(0x7fbc90079760 msgr2=0x7fbc90079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:03.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.081+0000 7fbc97552640 1 -- 172.21.15.7:0/4269680308 shutdown_connections 2024-09-21T06:00:03.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.081+0000 7fbc97552640 1 -- 172.21.15.7:0/4269680308 wait complete. 2024-09-21T06:00:03.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.081+0000 7fbc97552640 1 Processor -- start 2024-09-21T06:00:03.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.081+0000 7fbc97552640 1 -- start start 2024-09-21T06:00:03.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc97552640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc90102ae0 0x7fbc9019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc97552640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc901083d0 0x7fbc9019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc97552640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90108d20 0x7fbc9019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc97552640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc90113aa0 con 0x7fbc90108d20 2024-09-21T06:00:03.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc97552640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbc90113920 con 0x7fbc901083d0 2024-09-21T06:00:03.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc97552640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbc90113c20 con 0x7fbc90102ae0 2024-09-21T06:00:03.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc95aef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90108d20 0x7fbc9019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc95aef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90108d20 0x7fbc9019fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59756/0 (socket says 172.21.15.7:59756) 2024-09-21T06:00:03.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc95aef640 1 -- 172.21.15.7:0/137786635 learned_addr learned my addr 172.21.15.7:0/137786635 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:03.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc94aed640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc901083d0 0x7fbc9019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc952ee640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc90102ae0 0x7fbc9019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc95aef640 1 -- 172.21.15.7:0/137786635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc90102ae0 msgr2=0x7fbc9019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:03.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc95aef640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc90102ae0 0x7fbc9019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc95aef640 1 -- 172.21.15.7:0/137786635 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc901083d0 msgr2=0x7fbc9019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:03.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc95aef640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc901083d0 0x7fbc9019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc95aef640 1 -- 172.21.15.7:0/137786635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc901a0460 con 0x7fbc90108d20 2024-09-21T06:00:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc952ee640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc90102ae0 0x7fbc9019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc94aed640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc901083d0 0x7fbc9019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc95aef640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90108d20 0x7fbc9019fd30 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800eaa0 tx=0x7fbc8800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.082+0000 7fbc867fc640 1 -- 172.21.15.7:0/137786635 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800cdb0 con 0x7fbc90108d20 2024-09-21T06:00:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.083+0000 7fbc867fc640 1 -- 172.21.15.7:0/137786635 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc88005020 con 0x7fbc90108d20 2024-09-21T06:00:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.083+0000 7fbc97552640 1 -- 172.21.15.7:0/137786635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc901a0750 con 0x7fbc90108d20 2024-09-21T06:00:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.083+0000 7fbc867fc640 1 -- 172.21.15.7:0/137786635 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc880116d0 con 0x7fbc90108d20 2024-09-21T06:00:03.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.083+0000 7fbc97552640 1 -- 172.21.15.7:0/137786635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc901a6eb0 con 0x7fbc90108d20 2024-09-21T06:00:03.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.085+0000 7fbc9dac6740 1 Processor -- start 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.085+0000 7fbc867fc640 1 -- 172.21.15.7:0/137786635 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fbc880051d0 con 0x7fbc90108d20 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.085+0000 7fbc9dac6740 1 -- start start 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc9dac6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 0x55c003371270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc9dac6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa11b0 0x55c0033717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc9dac6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa9390 0x55c003371cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc9dac6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c0032e7e50 con 0x55c002fa9390 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc9dac6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c0032d7280 con 0x55c002fa11b0 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc9dac6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c0032db090 con 0x55c002fca070 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc94aed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa9390 0x55c003371cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc94aed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa9390 0x55c003371cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59762/0 (socket says 172.21.15.7:59762) 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc94aed640 1 -- 172.21.15.7:0/944799658 learned_addr learned my addr 172.21.15.7:0/944799658 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc94aed640 1 --2- 172.21.15.7:0/944799658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 0x55c003371270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc952ee640 1 --2- 172.21.15.7:0/944799658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa11b0 0x55c0033717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc94aed640 1 -- 172.21.15.7:0/944799658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 msgr2=0x55c003371270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc867fc640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbc7c0b6700 0x7fbc7c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc94aed640 1 --2- 172.21.15.7:0/944799658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 0x55c003371270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc94aed640 1 -- 172.21.15.7:0/944799658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa11b0 msgr2=0x55c0033717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc94aed640 1 --2- 172.21.15.7:0/944799658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa11b0 0x55c0033717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.086+0000 7fbc94aed640 1 -- 172.21.15.7:0/944799658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c003035650 con 0x55c002fa9390 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.087+0000 7fbc95aef640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbc7c0b6700 0x7fbc7c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.087+0000 7fbc867fc640 1 -- 172.21.15.7:0/137786635 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fbc880e7830 con 0x7fbc90108d20 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.087+0000 7fbc94aed640 1 --2- 172.21.15.7:0/944799658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa9390 0x55c003371cf0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fbc80012580 tx=0x7fbc800097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a473deefd495b59b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.087+0000 7fbc7b7fe640 1 -- 172.21.15.7:0/944799658 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80010710 con 0x55c002fa9390 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.087+0000 7fbc7b7fe640 1 -- 172.21.15.7:0/944799658 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc80010d60 con 0x55c002fa9390 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.087+0000 7fbc7b7fe640 1 -- 172.21.15.7:0/944799658 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8001dd10 con 0x55c002fa9390 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.088+0000 7fbc9dac6740 1 -- 172.21.15.7:0/944799658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa9390 msgr2=0x55c003371cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.088+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/944799658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa9390 0x55c003371cf0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fbc80012580 tx=0x7fbc800097b0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.088+0000 7fbc95aef640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbc7c0b6700 0x7fbc7c0b8c10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800efd0 tx=0x7fbc88071740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:03.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.088+0000 7fbc9dac6740 1 -- 172.21.15.7:0/944799658 shutdown_connections 2024-09-21T06:00:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.088+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/944799658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa9390 0x55c003371cf0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.088+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/944799658 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa11b0 0x55c0033717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.088+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/944799658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 0x55c003371270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.088+0000 7fbc9dac6740 1 -- 172.21.15.7:0/944799658 >> 172.21.15.7:0/944799658 conn(0x55c002fbe460 msgr2=0x55c00336f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.088+0000 7fbc9dac6740 1 -- 172.21.15.7:0/944799658 shutdown_connections 2024-09-21T06:00:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.088+0000 7fbc9dac6740 1 -- 172.21.15.7:0/944799658 wait complete. 2024-09-21T06:00:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.088+0000 7fbc9dac6740 1 -- start start 2024-09-21T06:00:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.088+0000 7fbc9dac6740 1 Processor -- start 2024-09-21T06:00:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc9dac6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 0x55c00337c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc9dac6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa9390 0x55c00337cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc9dac6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 0x55c00337d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc9dac6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c003138700 con 0x55c002fa11b0 2024-09-21T06:00:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc9dac6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c003272110 con 0x55c002fa9390 2024-09-21T06:00:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc9dac6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c003383e60 con 0x55c002fca070 2024-09-21T06:00:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc9dac6740 10 client.0 _ll_register_callbacks cb 0x55c00328b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc94aed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 0x55c00337c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc94aed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 0x55c00337c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59776/0 (socket says 172.21.15.7:59776) 2024-09-21T06:00:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc94aed640 1 -- 172.21.15.7:0/3037342242 learned_addr learned my addr 172.21.15.7:0/3037342242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc952ee640 1 --2- 172.21.15.7:0/3037342242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa9390 0x55c00337cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc94aed640 1 -- 172.21.15.7:0/3037342242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 msgr2=0x55c00337d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc94aed640 1 --2- 172.21.15.7:0/3037342242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 0x55c00337d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc94aed640 1 -- 172.21.15.7:0/3037342242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa9390 msgr2=0x55c00337cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc94aed640 1 --2- 172.21.15.7:0/3037342242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa9390 0x55c00337cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc94aed640 1 -- 172.21.15.7:0/3037342242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c00329fc40 con 0x55c002fa11b0 2024-09-21T06:00:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.089+0000 7fbc952ee640 1 --2- 172.21.15.7:0/3037342242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa9390 0x55c00337cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.090+0000 7fbc94aed640 1 --2- 172.21.15.7:0/3037342242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 0x55c00337c820 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fbc8001d610 tx=0x7fbc800095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa436303b3282559 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.090+0000 7fbc78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.090+0000 7fbc78ff9640 1 -- 172.21.15.7:0/3037342242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80010720 con 0x55c002fa11b0 2024-09-21T06:00:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.090+0000 7fbc78ff9640 1 -- 172.21.15.7:0/3037342242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fbc800108c0 con 0x55c002fa11b0 2024-09-21T06:00:03.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.090+0000 7fbc9dac6740 1 -- 172.21.15.7:0/3037342242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc80010d60 con 0x55c002fa11b0 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.090+0000 7fbc78ff9640 1 -- 172.21.15.7:0/3037342242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbc80010ac0 con 0x55c002fa11b0 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.090+0000 7fbc9dac6740 10 client.16962 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.090+0000 7fbc9dac6740 1 -- 172.21.15.7:0/3037342242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c00338fac0 con 0x55c002fa11b0 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.090+0000 7fbc78ff9640 1 -- 172.21.15.7:0/3037342242 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc80010d60 con 0x55c002fa11b0 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.090+0000 7fbc78ff9640 1 -- 172.21.15.7:0/3037342242 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbc80032070 con 0x55c002fa11b0 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.091+0000 7fbc9dac6740 10 client.16962 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.091+0000 7fbc9dac6740 10 client.16962 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.091+0000 7fbc9dac6740 20 client.16962 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.091+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/3037342242 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c002f889f0 0x55c003392ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.091+0000 7fbc9dac6740 4 client.16962 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.091+0000 7fbc9dac6740 1 -- 172.21.15.7:0/3037342242 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0032e9da0 con 0x55c002f889f0 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.091+0000 7fbc952ee640 1 --2- 172.21.15.7:0/3037342242 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c002f889f0 0x55c003392ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.091+0000 7fbc78ff9640 10 client.16962 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.091+0000 7fbc952ee640 1 --2- 172.21.15.7:0/3037342242 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c002f889f0 0x55c003392ed0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9f54b60e67dccb0 server_cookie=78209110e3a76561 in_seq=0 out_seq=0 2024-09-21T06:00:03.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.092+0000 7fbc78ff9640 1 -- 172.21.15.7:0/3037342242 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c0032e9da0 con 0x55c002f889f0 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.092+0000 7fbc78ff9640 10 client.16962 handle_command_reply: tid=0 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.092+0000 7fbc9dac6740 1 client.16962 shutdown 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.092+0000 7fbc9dac6740 1 -- 172.21.15.7:0/3037342242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 msgr2=0x55c00337c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.092+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/3037342242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 0x55c00337c820 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fbc8001d610 tx=0x7fbc800095e0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.092+0000 7fbc9dac6740 1 -- 172.21.15.7:0/3037342242 shutdown_connections 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.092+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/3037342242 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c002f889f0 0x55c003392ed0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.092+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/3037342242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 0x55c00337d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.092+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/3037342242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa9390 0x55c00337cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.092+0000 7fbc78ff9640 0 client.16962 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.092+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/3037342242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 0x55c00337c820 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.092+0000 7fbc9dac6740 1 -- 172.21.15.7:0/3037342242 >> 172.21.15.7:0/3037342242 conn(0x55c002fbe460 msgr2=0x55c003374400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.093+0000 7fbc9dac6740 1 -- 172.21.15.7:0/3037342242 shutdown_connections 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.093+0000 7fbc9dac6740 1 -- 172.21.15.7:0/3037342242 wait complete. 2024-09-21T06:00:03.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.093+0000 7fbc9dac6740 20 client.16962 trim_cache size 0 max 16384 2024-09-21T06:00:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.110+0000 7fbc9dac6740 1 Processor -- start 2024-09-21T06:00:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.110+0000 7fbc9dac6740 1 -- start start 2024-09-21T06:00:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc9dac6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 0x55c00337e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc9dac6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fa9390 0x55c003372960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc9dac6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fca070 0x55c00336e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc9dac6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc901afd10 con 0x55c002fa11b0 2024-09-21T06:00:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc9dac6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbc901ad5e0 con 0x55c002fca070 2024-09-21T06:00:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc9dac6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbc901ab430 con 0x55c002fa9390 2024-09-21T06:00:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc94aed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 0x55c00337e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc94aed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 0x55c00337e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59784/0 (socket says 172.21.15.7:59784) 2024-09-21T06:00:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc94aed640 1 -- 172.21.15.7:0/2777360859 learned_addr learned my addr 172.21.15.7:0/2777360859 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc94aed640 1 -- 172.21.15.7:0/2777360859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fa9390 msgr2=0x55c003372960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc94aed640 1 --2- 172.21.15.7:0/2777360859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fa9390 0x55c003372960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc94aed640 1 -- 172.21.15.7:0/2777360859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fca070 msgr2=0x55c00336e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc94aed640 1 --2- 172.21.15.7:0/2777360859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fca070 0x55c00336e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc94aed640 1 -- 172.21.15.7:0/2777360859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c003373560 con 0x55c002fa11b0 2024-09-21T06:00:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc94aed640 1 --2- 172.21.15.7:0/2777360859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 0x55c00337e700 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fbc8001d9d0 tx=0x7fbc8001df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06e9cac1a29167a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc7affd640 1 -- 172.21.15.7:0/2777360859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80038040 con 0x55c002fa11b0 2024-09-21T06:00:03.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc7affd640 1 -- 172.21.15.7:0/2777360859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc8001d770 con 0x55c002fa11b0 2024-09-21T06:00:03.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.111+0000 7fbc7affd640 1 -- 172.21.15.7:0/2777360859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80004f40 con 0x55c002fa11b0 2024-09-21T06:00:03.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.112+0000 7fbc9dac6740 1 -- 172.21.15.7:0/2777360859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 msgr2=0x55c00337e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:03.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.112+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/2777360859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 0x55c00337e700 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fbc8001d9d0 tx=0x7fbc8001df30 comp rx=0 tx=0).stop 2024-09-21T06:00:03.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.112+0000 7fbc9dac6740 1 -- 172.21.15.7:0/2777360859 shutdown_connections 2024-09-21T06:00:03.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.112+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/2777360859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fca070 0x55c00336e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.112+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/2777360859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fa9390 0x55c003372960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.112+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/2777360859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa11b0 0x55c00337e700 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.112+0000 7fbc9dac6740 1 -- 172.21.15.7:0/2777360859 >> 172.21.15.7:0/2777360859 conn(0x55c002fbe460 msgr2=0x55c003372250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:03.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.112+0000 7fbc9dac6740 1 -- 172.21.15.7:0/2777360859 shutdown_connections 2024-09-21T06:00:03.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.112+0000 7fbc9dac6740 1 -- 172.21.15.7:0/2777360859 wait complete. 2024-09-21T06:00:03.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.113+0000 7fbc9dac6740 1 -- start start 2024-09-21T06:00:03.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.113+0000 7fbc9dac6740 1 Processor -- start 2024-09-21T06:00:03.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.113+0000 7fbc9dac6740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa11b0 0x55c0033850e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.113+0000 7fbc9dac6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa9390 0x55c003385620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.113+0000 7fbc9dac6740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 0x55c003385b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.113+0000 7fbc9dac6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc901abaa0 con 0x55c002fa9390 2024-09-21T06:00:03.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.113+0000 7fbc9dac6740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbc901acf10 con 0x55c002fa11b0 2024-09-21T06:00:03.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.113+0000 7fbc9dac6740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbc901ac170 con 0x55c002fca070 2024-09-21T06:00:03.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.113+0000 7fbc9dac6740 10 client.0 _ll_register_callbacks cb 0x7fbc80012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:03.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc952ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa9390 0x55c003385620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc94aed640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa11b0 0x55c0033850e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc94aed640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa11b0 0x55c0033850e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:39930/0 (socket says 172.21.15.7:39930) 2024-09-21T06:00:03.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc94aed640 1 -- 172.21.15.7:0/393633201 learned_addr learned my addr 172.21.15.7:0/393633201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:03.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc94aed640 1 --2- 172.21.15.7:0/393633201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 0x55c003385b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc952ee640 1 -- 172.21.15.7:0/393633201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 msgr2=0x55c003385b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:03.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc952ee640 1 --2- 172.21.15.7:0/393633201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 0x55c003385b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc952ee640 1 -- 172.21.15.7:0/393633201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa11b0 msgr2=0x55c0033850e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:03.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc952ee640 1 --2- 172.21.15.7:0/393633201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa11b0 0x55c0033850e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc952ee640 1 -- 172.21.15.7:0/393633201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0033fc750 con 0x55c002fa9390 2024-09-21T06:00:03.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc94aed640 1 --2- 172.21.15.7:0/393633201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa11b0 0x55c0033850e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:03.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc952ee640 1 --2- 172.21.15.7:0/393633201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa9390 0x55c003385620 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c000c00 tx=0x7fbc8c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805f9476049b9b55 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:03.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:03.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc78ff9640 1 -- 172.21.15.7:0/393633201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c035040 con 0x55c002fa9390 2024-09-21T06:00:03.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc9dac6740 1 -- 172.21.15.7:0/393633201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc8001d770 con 0x55c002fa9390 2024-09-21T06:00:03.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.114+0000 7fbc78ff9640 1 -- 172.21.15.7:0/393633201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7fbc8c004400 con 0x55c002fa9390 2024-09-21T06:00:03.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.115+0000 7fbc78ff9640 1 -- 172.21.15.7:0/393633201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbc8c005040 con 0x55c002fa9390 2024-09-21T06:00:03.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.115+0000 7fbc9dac6740 10 client.16968 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.115+0000 7fbc9dac6740 1 -- 172.21.15.7:0/393633201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c0033fda10 con 0x55c002fa9390 2024-09-21T06:00:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.115+0000 7fbc78ff9640 1 -- 172.21.15.7:0/393633201 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc8001d770 con 0x55c002fa9390 2024-09-21T06:00:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.115+0000 7fbc78ff9640 1 -- 172.21.15.7:0/393633201 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbc8c0035f0 con 0x55c002fa9390 2024-09-21T06:00:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.115+0000 7fbc9dac6740 10 client.16968 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.115+0000 7fbc9dac6740 10 client.16968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.115+0000 7fbc9dac6740 20 client.16968 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.115+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/393633201 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c002f5dda0 0x55c003400220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.115+0000 7fbc9dac6740 4 client.16968 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:00:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.115+0000 7fbc9dac6740 1 -- 172.21.15.7:0/393633201 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c0032e5850 con 0x55c002f5dda0 2024-09-21T06:00:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.115+0000 7fbc94aed640 1 --2- 172.21.15.7:0/393633201 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c002f5dda0 0x55c003400220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc94aed640 1 --2- 172.21.15.7:0/393633201 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c002f5dda0 0x55c003400220 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52a7a4142d6d0529 server_cookie=14c9611d0ee8405b in_seq=0 out_seq=0 2024-09-21T06:00:03.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc78ff9640 10 client.16968 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:03.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc78ff9640 1 -- 172.21.15.7:0/393633201 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x55c0032e5850 con 0x55c002f5dda0 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc78ff9640 10 client.16968 handle_command_reply: tid=0 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc9dac6740 1 client.16968 shutdown 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc9dac6740 1 -- 172.21.15.7:0/393633201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa9390 msgr2=0x55c003385620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/393633201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa9390 0x55c003385620 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c000c00 tx=0x7fbc8c004040 comp rx=0 tx=0).stop 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc9dac6740 1 -- 172.21.15.7:0/393633201 shutdown_connections 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/393633201 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c002f5dda0 0x55c003400220 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/393633201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c002fa9390 0x55c003385620 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/393633201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c002fca070 0x55c003385b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc9dac6740 1 --2- 172.21.15.7:0/393633201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c002fa11b0 0x55c0033850e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc9dac6740 1 -- 172.21.15.7:0/393633201 >> 172.21.15.7:0/393633201 conn(0x55c002fbe460 msgr2=0x55c00337e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.116+0000 7fbc78ff9640 0 client.16968 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc9dac6740 1 -- 172.21.15.7:0/393633201 shutdown_connections 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc9dac6740 1 -- 172.21.15.7:0/393633201 wait complete. 2024-09-21T06:00:03.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc9dac6740 20 client.16968 trim_cache size 0 max 16384 2024-09-21T06:00:03.124 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:00:03.124 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:00:03.124 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:00:03.124 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:00:03.124 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:00:03.124 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:00:03.124 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:03.124 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:03.124 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:03.124 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:03.124 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:03.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:03.125 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:03.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:03.126 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:00:03.126 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:00:03.126 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:03.126 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:03.126 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:03.126 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:03.126 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:03.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:03.126 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:00:03.126 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:00:03.126 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:03.126 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:00:03.127 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:03.128 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:03.129 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:03.131 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:03.131 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:03.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:03.131 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:00:03.131 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:00:03.131 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:03.131 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:03.131 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:03.131 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:03.131 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:03.131 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:00:03.131 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:00:03.131 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:00:03.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc97552640 1 -- 172.21.15.7:0/137786635 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbc7c0b6700 msgr2=0x7fbc7c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:03.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc97552640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbc7c0b6700 0x7fbc7c0b8c10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800efd0 tx=0x7fbc88071740 comp rx=0 tx=0).stop 2024-09-21T06:00:03.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc97552640 1 -- 172.21.15.7:0/137786635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90108d20 msgr2=0x7fbc9019fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:03.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc97552640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90108d20 0x7fbc9019fd30 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800eaa0 tx=0x7fbc8800ef60 comp rx=0 tx=0).stop 2024-09-21T06:00:03.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc97552640 1 -- 172.21.15.7:0/137786635 shutdown_connections 2024-09-21T06:00:03.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc97552640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbc7c0b6700 0x7fbc7c0b8c10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc97552640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc90108d20 0x7fbc9019fd30 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc97552640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc901083d0 0x7fbc9019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc97552640 1 --2- 172.21.15.7:0/137786635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc90102ae0 0x7fbc9019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:03.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc97552640 1 -- 172.21.15.7:0/137786635 >> 172.21.15.7:0/137786635 conn(0x7fbc90079760 msgr2=0x7fbc901014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:03.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc97552640 1 -- 172.21.15.7:0/137786635 shutdown_connections 2024-09-21T06:00:03.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:03.117+0000 7fbc97552640 1 -- 172.21.15.7:0/137786635 wait complete. 2024-09-21T06:00:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:03 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:00:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:03 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:03 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:00:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:03 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:03 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:00:03.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:03 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:00:03.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:03 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:03.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:03 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:00:03.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:03 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:03.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:03 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:00:03.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:03 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:00:03.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:03 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:03.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:03 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:00:03.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:03 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:03.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:03 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:00:03.807 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:00:03.807 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:00:04.067 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:04.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:04 smithi007 ceph-mon[30983]: pgmap v503: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:00:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:04 smithi027 ceph-mon[34364]: pgmap v503: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:00:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.529+0000 7f27bfcf0640 1 -- 172.21.15.7:0/3668943526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27b8109e50 msgr2=0x7f27b8110680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.529+0000 7f27bfcf0640 1 --2- 172.21.15.7:0/3668943526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27b8109e50 0x7f27b8110680 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009ca0 tx=0x7f27b002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:00:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.529+0000 7f27bfcf0640 1 -- 172.21.15.7:0/3668943526 shutdown_connections 2024-09-21T06:00:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.529+0000 7f27bfcf0640 1 --2- 172.21.15.7:0/3668943526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27b8109e50 0x7f27b8110680 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:04.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.529+0000 7f27bfcf0640 1 --2- 172.21.15.7:0/3668943526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27b8109500 0x7f27b8109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:04.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.529+0000 7f27bfcf0640 1 --2- 172.21.15.7:0/3668943526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27b8101fc0 0x7f27b81023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:04.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.529+0000 7f27bfcf0640 1 -- 172.21.15.7:0/3668943526 >> 172.21.15.7:0/3668943526 conn(0x7f27b8079f90 msgr2=0x7f27b807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:04.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.529+0000 7f27bfcf0640 1 -- 172.21.15.7:0/3668943526 shutdown_connections 2024-09-21T06:00:04.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.529+0000 7f27bfcf0640 1 -- 172.21.15.7:0/3668943526 wait complete. 2024-09-21T06:00:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.530+0000 7f27bfcf0640 1 Processor -- start 2024-09-21T06:00:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.530+0000 7f27bfcf0640 1 -- start start 2024-09-21T06:00:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.530+0000 7f27bfcf0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27b8101fc0 0x7f27b819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.530+0000 7f27bfcf0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27b8109500 0x7f27b819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.530+0000 7f27bfcf0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27b8109e50 0x7f27b819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.530+0000 7f27bfcf0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27b8113b10 con 0x7f27b8109500 2024-09-21T06:00:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.530+0000 7f27bfcf0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f27b8113990 con 0x7f27b8109e50 2024-09-21T06:00:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.530+0000 7f27bfcf0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f27b8113c90 con 0x7f27b8101fc0 2024-09-21T06:00:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.530+0000 7f27bd28b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27b8109500 0x7f27b819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.530+0000 7f27bd28b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27b8109500 0x7f27b819aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59812/0 (socket says 172.21.15.7:59812) 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.530+0000 7f27bd28b640 1 -- 172.21.15.7:0/1598869089 learned_addr learned my addr 172.21.15.7:0/1598869089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.530+0000 7f27bda8c640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27b8101fc0 0x7f27b819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.531+0000 7f27be28d640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27b8109e50 0x7f27b819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.531+0000 7f27bd28b640 1 -- 172.21.15.7:0/1598869089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27b8101fc0 msgr2=0x7f27b819a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.531+0000 7f27bd28b640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27b8101fc0 0x7f27b819a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.531+0000 7f27bd28b640 1 -- 172.21.15.7:0/1598869089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27b8109e50 msgr2=0x7f27b819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.531+0000 7f27bd28b640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27b8109e50 0x7f27b819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.531+0000 7f27bd28b640 1 -- 172.21.15.7:0/1598869089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b81a03d0 con 0x7f27b8109500 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.531+0000 7f27bd28b640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27b8109500 0x7f27b819aac0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f27a800e9f0 tx=0x7f27a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.531+0000 7f27aeffd640 1 -- 172.21.15.7:0/1598869089 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a800ccc0 con 0x7f27b8109500 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.531+0000 7f27bfcf0640 1 -- 172.21.15.7:0/1598869089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b81a06c0 con 0x7f27b8109500 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.531+0000 7f27aeffd640 1 -- 172.21.15.7:0/1598869089 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27a80108e0 con 0x7f27b8109500 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.531+0000 7f27aeffd640 1 -- 172.21.15.7:0/1598869089 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8018880 con 0x7f27b8109500 2024-09-21T06:00:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.531+0000 7f27bfcf0640 1 -- 172.21.15.7:0/1598869089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b81a6ee0 con 0x7f27b8109500 2024-09-21T06:00:04.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.532+0000 7f27bfcf0640 1 -- 172.21.15.7:0/1598869089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b806b930 con 0x7f27b8109500 2024-09-21T06:00:04.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.534+0000 7f27aeffd640 1 -- 172.21.15.7:0/1598869089 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f27a8010430 con 0x7f27b8109500 2024-09-21T06:00:04.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.535+0000 7f27aeffd640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27a40b66b0 0x7f27a40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:04.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.535+0000 7f27bda8c640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27a40b66b0 0x7f27a40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:04.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.535+0000 7f27aeffd640 1 -- 172.21.15.7:0/1598869089 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f27a80e7ee0 con 0x7f27b8109500 2024-09-21T06:00:04.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.535+0000 7f27bda8c640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27a40b66b0 0x7f27a40b8bc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f27b400abe0 tx=0x7f27b400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:04.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.538+0000 7f27aeffd640 1 -- 172.21.15.7:0/1598869089 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f27a80ae450 con 0x7f27b8109500 2024-09-21T06:00:04.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:04 smithi119 ceph-mon[34833]: pgmap v503: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:00:04.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.765+0000 7f27bfcf0640 1 -- 172.21.15.7:0/1598869089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27b810bc40 con 0x7f27b8109500 2024-09-21T06:00:04.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.765+0000 7f27aeffd640 1 -- 172.21.15.7:0/1598869089 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f27a80b2830 con 0x7f27b8109500 2024-09-21T06:00:04.768 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:00:04.768 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:00:04.768 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:00:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.768+0000 7f27bfcf0640 1 -- 172.21.15.7:0/1598869089 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27a40b66b0 msgr2=0x7f27a40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.768+0000 7f27bfcf0640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27a40b66b0 0x7f27a40b8bc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f27b400abe0 tx=0x7f27b400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:00:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.768+0000 7f27bfcf0640 1 -- 172.21.15.7:0/1598869089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27b8109500 msgr2=0x7f27b819aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.768+0000 7f27bfcf0640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27b8109500 0x7f27b819aac0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f27a800e9f0 tx=0x7f27a800edf0 comp rx=0 tx=0).stop 2024-09-21T06:00:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.768+0000 7f27bfcf0640 1 -- 172.21.15.7:0/1598869089 shutdown_connections 2024-09-21T06:00:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.768+0000 7f27bfcf0640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27a40b66b0 0x7f27a40b8bc0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.768+0000 7f27bfcf0640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27b8109500 0x7f27b819aac0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.768+0000 7f27bfcf0640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27b8109e50 0x7f27b819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.768+0000 7f27bfcf0640 1 --2- 172.21.15.7:0/1598869089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27b8101fc0 0x7f27b819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.768+0000 7f27bfcf0640 1 -- 172.21.15.7:0/1598869089 >> 172.21.15.7:0/1598869089 conn(0x7f27b8079f90 msgr2=0x7f27b8107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.768+0000 7f27bfcf0640 1 -- 172.21.15.7:0/1598869089 shutdown_connections 2024-09-21T06:00:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:04.768+0000 7f27bfcf0640 1 -- 172.21.15.7:0/1598869089 wait complete. 2024-09-21T06:00:05.473 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:05 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1598869089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:05.475 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:00:05.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:05 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1598869089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:05.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:05 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1598869089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:05.733 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:06.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.148+0000 7f04a6a5f640 1 -- 172.21.15.7:0/1417011009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04a0103b60 msgr2=0x7f04a0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:06.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.148+0000 7f04a6a5f640 1 --2- 172.21.15.7:0/1417011009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04a0103b60 0x7f04a0103f70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f0490009900 tx=0x7f049002a410 comp rx=0 tx=0).stop 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.148+0000 7f04a6a5f640 1 -- 172.21.15.7:0/1417011009 shutdown_connections 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.148+0000 7f04a6a5f640 1 --2- 172.21.15.7:0/1417011009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a0109df0 0x7f04a0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.148+0000 7f04a6a5f640 1 --2- 172.21.15.7:0/1417011009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a01094a0 0x7f04a01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.148+0000 7f04a6a5f640 1 --2- 172.21.15.7:0/1417011009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04a0103b60 0x7f04a0103f70 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.148+0000 7f04a6a5f640 1 -- 172.21.15.7:0/1417011009 >> 172.21.15.7:0/1417011009 conn(0x7f04a007b850 msgr2=0x7f04a007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.148+0000 7f04a6a5f640 1 -- 172.21.15.7:0/1417011009 shutdown_connections 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.148+0000 7f04a6a5f640 1 -- 172.21.15.7:0/1417011009 wait complete. 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f04a6a5f640 1 Processor -- start 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f04a6a5f640 1 -- start start 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f04a6a5f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a0103b60 0x7f04a019c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f04a6a5f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a01094a0 0x7f04a019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f04a6a5f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04a0109df0 0x7f04a01a2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f04a6a5f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0113af0 con 0x7f04a0109df0 2024-09-21T06:00:06.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f04a6a5f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0113970 con 0x7f04a01094a0 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f04a6a5f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0113c70 con 0x7f04a0103b60 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f04a4ffc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04a0109df0 0x7f04a01a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a01094a0 0x7f04a019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f049ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a0103b60 0x7f04a019c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a01094a0 0x7f04a019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:39962/0 (socket says 172.21.15.7:39962) 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f04a4ffc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04a0109df0 0x7f04a01a2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59836/0 (socket says 172.21.15.7:59836) 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.149+0000 7f049f7fe640 1 -- 172.21.15.7:0/3645773515 learned_addr learned my addr 172.21.15.7:0/3645773515 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.150+0000 7f04a4ffc640 1 -- 172.21.15.7:0/3645773515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a0103b60 msgr2=0x7f04a019c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.150+0000 7f04a4ffc640 1 --2- 172.21.15.7:0/3645773515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a0103b60 0x7f04a019c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.150+0000 7f04a4ffc640 1 -- 172.21.15.7:0/3645773515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a01094a0 msgr2=0x7f04a019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.150+0000 7f04a4ffc640 1 --2- 172.21.15.7:0/3645773515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a01094a0 0x7f04a019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.150+0000 7f04a4ffc640 1 -- 172.21.15.7:0/3645773515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a01a2770 con 0x7f04a0109df0 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.150+0000 7f049f7fe640 1 --2- 172.21.15.7:0/3645773515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a01094a0 0x7f04a019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.150+0000 7f04a4ffc640 1 --2- 172.21.15.7:0/3645773515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04a0109df0 0x7f04a01a2040 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f049800ca30 tx=0x7f049800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:06.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.150+0000 7f049d7fa640 1 -- 172.21.15.7:0/3645773515 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0498007d90 con 0x7f04a0109df0 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.150+0000 7f049d7fa640 1 -- 172.21.15.7:0/3645773515 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0498005020 con 0x7f04a0109df0 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.150+0000 7f049d7fa640 1 -- 172.21.15.7:0/3645773515 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049800f690 con 0x7f04a0109df0 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.150+0000 7f04a6a5f640 1 -- 172.21.15.7:0/3645773515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a01a2a60 con 0x7f04a0109df0 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.150+0000 7f04a6a5f640 1 -- 172.21.15.7:0/3645773515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a01a91c0 con 0x7f04a0109df0 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.153+0000 7f04acfd3740 1 Processor -- start 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.154+0000 7f049d7fa640 1 -- 172.21.15.7:0/3645773515 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f04980051d0 con 0x7f04a0109df0 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.154+0000 7f04acfd3740 1 -- start start 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.154+0000 7f04acfd3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5ff070 0x55c63e9a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.154+0000 7f04acfd3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5d61b0 0x55c63e9a6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.154+0000 7f04acfd3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5de390 0x55c63e9a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.154+0000 7f04acfd3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c63e91cea0 con 0x55c63e5ff070 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.154+0000 7f04acfd3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c63e90c2d0 con 0x55c63e5de390 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.154+0000 7f04acfd3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c63e9100e0 con 0x55c63e5d61b0 2024-09-21T06:00:06.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.154+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5ff070 0x55c63e9a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.155+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5ff070 0x55c63e9a62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59842/0 (socket says 172.21.15.7:59842) 2024-09-21T06:00:06.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.155+0000 7f049f7fe640 1 -- 172.21.15.7:0/1879453686 learned_addr learned my addr 172.21.15.7:0/1879453686 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:06.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.155+0000 7f049ffff640 1 --2- 172.21.15.7:0/1879453686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5d61b0 0x55c63e9a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.155+0000 7f049f7fe640 1 --2- 172.21.15.7:0/1879453686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5de390 0x55c63e9a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.155+0000 7f049d7fa640 1 --2- 172.21.15.7:0/3645773515 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f04880b6700 0x7f04880b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.155+0000 7f049f7fe640 1 -- 172.21.15.7:0/1879453686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5d61b0 msgr2=0x55c63e9a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:06.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.155+0000 7f049f7fe640 1 --2- 172.21.15.7:0/1879453686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5d61b0 0x55c63e9a6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.155+0000 7f049f7fe640 1 -- 172.21.15.7:0/1879453686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5de390 msgr2=0x55c63e9a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:06.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.155+0000 7f049f7fe640 1 --2- 172.21.15.7:0/1879453686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5de390 0x55c63e9a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.155+0000 7f049f7fe640 1 -- 172.21.15.7:0/1879453686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c63e66a650 con 0x55c63e5ff070 2024-09-21T06:00:06.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.155+0000 7f04a4ffc640 1 --2- 172.21.15.7:0/3645773515 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f04880b6700 0x7f04880b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.155+0000 7f049d7fa640 1 -- 172.21.15.7:0/3645773515 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f04980e7830 con 0x7f04a0109df0 2024-09-21T06:00:06.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.155+0000 7f049f7fe640 1 --2- 172.21.15.7:0/1879453686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5ff070 0x55c63e9a62c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0494015700 tx=0x7f04940099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2064732bc3f93199 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:06.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.156+0000 7f04867fc640 1 -- 172.21.15.7:0/1879453686 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04940108f0 con 0x55c63e5ff070 2024-09-21T06:00:06.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.156+0000 7f04867fc640 1 -- 172.21.15.7:0/1879453686 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f049401c070 con 0x55c63e5ff070 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.156+0000 7f04867fc640 1 -- 172.21.15.7:0/1879453686 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494017c40 con 0x55c63e5ff070 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.157+0000 7f04acfd3740 1 -- 172.21.15.7:0/1879453686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5ff070 msgr2=0x55c63e9a62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.157+0000 7f04acfd3740 1 --2- 172.21.15.7:0/1879453686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5ff070 0x55c63e9a62c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0494015700 tx=0x7f04940099c0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.157+0000 7f04a4ffc640 1 --2- 172.21.15.7:0/3645773515 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f04880b6700 0x7f04880b8c10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04980e50b0 tx=0x7f04980762d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.157+0000 7f04acfd3740 1 -- 172.21.15.7:0/1879453686 shutdown_connections 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.157+0000 7f04acfd3740 1 --2- 172.21.15.7:0/1879453686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5de390 0x55c63e9a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.157+0000 7f04acfd3740 1 --2- 172.21.15.7:0/1879453686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5d61b0 0x55c63e9a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.157+0000 7f04acfd3740 1 --2- 172.21.15.7:0/1879453686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5ff070 0x55c63e9a62c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.157+0000 7f04acfd3740 1 -- 172.21.15.7:0/1879453686 >> 172.21.15.7:0/1879453686 conn(0x55c63e5f3460 msgr2=0x55c63e9a41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.157+0000 7f04acfd3740 1 -- 172.21.15.7:0/1879453686 shutdown_connections 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.157+0000 7f04acfd3740 1 -- 172.21.15.7:0/1879453686 wait complete. 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.157+0000 7f04acfd3740 1 -- start start 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.158+0000 7f04acfd3740 1 Processor -- start 2024-09-21T06:00:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.158+0000 7f04acfd3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5d61b0 0x55c63e9b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.158+0000 7f04acfd3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5de390 0x55c63e9b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.158+0000 7f04acfd3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5ff070 0x55c63e9b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.158+0000 7f04acfd3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c63e76d700 con 0x55c63e5ff070 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.158+0000 7f04acfd3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c63e8a7160 con 0x55c63e5d61b0 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.158+0000 7f04acfd3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c63e9b4a40 con 0x55c63e5de390 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.158+0000 7f04acfd3740 10 client.0 _ll_register_callbacks cb 0x55c63e8c09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5ff070 0x55c63e9b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f049ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5de390 0x55c63e9b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5ff070 0x55c63e9b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59854/0 (socket says 172.21.15.7:59854) 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f049f7fe640 1 -- 172.21.15.7:0/965212665 learned_addr learned my addr 172.21.15.7:0/965212665 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f049f7fe640 1 --2- 172.21.15.7:0/965212665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5d61b0 0x55c63e9b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f049ffff640 1 -- 172.21.15.7:0/965212665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5d61b0 msgr2=0x55c63e9b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f049ffff640 1 --2- 172.21.15.7:0/965212665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5d61b0 0x55c63e9b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f049ffff640 1 -- 172.21.15.7:0/965212665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5ff070 msgr2=0x55c63e9b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f049ffff640 1 --2- 172.21.15.7:0/965212665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5ff070 0x55c63e9b2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f049ffff640 1 -- 172.21.15.7:0/965212665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c63e8d4c90 con 0x55c63e5de390 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f049ffff640 1 --2- 172.21.15.7:0/965212665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5de390 0x55c63e9b1e00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0490009230 tx=0x7f04900316d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf7043d7c92df5ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f047f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f047f7fe640 1 -- 172.21.15.7:0/965212665 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490035040 con 0x55c63e5de390 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f04acfd3740 1 -- 172.21.15.7:0/965212665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f049401c070 con 0x55c63e5de390 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.159+0000 7f047f7fe640 1 -- 172.21.15.7:0/965212665 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f0490004040 con 0x55c63e5de390 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.160+0000 7f047f7fe640 1 -- 172.21.15.7:0/965212665 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0490004240 con 0x55c63e5de390 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.160+0000 7f04acfd3740 10 client.26410 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.160+0000 7f04acfd3740 1 -- 172.21.15.7:0/965212665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c63e9c0670 con 0x55c63e5de390 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.160+0000 7f047f7fe640 1 -- 172.21.15.7:0/965212665 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f049401c070 con 0x55c63e5de390 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.160+0000 7f047f7fe640 1 -- 172.21.15.7:0/965212665 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0490004ad0 con 0x55c63e5de390 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.160+0000 7f04acfd3740 10 client.26410 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.160+0000 7f04acfd3740 10 client.26410 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:00:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.160+0000 7f04acfd3740 20 client.26410 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.160+0000 7f04acfd3740 1 --2- 172.21.15.7:0/965212665 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c63e5bd9f0 0x55c63e9c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.160+0000 7f04acfd3740 4 client.26410 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.160+0000 7f04acfd3740 1 -- 172.21.15.7:0/965212665 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c63e91edf0 con 0x55c63e5bd9f0 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.160+0000 7f049f7fe640 1 --2- 172.21.15.7:0/965212665 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c63e5bd9f0 0x55c63e9c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.161+0000 7f049f7fe640 1 --2- 172.21.15.7:0/965212665 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c63e5bd9f0 0x55c63e9c3b90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=96c5fa5fe45be5f3 server_cookie=8f56bccf51b3210e in_seq=0 out_seq=0 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.161+0000 7f047f7fe640 10 client.26410 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f047f7fe640 1 -- 172.21.15.7:0/965212665 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c63e91edf0 con 0x55c63e5bd9f0 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f047f7fe640 10 client.26410 handle_command_reply: tid=0 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f04acfd3740 1 client.26410 shutdown 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f04acfd3740 1 -- 172.21.15.7:0/965212665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5de390 msgr2=0x55c63e9b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f04acfd3740 1 --2- 172.21.15.7:0/965212665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5de390 0x55c63e9b1e00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0490009230 tx=0x7f04900316d0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f04acfd3740 1 -- 172.21.15.7:0/965212665 shutdown_connections 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f04acfd3740 1 --2- 172.21.15.7:0/965212665 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c63e5bd9f0 0x55c63e9c3b90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f04acfd3740 1 --2- 172.21.15.7:0/965212665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5ff070 0x55c63e9b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f04acfd3740 1 --2- 172.21.15.7:0/965212665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5de390 0x55c63e9b1e00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f04acfd3740 1 --2- 172.21.15.7:0/965212665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5d61b0 0x55c63e9b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f04acfd3740 1 -- 172.21.15.7:0/965212665 >> 172.21.15.7:0/965212665 conn(0x55c63e5f3460 msgr2=0x55c63e9a94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f047f7fe640 0 client.26410 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f04acfd3740 1 -- 172.21.15.7:0/965212665 shutdown_connections 2024-09-21T06:00:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f04acfd3740 1 -- 172.21.15.7:0/965212665 wait complete. 2024-09-21T06:00:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.162+0000 7f04acfd3740 20 client.26410 trim_cache size 0 max 16384 2024-09-21T06:00:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.175+0000 7f04acfd3740 1 Processor -- start 2024-09-21T06:00:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.175+0000 7f04acfd3740 1 -- start start 2024-09-21T06:00:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f04acfd3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 0x55c63e9a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f04acfd3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5de390 0x55c63e9b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f04acfd3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5ff070 0x55c63e9a7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f04acfd3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04a01b40b0 con 0x55c63e5d61b0 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f04acfd3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f04a01b1980 con 0x55c63e5de390 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f04acfd3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f04a01af7d0 con 0x55c63e5ff070 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 0x55c63e9a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 0x55c63e9a9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59856/0 (socket says 172.21.15.7:59856) 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f049f7fe640 1 -- 172.21.15.7:0/837458152 learned_addr learned my addr 172.21.15.7:0/837458152 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f049f7fe640 1 -- 172.21.15.7:0/837458152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5ff070 msgr2=0x55c63e9a7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f049f7fe640 1 --2- 172.21.15.7:0/837458152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5ff070 0x55c63e9a7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f049f7fe640 1 -- 172.21.15.7:0/837458152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5de390 msgr2=0x55c63e9b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f049ffff640 1 --2- 172.21.15.7:0/837458152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5de390 0x55c63e9b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f049f7fe640 1 --2- 172.21.15.7:0/837458152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5de390 0x55c63e9b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f049f7fe640 1 -- 172.21.15.7:0/837458152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c63e9a87e0 con 0x55c63e5d61b0 2024-09-21T06:00:06.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f049f7fe640 1 --2- 172.21.15.7:0/837458152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 0x55c63e9a9e90 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f0494006fd0 tx=0x7f0494015f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cba7e02fca765 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:06.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.176+0000 7f0485ffb640 1 -- 172.21.15.7:0/837458152 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494017e00 con 0x55c63e5d61b0 2024-09-21T06:00:06.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.177+0000 7f0485ffb640 1 -- 172.21.15.7:0/837458152 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f049401c040 con 0x55c63e5d61b0 2024-09-21T06:00:06.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.177+0000 7f0485ffb640 1 -- 172.21.15.7:0/837458152 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049402f690 con 0x55c63e5d61b0 2024-09-21T06:00:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.177+0000 7f04acfd3740 1 -- 172.21.15.7:0/837458152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 msgr2=0x55c63e9a9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.177+0000 7f04acfd3740 1 --2- 172.21.15.7:0/837458152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 0x55c63e9a9e90 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f0494006fd0 tx=0x7f0494015f50 comp rx=0 tx=0).stop 2024-09-21T06:00:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.177+0000 7f04acfd3740 1 -- 172.21.15.7:0/837458152 shutdown_connections 2024-09-21T06:00:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.177+0000 7f04acfd3740 1 --2- 172.21.15.7:0/837458152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5ff070 0x55c63e9a7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.177+0000 7f04acfd3740 1 --2- 172.21.15.7:0/837458152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5de390 0x55c63e9b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.177+0000 7f04acfd3740 1 --2- 172.21.15.7:0/837458152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 0x55c63e9a9e90 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.177+0000 7f04acfd3740 1 -- 172.21.15.7:0/837458152 >> 172.21.15.7:0/837458152 conn(0x55c63e5f3460 msgr2=0x55c63e9a72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.177+0000 7f04acfd3740 1 -- 172.21.15.7:0/837458152 shutdown_connections 2024-09-21T06:00:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.177+0000 7f04acfd3740 1 -- 172.21.15.7:0/837458152 wait complete. 2024-09-21T06:00:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.178+0000 7f04acfd3740 1 -- start start 2024-09-21T06:00:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.178+0000 7f04acfd3740 1 Processor -- start 2024-09-21T06:00:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.178+0000 7f04acfd3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 0x55c63e9ba570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.178+0000 7f04acfd3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5de390 0x55c63e9b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.178+0000 7f04acfd3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5ff070 0x55c63e9b6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.178+0000 7f04acfd3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04a01afe40 con 0x55c63e5d61b0 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.178+0000 7f04acfd3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f04a01b12b0 con 0x55c63e5ff070 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.178+0000 7f04acfd3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f04a01b0510 con 0x55c63e5de390 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.178+0000 7f04acfd3740 10 client.0 _ll_register_callbacks cb 0x7f0490031b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 0x55c63e9ba570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 0x55c63e9ba570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59862/0 (socket says 172.21.15.7:59862) 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f049f7fe640 1 -- 172.21.15.7:0/1025594939 learned_addr learned my addr 172.21.15.7:0/1025594939 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f049ffff640 1 --2- 172.21.15.7:0/1025594939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5de390 0x55c63e9b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f049f7fe640 1 --2- 172.21.15.7:0/1025594939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5ff070 0x55c63e9b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f049f7fe640 1 -- 172.21.15.7:0/1025594939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5de390 msgr2=0x55c63e9b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f049f7fe640 1 --2- 172.21.15.7:0/1025594939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5de390 0x55c63e9b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f049f7fe640 1 -- 172.21.15.7:0/1025594939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5ff070 msgr2=0x55c63e9b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:06.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f049f7fe640 1 --2- 172.21.15.7:0/1025594939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5ff070 0x55c63e9b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f049f7fe640 1 -- 172.21.15.7:0/1025594939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c63e9b6800 con 0x55c63e5d61b0 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f049f7fe640 1 --2- 172.21.15.7:0/1025594939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 0x55c63e9ba570 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f0494004700 tx=0x7f0494017530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ede0fb3ce680f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f047f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f047f7fe640 1 -- 172.21.15.7:0/1025594939 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494041060 con 0x55c63e5d61b0 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f047f7fe640 1 -- 172.21.15.7:0/1025594939 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f0494010d20 con 0x55c63e5d61b0 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.179+0000 7f04acfd3740 1 -- 172.21.15.7:0/1025594939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f049401c040 con 0x55c63e5d61b0 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.180+0000 7f047f7fe640 1 -- 172.21.15.7:0/1025594939 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0494046430 con 0x55c63e5d61b0 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.180+0000 7f04acfd3740 10 client.16992 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.180+0000 7f04acfd3740 1 -- 172.21.15.7:0/1025594939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c63ea2e540 con 0x55c63e5d61b0 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.180+0000 7f047f7fe640 1 -- 172.21.15.7:0/1025594939 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f049401c040 con 0x55c63e5d61b0 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.180+0000 7f047f7fe640 1 -- 172.21.15.7:0/1025594939 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0494036050 con 0x55c63e5d61b0 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.180+0000 7f04acfd3740 10 client.16992 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.180+0000 7f04acfd3740 10 client.16992 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:00:06.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.180+0000 7f04acfd3740 20 client.16992 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.180+0000 7f04acfd3740 1 --2- 172.21.15.7:0/1025594939 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c63e592da0 0x55c63ea30910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.180+0000 7f04acfd3740 4 client.16992 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.180+0000 7f04acfd3740 1 -- 172.21.15.7:0/1025594939 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c63e91a8a0 con 0x55c63e592da0 2024-09-21T06:00:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.180+0000 7f049ffff640 1 --2- 172.21.15.7:0/1025594939 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c63e592da0 0x55c63ea30910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f049ffff640 1 --2- 172.21.15.7:0/1025594939 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c63e592da0 0x55c63ea30910 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41880ba98f4c6550 server_cookie=ce87900511e594c8 in_seq=0 out_seq=0 2024-09-21T06:00:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f047f7fe640 10 client.16992 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f047f7fe640 1 -- 172.21.15.7:0/1025594939 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c63e91a8a0 con 0x55c63e592da0 2024-09-21T06:00:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f047f7fe640 10 client.16992 handle_command_reply: tid=0 2024-09-21T06:00:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f04acfd3740 1 client.16992 shutdown 2024-09-21T06:00:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f04acfd3740 1 -- 172.21.15.7:0/1025594939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 msgr2=0x55c63e9ba570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f04acfd3740 1 --2- 172.21.15.7:0/1025594939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 0x55c63e9ba570 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f0494004700 tx=0x7f0494017530 comp rx=0 tx=0).stop 2024-09-21T06:00:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f04acfd3740 1 -- 172.21.15.7:0/1025594939 shutdown_connections 2024-09-21T06:00:06.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f04acfd3740 1 --2- 172.21.15.7:0/1025594939 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c63e592da0 0x55c63ea30910 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f04acfd3740 1 --2- 172.21.15.7:0/1025594939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c63e5ff070 0x55c63e9b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f04acfd3740 1 --2- 172.21.15.7:0/1025594939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c63e5de390 0x55c63e9b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f04acfd3740 1 --2- 172.21.15.7:0/1025594939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c63e5d61b0 0x55c63e9ba570 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f047f7fe640 0 client.16992 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f04acfd3740 1 -- 172.21.15.7:0/1025594939 >> 172.21.15.7:0/1025594939 conn(0x55c63e5f3460 msgr2=0x55c63e9b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f04acfd3740 1 -- 172.21.15.7:0/1025594939 shutdown_connections 2024-09-21T06:00:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.181+0000 7f04acfd3740 1 -- 172.21.15.7:0/1025594939 wait complete. 2024-09-21T06:00:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.182+0000 7f04acfd3740 20 client.16992 trim_cache size 0 max 16384 2024-09-21T06:00:06.188 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:06.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.182+0000 7f04a6a5f640 1 -- 172.21.15.7:0/3645773515 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f04880b6700 msgr2=0x7f04880b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:06.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.182+0000 7f04a6a5f640 1 --2- 172.21.15.7:0/3645773515 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f04880b6700 0x7f04880b8c10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04980e50b0 tx=0x7f04980762d0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.182+0000 7f04a6a5f640 1 -- 172.21.15.7:0/3645773515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04a0109df0 msgr2=0x7f04a01a2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:06.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.182+0000 7f04a6a5f640 1 --2- 172.21.15.7:0/3645773515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04a0109df0 0x7f04a01a2040 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f049800ca30 tx=0x7f049800cef0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.182+0000 7f04a6a5f640 1 -- 172.21.15.7:0/3645773515 shutdown_connections 2024-09-21T06:00:06.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.182+0000 7f04a6a5f640 1 --2- 172.21.15.7:0/3645773515 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f04880b6700 0x7f04880b8c10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.182+0000 7f04a6a5f640 1 --2- 172.21.15.7:0/3645773515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04a0109df0 0x7f04a01a2040 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.182+0000 7f04a6a5f640 1 --2- 172.21.15.7:0/3645773515 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a01094a0 0x7f04a019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.182+0000 7f04a6a5f640 1 --2- 172.21.15.7:0/3645773515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04a0103b60 0x7f04a019c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:06.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.182+0000 7f04a6a5f640 1 -- 172.21.15.7:0/3645773515 >> 172.21.15.7:0/3645773515 conn(0x7f04a007b850 msgr2=0x7f04a0107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:06.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.182+0000 7f04a6a5f640 1 -- 172.21.15.7:0/3645773515 shutdown_connections 2024-09-21T06:00:06.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:06.182+0000 7f04a6a5f640 1 -- 172.21.15.7:0/3645773515 wait complete. 2024-09-21T06:00:06.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:06 smithi007 ceph-mon[30983]: pgmap v504: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T06:00:06.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:06 smithi119 ceph-mon[34833]: pgmap v504: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T06:00:06.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:06 smithi027 ceph-mon[34364]: pgmap v504: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T06:00:06.872 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:00:07.130 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:07.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.623+0000 7f9c5ed30640 1 -- 172.21.15.7:0/682078981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c58103b70 msgr2=0x7f9c58103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:07.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.623+0000 7f9c5ed30640 1 --2- 172.21.15.7:0/682078981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c58103b70 0x7f9c58103f80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009ca0 tx=0x7f9c4802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.623+0000 7f9c5ed30640 1 -- 172.21.15.7:0/682078981 shutdown_connections 2024-09-21T06:00:07.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.623+0000 7f9c5ed30640 1 --2- 172.21.15.7:0/682078981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c58109e00 0x7f9c58110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.623+0000 7f9c5ed30640 1 --2- 172.21.15.7:0/682078981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c581094b0 0x7f9c581098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.623+0000 7f9c5ed30640 1 --2- 172.21.15.7:0/682078981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c58103b70 0x7f9c58103f80 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.623+0000 7f9c5ed30640 1 -- 172.21.15.7:0/682078981 >> 172.21.15.7:0/682078981 conn(0x7f9c580ff5e0 msgr2=0x7f9c58101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:07.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.623+0000 7f9c5ed30640 1 -- 172.21.15.7:0/682078981 shutdown_connections 2024-09-21T06:00:07.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.623+0000 7f9c5ed30640 1 -- 172.21.15.7:0/682078981 wait complete. 2024-09-21T06:00:07.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.624+0000 7f9c5ed30640 1 Processor -- start 2024-09-21T06:00:07.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.624+0000 7f9c5ed30640 1 -- start start 2024-09-21T06:00:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.624+0000 7f9c5ed30640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c58103b70 0x7f9c58075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.624+0000 7f9c5ed30640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c581094b0 0x7f9c58075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.624+0000 7f9c5ed30640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c58109e00 0x7f9c58076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.624+0000 7f9c5ed30640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58113ac0 con 0x7f9c58109e00 2024-09-21T06:00:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.624+0000 7f9c5ed30640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58113940 con 0x7f9c581094b0 2024-09-21T06:00:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.624+0000 7f9c5ed30640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58113c40 con 0x7f9c58103b70 2024-09-21T06:00:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.624+0000 7f9c5d2cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c58109e00 0x7f9c58076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.624+0000 7f9c5d2cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c58109e00 0x7f9c58076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59884/0 (socket says 172.21.15.7:59884) 2024-09-21T06:00:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.624+0000 7f9c5d2cd640 1 -- 172.21.15.7:0/1336788035 learned_addr learned my addr 172.21.15.7:0/1336788035 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.624+0000 7f9c57fff640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c581094b0 0x7f9c58075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.624+0000 7f9c5cacc640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c58103b70 0x7f9c58075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.625+0000 7f9c5d2cd640 1 -- 172.21.15.7:0/1336788035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c58103b70 msgr2=0x7f9c58075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:07.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.625+0000 7f9c5d2cd640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c58103b70 0x7f9c58075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.625+0000 7f9c5d2cd640 1 -- 172.21.15.7:0/1336788035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c581094b0 msgr2=0x7f9c58075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:07.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.625+0000 7f9c5d2cd640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c581094b0 0x7f9c58075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.625+0000 7f9c5d2cd640 1 -- 172.21.15.7:0/1336788035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c581a86c0 con 0x7f9c58109e00 2024-09-21T06:00:07.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.625+0000 7f9c5cacc640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c58103b70 0x7f9c58075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:07.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.625+0000 7f9c5d2cd640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c58109e00 0x7f9c58076190 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000e970 tx=0x7f9c5000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:07.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.625+0000 7f9c55ffb640 1 -- 172.21.15.7:0/1336788035 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000ccc0 con 0x7f9c58109e00 2024-09-21T06:00:07.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.625+0000 7f9c55ffb640 1 -- 172.21.15.7:0/1336788035 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c5000ce60 con 0x7f9c58109e00 2024-09-21T06:00:07.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.625+0000 7f9c55ffb640 1 -- 172.21.15.7:0/1336788035 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50010430 con 0x7f9c58109e00 2024-09-21T06:00:07.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.625+0000 7f9c5ed30640 1 -- 172.21.15.7:0/1336788035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c581a89b0 con 0x7f9c58109e00 2024-09-21T06:00:07.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.625+0000 7f9c5ed30640 1 -- 172.21.15.7:0/1336788035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c581a8ea0 con 0x7f9c58109e00 2024-09-21T06:00:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.628+0000 7f9c55ffb640 1 -- 172.21.15.7:0/1336788035 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9c50004f20 con 0x7f9c58109e00 2024-09-21T06:00:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.628+0000 7f9c652a4740 1 Processor -- start 2024-09-21T06:00:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.628+0000 7f9c652a4740 1 -- start start 2024-09-21T06:00:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.628+0000 7f9c652a4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69c6070 0x556ed6d6d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.628+0000 7f9c652a4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed699d1b0 0x556ed6d6d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.628+0000 7f9c652a4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69a5390 0x556ed6d6dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.628+0000 7f9c652a4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556ed6ce3ea0 con 0x556ed69a5390 2024-09-21T06:00:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.628+0000 7f9c652a4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556ed6cd32d0 con 0x556ed699d1b0 2024-09-21T06:00:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.628+0000 7f9c652a4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556ed6cd70e0 con 0x556ed69c6070 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.628+0000 7f9c57fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69a5390 0x556ed6d6dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c57fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69a5390 0x556ed6d6dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59894/0 (socket says 172.21.15.7:59894) 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c57fff640 1 -- 172.21.15.7:0/4282937511 learned_addr learned my addr 172.21.15.7:0/4282937511 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c5cacc640 1 --2- 172.21.15.7:0/4282937511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed699d1b0 0x556ed6d6d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c57fff640 1 --2- 172.21.15.7:0/4282937511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69c6070 0x556ed6d6d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c57fff640 1 -- 172.21.15.7:0/4282937511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69c6070 msgr2=0x556ed6d6d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c57fff640 1 --2- 172.21.15.7:0/4282937511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69c6070 0x556ed6d6d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c57fff640 1 -- 172.21.15.7:0/4282937511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed699d1b0 msgr2=0x556ed6d6d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c57fff640 1 --2- 172.21.15.7:0/4282937511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed699d1b0 0x556ed6d6d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c57fff640 1 -- 172.21.15.7:0/4282937511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ed6a31650 con 0x556ed69a5390 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c55ffb640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9c440b6680 0x7f9c440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c57fff640 1 --2- 172.21.15.7:0/4282937511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69a5390 0x556ed6d6dd40 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f9c40011580 tx=0x7f9c4000a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eda2ceef011a829 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c5cacc640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9c440b6680 0x7f9c440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c55ffb640 1 -- 172.21.15.7:0/1336788035 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9c500e7a90 con 0x7f9c58109e00 2024-09-21T06:00:07.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.629+0000 7f9c4effd640 1 -- 172.21.15.7:0/4282937511 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c40005220 con 0x556ed69a5390 2024-09-21T06:00:07.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.630+0000 7f9c4effd640 1 -- 172.21.15.7:0/4282937511 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c40004c50 con 0x556ed69a5390 2024-09-21T06:00:07.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.630+0000 7f9c4effd640 1 -- 172.21.15.7:0/4282937511 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000fa90 con 0x556ed69a5390 2024-09-21T06:00:07.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.630+0000 7f9c652a4740 1 -- 172.21.15.7:0/4282937511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69a5390 msgr2=0x556ed6d6dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:07.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.630+0000 7f9c5cacc640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9c440b6680 0x7f9c440b8b90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x556ed6d6bf40 tx=0x7f9c48009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:07.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.630+0000 7f9c652a4740 1 --2- 172.21.15.7:0/4282937511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69a5390 0x556ed6d6dd40 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f9c40011580 tx=0x7f9c4000a700 comp rx=0 tx=0).stop 2024-09-21T06:00:07.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.630+0000 7f9c652a4740 1 -- 172.21.15.7:0/4282937511 shutdown_connections 2024-09-21T06:00:07.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.630+0000 7f9c652a4740 1 --2- 172.21.15.7:0/4282937511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69a5390 0x556ed6d6dd40 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.630+0000 7f9c652a4740 1 --2- 172.21.15.7:0/4282937511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed699d1b0 0x556ed6d6d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.630+0000 7f9c652a4740 1 --2- 172.21.15.7:0/4282937511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69c6070 0x556ed6d6d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.631+0000 7f9c652a4740 1 -- 172.21.15.7:0/4282937511 >> 172.21.15.7:0/4282937511 conn(0x556ed69ba460 msgr2=0x556ed6d6b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.631+0000 7f9c652a4740 1 -- 172.21.15.7:0/4282937511 shutdown_connections 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.631+0000 7f9c652a4740 1 -- 172.21.15.7:0/4282937511 wait complete. 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.631+0000 7f9c652a4740 1 -- start start 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.631+0000 7f9c652a4740 1 Processor -- start 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c652a4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 0x556ed6d789d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c652a4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69a5390 0x556ed6d78f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c652a4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69c6070 0x556ed6d84dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c652a4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556ed6b34700 con 0x556ed699d1b0 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c652a4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556ed6c6e160 con 0x556ed69c6070 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c652a4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556ed6d7baa0 con 0x556ed69a5390 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c652a4740 10 client.0 _ll_register_callbacks cb 0x556ed6c879e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c5cacc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 0x556ed6d789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c5cacc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 0x556ed6d789d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59908/0 (socket says 172.21.15.7:59908) 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c5cacc640 1 -- 172.21.15.7:0/3593884117 learned_addr learned my addr 172.21.15.7:0/3593884117 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c57fff640 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69a5390 0x556ed6d78f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c5d2cd640 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69c6070 0x556ed6d84dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c5cacc640 1 -- 172.21.15.7:0/3593884117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69a5390 msgr2=0x556ed6d78f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c5cacc640 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69a5390 0x556ed6d78f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c5cacc640 1 -- 172.21.15.7:0/3593884117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69c6070 msgr2=0x556ed6d84dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c5cacc640 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69c6070 0x556ed6d84dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c5cacc640 1 -- 172.21.15.7:0/3593884117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ed6c9bc90 con 0x556ed699d1b0 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c5d2cd640 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69c6070 0x556ed6d84dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.633+0000 7f9c37fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.632+0000 7f9c5cacc640 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 0x556ed6d789d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9c48035000 tx=0x7f9c4802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180cd83a865ccabb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.633+0000 7f9c37fff640 1 -- 172.21.15.7:0/3593884117 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48003d00 con 0x556ed699d1b0 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.633+0000 7f9c37fff640 1 -- 172.21.15.7:0/3593884117 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9c48004040 con 0x556ed699d1b0 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.633+0000 7f9c652a4740 1 -- 172.21.15.7:0/3593884117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c40004c50 con 0x556ed699d1b0 2024-09-21T06:00:07.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.633+0000 7f9c37fff640 1 -- 172.21.15.7:0/3593884117 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c48004240 con 0x556ed699d1b0 2024-09-21T06:00:07.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.633+0000 7f9c652a4740 10 client.17004 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:07.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.633+0000 7f9c652a4740 1 -- 172.21.15.7:0/3593884117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556ed6d87840 con 0x556ed699d1b0 2024-09-21T06:00:07.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.633+0000 7f9c37fff640 1 -- 172.21.15.7:0/3593884117 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c40004c50 con 0x556ed699d1b0 2024-09-21T06:00:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.634+0000 7f9c37fff640 1 -- 172.21.15.7:0/3593884117 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9c48051070 con 0x556ed699d1b0 2024-09-21T06:00:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.634+0000 7f9c652a4740 10 client.17004 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.634+0000 7f9c652a4740 10 client.17004 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:00:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.634+0000 7f9c652a4740 20 client.17004 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.634+0000 7f9c652a4740 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556ed69849f0 0x556ed6d8ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.634+0000 7f9c652a4740 4 client.17004 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.634+0000 7f9c652a4740 1 -- 172.21.15.7:0/3593884117 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ed6ce5df0 con 0x556ed69849f0 2024-09-21T06:00:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.634+0000 7f9c57fff640 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556ed69849f0 0x556ed6d8ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.635+0000 7f9c57fff640 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556ed69849f0 0x556ed6d8ad10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b4f3d2c49358411a server_cookie=3ebc5ce085fabfb1 in_seq=0 out_seq=0 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.635+0000 7f9c37fff640 10 client.17004 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.635+0000 7f9c37fff640 1 -- 172.21.15.7:0/3593884117 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ed6ce5df0 con 0x556ed69849f0 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.635+0000 7f9c37fff640 10 client.17004 handle_command_reply: tid=0 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.635+0000 7f9c652a4740 1 client.17004 shutdown 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.636+0000 7f9c652a4740 1 -- 172.21.15.7:0/3593884117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 msgr2=0x556ed6d789d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.636+0000 7f9c652a4740 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 0x556ed6d789d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9c48035000 tx=0x7f9c4802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.636+0000 7f9c652a4740 1 -- 172.21.15.7:0/3593884117 shutdown_connections 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.636+0000 7f9c652a4740 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556ed69849f0 0x556ed6d8ad10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.636+0000 7f9c652a4740 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69c6070 0x556ed6d84dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.636+0000 7f9c652a4740 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69a5390 0x556ed6d78f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.636+0000 7f9c37fff640 0 client.17004 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.636+0000 7f9c652a4740 1 --2- 172.21.15.7:0/3593884117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 0x556ed6d789d0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.636+0000 7f9c652a4740 1 -- 172.21.15.7:0/3593884117 >> 172.21.15.7:0/3593884117 conn(0x556ed69ba460 msgr2=0x556ed6d70450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:07.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.636+0000 7f9c652a4740 1 -- 172.21.15.7:0/3593884117 shutdown_connections 2024-09-21T06:00:07.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.636+0000 7f9c652a4740 1 -- 172.21.15.7:0/3593884117 wait complete. 2024-09-21T06:00:07.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.636+0000 7f9c652a4740 20 client.17004 trim_cache size 0 max 16384 2024-09-21T06:00:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.649+0000 7f9c652a4740 1 Processor -- start 2024-09-21T06:00:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.649+0000 7f9c652a4740 1 -- start start 2024-09-21T06:00:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c652a4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed699d1b0 0x556ed6d70ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c652a4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69a5390 0x556ed6d75bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c652a4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69c6070 0x556ed6d76100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c652a4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581b3fd0 con 0x556ed69c6070 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c652a4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581b18a0 con 0x556ed69a5390 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c652a4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581af6f0 con 0x556ed699d1b0 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c5d2cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69c6070 0x556ed6d76100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c5d2cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69c6070 0x556ed6d76100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59924/0 (socket says 172.21.15.7:59924) 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c5d2cd640 1 -- 172.21.15.7:0/1574370808 learned_addr learned my addr 172.21.15.7:0/1574370808 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c57fff640 1 --2- 172.21.15.7:0/1574370808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69a5390 0x556ed6d75bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c5cacc640 1 --2- 172.21.15.7:0/1574370808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed699d1b0 0x556ed6d70ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c5d2cd640 1 -- 172.21.15.7:0/1574370808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed699d1b0 msgr2=0x556ed6d70ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c5d2cd640 1 --2- 172.21.15.7:0/1574370808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed699d1b0 0x556ed6d70ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c5d2cd640 1 -- 172.21.15.7:0/1574370808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69a5390 msgr2=0x556ed6d75bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c5d2cd640 1 --2- 172.21.15.7:0/1574370808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69a5390 0x556ed6d75bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c5d2cd640 1 -- 172.21.15.7:0/1574370808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ed6d79780 con 0x556ed69c6070 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c5d2cd640 1 --2- 172.21.15.7:0/1574370808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69c6070 0x556ed6d76100 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f9c500ad600 tx=0x7f9c500ad070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8b23e9279c632c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:07.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.650+0000 7f9c4e7fc640 1 -- 172.21.15.7:0/1574370808 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c500ad410 con 0x556ed69c6070 2024-09-21T06:00:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.651+0000 7f9c4e7fc640 1 -- 172.21.15.7:0/1574370808 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c500ae000 con 0x556ed69c6070 2024-09-21T06:00:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.651+0000 7f9c4e7fc640 1 -- 172.21.15.7:0/1574370808 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50005210 con 0x556ed69c6070 2024-09-21T06:00:07.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.651+0000 7f9c652a4740 1 -- 172.21.15.7:0/1574370808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69c6070 msgr2=0x556ed6d76100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:07.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.651+0000 7f9c652a4740 1 --2- 172.21.15.7:0/1574370808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69c6070 0x556ed6d76100 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f9c500ad600 tx=0x7f9c500ad070 comp rx=0 tx=0).stop 2024-09-21T06:00:07.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.651+0000 7f9c652a4740 1 -- 172.21.15.7:0/1574370808 shutdown_connections 2024-09-21T06:00:07.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.651+0000 7f9c652a4740 1 --2- 172.21.15.7:0/1574370808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed69c6070 0x556ed6d76100 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.651+0000 7f9c652a4740 1 --2- 172.21.15.7:0/1574370808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69a5390 0x556ed6d75bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.651+0000 7f9c652a4740 1 --2- 172.21.15.7:0/1574370808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed699d1b0 0x556ed6d70ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.651+0000 7f9c652a4740 1 -- 172.21.15.7:0/1574370808 >> 172.21.15.7:0/1574370808 conn(0x556ed69ba460 msgr2=0x556ed6d703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.651+0000 7f9c652a4740 1 -- 172.21.15.7:0/1574370808 shutdown_connections 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.651+0000 7f9c652a4740 1 -- 172.21.15.7:0/1574370808 wait complete. 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.652+0000 7f9c652a4740 1 -- start start 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.652+0000 7f9c652a4740 1 Processor -- start 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.652+0000 7f9c652a4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 0x556ed6d7d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.652+0000 7f9c652a4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69a5390 0x556ed6d7d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.652+0000 7f9c652a4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69c6070 0x556ed6df46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.652+0000 7f9c652a4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581afd60 con 0x556ed699d1b0 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.652+0000 7f9c652a4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581b11d0 con 0x556ed69c6070 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.652+0000 7f9c652a4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581b0430 con 0x556ed69a5390 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.652+0000 7f9c652a4740 10 client.0 _ll_register_callbacks cb 0x7f9c48009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c5cacc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 0x556ed6d7d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c5cacc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 0x556ed6d7d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59940/0 (socket says 172.21.15.7:59940) 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c5cacc640 1 -- 172.21.15.7:0/3678322342 learned_addr learned my addr 172.21.15.7:0/3678322342 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c5d2cd640 1 --2- 172.21.15.7:0/3678322342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69c6070 0x556ed6df46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c57fff640 1 --2- 172.21.15.7:0/3678322342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69a5390 0x556ed6d7d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c5cacc640 1 -- 172.21.15.7:0/3678322342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69a5390 msgr2=0x556ed6d7d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c5cacc640 1 --2- 172.21.15.7:0/3678322342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69a5390 0x556ed6d7d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c5cacc640 1 -- 172.21.15.7:0/3678322342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69c6070 msgr2=0x556ed6df46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c5cacc640 1 --2- 172.21.15.7:0/3678322342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69c6070 0x556ed6df46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c5cacc640 1 -- 172.21.15.7:0/3678322342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ed6df4c10 con 0x556ed699d1b0 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c5cacc640 1 --2- 172.21.15.7:0/3678322342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 0x556ed6d7d0d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009ca0 tx=0x7f9c4802f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8966bef84b6e742b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c37fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c37fff640 1 -- 172.21.15.7:0/3678322342 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48060020 con 0x556ed699d1b0 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c37fff640 1 -- 172.21.15.7:0/3678322342 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8397+0+0 (secure 0 0 0) 0x7f9c480043e0 con 0x556ed699d1b0 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.653+0000 7f9c652a4740 1 -- 172.21.15.7:0/3678322342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c500ae000 con 0x556ed699d1b0 2024-09-21T06:00:07.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.654+0000 7f9c37fff640 1 -- 172.21.15.7:0/3678322342 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c4806b050 con 0x556ed699d1b0 2024-09-21T06:00:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.654+0000 7f9c652a4740 10 client.17010 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.654+0000 7f9c652a4740 1 -- 172.21.15.7:0/3678322342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556ed6df5d30 con 0x556ed699d1b0 2024-09-21T06:00:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.654+0000 7f9c37fff640 1 -- 172.21.15.7:0/3678322342 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c500ae000 con 0x556ed699d1b0 2024-09-21T06:00:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.654+0000 7f9c37fff640 1 -- 172.21.15.7:0/3678322342 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9c48051040 con 0x556ed699d1b0 2024-09-21T06:00:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.654+0000 7f9c652a4740 10 client.17010 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.654+0000 7f9c652a4740 10 client.17010 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:00:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.654+0000 7f9c652a4740 20 client.17010 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.654+0000 7f9c652a4740 1 --2- 172.21.15.7:0/3678322342 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556ed6959da0 0x556ed6df8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.654+0000 7f9c652a4740 4 client.17010 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.654+0000 7f9c652a4740 1 -- 172.21.15.7:0/3678322342 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ed6d74580 con 0x556ed6959da0 2024-09-21T06:00:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.654+0000 7f9c57fff640 1 --2- 172.21.15.7:0/3678322342 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556ed6959da0 0x556ed6df8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:07.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c57fff640 1 --2- 172.21.15.7:0/3678322342 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556ed6959da0 0x556ed6df8570 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b90c7b5860bcbc16 server_cookie=1107df3f738459fa in_seq=0 out_seq=0 2024-09-21T06:00:07.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c37fff640 10 client.17010 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:07.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c37fff640 1 -- 172.21.15.7:0/3678322342 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ed6d74580 con 0x556ed6959da0 2024-09-21T06:00:07.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c37fff640 10 client.17010 handle_command_reply: tid=0 2024-09-21T06:00:07.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c652a4740 1 client.17010 shutdown 2024-09-21T06:00:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c652a4740 1 -- 172.21.15.7:0/3678322342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 msgr2=0x556ed6d7d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c652a4740 1 --2- 172.21.15.7:0/3678322342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 0x556ed6d7d0d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009ca0 tx=0x7f9c4802f890 comp rx=0 tx=0).stop 2024-09-21T06:00:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c652a4740 1 -- 172.21.15.7:0/3678322342 shutdown_connections 2024-09-21T06:00:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c652a4740 1 --2- 172.21.15.7:0/3678322342 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556ed6959da0 0x556ed6df8570 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c652a4740 1 --2- 172.21.15.7:0/3678322342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556ed69c6070 0x556ed6df46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c652a4740 1 --2- 172.21.15.7:0/3678322342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556ed69a5390 0x556ed6d7d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c652a4740 1 --2- 172.21.15.7:0/3678322342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ed699d1b0 0x556ed6d7d0d0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c652a4740 1 -- 172.21.15.7:0/3678322342 >> 172.21.15.7:0/3678322342 conn(0x556ed69ba460 msgr2=0x556ed6d6e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.655+0000 7f9c37fff640 0 client.17010 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.656+0000 7f9c652a4740 1 -- 172.21.15.7:0/3678322342 shutdown_connections 2024-09-21T06:00:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.656+0000 7f9c652a4740 1 -- 172.21.15.7:0/3678322342 wait complete. 2024-09-21T06:00:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.656+0000 7f9c652a4740 20 client.17010 trim_cache size 0 max 16384 2024-09-21T06:00:07.661 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:07.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.656+0000 7f9c5ed30640 1 -- 172.21.15.7:0/1336788035 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9c440b6680 msgr2=0x7f9c440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:07.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.656+0000 7f9c5ed30640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9c440b6680 0x7f9c440b8b90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x556ed6d6bf40 tx=0x7f9c48009360 comp rx=0 tx=0).stop 2024-09-21T06:00:07.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.656+0000 7f9c5ed30640 1 -- 172.21.15.7:0/1336788035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c58109e00 msgr2=0x7f9c58076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.656+0000 7f9c5ed30640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c58109e00 0x7f9c58076190 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000e970 tx=0x7f9c5000ed70 comp rx=0 tx=0).stop 2024-09-21T06:00:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.656+0000 7f9c5ed30640 1 -- 172.21.15.7:0/1336788035 shutdown_connections 2024-09-21T06:00:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.656+0000 7f9c5ed30640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9c440b6680 0x7f9c440b8b90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.656+0000 7f9c5ed30640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c58109e00 0x7f9c58076190 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.656+0000 7f9c5ed30640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c581094b0 0x7f9c58075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.656+0000 7f9c5ed30640 1 --2- 172.21.15.7:0/1336788035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c58103b70 0x7f9c58075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.656+0000 7f9c5ed30640 1 -- 172.21.15.7:0/1336788035 >> 172.21.15.7:0/1336788035 conn(0x7f9c580ff5e0 msgr2=0x7f9c58101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.657+0000 7f9c5ed30640 1 -- 172.21.15.7:0/1336788035 shutdown_connections 2024-09-21T06:00:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:07.657+0000 7f9c5ed30640 1 -- 172.21.15.7:0/1336788035 wait complete. 2024-09-21T06:00:08.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:08 smithi007 ceph-mon[30983]: pgmap v505: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:00:08.364 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:00:08.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:08 smithi119 ceph-mon[34833]: pgmap v505: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:00:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:08.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:08 smithi027 ceph-mon[34364]: pgmap v505: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:00:09.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.113+0000 7f5232b12640 1 -- 172.21.15.7:0/729637365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f522c102b80 msgr2=0x7f522c1080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:09.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.113+0000 7f5232b12640 1 --2- 172.21.15.7:0/729637365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f522c102b80 0x7f522c1080b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f5224009ca0 tx=0x7f522402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.113+0000 7f5232b12640 1 -- 172.21.15.7:0/729637365 shutdown_connections 2024-09-21T06:00:09.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.113+0000 7f5232b12640 1 --2- 172.21.15.7:0/729637365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f522c102b80 0x7f522c1080b0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.113+0000 7f5232b12640 1 --2- 172.21.15.7:0/729637365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f522c102770 0x7f522c107b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.113+0000 7f5232b12640 1 --2- 172.21.15.7:0/729637365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f522c06b2f0 0x7f522c102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.113+0000 7f5232b12640 1 -- 172.21.15.7:0/729637365 >> 172.21.15.7:0/729637365 conn(0x7f522c079e40 msgr2=0x7f522c07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:09.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.113+0000 7f5232b12640 1 -- 172.21.15.7:0/729637365 shutdown_connections 2024-09-21T06:00:09.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.113+0000 7f5232b12640 1 -- 172.21.15.7:0/729637365 wait complete. 2024-09-21T06:00:09.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.114+0000 7f5232b12640 1 Processor -- start 2024-09-21T06:00:09.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.114+0000 7f5232b12640 1 -- start start 2024-09-21T06:00:09.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f5232b12640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f522c06b2f0 0x7f522c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f5232b12640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f522c102770 0x7f522c1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f5232b12640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f522c102b80 0x7f522c19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f5232b12640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f522c112a40 con 0x7f522c102b80 2024-09-21T06:00:09.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f5232b12640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1128c0 con 0x7f522c102770 2024-09-21T06:00:09.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f5232b12640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f522c112bc0 con 0x7f522c06b2f0 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f52308ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f522c06b2f0 0x7f522c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f52310af640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f522c102b80 0x7f522c19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f52310af640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f522c102b80 0x7f522c19eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56642/0 (socket says 172.21.15.7:56642) 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f52310af640 1 -- 172.21.15.7:0/1573521680 learned_addr learned my addr 172.21.15.7:0/1573521680 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f52308ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f522c06b2f0 0x7f522c199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:53326/0 (socket says 172.21.15.7:53326) 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f522bfff640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f522c102770 0x7f522c1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f52310af640 1 -- 172.21.15.7:0/1573521680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f522c06b2f0 msgr2=0x7f522c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f52310af640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f522c06b2f0 0x7f522c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f52310af640 1 -- 172.21.15.7:0/1573521680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f522c102770 msgr2=0x7f522c1998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f52310af640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f522c102770 0x7f522c1998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f52310af640 1 -- 172.21.15.7:0/1573521680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c19f2a0 con 0x7f522c102b80 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f522bfff640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f522c102770 0x7f522c1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.115+0000 7f52310af640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f522c102b80 0x7f522c19eb70 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5224031a20 tx=0x7f5224031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.116+0000 7f5229ffb640 1 -- 172.21.15.7:0/1573521680 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224003d30 con 0x7f522c102b80 2024-09-21T06:00:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.116+0000 7f5229ffb640 1 -- 172.21.15.7:0/1573521680 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52240044f0 con 0x7f522c102b80 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.116+0000 7f5232b12640 1 -- 172.21.15.7:0/1573521680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522c19f530 con 0x7f522c102b80 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.116+0000 7f5229ffb640 1 -- 172.21.15.7:0/1573521680 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522402fd90 con 0x7f522c102b80 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.116+0000 7f5232b12640 1 -- 172.21.15.7:0/1573521680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f522c1a5cf0 con 0x7f522c102b80 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f5229ffb640 1 -- 172.21.15.7:0/1573521680 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f52240305c0 con 0x7f522c102b80 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f5239086740 1 Processor -- start 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f5239086740 1 -- start start 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f5239086740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253c96680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f5239086740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538bb1b0 0x563253c96c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f5239086740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 0x563253c95410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f5239086740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563253c01ea0 con 0x5632538e4070 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f5239086740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x563253bf12d0 con 0x5632538bb1b0 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f5239086740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563253bf50e0 con 0x5632538c3390 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f522bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253c96680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f522bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253c96680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56658/0 (socket says 172.21.15.7:56658) 2024-09-21T06:00:09.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f522bfff640 1 -- 172.21.15.7:0/839360207 learned_addr learned my addr 172.21.15.7:0/839360207 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:09.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f522bfff640 1 --2- 172.21.15.7:0/839360207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 0x563253c95410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f52308ae640 1 --2- 172.21.15.7:0/839360207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538bb1b0 0x563253c96c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.119+0000 7f5229ffb640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f52180b6700 0x7f52180b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.120+0000 7f522bfff640 1 -- 172.21.15.7:0/839360207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 msgr2=0x563253c95410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:09.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.120+0000 7f522bfff640 1 --2- 172.21.15.7:0/839360207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 0x563253c95410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.120+0000 7f52310af640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f52180b6700 0x7f52180b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.120+0000 7f522bfff640 1 -- 172.21.15.7:0/839360207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538bb1b0 msgr2=0x563253c96c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:09.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.120+0000 7f522bfff640 1 --2- 172.21.15.7:0/839360207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538bb1b0 0x563253c96c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.120+0000 7f522bfff640 1 -- 172.21.15.7:0/839360207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56325394f650 con 0x5632538e4070 2024-09-21T06:00:09.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.120+0000 7f52308ae640 1 --2- 172.21.15.7:0/839360207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538bb1b0 0x563253c96c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:09.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.120+0000 7f5229ffb640 1 -- 172.21.15.7:0/1573521680 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7f5224108af0 con 0x7f522c102b80 2024-09-21T06:00:09.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.120+0000 7f522bfff640 1 --2- 172.21.15.7:0/839360207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253c96680 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f5214012820 tx=0x7f521400c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1191ae65a05aad83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:09.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.120+0000 7f5222ffd640 1 -- 172.21.15.7:0/839360207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214012e60 con 0x5632538e4070 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.120+0000 7f5222ffd640 1 -- 172.21.15.7:0/839360207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5214004220 con 0x5632538e4070 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.120+0000 7f5222ffd640 1 -- 172.21.15.7:0/839360207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52140055b0 con 0x5632538e4070 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.121+0000 7f5239086740 1 -- 172.21.15.7:0/839360207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 msgr2=0x563253c96680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.121+0000 7f5239086740 1 --2- 172.21.15.7:0/839360207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253c96680 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f5214012820 tx=0x7f521400c600 comp rx=0 tx=0).stop 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.121+0000 7f52310af640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f52180b6700 0x7f52180b8c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5224106860 tx=0x7f5224040000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.121+0000 7f5239086740 1 -- 172.21.15.7:0/839360207 shutdown_connections 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.121+0000 7f5239086740 1 --2- 172.21.15.7:0/839360207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 0x563253c95410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.121+0000 7f5239086740 1 --2- 172.21.15.7:0/839360207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538bb1b0 0x563253c96c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.121+0000 7f5239086740 1 --2- 172.21.15.7:0/839360207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253c96680 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.121+0000 7f5239086740 1 -- 172.21.15.7:0/839360207 >> 172.21.15.7:0/839360207 conn(0x5632538d8460 msgr2=0x563253c88f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.121+0000 7f5239086740 1 -- 172.21.15.7:0/839360207 shutdown_connections 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.121+0000 7f5239086740 1 -- 172.21.15.7:0/839360207 wait complete. 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.122+0000 7f5239086740 1 -- start start 2024-09-21T06:00:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.122+0000 7f5239086740 1 Processor -- start 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.122+0000 7f5239086740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538bb1b0 0x563253c9bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.122+0000 7f5239086740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538c3390 0x563253c9c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.122+0000 7f5239086740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253ca10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.122+0000 7f5239086740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563253a52700 con 0x5632538e4070 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.122+0000 7f5239086740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x563253b8c160 con 0x5632538c3390 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.122+0000 7f5239086740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563253c95f10 con 0x5632538bb1b0 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.122+0000 7f5239086740 10 client.0 _ll_register_callbacks cb 0x563253ba59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.122+0000 7f522bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253ca10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.122+0000 7f522bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253ca10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56660/0 (socket says 172.21.15.7:56660) 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.122+0000 7f522bfff640 1 -- 172.21.15.7:0/149143328 learned_addr learned my addr 172.21.15.7:0/149143328 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f522bfff640 1 --2- 172.21.15.7:0/149143328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538bb1b0 0x563253c9bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f52308ae640 1 --2- 172.21.15.7:0/149143328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538c3390 0x563253c9c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f522bfff640 1 -- 172.21.15.7:0/149143328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538bb1b0 msgr2=0x563253c9bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f522bfff640 1 --2- 172.21.15.7:0/149143328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538bb1b0 0x563253c9bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f522bfff640 1 -- 172.21.15.7:0/149143328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538c3390 msgr2=0x563253c9c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f522bfff640 1 --2- 172.21.15.7:0/149143328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538c3390 0x563253c9c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f522bfff640 1 -- 172.21.15.7:0/149143328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563253bb9c90 con 0x5632538e4070 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f522bfff640 1 --2- 172.21.15.7:0/149143328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253ca10c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f52140045d0 tx=0x7f5214005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378cfb4d335a092f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f520bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f520bfff640 1 -- 172.21.15.7:0/149143328 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214027040 con 0x5632538e4070 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f5239086740 1 -- 172.21.15.7:0/149143328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5214004220 con 0x5632538e4070 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f520bfff640 1 -- 172.21.15.7:0/149143328 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7f5214010c00 con 0x5632538e4070 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f520bfff640 1 -- 172.21.15.7:0/149143328 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5214035050 con 0x5632538e4070 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f5239086740 10 client.17022 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.123+0000 7f5239086740 1 -- 172.21.15.7:0/149143328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563253ca9f80 con 0x5632538e4070 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.124+0000 7f520bfff640 1 -- 172.21.15.7:0/149143328 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5214004220 con 0x5632538e4070 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.124+0000 7f520bfff640 1 -- 172.21.15.7:0/149143328 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f521401d3f0 con 0x5632538e4070 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.124+0000 7f5239086740 10 client.17022 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.124+0000 7f5239086740 10 client.17022 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:09.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.124+0000 7f5239086740 20 client.17022 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.124+0000 7f5239086740 1 --2- 172.21.15.7:0/149143328 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5632538a29f0 0x563253cad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.124+0000 7f5239086740 4 client.17022 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.124+0000 7f5239086740 1 -- 172.21.15.7:0/149143328 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563253c03df0 con 0x5632538a29f0 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.124+0000 7f52308ae640 1 --2- 172.21.15.7:0/149143328 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5632538a29f0 0x563253cad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.125+0000 7f52308ae640 1 --2- 172.21.15.7:0/149143328 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5632538a29f0 0x563253cad2e0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fa3fe7910a12453 server_cookie=fa820730f348bf4 in_seq=0 out_seq=0 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.125+0000 7f520bfff640 10 client.17022 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.125+0000 7f520bfff640 1 -- 172.21.15.7:0/149143328 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563253c03df0 con 0x5632538a29f0 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.125+0000 7f520bfff640 10 client.17022 handle_command_reply: tid=0 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.126+0000 7f5239086740 1 client.17022 shutdown 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.126+0000 7f5239086740 1 -- 172.21.15.7:0/149143328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 msgr2=0x563253ca10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.126+0000 7f5239086740 1 --2- 172.21.15.7:0/149143328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253ca10c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f52140045d0 tx=0x7f5214005270 comp rx=0 tx=0).stop 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.126+0000 7f5239086740 1 -- 172.21.15.7:0/149143328 shutdown_connections 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.126+0000 7f5239086740 1 --2- 172.21.15.7:0/149143328 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5632538a29f0 0x563253cad2e0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.126+0000 7f5239086740 1 --2- 172.21.15.7:0/149143328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253ca10c0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.126+0000 7f5239086740 1 --2- 172.21.15.7:0/149143328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538c3390 0x563253c9c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.126+0000 7f5239086740 1 --2- 172.21.15.7:0/149143328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538bb1b0 0x563253c9bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.126+0000 7f520bfff640 0 client.17022 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:09.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.126+0000 7f5239086740 1 -- 172.21.15.7:0/149143328 >> 172.21.15.7:0/149143328 conn(0x5632538d8460 msgr2=0x563253c97570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:09.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.126+0000 7f5239086740 1 -- 172.21.15.7:0/149143328 shutdown_connections 2024-09-21T06:00:09.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.126+0000 7f5239086740 1 -- 172.21.15.7:0/149143328 wait complete. 2024-09-21T06:00:09.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.126+0000 7f5239086740 20 client.17022 trim_cache size 0 max 16384 2024-09-21T06:00:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.139+0000 7f5239086740 1 Processor -- start 2024-09-21T06:00:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f5239086740 1 -- start start 2024-09-21T06:00:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f5239086740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538bb1b0 0x563253ca1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f5239086740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 0x563253ca1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f5239086740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253c9cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f5239086740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1afd90 con 0x5632538e4070 2024-09-21T06:00:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f5239086740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1ad660 con 0x5632538bb1b0 2024-09-21T06:00:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f5239086740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1ab4d0 con 0x5632538c3390 2024-09-21T06:00:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f522bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253c9cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f522bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253c9cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56668/0 (socket says 172.21.15.7:56668) 2024-09-21T06:00:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f522bfff640 1 -- 172.21.15.7:0/1923004778 learned_addr learned my addr 172.21.15.7:0/1923004778 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:09.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f52308ae640 1 --2- 172.21.15.7:0/1923004778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 0x563253ca1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f522bfff640 1 --2- 172.21.15.7:0/1923004778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538bb1b0 0x563253ca1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f522bfff640 1 -- 172.21.15.7:0/1923004778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 msgr2=0x563253ca1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f522bfff640 1 --2- 172.21.15.7:0/1923004778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 0x563253ca1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f522bfff640 1 -- 172.21.15.7:0/1923004778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538bb1b0 msgr2=0x563253ca1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f522bfff640 1 --2- 172.21.15.7:0/1923004778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538bb1b0 0x563253ca1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.140+0000 7f522bfff640 1 -- 172.21.15.7:0/1923004778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563253c9c500 con 0x5632538e4070 2024-09-21T06:00:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.141+0000 7f522bfff640 1 --2- 172.21.15.7:0/1923004778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253c9cde0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f521400cf40 tx=0x7f52140052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657899418b4a81c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.141+0000 7f52227fc640 1 -- 172.21.15.7:0/1923004778 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214012550 con 0x5632538e4070 2024-09-21T06:00:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.141+0000 7f52227fc640 1 -- 172.21.15.7:0/1923004778 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52140120e0 con 0x5632538e4070 2024-09-21T06:00:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.141+0000 7f52227fc640 1 -- 172.21.15.7:0/1923004778 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52140048c0 con 0x5632538e4070 2024-09-21T06:00:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.142+0000 7f5239086740 1 -- 172.21.15.7:0/1923004778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 msgr2=0x563253c9cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.142+0000 7f5239086740 1 --2- 172.21.15.7:0/1923004778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253c9cde0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f521400cf40 tx=0x7f52140052e0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.142+0000 7f5239086740 1 -- 172.21.15.7:0/1923004778 shutdown_connections 2024-09-21T06:00:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.142+0000 7f5239086740 1 --2- 172.21.15.7:0/1923004778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538e4070 0x563253c9cde0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.142+0000 7f5239086740 1 --2- 172.21.15.7:0/1923004778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 0x563253ca1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.142+0000 7f5239086740 1 --2- 172.21.15.7:0/1923004778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538bb1b0 0x563253ca1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.142+0000 7f5239086740 1 -- 172.21.15.7:0/1923004778 >> 172.21.15.7:0/1923004778 conn(0x5632538d8460 msgr2=0x563253c94e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.142+0000 7f5239086740 1 -- 172.21.15.7:0/1923004778 shutdown_connections 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.142+0000 7f5239086740 1 -- 172.21.15.7:0/1923004778 wait complete. 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.142+0000 7f5239086740 1 -- start start 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.142+0000 7f5239086740 1 Processor -- start 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f5239086740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538bb1b0 0x563253cb1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f5239086740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 0x563253cb1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f5239086740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538e4070 0x563253cb22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f5239086740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1abb20 con 0x5632538bb1b0 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f5239086740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1acf90 con 0x5632538e4070 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f5239086740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1ac1f0 con 0x5632538c3390 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f5239086740 10 client.0 _ll_register_callbacks cb 0x7f521400cdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f522bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538bb1b0 0x563253cb1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f522bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538bb1b0 0x563253cb1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56676/0 (socket says 172.21.15.7:56676) 2024-09-21T06:00:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f522bfff640 1 -- 172.21.15.7:0/659760935 learned_addr learned my addr 172.21.15.7:0/659760935 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f52308ae640 1 --2- 172.21.15.7:0/659760935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 0x563253cb1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f522bfff640 1 -- 172.21.15.7:0/659760935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 msgr2=0x563253cb1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f522bfff640 1 --2- 172.21.15.7:0/659760935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 0x563253cb1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f522bfff640 1 -- 172.21.15.7:0/659760935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538e4070 msgr2=0x563253cb22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f522bfff640 1 --2- 172.21.15.7:0/659760935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538e4070 0x563253cb22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f522bfff640 1 -- 172.21.15.7:0/659760935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563253cb2830 con 0x5632538bb1b0 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f522bfff640 1 --2- 172.21.15.7:0/659760935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538bb1b0 0x563253cb1870 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f521401dd90 tx=0x7f521401ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568b75bb61905a12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.143+0000 7f520bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f520bfff640 1 -- 172.21.15.7:0/659760935 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214012550 con 0x5632538bb1b0 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f520bfff640 1 -- 172.21.15.7:0/659760935 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7f5214004660 con 0x5632538bb1b0 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f5239086740 1 -- 172.21.15.7:0/659760935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52140120e0 con 0x5632538bb1b0 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f520bfff640 1 -- 172.21.15.7:0/659760935 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f521401d640 con 0x5632538bb1b0 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f5239086740 10 client.17028 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f5239086740 1 -- 172.21.15.7:0/659760935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563253d17c90 con 0x5632538bb1b0 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f520bfff640 1 -- 172.21.15.7:0/659760935 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52140120e0 con 0x5632538bb1b0 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f520bfff640 1 -- 172.21.15.7:0/659760935 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f521402e580 con 0x5632538bb1b0 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f5239086740 10 client.17028 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f5239086740 10 client.17028 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f5239086740 20 client.17028 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f5239086740 1 --2- 172.21.15.7:0/659760935 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563253877da0 0x563253d1a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f5239086740 4 client.17028 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f5239086740 1 -- 172.21.15.7:0/659760935 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563253bff8a0 con 0x563253877da0 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.144+0000 7f52308ae640 1 --2- 172.21.15.7:0/659760935 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563253877da0 0x563253d1a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f520bfff640 10 client.17028 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f52308ae640 1 --2- 172.21.15.7:0/659760935 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563253877da0 0x563253d1a420 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ca9fa4e6439374e server_cookie=c9b62bba870c72ce in_seq=0 out_seq=0 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f520bfff640 1 -- 172.21.15.7:0/659760935 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563253bff8a0 con 0x563253877da0 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f520bfff640 10 client.17028 handle_command_reply: tid=0 2024-09-21T06:00:09.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f5239086740 1 client.17028 shutdown 2024-09-21T06:00:09.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f5239086740 1 -- 172.21.15.7:0/659760935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538bb1b0 msgr2=0x563253cb1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:09.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f5239086740 1 --2- 172.21.15.7:0/659760935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538bb1b0 0x563253cb1870 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f521401dd90 tx=0x7f521401ddc0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f5239086740 1 -- 172.21.15.7:0/659760935 shutdown_connections 2024-09-21T06:00:09.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f5239086740 1 --2- 172.21.15.7:0/659760935 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563253877da0 0x563253d1a420 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f5239086740 1 --2- 172.21.15.7:0/659760935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5632538e4070 0x563253cb22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f5239086740 1 --2- 172.21.15.7:0/659760935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5632538c3390 0x563253cb1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f5239086740 1 --2- 172.21.15.7:0/659760935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632538bb1b0 0x563253cb1870 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f520bfff640 0 client.17028 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:09.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.145+0000 7f5239086740 1 -- 172.21.15.7:0/659760935 >> 172.21.15.7:0/659760935 conn(0x5632538d8460 msgr2=0x563253c9eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:09.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5239086740 1 -- 172.21.15.7:0/659760935 shutdown_connections 2024-09-21T06:00:09.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5239086740 1 -- 172.21.15.7:0/659760935 wait complete. 2024-09-21T06:00:09.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5239086740 20 client.17028 trim_cache size 0 max 16384 2024-09-21T06:00:09.155 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5232b12640 1 -- 172.21.15.7:0/1573521680 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f52180b6700 msgr2=0x7f52180b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5232b12640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f52180b6700 0x7f52180b8c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5224106860 tx=0x7f5224040000 comp rx=0 tx=0).stop 2024-09-21T06:00:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5232b12640 1 -- 172.21.15.7:0/1573521680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f522c102b80 msgr2=0x7f522c19eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5232b12640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f522c102b80 0x7f522c19eb70 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5224031a20 tx=0x7f5224031a50 comp rx=0 tx=0).stop 2024-09-21T06:00:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5232b12640 1 -- 172.21.15.7:0/1573521680 shutdown_connections 2024-09-21T06:00:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5232b12640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f52180b6700 0x7f52180b8c10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5232b12640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f522c102b80 0x7f522c19eb70 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5232b12640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f522c102770 0x7f522c1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5232b12640 1 --2- 172.21.15.7:0/1573521680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f522c06b2f0 0x7f522c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:09.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5232b12640 1 -- 172.21.15.7:0/1573521680 >> 172.21.15.7:0/1573521680 conn(0x7f522c079e40 msgr2=0x7f522c100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:09.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5232b12640 1 -- 172.21.15.7:0/1573521680 shutdown_connections 2024-09-21T06:00:09.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:09.146+0000 7f5232b12640 1 -- 172.21.15.7:0/1573521680 wait complete. 2024-09-21T06:00:09.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:09 smithi007 ceph-mon[30983]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:00:09.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:09 smithi119 ceph-mon[34833]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:00:09.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:09 smithi027 ceph-mon[34364]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:00:10.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:10 smithi007 ceph-mon[30983]: pgmap v507: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:00:10.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:10 smithi119 ceph-mon[34833]: pgmap v507: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:00:10.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:10 smithi027 ceph-mon[34364]: pgmap v507: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:00:10.830 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:00:10.830 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:00:11.099 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:11.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.581+0000 7f1dbc0b2640 1 -- 172.21.15.7:0/1714306897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db4102a70 msgr2=0x7f1db4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:11.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.581+0000 7f1dbc0b2640 1 --2- 172.21.15.7:0/1714306897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db4102a70 0x7f1db4102e80 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009900 tx=0x7f1db002a410 comp rx=0 tx=0).stop 2024-09-21T06:00:11.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.581+0000 7f1dbc0b2640 1 -- 172.21.15.7:0/1714306897 shutdown_connections 2024-09-21T06:00:11.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.581+0000 7f1dbc0b2640 1 --2- 172.21.15.7:0/1714306897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1db4108d00 0x7f1db410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.581+0000 7f1dbc0b2640 1 --2- 172.21.15.7:0/1714306897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db41083b0 0x7f1db41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.581+0000 7f1dbc0b2640 1 --2- 172.21.15.7:0/1714306897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db4102a70 0x7f1db4102e80 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.581+0000 7f1dbc0b2640 1 -- 172.21.15.7:0/1714306897 >> 172.21.15.7:0/1714306897 conn(0x7f1db4079790 msgr2=0x7f1db4079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:11.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.581+0000 7f1dbc0b2640 1 -- 172.21.15.7:0/1714306897 shutdown_connections 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.581+0000 7f1dbc0b2640 1 -- 172.21.15.7:0/1714306897 wait complete. 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1dbc0b2640 1 Processor -- start 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1dbc0b2640 1 -- start start 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1dbc0b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db4102a70 0x7f1db40ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1dbc0b2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1db41083b0 0x7f1db40ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1dbc0b2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db4108d00 0x7f1db4100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1dbc0b2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1db41129c0 con 0x7f1db4102a70 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1dbc0b2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1db4112840 con 0x7f1db4108d00 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1dbc0b2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1db4112b40 con 0x7f1db41083b0 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1db9e4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db4102a70 0x7f1db40ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1db9e4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db4102a70 0x7f1db40ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56690/0 (socket says 172.21.15.7:56690) 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1db9e4e640 1 -- 172.21.15.7:0/3587109729 learned_addr learned my addr 172.21.15.7:0/3587109729 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1db964d640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1db41083b0 0x7f1db40ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1dba64f640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db4108d00 0x7f1db4100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1db9e4e640 1 -- 172.21.15.7:0/3587109729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1db41083b0 msgr2=0x7f1db40ffb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:11.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1db41083b0 0x7f1db40ffb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1db9e4e640 1 -- 172.21.15.7:0/3587109729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db4108d00 msgr2=0x7f1db4100070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:11.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db4108d00 0x7f1db4100070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1db9e4e640 1 -- 172.21.15.7:0/3587109729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db41a8760 con 0x7f1db4102a70 2024-09-21T06:00:11.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.582+0000 7f1dba64f640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db4108d00 0x7f1db4100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:11.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.583+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db4102a70 0x7f1db40ff5f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f1db0005940 tx=0x7f1db00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:11.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.583+0000 7f1daaffd640 1 -- 172.21.15.7:0/3587109729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db003f030 con 0x7f1db4102a70 2024-09-21T06:00:11.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.583+0000 7f1daaffd640 1 -- 172.21.15.7:0/3587109729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1db0003cb0 con 0x7f1db4102a70 2024-09-21T06:00:11.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.583+0000 7f1dbc0b2640 1 -- 172.21.15.7:0/3587109729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1db41a89f0 con 0x7f1db4102a70 2024-09-21T06:00:11.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.583+0000 7f1daaffd640 1 -- 172.21.15.7:0/3587109729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0035070 con 0x7f1db4102a70 2024-09-21T06:00:11.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.583+0000 7f1dbc0b2640 1 -- 172.21.15.7:0/3587109729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1db41a8f20 con 0x7f1db4102a70 2024-09-21T06:00:11.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.585+0000 7f1dc2626740 1 Processor -- start 2024-09-21T06:00:11.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1dc2626740 1 -- start start 2024-09-21T06:00:11.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1daaffd640 1 -- 172.21.15.7:0/3587109729 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f1db0042030 con 0x7f1db4102a70 2024-09-21T06:00:11.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1dc2626740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4bb5350 0x562ae4f5c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1dc2626740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4b8c490 0x562ae4f5c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1dc2626740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b94670 0x562ae4f5ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1dc2626740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562ae4ed2e60 con 0x562ae4b8c490 2024-09-21T06:00:11.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1dc2626740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562ae4ec2290 con 0x562ae4bb5350 2024-09-21T06:00:11.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1dc2626740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562ae4ec60a0 con 0x562ae4b94670 2024-09-21T06:00:11.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1db9e4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4b8c490 0x562ae4f5c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1db9e4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4b8c490 0x562ae4f5c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56694/0 (socket says 172.21.15.7:56694) 2024-09-21T06:00:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1db9e4e640 1 -- 172.21.15.7:0/954168484 learned_addr learned my addr 172.21.15.7:0/954168484 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1dba64f640 1 --2- 172.21.15.7:0/954168484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4bb5350 0x562ae4f5c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1db964d640 1 --2- 172.21.15.7:0/954168484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b94670 0x562ae4f5ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1db9e4e640 1 -- 172.21.15.7:0/954168484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b94670 msgr2=0x562ae4f5ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/954168484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b94670 0x562ae4f5ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1db9e4e640 1 -- 172.21.15.7:0/954168484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4bb5350 msgr2=0x562ae4f5c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.586+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/954168484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4bb5350 0x562ae4f5c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.587+0000 7f1db9e4e640 1 -- 172.21.15.7:0/954168484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ae4c20930 con 0x562ae4b8c490 2024-09-21T06:00:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.587+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/954168484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4b8c490 0x562ae4f5c970 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f1db01052c0 tx=0x7f1db010beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7765cf3e9c7ca648 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.587+0000 7f1daaffd640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1da00b6700 0x7f1da00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.587+0000 7f1d9ffff640 1 -- 172.21.15.7:0/954168484 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db00ca0a0 con 0x562ae4b8c490 2024-09-21T06:00:11.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.587+0000 7f1d9ffff640 1 -- 172.21.15.7:0/954168484 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1db00ce150 con 0x562ae4b8c490 2024-09-21T06:00:11.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.587+0000 7f1d9ffff640 1 -- 172.21.15.7:0/954168484 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db00cd3a0 con 0x562ae4b8c490 2024-09-21T06:00:11.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.587+0000 7f1dba64f640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1da00b6700 0x7f1da00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.587+0000 7f1daaffd640 1 -- 172.21.15.7:0/3587109729 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7f1db0107be0 con 0x7f1db4102a70 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.588+0000 7f1dc2626740 1 -- 172.21.15.7:0/954168484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4b8c490 msgr2=0x562ae4f5c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.588+0000 7f1dba64f640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1da00b6700 0x7f1da00b8c10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1dac005fd0 tx=0x7f1dac009700 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.588+0000 7f1dc2626740 1 --2- 172.21.15.7:0/954168484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4b8c490 0x562ae4f5c970 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f1db01052c0 tx=0x7f1db010beb0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.588+0000 7f1dc2626740 1 -- 172.21.15.7:0/954168484 shutdown_connections 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.588+0000 7f1dc2626740 1 --2- 172.21.15.7:0/954168484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4b8c490 0x562ae4f5c970 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.588+0000 7f1dc2626740 1 --2- 172.21.15.7:0/954168484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b94670 0x562ae4f5ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.588+0000 7f1dc2626740 1 --2- 172.21.15.7:0/954168484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4bb5350 0x562ae4f5c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.588+0000 7f1dc2626740 1 -- 172.21.15.7:0/954168484 >> 172.21.15.7:0/954168484 conn(0x562ae4ba9740 msgr2=0x562ae4f5a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.588+0000 7f1dc2626740 1 -- 172.21.15.7:0/954168484 shutdown_connections 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.588+0000 7f1dc2626740 1 -- 172.21.15.7:0/954168484 wait complete. 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.589+0000 7f1dc2626740 1 -- start start 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.589+0000 7f1dc2626740 1 Processor -- start 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.589+0000 7f1dc2626740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f67ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.589+0000 7f1dc2626740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f68530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.589+0000 7f1dc2626740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f73c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.589+0000 7f1dc2626740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562ae4d23890 con 0x562ae4bb5350 2024-09-21T06:00:11.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.589+0000 7f1dc2626740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562ae4e5cd40 con 0x562ae4b94670 2024-09-21T06:00:11.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.589+0000 7f1dc2626740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562ae4f6a9d0 con 0x562ae4b8c490 2024-09-21T06:00:11.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.589+0000 7f1dc2626740 10 client.0 _ll_register_callbacks cb 0x562ae4ec0c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:11.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.589+0000 7f1dba64f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f73c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.589+0000 7f1db964d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f68530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.589+0000 7f1db964d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f68530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:41060/0 (socket says 172.21.15.7:41060) 2024-09-21T06:00:11.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.589+0000 7f1dba64f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f73c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56704/0 (socket says 172.21.15.7:56704) 2024-09-21T06:00:11.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.590+0000 7f1db964d640 1 -- 172.21.15.7:0/4253560618 learned_addr learned my addr 172.21.15.7:0/4253560618 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:11.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.590+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f67ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.590+0000 7f1db964d640 1 -- 172.21.15.7:0/4253560618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 msgr2=0x562ae4f67ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.590+0000 7f1db964d640 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f67ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.590+0000 7f1db964d640 1 -- 172.21.15.7:0/4253560618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 msgr2=0x562ae4f73c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.590+0000 7f1db964d640 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f73c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.590+0000 7f1db964d640 1 -- 172.21.15.7:0/4253560618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ae4f741a0 con 0x562ae4b94670 2024-09-21T06:00:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.590+0000 7f1dba64f640 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f73c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.590+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f67ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.590+0000 7f1db964d640 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f68530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1da4010720 tx=0x7f1da4010be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37eb2fe7037fca6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.590+0000 7f1d9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T06:00:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.590+0000 7f1d9d7fa640 1 -- 172.21.15.7:0/4253560618 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da400cab0 con 0x562ae4b94670 2024-09-21T06:00:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.591+0000 7f1d9d7fa640 1 -- 172.21.15.7:0/4253560618 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7f1da400cc50 con 0x562ae4b94670 2024-09-21T06:00:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.591+0000 7f1dc2626740 1 -- 172.21.15.7:0/4253560618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1db00ce150 con 0x562ae4b94670 2024-09-21T06:00:11.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.591+0000 7f1d9d7fa640 1 -- 172.21.15.7:0/4253560618 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1da400ce50 con 0x562ae4b94670 2024-09-21T06:00:11.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.591+0000 7f1dc2626740 10 client.26528 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:11.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.591+0000 7f1dc2626740 1 -- 172.21.15.7:0/4253560618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ae4f76b30 con 0x562ae4b94670 2024-09-21T06:00:11.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.591+0000 7f1d9d7fa640 1 -- 172.21.15.7:0/4253560618 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1db00ce150 con 0x562ae4b94670 2024-09-21T06:00:11.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.591+0000 7f1d9d7fa640 1 -- 172.21.15.7:0/4253560618 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1da4022020 con 0x562ae4b94670 2024-09-21T06:00:11.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.591+0000 7f1dc2626740 10 client.26528 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:11.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.591+0000 7f1dc2626740 10 client.26528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:11.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.591+0000 7f1dc2626740 20 client.26528 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:11.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.591+0000 7f1dc2626740 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ae4b73cd0 0x562ae4f7a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.591+0000 7f1dc2626740 4 client.26528 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:11.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.591+0000 7f1dc2626740 1 -- 172.21.15.7:0/4253560618 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ae4ed4db0 con 0x562ae4b73cd0 2024-09-21T06:00:11.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.592+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ae4b73cd0 0x562ae4f7a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.592+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ae4b73cd0 0x562ae4f7a040 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bb1eef56eb807b5 server_cookie=4f1e52f6e339b827 in_seq=0 out_seq=0 2024-09-21T06:00:11.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.592+0000 7f1d9d7fa640 10 client.26528 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1d9d7fa640 1 -- 172.21.15.7:0/4253560618 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ae4ed4db0 con 0x562ae4b73cd0 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1d9d7fa640 10 client.26528 handle_command_reply: tid=0 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1dc2626740 1 client.26528 shutdown 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1dc2626740 1 -- 172.21.15.7:0/4253560618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 msgr2=0x562ae4f68530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1dc2626740 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f68530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1da4010720 tx=0x7f1da4010be0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1dc2626740 1 -- 172.21.15.7:0/4253560618 shutdown_connections 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1dc2626740 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ae4b73cd0 0x562ae4f7a040 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1dc2626740 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f73c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1dc2626740 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f68530 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1dc2626740 1 --2- 172.21.15.7:0/4253560618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f67ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1d9d7fa640 0 client.26528 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1dc2626740 1 -- 172.21.15.7:0/4253560618 >> 172.21.15.7:0/4253560618 conn(0x562ae4ba9740 msgr2=0x562ae4f5f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1dc2626740 1 -- 172.21.15.7:0/4253560618 shutdown_connections 2024-09-21T06:00:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.593+0000 7f1dc2626740 1 -- 172.21.15.7:0/4253560618 wait complete. 2024-09-21T06:00:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.594+0000 7f1dc2626740 20 client.26528 trim_cache size 0 max 16384 2024-09-21T06:00:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.613+0000 7f1dc2626740 1 Processor -- start 2024-09-21T06:00:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.613+0000 7f1dc2626740 1 -- start start 2024-09-21T06:00:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.613+0000 7f1dc2626740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f73b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.613+0000 7f1dc2626740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f67680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.613+0000 7f1dc2626740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f5db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.613+0000 7f1dc2626740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1db41b4170 con 0x562ae4bb5350 2024-09-21T06:00:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.613+0000 7f1dc2626740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1db41b1a40 con 0x562ae4b94670 2024-09-21T06:00:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.613+0000 7f1dc2626740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1db41af8b0 con 0x562ae4b8c490 2024-09-21T06:00:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.613+0000 7f1dba64f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f5db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.613+0000 7f1dba64f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f5db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56712/0 (socket says 172.21.15.7:56712) 2024-09-21T06:00:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.613+0000 7f1dba64f640 1 -- 172.21.15.7:0/4092920907 learned_addr learned my addr 172.21.15.7:0/4092920907 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.613+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/4092920907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f73b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.613+0000 7f1db964d640 1 --2- 172.21.15.7:0/4092920907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f67680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.614+0000 7f1dba64f640 1 -- 172.21.15.7:0/4092920907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 msgr2=0x562ae4f73b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.614+0000 7f1dba64f640 1 --2- 172.21.15.7:0/4092920907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f73b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.614+0000 7f1dba64f640 1 -- 172.21.15.7:0/4092920907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 msgr2=0x562ae4f67680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.614+0000 7f1dba64f640 1 --2- 172.21.15.7:0/4092920907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f67680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.614+0000 7f1dba64f640 1 -- 172.21.15.7:0/4092920907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ae4f5ac10 con 0x562ae4bb5350 2024-09-21T06:00:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.614+0000 7f1dba64f640 1 --2- 172.21.15.7:0/4092920907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f5db70 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0106d0 tx=0x7f1dac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc31ca43e0f87b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.614+0000 7f1d9f7fe640 1 -- 172.21.15.7:0/4092920907 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac02c070 con 0x562ae4bb5350 2024-09-21T06:00:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.614+0000 7f1d9f7fe640 1 -- 172.21.15.7:0/4092920907 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dac010e40 con 0x562ae4bb5350 2024-09-21T06:00:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.614+0000 7f1d9f7fe640 1 -- 172.21.15.7:0/4092920907 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac01e650 con 0x562ae4bb5350 2024-09-21T06:00:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.615+0000 7f1dc2626740 1 -- 172.21.15.7:0/4092920907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 msgr2=0x562ae4f5db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.615+0000 7f1dc2626740 1 --2- 172.21.15.7:0/4092920907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f5db70 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0106d0 tx=0x7f1dac015000 comp rx=0 tx=0).stop 2024-09-21T06:00:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.615+0000 7f1dc2626740 1 -- 172.21.15.7:0/4092920907 shutdown_connections 2024-09-21T06:00:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.615+0000 7f1dc2626740 1 --2- 172.21.15.7:0/4092920907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f5db70 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.615+0000 7f1dc2626740 1 --2- 172.21.15.7:0/4092920907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f67680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.615+0000 7f1dc2626740 1 --2- 172.21.15.7:0/4092920907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f73b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.615+0000 7f1dc2626740 1 -- 172.21.15.7:0/4092920907 >> 172.21.15.7:0/4092920907 conn(0x562ae4ba9740 msgr2=0x562ae4f5d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.615+0000 7f1dc2626740 1 -- 172.21.15.7:0/4092920907 shutdown_connections 2024-09-21T06:00:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.615+0000 7f1dc2626740 1 -- 172.21.15.7:0/4092920907 wait complete. 2024-09-21T06:00:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.615+0000 7f1dc2626740 1 -- start start 2024-09-21T06:00:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.615+0000 7f1dc2626740 1 Processor -- start 2024-09-21T06:00:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dc2626740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f6bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dc2626740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f6c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dc2626740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f6c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dc2626740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1db41aff00 con 0x562ae4bb5350 2024-09-21T06:00:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dc2626740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1db41b1370 con 0x562ae4b94670 2024-09-21T06:00:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dc2626740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1db41b05d0 con 0x562ae4b8c490 2024-09-21T06:00:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dc2626740 10 client.0 _ll_register_callbacks cb 0x7f1da400e350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dba64f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f6c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dba64f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f6c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56714/0 (socket says 172.21.15.7:56714) 2024-09-21T06:00:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dba64f640 1 -- 172.21.15.7:0/1353132333 learned_addr learned my addr 172.21.15.7:0/1353132333 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1db964d640 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f6c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f6bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dba64f640 1 -- 172.21.15.7:0/1353132333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 msgr2=0x562ae4f6bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dba64f640 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f6bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dba64f640 1 -- 172.21.15.7:0/1353132333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 msgr2=0x562ae4f6c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dba64f640 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f6c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1dba64f640 1 -- 172.21.15.7:0/1353132333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ae4fe39e0 con 0x562ae4bb5350 2024-09-21T06:00:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.616+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f6bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.617+0000 7f1dba64f640 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f6c620 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1dac011010 tx=0x7f1dac027640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4e7a90cd6b74d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.617+0000 7f1d9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.617+0000 7f1d9d7fa640 1 -- 172.21.15.7:0/1353132333 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac037060 con 0x562ae4bb5350 2024-09-21T06:00:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.617+0000 7f1d9d7fa640 1 -- 172.21.15.7:0/1353132333 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7f1dac027a40 con 0x562ae4bb5350 2024-09-21T06:00:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.617+0000 7f1dc2626740 1 -- 172.21.15.7:0/1353132333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dac010e40 con 0x562ae4bb5350 2024-09-21T06:00:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.617+0000 7f1d9d7fa640 1 -- 172.21.15.7:0/1353132333 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1dac02c070 con 0x562ae4bb5350 2024-09-21T06:00:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.617+0000 7f1dc2626740 10 client.17046 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.617+0000 7f1dc2626740 1 -- 172.21.15.7:0/1353132333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ae4fe4ca0 con 0x562ae4bb5350 2024-09-21T06:00:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.617+0000 7f1d9d7fa640 1 -- 172.21.15.7:0/1353132333 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dac010e40 con 0x562ae4bb5350 2024-09-21T06:00:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.617+0000 7f1d9d7fa640 1 -- 172.21.15.7:0/1353132333 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1dac032460 con 0x562ae4bb5350 2024-09-21T06:00:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.618+0000 7f1dc2626740 10 client.17046 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.618+0000 7f1dc2626740 10 client.17046 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.618+0000 7f1dc2626740 20 client.17046 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.618+0000 7f1dc2626740 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ae4b49080 0x562ae4fe73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.618+0000 7f1dc2626740 4 client.17046 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:00:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.618+0000 7f1dc2626740 1 -- 172.21.15.7:0/1353132333 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562ae4ed0860 con 0x562ae4b49080 2024-09-21T06:00:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.618+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ae4b49080 0x562ae4fe73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.618+0000 7f1db9e4e640 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ae4b49080 0x562ae4fe73b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24e16e5984a25b80 server_cookie=5c3ae77acd7c3fc2 in_seq=0 out_seq=0 2024-09-21T06:00:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.618+0000 7f1d9d7fa640 10 client.17046 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1d9d7fa640 1 -- 172.21.15.7:0/1353132333 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562ae4ed0860 con 0x562ae4b49080 2024-09-21T06:00:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1d9d7fa640 10 client.17046 handle_command_reply: tid=0 2024-09-21T06:00:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1dc2626740 1 client.17046 shutdown 2024-09-21T06:00:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1dc2626740 1 -- 172.21.15.7:0/1353132333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 msgr2=0x562ae4f6c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1dc2626740 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f6c620 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1dac011010 tx=0x7f1dac027640 comp rx=0 tx=0).stop 2024-09-21T06:00:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1dc2626740 1 -- 172.21.15.7:0/1353132333 shutdown_connections 2024-09-21T06:00:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1dc2626740 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x562ae4b49080 0x562ae4fe73b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1dc2626740 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ae4bb5350 0x562ae4f6c620 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1dc2626740 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ae4b94670 0x562ae4f6c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1d9d7fa640 0 client.17046 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:11.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1dc2626740 1 --2- 172.21.15.7:0/1353132333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ae4b8c490 0x562ae4f6bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1dc2626740 1 -- 172.21.15.7:0/1353132333 >> 172.21.15.7:0/1353132333 conn(0x562ae4ba9740 msgr2=0x562ae4f5f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:11.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1dc2626740 1 -- 172.21.15.7:0/1353132333 shutdown_connections 2024-09-21T06:00:11.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.620+0000 7f1dc2626740 1 -- 172.21.15.7:0/1353132333 wait complete. 2024-09-21T06:00:11.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.621+0000 7f1dc2626740 20 client.17046 trim_cache size 0 max 16384 2024-09-21T06:00:11.627 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:00:11.627 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:00:11.627 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "9ca9a0b5-d25e-483b-95ac-20cce2a306c9", 2024-09-21T06:00:11.627 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:00:11.628 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:00:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.621+0000 7f1dbc0b2640 1 -- 172.21.15.7:0/3587109729 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1da00b6700 msgr2=0x7f1da00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.621+0000 7f1dbc0b2640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1da00b6700 0x7f1da00b8c10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1dac005fd0 tx=0x7f1dac009700 comp rx=0 tx=0).stop 2024-09-21T06:00:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.621+0000 7f1dbc0b2640 1 -- 172.21.15.7:0/3587109729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db4102a70 msgr2=0x7f1db40ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.621+0000 7f1dbc0b2640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db4102a70 0x7f1db40ff5f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f1db0005940 tx=0x7f1db00042f0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.621+0000 7f1dbc0b2640 1 -- 172.21.15.7:0/3587109729 shutdown_connections 2024-09-21T06:00:11.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.621+0000 7f1dbc0b2640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f1da00b6700 0x7f1da00b8c10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.621+0000 7f1dbc0b2640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1db4108d00 0x7f1db4100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.621+0000 7f1dbc0b2640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1db41083b0 0x7f1db40ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.621+0000 7f1dbc0b2640 1 --2- 172.21.15.7:0/3587109729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db4102a70 0x7f1db40ff5f0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:11.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.621+0000 7f1dbc0b2640 1 -- 172.21.15.7:0/3587109729 >> 172.21.15.7:0/3587109729 conn(0x7f1db4079790 msgr2=0x7f1db406bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:11.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.621+0000 7f1dbc0b2640 1 -- 172.21.15.7:0/3587109729 shutdown_connections 2024-09-21T06:00:11.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:11.621+0000 7f1dbc0b2640 1 -- 172.21.15.7:0/3587109729 wait complete. 2024-09-21T06:00:12.220 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:00:12.480 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:12.528 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:12 smithi027 ceph-mon[34364]: pgmap v508: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:00:12.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:12 smithi007 ceph-mon[30983]: pgmap v508: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:00:12.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:12 smithi119 ceph-mon[34833]: pgmap v508: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:00:12.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.971+0000 7f82ec9a5640 1 -- 172.21.15.7:0/911730566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82e8108cf0 msgr2=0x7f82e810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:12.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.971+0000 7f82ec9a5640 1 --2- 172.21.15.7:0/911730566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82e8108cf0 0x7f82e810f520 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009ca0 tx=0x7f82e002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.971+0000 7f82ec9a5640 1 -- 172.21.15.7:0/911730566 shutdown_connections 2024-09-21T06:00:12.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.971+0000 7f82ec9a5640 1 --2- 172.21.15.7:0/911730566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82e8108cf0 0x7f82e810f520 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.971+0000 7f82ec9a5640 1 --2- 172.21.15.7:0/911730566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82e81083a0 0x7f82e81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.971+0000 7f82ec9a5640 1 --2- 172.21.15.7:0/911730566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82e8102a60 0x7f82e8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.971+0000 7f82ec9a5640 1 -- 172.21.15.7:0/911730566 >> 172.21.15.7:0/911730566 conn(0x7f82e8079730 msgr2=0x7f82e8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:12.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.971+0000 7f82ec9a5640 1 -- 172.21.15.7:0/911730566 shutdown_connections 2024-09-21T06:00:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.971+0000 7f82ec9a5640 1 -- 172.21.15.7:0/911730566 wait complete. 2024-09-21T06:00:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.972+0000 7f82ec9a5640 1 Processor -- start 2024-09-21T06:00:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.972+0000 7f82ec9a5640 1 -- start start 2024-09-21T06:00:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82ec9a5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82e8102a60 0x7f82e819b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82ec9a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82e81083a0 0x7f82e819b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82ec9a5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82e8108cf0 0x7f82e819bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82ec9a5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81129b0 con 0x7f82e81083a0 2024-09-21T06:00:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82ec9a5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f82e8112830 con 0x7f82e8108cf0 2024-09-21T06:00:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82ec9a5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f82e8112b30 con 0x7f82e8102a60 2024-09-21T06:00:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82e5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82e81083a0 0x7f82e819b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82e5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82e81083a0 0x7f82e819b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56738/0 (socket says 172.21.15.7:56738) 2024-09-21T06:00:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82e5d9b640 1 -- 172.21.15.7:0/2742427056 learned_addr learned my addr 172.21.15.7:0/2742427056 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82e659c640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82e8102a60 0x7f82e819b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82e6d9d640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82e8108cf0 0x7f82e819bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82e5d9b640 1 -- 172.21.15.7:0/2742427056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82e8102a60 msgr2=0x7f82e819b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82e5d9b640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82e8102a60 0x7f82e819b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82e5d9b640 1 -- 172.21.15.7:0/2742427056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82e8108cf0 msgr2=0x7f82e819bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82e5d9b640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82e8108cf0 0x7f82e819bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82e5d9b640 1 -- 172.21.15.7:0/2742427056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e81a6500 con 0x7f82e81083a0 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82e6d9d640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82e8108cf0 0x7f82e819bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.973+0000 7f82e5d9b640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82e81083a0 0x7f82e819b840 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00d770 tx=0x7f82dc00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.974+0000 7f82d77fe640 1 -- 172.21.15.7:0/2742427056 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc017070 con 0x7f82e81083a0 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.974+0000 7f82d77fe640 1 -- 172.21.15.7:0/2742427056 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82dc010460 con 0x7f82e81083a0 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.974+0000 7f82ec9a5640 1 -- 172.21.15.7:0/2742427056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e81a67f0 con 0x7f82e81083a0 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.974+0000 7f82d77fe640 1 -- 172.21.15.7:0/2742427056 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc00f620 con 0x7f82e81083a0 2024-09-21T06:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.974+0000 7f82ec9a5640 1 -- 172.21.15.7:0/2742427056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e81a6d30 con 0x7f82e81083a0 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.977+0000 7f82f2f19740 1 Processor -- start 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.977+0000 7f82d77fe640 1 -- 172.21.15.7:0/2742427056 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f82dc01a070 con 0x7f82e81083a0 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.978+0000 7f82f2f19740 1 -- start start 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.978+0000 7f82f2f19740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 0x557fd4bd1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.978+0000 7f82f2f19740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 0x557fd4bd1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.978+0000 7f82f2f19740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4bd24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.978+0000 7f82f2f19740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557fd4b43e50 con 0x557fd4826070 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.978+0000 7f82f2f19740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x557fd4b33280 con 0x557fd4805390 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.978+0000 7f82f2f19740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557fd4b37090 con 0x557fd47fd1b0 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.978+0000 7f82e6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 0x557fd4bd1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.978+0000 7f82e6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 0x557fd4bd1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56752/0 (socket says 172.21.15.7:56752) 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.978+0000 7f82e6d9d640 1 -- 172.21.15.7:0/3010303512 learned_addr learned my addr 172.21.15.7:0/3010303512 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.978+0000 7f82e5d9b640 1 --2- 172.21.15.7:0/3010303512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4bd24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.978+0000 7f82e659c640 1 --2- 172.21.15.7:0/3010303512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 0x557fd4bd1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.979+0000 7f82e6d9d640 1 -- 172.21.15.7:0/3010303512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 msgr2=0x557fd4bd1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.979+0000 7f82e6d9d640 1 --2- 172.21.15.7:0/3010303512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 0x557fd4bd1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.979+0000 7f82e6d9d640 1 -- 172.21.15.7:0/3010303512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 msgr2=0x557fd4bd24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.979+0000 7f82e6d9d640 1 --2- 172.21.15.7:0/3010303512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4bd24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.979+0000 7f82e6d9d640 1 -- 172.21.15.7:0/3010303512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fd4891650 con 0x557fd4826070 2024-09-21T06:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.979+0000 7f82e659c640 1 --2- 172.21.15.7:0/3010303512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 0x557fd4bd1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.979+0000 7f82d77fe640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f82d00b66b0 0x7f82d00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.979+0000 7f82e6d9d640 1 --2- 172.21.15.7:0/3010303512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 0x557fd4bd1a60 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f82e0031b70 tx=0x7f82e0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13abee0aaabc78f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.979+0000 7f82d77fe640 1 -- 172.21.15.7:0/2742427056 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7f82dc0e70b0 con 0x7f82e81083a0 2024-09-21T06:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.979+0000 7f82e659c640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f82d00b66b0 0x7f82d00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.979+0000 7f82d4ff9640 1 -- 172.21.15.7:0/3010303512 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0031450 con 0x557fd4826070 2024-09-21T06:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.979+0000 7f82d4ff9640 1 -- 172.21.15.7:0/3010303512 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82e0036040 con 0x557fd4826070 2024-09-21T06:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.979+0000 7f82d4ff9640 1 -- 172.21.15.7:0/3010303512 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e00045a0 con 0x557fd4826070 2024-09-21T06:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.980+0000 7f82f2f19740 1 -- 172.21.15.7:0/3010303512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 msgr2=0x557fd4bd1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.980+0000 7f82e659c640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f82d00b66b0 0x7f82d00b8bc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x557fd4bd06e0 tx=0x7f82d800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.980+0000 7f82f2f19740 1 --2- 172.21.15.7:0/3010303512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 0x557fd4bd1a60 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f82e0031b70 tx=0x7f82e0009a20 comp rx=0 tx=0).stop 2024-09-21T06:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.980+0000 7f82f2f19740 1 -- 172.21.15.7:0/3010303512 shutdown_connections 2024-09-21T06:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.980+0000 7f82f2f19740 1 --2- 172.21.15.7:0/3010303512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4bd24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.980+0000 7f82f2f19740 1 --2- 172.21.15.7:0/3010303512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 0x557fd4bd1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.980+0000 7f82f2f19740 1 --2- 172.21.15.7:0/3010303512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 0x557fd4bd1a60 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.980+0000 7f82f2f19740 1 -- 172.21.15.7:0/3010303512 >> 172.21.15.7:0/3010303512 conn(0x557fd481a460 msgr2=0x557fd4bcf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.980+0000 7f82f2f19740 1 -- 172.21.15.7:0/3010303512 shutdown_connections 2024-09-21T06:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.980+0000 7f82f2f19740 1 -- 172.21.15.7:0/3010303512 wait complete. 2024-09-21T06:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82f2f19740 1 -- start start 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82f2f19740 1 Processor -- start 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82f2f19740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 0x557fd4bdd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82f2f19740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4bdd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82f2f19740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 0x557fd4be94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82f2f19740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557fd4994700 con 0x557fd4826070 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82f2f19740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x557fd4ace110 con 0x557fd4805390 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82f2f19740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557fd4be01e0 con 0x557fd47fd1b0 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82e6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 0x557fd4be94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82f2f19740 10 client.0 _ll_register_callbacks cb 0x557fd4ae7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82e5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4bdd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82e6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 0x557fd4be94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56756/0 (socket says 172.21.15.7:56756) 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82e6d9d640 1 -- 172.21.15.7:0/3866249724 learned_addr learned my addr 172.21.15.7:0/3866249724 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.981+0000 7f82e659c640 1 --2- 172.21.15.7:0/3866249724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 0x557fd4bdd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82e6d9d640 1 -- 172.21.15.7:0/3866249724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 msgr2=0x557fd4bdd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82e6d9d640 1 --2- 172.21.15.7:0/3866249724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 0x557fd4bdd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82e6d9d640 1 -- 172.21.15.7:0/3866249724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 msgr2=0x557fd4bdd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82e6d9d640 1 --2- 172.21.15.7:0/3866249724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4bdd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82e6d9d640 1 -- 172.21.15.7:0/3866249724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fd4afbc40 con 0x557fd4826070 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82e5d9b640 1 --2- 172.21.15.7:0/3866249724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4bdd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82e6d9d640 1 --2- 172.21.15.7:0/3866249724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 0x557fd4be94d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f82e0006010 tx=0x7f82e0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a3fb24f2eb35b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82cdffb640 1 -- 172.21.15.7:0/3866249724 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e004a040 con 0x557fd4826070 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82f2f19740 1 -- 172.21.15.7:0/3866249724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82e0036040 con 0x557fd4826070 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82cdffb640 1 -- 172.21.15.7:0/3866249724 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7f82e0003b70 con 0x557fd4826070 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82cdffb640 1 -- 172.21.15.7:0/3866249724 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f82e005c050 con 0x557fd4826070 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82f2f19740 10 client.17058 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.982+0000 7f82f2f19740 1 -- 172.21.15.7:0/3866249724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557fd4bebfb0 con 0x557fd4826070 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.983+0000 7f82cdffb640 1 -- 172.21.15.7:0/3866249724 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82e0036040 con 0x557fd4826070 2024-09-21T06:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.983+0000 7f82cdffb640 1 -- 172.21.15.7:0/3866249724 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f82e004d070 con 0x557fd4826070 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.983+0000 7f82f2f19740 10 client.17058 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.983+0000 7f82f2f19740 10 client.17058 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.983+0000 7f82f2f19740 20 client.17058 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.983+0000 7f82f2f19740 1 --2- 172.21.15.7:0/3866249724 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557fd47e49f0 0x557fd4bef310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.983+0000 7f82f2f19740 4 client.17058 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.983+0000 7f82f2f19740 1 -- 172.21.15.7:0/3866249724 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fd4b45da0 con 0x557fd47e49f0 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.983+0000 7f82e659c640 1 --2- 172.21.15.7:0/3866249724 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557fd47e49f0 0x557fd4bef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.984+0000 7f82e659c640 1 --2- 172.21.15.7:0/3866249724 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557fd47e49f0 0x557fd4bef310 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e81c7e0b2cbfd067 server_cookie=2181bb54925d0998 in_seq=0 out_seq=0 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.984+0000 7f82cdffb640 10 client.17058 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.984+0000 7f82cdffb640 1 -- 172.21.15.7:0/3866249724 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557fd4b45da0 con 0x557fd47e49f0 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.984+0000 7f82cdffb640 10 client.17058 handle_command_reply: tid=0 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.984+0000 7f82f2f19740 1 client.17058 shutdown 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.985+0000 7f82f2f19740 1 -- 172.21.15.7:0/3866249724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 msgr2=0x557fd4be94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.985+0000 7f82f2f19740 1 --2- 172.21.15.7:0/3866249724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 0x557fd4be94d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f82e0006010 tx=0x7f82e0009880 comp rx=0 tx=0).stop 2024-09-21T06:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.985+0000 7f82f2f19740 1 -- 172.21.15.7:0/3866249724 shutdown_connections 2024-09-21T06:00:12.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.985+0000 7f82f2f19740 1 --2- 172.21.15.7:0/3866249724 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557fd47e49f0 0x557fd4bef310 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.985+0000 7f82f2f19740 1 --2- 172.21.15.7:0/3866249724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd4826070 0x557fd4be94d0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.985+0000 7f82f2f19740 1 --2- 172.21.15.7:0/3866249724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4bdd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.985+0000 7f82f2f19740 1 --2- 172.21.15.7:0/3866249724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 0x557fd4bdd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:12.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.985+0000 7f82f2f19740 1 -- 172.21.15.7:0/3866249724 >> 172.21.15.7:0/3866249724 conn(0x557fd481a460 msgr2=0x557fd4bd4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:12.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.985+0000 7f82cdffb640 0 client.17058 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:12.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.985+0000 7f82f2f19740 1 -- 172.21.15.7:0/3866249724 shutdown_connections 2024-09-21T06:00:12.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.985+0000 7f82f2f19740 1 -- 172.21.15.7:0/3866249724 wait complete. 2024-09-21T06:00:12.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:12.985+0000 7f82f2f19740 20 client.17058 trim_cache size 0 max 16384 2024-09-21T06:00:13.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.002+0000 7f82f2f19740 1 Processor -- start 2024-09-21T06:00:13.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.002+0000 7f82f2f19740 1 -- start start 2024-09-21T06:00:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82f2f19740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd481a460 0x557fd4bdf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82f2f19740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 0x557fd4bd31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82f2f19740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4be9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82f2f19740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81afd30 con 0x557fd481a460 2024-09-21T06:00:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82f2f19740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81ad600 con 0x557fd4805390 2024-09-21T06:00:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82f2f19740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81ab490 con 0x557fd47fd1b0 2024-09-21T06:00:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82e659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd481a460 0x557fd4bdf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82e659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd481a460 0x557fd4bdf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56766/0 (socket says 172.21.15.7:56766) 2024-09-21T06:00:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82e659c640 1 -- 172.21.15.7:0/1308962499 learned_addr learned my addr 172.21.15.7:0/1308962499 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82e6d9d640 1 --2- 172.21.15.7:0/1308962499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4be9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82e5d9b640 1 --2- 172.21.15.7:0/1308962499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 0x557fd4bd31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:13.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82e659c640 1 -- 172.21.15.7:0/1308962499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 msgr2=0x557fd4bd31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:13.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82e659c640 1 --2- 172.21.15.7:0/1308962499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 0x557fd4bd31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82e659c640 1 -- 172.21.15.7:0/1308962499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 msgr2=0x557fd4be9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:13.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82e659c640 1 --2- 172.21.15.7:0/1308962499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4be9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82e659c640 1 -- 172.21.15.7:0/1308962499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fd4bd0510 con 0x557fd481a460 2024-09-21T06:00:13.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82e6d9d640 1 --2- 172.21.15.7:0/1308962499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4be9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:13.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.003+0000 7f82e659c640 1 --2- 172.21.15.7:0/1308962499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd481a460 0x557fd4bdf0b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f82e806c720 tx=0x7f82d8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49901676ff26b574 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:13.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.004+0000 7f82cffff640 1 -- 172.21.15.7:0/1308962499 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d80219f0 con 0x557fd481a460 2024-09-21T06:00:13.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.004+0000 7f82cffff640 1 -- 172.21.15.7:0/1308962499 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82d802e070 con 0x557fd481a460 2024-09-21T06:00:13.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.004+0000 7f82cffff640 1 -- 172.21.15.7:0/1308962499 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d801f3f0 con 0x557fd481a460 2024-09-21T06:00:13.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.004+0000 7f82f2f19740 1 -- 172.21.15.7:0/1308962499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd481a460 msgr2=0x557fd4bdf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:13.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.004+0000 7f82f2f19740 1 --2- 172.21.15.7:0/1308962499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd481a460 0x557fd4bdf0b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f82e806c720 tx=0x7f82d8015000 comp rx=0 tx=0).stop 2024-09-21T06:00:13.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.004+0000 7f82f2f19740 1 -- 172.21.15.7:0/1308962499 shutdown_connections 2024-09-21T06:00:13.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.004+0000 7f82f2f19740 1 --2- 172.21.15.7:0/1308962499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd4805390 0x557fd4be9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.004+0000 7f82f2f19740 1 --2- 172.21.15.7:0/1308962499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd47fd1b0 0x557fd4bd31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.004+0000 7f82f2f19740 1 --2- 172.21.15.7:0/1308962499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd481a460 0x557fd4bdf0b0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.004+0000 7f82f2f19740 1 -- 172.21.15.7:0/1308962499 >> 172.21.15.7:0/1308962499 conn(0x557fd4bddac0 msgr2=0x557fd4bd2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82f2f19740 1 -- 172.21.15.7:0/1308962499 shutdown_connections 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82f2f19740 1 -- 172.21.15.7:0/1308962499 wait complete. 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82f2f19740 1 -- start start 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82f2f19740 1 Processor -- start 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82f2f19740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd47fd1b0 0x557fd4bf0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82f2f19740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd4805390 0x557fd4bf0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82f2f19740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd481a460 0x557fd4bf0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82f2f19740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81abae0 con 0x557fd47fd1b0 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82f2f19740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81acf30 con 0x557fd481a460 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82f2f19740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81ac190 con 0x557fd4805390 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82f2f19740 10 client.0 _ll_register_callbacks cb 0x7f82dc0eaad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:13.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82e659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd47fd1b0 0x557fd4bf0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82e659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd47fd1b0 0x557fd4bf0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56768/0 (socket says 172.21.15.7:56768) 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.005+0000 7f82e659c640 1 -- 172.21.15.7:0/2238763597 learned_addr learned my addr 172.21.15.7:0/2238763597 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82e5d9b640 1 --2- 172.21.15.7:0/2238763597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd4805390 0x557fd4bf0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82e6d9d640 1 --2- 172.21.15.7:0/2238763597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd481a460 0x557fd4bf0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82e659c640 1 -- 172.21.15.7:0/2238763597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd4805390 msgr2=0x557fd4bf0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82e659c640 1 --2- 172.21.15.7:0/2238763597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd4805390 0x557fd4bf0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82e659c640 1 -- 172.21.15.7:0/2238763597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd481a460 msgr2=0x557fd4bf0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82e659c640 1 --2- 172.21.15.7:0/2238763597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd481a460 0x557fd4bf0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82e659c640 1 -- 172.21.15.7:0/2238763597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fd4c58b60 con 0x557fd47fd1b0 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82e659c640 1 --2- 172.21.15.7:0/2238763597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd47fd1b0 0x557fd4bf0400 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f82d8022ce0 tx=0x7f82d8022d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fedfdac439b5e3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82cdffb640 1 -- 172.21.15.7:0/2238763597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d8036070 con 0x557fd47fd1b0 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82cdffb640 1 -- 172.21.15.7:0/2238763597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7f82d8010650 con 0x557fd47fd1b0 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82f2f19740 1 -- 172.21.15.7:0/2238763597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82d802e070 con 0x557fd47fd1b0 2024-09-21T06:00:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82cdffb640 1 -- 172.21.15.7:0/2238763597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f82d8042050 con 0x557fd47fd1b0 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82f2f19740 10 client.17064 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.006+0000 7f82f2f19740 1 -- 172.21.15.7:0/2238763597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557fd4c59e20 con 0x557fd47fd1b0 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.007+0000 7f82cdffb640 1 -- 172.21.15.7:0/2238763597 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82d802e070 con 0x557fd47fd1b0 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.007+0000 7f82cdffb640 1 -- 172.21.15.7:0/2238763597 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f82d80047e0 con 0x557fd47fd1b0 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.007+0000 7f82f2f19740 10 client.17064 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.007+0000 7f82f2f19740 10 client.17064 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.007+0000 7f82f2f19740 20 client.17064 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.007+0000 7f82f2f19740 1 --2- 172.21.15.7:0/2238763597 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557fd4826070 0x557fd4c5c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.007+0000 7f82f2f19740 4 client.17064 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.007+0000 7f82f2f19740 1 -- 172.21.15.7:0/2238763597 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557fd4b41850 con 0x557fd4826070 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.007+0000 7f82e5d9b640 1 --2- 172.21.15.7:0/2238763597 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557fd4826070 0x557fd4c5c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82cdffb640 10 client.17064 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82e5d9b640 1 --2- 172.21.15.7:0/2238763597 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557fd4826070 0x557fd4c5c610 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ef4469f32c1d313 server_cookie=a4451eaddab05c57 in_seq=0 out_seq=0 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82cdffb640 1 -- 172.21.15.7:0/2238763597 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x557fd4b41850 con 0x557fd4826070 2024-09-21T06:00:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82cdffb640 10 client.17064 handle_command_reply: tid=0 2024-09-21T06:00:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82f2f19740 1 client.17064 shutdown 2024-09-21T06:00:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82f2f19740 1 -- 172.21.15.7:0/2238763597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd47fd1b0 msgr2=0x557fd4bf0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82f2f19740 1 --2- 172.21.15.7:0/2238763597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd47fd1b0 0x557fd4bf0400 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f82d8022ce0 tx=0x7f82d8022d10 comp rx=0 tx=0).stop 2024-09-21T06:00:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82f2f19740 1 -- 172.21.15.7:0/2238763597 shutdown_connections 2024-09-21T06:00:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82f2f19740 1 --2- 172.21.15.7:0/2238763597 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557fd4826070 0x557fd4c5c610 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82f2f19740 1 --2- 172.21.15.7:0/2238763597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557fd481a460 0x557fd4bf0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82f2f19740 1 --2- 172.21.15.7:0/2238763597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557fd4805390 0x557fd4bf0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82f2f19740 1 --2- 172.21.15.7:0/2238763597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fd47fd1b0 0x557fd4bf0400 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82f2f19740 1 -- 172.21.15.7:0/2238763597 >> 172.21.15.7:0/2238763597 conn(0x557fd4bddac0 msgr2=0x557fd4bd3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82cdffb640 0 client.17064 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82f2f19740 1 -- 172.21.15.7:0/2238763597 shutdown_connections 2024-09-21T06:00:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.008+0000 7f82f2f19740 1 -- 172.21.15.7:0/2238763597 wait complete. 2024-09-21T06:00:13.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.009+0000 7f82f2f19740 20 client.17064 trim_cache size 0 max 16384 2024-09-21T06:00:13.015 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:00:13.015 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:00:13.015 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:00:13.015 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:00:13.015 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:00:13.015 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:00:13.015 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.015 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.015 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.015 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.015 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.016 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.017 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:00:13.018 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:00:13.019 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:13.020 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:13.022 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:13.023 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:13.023 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:13.023 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:13.023 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:00:13.023 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:00:13.023 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:00:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.009+0000 7f82ec9a5640 1 -- 172.21.15.7:0/2742427056 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f82d00b66b0 msgr2=0x7f82d00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.009+0000 7f82ec9a5640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f82d00b66b0 0x7f82d00b8bc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x557fd4bd06e0 tx=0x7f82d800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.009+0000 7f82ec9a5640 1 -- 172.21.15.7:0/2742427056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82e81083a0 msgr2=0x7f82e819b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.009+0000 7f82ec9a5640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82e81083a0 0x7f82e819b840 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00d770 tx=0x7f82dc00db70 comp rx=0 tx=0).stop 2024-09-21T06:00:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.009+0000 7f82ec9a5640 1 -- 172.21.15.7:0/2742427056 shutdown_connections 2024-09-21T06:00:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.009+0000 7f82ec9a5640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f82d00b66b0 0x7f82d00b8bc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.009+0000 7f82ec9a5640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82e81083a0 0x7f82e819b840 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.009+0000 7f82ec9a5640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82e8108cf0 0x7f82e819bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.009+0000 7f82ec9a5640 1 --2- 172.21.15.7:0/2742427056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82e8102a60 0x7f82e819b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.009+0000 7f82ec9a5640 1 -- 172.21.15.7:0/2742427056 >> 172.21.15.7:0/2742427056 conn(0x7f82e8079730 msgr2=0x7f82e8104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.009+0000 7f82ec9a5640 1 -- 172.21.15.7:0/2742427056 shutdown_connections 2024-09-21T06:00:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:13.009+0000 7f82ec9a5640 1 -- 172.21.15.7:0/2742427056 wait complete. 2024-09-21T06:00:13.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:13 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:00:13.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:13 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:13.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:13 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:00:13.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:13 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:13.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:13 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:00:13.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:13 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:00:13.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:13 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:13.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:13 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:00:13.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:13 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:13.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:13 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:00:13.646 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:00:13.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:00:13.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:13 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:00:13.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:13 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:13.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:13 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:00:13.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:13 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:13.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:13 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:00:13.905 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:14.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:14 smithi007 ceph-mon[30983]: pgmap v509: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:00:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.355+0000 7f23db8c4640 1 -- 172.21.15.7:0/1096242517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23d41038f0 msgr2=0x7f23d410f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.355+0000 7f23db8c4640 1 --2- 172.21.15.7:0/1096242517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23d41038f0 0x7f23d410f4a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009ca0 tx=0x7f23cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:00:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.355+0000 7f23db8c4640 1 -- 172.21.15.7:0/1096242517 shutdown_connections 2024-09-21T06:00:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.355+0000 7f23db8c4640 1 --2- 172.21.15.7:0/1096242517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23d41038f0 0x7f23d410f4a0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.355+0000 7f23db8c4640 1 --2- 172.21.15.7:0/1096242517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d4102fa0 0x7f23d41033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.355+0000 7f23db8c4640 1 --2- 172.21.15.7:0/1096242517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23d4107630 0x7f23d4107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.355+0000 7f23db8c4640 1 -- 172.21.15.7:0/1096242517 >> 172.21.15.7:0/1096242517 conn(0x7f23d4079e40 msgr2=0x7f23d407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.355+0000 7f23db8c4640 1 -- 172.21.15.7:0/1096242517 shutdown_connections 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.355+0000 7f23db8c4640 1 -- 172.21.15.7:0/1096242517 wait complete. 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.355+0000 7f23db8c4640 1 Processor -- start 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23db8c4640 1 -- start start 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23db8c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23d4102fa0 0x7f23d419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23db8c4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d41038f0 0x7f23d419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23db8c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23d4107630 0x7f23d419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23db8c4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4112a40 con 0x7f23d4102fa0 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23db8c4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41128c0 con 0x7f23d41038f0 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23db8c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4112bc0 con 0x7f23d4107630 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23d9660640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23d4102fa0 0x7f23d419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23d9660640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23d4102fa0 0x7f23d419b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56786/0 (socket says 172.21.15.7:56786) 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23d9660640 1 -- 172.21.15.7:0/1563469580 learned_addr learned my addr 172.21.15.7:0/1563469580 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23d8e5f640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d41038f0 0x7f23d419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23d9660640 1 -- 172.21.15.7:0/1563469580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23d4107630 msgr2=0x7f23d419bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23d9660640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23d4107630 0x7f23d419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23d9660640 1 -- 172.21.15.7:0/1563469580 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d41038f0 msgr2=0x7f23d419b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23d9660640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d41038f0 0x7f23d419b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23d9660640 1 -- 172.21.15.7:0/1563469580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d41a64f0 con 0x7f23d4102fa0 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.356+0000 7f23d8e5f640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d41038f0 0x7f23d419b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.357+0000 7f23d9660640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23d4102fa0 0x7f23d419b2f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f23d000b4a0 tx=0x7f23d000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.357+0000 7f23ca7fc640 1 -- 172.21.15.7:0/1563469580 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0014070 con 0x7f23d4102fa0 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.357+0000 7f23db8c4640 1 -- 172.21.15.7:0/1563469580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d41a67e0 con 0x7f23d4102fa0 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.357+0000 7f23ca7fc640 1 -- 172.21.15.7:0/1563469580 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23d0010ac0 con 0x7f23d4102fa0 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.357+0000 7f23ca7fc640 1 -- 172.21.15.7:0/1563469580 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0017c30 con 0x7f23d4102fa0 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.357+0000 7f23db8c4640 1 -- 172.21.15.7:0/1563469580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d41a6da0 con 0x7f23d4102fa0 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.358+0000 7f23db8c4640 1 -- 172.21.15.7:0/1563469580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d41033b0 con 0x7f23d4102fa0 2024-09-21T06:00:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.360+0000 7f23ca7fc640 1 -- 172.21.15.7:0/1563469580 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f23d0017070 con 0x7f23d4102fa0 2024-09-21T06:00:14.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.361+0000 7f23ca7fc640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23c00b66b0 0x7f23c00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:14.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.361+0000 7f23d8e5f640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23c00b66b0 0x7f23c00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:14.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.361+0000 7f23ca7fc640 1 -- 172.21.15.7:0/1563469580 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7f23d00e6e30 con 0x7f23d4102fa0 2024-09-21T06:00:14.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.362+0000 7f23d8e5f640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23c00b66b0 0x7f23c00b8bc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f23d4107080 tx=0x7f23c4005db0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:14.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.365+0000 7f23ca7fc640 1 -- 172.21.15.7:0/1563469580 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23d00ad340 con 0x7f23d4102fa0 2024-09-21T06:00:14.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:14 smithi119 ceph-mon[34833]: pgmap v509: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:00:14.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.591+0000 7f23db8c4640 1 -- 172.21.15.7:0/1563469580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23d41022a0 con 0x7f23d4102fa0 2024-09-21T06:00:14.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.592+0000 7f23ca7fc640 1 -- 172.21.15.7:0/1563469580 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f23d00b1720 con 0x7f23d4102fa0 2024-09-21T06:00:14.594 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:00:14.594 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:00:14.595 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:00:14.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.594+0000 7f23db8c4640 1 -- 172.21.15.7:0/1563469580 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23c00b66b0 msgr2=0x7f23c00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:14.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.594+0000 7f23db8c4640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23c00b66b0 0x7f23c00b8bc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f23d4107080 tx=0x7f23c4005db0 comp rx=0 tx=0).stop 2024-09-21T06:00:14.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.594+0000 7f23db8c4640 1 -- 172.21.15.7:0/1563469580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23d4102fa0 msgr2=0x7f23d419b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:14.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.594+0000 7f23db8c4640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23d4102fa0 0x7f23d419b2f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f23d000b4a0 tx=0x7f23d000b960 comp rx=0 tx=0).stop 2024-09-21T06:00:14.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.594+0000 7f23db8c4640 1 -- 172.21.15.7:0/1563469580 shutdown_connections 2024-09-21T06:00:14.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.594+0000 7f23db8c4640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23c00b66b0 0x7f23c00b8bc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:14.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.594+0000 7f23db8c4640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23d4107630 0x7f23d419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:14.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.594+0000 7f23db8c4640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23d41038f0 0x7f23d419b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:14.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.594+0000 7f23db8c4640 1 --2- 172.21.15.7:0/1563469580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23d4102fa0 0x7f23d419b2f0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:14.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.594+0000 7f23db8c4640 1 -- 172.21.15.7:0/1563469580 >> 172.21.15.7:0/1563469580 conn(0x7f23d4079e40 msgr2=0x7f23d41041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:14.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.594+0000 7f23db8c4640 1 -- 172.21.15.7:0/1563469580 shutdown_connections 2024-09-21T06:00:14.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:14.594+0000 7f23db8c4640 1 -- 172.21.15.7:0/1563469580 wait complete. 2024-09-21T06:00:14.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:14 smithi027 ceph-mon[34364]: pgmap v509: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:00:15.194 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:00:15.452 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:15.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:15 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1563469580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:15.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:15 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1563469580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:15.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:15 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1563469580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.944+0000 7fd268c36640 1 -- 172.21.15.7:0/27287228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2641094f0 msgr2=0x7fd264109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.944+0000 7fd268c36640 1 --2- 172.21.15.7:0/27287228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2641094f0 0x7fd264109900 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd258009900 tx=0x7fd25802a410 comp rx=0 tx=0).stop 2024-09-21T06:00:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.945+0000 7fd268c36640 1 -- 172.21.15.7:0/27287228 shutdown_connections 2024-09-21T06:00:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.945+0000 7fd268c36640 1 --2- 172.21.15.7:0/27287228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2641094f0 0x7fd264109900 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.945+0000 7fd268c36640 1 --2- 172.21.15.7:0/27287228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd264109e40 0x7fd264110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.945+0000 7fd268c36640 1 --2- 172.21.15.7:0/27287228 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264103bb0 0x7fd264103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.945+0000 7fd268c36640 1 -- 172.21.15.7:0/27287228 >> 172.21.15.7:0/27287228 conn(0x7fd2640ff600 msgr2=0x7fd264101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.945+0000 7fd268c36640 1 -- 172.21.15.7:0/27287228 shutdown_connections 2024-09-21T06:00:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.945+0000 7fd268c36640 1 -- 172.21.15.7:0/27287228 wait complete. 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.945+0000 7fd268c36640 1 Processor -- start 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.945+0000 7fd268c36640 1 -- start start 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd268c36640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264103bb0 0x7fd26419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd268c36640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2641094f0 0x7fd26419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd268c36640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd264109e40 0x7fd26419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd268c36640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd264113b00 con 0x7fd264109e40 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd268c36640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd264113980 con 0x7fd264103bb0 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd268c36640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd264113c80 con 0x7fd2641094f0 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd262d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd264109e40 0x7fd26419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd262d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd264109e40 0x7fd26419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56792/0 (socket says 172.21.15.7:56792) 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd262d9d640 1 -- 172.21.15.7:0/2418656767 learned_addr learned my addr 172.21.15.7:0/2418656767 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd261d9b640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2641094f0 0x7fd26419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd26259c640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264103bb0 0x7fd26419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd262d9d640 1 -- 172.21.15.7:0/2418656767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2641094f0 msgr2=0x7fd26419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd262d9d640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2641094f0 0x7fd26419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd262d9d640 1 -- 172.21.15.7:0/2418656767 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264103bb0 msgr2=0x7fd26419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd262d9d640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264103bb0 0x7fd26419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.946+0000 7fd262d9d640 1 -- 172.21.15.7:0/2418656767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2641a0380 con 0x7fd264109e40 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.947+0000 7fd262d9d640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd264109e40 0x7fd26419fd10 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00cce0 tx=0x7fd25c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.947+0000 7fd2537fe640 1 -- 172.21.15.7:0/2418656767 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c00f450 con 0x7fd264109e40 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.947+0000 7fd268c36640 1 -- 172.21.15.7:0/2418656767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2641a0670 con 0x7fd264109e40 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.947+0000 7fd2537fe640 1 -- 172.21.15.7:0/2418656767 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd25c00faa0 con 0x7fd264109e40 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.947+0000 7fd2537fe640 1 -- 172.21.15.7:0/2418656767 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c018b70 con 0x7fd264109e40 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.947+0000 7fd268c36640 1 -- 172.21.15.7:0/2418656767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2641a0b30 con 0x7fd264109e40 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.950+0000 7fd26f1aa740 1 Processor -- start 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.950+0000 7fd2537fe640 1 -- 172.21.15.7:0/2418656767 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd25c018d10 con 0x7fd264109e40 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.950+0000 7fd26f1aa740 1 -- start start 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.950+0000 7fd26f1aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446e2070 0x55e244a896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.950+0000 7fd26f1aa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446b91b0 0x55e244a89be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.950+0000 7fd26f1aa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446c1390 0x55e244a8a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.950+0000 7fd26f1aa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e2449ffea0 con 0x55e2446c1390 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.950+0000 7fd26f1aa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e2449ef2d0 con 0x55e2446b91b0 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.950+0000 7fd26f1aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e2449f30e0 con 0x55e2446e2070 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.950+0000 7fd261d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446c1390 0x55e244a8a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.950+0000 7fd261d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446c1390 0x55e244a8a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56796/0 (socket says 172.21.15.7:56796) 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.950+0000 7fd26259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446b91b0 0x55e244a89be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.950+0000 7fd261d9b640 1 -- 172.21.15.7:0/3051760582 learned_addr learned my addr 172.21.15.7:0/3051760582 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.951+0000 7fd261d9b640 1 --2- 172.21.15.7:0/3051760582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446e2070 0x55e244a896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.951+0000 7fd26259c640 1 -- 172.21.15.7:0/3051760582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446e2070 msgr2=0x55e244a896a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.951+0000 7fd26259c640 1 --2- 172.21.15.7:0/3051760582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446e2070 0x55e244a896a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.951+0000 7fd26259c640 1 -- 172.21.15.7:0/3051760582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446c1390 msgr2=0x55e244a8a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.951+0000 7fd26259c640 1 --2- 172.21.15.7:0/3051760582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446c1390 0x55e244a8a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.951+0000 7fd26259c640 1 -- 172.21.15.7:0/3051760582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e24474d650 con 0x55e2446b91b0 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.951+0000 7fd2537fe640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd24c0b66b0 0x7fd24c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.951+0000 7fd261d9b640 1 --2- 172.21.15.7:0/3051760582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446e2070 0x55e244a896a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:15.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.951+0000 7fd261d9b640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd24c0b66b0 0x7fd24c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.951+0000 7fd26259c640 1 --2- 172.21.15.7:0/3051760582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446b91b0 0x55e244a89be0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd25400dc60 tx=0x7fd25400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=796a1de2e5f99167 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:15.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.951+0000 7fd2537fe640 1 -- 172.21.15.7:0/2418656767 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7fd25c0e7af0 con 0x7fd264109e40 2024-09-21T06:00:15.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.951+0000 7fd250ff9640 1 -- 172.21.15.7:0/3051760582 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254015070 con 0x55e2446b91b0 2024-09-21T06:00:15.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.952+0000 7fd250ff9640 1 -- 172.21.15.7:0/3051760582 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2540054d0 con 0x55e2446b91b0 2024-09-21T06:00:15.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.952+0000 7fd250ff9640 1 -- 172.21.15.7:0/3051760582 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254011440 con 0x55e2446b91b0 2024-09-21T06:00:15.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.952+0000 7fd26f1aa740 1 -- 172.21.15.7:0/3051760582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446b91b0 msgr2=0x55e244a89be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:15.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.952+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/3051760582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446b91b0 0x55e244a89be0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd25400dc60 tx=0x7fd25400f730 comp rx=0 tx=0).stop 2024-09-21T06:00:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.952+0000 7fd261d9b640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd24c0b66b0 0x7fd24c0b8bc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd2580096c0 tx=0x7fd258041040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.952+0000 7fd26f1aa740 1 -- 172.21.15.7:0/3051760582 shutdown_connections 2024-09-21T06:00:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.953+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/3051760582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446c1390 0x55e244a8a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.953+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/3051760582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446b91b0 0x55e244a89be0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.953+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/3051760582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446e2070 0x55e244a896a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.953+0000 7fd26f1aa740 1 -- 172.21.15.7:0/3051760582 >> 172.21.15.7:0/3051760582 conn(0x55e2446d6460 msgr2=0x55e244a87590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.953+0000 7fd26f1aa740 1 -- 172.21.15.7:0/3051760582 shutdown_connections 2024-09-21T06:00:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.953+0000 7fd26f1aa740 1 -- 172.21.15.7:0/3051760582 wait complete. 2024-09-21T06:00:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.953+0000 7fd26f1aa740 1 -- start start 2024-09-21T06:00:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.953+0000 7fd26f1aa740 1 Processor -- start 2024-09-21T06:00:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.953+0000 7fd26f1aa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446b91b0 0x55e244a94d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.953+0000 7fd26f1aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446c1390 0x55e244a95270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.953+0000 7fd26f1aa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446e2070 0x55e244aa1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26f1aa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e244850700 con 0x55e2446b91b0 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26f1aa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e24498a160 con 0x55e2446e2070 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26f1aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e244a97e80 con 0x55e2446c1390 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26f1aa740 10 client.0 _ll_register_callbacks cb 0x55e2449a39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446b91b0 0x55e244a94d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446b91b0 0x55e244a94d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56800/0 (socket says 172.21.15.7:56800) 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26259c640 1 -- 172.21.15.7:0/1100700425 learned_addr learned my addr 172.21.15.7:0/1100700425 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd262d9d640 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446e2070 0x55e244aa1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd261d9b640 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446c1390 0x55e244a95270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26259c640 1 -- 172.21.15.7:0/1100700425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446c1390 msgr2=0x55e244a95270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26259c640 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446c1390 0x55e244a95270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26259c640 1 -- 172.21.15.7:0/1100700425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446e2070 msgr2=0x55e244aa1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26259c640 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446e2070 0x55e244aa1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26259c640 1 -- 172.21.15.7:0/1100700425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2449b7c90 con 0x55e2446b91b0 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd261d9b640 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446c1390 0x55e244a95270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26259c640 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446b91b0 0x55e244a94d30 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd254004cd0 tx=0x7fd254004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7464cfdabb82e5f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd249ffb640 1 -- 172.21.15.7:0/1100700425 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254028060 con 0x55e2446b91b0 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd249ffb640 1 -- 172.21.15.7:0/1100700425 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7fd25400d7a0 con 0x55e2446b91b0 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.954+0000 7fd26f1aa740 1 -- 172.21.15.7:0/1100700425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2540054d0 con 0x55e2446b91b0 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.955+0000 7fd249ffb640 1 -- 172.21.15.7:0/1100700425 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd254015070 con 0x55e2446b91b0 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.955+0000 7fd26f1aa740 10 client.17082 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.955+0000 7fd26f1aa740 1 -- 172.21.15.7:0/1100700425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e244aa3b60 con 0x55e2446b91b0 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.955+0000 7fd249ffb640 1 -- 172.21.15.7:0/1100700425 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2540054d0 con 0x55e2446b91b0 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.955+0000 7fd249ffb640 1 -- 172.21.15.7:0/1100700425 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd254011a50 con 0x55e2446b91b0 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.955+0000 7fd26f1aa740 10 client.17082 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.955+0000 7fd26f1aa740 10 client.17082 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:00:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.955+0000 7fd26f1aa740 20 client.17082 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.955+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e2446a09f0 0x55e244aa6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.955+0000 7fd26f1aa740 4 client.17082 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.955+0000 7fd26f1aa740 1 -- 172.21.15.7:0/1100700425 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e244a01df0 con 0x55e2446a09f0 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.956+0000 7fd261d9b640 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e2446a09f0 0x55e244aa6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.956+0000 7fd261d9b640 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e2446a09f0 0x55e244aa6f70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b3b60a521a035d server_cookie=38e3d9358a03e79e in_seq=0 out_seq=0 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.956+0000 7fd249ffb640 10 client.17082 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd249ffb640 1 -- 172.21.15.7:0/1100700425 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e244a01df0 con 0x55e2446a09f0 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd249ffb640 10 client.17082 handle_command_reply: tid=0 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd26f1aa740 1 client.17082 shutdown 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd26f1aa740 1 -- 172.21.15.7:0/1100700425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446b91b0 msgr2=0x55e244a94d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446b91b0 0x55e244a94d30 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd254004cd0 tx=0x7fd254004a00 comp rx=0 tx=0).stop 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd26f1aa740 1 -- 172.21.15.7:0/1100700425 shutdown_connections 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e2446a09f0 0x55e244aa6f70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446e2070 0x55e244aa1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446c1390 0x55e244a95270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/1100700425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446b91b0 0x55e244a94d30 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd249ffb640 0 client.17082 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd26f1aa740 1 -- 172.21.15.7:0/1100700425 >> 172.21.15.7:0/1100700425 conn(0x55e2446d6460 msgr2=0x55e244a8c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd26f1aa740 1 -- 172.21.15.7:0/1100700425 shutdown_connections 2024-09-21T06:00:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd26f1aa740 1 -- 172.21.15.7:0/1100700425 wait complete. 2024-09-21T06:00:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.957+0000 7fd26f1aa740 20 client.17082 trim_cache size 0 max 16384 2024-09-21T06:00:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.970+0000 7fd26f1aa740 1 Processor -- start 2024-09-21T06:00:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd26f1aa740 1 -- start start 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd26f1aa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446b91b0 0x55e244a951f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd26f1aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446c1390 0x55e244aa10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd26f1aa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446e2070 0x55e244a91f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd26f1aa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2641b1f20 con 0x55e2446e2070 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd26f1aa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd2641af7f0 con 0x55e2446b91b0 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd26f1aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd2641ad660 con 0x55e2446c1390 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd262d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446e2070 0x55e244a91f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd262d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446e2070 0x55e244a91f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56816/0 (socket says 172.21.15.7:56816) 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd262d9d640 1 -- 172.21.15.7:0/2108430320 learned_addr learned my addr 172.21.15.7:0/2108430320 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd261d9b640 1 --2- 172.21.15.7:0/2108430320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446c1390 0x55e244aa10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd26259c640 1 --2- 172.21.15.7:0/2108430320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446b91b0 0x55e244a951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd262d9d640 1 -- 172.21.15.7:0/2108430320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446c1390 msgr2=0x55e244aa10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd262d9d640 1 --2- 172.21.15.7:0/2108430320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446c1390 0x55e244aa10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd262d9d640 1 -- 172.21.15.7:0/2108430320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446b91b0 msgr2=0x55e244a951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd262d9d640 1 --2- 172.21.15.7:0/2108430320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446b91b0 0x55e244a951f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd262d9d640 1 -- 172.21.15.7:0/2108430320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e244a93f70 con 0x55e2446e2070 2024-09-21T06:00:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.971+0000 7fd26259c640 1 --2- 172.21.15.7:0/2108430320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446b91b0 0x55e244a951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.972+0000 7fd262d9d640 1 --2- 172.21.15.7:0/2108430320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446e2070 0x55e244a91f20 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd25c01f000 tx=0x7fd25c0d1150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f40233ffaa9ed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.972+0000 7fd24bfff640 1 -- 172.21.15.7:0/2108430320 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c0a90d0 con 0x55e2446e2070 2024-09-21T06:00:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.972+0000 7fd24bfff640 1 -- 172.21.15.7:0/2108430320 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd25c0ad470 con 0x55e2446e2070 2024-09-21T06:00:15.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.972+0000 7fd24bfff640 1 -- 172.21.15.7:0/2108430320 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c0acbc0 con 0x55e2446e2070 2024-09-21T06:00:15.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.972+0000 7fd26f1aa740 1 -- 172.21.15.7:0/2108430320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446e2070 msgr2=0x55e244a91f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:15.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.973+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/2108430320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446e2070 0x55e244a91f20 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd25c01f000 tx=0x7fd25c0d1150 comp rx=0 tx=0).stop 2024-09-21T06:00:15.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.973+0000 7fd26f1aa740 1 -- 172.21.15.7:0/2108430320 shutdown_connections 2024-09-21T06:00:15.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.973+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/2108430320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446e2070 0x55e244a91f20 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.973+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/2108430320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446c1390 0x55e244aa10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.973+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/2108430320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446b91b0 0x55e244a951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.973+0000 7fd26f1aa740 1 -- 172.21.15.7:0/2108430320 >> 172.21.15.7:0/2108430320 conn(0x55e2446d6460 msgr2=0x55e244a94ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.973+0000 7fd26f1aa740 1 -- 172.21.15.7:0/2108430320 shutdown_connections 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.973+0000 7fd26f1aa740 1 -- 172.21.15.7:0/2108430320 wait complete. 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.973+0000 7fd26f1aa740 1 -- start start 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.973+0000 7fd26f1aa740 1 Processor -- start 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.973+0000 7fd26f1aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446b91b0 0x55e244aa7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.973+0000 7fd26f1aa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446c1390 0x55e244aa84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.973+0000 7fd26f1aa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446e2070 0x55e244aa89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd26f1aa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2641adcb0 con 0x55e2446c1390 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd26f1aa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd2641af120 con 0x55e2446e2070 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd26f1aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd2641ae380 con 0x55e2446b91b0 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd261d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446c1390 0x55e244aa84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd26f1aa740 10 client.0 _ll_register_callbacks cb 0x7fd258032b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:15.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd261d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446c1390 0x55e244aa84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56820/0 (socket says 172.21.15.7:56820) 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd261d9b640 1 -- 172.21.15.7:0/2104834108 learned_addr learned my addr 172.21.15.7:0/2104834108 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd26259c640 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446b91b0 0x55e244aa7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd262d9d640 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446e2070 0x55e244aa89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd261d9b640 1 -- 172.21.15.7:0/2104834108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446b91b0 msgr2=0x55e244aa7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd261d9b640 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446b91b0 0x55e244aa7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd261d9b640 1 -- 172.21.15.7:0/2104834108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446e2070 msgr2=0x55e244aa89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd261d9b640 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446e2070 0x55e244aa89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd261d9b640 1 -- 172.21.15.7:0/2104834108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e244b14b00 con 0x55e2446c1390 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd262d9d640 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446e2070 0x55e244aa89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd261d9b640 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446c1390 0x55e244aa84b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd258009900 tx=0x7fd25802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8504cc59e9d19c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd249ffb640 1 -- 172.21.15.7:0/2104834108 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25805d060 con 0x55e2446c1390 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd249ffb640 1 -- 172.21.15.7:0/2104834108 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7fd258005040 con 0x55e2446c1390 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.974+0000 7fd26f1aa740 1 -- 172.21.15.7:0/2104834108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd25c0ad470 con 0x55e2446c1390 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.975+0000 7fd249ffb640 1 -- 172.21.15.7:0/2104834108 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd258046070 con 0x55e2446c1390 2024-09-21T06:00:15.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.975+0000 7fd26f1aa740 10 client.17088 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:15.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.975+0000 7fd26f1aa740 1 -- 172.21.15.7:0/2104834108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e244b15db0 con 0x55e2446c1390 2024-09-21T06:00:15.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.975+0000 7fd249ffb640 1 -- 172.21.15.7:0/2104834108 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd25c0ad470 con 0x55e2446c1390 2024-09-21T06:00:15.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.975+0000 7fd249ffb640 1 -- 172.21.15.7:0/2104834108 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd258057070 con 0x55e2446c1390 2024-09-21T06:00:15.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.975+0000 7fd26f1aa740 10 client.17088 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:15.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.975+0000 7fd26f1aa740 10 client.17088 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:00:15.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.975+0000 7fd26f1aa740 20 client.17088 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:15.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.975+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e244675da0 0x55e244b18550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:15.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.975+0000 7fd26f1aa740 4 client.17088 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:15.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.975+0000 7fd26f1aa740 1 -- 172.21.15.7:0/2104834108 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e2449fd8a0 con 0x55e244675da0 2024-09-21T06:00:15.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.975+0000 7fd26259c640 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e244675da0 0x55e244b18550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:15.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd26259c640 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e244675da0 0x55e244b18550 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a724d2e6289da31 server_cookie=f005c2a75449c342 in_seq=0 out_seq=0 2024-09-21T06:00:15.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd249ffb640 10 client.17088 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:15.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd249ffb640 1 -- 172.21.15.7:0/2104834108 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e2449fd8a0 con 0x55e244675da0 2024-09-21T06:00:15.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd249ffb640 10 client.17088 handle_command_reply: tid=0 2024-09-21T06:00:15.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd26f1aa740 1 client.17088 shutdown 2024-09-21T06:00:15.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd26f1aa740 1 -- 172.21.15.7:0/2104834108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446c1390 msgr2=0x55e244aa84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:15.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446c1390 0x55e244aa84b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd258009900 tx=0x7fd25802a410 comp rx=0 tx=0).stop 2024-09-21T06:00:15.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd26f1aa740 1 -- 172.21.15.7:0/2104834108 shutdown_connections 2024-09-21T06:00:15.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55e244675da0 0x55e244b18550 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2446c1390 0x55e244aa84b0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e2446e2070 0x55e244aa89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd249ffb640 0 client.17088 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd26f1aa740 1 --2- 172.21.15.7:0/2104834108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e2446b91b0 0x55e244aa7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd26f1aa740 1 -- 172.21.15.7:0/2104834108 >> 172.21.15.7:0/2104834108 conn(0x55e2446d6460 msgr2=0x55e244a8a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd26f1aa740 1 -- 172.21.15.7:0/2104834108 shutdown_connections 2024-09-21T06:00:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd26f1aa740 1 -- 172.21.15.7:0/2104834108 wait complete. 2024-09-21T06:00:15.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.976+0000 7fd26f1aa740 20 client.17088 trim_cache size 0 max 16384 2024-09-21T06:00:15.982 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.977+0000 7fd268c36640 1 -- 172.21.15.7:0/2418656767 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd24c0b66b0 msgr2=0x7fd24c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.977+0000 7fd268c36640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd24c0b66b0 0x7fd24c0b8bc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd2580096c0 tx=0x7fd258041040 comp rx=0 tx=0).stop 2024-09-21T06:00:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.977+0000 7fd268c36640 1 -- 172.21.15.7:0/2418656767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd264109e40 msgr2=0x7fd26419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.977+0000 7fd268c36640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd264109e40 0x7fd26419fd10 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00cce0 tx=0x7fd25c00a620 comp rx=0 tx=0).stop 2024-09-21T06:00:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.977+0000 7fd268c36640 1 -- 172.21.15.7:0/2418656767 shutdown_connections 2024-09-21T06:00:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.977+0000 7fd268c36640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd24c0b66b0 0x7fd24c0b8bc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.977+0000 7fd268c36640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd264109e40 0x7fd26419fd10 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.977+0000 7fd268c36640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2641094f0 0x7fd26419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.977+0000 7fd268c36640 1 --2- 172.21.15.7:0/2418656767 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd264103bb0 0x7fd26419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.977+0000 7fd268c36640 1 -- 172.21.15.7:0/2418656767 >> 172.21.15.7:0/2418656767 conn(0x7fd2640ff600 msgr2=0x7fd264101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.977+0000 7fd268c36640 1 -- 172.21.15.7:0/2418656767 shutdown_connections 2024-09-21T06:00:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:15.977+0000 7fd268c36640 1 -- 172.21.15.7:0/2418656767 wait complete. 2024-09-21T06:00:16.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:16 smithi007 ceph-mon[30983]: pgmap v510: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:00:16.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:16 smithi119 ceph-mon[34833]: pgmap v510: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:00:16.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:00:16.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:16 smithi027 ceph-mon[34364]: pgmap v510: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:00:16.920 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:17.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.378+0000 7f7c5c9a8640 1 -- 172.21.15.7:0/1742149232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c58102a80 msgr2=0x7f7c58102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:17.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.378+0000 7f7c5c9a8640 1 --2- 172.21.15.7:0/1742149232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c58102a80 0x7f7c58102e90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009900 tx=0x7f7c4802a410 comp rx=0 tx=0).stop 2024-09-21T06:00:17.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.378+0000 7f7c5c9a8640 1 -- 172.21.15.7:0/1742149232 shutdown_connections 2024-09-21T06:00:17.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.378+0000 7f7c5c9a8640 1 --2- 172.21.15.7:0/1742149232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c58108d10 0x7f7c5810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.378+0000 7f7c5c9a8640 1 --2- 172.21.15.7:0/1742149232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c581083c0 0x7f7c581087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.378+0000 7f7c5c9a8640 1 --2- 172.21.15.7:0/1742149232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c58102a80 0x7f7c58102e90 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.378+0000 7f7c5c9a8640 1 -- 172.21.15.7:0/1742149232 >> 172.21.15.7:0/1742149232 conn(0x7f7c58079740 msgr2=0x7f7c58079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:17.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.378+0000 7f7c5c9a8640 1 -- 172.21.15.7:0/1742149232 shutdown_connections 2024-09-21T06:00:17.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.378+0000 7f7c5c9a8640 1 -- 172.21.15.7:0/1742149232 wait complete. 2024-09-21T06:00:17.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.379+0000 7f7c5c9a8640 1 Processor -- start 2024-09-21T06:00:17.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.379+0000 7f7c5c9a8640 1 -- start start 2024-09-21T06:00:17.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c5c9a8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c58102a80 0x7f7c5819b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c5c9a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c581083c0 0x7f7c5819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c5c9a8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58108d10 0x7f7c5819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c5c9a8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7c58112980 con 0x7f7c581083c0 2024-09-21T06:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c5c9a8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7c58112800 con 0x7f7c58108d10 2024-09-21T06:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c5c9a8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7c58112b00 con 0x7f7c58102a80 2024-09-21T06:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c55d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c581083c0 0x7f7c5819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c55d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c581083c0 0x7f7c5819b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56834/0 (socket says 172.21.15.7:56834) 2024-09-21T06:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c55d9b640 1 -- 172.21.15.7:0/3152403861 learned_addr learned my addr 172.21.15.7:0/3152403861 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c5659c640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c58102a80 0x7f7c5819b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c56d9d640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58108d10 0x7f7c5819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c55d9b640 1 -- 172.21.15.7:0/3152403861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c58102a80 msgr2=0x7f7c5819b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c55d9b640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c58102a80 0x7f7c5819b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c55d9b640 1 -- 172.21.15.7:0/3152403861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58108d10 msgr2=0x7f7c5819bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c55d9b640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58108d10 0x7f7c5819bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c55d9b640 1 -- 172.21.15.7:0/3152403861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c581a65a0 con 0x7f7c581083c0 2024-09-21T06:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c5659c640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c58102a80 0x7f7c5819b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.380+0000 7f7c55d9b640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c581083c0 0x7f7c5819b850 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c005fd0 tx=0x7f7c4c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.381+0000 7f7c477fe640 1 -- 172.21.15.7:0/3152403861 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c017070 con 0x7f7c581083c0 2024-09-21T06:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.381+0000 7f7c477fe640 1 -- 172.21.15.7:0/3152403861 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c4c009c30 con 0x7f7c581083c0 2024-09-21T06:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.381+0000 7f7c477fe640 1 -- 172.21.15.7:0/3152403861 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c003d30 con 0x7f7c581083c0 2024-09-21T06:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.381+0000 7f7c5c9a8640 1 -- 172.21.15.7:0/3152403861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c581a6890 con 0x7f7c581083c0 2024-09-21T06:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.381+0000 7f7c5c9a8640 1 -- 172.21.15.7:0/3152403861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c581a6dd0 con 0x7f7c581083c0 2024-09-21T06:00:17.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.383+0000 7f7c62f1c740 1 Processor -- start 2024-09-21T06:00:17.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.384+0000 7f7c62f1c740 1 -- start start 2024-09-21T06:00:17.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.384+0000 7f7c477fe640 1 -- 172.21.15.7:0/3152403861 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7c4c003ed0 con 0x7f7c581083c0 2024-09-21T06:00:17.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.384+0000 7f7c62f1c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 0x558cc40fc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.384+0000 7f7c62f1c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d2c1b0 0x558cc40fcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.384+0000 7f7c62f1c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d34390 0x558cc40fd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.384+0000 7f7c62f1c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558cc4072ea0 con 0x558cc3d55070 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.384+0000 7f7c62f1c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558cc40622d0 con 0x558cc3d2c1b0 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.384+0000 7f7c62f1c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558cc40660e0 con 0x558cc3d34390 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.384+0000 7f7c56d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 0x558cc40fc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.384+0000 7f7c56d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 0x558cc40fc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56838/0 (socket says 172.21.15.7:56838) 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.384+0000 7f7c56d9d640 1 -- 172.21.15.7:0/517358523 learned_addr learned my addr 172.21.15.7:0/517358523 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.384+0000 7f7c5659c640 1 --2- 172.21.15.7:0/517358523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d2c1b0 0x558cc40fcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.384+0000 7f7c55d9b640 1 --2- 172.21.15.7:0/517358523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d34390 0x558cc40fd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.385+0000 7f7c56d9d640 1 -- 172.21.15.7:0/517358523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d34390 msgr2=0x558cc40fd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.385+0000 7f7c56d9d640 1 --2- 172.21.15.7:0/517358523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d34390 0x558cc40fd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.385+0000 7f7c56d9d640 1 -- 172.21.15.7:0/517358523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d2c1b0 msgr2=0x558cc40fcbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.385+0000 7f7c56d9d640 1 --2- 172.21.15.7:0/517358523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d2c1b0 0x558cc40fcbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.385+0000 7f7c56d9d640 1 -- 172.21.15.7:0/517358523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc3dc0650 con 0x558cc3d55070 2024-09-21T06:00:17.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.385+0000 7f7c56d9d640 1 --2- 172.21.15.7:0/517358523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 0x558cc40fc6a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f7c50008c80 tx=0x7f7c5000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ceae329ee284fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:17.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.385+0000 7f7c44ff9640 1 -- 172.21.15.7:0/517358523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50018680 con 0x558cc3d55070 2024-09-21T06:00:17.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.385+0000 7f7c44ff9640 1 -- 172.21.15.7:0/517358523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c50018cd0 con 0x558cc3d55070 2024-09-21T06:00:17.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.385+0000 7f7c44ff9640 1 -- 172.21.15.7:0/517358523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000fd20 con 0x558cc3d55070 2024-09-21T06:00:17.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.385+0000 7f7c477fe640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7c400b66b0 0x7f7c400b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.385+0000 7f7c5659c640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7c400b66b0 0x7f7c400b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.386+0000 7f7c477fe640 1 -- 172.21.15.7:0/3152403861 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7f7c4c0e7400 con 0x7f7c581083c0 2024-09-21T06:00:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.386+0000 7f7c62f1c740 1 -- 172.21.15.7:0/517358523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 msgr2=0x558cc40fc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.386+0000 7f7c5659c640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7c400b66b0 0x7f7c400b8bc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7c48005ab0 tx=0x7f7c48005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.386+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/517358523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 0x558cc40fc6a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f7c50008c80 tx=0x7f7c5000d710 comp rx=0 tx=0).stop 2024-09-21T06:00:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.386+0000 7f7c62f1c740 1 -- 172.21.15.7:0/517358523 shutdown_connections 2024-09-21T06:00:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.386+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/517358523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d34390 0x558cc40fd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.386+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/517358523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d2c1b0 0x558cc40fcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.386+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/517358523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 0x558cc40fc6a0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.386+0000 7f7c62f1c740 1 -- 172.21.15.7:0/517358523 >> 172.21.15.7:0/517358523 conn(0x558cc3d49460 msgr2=0x558cc40fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.386+0000 7f7c62f1c740 1 -- 172.21.15.7:0/517358523 shutdown_connections 2024-09-21T06:00:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.386+0000 7f7c62f1c740 1 -- 172.21.15.7:0/517358523 wait complete. 2024-09-21T06:00:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.387+0000 7f7c62f1c740 1 -- start start 2024-09-21T06:00:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.387+0000 7f7c62f1c740 1 Processor -- start 2024-09-21T06:00:17.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.387+0000 7f7c62f1c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d2c1b0 0x558cc4107de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.387+0000 7f7c62f1c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d34390 0x558cc4108320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.387+0000 7f7c62f1c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 0x558cc4114170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.387+0000 7f7c62f1c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558cc3ec3700 con 0x558cc3d55070 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.387+0000 7f7c62f1c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558cc3ffd160 con 0x558cc3d34390 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.387+0000 7f7c62f1c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558cc410ae80 con 0x558cc3d2c1b0 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.387+0000 7f7c62f1c740 10 client.0 _ll_register_callbacks cb 0x558cc40169e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.387+0000 7f7c56d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 0x558cc4114170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c56d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 0x558cc4114170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56846/0 (socket says 172.21.15.7:56846) 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c55d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d34390 0x558cc4108320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c56d9d640 1 -- 172.21.15.7:0/2517976666 learned_addr learned my addr 172.21.15.7:0/2517976666 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c5659c640 1 --2- 172.21.15.7:0/2517976666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d2c1b0 0x558cc4107de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c56d9d640 1 -- 172.21.15.7:0/2517976666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d2c1b0 msgr2=0x558cc4107de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c56d9d640 1 --2- 172.21.15.7:0/2517976666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d2c1b0 0x558cc4107de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c56d9d640 1 -- 172.21.15.7:0/2517976666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d34390 msgr2=0x558cc4108320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c56d9d640 1 --2- 172.21.15.7:0/2517976666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d34390 0x558cc4108320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c56d9d640 1 -- 172.21.15.7:0/2517976666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc402ac90 con 0x558cc3d55070 2024-09-21T06:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c5659c640 1 --2- 172.21.15.7:0/2517976666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d2c1b0 0x558cc4107de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c56d9d640 1 --2- 172.21.15.7:0/2517976666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 0x558cc4114170 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000f660 tx=0x7f7c500089a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23891b076eb391d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c3dffb640 1 -- 172.21.15.7:0/2517976666 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50028060 con 0x558cc3d55070 2024-09-21T06:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c3dffb640 1 -- 172.21.15.7:0/2517976666 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7f7c50018480 con 0x558cc3d55070 2024-09-21T06:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.388+0000 7f7c62f1c740 1 -- 172.21.15.7:0/2517976666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c50018cd0 con 0x558cc3d55070 2024-09-21T06:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.389+0000 7f7c3dffb640 1 -- 172.21.15.7:0/2517976666 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7c50004e50 con 0x558cc3d55070 2024-09-21T06:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.389+0000 7f7c62f1c740 10 client.17100 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.389+0000 7f7c62f1c740 1 -- 172.21.15.7:0/2517976666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558cc4116bc0 con 0x558cc3d55070 2024-09-21T06:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.389+0000 7f7c3dffb640 1 -- 172.21.15.7:0/2517976666 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c50018cd0 con 0x558cc3d55070 2024-09-21T06:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.389+0000 7f7c3dffb640 1 -- 172.21.15.7:0/2517976666 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7c50005610 con 0x558cc3d55070 2024-09-21T06:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.389+0000 7f7c62f1c740 10 client.17100 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.389+0000 7f7c62f1c740 10 client.17100 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.389+0000 7f7c62f1c740 20 client.17100 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.389+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/2517976666 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x558cc3d139f0 0x558cc4119fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.389+0000 7f7c62f1c740 4 client.17100 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.389+0000 7f7c62f1c740 1 -- 172.21.15.7:0/2517976666 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cc4074df0 con 0x558cc3d139f0 2024-09-21T06:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.389+0000 7f7c5659c640 1 --2- 172.21.15.7:0/2517976666 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x558cc3d139f0 0x558cc4119fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.390+0000 7f7c3dffb640 10 client.17100 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.390+0000 7f7c5659c640 1 --2- 172.21.15.7:0/2517976666 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x558cc3d139f0 0x558cc4119fd0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9011ccd340f7cef6 server_cookie=dd4994e99e7c3d1e in_seq=0 out_seq=0 2024-09-21T06:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c3dffb640 1 -- 172.21.15.7:0/2517976666 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558cc4074df0 con 0x558cc3d139f0 2024-09-21T06:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c3dffb640 10 client.17100 handle_command_reply: tid=0 2024-09-21T06:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c62f1c740 1 client.17100 shutdown 2024-09-21T06:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c62f1c740 1 -- 172.21.15.7:0/2517976666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 msgr2=0x558cc4114170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/2517976666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 0x558cc4114170 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000f660 tx=0x7f7c500089a0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c62f1c740 1 -- 172.21.15.7:0/2517976666 shutdown_connections 2024-09-21T06:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/2517976666 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x558cc3d139f0 0x558cc4119fd0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/2517976666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d55070 0x558cc4114170 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/2517976666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d34390 0x558cc4108320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c3dffb640 0 client.17100 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:17.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/2517976666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d2c1b0 0x558cc4107de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c62f1c740 1 -- 172.21.15.7:0/2517976666 >> 172.21.15.7:0/2517976666 conn(0x558cc3d49460 msgr2=0x558cc40ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:17.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c62f1c740 1 -- 172.21.15.7:0/2517976666 shutdown_connections 2024-09-21T06:00:17.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c62f1c740 1 -- 172.21.15.7:0/2517976666 wait complete. 2024-09-21T06:00:17.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.391+0000 7f7c62f1c740 20 client.17100 trim_cache size 0 max 16384 2024-09-21T06:00:17.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.404+0000 7f7c62f1c740 1 Processor -- start 2024-09-21T06:00:17.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.404+0000 7f7c62f1c740 1 -- start start 2024-09-21T06:00:17.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c62f1c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d2c1b0 0x558cc4109a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c62f1c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d34390 0x558cc4104fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c62f1c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d55070 0x558cc4105510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c62f1c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7c581b20c0 con 0x558cc3d34390 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c62f1c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7c581af990 con 0x558cc3d55070 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c62f1c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7c581ad800 con 0x558cc3d2c1b0 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c55d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d34390 0x558cc4104fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c55d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d34390 0x558cc4104fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56852/0 (socket says 172.21.15.7:56852) 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c55d9b640 1 -- 172.21.15.7:0/3657740849 learned_addr learned my addr 172.21.15.7:0/3657740849 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c5659c640 1 --2- 172.21.15.7:0/3657740849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d2c1b0 0x558cc4109a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c56d9d640 1 --2- 172.21.15.7:0/3657740849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d55070 0x558cc4105510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c55d9b640 1 -- 172.21.15.7:0/3657740849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d2c1b0 msgr2=0x558cc4109a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c55d9b640 1 --2- 172.21.15.7:0/3657740849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d2c1b0 0x558cc4109a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c55d9b640 1 -- 172.21.15.7:0/3657740849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d55070 msgr2=0x558cc4105510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c55d9b640 1 --2- 172.21.15.7:0/3657740849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d55070 0x558cc4105510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c55d9b640 1 -- 172.21.15.7:0/3657740849 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc40febe0 con 0x558cc3d34390 2024-09-21T06:00:17.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c5659c640 1 --2- 172.21.15.7:0/3657740849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d2c1b0 0x558cc4109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:17.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c56d9d640 1 --2- 172.21.15.7:0/3657740849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d55070 0x558cc4105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:17.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c55d9b640 1 --2- 172.21.15.7:0/3657740849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d34390 0x558cc4104fd0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c009610 tx=0x7f7c4c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e2addf5084ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:17.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.405+0000 7f7c3ffff640 1 -- 172.21.15.7:0/3657740849 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c009de0 con 0x558cc3d34390 2024-09-21T06:00:17.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.406+0000 7f7c3ffff640 1 -- 172.21.15.7:0/3657740849 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c4c0ad970 con 0x558cc3d34390 2024-09-21T06:00:17.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.406+0000 7f7c3ffff640 1 -- 172.21.15.7:0/3657740849 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c022b70 con 0x558cc3d34390 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.406+0000 7f7c62f1c740 1 -- 172.21.15.7:0/3657740849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d34390 msgr2=0x558cc4104fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.406+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/3657740849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d34390 0x558cc4104fd0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c009610 tx=0x7f7c4c00bf60 comp rx=0 tx=0).stop 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.406+0000 7f7c62f1c740 1 -- 172.21.15.7:0/3657740849 shutdown_connections 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.406+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/3657740849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d34390 0x558cc4104fd0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.406+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/3657740849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d55070 0x558cc4105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.406+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/3657740849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d2c1b0 0x558cc4109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.406+0000 7f7c62f1c740 1 -- 172.21.15.7:0/3657740849 >> 172.21.15.7:0/3657740849 conn(0x558cc3d49460 msgr2=0x558cc4109300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.406+0000 7f7c62f1c740 1 -- 172.21.15.7:0/3657740849 shutdown_connections 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.406+0000 7f7c62f1c740 1 -- 172.21.15.7:0/3657740849 wait complete. 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.407+0000 7f7c62f1c740 1 -- start start 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.407+0000 7f7c62f1c740 1 Processor -- start 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.407+0000 7f7c62f1c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d2c1b0 0x558cc41106b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.407+0000 7f7c62f1c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d34390 0x558cc417f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.407+0000 7f7c62f1c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d55070 0x558cc417fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.407+0000 7f7c62f1c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7c581ade50 con 0x558cc3d2c1b0 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.407+0000 7f7c62f1c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7c581af2c0 con 0x558cc3d55070 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.407+0000 7f7c62f1c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7c581ae520 con 0x558cc3d34390 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.407+0000 7f7c62f1c740 10 client.0 _ll_register_callbacks cb 0x7f7c48009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.407+0000 7f7c5659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d2c1b0 0x558cc41106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.407+0000 7f7c5659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d2c1b0 0x558cc41106b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56864/0 (socket says 172.21.15.7:56864) 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.407+0000 7f7c5659c640 1 -- 172.21.15.7:0/3109048266 learned_addr learned my addr 172.21.15.7:0/3109048266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c55d9b640 1 --2- 172.21.15.7:0/3109048266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d34390 0x558cc417f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c56d9d640 1 --2- 172.21.15.7:0/3109048266 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d55070 0x558cc417fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c5659c640 1 -- 172.21.15.7:0/3109048266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d34390 msgr2=0x558cc417f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c5659c640 1 --2- 172.21.15.7:0/3109048266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d34390 0x558cc417f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c5659c640 1 -- 172.21.15.7:0/3109048266 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d55070 msgr2=0x558cc417fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c5659c640 1 --2- 172.21.15.7:0/3109048266 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d55070 0x558cc417fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c5659c640 1 -- 172.21.15.7:0/3109048266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc4180290 con 0x558cc3d2c1b0 2024-09-21T06:00:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c5659c640 1 --2- 172.21.15.7:0/3109048266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d2c1b0 0x558cc41106b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f7c5806c6a0 tx=0x7f7c4802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ecb9db63897587 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c3dffb640 1 -- 172.21.15.7:0/3109048266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48055020 con 0x558cc3d2c1b0 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c62f1c740 1 -- 172.21.15.7:0/3109048266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c4c0ad970 con 0x558cc3d2c1b0 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c3dffb640 1 -- 172.21.15.7:0/3109048266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8485+0+0 (secure 0 0 0) 0x7f7c480043d0 con 0x558cc3d2c1b0 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c3dffb640 1 -- 172.21.15.7:0/3109048266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7c48060050 con 0x558cc3d2c1b0 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c62f1c740 10 client.17106 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.408+0000 7f7c62f1c740 1 -- 172.21.15.7:0/3109048266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558cc410e950 con 0x558cc3d2c1b0 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.409+0000 7f7c3dffb640 1 -- 172.21.15.7:0/3109048266 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c4c0ad970 con 0x558cc3d2c1b0 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.409+0000 7f7c3dffb640 1 -- 172.21.15.7:0/3109048266 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7c48004ca0 con 0x558cc3d2c1b0 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.409+0000 7f7c62f1c740 10 client.17106 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.409+0000 7f7c62f1c740 10 client.17106 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.409+0000 7f7c62f1c740 20 client.17106 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.409+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/3109048266 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x558cc3ce8da0 0x558cc418b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:17.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.409+0000 7f7c62f1c740 4 client.17106 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.409+0000 7f7c62f1c740 1 -- 172.21.15.7:0/3109048266 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558cc40708a0 con 0x558cc3ce8da0 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.409+0000 7f7c55d9b640 1 --2- 172.21.15.7:0/3109048266 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x558cc3ce8da0 0x558cc418b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c55d9b640 1 --2- 172.21.15.7:0/3109048266 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x558cc3ce8da0 0x558cc418b100 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=89f9d7bb3b9f6620 server_cookie=17d8c502d17c24e in_seq=0 out_seq=0 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c3dffb640 10 client.17106 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c3dffb640 1 -- 172.21.15.7:0/3109048266 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558cc40708a0 con 0x558cc3ce8da0 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c3dffb640 10 client.17106 handle_command_reply: tid=0 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c62f1c740 1 client.17106 shutdown 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c62f1c740 1 -- 172.21.15.7:0/3109048266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d2c1b0 msgr2=0x558cc41106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/3109048266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d2c1b0 0x558cc41106b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f7c5806c6a0 tx=0x7f7c4802a410 comp rx=0 tx=0).stop 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c62f1c740 1 -- 172.21.15.7:0/3109048266 shutdown_connections 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/3109048266 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x558cc3ce8da0 0x558cc418b100 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/3109048266 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558cc3d55070 0x558cc417fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c3dffb640 0 client.17106 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:17.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/3109048266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558cc3d34390 0x558cc417f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c62f1c740 1 --2- 172.21.15.7:0/3109048266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cc3d2c1b0 0x558cc41106b0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c62f1c740 1 -- 172.21.15.7:0/3109048266 >> 172.21.15.7:0/3109048266 conn(0x558cc3d49460 msgr2=0x558cc4109c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:17.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c62f1c740 1 -- 172.21.15.7:0/3109048266 shutdown_connections 2024-09-21T06:00:17.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c62f1c740 1 -- 172.21.15.7:0/3109048266 wait complete. 2024-09-21T06:00:17.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.410+0000 7f7c62f1c740 20 client.17106 trim_cache size 0 max 16384 2024-09-21T06:00:17.417 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:17.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.411+0000 7f7c5c9a8640 1 -- 172.21.15.7:0/3152403861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7c400b66b0 msgr2=0x7f7c400b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:17.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.411+0000 7f7c5c9a8640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7c400b66b0 0x7f7c400b8bc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7c48005ab0 tx=0x7f7c48005a20 comp rx=0 tx=0).stop 2024-09-21T06:00:17.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.411+0000 7f7c5c9a8640 1 -- 172.21.15.7:0/3152403861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c581083c0 msgr2=0x7f7c5819b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:17.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.411+0000 7f7c5c9a8640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c581083c0 0x7f7c5819b850 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c005fd0 tx=0x7f7c4c00dde0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.411+0000 7f7c5c9a8640 1 -- 172.21.15.7:0/3152403861 shutdown_connections 2024-09-21T06:00:17.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.411+0000 7f7c5c9a8640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7c400b66b0 0x7f7c400b8bc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.411+0000 7f7c5c9a8640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c581083c0 0x7f7c5819b850 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.411+0000 7f7c5c9a8640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c58108d10 0x7f7c5819bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.411+0000 7f7c5c9a8640 1 --2- 172.21.15.7:0/3152403861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c58102a80 0x7f7c5819b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:17.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.411+0000 7f7c5c9a8640 1 -- 172.21.15.7:0/3152403861 >> 172.21.15.7:0/3152403861 conn(0x7f7c58079740 msgr2=0x7f7c58101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:17.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.411+0000 7f7c5c9a8640 1 -- 172.21.15.7:0/3152403861 shutdown_connections 2024-09-21T06:00:17.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:17.411+0000 7f7c5c9a8640 1 -- 172.21.15.7:0/3152403861 wait complete. 2024-09-21T06:00:18.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:00:18.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:18 smithi007 ceph-mon[30983]: pgmap v511: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:00:18.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:18 smithi007 ceph-mon[30983]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:00:18.329 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:18.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:18 smithi119 ceph-mon[34833]: pgmap v511: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:00:18.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:18 smithi119 ceph-mon[34833]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:00:18.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:18 smithi027 ceph-mon[34364]: pgmap v511: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:00:18.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:18 smithi027 ceph-mon[34364]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:00:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.820+0000 7f4db237f640 1 -- 172.21.15.7:0/123305040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1049b0 msgr2=0x7f4dac104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.820+0000 7f4db237f640 1 --2- 172.21.15.7:0/123305040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1049b0 0x7f4dac104dc0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009900 tx=0x7f4d9c02a410 comp rx=0 tx=0).stop 2024-09-21T06:00:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.820+0000 7f4db237f640 1 -- 172.21.15.7:0/123305040 shutdown_connections 2024-09-21T06:00:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.820+0000 7f4db237f640 1 --2- 172.21.15.7:0/123305040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4dac10de10 0x7f4dac110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.820+0000 7f4db237f640 1 --2- 172.21.15.7:0/123305040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dac105300 0x7f4dac10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.820+0000 7f4db237f640 1 --2- 172.21.15.7:0/123305040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1049b0 0x7f4dac104dc0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.820+0000 7f4db237f640 1 -- 172.21.15.7:0/123305040 >> 172.21.15.7:0/123305040 conn(0x7f4dac079730 msgr2=0x7f4dac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:18.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.820+0000 7f4db237f640 1 -- 172.21.15.7:0/123305040 shutdown_connections 2024-09-21T06:00:18.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.820+0000 7f4db237f640 1 -- 172.21.15.7:0/123305040 wait complete. 2024-09-21T06:00:18.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.821+0000 7f4db237f640 1 Processor -- start 2024-09-21T06:00:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.821+0000 7f4db237f640 1 -- start start 2024-09-21T06:00:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.821+0000 7f4db237f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1049b0 0x7f4dac19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.821+0000 7f4db237f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dac105300 0x7f4dac19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.821+0000 7f4db237f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4dac10de10 0x7f4dac19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.821+0000 7f4db237f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac113ad0 con 0x7f4dac1049b0 2024-09-21T06:00:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.821+0000 7f4db237f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac113950 con 0x7f4dac10de10 2024-09-21T06:00:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.821+0000 7f4db237f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac113c50 con 0x7f4dac105300 2024-09-21T06:00:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.821+0000 7f4dabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1049b0 0x7f4dac19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.821+0000 7f4dabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1049b0 0x7f4dac19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40318/0 (socket says 172.21.15.7:40318) 2024-09-21T06:00:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.821+0000 7f4dabfff640 1 -- 172.21.15.7:0/1453897026 learned_addr learned my addr 172.21.15.7:0/1453897026 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.822+0000 7f4db091c640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4dac10de10 0x7f4dac19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.822+0000 7f4da3fff640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dac105300 0x7f4dac19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.822+0000 7f4dabfff640 1 -- 172.21.15.7:0/1453897026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dac105300 msgr2=0x7f4dac19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.822+0000 7f4dabfff640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dac105300 0x7f4dac19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.822+0000 7f4dabfff640 1 -- 172.21.15.7:0/1453897026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4dac10de10 msgr2=0x7f4dac19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.822+0000 7f4dabfff640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4dac10de10 0x7f4dac19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.822+0000 7f4dabfff640 1 -- 172.21.15.7:0/1453897026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dac1a0510 con 0x7f4dac1049b0 2024-09-21T06:00:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.822+0000 7f4dabfff640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1049b0 0x7f4dac19a5a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c032fd0 tx=0x7f4d9c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.822+0000 7f4da9ffb640 1 -- 172.21.15.7:0/1453897026 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c03f030 con 0x7f4dac1049b0 2024-09-21T06:00:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.822+0000 7f4da9ffb640 1 -- 172.21.15.7:0/1453897026 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d9c004490 con 0x7f4dac1049b0 2024-09-21T06:00:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.822+0000 7f4da9ffb640 1 -- 172.21.15.7:0/1453897026 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c035070 con 0x7f4dac1049b0 2024-09-21T06:00:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.822+0000 7f4db237f640 1 -- 172.21.15.7:0/1453897026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dac1a07a0 con 0x7f4dac1049b0 2024-09-21T06:00:18.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.822+0000 7f4db237f640 1 -- 172.21.15.7:0/1453897026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dac1a6f60 con 0x7f4dac1049b0 2024-09-21T06:00:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.825+0000 7f4db88f3740 1 Processor -- start 2024-09-21T06:00:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.825+0000 7f4db88f3740 1 -- start start 2024-09-21T06:00:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.825+0000 7f4da9ffb640 1 -- 172.21.15.7:0/1453897026 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f4d9c042030 con 0x7f4dac1049b0 2024-09-21T06:00:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.825+0000 7f4db88f3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee9c070 0x56000f2476d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.825+0000 7f4db88f3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 0x56000f247c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.825+0000 7f4db88f3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee7b390 0x56000f248150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.825+0000 7f4db88f3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56000f1b9ea0 con 0x56000ee9c070 2024-09-21T06:00:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.825+0000 7f4db88f3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56000f1a92d0 con 0x56000ee731b0 2024-09-21T06:00:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.825+0000 7f4db88f3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56000f1ad0e0 con 0x56000ee7b390 2024-09-21T06:00:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4db091c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee9c070 0x56000f2476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4db091c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee9c070 0x56000f2476d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40330/0 (socket says 172.21.15.7:40330) 2024-09-21T06:00:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4db091c640 1 -- 172.21.15.7:0/2557810852 learned_addr learned my addr 172.21.15.7:0/2557810852 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4da3fff640 1 --2- 172.21.15.7:0/2557810852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee7b390 0x56000f248150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4dabfff640 1 --2- 172.21.15.7:0/2557810852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 0x56000f247c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4db091c640 1 -- 172.21.15.7:0/2557810852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee7b390 msgr2=0x56000f248150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4db091c640 1 --2- 172.21.15.7:0/2557810852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee7b390 0x56000f248150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4db091c640 1 -- 172.21.15.7:0/2557810852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 msgr2=0x56000f247c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4db091c640 1 --2- 172.21.15.7:0/2557810852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 0x56000f247c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4db091c640 1 -- 172.21.15.7:0/2557810852 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000ef07650 con 0x56000ee9c070 2024-09-21T06:00:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4da3fff640 1 --2- 172.21.15.7:0/2557810852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee7b390 0x56000f248150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4db091c640 1 --2- 172.21.15.7:0/2557810852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee9c070 0x56000f2476d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f4da4010370 tx=0x7f4da4010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac9d2cd05384093 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4da9ffb640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4d980b6700 0x7f4d980b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.826+0000 7f4da27fc640 1 -- 172.21.15.7:0/2557810852 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4016070 con 0x56000ee9c070 2024-09-21T06:00:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.827+0000 7f4da27fc640 1 -- 172.21.15.7:0/2557810852 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4da4004d20 con 0x56000ee9c070 2024-09-21T06:00:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.827+0000 7f4da27fc640 1 -- 172.21.15.7:0/2557810852 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4005350 con 0x56000ee9c070 2024-09-21T06:00:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.827+0000 7f4dabfff640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4d980b6700 0x7f4d980b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.827+0000 7f4da9ffb640 1 -- 172.21.15.7:0/1453897026 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f4d9c107b80 con 0x7f4dac1049b0 2024-09-21T06:00:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.828+0000 7f4db88f3740 1 -- 172.21.15.7:0/2557810852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee9c070 msgr2=0x56000f2476d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.828+0000 7f4dabfff640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4d980b6700 0x7f4d980b8c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c1053d0 tx=0x7f4d9c005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.828+0000 7f4db88f3740 1 --2- 172.21.15.7:0/2557810852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee9c070 0x56000f2476d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f4da4010370 tx=0x7f4da4010830 comp rx=0 tx=0).stop 2024-09-21T06:00:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.828+0000 7f4db88f3740 1 -- 172.21.15.7:0/2557810852 shutdown_connections 2024-09-21T06:00:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.828+0000 7f4db88f3740 1 --2- 172.21.15.7:0/2557810852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee7b390 0x56000f248150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.828+0000 7f4db88f3740 1 --2- 172.21.15.7:0/2557810852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 0x56000f247c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.828+0000 7f4db88f3740 1 --2- 172.21.15.7:0/2557810852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee9c070 0x56000f2476d0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.828+0000 7f4db88f3740 1 -- 172.21.15.7:0/2557810852 >> 172.21.15.7:0/2557810852 conn(0x56000ee90460 msgr2=0x56000f2455c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.828+0000 7f4db88f3740 1 -- 172.21.15.7:0/2557810852 shutdown_connections 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.828+0000 7f4db88f3740 1 -- 172.21.15.7:0/2557810852 wait complete. 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.828+0000 7f4db88f3740 1 -- start start 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.828+0000 7f4db88f3740 1 Processor -- start 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4db88f3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 0x56000f252df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4db88f3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 0x56000f253330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4db88f3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 0x56000f25f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4db88f3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56000f00a700 con 0x56000ee7b390 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4db88f3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56000f144160 con 0x56000ee731b0 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4db88f3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56000f255eb0 con 0x56000ee9c070 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4db88f3740 10 client.0 _ll_register_callbacks cb 0x56000f15d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4da3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 0x56000f253330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4da3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 0x56000f253330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40344/0 (socket says 172.21.15.7:40344) 2024-09-21T06:00:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4da3fff640 1 -- 172.21.15.7:0/3679790914 learned_addr learned my addr 172.21.15.7:0/3679790914 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4db091c640 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 0x56000f252df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4db091c640 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 0x56000f25f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4da3fff640 1 -- 172.21.15.7:0/3679790914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 msgr2=0x56000f25f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4da3fff640 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 0x56000f25f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4da3fff640 1 -- 172.21.15.7:0/3679790914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 msgr2=0x56000f252df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4da3fff640 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 0x56000f252df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4da3fff640 1 -- 172.21.15.7:0/3679790914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56000f171c90 con 0x56000ee7b390 2024-09-21T06:00:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.829+0000 7f4db091c640 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 0x56000f25f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.830+0000 7f4da3fff640 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 0x56000f253330 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400beb0 tx=0x7f4d9400f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ea62d61e577bab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.830+0000 7f4d8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.830+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/3679790914 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94019020 con 0x56000ee7b390 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.830+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/3679790914 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f4d94014660 con 0x56000ee7b390 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.830+0000 7f4db88f3740 1 -- 172.21.15.7:0/3679790914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4da4004d20 con 0x56000ee7b390 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.830+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/3679790914 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4d94024050 con 0x56000ee7b390 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.830+0000 7f4db88f3740 10 client.17118 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.830+0000 7f4db88f3740 1 -- 172.21.15.7:0/3679790914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56000f261c20 con 0x56000ee7b390 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.830+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/3679790914 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d94014d10 con 0x56000ee7b390 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.830+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/3679790914 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4d94015b90 con 0x56000ee7b390 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.831+0000 7f4db88f3740 10 client.17118 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.831+0000 7f4db88f3740 10 client.17118 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.831+0000 7f4db88f3740 20 client.17118 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.831+0000 7f4db88f3740 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56000ee5a9f0 0x56000f2651b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.831+0000 7f4db88f3740 4 client.17118 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.831+0000 7f4db88f3740 1 -- 172.21.15.7:0/3679790914 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4da4004d20 con 0x56000ee5a9f0 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.831+0000 7f4db091c640 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56000ee5a9f0 0x56000f2651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.832+0000 7f4d8b7fe640 10 client.17118 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.832+0000 7f4db091c640 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56000ee5a9f0 0x56000f2651b0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf9b001fb41aac4 server_cookie=ac38561b9c5bb44b in_seq=0 out_seq=0 2024-09-21T06:00:18.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.832+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/3679790914 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f4da4004d20 con 0x56000ee5a9f0 2024-09-21T06:00:18.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.832+0000 7f4d8b7fe640 10 client.17118 handle_command_reply: tid=0 2024-09-21T06:00:18.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.832+0000 7f4db88f3740 1 client.17118 shutdown 2024-09-21T06:00:18.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.833+0000 7f4db88f3740 1 -- 172.21.15.7:0/3679790914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 msgr2=0x56000f253330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:18.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.833+0000 7f4db88f3740 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 0x56000f253330 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400beb0 tx=0x7f4d9400f5b0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.833+0000 7f4db88f3740 1 -- 172.21.15.7:0/3679790914 shutdown_connections 2024-09-21T06:00:18.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.833+0000 7f4db88f3740 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56000ee5a9f0 0x56000f2651b0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.833+0000 7f4db88f3740 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 0x56000f253330 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.833+0000 7f4db88f3740 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 0x56000f25f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.833+0000 7f4db88f3740 1 --2- 172.21.15.7:0/3679790914 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 0x56000f252df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.833+0000 7f4db88f3740 1 -- 172.21.15.7:0/3679790914 >> 172.21.15.7:0/3679790914 conn(0x56000ee90460 msgr2=0x56000f24a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:18.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.833+0000 7f4d8b7fe640 0 client.17118 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.833+0000 7f4db88f3740 1 -- 172.21.15.7:0/3679790914 shutdown_connections 2024-09-21T06:00:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.833+0000 7f4db88f3740 1 -- 172.21.15.7:0/3679790914 wait complete. 2024-09-21T06:00:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.833+0000 7f4db88f3740 20 client.17118 trim_cache size 0 max 16384 2024-09-21T06:00:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.846+0000 7f4db88f3740 1 Processor -- start 2024-09-21T06:00:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.846+0000 7f4db88f3740 1 -- start start 2024-09-21T06:00:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.846+0000 7f4db88f3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee731b0 0x56000f24e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.846+0000 7f4db88f3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee7b390 0x56000f254a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.846+0000 7f4db88f3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 0x56000f25f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.846+0000 7f4db88f3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac1afd30 con 0x56000ee731b0 2024-09-21T06:00:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.846+0000 7f4db88f3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac1ad600 con 0x56000ee7b390 2024-09-21T06:00:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.846+0000 7f4db88f3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac1ab470 con 0x56000ee9c070 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.846+0000 7f4db091c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee731b0 0x56000f24e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.847+0000 7f4db091c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee731b0 0x56000f24e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40356/0 (socket says 172.21.15.7:40356) 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.847+0000 7f4db091c640 1 -- 172.21.15.7:0/201091775 learned_addr learned my addr 172.21.15.7:0/201091775 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.847+0000 7f4da3fff640 1 --2- 172.21.15.7:0/201091775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee7b390 0x56000f254a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.847+0000 7f4db091c640 1 --2- 172.21.15.7:0/201091775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 0x56000f25f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.847+0000 7f4db091c640 1 -- 172.21.15.7:0/201091775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 msgr2=0x56000f25f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.847+0000 7f4db091c640 1 --2- 172.21.15.7:0/201091775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 0x56000f25f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.847+0000 7f4db091c640 1 -- 172.21.15.7:0/201091775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee7b390 msgr2=0x56000f254a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.847+0000 7f4db091c640 1 --2- 172.21.15.7:0/201091775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee7b390 0x56000f254a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.847+0000 7f4db091c640 1 -- 172.21.15.7:0/201091775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000f24a530 con 0x56000ee731b0 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.847+0000 7f4db091c640 1 --2- 172.21.15.7:0/201091775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee731b0 0x56000f24e5a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009390 tx=0x7f4da4012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb891bd93f02527 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.847+0000 7f4da1ffb640 1 -- 172.21.15.7:0/201091775 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4016040 con 0x56000ee731b0 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.847+0000 7f4da1ffb640 1 -- 172.21.15.7:0/201091775 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4da40129c0 con 0x56000ee731b0 2024-09-21T06:00:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.847+0000 7f4da1ffb640 1 -- 172.21.15.7:0/201091775 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4023040 con 0x56000ee731b0 2024-09-21T06:00:18.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.848+0000 7f4db88f3740 1 -- 172.21.15.7:0/201091775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee731b0 msgr2=0x56000f24e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:18.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.848+0000 7f4db88f3740 1 --2- 172.21.15.7:0/201091775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee731b0 0x56000f24e5a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009390 tx=0x7f4da4012ea0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.848+0000 7f4db88f3740 1 -- 172.21.15.7:0/201091775 shutdown_connections 2024-09-21T06:00:18.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.848+0000 7f4db88f3740 1 --2- 172.21.15.7:0/201091775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 0x56000f25f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.848+0000 7f4db88f3740 1 --2- 172.21.15.7:0/201091775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee7b390 0x56000f254a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.848+0000 7f4db88f3740 1 --2- 172.21.15.7:0/201091775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee731b0 0x56000f24e5a0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.848+0000 7f4db88f3740 1 -- 172.21.15.7:0/201091775 >> 172.21.15.7:0/201091775 conn(0x56000ee90460 msgr2=0x56000f254310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:18.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.848+0000 7f4db88f3740 1 -- 172.21.15.7:0/201091775 shutdown_connections 2024-09-21T06:00:18.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.848+0000 7f4db88f3740 1 -- 172.21.15.7:0/201091775 wait complete. 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.848+0000 7f4db88f3740 1 -- start start 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4db88f3740 1 Processor -- start 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4db88f3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 0x56000f25b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4db88f3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 0x56000f256d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4db88f3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 0x56000f2572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4db88f3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac1abac0 con 0x56000ee7b390 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4db88f3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac1acf30 con 0x56000ee731b0 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4db88f3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac1ac190 con 0x56000ee9c070 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4db88f3740 10 client.0 _ll_register_callbacks cb 0x7f4d9400b1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4da3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 0x56000f256d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4da3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 0x56000f256d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40358/0 (socket says 172.21.15.7:40358) 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4da3fff640 1 -- 172.21.15.7:0/1897501327 learned_addr learned my addr 172.21.15.7:0/1897501327 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4db091c640 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 0x56000f2572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4db091c640 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 0x56000f25b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4da3fff640 1 -- 172.21.15.7:0/1897501327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 msgr2=0x56000f2572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4da3fff640 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 0x56000f2572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4da3fff640 1 -- 172.21.15.7:0/1897501327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 msgr2=0x56000f25b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.849+0000 7f4da3fff640 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 0x56000f25b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.850+0000 7f4da3fff640 1 -- 172.21.15.7:0/1897501327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56000f2579c0 con 0x56000ee7b390 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.850+0000 7f4db091c640 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 0x56000f25b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.850+0000 7f4da3fff640 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 0x56000f256d70 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4d94000c00 tx=0x7f4d94013780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef75f33a93a9974 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.850+0000 7f4d8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.850+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/1897501327 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94013d80 con 0x56000ee7b390 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.850+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/1897501327 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f4d94014460 con 0x56000ee7b390 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.850+0000 7f4db88f3740 1 -- 172.21.15.7:0/1897501327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4da40129c0 con 0x56000ee7b390 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.850+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/1897501327 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4d94038050 con 0x56000ee7b390 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.850+0000 7f4db88f3740 10 client.17124 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.850+0000 7f4db88f3740 1 -- 172.21.15.7:0/1897501327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56000f2cfa60 con 0x56000ee7b390 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.850+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/1897501327 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4da40129c0 con 0x56000ee7b390 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.851+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/1897501327 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4d9402a440 con 0x56000ee7b390 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.851+0000 7f4db88f3740 10 client.17124 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.851+0000 7f4db88f3740 10 client.17124 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.851+0000 7f4db88f3740 20 client.17124 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.851+0000 7f4db88f3740 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56000ee2fda0 0x56000f2d2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.851+0000 7f4db88f3740 4 client.17124 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.851+0000 7f4db88f3740 1 -- 172.21.15.7:0/1897501327 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56000f1bbdf0 con 0x56000ee2fda0 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.851+0000 7f4db091c640 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56000ee2fda0 0x56000f2d2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.851+0000 7f4d8b7fe640 10 client.17124 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.851+0000 7f4db091c640 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56000ee2fda0 0x56000f2d2240 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cbca67b77ba0363 server_cookie=f8440c5f960442e6 in_seq=0 out_seq=0 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4d8b7fe640 1 -- 172.21.15.7:0/1897501327 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56000f1bbdf0 con 0x56000ee2fda0 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4d8b7fe640 10 client.17124 handle_command_reply: tid=0 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4db88f3740 1 client.17124 shutdown 2024-09-21T06:00:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4db88f3740 1 -- 172.21.15.7:0/1897501327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 msgr2=0x56000f256d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4db88f3740 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 0x56000f256d70 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4d94000c00 tx=0x7f4d94013780 comp rx=0 tx=0).stop 2024-09-21T06:00:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4db88f3740 1 -- 172.21.15.7:0/1897501327 shutdown_connections 2024-09-21T06:00:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4db88f3740 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56000ee2fda0 0x56000f2d2240 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4db88f3740 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56000ee7b390 0x56000f256d70 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4db88f3740 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56000ee9c070 0x56000f2572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4db88f3740 1 --2- 172.21.15.7:0/1897501327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56000ee731b0 0x56000f25b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4db88f3740 1 -- 172.21.15.7:0/1897501327 >> 172.21.15.7:0/1897501327 conn(0x56000ee90460 msgr2=0x56000f254230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4d8b7fe640 0 client.17124 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4db88f3740 1 -- 172.21.15.7:0/1897501327 shutdown_connections 2024-09-21T06:00:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4db88f3740 1 -- 172.21.15.7:0/1897501327 wait complete. 2024-09-21T06:00:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.852+0000 7f4db88f3740 20 client.17124 trim_cache size 0 max 16384 2024-09-21T06:00:18.859 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.853+0000 7f4db237f640 1 -- 172.21.15.7:0/1453897026 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4d980b6700 msgr2=0x7f4d980b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.853+0000 7f4db237f640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4d980b6700 0x7f4d980b8c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c1053d0 tx=0x7f4d9c005fd0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.853+0000 7f4db237f640 1 -- 172.21.15.7:0/1453897026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1049b0 msgr2=0x7f4dac19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.853+0000 7f4db237f640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1049b0 0x7f4dac19a5a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c032fd0 tx=0x7f4d9c004270 comp rx=0 tx=0).stop 2024-09-21T06:00:18.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.853+0000 7f4db237f640 1 -- 172.21.15.7:0/1453897026 shutdown_connections 2024-09-21T06:00:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.853+0000 7f4db237f640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4d980b6700 0x7f4d980b8c10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.853+0000 7f4db237f640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4dac10de10 0x7f4dac19fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.853+0000 7f4db237f640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dac105300 0x7f4dac19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.853+0000 7f4db237f640 1 --2- 172.21.15.7:0/1453897026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1049b0 0x7f4dac19a5a0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.853+0000 7f4db237f640 1 -- 172.21.15.7:0/1453897026 >> 172.21.15.7:0/1453897026 conn(0x7f4dac079730 msgr2=0x7f4dac0ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.853+0000 7f4db237f640 1 -- 172.21.15.7:0/1453897026 shutdown_connections 2024-09-21T06:00:18.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:18.853+0000 7f4db237f640 1 -- 172.21.15.7:0/1453897026 wait complete. 2024-09-21T06:00:20.510 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:00:20.510 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:00:20.539 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:20 smithi007 ceph-mon[30983]: pgmap v513: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:00:20.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:20 smithi119 ceph-mon[34833]: pgmap v513: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:00:20.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:20 smithi027 ceph-mon[34364]: pgmap v513: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:00:20.784 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:21.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.291+0000 7fb8fae14640 1 -- 172.21.15.7:0/708530534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4109df0 msgr2=0x7fb8f4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:21.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.291+0000 7fb8fae14640 1 --2- 172.21.15.7:0/708530534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4109df0 0x7fb8f4110620 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009ca0 tx=0x7fb8ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.291+0000 7fb8fae14640 1 -- 172.21.15.7:0/708530534 shutdown_connections 2024-09-21T06:00:21.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.291+0000 7fb8fae14640 1 --2- 172.21.15.7:0/708530534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4109df0 0x7fb8f4110620 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.291+0000 7fb8fae14640 1 --2- 172.21.15.7:0/708530534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8f41094a0 0x7fb8f41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.291+0000 7fb8fae14640 1 --2- 172.21.15.7:0/708530534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8f4103b60 0x7fb8f4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.291+0000 7fb8fae14640 1 -- 172.21.15.7:0/708530534 >> 172.21.15.7:0/708530534 conn(0x7fb8f407b850 msgr2=0x7fb8f407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:21.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.291+0000 7fb8fae14640 1 -- 172.21.15.7:0/708530534 shutdown_connections 2024-09-21T06:00:21.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.291+0000 7fb8fae14640 1 -- 172.21.15.7:0/708530534 wait complete. 2024-09-21T06:00:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.292+0000 7fb8fae14640 1 Processor -- start 2024-09-21T06:00:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.292+0000 7fb8fae14640 1 -- start start 2024-09-21T06:00:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.292+0000 7fb8fae14640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8f4103b60 0x7fb8f419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.292+0000 7fb8fae14640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8f41094a0 0x7fb8f419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.292+0000 7fb8fae14640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4109df0 0x7fb8f41a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.292+0000 7fb8fae14640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f4113ab0 con 0x7fb8f4109df0 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.292+0000 7fb8fae14640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f4113930 con 0x7fb8f41094a0 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.292+0000 7fb8fae14640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f4113c30 con 0x7fb8f4103b60 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.292+0000 7fb8f93b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4109df0 0x7fb8f41a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.292+0000 7fb8f93b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4109df0 0x7fb8f41a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40380/0 (socket says 172.21.15.7:40380) 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.292+0000 7fb8f93b1640 1 -- 172.21.15.7:0/346331096 learned_addr learned my addr 172.21.15.7:0/346331096 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.292+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8f41094a0 0x7fb8f419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.292+0000 7fb8f8bb0640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8f4103b60 0x7fb8f419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.293+0000 7fb8f93b1640 1 -- 172.21.15.7:0/346331096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8f4103b60 msgr2=0x7fb8f419c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.293+0000 7fb8f93b1640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8f4103b60 0x7fb8f419c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.293+0000 7fb8f93b1640 1 -- 172.21.15.7:0/346331096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8f41094a0 msgr2=0x7fb8f419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.293+0000 7fb8f93b1640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8f41094a0 0x7fb8f419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.293+0000 7fb8f93b1640 1 -- 172.21.15.7:0/346331096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f41a2630 con 0x7fb8f4109df0 2024-09-21T06:00:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.293+0000 7fb8f8bb0640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8f4103b60 0x7fb8f419c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.293+0000 7fb8f93b1640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4109df0 0x7fb8f41a1f00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec005cc0 tx=0x7fb8ec02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.293+0000 7fb8f1ffb640 1 -- 172.21.15.7:0/346331096 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec003bf0 con 0x7fb8f4109df0 2024-09-21T06:00:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.293+0000 7fb8f1ffb640 1 -- 172.21.15.7:0/346331096 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8ec003d90 con 0x7fb8f4109df0 2024-09-21T06:00:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.293+0000 7fb8fae14640 1 -- 172.21.15.7:0/346331096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f41a28c0 con 0x7fb8f4109df0 2024-09-21T06:00:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.293+0000 7fb8f1ffb640 1 -- 172.21.15.7:0/346331096 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec02fbc0 con 0x7fb8f4109df0 2024-09-21T06:00:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.293+0000 7fb8fae14640 1 -- 172.21.15.7:0/346331096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f41a9080 con 0x7fb8f4109df0 2024-09-21T06:00:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.296+0000 7fb901388740 1 Processor -- start 2024-09-21T06:00:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.296+0000 7fb8f1ffb640 1 -- 172.21.15.7:0/346331096 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb8ec02fd60 con 0x7fb8f4109df0 2024-09-21T06:00:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.296+0000 7fb901388740 1 -- start start 2024-09-21T06:00:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.296+0000 7fb901388740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad548350 0x55f8ad8ef430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb901388740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad51f490 0x55f8ad8ef970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb901388740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad527670 0x55f8ad8efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb901388740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f8ad865e60 con 0x55f8ad527670 2024-09-21T06:00:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb901388740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f8ad855290 con 0x55f8ad548350 2024-09-21T06:00:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb901388740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f8ad8590a0 con 0x55f8ad51f490 2024-09-21T06:00:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb8f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad527670 0x55f8ad8efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb8f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad527670 0x55f8ad8efeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40390/0 (socket says 172.21.15.7:40390) 2024-09-21T06:00:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb8f3fff640 1 -- 172.21.15.7:0/4203877134 learned_addr learned my addr 172.21.15.7:0/4203877134 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb8f8bb0640 1 --2- 172.21.15.7:0/4203877134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad51f490 0x55f8ad8ef970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/4203877134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad548350 0x55f8ad8ef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb8f1ffb640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8e40b6700 0x7fb8e40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb8f3fff640 1 -- 172.21.15.7:0/4203877134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad51f490 msgr2=0x55f8ad8ef970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/4203877134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad51f490 0x55f8ad8ef970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb8f3fff640 1 -- 172.21.15.7:0/4203877134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad548350 msgr2=0x55f8ad8ef430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/4203877134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad548350 0x55f8ad8ef430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb8f3fff640 1 -- 172.21.15.7:0/4203877134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ad5b3930 con 0x55f8ad527670 2024-09-21T06:00:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb8f93b1640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8e40b6700 0x7fb8e40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.297+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/4203877134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad527670 0x55f8ad8efeb0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00126c0 tx=0x7fb8e000b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70eac9e4c967ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.298+0000 7fb8f1ffb640 1 -- 172.21.15.7:0/346331096 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fb8ec108b40 con 0x7fb8f4109df0 2024-09-21T06:00:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.298+0000 7fb8deffd640 1 -- 172.21.15.7:0/4203877134 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0012c40 con 0x55f8ad527670 2024-09-21T06:00:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.298+0000 7fb8deffd640 1 -- 172.21.15.7:0/4203877134 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8e0012de0 con 0x55f8ad527670 2024-09-21T06:00:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.298+0000 7fb8deffd640 1 -- 172.21.15.7:0/4203877134 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0005650 con 0x55f8ad527670 2024-09-21T06:00:21.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.299+0000 7fb901388740 1 -- 172.21.15.7:0/4203877134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad527670 msgr2=0x55f8ad8efeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:21.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.299+0000 7fb901388740 1 --2- 172.21.15.7:0/4203877134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad527670 0x55f8ad8efeb0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00126c0 tx=0x7fb8e000b6e0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.299+0000 7fb8f93b1640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8e40b6700 0x7fb8e40b8c10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0ce6e0 tx=0x7fb8ec09bdd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:21.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.299+0000 7fb901388740 1 -- 172.21.15.7:0/4203877134 shutdown_connections 2024-09-21T06:00:21.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.299+0000 7fb901388740 1 --2- 172.21.15.7:0/4203877134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad527670 0x55f8ad8efeb0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.299+0000 7fb901388740 1 --2- 172.21.15.7:0/4203877134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad51f490 0x55f8ad8ef970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.299+0000 7fb901388740 1 --2- 172.21.15.7:0/4203877134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad548350 0x55f8ad8ef430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.299+0000 7fb901388740 1 -- 172.21.15.7:0/4203877134 >> 172.21.15.7:0/4203877134 conn(0x55f8ad53c740 msgr2=0x55f8ad8ed320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:21.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.299+0000 7fb901388740 1 -- 172.21.15.7:0/4203877134 shutdown_connections 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.299+0000 7fb901388740 1 -- 172.21.15.7:0/4203877134 wait complete. 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.299+0000 7fb901388740 1 -- start start 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.299+0000 7fb901388740 1 Processor -- start 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb901388740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad51f490 0x55f8ad8fb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb901388740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad527670 0x55f8ad8fb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb901388740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad548350 0x55f8ad906f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb901388740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f8ad6b6890 con 0x55f8ad548350 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb901388740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f8ad7efd40 con 0x55f8ad527670 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb901388740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f8ad8fdc10 con 0x55f8ad51f490 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb901388740 10 client.0 _ll_register_callbacks cb 0x55f8ad853c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb8f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad548350 0x55f8ad906f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb8f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad548350 0x55f8ad906f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40396/0 (socket says 172.21.15.7:40396) 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb8f3fff640 1 -- 172.21.15.7:0/2083752873 learned_addr learned my addr 172.21.15.7:0/2083752873 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad51f490 0x55f8ad8fb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb8f8bb0640 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad527670 0x55f8ad8fb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb8f3fff640 1 -- 172.21.15.7:0/2083752873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad51f490 msgr2=0x55f8ad8fb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad51f490 0x55f8ad8fb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb8f3fff640 1 -- 172.21.15.7:0/2083752873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad527670 msgr2=0x55f8ad8fb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad527670 0x55f8ad8fb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb8f3fff640 1 -- 172.21.15.7:0/2083752873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8ad907550 con 0x55f8ad548350 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb8f8bb0640 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad527670 0x55f8ad8fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad548350 0x55f8ad906f60 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000b420 tx=0x7fb8e0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbdd7feb469b4e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.300+0000 7fb8d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb8d3fff640 1 -- 172.21.15.7:0/2083752873 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0005630 con 0x55f8ad548350 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb8d3fff640 1 -- 172.21.15.7:0/2083752873 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fb8e0010770 con 0x55f8ad548350 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb901388740 1 -- 172.21.15.7:0/2083752873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8e0012de0 con 0x55f8ad548350 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb8d3fff640 1 -- 172.21.15.7:0/2083752873 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8e0032050 con 0x55f8ad548350 2024-09-21T06:00:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb901388740 10 client.17136 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb901388740 1 -- 172.21.15.7:0/2083752873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f8ad909e80 con 0x55f8ad548350 2024-09-21T06:00:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb8d3fff640 1 -- 172.21.15.7:0/2083752873 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8e0012de0 con 0x55f8ad548350 2024-09-21T06:00:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb8d3fff640 1 -- 172.21.15.7:0/2083752873 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb8e0004bf0 con 0x55f8ad548350 2024-09-21T06:00:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb901388740 10 client.17136 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb901388740 10 client.17136 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb901388740 20 client.17136 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb901388740 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f8ad506cd0 0x55f8ad90d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb901388740 4 client.17136 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.301+0000 7fb901388740 1 -- 172.21.15.7:0/2083752873 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8ad867db0 con 0x55f8ad506cd0 2024-09-21T06:00:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.302+0000 7fb8f8bb0640 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f8ad506cd0 0x55f8ad90d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.302+0000 7fb8f8bb0640 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f8ad506cd0 0x55f8ad90d1e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=662cb2786840f162 server_cookie=e1cca76cfed8e642 in_seq=0 out_seq=0 2024-09-21T06:00:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.302+0000 7fb8d3fff640 10 client.17136 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.303+0000 7fb8d3fff640 1 -- 172.21.15.7:0/2083752873 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8ad867db0 con 0x55f8ad506cd0 2024-09-21T06:00:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.303+0000 7fb8d3fff640 10 client.17136 handle_command_reply: tid=0 2024-09-21T06:00:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.303+0000 7fb901388740 1 client.17136 shutdown 2024-09-21T06:00:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.303+0000 7fb901388740 1 -- 172.21.15.7:0/2083752873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad548350 msgr2=0x55f8ad906f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.303+0000 7fb901388740 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad548350 0x55f8ad906f60 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000b420 tx=0x7fb8e0014040 comp rx=0 tx=0).stop 2024-09-21T06:00:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.303+0000 7fb901388740 1 -- 172.21.15.7:0/2083752873 shutdown_connections 2024-09-21T06:00:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.303+0000 7fb901388740 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f8ad506cd0 0x55f8ad90d1e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.303+0000 7fb8d3fff640 0 client.17136 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.303+0000 7fb901388740 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad548350 0x55f8ad906f60 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.303+0000 7fb901388740 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad527670 0x55f8ad8fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.303+0000 7fb901388740 1 --2- 172.21.15.7:0/2083752873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad51f490 0x55f8ad8fb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.303+0000 7fb901388740 1 -- 172.21.15.7:0/2083752873 >> 172.21.15.7:0/2083752873 conn(0x55f8ad53c740 msgr2=0x55f8ad8f25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.304+0000 7fb901388740 1 -- 172.21.15.7:0/2083752873 shutdown_connections 2024-09-21T06:00:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.304+0000 7fb901388740 1 -- 172.21.15.7:0/2083752873 wait complete. 2024-09-21T06:00:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.304+0000 7fb901388740 20 client.17136 trim_cache size 0 max 16384 2024-09-21T06:00:21.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.321+0000 7fb901388740 1 Processor -- start 2024-09-21T06:00:21.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.321+0000 7fb901388740 1 -- start start 2024-09-21T06:00:21.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.321+0000 7fb901388740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad506cd0 0x55f8ad906e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.321+0000 7fb901388740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad51f490 0x55f8ad8fa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.321+0000 7fb901388740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad527670 0x55f8ad8fca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.321+0000 7fb901388740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f41b40e0 con 0x55f8ad506cd0 2024-09-21T06:00:21.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.321+0000 7fb901388740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f41b19b0 con 0x55f8ad51f490 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.321+0000 7fb901388740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f41af820 con 0x55f8ad527670 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad506cd0 0x55f8ad906e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad506cd0 0x55f8ad906e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40400/0 (socket says 172.21.15.7:40400) 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8f3fff640 1 -- 172.21.15.7:0/857955468 learned_addr learned my addr 172.21.15.7:0/857955468 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8f8bb0640 1 --2- 172.21.15.7:0/857955468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad51f490 0x55f8ad8fa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/857955468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad527670 0x55f8ad8fca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8f3fff640 1 -- 172.21.15.7:0/857955468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad527670 msgr2=0x55f8ad8fca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/857955468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad527670 0x55f8ad8fca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8f3fff640 1 -- 172.21.15.7:0/857955468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad51f490 msgr2=0x55f8ad8fa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/857955468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad51f490 0x55f8ad8fa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8f3fff640 1 -- 172.21.15.7:0/857955468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ad8fb380 con 0x55f8ad506cd0 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/857955468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad506cd0 0x55f8ad906e60 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0005390 tx=0x7fb8e001e500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739b3d855b5cd7eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8de7fc640 1 -- 172.21.15.7:0/857955468 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e000b9b0 con 0x55f8ad506cd0 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8de7fc640 1 -- 172.21.15.7:0/857955468 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8e0016070 con 0x55f8ad506cd0 2024-09-21T06:00:21.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.322+0000 7fb8de7fc640 1 -- 172.21.15.7:0/857955468 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0010aa0 con 0x55f8ad506cd0 2024-09-21T06:00:21.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.323+0000 7fb901388740 1 -- 172.21.15.7:0/857955468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad506cd0 msgr2=0x55f8ad906e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:21.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.323+0000 7fb901388740 1 --2- 172.21.15.7:0/857955468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad506cd0 0x55f8ad906e60 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0005390 tx=0x7fb8e001e500 comp rx=0 tx=0).stop 2024-09-21T06:00:21.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.323+0000 7fb901388740 1 -- 172.21.15.7:0/857955468 shutdown_connections 2024-09-21T06:00:21.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.323+0000 7fb901388740 1 --2- 172.21.15.7:0/857955468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad527670 0x55f8ad8fca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.323+0000 7fb901388740 1 --2- 172.21.15.7:0/857955468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad51f490 0x55f8ad8fa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.323+0000 7fb901388740 1 --2- 172.21.15.7:0/857955468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad506cd0 0x55f8ad906e60 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.323+0000 7fb901388740 1 -- 172.21.15.7:0/857955468 >> 172.21.15.7:0/857955468 conn(0x55f8ad53c740 msgr2=0x55f8ad8fc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.323+0000 7fb901388740 1 -- 172.21.15.7:0/857955468 shutdown_connections 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.323+0000 7fb901388740 1 -- 172.21.15.7:0/857955468 wait complete. 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb901388740 1 -- start start 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb901388740 1 Processor -- start 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb901388740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad506cd0 0x55f8ad9036c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb901388740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad51f490 0x55f8ad8febc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb901388740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad527670 0x55f8ad8ff120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb901388740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f41afe70 con 0x55f8ad506cd0 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb901388740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f41b12e0 con 0x55f8ad51f490 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb901388740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f41b0540 con 0x55f8ad527670 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb901388740 10 client.0 _ll_register_callbacks cb 0x7fb8e000bd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb8f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad506cd0 0x55f8ad9036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb8f8bb0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad51f490 0x55f8ad8febc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb8f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad506cd0 0x55f8ad9036c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40410/0 (socket says 172.21.15.7:40410) 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb8f3fff640 1 -- 172.21.15.7:0/3254451293 learned_addr learned my addr 172.21.15.7:0/3254451293 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.324+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/3254451293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad527670 0x55f8ad8ff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.325+0000 7fb8f8bb0640 1 -- 172.21.15.7:0/3254451293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad527670 msgr2=0x55f8ad8ff120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.325+0000 7fb8f8bb0640 1 --2- 172.21.15.7:0/3254451293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad527670 0x55f8ad8ff120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.325+0000 7fb8f8bb0640 1 -- 172.21.15.7:0/3254451293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad506cd0 msgr2=0x55f8ad9036c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.325+0000 7fb8f8bb0640 1 --2- 172.21.15.7:0/3254451293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad506cd0 0x55f8ad9036c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.325+0000 7fb8f8bb0640 1 -- 172.21.15.7:0/3254451293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8ad8ff8b0 con 0x55f8ad51f490 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.325+0000 7fb8f8bb0640 1 --2- 172.21.15.7:0/3254451293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad51f490 0x55f8ad8febc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55f8ad90d750 tx=0x7fb8e8012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c296dda5732fc63 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.325+0000 7fb8d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.325+0000 7fb8d3fff640 1 -- 172.21.15.7:0/3254451293 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e801f070 con 0x55f8ad51f490 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.325+0000 7fb901388740 1 -- 172.21.15.7:0/3254451293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8e0016070 con 0x55f8ad51f490 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.325+0000 7fb8d3fff640 1 -- 172.21.15.7:0/3254451293 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fb8e8004440 con 0x55f8ad51f490 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.325+0000 7fb8d3fff640 1 -- 172.21.15.7:0/3254451293 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8e802c050 con 0x55f8ad51f490 2024-09-21T06:00:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.325+0000 7fb901388740 10 client.26612 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.325+0000 7fb901388740 1 -- 172.21.15.7:0/3254451293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f8ad977a10 con 0x55f8ad51f490 2024-09-21T06:00:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.326+0000 7fb8d3fff640 1 -- 172.21.15.7:0/3254451293 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8e0016070 con 0x55f8ad51f490 2024-09-21T06:00:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.326+0000 7fb8d3fff640 1 -- 172.21.15.7:0/3254451293 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb8e80035f0 con 0x55f8ad51f490 2024-09-21T06:00:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.326+0000 7fb901388740 10 client.26612 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.326+0000 7fb901388740 10 client.26612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.326+0000 7fb901388740 20 client.26612 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.326+0000 7fb901388740 1 --2- 172.21.15.7:0/3254451293 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f8ad548350 0x55f8ad97a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.326+0000 7fb901388740 4 client.26612 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:00:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.326+0000 7fb901388740 1 -- 172.21.15.7:0/3254451293 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f8ad863860 con 0x55f8ad548350 2024-09-21T06:00:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.326+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/3254451293 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f8ad548350 0x55f8ad97a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.327+0000 7fb8d3fff640 10 client.26612 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.327+0000 7fb8f3fff640 1 --2- 172.21.15.7:0/3254451293 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f8ad548350 0x55f8ad97a220 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebb1ece02daa24f server_cookie=f471df1f6e1b6a7b in_seq=0 out_seq=0 2024-09-21T06:00:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.328+0000 7fb8d3fff640 1 -- 172.21.15.7:0/3254451293 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f8ad863860 con 0x55f8ad548350 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.328+0000 7fb8d3fff640 10 client.26612 handle_command_reply: tid=0 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.328+0000 7fb901388740 1 client.26612 shutdown 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.329+0000 7fb901388740 1 -- 172.21.15.7:0/3254451293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad51f490 msgr2=0x55f8ad8febc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.329+0000 7fb901388740 1 --2- 172.21.15.7:0/3254451293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad51f490 0x55f8ad8febc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55f8ad90d750 tx=0x7fb8e8012820 comp rx=0 tx=0).stop 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.329+0000 7fb901388740 1 -- 172.21.15.7:0/3254451293 shutdown_connections 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.329+0000 7fb901388740 1 --2- 172.21.15.7:0/3254451293 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f8ad548350 0x55f8ad97a220 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.329+0000 7fb901388740 1 --2- 172.21.15.7:0/3254451293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f8ad527670 0x55f8ad8ff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.329+0000 7fb901388740 1 --2- 172.21.15.7:0/3254451293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f8ad51f490 0x55f8ad8febc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.329+0000 7fb901388740 1 --2- 172.21.15.7:0/3254451293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f8ad506cd0 0x55f8ad9036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.329+0000 7fb901388740 1 -- 172.21.15.7:0/3254451293 >> 172.21.15.7:0/3254451293 conn(0x55f8ad53c740 msgr2=0x55f8ad8fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.329+0000 7fb8d3fff640 0 client.26612 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.329+0000 7fb901388740 1 -- 172.21.15.7:0/3254451293 shutdown_connections 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.329+0000 7fb901388740 1 -- 172.21.15.7:0/3254451293 wait complete. 2024-09-21T06:00:21.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.329+0000 7fb901388740 20 client.26612 trim_cache size 0 max 16384 2024-09-21T06:00:21.334 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:00:21.334 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:00:21.334 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "d0e9a5a2-105e-4374-8ece-18bc245b9a3e", 2024-09-21T06:00:21.334 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:00:21.334 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:00:21.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.330+0000 7fb8fae14640 1 -- 172.21.15.7:0/346331096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8e40b6700 msgr2=0x7fb8e40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.330+0000 7fb8fae14640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8e40b6700 0x7fb8e40b8c10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0ce6e0 tx=0x7fb8ec09bdd0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.330+0000 7fb8fae14640 1 -- 172.21.15.7:0/346331096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4109df0 msgr2=0x7fb8f41a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.330+0000 7fb8fae14640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4109df0 0x7fb8f41a1f00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec005cc0 tx=0x7fb8ec02f380 comp rx=0 tx=0).stop 2024-09-21T06:00:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.330+0000 7fb8fae14640 1 -- 172.21.15.7:0/346331096 shutdown_connections 2024-09-21T06:00:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.330+0000 7fb8fae14640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8e40b6700 0x7fb8e40b8c10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.330+0000 7fb8fae14640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4109df0 0x7fb8f41a1f00 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.330+0000 7fb8fae14640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8f41094a0 0x7fb8f419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.330+0000 7fb8fae14640 1 --2- 172.21.15.7:0/346331096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8f4103b60 0x7fb8f419c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.330+0000 7fb8fae14640 1 -- 172.21.15.7:0/346331096 >> 172.21.15.7:0/346331096 conn(0x7fb8f407b850 msgr2=0x7fb8f4107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.330+0000 7fb8fae14640 1 -- 172.21.15.7:0/346331096 shutdown_connections 2024-09-21T06:00:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:21.330+0000 7fb8fae14640 1 -- 172.21.15.7:0/346331096 wait complete. 2024-09-21T06:00:22.036 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:00:22.340 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:22.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:22 smithi007 ceph-mon[30983]: pgmap v514: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:00:22.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:22 smithi119 ceph-mon[34833]: pgmap v514: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:00:22.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:22 smithi027 ceph-mon[34364]: pgmap v514: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:00:22.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.843+0000 7f4537949640 1 -- 172.21.15.7:0/3756779523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4530102a60 msgr2=0x7f4530102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:22.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.843+0000 7f4537949640 1 --2- 172.21.15.7:0/3756779523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4530102a60 0x7f4530102e70 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f4520009900 tx=0x7f452002a410 comp rx=0 tx=0).stop 2024-09-21T06:00:22.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.843+0000 7f4537949640 1 -- 172.21.15.7:0/3756779523 shutdown_connections 2024-09-21T06:00:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.843+0000 7f4537949640 1 --2- 172.21.15.7:0/3756779523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4530108cf0 0x7f453010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.843+0000 7f4537949640 1 --2- 172.21.15.7:0/3756779523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45301083a0 0x7f45301087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.843+0000 7f4537949640 1 --2- 172.21.15.7:0/3756779523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4530102a60 0x7f4530102e70 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.843+0000 7f4537949640 1 -- 172.21.15.7:0/3756779523 >> 172.21.15.7:0/3756779523 conn(0x7f4530079730 msgr2=0x7f4530079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.843+0000 7f4537949640 1 -- 172.21.15.7:0/3756779523 shutdown_connections 2024-09-21T06:00:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.843+0000 7f4537949640 1 -- 172.21.15.7:0/3756779523 wait complete. 2024-09-21T06:00:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.844+0000 7f4537949640 1 Processor -- start 2024-09-21T06:00:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.844+0000 7f4537949640 1 -- start start 2024-09-21T06:00:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.844+0000 7f4537949640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4530102a60 0x7f4530104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.844+0000 7f4537949640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45301083a0 0x7f4530104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.844+0000 7f4537949640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4530108cf0 0x7f4530104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.844+0000 7f4537949640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4530112960 con 0x7f4530108cf0 2024-09-21T06:00:22.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.844+0000 7f4537949640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f45301127e0 con 0x7f45301083a0 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.844+0000 7f4537949640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4530112ae0 con 0x7f4530102a60 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f4535ee6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4530108cf0 0x7f4530104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f4535ee6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4530108cf0 0x7f4530104cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40424/0 (socket says 172.21.15.7:40424) 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f4535ee6640 1 -- 172.21.15.7:0/1723211931 learned_addr learned my addr 172.21.15.7:0/1723211931 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f4534ee4640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45301083a0 0x7f4530104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f45356e5640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4530102a60 0x7f4530104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f4535ee6640 1 -- 172.21.15.7:0/1723211931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4530102a60 msgr2=0x7f4530104250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f4535ee6640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4530102a60 0x7f4530104250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f4535ee6640 1 -- 172.21.15.7:0/1723211931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45301083a0 msgr2=0x7f4530104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f4535ee6640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45301083a0 0x7f4530104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f4535ee6640 1 -- 172.21.15.7:0/1723211931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45301a8700 con 0x7f4530108cf0 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f4535ee6640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4530108cf0 0x7f4530104cd0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f452800eaa0 tx=0x7f452800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f45267fc640 1 -- 172.21.15.7:0/1723211931 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452800cdb0 con 0x7f4530108cf0 2024-09-21T06:00:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f45267fc640 1 -- 172.21.15.7:0/1723211931 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4528005020 con 0x7f4530108cf0 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f4537949640 1 -- 172.21.15.7:0/1723211931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45301a89f0 con 0x7f4530108cf0 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.845+0000 7f45267fc640 1 -- 172.21.15.7:0/1723211931 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45280116d0 con 0x7f4530108cf0 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.846+0000 7f4537949640 1 -- 172.21.15.7:0/1723211931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45301a8ee0 con 0x7f4530108cf0 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.848+0000 7f453debd740 1 Processor -- start 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.849+0000 7f45267fc640 1 -- 172.21.15.7:0/1723211931 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f45280051d0 con 0x7f4530108cf0 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.849+0000 7f453debd740 1 -- start start 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.849+0000 7f453debd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be9110070 0x560be94b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.849+0000 7f453debd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94b7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.849+0000 7f453debd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be90ef390 0x560be94b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.849+0000 7f453debd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560be942de50 con 0x560be90e71b0 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.849+0000 7f453debd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560be941d280 con 0x560be9110070 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.849+0000 7f453debd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560be9421090 con 0x560be90ef390 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.849+0000 7f45356e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94b7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.849+0000 7f45356e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94b7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40438/0 (socket says 172.21.15.7:40438) 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.849+0000 7f45356e5640 1 -- 172.21.15.7:0/3795055926 learned_addr learned my addr 172.21.15.7:0/3795055926 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.849+0000 7f4534ee4640 1 --2- 172.21.15.7:0/3795055926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be9110070 0x560be94b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.850+0000 7f4534ee4640 1 --2- 172.21.15.7:0/3795055926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be90ef390 0x560be94b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.850+0000 7f45356e5640 1 -- 172.21.15.7:0/3795055926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be90ef390 msgr2=0x560be94b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.850+0000 7f45356e5640 1 --2- 172.21.15.7:0/3795055926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be90ef390 0x560be94b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.850+0000 7f45356e5640 1 -- 172.21.15.7:0/3795055926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be9110070 msgr2=0x560be94b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.850+0000 7f45356e5640 1 --2- 172.21.15.7:0/3795055926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be9110070 0x560be94b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.850+0000 7f45356e5640 1 -- 172.21.15.7:0/3795055926 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560be917b650 con 0x560be90e71b0 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.850+0000 7f4534ee4640 1 --2- 172.21.15.7:0/3795055926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be90ef390 0x560be94b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.850+0000 7f45267fc640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f451c0b6680 0x7f451c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.850+0000 7f45356e5640 1 --2- 172.21.15.7:0/3795055926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94b7b90 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f4520009900 tx=0x7f4520032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe68804d03f9b79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.850+0000 7f4534ee4640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f451c0b6680 0x7f451c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.850+0000 7f45267fc640 1 -- 172.21.15.7:0/1723211931 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f45280e7820 con 0x7f4530108cf0 2024-09-21T06:00:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.850+0000 7f451b7fe640 1 -- 172.21.15.7:0/3795055926 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520040070 con 0x560be90e71b0 2024-09-21T06:00:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.851+0000 7f451b7fe640 1 -- 172.21.15.7:0/3795055926 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4520032e50 con 0x560be90e71b0 2024-09-21T06:00:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.851+0000 7f451b7fe640 1 -- 172.21.15.7:0/3795055926 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520035040 con 0x560be90e71b0 2024-09-21T06:00:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.851+0000 7f453debd740 1 -- 172.21.15.7:0/3795055926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 msgr2=0x560be94b7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.851+0000 7f4534ee4640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f451c0b6680 0x7f451c0b8b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4530100b70 tx=0x7f452c014040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.851+0000 7f453debd740 1 --2- 172.21.15.7:0/3795055926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94b7b90 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f4520009900 tx=0x7f4520032c60 comp rx=0 tx=0).stop 2024-09-21T06:00:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.851+0000 7f453debd740 1 -- 172.21.15.7:0/3795055926 shutdown_connections 2024-09-21T06:00:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.852+0000 7f453debd740 1 --2- 172.21.15.7:0/3795055926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94b7b90 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.852+0000 7f453debd740 1 --2- 172.21.15.7:0/3795055926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be90ef390 0x560be94b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.852+0000 7f453debd740 1 --2- 172.21.15.7:0/3795055926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be9110070 0x560be94b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.852+0000 7f453debd740 1 -- 172.21.15.7:0/3795055926 >> 172.21.15.7:0/3795055926 conn(0x560be9104460 msgr2=0x560be94b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.852+0000 7f453debd740 1 -- 172.21.15.7:0/3795055926 shutdown_connections 2024-09-21T06:00:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.852+0000 7f453debd740 1 -- 172.21.15.7:0/3795055926 wait complete. 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.852+0000 7f453debd740 1 -- start start 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.852+0000 7f453debd740 1 Processor -- start 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f453debd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f453debd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be90ef390 0x560be94c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f453debd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be9110070 0x560be94c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f453debd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560be927e700 con 0x560be90e71b0 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f453debd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560be93b8110 con 0x560be90ef390 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f453debd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560be94c5dd0 con 0x560be9110070 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f453debd740 10 client.0 _ll_register_callbacks cb 0x560be93d1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f45356e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f45356e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40440/0 (socket says 172.21.15.7:40440) 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f45356e5640 1 -- 172.21.15.7:0/2137660859 learned_addr learned my addr 172.21.15.7:0/2137660859 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f4534ee4640 1 --2- 172.21.15.7:0/2137660859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be90ef390 0x560be94c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f4535ee6640 1 --2- 172.21.15.7:0/2137660859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be9110070 0x560be94c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f45356e5640 1 -- 172.21.15.7:0/2137660859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be9110070 msgr2=0x560be94c37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f45356e5640 1 --2- 172.21.15.7:0/2137660859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be9110070 0x560be94c37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f45356e5640 1 -- 172.21.15.7:0/2137660859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be90ef390 msgr2=0x560be94c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f45356e5640 1 --2- 172.21.15.7:0/2137660859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be90ef390 0x560be94c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.853+0000 7f45356e5640 1 -- 172.21.15.7:0/2137660859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560be93e5c40 con 0x560be90e71b0 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.854+0000 7f45356e5640 1 --2- 172.21.15.7:0/2137660859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94c2cf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4520005560 tx=0x7f45200050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969e14aaee47e078 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.854+0000 7f4518ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.854+0000 7f4518ff9640 1 -- 172.21.15.7:0/2137660859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520035040 con 0x560be90e71b0 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.854+0000 7f4518ff9640 1 -- 172.21.15.7:0/2137660859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f4520004040 con 0x560be90e71b0 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.854+0000 7f453debd740 1 -- 172.21.15.7:0/2137660859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4520032e50 con 0x560be90e71b0 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.854+0000 7f4518ff9640 1 -- 172.21.15.7:0/2137660859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4520040040 con 0x560be90e71b0 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.854+0000 7f453debd740 10 client.17154 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.854+0000 7f453debd740 1 -- 172.21.15.7:0/2137660859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560be94d1a10 con 0x560be90e71b0 2024-09-21T06:00:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.854+0000 7f4518ff9640 1 -- 172.21.15.7:0/2137660859 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4520032e50 con 0x560be90e71b0 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.855+0000 7f4518ff9640 1 -- 172.21.15.7:0/2137660859 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4520004d90 con 0x560be90e71b0 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.855+0000 7f453debd740 10 client.17154 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.855+0000 7f453debd740 10 client.17154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.855+0000 7f453debd740 20 client.17154 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.855+0000 7f453debd740 1 --2- 172.21.15.7:0/2137660859 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560be90ce9f0 0x560be94d4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.855+0000 7f453debd740 4 client.17154 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.855+0000 7f453debd740 1 -- 172.21.15.7:0/2137660859 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560be942fda0 con 0x560be90ce9f0 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.855+0000 7f4534ee4640 1 --2- 172.21.15.7:0/2137660859 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560be90ce9f0 0x560be94d4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.856+0000 7f4534ee4640 1 --2- 172.21.15.7:0/2137660859 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560be90ce9f0 0x560be94d4d70 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f978ded2f6fa3406 server_cookie=929a2e99c66ca870 in_seq=0 out_seq=0 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.856+0000 7f4518ff9640 10 client.17154 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.856+0000 7f4518ff9640 1 -- 172.21.15.7:0/2137660859 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560be942fda0 con 0x560be90ce9f0 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.856+0000 7f4518ff9640 10 client.17154 handle_command_reply: tid=0 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.856+0000 7f453debd740 1 client.17154 shutdown 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.857+0000 7f453debd740 1 -- 172.21.15.7:0/2137660859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 msgr2=0x560be94c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.857+0000 7f453debd740 1 --2- 172.21.15.7:0/2137660859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94c2cf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4520005560 tx=0x7f45200050e0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.857+0000 7f453debd740 1 -- 172.21.15.7:0/2137660859 shutdown_connections 2024-09-21T06:00:22.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.857+0000 7f453debd740 1 --2- 172.21.15.7:0/2137660859 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560be90ce9f0 0x560be94d4d70 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.857+0000 7f453debd740 1 --2- 172.21.15.7:0/2137660859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be9110070 0x560be94c37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.857+0000 7f453debd740 1 --2- 172.21.15.7:0/2137660859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be90ef390 0x560be94c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.857+0000 7f453debd740 1 --2- 172.21.15.7:0/2137660859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94c2cf0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.857+0000 7f453debd740 1 -- 172.21.15.7:0/2137660859 >> 172.21.15.7:0/2137660859 conn(0x560be9104460 msgr2=0x560be94ba7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:22.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.857+0000 7f4518ff9640 0 client.17154 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:22.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.857+0000 7f453debd740 1 -- 172.21.15.7:0/2137660859 shutdown_connections 2024-09-21T06:00:22.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.857+0000 7f453debd740 1 -- 172.21.15.7:0/2137660859 wait complete. 2024-09-21T06:00:22.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.857+0000 7f453debd740 20 client.17154 trim_cache size 0 max 16384 2024-09-21T06:00:22.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.876+0000 7f453debd740 1 Processor -- start 2024-09-21T06:00:22.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.876+0000 7f453debd740 1 -- start start 2024-09-21T06:00:22.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f453debd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94be4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f453debd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be90ef390 0x560be94c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f453debd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be9110070 0x560be94bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f453debd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f45301b3fc0 con 0x560be90e71b0 2024-09-21T06:00:22.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f453debd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f45301b1890 con 0x560be90ef390 2024-09-21T06:00:22.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f453debd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f45301af700 con 0x560be9110070 2024-09-21T06:00:22.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f45356e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94be4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f45356e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94be4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40448/0 (socket says 172.21.15.7:40448) 2024-09-21T06:00:22.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f45356e5640 1 -- 172.21.15.7:0/3954785556 learned_addr learned my addr 172.21.15.7:0/3954785556 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f4534ee4640 1 --2- 172.21.15.7:0/3954785556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be90ef390 0x560be94c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f45356e5640 1 -- 172.21.15.7:0/3954785556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be9110070 msgr2=0x560be94bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f45356e5640 1 --2- 172.21.15.7:0/3954785556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be9110070 0x560be94bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f45356e5640 1 -- 172.21.15.7:0/3954785556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be90ef390 msgr2=0x560be94c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f45356e5640 1 --2- 172.21.15.7:0/3954785556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be90ef390 0x560be94c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f45356e5640 1 -- 172.21.15.7:0/3954785556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560be94c5430 con 0x560be90e71b0 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f4534ee4640 1 --2- 172.21.15.7:0/3954785556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be90ef390 0x560be94c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.877+0000 7f45356e5640 1 --2- 172.21.15.7:0/3954785556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94be4a0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4520005530 tx=0x7f4520031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2e66ae23f7c829 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.878+0000 7f451affd640 1 -- 172.21.15.7:0/3954785556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520005db0 con 0x560be90e71b0 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.878+0000 7f451affd640 1 -- 172.21.15.7:0/3954785556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4520031b60 con 0x560be90e71b0 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.878+0000 7f451affd640 1 -- 172.21.15.7:0/3954785556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520004eb0 con 0x560be90e71b0 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.878+0000 7f453debd740 1 -- 172.21.15.7:0/3954785556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 msgr2=0x560be94be4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.878+0000 7f453debd740 1 --2- 172.21.15.7:0/3954785556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94be4a0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4520005530 tx=0x7f4520031400 comp rx=0 tx=0).stop 2024-09-21T06:00:22.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.878+0000 7f453debd740 1 -- 172.21.15.7:0/3954785556 shutdown_connections 2024-09-21T06:00:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.878+0000 7f453debd740 1 --2- 172.21.15.7:0/3954785556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be9110070 0x560be94bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.878+0000 7f453debd740 1 --2- 172.21.15.7:0/3954785556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be90ef390 0x560be94c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.878+0000 7f453debd740 1 --2- 172.21.15.7:0/3954785556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94be4a0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.878+0000 7f453debd740 1 -- 172.21.15.7:0/3954785556 >> 172.21.15.7:0/3954785556 conn(0x560be9104460 msgr2=0x560be94c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.879+0000 7f453debd740 1 -- 172.21.15.7:0/3954785556 shutdown_connections 2024-09-21T06:00:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.879+0000 7f453debd740 1 -- 172.21.15.7:0/3954785556 wait complete. 2024-09-21T06:00:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.879+0000 7f453debd740 1 -- start start 2024-09-21T06:00:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.879+0000 7f453debd740 1 Processor -- start 2024-09-21T06:00:22.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.879+0000 7f453debd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94d8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.879+0000 7f453debd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be90ef390 0x560be94d5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.879+0000 7f453debd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be9110070 0x560be94d63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.879+0000 7f453debd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f45301afd50 con 0x560be90e71b0 2024-09-21T06:00:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.879+0000 7f453debd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f45301b11c0 con 0x560be9110070 2024-09-21T06:00:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.879+0000 7f453debd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f45301b0420 con 0x560be90ef390 2024-09-21T06:00:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f45356e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94d8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f453debd740 10 client.0 _ll_register_callbacks cb 0x7f4520032bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f45356e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94d8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40460/0 (socket says 172.21.15.7:40460) 2024-09-21T06:00:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f45356e5640 1 -- 172.21.15.7:0/1449914636 learned_addr learned my addr 172.21.15.7:0/1449914636 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f4534ee4640 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be90ef390 0x560be94d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f4535ee6640 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be9110070 0x560be94d63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f45356e5640 1 -- 172.21.15.7:0/1449914636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be90ef390 msgr2=0x560be94d5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f45356e5640 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be90ef390 0x560be94d5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f45356e5640 1 -- 172.21.15.7:0/1449914636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be9110070 msgr2=0x560be94d63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f45356e5640 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be9110070 0x560be94d63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f45356e5640 1 -- 172.21.15.7:0/1449914636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560be953e4f0 con 0x560be90e71b0 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f4535ee6640 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be9110070 0x560be94d63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f45356e5640 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94d8790 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f4520031f40 tx=0x7f4520005220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1776b67e8b2994 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f4518ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f4518ff9640 1 -- 172.21.15.7:0/1449914636 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520035030 con 0x560be90e71b0 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f4518ff9640 1 -- 172.21.15.7:0/1449914636 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f4520004b30 con 0x560be90e71b0 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.880+0000 7f453debd740 1 -- 172.21.15.7:0/1449914636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4520031b60 con 0x560be90e71b0 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.881+0000 7f4518ff9640 1 -- 172.21.15.7:0/1449914636 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f452006e050 con 0x560be90e71b0 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.881+0000 7f453debd740 10 client.17160 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.881+0000 7f453debd740 1 -- 172.21.15.7:0/1449914636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560be953f5c0 con 0x560be90e71b0 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.881+0000 7f4518ff9640 1 -- 172.21.15.7:0/1449914636 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4520031b60 con 0x560be90e71b0 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.881+0000 7f4518ff9640 1 -- 172.21.15.7:0/1449914636 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4520032770 con 0x560be90e71b0 2024-09-21T06:00:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.881+0000 7f453debd740 10 client.17160 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.881+0000 7f453debd740 10 client.17160 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.881+0000 7f453debd740 20 client.17160 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.881+0000 7f453debd740 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560be90a3da0 0x560be9541d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.881+0000 7f453debd740 4 client.17160 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.881+0000 7f453debd740 1 -- 172.21.15.7:0/1449914636 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560be942b850 con 0x560be90a3da0 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.882+0000 7f4534ee4640 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560be90a3da0 0x560be9541d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.882+0000 7f4518ff9640 10 client.17160 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.882+0000 7f4534ee4640 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560be90a3da0 0x560be9541d00 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31e542f43d892ea8 server_cookie=6d5fd6dba8a82662 in_seq=0 out_seq=0 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.882+0000 7f4518ff9640 1 -- 172.21.15.7:0/1449914636 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x560be942b850 con 0x560be90a3da0 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.882+0000 7f4518ff9640 10 client.17160 handle_command_reply: tid=0 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.882+0000 7f453debd740 1 client.17160 shutdown 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.882+0000 7f453debd740 1 -- 172.21.15.7:0/1449914636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 msgr2=0x560be94d8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.882+0000 7f453debd740 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94d8790 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f4520031f40 tx=0x7f4520005220 comp rx=0 tx=0).stop 2024-09-21T06:00:22.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f453debd740 1 -- 172.21.15.7:0/1449914636 shutdown_connections 2024-09-21T06:00:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f453debd740 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560be90a3da0 0x560be9541d00 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f453debd740 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560be9110070 0x560be94d63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f453debd740 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560be90ef390 0x560be94d5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f4518ff9640 0 client.17160 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f453debd740 1 --2- 172.21.15.7:0/1449914636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560be90e71b0 0x560be94d8790 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f453debd740 1 -- 172.21.15.7:0/1449914636 >> 172.21.15.7:0/1449914636 conn(0x560be9104460 msgr2=0x560be94c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f453debd740 1 -- 172.21.15.7:0/1449914636 shutdown_connections 2024-09-21T06:00:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f453debd740 1 -- 172.21.15.7:0/1449914636 wait complete. 2024-09-21T06:00:22.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f453debd740 20 client.17160 trim_cache size 0 max 16384 2024-09-21T06:00:22.888 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:00:22.889 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:00:22.890 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.891 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.894 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:00:22.895 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:00:22.897 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:00:22.897 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:22.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:22.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:22.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:22.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:22.897 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:00:22.897 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:00:22.897 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:00:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f4537949640 1 -- 172.21.15.7:0/1723211931 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f451c0b6680 msgr2=0x7f451c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f4537949640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f451c0b6680 0x7f451c0b8b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4530100b70 tx=0x7f452c014040 comp rx=0 tx=0).stop 2024-09-21T06:00:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f4537949640 1 -- 172.21.15.7:0/1723211931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4530108cf0 msgr2=0x7f4530104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f4537949640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4530108cf0 0x7f4530104cd0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f452800eaa0 tx=0x7f452800ef60 comp rx=0 tx=0).stop 2024-09-21T06:00:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f4537949640 1 -- 172.21.15.7:0/1723211931 shutdown_connections 2024-09-21T06:00:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f4537949640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f451c0b6680 0x7f451c0b8b90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f4537949640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4530108cf0 0x7f4530104cd0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.883+0000 7f4537949640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f45301083a0 0x7f4530104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.884+0000 7f4537949640 1 --2- 172.21.15.7:0/1723211931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4530102a60 0x7f4530104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.884+0000 7f4537949640 1 -- 172.21.15.7:0/1723211931 >> 172.21.15.7:0/1723211931 conn(0x7f4530079730 msgr2=0x7f4530101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.884+0000 7f4537949640 1 -- 172.21.15.7:0/1723211931 shutdown_connections 2024-09-21T06:00:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:22.884+0000 7f4537949640 1 -- 172.21.15.7:0/1723211931 wait complete. 2024-09-21T06:00:23.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:23 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:00:23.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:23 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:23.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:23 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:00:23.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:23 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:23.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:23 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:00:23.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:23 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:00:23.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:23 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:23.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:23 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:00:23.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:23 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:23.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:23 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:00:23.686 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:00:23.686 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:00:23.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:23 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:00:23.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:23 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:23.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:23 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:00:23.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:23 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:23.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:23 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:00:23.954 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:24.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.418+0000 7f80169a2640 1 -- 172.21.15.7:0/2187436158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80101083a0 msgr2=0x7f80101087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:24.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.418+0000 7f80169a2640 1 --2- 172.21.15.7:0/2187436158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80101083a0 0x7f80101087b0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009900 tx=0x7f7ff802a410 comp rx=0 tx=0).stop 2024-09-21T06:00:24.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.419+0000 7f80169a2640 1 -- 172.21.15.7:0/2187436158 shutdown_connections 2024-09-21T06:00:24.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.419+0000 7f80169a2640 1 --2- 172.21.15.7:0/2187436158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80101083a0 0x7f80101087b0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:24.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.419+0000 7f80169a2640 1 --2- 172.21.15.7:0/2187436158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8010108cf0 0x7f801010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:24.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.419+0000 7f80169a2640 1 --2- 172.21.15.7:0/2187436158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8010102a60 0x7f8010102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:24.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.419+0000 7f80169a2640 1 -- 172.21.15.7:0/2187436158 >> 172.21.15.7:0/2187436158 conn(0x7f8010079730 msgr2=0x7f8010079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:24.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.419+0000 7f80169a2640 1 -- 172.21.15.7:0/2187436158 shutdown_connections 2024-09-21T06:00:24.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.419+0000 7f80169a2640 1 -- 172.21.15.7:0/2187436158 wait complete. 2024-09-21T06:00:24.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.419+0000 7f80169a2640 1 Processor -- start 2024-09-21T06:00:24.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.419+0000 7f80169a2640 1 -- start start 2024-09-21T06:00:24.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f80169a2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8010102a60 0x7f801019c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f80169a2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80101083a0 0x7f801019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f80169a2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8010108cf0 0x7f80101a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f80169a2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8010113aa0 con 0x7f8010102a60 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f80169a2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8010113920 con 0x7f80101083a0 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f80169a2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8010113c20 con 0x7f8010108cf0 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f800ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8010102a60 0x7f801019c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f800ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8010102a60 0x7f801019c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40490/0 (socket says 172.21.15.7:40490) 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f800ffff640 1 -- 172.21.15.7:0/2938146550 learned_addr learned my addr 172.21.15.7:0/2938146550 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f8007fff640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80101083a0 0x7f801019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f8014f3f640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8010108cf0 0x7f80101a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f800ffff640 1 -- 172.21.15.7:0/2938146550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8010108cf0 msgr2=0x7f80101a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f800ffff640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8010108cf0 0x7f80101a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f800ffff640 1 -- 172.21.15.7:0/2938146550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80101083a0 msgr2=0x7f801019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f800ffff640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80101083a0 0x7f801019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f800ffff640 1 -- 172.21.15.7:0/2938146550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80101a2680 con 0x7f8010102a60 2024-09-21T06:00:24.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.420+0000 7f8014f3f640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8010108cf0 0x7f80101a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:24.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.421+0000 7f800ffff640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8010102a60 0x7f801019c710 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f800000d950 tx=0x7f800000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:24.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.421+0000 7f800dffb640 1 -- 172.21.15.7:0/2938146550 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000017070 con 0x7f8010102a60 2024-09-21T06:00:24.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.421+0000 7f800dffb640 1 -- 172.21.15.7:0/2938146550 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8000009c30 con 0x7f8010102a60 2024-09-21T06:00:24.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.421+0000 7f80169a2640 1 -- 172.21.15.7:0/2938146550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80101a2970 con 0x7f8010102a60 2024-09-21T06:00:24.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.421+0000 7f800dffb640 1 -- 172.21.15.7:0/2938146550 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800000f620 con 0x7f8010102a60 2024-09-21T06:00:24.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.421+0000 7f80169a2640 1 -- 172.21.15.7:0/2938146550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80101a90d0 con 0x7f8010102a60 2024-09-21T06:00:24.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.422+0000 7f80169a2640 1 -- 172.21.15.7:0/2938146550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8010102e70 con 0x7f8010102a60 2024-09-21T06:00:24.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.424+0000 7f800dffb640 1 -- 172.21.15.7:0/2938146550 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8000010460 con 0x7f8010102a60 2024-09-21T06:00:24.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.424+0000 7f800dffb640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7ffc0b6680 0x7f7ffc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:24.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.424+0000 7f800dffb640 1 -- 172.21.15.7:0/2938146550 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f80000e7340 con 0x7f8010102a60 2024-09-21T06:00:24.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.424+0000 7f8007fff640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7ffc0b6680 0x7f7ffc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:24.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.425+0000 7f8007fff640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7ffc0b6680 0x7f7ffc0b8b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8000c00 tx=0x7f7ff8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:24.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.429+0000 7f800dffb640 1 -- 172.21.15.7:0/2938146550 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80000ad8e0 con 0x7f8010102a60 2024-09-21T06:00:24.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:24 smithi007 ceph-mon[30983]: pgmap v515: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:00:24.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:24 smithi119 ceph-mon[34833]: pgmap v515: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:00:24.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.659+0000 7f80169a2640 1 -- 172.21.15.7:0/2938146550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80101a9450 con 0x7f8010102a60 2024-09-21T06:00:24.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.660+0000 7f800dffb640 1 -- 172.21.15.7:0/2938146550 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f8000009de0 con 0x7f8010102a60 2024-09-21T06:00:24.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:00:24.663 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:00:24.663 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:00:24.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.662+0000 7f80169a2640 1 -- 172.21.15.7:0/2938146550 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7ffc0b6680 msgr2=0x7f7ffc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:24.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.662+0000 7f80169a2640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7ffc0b6680 0x7f7ffc0b8b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8000c00 tx=0x7f7ff8031400 comp rx=0 tx=0).stop 2024-09-21T06:00:24.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.662+0000 7f80169a2640 1 -- 172.21.15.7:0/2938146550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8010102a60 msgr2=0x7f801019c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:24.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.662+0000 7f80169a2640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8010102a60 0x7f801019c710 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f800000d950 tx=0x7f800000de10 comp rx=0 tx=0).stop 2024-09-21T06:00:24.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.663+0000 7f80169a2640 1 -- 172.21.15.7:0/2938146550 shutdown_connections 2024-09-21T06:00:24.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.663+0000 7f80169a2640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7ffc0b6680 0x7f7ffc0b8b90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:24.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.663+0000 7f80169a2640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8010108cf0 0x7f80101a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:24.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.663+0000 7f80169a2640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f80101083a0 0x7f801019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:24.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.663+0000 7f80169a2640 1 --2- 172.21.15.7:0/2938146550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8010102a60 0x7f801019c710 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:24.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.663+0000 7f80169a2640 1 -- 172.21.15.7:0/2938146550 >> 172.21.15.7:0/2938146550 conn(0x7f8010079730 msgr2=0x7f8010104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:24.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.663+0000 7f80169a2640 1 -- 172.21.15.7:0/2938146550 shutdown_connections 2024-09-21T06:00:24.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:24.663+0000 7f80169a2640 1 -- 172.21.15.7:0/2938146550 wait complete. 2024-09-21T06:00:24.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:24 smithi027 ceph-mon[34364]: pgmap v515: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:00:25.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:00:25.567 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:25.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:25 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2938146550' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:25.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:25 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2938146550' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:25.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:25 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2938146550' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:26.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.068+0000 7fbc3fc4f640 1 -- 172.21.15.7:0/4275380318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc381094f0 msgr2=0x7fbc38109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:26.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.068+0000 7fbc3fc4f640 1 --2- 172.21.15.7:0/4275380318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc381094f0 0x7fbc38109900 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009900 tx=0x7fbc2802a410 comp rx=0 tx=0).stop 2024-09-21T06:00:26.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.068+0000 7fbc3fc4f640 1 -- 172.21.15.7:0/4275380318 shutdown_connections 2024-09-21T06:00:26.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.068+0000 7fbc3fc4f640 1 --2- 172.21.15.7:0/4275380318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc381094f0 0x7fbc38109900 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.068+0000 7fbc3fc4f640 1 --2- 172.21.15.7:0/4275380318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38109e40 0x7fbc38110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.068+0000 7fbc3fc4f640 1 --2- 172.21.15.7:0/4275380318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc38103bb0 0x7fbc38103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.068+0000 7fbc3fc4f640 1 -- 172.21.15.7:0/4275380318 >> 172.21.15.7:0/4275380318 conn(0x7fbc380ff600 msgr2=0x7fbc38101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:26.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.068+0000 7fbc3fc4f640 1 -- 172.21.15.7:0/4275380318 shutdown_connections 2024-09-21T06:00:26.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.068+0000 7fbc3fc4f640 1 -- 172.21.15.7:0/4275380318 wait complete. 2024-09-21T06:00:26.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.069+0000 7fbc3fc4f640 1 Processor -- start 2024-09-21T06:00:26.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.069+0000 7fbc3fc4f640 1 -- start start 2024-09-21T06:00:26.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.069+0000 7fbc3fc4f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38103bb0 0x7fbc3819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.069+0000 7fbc3fc4f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc381094f0 0x7fbc3819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.069+0000 7fbc3fc4f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc38109e40 0x7fbc3819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.069+0000 7fbc3fc4f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc38113b00 con 0x7fbc38109e40 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.069+0000 7fbc3fc4f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbc38113980 con 0x7fbc381094f0 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.069+0000 7fbc3fc4f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbc38113c80 con 0x7fbc38103bb0 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc3e1ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc38109e40 0x7fbc3819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc3d9eb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38103bb0 0x7fbc3819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc3d9eb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38103bb0 0x7fbc3819a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:48636/0 (socket says 172.21.15.7:48636) 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc3e1ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc38109e40 0x7fbc3819fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40512/0 (socket says 172.21.15.7:40512) 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc3d9eb640 1 -- 172.21.15.7:0/3481993881 learned_addr learned my addr 172.21.15.7:0/3481993881 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/3481993881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc381094f0 0x7fbc3819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc3e1ec640 1 -- 172.21.15.7:0/3481993881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38103bb0 msgr2=0x7fbc3819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc3e1ec640 1 --2- 172.21.15.7:0/3481993881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38103bb0 0x7fbc3819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc3e1ec640 1 -- 172.21.15.7:0/3481993881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc381094f0 msgr2=0x7fbc3819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc3e1ec640 1 --2- 172.21.15.7:0/3481993881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc381094f0 0x7fbc3819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc3e1ec640 1 -- 172.21.15.7:0/3481993881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc381a04a0 con 0x7fbc38109e40 2024-09-21T06:00:26.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc3e1ec640 1 --2- 172.21.15.7:0/3481993881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc38109e40 0x7fbc3819fd70 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000e940 tx=0x7fbc3000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:26.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc2effd640 1 -- 172.21.15.7:0/3481993881 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30004d20 con 0x7fbc38109e40 2024-09-21T06:00:26.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc3fc4f640 1 -- 172.21.15.7:0/3481993881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc381a0790 con 0x7fbc38109e40 2024-09-21T06:00:26.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc2effd640 1 -- 172.21.15.7:0/3481993881 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc30005020 con 0x7fbc38109e40 2024-09-21T06:00:26.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.070+0000 7fbc2effd640 1 -- 172.21.15.7:0/3481993881 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc300116d0 con 0x7fbc38109e40 2024-09-21T06:00:26.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.071+0000 7fbc3fc4f640 1 -- 172.21.15.7:0/3481993881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc381a6ef0 con 0x7fbc38109e40 2024-09-21T06:00:26.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.073+0000 7fbc461c3740 1 Processor -- start 2024-09-21T06:00:26.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.073+0000 7fbc2effd640 1 -- 172.21.15.7:0/3481993881 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fbc30005460 con 0x7fbc38109e40 2024-09-21T06:00:26.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.074+0000 7fbc461c3740 1 -- start start 2024-09-21T06:00:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.074+0000 7fbc461c3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 0x5651498a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.074+0000 7fbc461c3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494d71b0 0x5651498a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.074+0000 7fbc461c3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494df390 0x5651498a8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.074+0000 7fbc461c3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56514981dea0 con 0x5651494d71b0 2024-09-21T06:00:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.074+0000 7fbc461c3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56514980d2d0 con 0x565149500070 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.074+0000 7fbc461c3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5651498110e0 con 0x5651494df390 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.074+0000 7fbc3d9eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494d71b0 0x5651498a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.074+0000 7fbc3d9eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494d71b0 0x5651498a7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40528/0 (socket says 172.21.15.7:40528) 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.074+0000 7fbc3d9eb640 1 -- 172.21.15.7:0/1858873906 learned_addr learned my addr 172.21.15.7:0/1858873906 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.074+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/1858873906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 0x5651498a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/1858873906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494df390 0x5651498a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc3d9eb640 1 -- 172.21.15.7:0/1858873906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494df390 msgr2=0x5651498a8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc3d9eb640 1 --2- 172.21.15.7:0/1858873906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494df390 0x5651498a8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc2effd640 1 --2- 172.21.15.7:0/3481993881 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbc240b6680 0x7fbc240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc3d9eb640 1 -- 172.21.15.7:0/1858873906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 msgr2=0x5651498a76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc3d9eb640 1 --2- 172.21.15.7:0/1858873906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 0x5651498a76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc3d9eb640 1 -- 172.21.15.7:0/1858873906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56514956b650 con 0x5651494d71b0 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/1858873906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494df390 0x5651498a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc3e1ec640 1 --2- 172.21.15.7:0/3481993881 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbc240b6680 0x7fbc240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc3d9eb640 1 --2- 172.21.15.7:0/1858873906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494d71b0 0x5651498a7be0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400acd0 tx=0x7fbc3400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ff3681feac09e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:26.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc2effd640 1 -- 172.21.15.7:0/3481993881 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fbc300e79d0 con 0x7fbc38109e40 2024-09-21T06:00:26.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc23fff640 1 -- 172.21.15.7:0/1858873906 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3401d070 con 0x5651494d71b0 2024-09-21T06:00:26.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc23fff640 1 -- 172.21.15.7:0/1858873906 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc34018af0 con 0x5651494d71b0 2024-09-21T06:00:26.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.075+0000 7fbc23fff640 1 -- 172.21.15.7:0/1858873906 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34010ba0 con 0x5651494d71b0 2024-09-21T06:00:26.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.076+0000 7fbc461c3740 1 -- 172.21.15.7:0/1858873906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494d71b0 msgr2=0x5651498a7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:26.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.076+0000 7fbc3e1ec640 1 --2- 172.21.15.7:0/3481993881 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbc240b6680 0x7fbc240b8b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbc300e5220 tx=0x7fbc3007a5d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:26.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.076+0000 7fbc461c3740 1 --2- 172.21.15.7:0/1858873906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494d71b0 0x5651498a7be0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400acd0 tx=0x7fbc3400f790 comp rx=0 tx=0).stop 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.076+0000 7fbc461c3740 1 -- 172.21.15.7:0/1858873906 shutdown_connections 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.076+0000 7fbc461c3740 1 --2- 172.21.15.7:0/1858873906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494d71b0 0x5651498a7be0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.076+0000 7fbc461c3740 1 --2- 172.21.15.7:0/1858873906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494df390 0x5651498a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.076+0000 7fbc461c3740 1 --2- 172.21.15.7:0/1858873906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 0x5651498a76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.076+0000 7fbc461c3740 1 -- 172.21.15.7:0/1858873906 >> 172.21.15.7:0/1858873906 conn(0x5651494f4460 msgr2=0x5651498a5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.076+0000 7fbc461c3740 1 -- 172.21.15.7:0/1858873906 shutdown_connections 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.076+0000 7fbc461c3740 1 -- 172.21.15.7:0/1858873906 wait complete. 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.077+0000 7fbc461c3740 1 -- start start 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.077+0000 7fbc461c3740 1 Processor -- start 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc461c3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651494d71b0 0x5651498b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc461c3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494df390 0x5651498b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc461c3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565149500070 0x5651498bf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc461c3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56514966e700 con 0x565149500070 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc461c3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5651497a8160 con 0x5651494d71b0 2024-09-21T06:00:26.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc461c3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5651498b5e80 con 0x5651494df390 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc461c3740 10 client.0 _ll_register_callbacks cb 0x5651497c19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc3d1ea640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565149500070 0x5651498bf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc3d1ea640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565149500070 0x5651498bf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40532/0 (socket says 172.21.15.7:40532) 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc3d1ea640 1 -- 172.21.15.7:0/4096249010 learned_addr learned my addr 172.21.15.7:0/4096249010 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/4096249010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651494d71b0 0x5651498b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc3d9eb640 1 --2- 172.21.15.7:0/4096249010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494df390 0x5651498b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc3d1ea640 1 -- 172.21.15.7:0/4096249010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494df390 msgr2=0x5651498b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/4096249010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494df390 0x5651498b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc3d1ea640 1 -- 172.21.15.7:0/4096249010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651494d71b0 msgr2=0x5651498b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/4096249010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651494d71b0 0x5651498b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc3d1ea640 1 -- 172.21.15.7:0/4096249010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651497d5c90 con 0x565149500070 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/4096249010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565149500070 0x5651498bf1a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fbc3806cbc0 tx=0x7fbc2802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469f46c7eb441cda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc217fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:26.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.078+0000 7fbc217fa640 1 -- 172.21.15.7:0/4096249010 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28035040 con 0x565149500070 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.079+0000 7fbc217fa640 1 -- 172.21.15.7:0/4096249010 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fbc28004460 con 0x565149500070 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.079+0000 7fbc461c3740 1 -- 172.21.15.7:0/4096249010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc34018af0 con 0x565149500070 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.079+0000 7fbc217fa640 1 -- 172.21.15.7:0/4096249010 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbc28051050 con 0x565149500070 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.079+0000 7fbc461c3740 10 client.17178 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.079+0000 7fbc461c3740 1 -- 172.21.15.7:0/4096249010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5651498c1bf0 con 0x565149500070 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.079+0000 7fbc217fa640 1 -- 172.21.15.7:0/4096249010 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc34018af0 con 0x565149500070 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.079+0000 7fbc217fa640 1 -- 172.21.15.7:0/4096249010 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbc2804a060 con 0x565149500070 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.079+0000 7fbc461c3740 10 client.17178 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.079+0000 7fbc461c3740 10 client.17178 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.079+0000 7fbc461c3740 20 client.17178 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.079+0000 7fbc461c3740 1 --2- 172.21.15.7:0/4096249010 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5651494be9f0 0x5651498c5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.079+0000 7fbc461c3740 4 client.17178 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.079+0000 7fbc461c3740 1 -- 172.21.15.7:0/4096249010 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56514981fdf0 con 0x5651494be9f0 2024-09-21T06:00:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.080+0000 7fbc3d9eb640 1 --2- 172.21.15.7:0/4096249010 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5651494be9f0 0x5651498c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.080+0000 7fbc3d9eb640 1 --2- 172.21.15.7:0/4096249010 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5651494be9f0 0x5651498c5150 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1997e6c420ff9e35 server_cookie=d2b5fefc8a1a531d in_seq=0 out_seq=0 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.080+0000 7fbc217fa640 10 client.17178 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc217fa640 1 -- 172.21.15.7:0/4096249010 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56514981fdf0 con 0x5651494be9f0 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc217fa640 10 client.17178 handle_command_reply: tid=0 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc461c3740 1 client.17178 shutdown 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc461c3740 1 -- 172.21.15.7:0/4096249010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565149500070 msgr2=0x5651498bf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc461c3740 1 --2- 172.21.15.7:0/4096249010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565149500070 0x5651498bf1a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fbc3806cbc0 tx=0x7fbc2802a410 comp rx=0 tx=0).stop 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc461c3740 1 -- 172.21.15.7:0/4096249010 shutdown_connections 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc461c3740 1 --2- 172.21.15.7:0/4096249010 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5651494be9f0 0x5651498c5150 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc461c3740 1 --2- 172.21.15.7:0/4096249010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565149500070 0x5651498bf1a0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc461c3740 1 --2- 172.21.15.7:0/4096249010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494df390 0x5651498b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc217fa640 0 client.17178 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc461c3740 1 --2- 172.21.15.7:0/4096249010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651494d71b0 0x5651498b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc461c3740 1 -- 172.21.15.7:0/4096249010 >> 172.21.15.7:0/4096249010 conn(0x5651494f4460 msgr2=0x5651498aa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:26.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc461c3740 1 -- 172.21.15.7:0/4096249010 shutdown_connections 2024-09-21T06:00:26.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc461c3740 1 -- 172.21.15.7:0/4096249010 wait complete. 2024-09-21T06:00:26.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.081+0000 7fbc461c3740 20 client.17178 trim_cache size 0 max 16384 2024-09-21T06:00:26.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc461c3740 1 Processor -- start 2024-09-21T06:00:26.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc461c3740 1 -- start start 2024-09-21T06:00:26.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc461c3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494d71b0 0x5651498b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc461c3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 0x5651498bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc461c3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 0x5651498affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc461c3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381b1fd0 con 0x5651494df390 2024-09-21T06:00:26.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc461c3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381af8a0 con 0x565149500070 2024-09-21T06:00:26.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc461c3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381ad710 con 0x5651494d71b0 2024-09-21T06:00:26.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc3d9eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 0x5651498bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc3d9eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 0x5651498bf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40548/0 (socket says 172.21.15.7:40548) 2024-09-21T06:00:26.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc3d9eb640 1 -- 172.21.15.7:0/454689771 learned_addr learned my addr 172.21.15.7:0/454689771 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:26.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/454689771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 0x5651498affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc3d9eb640 1 -- 172.21.15.7:0/454689771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494d71b0 msgr2=0x5651498b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:26.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc3d9eb640 1 --2- 172.21.15.7:0/454689771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494d71b0 0x5651498b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc3d9eb640 1 -- 172.21.15.7:0/454689771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 msgr2=0x5651498affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:26.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc3d9eb640 1 --2- 172.21.15.7:0/454689771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 0x5651498affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc3d9eb640 1 -- 172.21.15.7:0/454689771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651498a57c0 con 0x5651494df390 2024-09-21T06:00:26.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.095+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/454689771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 0x5651498affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:26.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.096+0000 7fbc3d9eb640 1 --2- 172.21.15.7:0/454689771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 0x5651498bf0a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x5651498a6320 tx=0x7fbc3400ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936b8143a03b4ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:26.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.096+0000 7fbc237fe640 1 -- 172.21.15.7:0/454689771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3401d040 con 0x5651494df390 2024-09-21T06:00:26.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.096+0000 7fbc237fe640 1 -- 172.21.15.7:0/454689771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc34030070 con 0x5651494df390 2024-09-21T06:00:26.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.096+0000 7fbc237fe640 1 -- 172.21.15.7:0/454689771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34010df0 con 0x5651494df390 2024-09-21T06:00:26.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.097+0000 7fbc461c3740 1 -- 172.21.15.7:0/454689771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 msgr2=0x5651498bf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:26.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.097+0000 7fbc461c3740 1 --2- 172.21.15.7:0/454689771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 0x5651498bf0a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x5651498a6320 tx=0x7fbc3400ac20 comp rx=0 tx=0).stop 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.097+0000 7fbc461c3740 1 -- 172.21.15.7:0/454689771 shutdown_connections 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.097+0000 7fbc461c3740 1 --2- 172.21.15.7:0/454689771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 0x5651498bf0a0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.097+0000 7fbc461c3740 1 --2- 172.21.15.7:0/454689771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 0x5651498affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.097+0000 7fbc461c3740 1 --2- 172.21.15.7:0/454689771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494d71b0 0x5651498b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.097+0000 7fbc461c3740 1 -- 172.21.15.7:0/454689771 >> 172.21.15.7:0/454689771 conn(0x5651494f4460 msgr2=0x5651498b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.097+0000 7fbc461c3740 1 -- 172.21.15.7:0/454689771 shutdown_connections 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.097+0000 7fbc461c3740 1 -- 172.21.15.7:0/454689771 wait complete. 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.097+0000 7fbc461c3740 1 -- start start 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.097+0000 7fbc461c3740 1 Processor -- start 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc461c3740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494d71b0 0x5651498bbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc461c3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 0x5651498b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc461c3740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 0x5651498b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc461c3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381add60 con 0x5651494df390 2024-09-21T06:00:26.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc461c3740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381af1d0 con 0x565149500070 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc461c3740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381ae430 con 0x5651494d71b0 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc461c3740 10 client.0 _ll_register_callbacks cb 0x7fbc28009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc3d9eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 0x5651498b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc3d9eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 0x5651498b6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40550/0 (socket says 172.21.15.7:40550) 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc3d9eb640 1 -- 172.21.15.7:0/2918833263 learned_addr learned my addr 172.21.15.7:0/2918833263 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/2918833263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494d71b0 0x5651498bbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc3d9eb640 1 -- 172.21.15.7:0/2918833263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494d71b0 msgr2=0x5651498bbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc3d9eb640 1 --2- 172.21.15.7:0/2918833263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494d71b0 0x5651498bbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/2918833263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 0x5651498b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc3d9eb640 1 -- 172.21.15.7:0/2918833263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 msgr2=0x5651498b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc3d9eb640 1 --2- 172.21.15.7:0/2918833263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 0x5651498b76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc3d9eb640 1 -- 172.21.15.7:0/2918833263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565149932f60 con 0x5651494df390 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc3d9eb640 1 --2- 172.21.15.7:0/2918833263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 0x5651498b6fd0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fbc34006010 tx=0x7fbc3400fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a1d73c89ecd2c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.098+0000 7fbc217fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:26.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc217fa640 1 -- 172.21.15.7:0/2918833263 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34038070 con 0x5651494df390 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc217fa640 1 -- 172.21.15.7:0/2918833263 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fbc34005040 con 0x5651494df390 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc461c3740 1 -- 172.21.15.7:0/2918833263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc34030070 con 0x5651494df390 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc217fa640 1 -- 172.21.15.7:0/2918833263 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbc34044050 con 0x5651494df390 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc461c3740 10 client.17184 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc461c3740 1 -- 172.21.15.7:0/2918833263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565149934020 con 0x5651494df390 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc217fa640 1 -- 172.21.15.7:0/2918833263 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc34030070 con 0x5651494df390 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc217fa640 1 -- 172.21.15.7:0/2918833263 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbc34004660 con 0x5651494df390 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc461c3740 10 client.17184 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc461c3740 10 client.17184 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc461c3740 20 client.17184 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc461c3740 1 --2- 172.21.15.7:0/2918833263 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x565149493da0 0x565149936500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc461c3740 4 client.17184 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.099+0000 7fbc461c3740 1 -- 172.21.15.7:0/2918833263 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56514981b8a0 con 0x565149493da0 2024-09-21T06:00:26.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.100+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/2918833263 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x565149493da0 0x565149936500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.100+0000 7fbc3d1ea640 1 --2- 172.21.15.7:0/2918833263 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x565149493da0 0x565149936500 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f055855fbbfc34c3 server_cookie=bf419878d9fecf59 in_seq=0 out_seq=0 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.100+0000 7fbc217fa640 10 client.17184 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.100+0000 7fbc217fa640 1 -- 172.21.15.7:0/2918833263 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56514981b8a0 con 0x565149493da0 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.100+0000 7fbc217fa640 10 client.17184 handle_command_reply: tid=0 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.100+0000 7fbc461c3740 1 client.17184 shutdown 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.100+0000 7fbc461c3740 1 -- 172.21.15.7:0/2918833263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 msgr2=0x5651498b6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.100+0000 7fbc461c3740 1 --2- 172.21.15.7:0/2918833263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 0x5651498b6fd0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fbc34006010 tx=0x7fbc3400fdf0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc461c3740 1 -- 172.21.15.7:0/2918833263 shutdown_connections 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc461c3740 1 --2- 172.21.15.7:0/2918833263 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x565149493da0 0x565149936500 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc461c3740 1 --2- 172.21.15.7:0/2918833263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651494df390 0x5651498b6fd0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc217fa640 0 client.17184 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc461c3740 1 --2- 172.21.15.7:0/2918833263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565149500070 0x5651498b76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc461c3740 1 --2- 172.21.15.7:0/2918833263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651494d71b0 0x5651498bbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc461c3740 1 -- 172.21.15.7:0/2918833263 >> 172.21.15.7:0/2918833263 conn(0x5651494f4460 msgr2=0x5651498a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:26.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc461c3740 1 -- 172.21.15.7:0/2918833263 shutdown_connections 2024-09-21T06:00:26.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc461c3740 1 -- 172.21.15.7:0/2918833263 wait complete. 2024-09-21T06:00:26.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc461c3740 20 client.17184 trim_cache size 0 max 16384 2024-09-21T06:00:26.108 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:26.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc3fc4f640 1 -- 172.21.15.7:0/3481993881 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbc240b6680 msgr2=0x7fbc240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc3fc4f640 1 --2- 172.21.15.7:0/3481993881 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbc240b6680 0x7fbc240b8b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbc300e5220 tx=0x7fbc3007a5d0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc3fc4f640 1 -- 172.21.15.7:0/3481993881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc38109e40 msgr2=0x7fbc3819fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc3fc4f640 1 --2- 172.21.15.7:0/3481993881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc38109e40 0x7fbc3819fd70 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000e940 tx=0x7fbc3000ee00 comp rx=0 tx=0).stop 2024-09-21T06:00:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc3fc4f640 1 -- 172.21.15.7:0/3481993881 shutdown_connections 2024-09-21T06:00:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc3fc4f640 1 --2- 172.21.15.7:0/3481993881 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbc240b6680 0x7fbc240b8b90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc3fc4f640 1 --2- 172.21.15.7:0/3481993881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc38109e40 0x7fbc3819fd70 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc3fc4f640 1 --2- 172.21.15.7:0/3481993881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc381094f0 0x7fbc3819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc3fc4f640 1 --2- 172.21.15.7:0/3481993881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc38103bb0 0x7fbc3819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc3fc4f640 1 -- 172.21.15.7:0/3481993881 >> 172.21.15.7:0/3481993881 conn(0x7fbc380ff600 msgr2=0x7fbc38101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.101+0000 7fbc3fc4f640 1 -- 172.21.15.7:0/3481993881 shutdown_connections 2024-09-21T06:00:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:26.102+0000 7fbc3fc4f640 1 -- 172.21.15.7:0/3481993881 wait complete. 2024-09-21T06:00:26.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:26 smithi007 ceph-mon[30983]: pgmap v516: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:00:26.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:26 smithi119 ceph-mon[34833]: pgmap v516: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:00:26.701 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:00:26.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:26 smithi027 ceph-mon[34364]: pgmap v516: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:00:26.966 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.425+0000 7f14c8ce9640 1 -- 172.21.15.7:0/2213967192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14c4103b60 msgr2=0x7f14c4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.425+0000 7f14c8ce9640 1 --2- 172.21.15.7:0/2213967192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14c4103b60 0x7f14c4103f70 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009900 tx=0x7f14b402a410 comp rx=0 tx=0).stop 2024-09-21T06:00:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.425+0000 7f14c8ce9640 1 -- 172.21.15.7:0/2213967192 shutdown_connections 2024-09-21T06:00:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.425+0000 7f14c8ce9640 1 --2- 172.21.15.7:0/2213967192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14c4109df0 0x7f14c4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.425+0000 7f14c8ce9640 1 --2- 172.21.15.7:0/2213967192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14c41094a0 0x7f14c41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.425+0000 7f14c8ce9640 1 --2- 172.21.15.7:0/2213967192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14c4103b60 0x7f14c4103f70 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.425+0000 7f14c8ce9640 1 -- 172.21.15.7:0/2213967192 >> 172.21.15.7:0/2213967192 conn(0x7f14c407b850 msgr2=0x7f14c407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.426+0000 7f14c8ce9640 1 -- 172.21.15.7:0/2213967192 shutdown_connections 2024-09-21T06:00:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.426+0000 7f14c8ce9640 1 -- 172.21.15.7:0/2213967192 wait complete. 2024-09-21T06:00:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.426+0000 7f14c8ce9640 1 Processor -- start 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.426+0000 7f14c8ce9640 1 -- start start 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c8ce9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14c4103b60 0x7f14c4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c8ce9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14c41094a0 0x7f14c4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c8ce9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14c4109df0 0x7f14c4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c8ce9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14c4113ab0 con 0x7f14c4103b60 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c8ce9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f14c4113930 con 0x7f14c4109df0 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c8ce9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f14c4113c30 con 0x7f14c41094a0 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14c4103b60 0x7f14c4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14c4103b60 0x7f14c4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40574/0 (socket says 172.21.15.7:40574) 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c259c640 1 -- 172.21.15.7:0/1154236302 learned_addr learned my addr 172.21.15.7:0/1154236302 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14c4109df0 0x7f14c4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c1d9b640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14c41094a0 0x7f14c4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c259c640 1 -- 172.21.15.7:0/1154236302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14c41094a0 msgr2=0x7f14c4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c259c640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14c41094a0 0x7f14c4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c259c640 1 -- 172.21.15.7:0/1154236302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14c4109df0 msgr2=0x7f14c4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c259c640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14c4109df0 0x7f14c4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c259c640 1 -- 172.21.15.7:0/1154236302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c41a8710 con 0x7f14c4103b60 2024-09-21T06:00:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14c4109df0 0x7f14c4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c1d9b640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14c41094a0 0x7f14c4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.427+0000 7f14c259c640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14c4103b60 0x7f14c4075710 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f14b4005940 tx=0x7f14b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.428+0000 7f14bb7fe640 1 -- 172.21.15.7:0/1154236302 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b403f030 con 0x7f14c4103b60 2024-09-21T06:00:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.428+0000 7f14bb7fe640 1 -- 172.21.15.7:0/1154236302 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14b4003cb0 con 0x7f14c4103b60 2024-09-21T06:00:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.428+0000 7f14c8ce9640 1 -- 172.21.15.7:0/1154236302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c41a89a0 con 0x7f14c4103b60 2024-09-21T06:00:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.428+0000 7f14bb7fe640 1 -- 172.21.15.7:0/1154236302 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4035070 con 0x7f14c4103b60 2024-09-21T06:00:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.428+0000 7f14c8ce9640 1 -- 172.21.15.7:0/1154236302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c41a8ed0 con 0x7f14c4103b60 2024-09-21T06:00:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.430+0000 7f14cf25d740 1 Processor -- start 2024-09-21T06:00:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14cf25d740 1 -- start start 2024-09-21T06:00:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14bb7fe640 1 -- 172.21.15.7:0/1154236302 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f14b4042030 con 0x7f14c4103b60 2024-09-21T06:00:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14cf25d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 0x55eca951f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14cf25d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca914f1b0 0x55eca951f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14cf25d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca9157390 0x55eca951fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14cf25d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55eca9495ea0 con 0x55eca9178070 2024-09-21T06:00:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14cf25d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55eca94852d0 con 0x55eca9157390 2024-09-21T06:00:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14cf25d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55eca94890e0 con 0x55eca914f1b0 2024-09-21T06:00:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14c2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 0x55eca951f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14c2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 0x55eca951f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40578/0 (socket says 172.21.15.7:40578) 2024-09-21T06:00:27.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14c2d9d640 1 -- 172.21.15.7:0/2128190 learned_addr learned my addr 172.21.15.7:0/2128190 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:27.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14c259c640 1 --2- 172.21.15.7:0/2128190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca914f1b0 0x55eca951f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14c1d9b640 1 --2- 172.21.15.7:0/2128190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca9157390 0x55eca951fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14c2d9d640 1 -- 172.21.15.7:0/2128190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca914f1b0 msgr2=0x55eca951f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:27.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/2128190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca914f1b0 0x55eca951f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14c2d9d640 1 -- 172.21.15.7:0/2128190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca9157390 msgr2=0x55eca951fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:27.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/2128190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca9157390 0x55eca951fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14c2d9d640 1 -- 172.21.15.7:0/2128190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca91e3650 con 0x55eca9178070 2024-09-21T06:00:27.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14c259c640 1 --2- 172.21.15.7:0/2128190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca914f1b0 0x55eca951f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.431+0000 7f14c1d9b640 1 --2- 172.21.15.7:0/2128190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca9157390 0x55eca951fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.432+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/2128190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 0x55eca951f2c0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f14bc007e60 tx=0x7f14bc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd6f447f524261b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.432+0000 7f14bb7fe640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f14b00b6700 0x7f14b00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.432+0000 7f14c259c640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f14b00b6700 0x7f14b00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.432+0000 7f14b8ff9640 1 -- 172.21.15.7:0/2128190 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc014070 con 0x55eca9178070 2024-09-21T06:00:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.432+0000 7f14b8ff9640 1 -- 172.21.15.7:0/2128190 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14bc003e20 con 0x55eca9178070 2024-09-21T06:00:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.432+0000 7f14b8ff9640 1 -- 172.21.15.7:0/2128190 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc004740 con 0x55eca9178070 2024-09-21T06:00:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.432+0000 7f14bb7fe640 1 -- 172.21.15.7:0/1154236302 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f14b4107fb0 con 0x7f14c4103b60 2024-09-21T06:00:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.433+0000 7f14cf25d740 1 -- 172.21.15.7:0/2128190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 msgr2=0x55eca951f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.433+0000 7f14cf25d740 1 --2- 172.21.15.7:0/2128190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 0x55eca951f2c0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f14bc007e60 tx=0x7f14bc00e720 comp rx=0 tx=0).stop 2024-09-21T06:00:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.433+0000 7f14c259c640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f14b00b6700 0x7f14b00b8c10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f14b4105800 tx=0x7f14b403b640 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.433+0000 7f14cf25d740 1 -- 172.21.15.7:0/2128190 shutdown_connections 2024-09-21T06:00:27.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.433+0000 7f14cf25d740 1 --2- 172.21.15.7:0/2128190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca9157390 0x55eca951fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.433+0000 7f14cf25d740 1 --2- 172.21.15.7:0/2128190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca914f1b0 0x55eca951f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.433+0000 7f14cf25d740 1 --2- 172.21.15.7:0/2128190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 0x55eca951f2c0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.433+0000 7f14cf25d740 1 -- 172.21.15.7:0/2128190 >> 172.21.15.7:0/2128190 conn(0x55eca916c460 msgr2=0x55eca951d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.433+0000 7f14cf25d740 1 -- 172.21.15.7:0/2128190 shutdown_connections 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.433+0000 7f14cf25d740 1 -- 172.21.15.7:0/2128190 wait complete. 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.433+0000 7f14cf25d740 1 -- start start 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14cf25d740 1 Processor -- start 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14cf25d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca914f1b0 0x55eca952a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14cf25d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9157390 0x55eca952ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14cf25d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9178070 0x55eca9536d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14cf25d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55eca92e6700 con 0x55eca9157390 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14cf25d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55eca9420160 con 0x55eca914f1b0 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14cf25d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55eca952daa0 con 0x55eca9178070 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14cf25d740 10 client.0 _ll_register_callbacks cb 0x55eca94399e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14c1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9157390 0x55eca952ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14c1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9157390 0x55eca952ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40584/0 (socket says 172.21.15.7:40584) 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14c1d9b640 1 -- 172.21.15.7:0/4155460162 learned_addr learned my addr 172.21.15.7:0/4155460162 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca914f1b0 0x55eca952a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9178070 0x55eca9536d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14c1d9b640 1 -- 172.21.15.7:0/4155460162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9178070 msgr2=0x55eca9536d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14c1d9b640 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9178070 0x55eca9536d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14c1d9b640 1 -- 172.21.15.7:0/4155460162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca914f1b0 msgr2=0x55eca952a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14c1d9b640 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca914f1b0 0x55eca952a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14c1d9b640 1 -- 172.21.15.7:0/4155460162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca944dc90 con 0x55eca9157390 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.434+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9178070 0x55eca9536d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14c1d9b640 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9157390 0x55eca952ae70 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00dde0 tx=0x7f14ac00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46e2488848c35d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14a9ffb640 1 -- 172.21.15.7:0/4155460162 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac004220 con 0x55eca9157390 2024-09-21T06:00:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14a9ffb640 1 -- 172.21.15.7:0/4155460162 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f14ac0043c0 con 0x55eca9157390 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14cf25d740 1 -- 172.21.15.7:0/4155460162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14bc003e20 con 0x55eca9157390 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14a9ffb640 1 -- 172.21.15.7:0/4155460162 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f14ac011650 con 0x55eca9157390 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14cf25d740 10 client.17196 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14cf25d740 1 -- 172.21.15.7:0/4155460162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eca9539740 con 0x55eca9157390 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14a9ffb640 1 -- 172.21.15.7:0/4155460162 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14bc003e20 con 0x55eca9157390 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14a9ffb640 1 -- 172.21.15.7:0/4155460162 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f14ac003a00 con 0x55eca9157390 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14cf25d740 10 client.17196 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14cf25d740 10 client.17196 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14cf25d740 20 client.17196 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14cf25d740 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55eca91369f0 0x55eca953cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14cf25d740 4 client.17196 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.435+0000 7f14cf25d740 1 -- 172.21.15.7:0/4155460162 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eca9497df0 con 0x55eca91369f0 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.436+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55eca91369f0 0x55eca953cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.436+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55eca91369f0 0x55eca953cca0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=759a999d1b4d7f42 server_cookie=dc5dd2f3b6154910 in_seq=0 out_seq=0 2024-09-21T06:00:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.436+0000 7f14a9ffb640 10 client.17196 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14a9ffb640 1 -- 172.21.15.7:0/4155460162 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eca9497df0 con 0x55eca91369f0 2024-09-21T06:00:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14a9ffb640 10 client.17196 handle_command_reply: tid=0 2024-09-21T06:00:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14cf25d740 1 client.17196 shutdown 2024-09-21T06:00:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14cf25d740 1 -- 172.21.15.7:0/4155460162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9157390 msgr2=0x55eca952ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14cf25d740 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9157390 0x55eca952ae70 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00dde0 tx=0x7f14ac00f730 comp rx=0 tx=0).stop 2024-09-21T06:00:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14cf25d740 1 -- 172.21.15.7:0/4155460162 shutdown_connections 2024-09-21T06:00:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14cf25d740 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55eca91369f0 0x55eca953cca0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14cf25d740 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9157390 0x55eca952ae70 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14cf25d740 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9178070 0x55eca9536d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14cf25d740 1 --2- 172.21.15.7:0/4155460162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca914f1b0 0x55eca952a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14a9ffb640 0 client.17196 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:27.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14cf25d740 1 -- 172.21.15.7:0/4155460162 >> 172.21.15.7:0/4155460162 conn(0x55eca916c460 msgr2=0x55eca95224a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:27.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14cf25d740 1 -- 172.21.15.7:0/4155460162 shutdown_connections 2024-09-21T06:00:27.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.437+0000 7f14cf25d740 1 -- 172.21.15.7:0/4155460162 wait complete. 2024-09-21T06:00:27.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.438+0000 7f14cf25d740 20 client.17196 trim_cache size 0 max 16384 2024-09-21T06:00:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14cf25d740 1 Processor -- start 2024-09-21T06:00:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14cf25d740 1 -- start start 2024-09-21T06:00:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14cf25d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca914f1b0 0x55eca952c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14cf25d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9157390 0x55eca9520a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14cf25d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 0x55eca9536c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14cf25d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14c41b4110 con 0x55eca9178070 2024-09-21T06:00:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14cf25d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f14c41b19e0 con 0x55eca914f1b0 2024-09-21T06:00:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14cf25d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f14c41af850 con 0x55eca9157390 2024-09-21T06:00:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14c2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 0x55eca9536c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14c2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 0x55eca9536c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40594/0 (socket says 172.21.15.7:40594) 2024-09-21T06:00:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14c2d9d640 1 -- 172.21.15.7:0/1142015476 learned_addr learned my addr 172.21.15.7:0/1142015476 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/1142015476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca914f1b0 0x55eca952c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14c1d9b640 1 --2- 172.21.15.7:0/1142015476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9157390 0x55eca9520a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14c2d9d640 1 -- 172.21.15.7:0/1142015476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9157390 msgr2=0x55eca9520a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:27.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/1142015476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9157390 0x55eca9520a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14c2d9d640 1 -- 172.21.15.7:0/1142015476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca914f1b0 msgr2=0x55eca952c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:27.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/1142015476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca914f1b0 0x55eca952c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.451+0000 7f14c2d9d640 1 -- 172.21.15.7:0/1142015476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca95185d0 con 0x55eca9178070 2024-09-21T06:00:27.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.452+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/1142015476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 0x55eca9536c90 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0042b0 tx=0x7f14bc0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f44b5b09311230 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:27.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.452+0000 7f14abfff640 1 -- 172.21.15.7:0/1142015476 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc014030 con 0x55eca9178070 2024-09-21T06:00:27.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.452+0000 7f14abfff640 1 -- 172.21.15.7:0/1142015476 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14bc0058b0 con 0x55eca9178070 2024-09-21T06:00:27.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.452+0000 7f14abfff640 1 -- 172.21.15.7:0/1142015476 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc010640 con 0x55eca9178070 2024-09-21T06:00:27.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.453+0000 7f14cf25d740 1 -- 172.21.15.7:0/1142015476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 msgr2=0x55eca9536c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:27.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.453+0000 7f14cf25d740 1 --2- 172.21.15.7:0/1142015476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 0x55eca9536c90 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0042b0 tx=0x7f14bc0042e0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.453+0000 7f14cf25d740 1 -- 172.21.15.7:0/1142015476 shutdown_connections 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.453+0000 7f14cf25d740 1 --2- 172.21.15.7:0/1142015476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca9178070 0x55eca9536c90 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.453+0000 7f14cf25d740 1 --2- 172.21.15.7:0/1142015476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9157390 0x55eca9520a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.453+0000 7f14cf25d740 1 --2- 172.21.15.7:0/1142015476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca914f1b0 0x55eca952c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.453+0000 7f14cf25d740 1 -- 172.21.15.7:0/1142015476 >> 172.21.15.7:0/1142015476 conn(0x55eca916c460 msgr2=0x55eca95202f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.453+0000 7f14cf25d740 1 -- 172.21.15.7:0/1142015476 shutdown_connections 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.453+0000 7f14cf25d740 1 -- 172.21.15.7:0/1142015476 wait complete. 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.453+0000 7f14cf25d740 1 -- start start 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.453+0000 7f14cf25d740 1 Processor -- start 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.453+0000 7f14cf25d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca914f1b0 0x55eca952ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.453+0000 7f14cf25d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9157390 0x55eca952f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14cf25d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca9178070 0x55eca952f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14cf25d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14c41afea0 con 0x55eca914f1b0 2024-09-21T06:00:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14cf25d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f14c41b1310 con 0x55eca9178070 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14cf25d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f14c41b0570 con 0x55eca9157390 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14cf25d740 10 client.0 _ll_register_callbacks cb 0x7f14ac00d300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14c2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca914f1b0 0x55eca952ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14c2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca914f1b0 0x55eca952ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40610/0 (socket says 172.21.15.7:40610) 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14c2d9d640 1 -- 172.21.15.7:0/1938729067 learned_addr learned my addr 172.21.15.7:0/1938729067 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14c1d9b640 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9157390 0x55eca952f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca9178070 0x55eca952f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14c2d9d640 1 -- 172.21.15.7:0/1938729067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9157390 msgr2=0x55eca952f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9157390 0x55eca952f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14c2d9d640 1 -- 172.21.15.7:0/1938729067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca9178070 msgr2=0x55eca952f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca9178070 0x55eca952f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14c2d9d640 1 -- 172.21.15.7:0/1938729067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca95a6660 con 0x55eca914f1b0 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14c1d9b640 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9157390 0x55eca952f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:27.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14c2d9d640 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca914f1b0 0x55eca952ebf0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f14bc005b40 tx=0x7f14bc007fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8f8cd0028f7dcc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14a9ffb640 1 -- 172.21.15.7:0/1938729067 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc014040 con 0x55eca914f1b0 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14a9ffb640 1 -- 172.21.15.7:0/1938729067 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f14bc0052a0 con 0x55eca914f1b0 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.454+0000 7f14cf25d740 1 -- 172.21.15.7:0/1938729067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14bc0058b0 con 0x55eca914f1b0 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.455+0000 7f14a9ffb640 1 -- 172.21.15.7:0/1938729067 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f14bc040050 con 0x55eca914f1b0 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.455+0000 7f14cf25d740 10 client.17202 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.455+0000 7f14cf25d740 1 -- 172.21.15.7:0/1938729067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eca95a7800 con 0x55eca914f1b0 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.455+0000 7f14a9ffb640 1 -- 172.21.15.7:0/1938729067 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14bc0058b0 con 0x55eca914f1b0 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.455+0000 7f14a9ffb640 1 -- 172.21.15.7:0/1938729067 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f14bc027450 con 0x55eca914f1b0 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.455+0000 7f14cf25d740 10 client.17202 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.455+0000 7f14cf25d740 10 client.17202 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.455+0000 7f14cf25d740 20 client.17202 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.455+0000 7f14cf25d740 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55eca910bda0 0x55eca95a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.455+0000 7f14cf25d740 4 client.17202 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.455+0000 7f14cf25d740 1 -- 172.21.15.7:0/1938729067 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eca94938a0 con 0x55eca910bda0 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.455+0000 7f14c1d9b640 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55eca910bda0 0x55eca95a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14c1d9b640 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55eca910bda0 0x55eca95a9d70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8c1fbf5040159866 server_cookie=3485915e880019fd in_seq=0 out_seq=0 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14a9ffb640 10 client.17202 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14a9ffb640 1 -- 172.21.15.7:0/1938729067 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eca94938a0 con 0x55eca910bda0 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14a9ffb640 10 client.17202 handle_command_reply: tid=0 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14cf25d740 1 client.17202 shutdown 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14cf25d740 1 -- 172.21.15.7:0/1938729067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca914f1b0 msgr2=0x55eca952ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14cf25d740 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca914f1b0 0x55eca952ebf0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f14bc005b40 tx=0x7f14bc007fb0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14cf25d740 1 -- 172.21.15.7:0/1938729067 shutdown_connections 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14cf25d740 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55eca910bda0 0x55eca95a9d70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14cf25d740 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55eca9178070 0x55eca952f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14cf25d740 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55eca9157390 0x55eca952f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14cf25d740 1 --2- 172.21.15.7:0/1938729067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eca914f1b0 0x55eca952ebf0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14cf25d740 1 -- 172.21.15.7:0/1938729067 >> 172.21.15.7:0/1938729067 conn(0x55eca916c460 msgr2=0x55eca9520a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:27.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14a9ffb640 0 client.17202 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:27.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14cf25d740 1 -- 172.21.15.7:0/1938729067 shutdown_connections 2024-09-21T06:00:27.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.456+0000 7f14cf25d740 1 -- 172.21.15.7:0/1938729067 wait complete. 2024-09-21T06:00:27.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.457+0000 7f14cf25d740 20 client.17202 trim_cache size 0 max 16384 2024-09-21T06:00:27.465 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:27.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.457+0000 7f14c8ce9640 1 -- 172.21.15.7:0/1154236302 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f14b00b6700 msgr2=0x7f14b00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:27.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.457+0000 7f14c8ce9640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f14b00b6700 0x7f14b00b8c10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f14b4105800 tx=0x7f14b403b640 comp rx=0 tx=0).stop 2024-09-21T06:00:27.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.457+0000 7f14c8ce9640 1 -- 172.21.15.7:0/1154236302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14c4103b60 msgr2=0x7f14c4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:27.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.457+0000 7f14c8ce9640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14c4103b60 0x7f14c4075710 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f14b4005940 tx=0x7f14b40042f0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.457+0000 7f14c8ce9640 1 -- 172.21.15.7:0/1154236302 shutdown_connections 2024-09-21T06:00:27.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.457+0000 7f14c8ce9640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f14b00b6700 0x7f14b00b8c10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.457+0000 7f14c8ce9640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14c4109df0 0x7f14c4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.457+0000 7f14c8ce9640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14c41094a0 0x7f14c4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.457+0000 7f14c8ce9640 1 --2- 172.21.15.7:0/1154236302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14c4103b60 0x7f14c4075710 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:27.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.457+0000 7f14c8ce9640 1 -- 172.21.15.7:0/1154236302 >> 172.21.15.7:0/1154236302 conn(0x7f14c407b850 msgr2=0x7f14c41075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:27.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.457+0000 7f14c8ce9640 1 -- 172.21.15.7:0/1154236302 shutdown_connections 2024-09-21T06:00:27.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:27.457+0000 7f14c8ce9640 1 -- 172.21.15.7:0/1154236302 wait complete. 2024-09-21T06:00:28.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:00:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:28.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:28 smithi007 ceph-mon[30983]: pgmap v517: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:00:28.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:28 smithi119 ceph-mon[34833]: pgmap v517: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:00:28.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:28 smithi027 ceph-mon[34364]: pgmap v517: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:00:28.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.950+0000 7fa54e8e4640 1 -- 172.21.15.7:0/1839875083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa548103b60 msgr2=0x7fa548103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:28.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.950+0000 7fa54e8e4640 1 --2- 172.21.15.7:0/1839875083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa548103b60 0x7fa548103f70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fa538009900 tx=0x7fa53802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.951+0000 7fa54e8e4640 1 -- 172.21.15.7:0/1839875083 shutdown_connections 2024-09-21T06:00:28.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.951+0000 7fa54e8e4640 1 --2- 172.21.15.7:0/1839875083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa548109df0 0x7fa548110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.951+0000 7fa54e8e4640 1 --2- 172.21.15.7:0/1839875083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5481094a0 0x7fa5481098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.951+0000 7fa54e8e4640 1 --2- 172.21.15.7:0/1839875083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa548103b60 0x7fa548103f70 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.951+0000 7fa54e8e4640 1 -- 172.21.15.7:0/1839875083 >> 172.21.15.7:0/1839875083 conn(0x7fa54807b850 msgr2=0x7fa54807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:28.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.951+0000 7fa54e8e4640 1 -- 172.21.15.7:0/1839875083 shutdown_connections 2024-09-21T06:00:28.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.951+0000 7fa54e8e4640 1 -- 172.21.15.7:0/1839875083 wait complete. 2024-09-21T06:00:28.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.951+0000 7fa54e8e4640 1 Processor -- start 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.951+0000 7fa54e8e4640 1 -- start start 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa54e8e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa548103b60 0x7fa54819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa54e8e4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5481094a0 0x7fa54819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa54e8e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa548109df0 0x7fa54819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa54e8e4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa548113ab0 con 0x7fa5481094a0 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa54e8e4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa548113930 con 0x7fa548109df0 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa54e8e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa548113c30 con 0x7fa548103b60 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa5477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5481094a0 0x7fa54819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa5477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5481094a0 0x7fa54819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39634/0 (socket says 172.21.15.7:39634) 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa5477fe640 1 -- 172.21.15.7:0/714629475 learned_addr learned my addr 172.21.15.7:0/714629475 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa547fff640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa548103b60 0x7fa54819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa54ce81640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa548109df0 0x7fa54819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa5477fe640 1 -- 172.21.15.7:0/714629475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa548103b60 msgr2=0x7fa54819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:28.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa5477fe640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa548103b60 0x7fa54819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa5477fe640 1 -- 172.21.15.7:0/714629475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa548109df0 msgr2=0x7fa54819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa5477fe640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa548109df0 0x7fa54819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa5477fe640 1 -- 172.21.15.7:0/714629475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5481a0330 con 0x7fa5481094a0 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa54ce81640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa548109df0 0x7fa54819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.952+0000 7fa547fff640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa548103b60 0x7fa54819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.953+0000 7fa5477fe640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5481094a0 0x7fa54819aa20 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c8c0 tx=0x7fa53c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.953+0000 7fa5457fa640 1 -- 172.21.15.7:0/714629475 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c007bb0 con 0x7fa5481094a0 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.953+0000 7fa54e8e4640 1 -- 172.21.15.7:0/714629475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5481a0620 con 0x7fa5481094a0 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.953+0000 7fa5457fa640 1 -- 172.21.15.7:0/714629475 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa53c007d50 con 0x7fa5481094a0 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.953+0000 7fa5457fa640 1 -- 172.21.15.7:0/714629475 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0187c0 con 0x7fa5481094a0 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.953+0000 7fa54e8e4640 1 -- 172.21.15.7:0/714629475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5481a6e40 con 0x7fa5481094a0 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.956+0000 7fa554e58740 1 Processor -- start 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.956+0000 7fa554e58740 1 -- start start 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.956+0000 7fa554e58740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c752c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.956+0000 7fa554e58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c75800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.956+0000 7fa554e58740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 0x559fc1c75d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.956+0000 7fa554e58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559fc1bebea0 con 0x559fc18a51b0 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.956+0000 7fa554e58740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559fc1bdb2d0 con 0x559fc18ce070 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.956+0000 7fa554e58740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559fc1bdf0e0 con 0x559fc18ad390 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.957+0000 7fa5457fa640 1 -- 172.21.15.7:0/714629475 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa53c00fa20 con 0x7fa5481094a0 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.957+0000 7fa547fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c75800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.957+0000 7fa547fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c75800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39640/0 (socket says 172.21.15.7:39640) 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.957+0000 7fa547fff640 1 -- 172.21.15.7:0/1126306952 learned_addr learned my addr 172.21.15.7:0/1126306952 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.957+0000 7fa54ce81640 1 --2- 172.21.15.7:0/1126306952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c752c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.957+0000 7fa5477fe640 1 --2- 172.21.15.7:0/1126306952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 0x559fc1c75d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.957+0000 7fa547fff640 1 -- 172.21.15.7:0/1126306952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 msgr2=0x559fc1c75d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.957+0000 7fa547fff640 1 --2- 172.21.15.7:0/1126306952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 0x559fc1c75d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.957+0000 7fa547fff640 1 -- 172.21.15.7:0/1126306952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 msgr2=0x559fc1c752c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.957+0000 7fa547fff640 1 --2- 172.21.15.7:0/1126306952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c752c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.957+0000 7fa547fff640 1 -- 172.21.15.7:0/1126306952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fc1939650 con 0x559fc18a51b0 2024-09-21T06:00:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.957+0000 7fa54ce81640 1 --2- 172.21.15.7:0/1126306952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c752c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:28.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.957+0000 7fa547fff640 1 --2- 172.21.15.7:0/1126306952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c75800 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fa538009900 tx=0x7fa538032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e169f0595ea0be14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:28.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.958+0000 7fa52e7fc640 1 -- 172.21.15.7:0/1126306952 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53803f070 con 0x559fc18a51b0 2024-09-21T06:00:28.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.958+0000 7fa52e7fc640 1 -- 172.21.15.7:0/1126306952 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5380316a0 con 0x559fc18a51b0 2024-09-21T06:00:28.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.958+0000 7fa52e7fc640 1 -- 172.21.15.7:0/1126306952 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538035070 con 0x559fc18a51b0 2024-09-21T06:00:28.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.958+0000 7fa5457fa640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5300b66b0 0x7fa5300b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.958+0000 7fa54ce81640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5300b66b0 0x7fa5300b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.958+0000 7fa5457fa640 1 -- 172.21.15.7:0/714629475 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fa53c0e7820 con 0x7fa5481094a0 2024-09-21T06:00:28.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.959+0000 7fa554e58740 1 -- 172.21.15.7:0/1126306952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 msgr2=0x559fc1c75800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.959+0000 7fa54ce81640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5300b66b0 0x7fa5300b8bc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa540005fd0 tx=0x7fa540009700 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.959+0000 7fa554e58740 1 --2- 172.21.15.7:0/1126306952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c75800 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fa538009900 tx=0x7fa538032e70 comp rx=0 tx=0).stop 2024-09-21T06:00:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.959+0000 7fa554e58740 1 -- 172.21.15.7:0/1126306952 shutdown_connections 2024-09-21T06:00:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.959+0000 7fa554e58740 1 --2- 172.21.15.7:0/1126306952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c75800 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.959+0000 7fa554e58740 1 --2- 172.21.15.7:0/1126306952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 0x559fc1c75d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.959+0000 7fa554e58740 1 --2- 172.21.15.7:0/1126306952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c752c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.959+0000 7fa554e58740 1 -- 172.21.15.7:0/1126306952 >> 172.21.15.7:0/1126306952 conn(0x559fc18c2460 msgr2=0x559fc1c731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.959+0000 7fa554e58740 1 -- 172.21.15.7:0/1126306952 shutdown_connections 2024-09-21T06:00:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.959+0000 7fa554e58740 1 -- 172.21.15.7:0/1126306952 wait complete. 2024-09-21T06:00:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.959+0000 7fa554e58740 1 -- start start 2024-09-21T06:00:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.959+0000 7fa554e58740 1 Processor -- start 2024-09-21T06:00:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa554e58740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18a51b0 0x559fc1c84d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa554e58740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ad390 0x559fc1c85280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa554e58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18ce070 0x559fc1c85800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa554e58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559fc1a3c700 con 0x559fc18ce070 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa554e58740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559fc1b76160 con 0x559fc18ad390 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa554e58740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559fc1c87da0 con 0x559fc18a51b0 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa554e58740 10 client.0 _ll_register_callbacks cb 0x559fc1b8f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa54ce81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18ce070 0x559fc1c85800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa547fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18a51b0 0x559fc1c84d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa54ce81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18ce070 0x559fc1c85800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39650/0 (socket says 172.21.15.7:39650) 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa54ce81640 1 -- 172.21.15.7:0/1496493254 learned_addr learned my addr 172.21.15.7:0/1496493254 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa5477fe640 1 --2- 172.21.15.7:0/1496493254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ad390 0x559fc1c85280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa54ce81640 1 -- 172.21.15.7:0/1496493254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18a51b0 msgr2=0x559fc1c84d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa54ce81640 1 --2- 172.21.15.7:0/1496493254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18a51b0 0x559fc1c84d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa54ce81640 1 -- 172.21.15.7:0/1496493254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ad390 msgr2=0x559fc1c85280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa54ce81640 1 --2- 172.21.15.7:0/1496493254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ad390 0x559fc1c85280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa54ce81640 1 -- 172.21.15.7:0/1496493254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fc1ba3c90 con 0x559fc18ce070 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa54ce81640 1 --2- 172.21.15.7:0/1496493254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18ce070 0x559fc1c85800 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fa5400109c0 tx=0x7fa540004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a1f1835f69e89b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.960+0000 7fa5277fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.961+0000 7fa5277fe640 1 -- 172.21.15.7:0/1496493254 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54000fd50 con 0x559fc18ce070 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.961+0000 7fa5277fe640 1 -- 172.21.15.7:0/1496493254 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fa540028470 con 0x559fc18ce070 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.961+0000 7fa554e58740 1 -- 172.21.15.7:0/1496493254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5380316a0 con 0x559fc18ce070 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.961+0000 7fa5277fe640 1 -- 172.21.15.7:0/1496493254 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa540010e80 con 0x559fc18ce070 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.961+0000 7fa554e58740 10 client.17214 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.961+0000 7fa554e58740 1 -- 172.21.15.7:0/1496493254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559fc1c93b10 con 0x559fc18ce070 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.961+0000 7fa5277fe640 1 -- 172.21.15.7:0/1496493254 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5380316a0 con 0x559fc18ce070 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.961+0000 7fa5277fe640 1 -- 172.21.15.7:0/1496493254 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa540031790 con 0x559fc18ce070 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.961+0000 7fa554e58740 10 client.17214 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.961+0000 7fa554e58740 10 client.17214 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.961+0000 7fa554e58740 20 client.17214 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:28.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.962+0000 7fa554e58740 1 --2- 172.21.15.7:0/1496493254 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559fc188c9f0 0x559fc1c96f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.962+0000 7fa554e58740 4 client.17214 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.962+0000 7fa554e58740 1 -- 172.21.15.7:0/1496493254 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fc1beddf0 con 0x559fc188c9f0 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.962+0000 7fa547fff640 1 --2- 172.21.15.7:0/1496493254 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559fc188c9f0 0x559fc1c96f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.962+0000 7fa547fff640 1 --2- 172.21.15.7:0/1496493254 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559fc188c9f0 0x559fc1c96f80 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b0681a7643af0c3 server_cookie=6007345df1e2a645 in_seq=0 out_seq=0 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.962+0000 7fa5277fe640 10 client.17214 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa5277fe640 1 -- 172.21.15.7:0/1496493254 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559fc1beddf0 con 0x559fc188c9f0 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa5277fe640 10 client.17214 handle_command_reply: tid=0 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa554e58740 1 client.17214 shutdown 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa554e58740 1 -- 172.21.15.7:0/1496493254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18ce070 msgr2=0x559fc1c85800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa554e58740 1 --2- 172.21.15.7:0/1496493254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18ce070 0x559fc1c85800 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fa5400109c0 tx=0x7fa540004a40 comp rx=0 tx=0).stop 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa554e58740 1 -- 172.21.15.7:0/1496493254 shutdown_connections 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa554e58740 1 --2- 172.21.15.7:0/1496493254 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559fc188c9f0 0x559fc1c96f80 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa554e58740 1 --2- 172.21.15.7:0/1496493254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18ce070 0x559fc1c85800 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa554e58740 1 --2- 172.21.15.7:0/1496493254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ad390 0x559fc1c85280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa554e58740 1 --2- 172.21.15.7:0/1496493254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18a51b0 0x559fc1c84d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa554e58740 1 -- 172.21.15.7:0/1496493254 >> 172.21.15.7:0/1496493254 conn(0x559fc18c2460 msgr2=0x559fc1c76cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:28.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa5277fe640 0 client.17214 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:28.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa554e58740 1 -- 172.21.15.7:0/1496493254 shutdown_connections 2024-09-21T06:00:28.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.963+0000 7fa554e58740 1 -- 172.21.15.7:0/1496493254 wait complete. 2024-09-21T06:00:28.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.964+0000 7fa554e58740 20 client.17214 trim_cache size 0 max 16384 2024-09-21T06:00:28.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa554e58740 1 Processor -- start 2024-09-21T06:00:28.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa554e58740 1 -- start start 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa554e58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c72ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa554e58740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 0x559fc1c73010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa554e58740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c81f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa554e58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa5481afbd0 con 0x559fc18a51b0 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa554e58740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa5481ad4a0 con 0x559fc18ce070 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa554e58740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa5481ab310 con 0x559fc18ad390 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa547fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c72ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa547fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c72ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39662/0 (socket says 172.21.15.7:39662) 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa547fff640 1 -- 172.21.15.7:0/85266179 learned_addr learned my addr 172.21.15.7:0/85266179 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa547fff640 1 -- 172.21.15.7:0/85266179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 msgr2=0x559fc1c73010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa547fff640 1 --2- 172.21.15.7:0/85266179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 0x559fc1c73010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa54ce81640 1 --2- 172.21.15.7:0/85266179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c81f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa547fff640 1 -- 172.21.15.7:0/85266179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 msgr2=0x559fc1c81f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:28.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa547fff640 1 --2- 172.21.15.7:0/85266179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c81f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa547fff640 1 -- 172.21.15.7:0/85266179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fc1c76100 con 0x559fc18a51b0 2024-09-21T06:00:28.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.977+0000 7fa54ce81640 1 --2- 172.21.15.7:0/85266179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c81f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:28.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.978+0000 7fa547fff640 1 --2- 172.21.15.7:0/85266179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c72ad0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fa5380053b0 tx=0x7fa5380053e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d00f05cdd78796 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:28.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.978+0000 7fa52dffb640 1 -- 172.21.15.7:0/85266179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53803f040 con 0x559fc18a51b0 2024-09-21T06:00:28.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.978+0000 7fa52dffb640 1 -- 172.21.15.7:0/85266179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa538004240 con 0x559fc18a51b0 2024-09-21T06:00:28.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.978+0000 7fa52dffb640 1 -- 172.21.15.7:0/85266179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538035040 con 0x559fc18a51b0 2024-09-21T06:00:28.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.978+0000 7fa554e58740 1 -- 172.21.15.7:0/85266179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 msgr2=0x559fc1c72ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:28.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.978+0000 7fa554e58740 1 --2- 172.21.15.7:0/85266179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c72ad0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fa5380053b0 tx=0x7fa5380053e0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.978+0000 7fa554e58740 1 -- 172.21.15.7:0/85266179 shutdown_connections 2024-09-21T06:00:28.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.978+0000 7fa554e58740 1 --2- 172.21.15.7:0/85266179 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c81f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.979+0000 7fa554e58740 1 --2- 172.21.15.7:0/85266179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 0x559fc1c73010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.979+0000 7fa554e58740 1 --2- 172.21.15.7:0/85266179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c72ad0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.979+0000 7fa554e58740 1 -- 172.21.15.7:0/85266179 >> 172.21.15.7:0/85266179 conn(0x559fc18c2460 msgr2=0x559fc1c835c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:28.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.979+0000 7fa554e58740 1 -- 172.21.15.7:0/85266179 shutdown_connections 2024-09-21T06:00:28.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.979+0000 7fa554e58740 1 -- 172.21.15.7:0/85266179 wait complete. 2024-09-21T06:00:28.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.979+0000 7fa554e58740 1 -- start start 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.979+0000 7fa554e58740 1 Processor -- start 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa554e58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c8d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa554e58740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 0x559fc1c88e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa554e58740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c894c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa554e58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa5481ab960 con 0x559fc18a51b0 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa554e58740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa5481acdd0 con 0x559fc18ce070 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa554e58740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa5481ac030 con 0x559fc18ad390 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa554e58740 10 client.0 _ll_register_callbacks cb 0x7fa540009960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa547fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c8d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa547fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c8d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39674/0 (socket says 172.21.15.7:39674) 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa547fff640 1 -- 172.21.15.7:0/3935833272 learned_addr learned my addr 172.21.15.7:0/3935833272 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa54ce81640 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c894c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa5477fe640 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 0x559fc1c88e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa547fff640 1 -- 172.21.15.7:0/3935833272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 msgr2=0x559fc1c88e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa547fff640 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 0x559fc1c88e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa547fff640 1 -- 172.21.15.7:0/3935833272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 msgr2=0x559fc1c894c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa547fff640 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c894c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa547fff640 1 -- 172.21.15.7:0/3935833272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fc1c89c30 con 0x559fc18a51b0 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa54ce81640 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c894c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa547fff640 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c8d970 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa53802a910 tx=0x7fa538005340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4acb77b9bd402b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa5277fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.980+0000 7fa5277fe640 1 -- 172.21.15.7:0/3935833272 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538059070 con 0x559fc18a51b0 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa5277fe640 1 -- 172.21.15.7:0/3935833272 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fa5380316a0 con 0x559fc18a51b0 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa554e58740 1 -- 172.21.15.7:0/3935833272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa538004240 con 0x559fc18a51b0 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa5277fe640 1 -- 172.21.15.7:0/3935833272 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa53803f070 con 0x559fc18a51b0 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa554e58740 10 client.17220 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa554e58740 1 -- 172.21.15.7:0/3935833272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559fc1d01930 con 0x559fc18a51b0 2024-09-21T06:00:28.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa5277fe640 1 -- 172.21.15.7:0/3935833272 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa538004240 con 0x559fc18a51b0 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa5277fe640 1 -- 172.21.15.7:0/3935833272 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa5380046c0 con 0x559fc18a51b0 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa554e58740 10 client.17220 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa554e58740 10 client.17220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa554e58740 20 client.17220 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa554e58740 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559fc1861da0 0x559fc1d03bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa554e58740 4 client.17220 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa554e58740 1 -- 172.21.15.7:0/3935833272 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559fc1be98a0 con 0x559fc1861da0 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.981+0000 7fa5477fe640 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559fc1861da0 0x559fc1d03bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa5477fe640 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559fc1861da0 0x559fc1d03bb0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27226261e84941c5 server_cookie=b67b189c3d2ffb1c in_seq=0 out_seq=0 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa5277fe640 10 client.17220 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa5277fe640 1 -- 172.21.15.7:0/3935833272 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559fc1be98a0 con 0x559fc1861da0 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa5277fe640 10 client.17220 handle_command_reply: tid=0 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa554e58740 1 client.17220 shutdown 2024-09-21T06:00:28.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa554e58740 1 -- 172.21.15.7:0/3935833272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 msgr2=0x559fc1c8d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:28.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa554e58740 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c8d970 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa53802a910 tx=0x7fa538005340 comp rx=0 tx=0).stop 2024-09-21T06:00:28.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa554e58740 1 -- 172.21.15.7:0/3935833272 shutdown_connections 2024-09-21T06:00:28.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa554e58740 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559fc1861da0 0x559fc1d03bb0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa5277fe640 0 client.17220 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:28.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa554e58740 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559fc18ce070 0x559fc1c894c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa554e58740 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559fc18ad390 0x559fc1c88e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa554e58740 1 --2- 172.21.15.7:0/3935833272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fc18a51b0 0x559fc1c8d970 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa554e58740 1 -- 172.21.15.7:0/3935833272 >> 172.21.15.7:0/3935833272 conn(0x559fc18c2460 msgr2=0x559fc1c831c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:28.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.982+0000 7fa554e58740 1 -- 172.21.15.7:0/3935833272 shutdown_connections 2024-09-21T06:00:28.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa554e58740 1 -- 172.21.15.7:0/3935833272 wait complete. 2024-09-21T06:00:28.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa554e58740 20 client.17220 trim_cache size 0 max 16384 2024-09-21T06:00:28.991 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:28.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa54e8e4640 1 -- 172.21.15.7:0/714629475 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5300b66b0 msgr2=0x7fa5300b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:28.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa54e8e4640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5300b66b0 0x7fa5300b8bc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa540005fd0 tx=0x7fa540009700 comp rx=0 tx=0).stop 2024-09-21T06:00:28.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa54e8e4640 1 -- 172.21.15.7:0/714629475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5481094a0 msgr2=0x7fa54819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:28.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa54e8e4640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5481094a0 0x7fa54819aa20 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c8c0 tx=0x7fa53c00cd80 comp rx=0 tx=0).stop 2024-09-21T06:00:28.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa54e8e4640 1 -- 172.21.15.7:0/714629475 shutdown_connections 2024-09-21T06:00:28.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa54e8e4640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5300b66b0 0x7fa5300b8bc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa54e8e4640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5481094a0 0x7fa54819aa20 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa54e8e4640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa548109df0 0x7fa54819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa54e8e4640 1 --2- 172.21.15.7:0/714629475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa548103b60 0x7fa54819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:28.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa54e8e4640 1 -- 172.21.15.7:0/714629475 >> 172.21.15.7:0/714629475 conn(0x7fa54807b850 msgr2=0x7fa548107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:28.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa54e8e4640 1 -- 172.21.15.7:0/714629475 shutdown_connections 2024-09-21T06:00:28.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:28.983+0000 7fa54e8e4640 1 -- 172.21.15.7:0/714629475 wait complete. 2024-09-21T06:00:30.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:30 smithi007 ceph-mon[30983]: pgmap v518: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-09-21T06:00:30.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:30 smithi119 ceph-mon[34833]: pgmap v518: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-09-21T06:00:30.659 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:00:30.659 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:00:30.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:30 smithi027 ceph-mon[34364]: pgmap v518: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-09-21T06:00:30.930 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:31.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.337+0000 7f30ef57b640 1 -- 172.21.15.7:0/4191864082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30e810de60 msgr2=0x7f30e8110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:31.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.337+0000 7f30ef57b640 1 --2- 172.21.15.7:0/4191864082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30e810de60 0x7f30e8110330 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f30e0009ca0 tx=0x7f30e002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.337+0000 7f30ef57b640 1 -- 172.21.15.7:0/4191864082 shutdown_connections 2024-09-21T06:00:31.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.337+0000 7f30ef57b640 1 --2- 172.21.15.7:0/4191864082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30e810de60 0x7f30e8110330 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.337+0000 7f30ef57b640 1 --2- 172.21.15.7:0/4191864082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30e8105380 0x7f30e810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.337+0000 7f30ef57b640 1 --2- 172.21.15.7:0/4191864082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30e8104a30 0x7f30e8104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.337+0000 7f30ef57b640 1 -- 172.21.15.7:0/4191864082 >> 172.21.15.7:0/4191864082 conn(0x7f30e8079760 msgr2=0x7f30e8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:31.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.337+0000 7f30ef57b640 1 -- 172.21.15.7:0/4191864082 shutdown_connections 2024-09-21T06:00:31.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.337+0000 7f30ef57b640 1 -- 172.21.15.7:0/4191864082 wait complete. 2024-09-21T06:00:31.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.338+0000 7f30ef57b640 1 Processor -- start 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.338+0000 7f30ef57b640 1 -- start start 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.338+0000 7f30ef57b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30e8104a30 0x7f30e819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.338+0000 7f30ef57b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30e8105380 0x7f30e819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.338+0000 7f30ef57b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30e810de60 0x7f30e819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.338+0000 7f30ef57b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8113aa0 con 0x7f30e8105380 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.338+0000 7f30ef57b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8113920 con 0x7f30e810de60 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.338+0000 7f30ef57b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8113c20 con 0x7f30e8104a30 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.338+0000 7f30ecb16640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30e8105380 0x7f30e819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.338+0000 7f30ecb16640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30e8105380 0x7f30e819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39690/0 (socket says 172.21.15.7:39690) 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.338+0000 7f30ecb16640 1 -- 172.21.15.7:0/403108526 learned_addr learned my addr 172.21.15.7:0/403108526 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.338+0000 7f30edb18640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30e810de60 0x7f30e819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.338+0000 7f30ed317640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30e8104a30 0x7f30e819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.339+0000 7f30ecb16640 1 -- 172.21.15.7:0/403108526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30e8104a30 msgr2=0x7f30e819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:31.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.339+0000 7f30ecb16640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30e8104a30 0x7f30e819a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.339+0000 7f30ecb16640 1 -- 172.21.15.7:0/403108526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30e810de60 msgr2=0x7f30e819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.339+0000 7f30ecb16640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30e810de60 0x7f30e819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.339+0000 7f30ecb16640 1 -- 172.21.15.7:0/403108526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e81a03c0 con 0x7f30e8105380 2024-09-21T06:00:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.339+0000 7f30ecb16640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30e8105380 0x7f30e819a9f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f30d800c970 tx=0x7f30d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.339+0000 7f30de7fc640 1 -- 172.21.15.7:0/403108526 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d8007bb0 con 0x7f30e8105380 2024-09-21T06:00:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.339+0000 7f30ef57b640 1 -- 172.21.15.7:0/403108526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e81a06b0 con 0x7f30e8105380 2024-09-21T06:00:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.339+0000 7f30de7fc640 1 -- 172.21.15.7:0/403108526 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30d8007d50 con 0x7f30e8105380 2024-09-21T06:00:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.339+0000 7f30de7fc640 1 -- 172.21.15.7:0/403108526 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d8004e10 con 0x7f30e8105380 2024-09-21T06:00:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.339+0000 7f30ef57b640 1 -- 172.21.15.7:0/403108526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e81a6e10 con 0x7f30e8105380 2024-09-21T06:00:31.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.342+0000 7f30f5aef740 1 Processor -- start 2024-09-21T06:00:31.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.342+0000 7f30de7fc640 1 -- 172.21.15.7:0/403108526 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f30d8004fb0 con 0x7f30e8105380 2024-09-21T06:00:31.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.342+0000 7f30f5aef740 1 -- start start 2024-09-21T06:00:31.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.342+0000 7f30f5aef740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 0x565068c4c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.342+0000 7f30f5aef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c4c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.342+0000 7f30f5aef740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c4ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.342+0000 7f30f5aef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x565068bc2e60 con 0x56506887c490 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.342+0000 7f30f5aef740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x565068bb2290 con 0x565068884670 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.342+0000 7f30f5aef740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x565068bb60a0 con 0x5650688a5350 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.342+0000 7f30ed317640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c4c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30ed317640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c4c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39696/0 (socket says 172.21.15.7:39696) 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30ed317640 1 -- 172.21.15.7:0/3566560459 learned_addr learned my addr 172.21.15.7:0/3566560459 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30ecb16640 1 --2- 172.21.15.7:0/3566560459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c4ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30edb18640 1 --2- 172.21.15.7:0/3566560459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 0x565068c4c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30ed317640 1 -- 172.21.15.7:0/3566560459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 msgr2=0x565068c4c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30ed317640 1 --2- 172.21.15.7:0/3566560459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 0x565068c4c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30ed317640 1 -- 172.21.15.7:0/3566560459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 msgr2=0x565068c4ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30ed317640 1 --2- 172.21.15.7:0/3566560459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c4ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30ed317640 1 -- 172.21.15.7:0/3566560459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565068910930 con 0x56506887c490 2024-09-21T06:00:31.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30ecb16640 1 --2- 172.21.15.7:0/3566560459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c4ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:31.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30ed317640 1 --2- 172.21.15.7:0/3566560459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c4c970 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f30e400bcb0 tx=0x7f30e40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e301fdffa6e5d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:31.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30de7fc640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f30d40b6680 0x7f30d40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30edb18640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f30d40b6680 0x7f30d40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30d37fe640 1 -- 172.21.15.7:0/3566560459 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4004020 con 0x56506887c490 2024-09-21T06:00:31.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.343+0000 7f30de7fc640 1 -- 172.21.15.7:0/403108526 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f30d80e7390 con 0x7f30e8105380 2024-09-21T06:00:31.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.344+0000 7f30d37fe640 1 -- 172.21.15.7:0/3566560459 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30e40054d0 con 0x56506887c490 2024-09-21T06:00:31.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.344+0000 7f30d37fe640 1 -- 172.21.15.7:0/3566560459 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4004ce0 con 0x56506887c490 2024-09-21T06:00:31.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.344+0000 7f30f5aef740 1 -- 172.21.15.7:0/3566560459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 msgr2=0x565068c4c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:31.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.344+0000 7f30f5aef740 1 --2- 172.21.15.7:0/3566560459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c4c970 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f30e400bcb0 tx=0x7f30e40107a0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.344+0000 7f30edb18640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f30d40b6680 0x7f30d40b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f30e0006010 tx=0x7f30e002f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:31.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.344+0000 7f30f5aef740 1 -- 172.21.15.7:0/3566560459 shutdown_connections 2024-09-21T06:00:31.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.344+0000 7f30f5aef740 1 --2- 172.21.15.7:0/3566560459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c4c970 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.344+0000 7f30f5aef740 1 --2- 172.21.15.7:0/3566560459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c4ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.344+0000 7f30f5aef740 1 --2- 172.21.15.7:0/3566560459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 0x565068c4c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.344+0000 7f30f5aef740 1 -- 172.21.15.7:0/3566560459 >> 172.21.15.7:0/3566560459 conn(0x565068899740 msgr2=0x565068c4a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:31.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.345+0000 7f30f5aef740 1 -- 172.21.15.7:0/3566560459 shutdown_connections 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.345+0000 7f30f5aef740 1 -- 172.21.15.7:0/3566560459 wait complete. 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.345+0000 7f30f5aef740 1 -- start start 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.345+0000 7f30f5aef740 1 Processor -- start 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.345+0000 7f30f5aef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c57ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30f5aef740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c58530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30f5aef740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 0x565068c63f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30f5aef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x565068a13890 con 0x56506887c490 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30f5aef740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x565068b4cd40 con 0x565068884670 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30f5aef740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x565068c5ac10 con 0x5650688a5350 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30ed317640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c57ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30ed317640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c57ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39704/0 (socket says 172.21.15.7:39704) 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30ed317640 1 -- 172.21.15.7:0/1039263177 learned_addr learned my addr 172.21.15.7:0/1039263177 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30f5aef740 10 client.0 _ll_register_callbacks cb 0x565068bb0c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30ecb16640 1 --2- 172.21.15.7:0/1039263177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c58530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30edb18640 1 --2- 172.21.15.7:0/1039263177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 0x565068c63f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30ed317640 1 -- 172.21.15.7:0/1039263177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 msgr2=0x565068c63f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30ed317640 1 --2- 172.21.15.7:0/1039263177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 0x565068c63f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30ed317640 1 -- 172.21.15.7:0/1039263177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 msgr2=0x565068c58530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30ed317640 1 --2- 172.21.15.7:0/1039263177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c58530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30ed317640 1 -- 172.21.15.7:0/1039263177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565068c644f0 con 0x56506887c490 2024-09-21T06:00:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30ed317640 1 --2- 172.21.15.7:0/1039263177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c57ff0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f30e4000c00 tx=0x7f30e400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bce3885908a0bdb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.346+0000 7f30d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30d0ff9640 1 -- 172.21.15.7:0/1039263177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e402f060 con 0x56506887c490 2024-09-21T06:00:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30d0ff9640 1 -- 172.21.15.7:0/1039263177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f30e401fa50 con 0x56506887c490 2024-09-21T06:00:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30f5aef740 1 -- 172.21.15.7:0/1039263177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30e40054d0 con 0x56506887c490 2024-09-21T06:00:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30d0ff9640 1 -- 172.21.15.7:0/1039263177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f30e4004640 con 0x56506887c490 2024-09-21T06:00:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30f5aef740 10 client.17232 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30f5aef740 1 -- 172.21.15.7:0/1039263177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565068c66e20 con 0x56506887c490 2024-09-21T06:00:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30d0ff9640 1 -- 172.21.15.7:0/1039263177 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30e40054d0 con 0x56506887c490 2024-09-21T06:00:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30d0ff9640 1 -- 172.21.15.7:0/1039263177 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f30e4005090 con 0x56506887c490 2024-09-21T06:00:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30f5aef740 10 client.17232 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30f5aef740 10 client.17232 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30f5aef740 20 client.17232 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:31.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30f5aef740 1 --2- 172.21.15.7:0/1039263177 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x565068863cd0 0x565068c6a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30f5aef740 4 client.17232 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:31.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.347+0000 7f30f5aef740 1 -- 172.21.15.7:0/1039263177 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565068bc4db0 con 0x565068863cd0 2024-09-21T06:00:31.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.348+0000 7f30ecb16640 1 --2- 172.21.15.7:0/1039263177 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x565068863cd0 0x565068c6a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.348+0000 7f30ecb16640 1 --2- 172.21.15.7:0/1039263177 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x565068863cd0 0x565068c6a230 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de3c88f637992f34 server_cookie=b78162e841065a21 in_seq=0 out_seq=0 2024-09-21T06:00:31.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.348+0000 7f30d0ff9640 10 client.17232 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:31.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30d0ff9640 1 -- 172.21.15.7:0/1039263177 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565068bc4db0 con 0x565068863cd0 2024-09-21T06:00:31.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30d0ff9640 10 client.17232 handle_command_reply: tid=0 2024-09-21T06:00:31.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30f5aef740 1 client.17232 shutdown 2024-09-21T06:00:31.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30f5aef740 1 -- 172.21.15.7:0/1039263177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 msgr2=0x565068c57ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30f5aef740 1 --2- 172.21.15.7:0/1039263177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c57ff0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f30e4000c00 tx=0x7f30e400bfd0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30f5aef740 1 -- 172.21.15.7:0/1039263177 shutdown_connections 2024-09-21T06:00:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30f5aef740 1 --2- 172.21.15.7:0/1039263177 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x565068863cd0 0x565068c6a230 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30f5aef740 1 --2- 172.21.15.7:0/1039263177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 0x565068c63f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30f5aef740 1 --2- 172.21.15.7:0/1039263177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c58530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30d0ff9640 0 client.17232 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30f5aef740 1 --2- 172.21.15.7:0/1039263177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c57ff0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30f5aef740 1 -- 172.21.15.7:0/1039263177 >> 172.21.15.7:0/1039263177 conn(0x565068899740 msgr2=0x565068c4f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30f5aef740 1 -- 172.21.15.7:0/1039263177 shutdown_connections 2024-09-21T06:00:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30f5aef740 1 -- 172.21.15.7:0/1039263177 wait complete. 2024-09-21T06:00:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.349+0000 7f30f5aef740 20 client.17232 trim_cache size 0 max 16384 2024-09-21T06:00:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.367+0000 7f30f5aef740 1 Processor -- start 2024-09-21T06:00:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.367+0000 7f30f5aef740 1 -- start start 2024-09-21T06:00:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.367+0000 7f30f5aef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c63ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.367+0000 7f30f5aef740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c52550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.367+0000 7f30f5aef740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 0x565068c54fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.367+0000 7f30f5aef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81afd10 con 0x56506887c490 2024-09-21T06:00:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.367+0000 7f30f5aef740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81ad5e0 con 0x565068884670 2024-09-21T06:00:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.367+0000 7f30f5aef740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81ab450 con 0x5650688a5350 2024-09-21T06:00:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.367+0000 7f30ed317640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c63ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.367+0000 7f30ed317640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c63ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39708/0 (socket says 172.21.15.7:39708) 2024-09-21T06:00:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.367+0000 7f30ed317640 1 -- 172.21.15.7:0/3083148461 learned_addr learned my addr 172.21.15.7:0/3083148461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.367+0000 7f30ecb16640 1 --2- 172.21.15.7:0/3083148461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c52550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.367+0000 7f30edb18640 1 --2- 172.21.15.7:0/3083148461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 0x565068c54fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.368+0000 7f30ed317640 1 -- 172.21.15.7:0/3083148461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 msgr2=0x565068c54fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.368+0000 7f30ed317640 1 --2- 172.21.15.7:0/3083148461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 0x565068c54fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.368+0000 7f30ed317640 1 -- 172.21.15.7:0/3083148461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 msgr2=0x565068c52550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.368+0000 7f30ed317640 1 --2- 172.21.15.7:0/3083148461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c52550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.368+0000 7f30ed317640 1 -- 172.21.15.7:0/3083148461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565068c590b0 con 0x56506887c490 2024-09-21T06:00:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.368+0000 7f30ecb16640 1 --2- 172.21.15.7:0/3083148461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c52550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.368+0000 7f30ed317640 1 --2- 172.21.15.7:0/3083148461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c63ed0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f30e4011010 tx=0x7f30e40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8693ce9089b5be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.368+0000 7f30d2ffd640 1 -- 172.21.15.7:0/3083148461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e402f050 con 0x56506887c490 2024-09-21T06:00:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.368+0000 7f30d2ffd640 1 -- 172.21.15.7:0/3083148461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30e40347a0 con 0x56506887c490 2024-09-21T06:00:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.368+0000 7f30d2ffd640 1 -- 172.21.15.7:0/3083148461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4011440 con 0x56506887c490 2024-09-21T06:00:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.369+0000 7f30f5aef740 1 -- 172.21.15.7:0/3083148461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 msgr2=0x565068c63ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.369+0000 7f30f5aef740 1 --2- 172.21.15.7:0/3083148461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c63ed0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f30e4011010 tx=0x7f30e40107a0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.369+0000 7f30f5aef740 1 -- 172.21.15.7:0/3083148461 shutdown_connections 2024-09-21T06:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.369+0000 7f30f5aef740 1 --2- 172.21.15.7:0/3083148461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5650688a5350 0x565068c54fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.369+0000 7f30f5aef740 1 --2- 172.21.15.7:0/3083148461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x565068884670 0x565068c52550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.369+0000 7f30f5aef740 1 --2- 172.21.15.7:0/3083148461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56506887c490 0x565068c63ed0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.369+0000 7f30f5aef740 1 -- 172.21.15.7:0/3083148461 >> 172.21.15.7:0/3083148461 conn(0x565068899740 msgr2=0x565068c56670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.369+0000 7f30f5aef740 1 -- 172.21.15.7:0/3083148461 shutdown_connections 2024-09-21T06:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.369+0000 7f30f5aef740 1 -- 172.21.15.7:0/3083148461 wait complete. 2024-09-21T06:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.369+0000 7f30f5aef740 1 -- start start 2024-09-21T06:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.369+0000 7f30f5aef740 1 Processor -- start 2024-09-21T06:00:31.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30f5aef740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506887c490 0x565068c6b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30f5aef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565068884670 0x565068c6b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30f5aef740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5650688a5350 0x565068c6bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30f5aef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81abaa0 con 0x565068884670 2024-09-21T06:00:31.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30f5aef740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81acf10 con 0x5650688a5350 2024-09-21T06:00:31.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30f5aef740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81ac170 con 0x56506887c490 2024-09-21T06:00:31.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30f5aef740 10 client.0 _ll_register_callbacks cb 0x7f30d80eadb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:31.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30ecb16640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565068884670 0x565068c6b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30ecb16640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565068884670 0x565068c6b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39722/0 (socket says 172.21.15.7:39722) 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30ecb16640 1 -- 172.21.15.7:0/4208613940 learned_addr learned my addr 172.21.15.7:0/4208613940 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30edb18640 1 --2- 172.21.15.7:0/4208613940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5650688a5350 0x565068c6bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30ed317640 1 --2- 172.21.15.7:0/4208613940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506887c490 0x565068c6b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30ecb16640 1 -- 172.21.15.7:0/4208613940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506887c490 msgr2=0x565068c6b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30ecb16640 1 --2- 172.21.15.7:0/4208613940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506887c490 0x565068c6b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30ecb16640 1 -- 172.21.15.7:0/4208613940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5650688a5350 msgr2=0x565068c6bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30ecb16640 1 --2- 172.21.15.7:0/4208613940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5650688a5350 0x565068c6bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.370+0000 7f30ecb16640 1 -- 172.21.15.7:0/4208613940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565068cd3a30 con 0x565068884670 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30ecb16640 1 --2- 172.21.15.7:0/4208613940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565068884670 0x565068c6b820 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f30d80047e0 tx=0x7f30d80e98a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947f541f94dcd378 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30d0ff9640 1 -- 172.21.15.7:0/4208613940 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d801d040 con 0x565068884670 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30d0ff9640 1 -- 172.21.15.7:0/4208613940 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f30d80052a0 con 0x565068884670 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30f5aef740 1 -- 172.21.15.7:0/4208613940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30e40347a0 con 0x565068884670 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30d0ff9640 1 -- 172.21.15.7:0/4208613940 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f30d80a9180 con 0x565068884670 2024-09-21T06:00:31.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30f5aef740 10 client.17238 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30f5aef740 1 -- 172.21.15.7:0/4208613940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565068cd4cf0 con 0x565068884670 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30d0ff9640 1 -- 172.21.15.7:0/4208613940 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30e40347a0 con 0x565068884670 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30d0ff9640 1 -- 172.21.15.7:0/4208613940 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f30d80a8c30 con 0x565068884670 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30f5aef740 10 client.17238 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30f5aef740 10 client.17238 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30f5aef740 20 client.17238 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30f5aef740 1 --2- 172.21.15.7:0/4208613940 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x565068839080 0x565068cd7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30f5aef740 4 client.17238 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.371+0000 7f30f5aef740 1 -- 172.21.15.7:0/4208613940 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x565068bc0860 con 0x565068839080 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.372+0000 7f30ed317640 1 --2- 172.21.15.7:0/4208613940 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x565068839080 0x565068cd7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.372+0000 7f30ed317640 1 --2- 172.21.15.7:0/4208613940 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x565068839080 0x565068cd7460 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf55255080b85fee server_cookie=acdb9d6dd90d8a4c in_seq=0 out_seq=0 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.372+0000 7f30d0ff9640 10 client.17238 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30d0ff9640 1 -- 172.21.15.7:0/4208613940 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x565068bc0860 con 0x565068839080 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30d0ff9640 10 client.17238 handle_command_reply: tid=0 2024-09-21T06:00:31.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30f5aef740 1 client.17238 shutdown 2024-09-21T06:00:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30f5aef740 1 -- 172.21.15.7:0/4208613940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565068884670 msgr2=0x565068c6b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30f5aef740 1 --2- 172.21.15.7:0/4208613940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565068884670 0x565068c6b820 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f30d80047e0 tx=0x7f30d80e98a0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30f5aef740 1 -- 172.21.15.7:0/4208613940 shutdown_connections 2024-09-21T06:00:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30f5aef740 1 --2- 172.21.15.7:0/4208613940 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x565068839080 0x565068cd7460 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30f5aef740 1 --2- 172.21.15.7:0/4208613940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565068884670 0x565068c6b820 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30f5aef740 1 --2- 172.21.15.7:0/4208613940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5650688a5350 0x565068c6bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30d0ff9640 0 client.17238 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30f5aef740 1 --2- 172.21.15.7:0/4208613940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56506887c490 0x565068c6b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30f5aef740 1 -- 172.21.15.7:0/4208613940 >> 172.21.15.7:0/4208613940 conn(0x565068899740 msgr2=0x565068c56270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30f5aef740 1 -- 172.21.15.7:0/4208613940 shutdown_connections 2024-09-21T06:00:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.374+0000 7f30f5aef740 1 -- 172.21.15.7:0/4208613940 wait complete. 2024-09-21T06:00:31.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.375+0000 7f30f5aef740 20 client.17238 trim_cache size 0 max 16384 2024-09-21T06:00:31.382 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:00:31.382 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:00:31.382 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "b9604e01-6d58-4b44-8781-0b517ac24064", 2024-09-21T06:00:31.382 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:00:31.382 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:00:31.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.375+0000 7f30ef57b640 1 -- 172.21.15.7:0/403108526 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f30d40b6680 msgr2=0x7f30d40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:31.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.375+0000 7f30ef57b640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f30d40b6680 0x7f30d40b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f30e0006010 tx=0x7f30e002f310 comp rx=0 tx=0).stop 2024-09-21T06:00:31.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.375+0000 7f30ef57b640 1 -- 172.21.15.7:0/403108526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30e8105380 msgr2=0x7f30e819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:31.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.375+0000 7f30ef57b640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30e8105380 0x7f30e819a9f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f30d800c970 tx=0x7f30d800ce30 comp rx=0 tx=0).stop 2024-09-21T06:00:31.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.375+0000 7f30ef57b640 1 -- 172.21.15.7:0/403108526 shutdown_connections 2024-09-21T06:00:31.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.375+0000 7f30ef57b640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f30d40b6680 0x7f30d40b8b90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.375+0000 7f30ef57b640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30e8105380 0x7f30e819a9f0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.375+0000 7f30ef57b640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30e810de60 0x7f30e819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.375+0000 7f30ef57b640 1 --2- 172.21.15.7:0/403108526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30e8104a30 0x7f30e819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:31.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.375+0000 7f30ef57b640 1 -- 172.21.15.7:0/403108526 >> 172.21.15.7:0/403108526 conn(0x7f30e8079760 msgr2=0x7f30e81007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:31.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.375+0000 7f30ef57b640 1 -- 172.21.15.7:0/403108526 shutdown_connections 2024-09-21T06:00:31.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:31.375+0000 7f30ef57b640 1 -- 172.21.15.7:0/403108526 wait complete. 2024-09-21T06:00:32.075 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:00:32.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:32 smithi007 ceph-mon[30983]: pgmap v519: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:00:32.334 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:32.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:32 smithi119 ceph-mon[34833]: pgmap v519: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:00:32.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:32 smithi027 ceph-mon[34364]: pgmap v519: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:00:32.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.751+0000 7fd98e100640 1 -- 172.21.15.7:0/4168552201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9881094f0 msgr2=0x7fd988109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:32.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.751+0000 7fd98e100640 1 --2- 172.21.15.7:0/4168552201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9881094f0 0x7fd988109900 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009900 tx=0x7fd97c02a410 comp rx=0 tx=0).stop 2024-09-21T06:00:32.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.751+0000 7fd98e100640 1 -- 172.21.15.7:0/4168552201 shutdown_connections 2024-09-21T06:00:32.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.751+0000 7fd98e100640 1 --2- 172.21.15.7:0/4168552201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9881094f0 0x7fd988109900 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.751+0000 7fd98e100640 1 --2- 172.21.15.7:0/4168552201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd988109e40 0x7fd988110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.751+0000 7fd98e100640 1 --2- 172.21.15.7:0/4168552201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9881020a0 0x7fd9881024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.751+0000 7fd98e100640 1 -- 172.21.15.7:0/4168552201 >> 172.21.15.7:0/4168552201 conn(0x7fd988079e40 msgr2=0x7fd98807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:32.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.751+0000 7fd98e100640 1 -- 172.21.15.7:0/4168552201 shutdown_connections 2024-09-21T06:00:32.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.751+0000 7fd98e100640 1 -- 172.21.15.7:0/4168552201 wait complete. 2024-09-21T06:00:32.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.752+0000 7fd98e100640 1 Processor -- start 2024-09-21T06:00:32.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.752+0000 7fd98e100640 1 -- start start 2024-09-21T06:00:32.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.752+0000 7fd98e100640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9881020a0 0x7fd98819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.752+0000 7fd98e100640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9881094f0 0x7fd98819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.752+0000 7fd98e100640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd988109e40 0x7fd98819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.752+0000 7fd98e100640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd988113b20 con 0x7fd9881020a0 2024-09-21T06:00:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.752+0000 7fd98e100640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd9881139a0 con 0x7fd9881094f0 2024-09-21T06:00:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd98e100640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd988113ca0 con 0x7fd988109e40 2024-09-21T06:00:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd9877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9881020a0 0x7fd98819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd9877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9881020a0 0x7fd98819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39732/0 (socket says 172.21.15.7:39732) 2024-09-21T06:00:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd9877fe640 1 -- 172.21.15.7:0/3413081837 learned_addr learned my addr 172.21.15.7:0/3413081837 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd987fff640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd988109e40 0x7fd98819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd986ffd640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9881094f0 0x7fd98819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd9877fe640 1 -- 172.21.15.7:0/3413081837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd988109e40 msgr2=0x7fd98819fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd9877fe640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd988109e40 0x7fd98819fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd9877fe640 1 -- 172.21.15.7:0/3413081837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9881094f0 msgr2=0x7fd98819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd9877fe640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9881094f0 0x7fd98819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd9877fe640 1 -- 172.21.15.7:0/3413081837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9881a0440 con 0x7fd9881020a0 2024-09-21T06:00:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd987fff640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd988109e40 0x7fd98819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd9877fe640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9881020a0 0x7fd98819a590 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fd97800c920 tx=0x7fd97800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd984ff9640 1 -- 172.21.15.7:0/3413081837 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978007c70 con 0x7fd9881020a0 2024-09-21T06:00:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd98e100640 1 -- 172.21.15.7:0/3413081837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9881a0730 con 0x7fd9881020a0 2024-09-21T06:00:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd98e100640 1 -- 172.21.15.7:0/3413081837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9881a6f50 con 0x7fd9881020a0 2024-09-21T06:00:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd984ff9640 1 -- 172.21.15.7:0/3413081837 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd978007e10 con 0x7fd9881020a0 2024-09-21T06:00:32.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.753+0000 7fd984ff9640 1 -- 172.21.15.7:0/3413081837 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97800f450 con 0x7fd9881020a0 2024-09-21T06:00:32.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.756+0000 7fd984ff9640 1 -- 172.21.15.7:0/3413081837 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd9780046c0 con 0x7fd9881020a0 2024-09-21T06:00:32.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd994674740 1 Processor -- start 2024-09-21T06:00:32.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd994674740 1 -- start start 2024-09-21T06:00:32.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd994674740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 0x55bcfb8b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd994674740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd994674740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 0x55bcfb8b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd994674740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bcfb82ce50 con 0x55bcfb50f070 2024-09-21T06:00:32.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd994674740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55bcfb81c280 con 0x55bcfb4ee390 2024-09-21T06:00:32.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd994674740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55bcfb820090 con 0x55bcfb4e61b0 2024-09-21T06:00:32.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd984ff9640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd9700b66b0 0x7fd9700b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd987fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 0x55bcfb8b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd987fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 0x55bcfb8b6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39736/0 (socket says 172.21.15.7:39736) 2024-09-21T06:00:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd987fff640 1 -- 172.21.15.7:0/665800516 learned_addr learned my addr 172.21.15.7:0/665800516 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd987fff640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd9700b66b0 0x7fd9700b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.757+0000 7fd986ffd640 1 --2- 172.21.15.7:0/665800516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 0x55bcfb8b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.758+0000 7fd9877fe640 1 --2- 172.21.15.7:0/665800516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.758+0000 7fd984ff9640 1 -- 172.21.15.7:0/3413081837 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fd9780e76f0 con 0x7fd9881020a0 2024-09-21T06:00:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.758+0000 7fd987fff640 1 -- 172.21.15.7:0/665800516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb4e61b0 msgr2=0x55bcfb8b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.758+0000 7fd987fff640 1 --2- 172.21.15.7:0/665800516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8b67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.758+0000 7fd987fff640 1 -- 172.21.15.7:0/665800516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 msgr2=0x55bcfb8b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.758+0000 7fd987fff640 1 --2- 172.21.15.7:0/665800516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 0x55bcfb8b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.758+0000 7fd987fff640 1 -- 172.21.15.7:0/665800516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcfb57a650 con 0x55bcfb50f070 2024-09-21T06:00:32.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.758+0000 7fd987fff640 1 --2- 172.21.15.7:0/665800516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 0x55bcfb8b6270 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fd98000afa0 tx=0x7fd980016700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88568f0934394afe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.758+0000 7fd987fff640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd9700b66b0 0x7fd9700b8bc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd98000afd0 tx=0x7fd98001a000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.758+0000 7fd96dffb640 1 -- 172.21.15.7:0/665800516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980026070 con 0x55bcfb50f070 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.758+0000 7fd96dffb640 1 -- 172.21.15.7:0/665800516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd980009d00 con 0x55bcfb50f070 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.758+0000 7fd96dffb640 1 -- 172.21.15.7:0/665800516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980013040 con 0x55bcfb50f070 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.759+0000 7fd994674740 1 -- 172.21.15.7:0/665800516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 msgr2=0x55bcfb8b6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.759+0000 7fd994674740 1 --2- 172.21.15.7:0/665800516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 0x55bcfb8b6270 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fd98000afa0 tx=0x7fd980016700 comp rx=0 tx=0).stop 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.759+0000 7fd994674740 1 -- 172.21.15.7:0/665800516 shutdown_connections 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.759+0000 7fd994674740 1 --2- 172.21.15.7:0/665800516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 0x55bcfb8b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.759+0000 7fd994674740 1 --2- 172.21.15.7:0/665800516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.759+0000 7fd994674740 1 --2- 172.21.15.7:0/665800516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 0x55bcfb8b6270 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.759+0000 7fd994674740 1 -- 172.21.15.7:0/665800516 >> 172.21.15.7:0/665800516 conn(0x55bcfb503460 msgr2=0x55bcfb8b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.759+0000 7fd994674740 1 -- 172.21.15.7:0/665800516 shutdown_connections 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.759+0000 7fd994674740 1 -- 172.21.15.7:0/665800516 wait complete. 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.760+0000 7fd994674740 1 -- start start 2024-09-21T06:00:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.760+0000 7fd994674740 1 Processor -- start 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.760+0000 7fd994674740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.760+0000 7fd994674740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 0x55bcfb8c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.760+0000 7fd994674740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb50f070 0x55bcfb8cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.760+0000 7fd994674740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bcfb67d700 con 0x55bcfb4e61b0 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.760+0000 7fd994674740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55bcfb7b7110 con 0x55bcfb4ee390 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.760+0000 7fd994674740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55bcfb8c49f0 con 0x55bcfb50f070 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.760+0000 7fd994674740 10 client.0 _ll_register_callbacks cb 0x55bcfb7d0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.760+0000 7fd9877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.760+0000 7fd9877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8c19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39750/0 (socket says 172.21.15.7:39750) 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.760+0000 7fd9877fe640 1 -- 172.21.15.7:0/4029038912 learned_addr learned my addr 172.21.15.7:0/4029038912 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd987fff640 1 --2- 172.21.15.7:0/4029038912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb50f070 0x55bcfb8cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd986ffd640 1 --2- 172.21.15.7:0/4029038912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 0x55bcfb8c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd9877fe640 1 -- 172.21.15.7:0/4029038912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb50f070 msgr2=0x55bcfb8cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd9877fe640 1 --2- 172.21.15.7:0/4029038912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb50f070 0x55bcfb8cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd9877fe640 1 -- 172.21.15.7:0/4029038912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 msgr2=0x55bcfb8c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd9877fe640 1 --2- 172.21.15.7:0/4029038912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 0x55bcfb8c1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd9877fe640 1 -- 172.21.15.7:0/4029038912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcfb7e4c40 con 0x55bcfb4e61b0 2024-09-21T06:00:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd9877fe640 1 --2- 172.21.15.7:0/4029038912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8c19d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd9780a9b60 tx=0x7fd9780050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12188c15cac81493 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd966ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd966ffd640 1 -- 172.21.15.7:0/4029038912 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9780a1e60 con 0x55bcfb4e61b0 2024-09-21T06:00:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd966ffd640 1 -- 172.21.15.7:0/4029038912 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fd978005270 con 0x55bcfb4e61b0 2024-09-21T06:00:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd994674740 1 -- 172.21.15.7:0/4029038912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd980009d00 con 0x55bcfb4e61b0 2024-09-21T06:00:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd966ffd640 1 -- 172.21.15.7:0/4029038912 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd97805c020 con 0x55bcfb4e61b0 2024-09-21T06:00:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd994674740 10 client.17250 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.761+0000 7fd994674740 1 -- 172.21.15.7:0/4029038912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bcfb8d0780 con 0x55bcfb4e61b0 2024-09-21T06:00:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.762+0000 7fd966ffd640 1 -- 172.21.15.7:0/4029038912 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd980009d00 con 0x55bcfb4e61b0 2024-09-21T06:00:32.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.762+0000 7fd966ffd640 1 -- 172.21.15.7:0/4029038912 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd9780ac260 con 0x55bcfb4e61b0 2024-09-21T06:00:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.762+0000 7fd994674740 10 client.17250 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.762+0000 7fd994674740 10 client.17250 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.762+0000 7fd994674740 20 client.17250 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.762+0000 7fd994674740 1 --2- 172.21.15.7:0/4029038912 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bcfb4cd9f0 0x55bcfb8d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.762+0000 7fd994674740 4 client.17250 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.762+0000 7fd994674740 1 -- 172.21.15.7:0/4029038912 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcfb82eda0 con 0x55bcfb4cd9f0 2024-09-21T06:00:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.762+0000 7fd986ffd640 1 --2- 172.21.15.7:0/4029038912 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bcfb4cd9f0 0x55bcfb8d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.763+0000 7fd986ffd640 1 --2- 172.21.15.7:0/4029038912 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bcfb4cd9f0 0x55bcfb8d3ae0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b83f81a1c1b42903 server_cookie=630bcf1cac672194 in_seq=0 out_seq=0 2024-09-21T06:00:32.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.763+0000 7fd966ffd640 10 client.17250 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:32.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.763+0000 7fd966ffd640 1 -- 172.21.15.7:0/4029038912 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bcfb82eda0 con 0x55bcfb4cd9f0 2024-09-21T06:00:32.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.763+0000 7fd966ffd640 10 client.17250 handle_command_reply: tid=0 2024-09-21T06:00:32.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.764+0000 7fd994674740 1 client.17250 shutdown 2024-09-21T06:00:32.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.764+0000 7fd994674740 1 -- 172.21.15.7:0/4029038912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 msgr2=0x55bcfb8c19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:32.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.764+0000 7fd994674740 1 --2- 172.21.15.7:0/4029038912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8c19d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd9780a9b60 tx=0x7fd9780050b0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.764+0000 7fd994674740 1 -- 172.21.15.7:0/4029038912 shutdown_connections 2024-09-21T06:00:32.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.764+0000 7fd994674740 1 --2- 172.21.15.7:0/4029038912 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bcfb4cd9f0 0x55bcfb8d3ae0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.764+0000 7fd994674740 1 --2- 172.21.15.7:0/4029038912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb50f070 0x55bcfb8cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.764+0000 7fd994674740 1 --2- 172.21.15.7:0/4029038912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 0x55bcfb8c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.764+0000 7fd994674740 1 --2- 172.21.15.7:0/4029038912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8c19d0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.764+0000 7fd994674740 1 -- 172.21.15.7:0/4029038912 >> 172.21.15.7:0/4029038912 conn(0x55bcfb503460 msgr2=0x55bcfb8b9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:32.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.764+0000 7fd966ffd640 0 client.17250 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:32.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.764+0000 7fd994674740 1 -- 172.21.15.7:0/4029038912 shutdown_connections 2024-09-21T06:00:32.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.764+0000 7fd994674740 1 -- 172.21.15.7:0/4029038912 wait complete. 2024-09-21T06:00:32.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.764+0000 7fd994674740 20 client.17250 trim_cache size 0 max 16384 2024-09-21T06:00:32.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.781+0000 7fd994674740 1 Processor -- start 2024-09-21T06:00:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.781+0000 7fd994674740 1 -- start start 2024-09-21T06:00:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd994674740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd994674740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 0x55bcfb8cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd994674740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb50f070 0x55bcfb8b9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd994674740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd974010ea0 con 0x55bcfb4e61b0 2024-09-21T06:00:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd994674740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd97400e770 con 0x55bcfb4ee390 2024-09-21T06:00:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd994674740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd97400c5e0 con 0x55bcfb50f070 2024-09-21T06:00:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd9877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd9877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39756/0 (socket says 172.21.15.7:39756) 2024-09-21T06:00:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd9877fe640 1 -- 172.21.15.7:0/4136971739 learned_addr learned my addr 172.21.15.7:0/4136971739 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd986ffd640 1 --2- 172.21.15.7:0/4136971739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 0x55bcfb8cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd987fff640 1 --2- 172.21.15.7:0/4136971739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb50f070 0x55bcfb8b9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd9877fe640 1 -- 172.21.15.7:0/4136971739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb50f070 msgr2=0x55bcfb8b9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd9877fe640 1 --2- 172.21.15.7:0/4136971739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb50f070 0x55bcfb8b9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd9877fe640 1 -- 172.21.15.7:0/4136971739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 msgr2=0x55bcfb8cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd9877fe640 1 --2- 172.21.15.7:0/4136971739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 0x55bcfb8cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd9877fe640 1 -- 172.21.15.7:0/4136971739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcfb8c4580 con 0x55bcfb4e61b0 2024-09-21T06:00:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.782+0000 7fd9877fe640 1 --2- 172.21.15.7:0/4136971739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8b4190 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fd97800cfd0 tx=0x7fd9780a9560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf5f14b19927638 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.783+0000 7fd96d7fa640 1 -- 172.21.15.7:0/4136971739 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9780acd00 con 0x55bcfb4e61b0 2024-09-21T06:00:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.783+0000 7fd96d7fa640 1 -- 172.21.15.7:0/4136971739 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9780adc90 con 0x55bcfb4e61b0 2024-09-21T06:00:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.783+0000 7fd96d7fa640 1 -- 172.21.15.7:0/4136971739 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9780b7000 con 0x55bcfb4e61b0 2024-09-21T06:00:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.783+0000 7fd994674740 1 -- 172.21.15.7:0/4136971739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 msgr2=0x55bcfb8b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.783+0000 7fd994674740 1 --2- 172.21.15.7:0/4136971739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8b4190 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fd97800cfd0 tx=0x7fd9780a9560 comp rx=0 tx=0).stop 2024-09-21T06:00:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.783+0000 7fd994674740 1 -- 172.21.15.7:0/4136971739 shutdown_connections 2024-09-21T06:00:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.783+0000 7fd994674740 1 --2- 172.21.15.7:0/4136971739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb50f070 0x55bcfb8b9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.783+0000 7fd994674740 1 --2- 172.21.15.7:0/4136971739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4ee390 0x55bcfb8cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.783+0000 7fd994674740 1 --2- 172.21.15.7:0/4136971739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8b4190 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.783+0000 7fd994674740 1 -- 172.21.15.7:0/4136971739 >> 172.21.15.7:0/4136971739 conn(0x55bcfb503460 msgr2=0x55bcfb8b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:32.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.783+0000 7fd994674740 1 -- 172.21.15.7:0/4136971739 shutdown_connections 2024-09-21T06:00:32.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.783+0000 7fd994674740 1 -- 172.21.15.7:0/4136971739 wait complete. 2024-09-21T06:00:32.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.784+0000 7fd994674740 1 -- start start 2024-09-21T06:00:32.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.784+0000 7fd994674740 1 Processor -- start 2024-09-21T06:00:32.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.784+0000 7fd994674740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.784+0000 7fd994674740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb4ee390 0x55bcfb8c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.784+0000 7fd994674740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 0x55bcfb8c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.784+0000 7fd994674740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd97400cc30 con 0x55bcfb50f070 2024-09-21T06:00:32.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.784+0000 7fd994674740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd97400e0a0 con 0x55bcfb4e61b0 2024-09-21T06:00:32.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.784+0000 7fd994674740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd97400d300 con 0x55bcfb4ee390 2024-09-21T06:00:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.784+0000 7fd994674740 10 client.0 _ll_register_callbacks cb 0x7fd9780a9a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd987fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 0x55bcfb8c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd986ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb4ee390 0x55bcfb8c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd987fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 0x55bcfb8c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39760/0 (socket says 172.21.15.7:39760) 2024-09-21T06:00:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd987fff640 1 -- 172.21.15.7:0/3107802613 learned_addr learned my addr 172.21.15.7:0/3107802613 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd9877fe640 1 --2- 172.21.15.7:0/3107802613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd987fff640 1 -- 172.21.15.7:0/3107802613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb4ee390 msgr2=0x55bcfb8c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd987fff640 1 --2- 172.21.15.7:0/3107802613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb4ee390 0x55bcfb8c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd987fff640 1 -- 172.21.15.7:0/3107802613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4e61b0 msgr2=0x55bcfb8ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd987fff640 1 --2- 172.21.15.7:0/3107802613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd987fff640 1 -- 172.21.15.7:0/3107802613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcfb8c67d0 con 0x55bcfb50f070 2024-09-21T06:00:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd987fff640 1 --2- 172.21.15.7:0/3107802613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 0x55bcfb8c5ff0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fd98000afa0 tx=0x7fd98000a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b656a89f0d7204c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:32.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd966ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd966ffd640 1 -- 172.21.15.7:0/3107802613 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980032030 con 0x55bcfb50f070 2024-09-21T06:00:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd966ffd640 1 -- 172.21.15.7:0/3107802613 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fd980009d00 con 0x55bcfb50f070 2024-09-21T06:00:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.785+0000 7fd994674740 1 -- 172.21.15.7:0/3107802613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9780adc90 con 0x55bcfb50f070 2024-09-21T06:00:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.786+0000 7fd966ffd640 1 -- 172.21.15.7:0/3107802613 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd98003b020 con 0x55bcfb50f070 2024-09-21T06:00:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.786+0000 7fd994674740 10 client.17256 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.786+0000 7fd994674740 1 -- 172.21.15.7:0/3107802613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bcfb93e4a0 con 0x55bcfb50f070 2024-09-21T06:00:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.786+0000 7fd966ffd640 1 -- 172.21.15.7:0/3107802613 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd980019c50 con 0x55bcfb50f070 2024-09-21T06:00:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.786+0000 7fd966ffd640 1 -- 172.21.15.7:0/3107802613 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd98002c040 con 0x55bcfb50f070 2024-09-21T06:00:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.786+0000 7fd994674740 10 client.17256 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.786+0000 7fd994674740 10 client.17256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.786+0000 7fd994674740 20 client.17256 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.786+0000 7fd994674740 1 --2- 172.21.15.7:0/3107802613 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bcfb4a2da0 0x55bcfb940a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.786+0000 7fd994674740 4 client.17256 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.786+0000 7fd994674740 1 -- 172.21.15.7:0/3107802613 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fd9780adc90 con 0x55bcfb4a2da0 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.786+0000 7fd9877fe640 1 --2- 172.21.15.7:0/3107802613 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bcfb4a2da0 0x55bcfb940a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd9877fe640 1 --2- 172.21.15.7:0/3107802613 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bcfb4a2da0 0x55bcfb940a30 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ada113849d8f3117 server_cookie=1e2b613feb4e3d19 in_seq=0 out_seq=0 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd966ffd640 10 client.17256 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd966ffd640 1 -- 172.21.15.7:0/3107802613 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x7fd9780adc90 con 0x55bcfb4a2da0 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd966ffd640 10 client.17256 handle_command_reply: tid=0 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd994674740 1 client.17256 shutdown 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd994674740 1 -- 172.21.15.7:0/3107802613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 msgr2=0x55bcfb8c5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd994674740 1 --2- 172.21.15.7:0/3107802613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 0x55bcfb8c5ff0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fd98000afa0 tx=0x7fd98000a6f0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd994674740 1 -- 172.21.15.7:0/3107802613 shutdown_connections 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd994674740 1 --2- 172.21.15.7:0/3107802613 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bcfb4a2da0 0x55bcfb940a30 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd994674740 1 --2- 172.21.15.7:0/3107802613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcfb50f070 0x55bcfb8c5ff0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd994674740 1 --2- 172.21.15.7:0/3107802613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bcfb4ee390 0x55bcfb8c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd994674740 1 --2- 172.21.15.7:0/3107802613 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bcfb4e61b0 0x55bcfb8ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd966ffd640 0 client.17256 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd994674740 1 -- 172.21.15.7:0/3107802613 >> 172.21.15.7:0/3107802613 conn(0x55bcfb503460 msgr2=0x55bcfb8b9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd994674740 1 -- 172.21.15.7:0/3107802613 shutdown_connections 2024-09-21T06:00:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.787+0000 7fd994674740 1 -- 172.21.15.7:0/3107802613 wait complete. 2024-09-21T06:00:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.788+0000 7fd994674740 20 client.17256 trim_cache size 0 max 16384 2024-09-21T06:00:32.797 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:00:32.797 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:00:32.797 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:00:32.797 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:00:32.797 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.800 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.801 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.801 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.801 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.801 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:00:32.801 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:00:32.801 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.801 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.801 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.801 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.801 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.801 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:00:32.806 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:00:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.788+0000 7fd98e100640 1 -- 172.21.15.7:0/3413081837 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd9700b66b0 msgr2=0x7fd9700b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.788+0000 7fd98e100640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd9700b66b0 0x7fd9700b8bc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd98000afd0 tx=0x7fd98001a000 comp rx=0 tx=0).stop 2024-09-21T06:00:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.788+0000 7fd98e100640 1 -- 172.21.15.7:0/3413081837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9881020a0 msgr2=0x7fd98819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.788+0000 7fd98e100640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9881020a0 0x7fd98819a590 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fd97800c920 tx=0x7fd97800cde0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.788+0000 7fd98e100640 1 -- 172.21.15.7:0/3413081837 shutdown_connections 2024-09-21T06:00:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.788+0000 7fd98e100640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd9700b66b0 0x7fd9700b8bc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.788+0000 7fd98e100640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd988109e40 0x7fd98819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.788+0000 7fd98e100640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9881094f0 0x7fd98819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.788+0000 7fd98e100640 1 --2- 172.21.15.7:0/3413081837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9881020a0 0x7fd98819a590 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.788+0000 7fd98e100640 1 -- 172.21.15.7:0/3413081837 >> 172.21.15.7:0/3413081837 conn(0x7fd988079e40 msgr2=0x7fd988107630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.788+0000 7fd98e100640 1 -- 172.21.15.7:0/3413081837 shutdown_connections 2024-09-21T06:00:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:32.789+0000 7fd98e100640 1 -- 172.21.15.7:0/3413081837 wait complete. 2024-09-21T06:00:33.448 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:33 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:00:33.448 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:33 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:33.448 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:33 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:00:33.448 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:33 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:33.448 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:33 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:00:33.475 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:00:33.475 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:00:33.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:33 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:00:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:33 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:33 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:00:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:33 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:33.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:33 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:00:33.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:33 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:00:33.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:33 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:33.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:33 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:00:33.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:33 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:33.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:33 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:00:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.214+0000 7f8adf87c640 1 -- 172.21.15.7:0/588963147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ad81083a0 msgr2=0x7f8ad81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.214+0000 7f8adf87c640 1 --2- 172.21.15.7:0/588963147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ad81083a0 0x7f8ad81087b0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009900 tx=0x7f8ac802a410 comp rx=0 tx=0).stop 2024-09-21T06:00:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.214+0000 7f8adf87c640 1 -- 172.21.15.7:0/588963147 shutdown_connections 2024-09-21T06:00:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.214+0000 7f8adf87c640 1 --2- 172.21.15.7:0/588963147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ad81083a0 0x7f8ad81087b0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.214+0000 7f8adf87c640 1 --2- 172.21.15.7:0/588963147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ad8108cf0 0x7f8ad810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.214+0000 7f8adf87c640 1 --2- 172.21.15.7:0/588963147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ad8102a60 0x7f8ad8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:34.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.214+0000 7f8adf87c640 1 -- 172.21.15.7:0/588963147 >> 172.21.15.7:0/588963147 conn(0x7f8ad8079730 msgr2=0x7f8ad8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:34.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.214+0000 7f8adf87c640 1 -- 172.21.15.7:0/588963147 shutdown_connections 2024-09-21T06:00:34.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.214+0000 7f8adf87c640 1 -- 172.21.15.7:0/588963147 wait complete. 2024-09-21T06:00:34.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.215+0000 7f8adf87c640 1 Processor -- start 2024-09-21T06:00:34.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.215+0000 7f8adf87c640 1 -- start start 2024-09-21T06:00:34.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.215+0000 7f8adf87c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ad8102a60 0x7f8ad81993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:34.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.215+0000 7f8adf87c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ad81083a0 0x7f8ad8199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:34.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.215+0000 7f8adf87c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ad8108cf0 0x7f8ad819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.215+0000 7f8adf87c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad81129c0 con 0x7f8ad81083a0 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.215+0000 7f8adf87c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad8112840 con 0x7f8ad8102a60 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.215+0000 7f8adf87c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad8112b40 con 0x7f8ad8108cf0 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8adce17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ad81083a0 0x7f8ad8199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8adce17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ad81083a0 0x7f8ad8199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39784/0 (socket says 172.21.15.7:39784) 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8adce17640 1 -- 172.21.15.7:0/938654254 learned_addr learned my addr 172.21.15.7:0/938654254 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8add618640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ad8102a60 0x7f8ad81993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8adde19640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ad8108cf0 0x7f8ad819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8adce17640 1 -- 172.21.15.7:0/938654254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ad8108cf0 msgr2=0x7f8ad819ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8adce17640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ad8108cf0 0x7f8ad819ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8adce17640 1 -- 172.21.15.7:0/938654254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ad8102a60 msgr2=0x7f8ad81993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8adce17640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ad8102a60 0x7f8ad81993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8adce17640 1 -- 172.21.15.7:0/938654254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad819f320 con 0x7f8ad81083a0 2024-09-21T06:00:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8adce17640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ad81083a0 0x7f8ad8199950 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8031a90 tx=0x7f8ac8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8ace7fc640 1 -- 172.21.15.7:0/938654254 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac803f030 con 0x7f8ad81083a0 2024-09-21T06:00:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8adf87c640 1 -- 172.21.15.7:0/938654254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad819f5b0 con 0x7f8ad81083a0 2024-09-21T06:00:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8ace7fc640 1 -- 172.21.15.7:0/938654254 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ac8003cb0 con 0x7f8ad81083a0 2024-09-21T06:00:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.216+0000 7f8ace7fc640 1 -- 172.21.15.7:0/938654254 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8035070 con 0x7f8ad81083a0 2024-09-21T06:00:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.217+0000 7f8adf87c640 1 -- 172.21.15.7:0/938654254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad81a5d70 con 0x7f8ad81083a0 2024-09-21T06:00:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.217+0000 7f8adf87c640 1 -- 172.21.15.7:0/938654254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad8102e70 con 0x7f8ad81083a0 2024-09-21T06:00:34.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.220+0000 7f8ace7fc640 1 -- 172.21.15.7:0/938654254 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8ac8042030 con 0x7f8ad81083a0 2024-09-21T06:00:34.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.221+0000 7f8ace7fc640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8ac40b6680 0x7f8ac40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:34.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.221+0000 7f8add618640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8ac40b6680 0x7f8ac40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:34.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.221+0000 7f8ace7fc640 1 -- 172.21.15.7:0/938654254 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f8ac8108020 con 0x7f8ad81083a0 2024-09-21T06:00:34.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.221+0000 7f8add618640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8ac40b6680 0x7f8ac40b8b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40058c0 tx=0x7f8ad400a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:34.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.224+0000 7f8ace7fc640 1 -- 172.21.15.7:0/938654254 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ac80d29a0 con 0x7f8ad81083a0 2024-09-21T06:00:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.452+0000 7f8adf87c640 1 -- 172.21.15.7:0/938654254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ad819a4e0 con 0x7f8ad81083a0 2024-09-21T06:00:34.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:34 smithi007 ceph-mon[30983]: pgmap v520: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:00:34.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.453+0000 7f8ace7fc640 1 -- 172.21.15.7:0/938654254 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f8ad819a4e0 con 0x7f8ad81083a0 2024-09-21T06:00:34.456 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:00:34.456 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:00:34.457 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:00:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.456+0000 7f8adf87c640 1 -- 172.21.15.7:0/938654254 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8ac40b6680 msgr2=0x7f8ac40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.456+0000 7f8adf87c640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8ac40b6680 0x7f8ac40b8b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40058c0 tx=0x7f8ad400a250 comp rx=0 tx=0).stop 2024-09-21T06:00:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.456+0000 7f8adf87c640 1 -- 172.21.15.7:0/938654254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ad81083a0 msgr2=0x7f8ad8199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.456+0000 7f8adf87c640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ad81083a0 0x7f8ad8199950 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8031a90 tx=0x7f8ac8004270 comp rx=0 tx=0).stop 2024-09-21T06:00:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.456+0000 7f8adf87c640 1 -- 172.21.15.7:0/938654254 shutdown_connections 2024-09-21T06:00:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.456+0000 7f8adf87c640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8ac40b6680 0x7f8ac40b8b90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.456+0000 7f8adf87c640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ad81083a0 0x7f8ad8199950 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.456+0000 7f8adf87c640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ad8108cf0 0x7f8ad819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.456+0000 7f8adf87c640 1 --2- 172.21.15.7:0/938654254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ad8102a60 0x7f8ad81993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.456+0000 7f8adf87c640 1 -- 172.21.15.7:0/938654254 >> 172.21.15.7:0/938654254 conn(0x7f8ad8079730 msgr2=0x7f8ad8104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.456+0000 7f8adf87c640 1 -- 172.21.15.7:0/938654254 shutdown_connections 2024-09-21T06:00:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:34.456+0000 7f8adf87c640 1 -- 172.21.15.7:0/938654254 wait complete. 2024-09-21T06:00:34.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:34 smithi119 ceph-mon[34833]: pgmap v520: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:00:34.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:34 smithi027 ceph-mon[34364]: pgmap v520: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:00:35.109 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:00:35.368 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:35.489 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/938654254' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:35.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:35 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/938654254' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:35.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:35 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/938654254' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:35.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.833+0000 7fe2a92ca640 1 -- 172.21.15.7:0/332373447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a41083b0 msgr2=0x7fe2a41087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:35.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.833+0000 7fe2a92ca640 1 --2- 172.21.15.7:0/332373447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a41083b0 0x7fe2a41087c0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fe298009900 tx=0x7fe29802a410 comp rx=0 tx=0).stop 2024-09-21T06:00:35.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.833+0000 7fe2a92ca640 1 -- 172.21.15.7:0/332373447 shutdown_connections 2024-09-21T06:00:35.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.833+0000 7fe2a92ca640 1 --2- 172.21.15.7:0/332373447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a41083b0 0x7fe2a41087c0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.833+0000 7fe2a92ca640 1 --2- 172.21.15.7:0/332373447 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a4108d00 0x7fe2a410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.833+0000 7fe2a92ca640 1 --2- 172.21.15.7:0/332373447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a4102a70 0x7fe2a4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.833+0000 7fe2a92ca640 1 -- 172.21.15.7:0/332373447 >> 172.21.15.7:0/332373447 conn(0x7fe2a4079710 msgr2=0x7fe2a4079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:35.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.833+0000 7fe2a92ca640 1 -- 172.21.15.7:0/332373447 shutdown_connections 2024-09-21T06:00:35.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.833+0000 7fe2a92ca640 1 -- 172.21.15.7:0/332373447 wait complete. 2024-09-21T06:00:35.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.834+0000 7fe2a92ca640 1 Processor -- start 2024-09-21T06:00:35.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.834+0000 7fe2a92ca640 1 -- start start 2024-09-21T06:00:35.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.834+0000 7fe2a92ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a4102a70 0x7fe2a40ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a92ca640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a41083b0 0x7fe2a40ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a92ca640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a4108d00 0x7fe2a4100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a92ca640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a41129c0 con 0x7fe2a4108d00 2024-09-21T06:00:35.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a92ca640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a4112840 con 0x7fe2a41083b0 2024-09-21T06:00:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a92ca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a4112b40 con 0x7fe2a4102a70 2024-09-21T06:00:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a4108d00 0x7fe2a4100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a4108d00 0x7fe2a4100070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39804/0 (socket says 172.21.15.7:39804) 2024-09-21T06:00:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a37fe640 1 -- 172.21.15.7:0/3718329689 learned_addr learned my addr 172.21.15.7:0/3718329689 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a2ffd640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a4102a70 0x7fe2a40ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a41083b0 0x7fe2a40ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a37fe640 1 -- 172.21.15.7:0/3718329689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a4102a70 msgr2=0x7fe2a40ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a37fe640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a4102a70 0x7fe2a40ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a37fe640 1 -- 172.21.15.7:0/3718329689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a41083b0 msgr2=0x7fe2a40ffb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a37fe640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a41083b0 0x7fe2a40ffb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a37fe640 1 -- 172.21.15.7:0/3718329689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a41a8860 con 0x7fe2a4108d00 2024-09-21T06:00:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe2a37fe640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a4108d00 0x7fe2a4100070 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00c970 tx=0x7fe29c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe28bfff640 1 -- 172.21.15.7:0/3718329689 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c007bb0 con 0x7fe2a4108d00 2024-09-21T06:00:35.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.835+0000 7fe28bfff640 1 -- 172.21.15.7:0/3718329689 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe29c007d50 con 0x7fe2a4108d00 2024-09-21T06:00:35.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.836+0000 7fe2a92ca640 1 -- 172.21.15.7:0/3718329689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a41a8b50 con 0x7fe2a4108d00 2024-09-21T06:00:35.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.836+0000 7fe28bfff640 1 -- 172.21.15.7:0/3718329689 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c004e60 con 0x7fe2a4108d00 2024-09-21T06:00:35.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.836+0000 7fe2a92ca640 1 -- 172.21.15.7:0/3718329689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a41a9010 con 0x7fe2a4108d00 2024-09-21T06:00:35.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.839+0000 7fe2af83e740 1 Processor -- start 2024-09-21T06:00:35.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.839+0000 7fe28bfff640 1 -- 172.21.15.7:0/3718329689 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe29c005020 con 0x7fe2a4108d00 2024-09-21T06:00:35.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.839+0000 7fe2af83e740 1 -- start start 2024-09-21T06:00:35.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.839+0000 7fe2af83e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 0x55c05a7366a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.839+0000 7fe2af83e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a3661b0 0x55c05a736be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.839+0000 7fe2af83e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a36e390 0x55c05a737120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.839+0000 7fe2af83e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c05a6acea0 con 0x55c05a3661b0 2024-09-21T06:00:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.839+0000 7fe2af83e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c05a69c2d0 con 0x55c05a36e390 2024-09-21T06:00:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.839+0000 7fe2af83e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c05a6a00e0 con 0x55c05a38f070 2024-09-21T06:00:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe2a2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a3661b0 0x55c05a736be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe2a2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a3661b0 0x55c05a736be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39812/0 (socket says 172.21.15.7:39812) 2024-09-21T06:00:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe2a2ffd640 1 -- 172.21.15.7:0/1669120082 learned_addr learned my addr 172.21.15.7:0/1669120082 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/1669120082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a36e390 0x55c05a737120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/1669120082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 0x55c05a7366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe2a2ffd640 1 -- 172.21.15.7:0/1669120082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 msgr2=0x55c05a7366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe2a2ffd640 1 --2- 172.21.15.7:0/1669120082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 0x55c05a7366a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe2a2ffd640 1 -- 172.21.15.7:0/1669120082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a36e390 msgr2=0x55c05a737120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe2a2ffd640 1 --2- 172.21.15.7:0/1669120082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a36e390 0x55c05a737120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe2a2ffd640 1 -- 172.21.15.7:0/1669120082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05a3fa650 con 0x55c05a3661b0 2024-09-21T06:00:35.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe28bfff640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe28c0b6680 0x7fe28c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe28c0b6680 0x7fe28c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe28bfff640 1 -- 172.21.15.7:0/3718329689 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fe29c0e7330 con 0x7fe2a4108d00 2024-09-21T06:00:35.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe2a2ffd640 1 --2- 172.21.15.7:0/1669120082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a3661b0 0x55c05a736be0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe294009fd0 tx=0x7fe294010880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd55acf452488fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:35.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.840+0000 7fe2897fa640 1 -- 172.21.15.7:0/1669120082 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294016070 con 0x55c05a3661b0 2024-09-21T06:00:35.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.841+0000 7fe2897fa640 1 -- 172.21.15.7:0/1669120082 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe294012bc0 con 0x55c05a3661b0 2024-09-21T06:00:35.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.841+0000 7fe2897fa640 1 -- 172.21.15.7:0/1669120082 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29401bc20 con 0x55c05a3661b0 2024-09-21T06:00:35.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.841+0000 7fe2af83e740 1 -- 172.21.15.7:0/1669120082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a3661b0 msgr2=0x55c05a736be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:35.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.841+0000 7fe2af83e740 1 --2- 172.21.15.7:0/1669120082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a3661b0 0x55c05a736be0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe294009fd0 tx=0x7fe294010880 comp rx=0 tx=0).stop 2024-09-21T06:00:35.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.841+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe28c0b6680 0x7fe28c0b8b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe298009230 tx=0x7fe298040040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:35.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.841+0000 7fe2af83e740 1 -- 172.21.15.7:0/1669120082 shutdown_connections 2024-09-21T06:00:35.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.841+0000 7fe2af83e740 1 --2- 172.21.15.7:0/1669120082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a3661b0 0x55c05a736be0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.841+0000 7fe2af83e740 1 --2- 172.21.15.7:0/1669120082 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a36e390 0x55c05a737120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.841+0000 7fe2af83e740 1 --2- 172.21.15.7:0/1669120082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 0x55c05a7366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.841+0000 7fe2af83e740 1 -- 172.21.15.7:0/1669120082 >> 172.21.15.7:0/1669120082 conn(0x55c05a383460 msgr2=0x55c05a734590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.842+0000 7fe2af83e740 1 -- 172.21.15.7:0/1669120082 shutdown_connections 2024-09-21T06:00:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.842+0000 7fe2af83e740 1 -- 172.21.15.7:0/1669120082 wait complete. 2024-09-21T06:00:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.842+0000 7fe2af83e740 1 -- start start 2024-09-21T06:00:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.842+0000 7fe2af83e740 1 Processor -- start 2024-09-21T06:00:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.842+0000 7fe2af83e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a3661b0 0x55c05a741d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.842+0000 7fe2af83e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a742250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.842+0000 7fe2af83e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 0x55c05a7427b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.842+0000 7fe2af83e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c05a4fd700 con 0x55c05a36e390 2024-09-21T06:00:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.842+0000 7fe2af83e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c05a637160 con 0x55c05a3661b0 2024-09-21T06:00:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.842+0000 7fe2af83e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c05a744e80 con 0x55c05a38f070 2024-09-21T06:00:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.842+0000 7fe2af83e740 10 client.0 _ll_register_callbacks cb 0x55c05a6509e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:35.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a742250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2a2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a3661b0 0x55c05a741d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a742250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39824/0 (socket says 172.21.15.7:39824) 2024-09-21T06:00:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2a27fc640 1 -- 172.21.15.7:0/3883033435 learned_addr learned my addr 172.21.15.7:0/3883033435 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2a37fe640 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 0x55c05a7427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2a27fc640 1 -- 172.21.15.7:0/3883033435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 msgr2=0x55c05a7427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 0x55c05a7427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2a27fc640 1 -- 172.21.15.7:0/3883033435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a3661b0 msgr2=0x55c05a741d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a3661b0 0x55c05a741d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2a27fc640 1 -- 172.21.15.7:0/3883033435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05a664c90 con 0x55c05a36e390 2024-09-21T06:00:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2a2ffd640 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a3661b0 0x55c05a741d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2a37fe640 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 0x55c05a7427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a742250 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fe298000c00 tx=0x7fe29802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21caae597bced855 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe286ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe286ff5640 1 -- 172.21.15.7:0/3883033435 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29804f030 con 0x55c05a36e390 2024-09-21T06:00:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe286ff5640 1 -- 172.21.15.7:0/3883033435 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fe298003800 con 0x55c05a36e390 2024-09-21T06:00:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.843+0000 7fe2af83e740 1 -- 172.21.15.7:0/3883033435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe294012bc0 con 0x55c05a36e390 2024-09-21T06:00:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.844+0000 7fe286ff5640 1 -- 172.21.15.7:0/3883033435 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe298058030 con 0x55c05a36e390 2024-09-21T06:00:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.844+0000 7fe2af83e740 10 client.17274 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.844+0000 7fe2af83e740 1 -- 172.21.15.7:0/3883033435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c05a750b30 con 0x55c05a36e390 2024-09-21T06:00:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.844+0000 7fe286ff5640 1 -- 172.21.15.7:0/3883033435 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe294012bc0 con 0x55c05a36e390 2024-09-21T06:00:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.844+0000 7fe286ff5640 1 -- 172.21.15.7:0/3883033435 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe29803a040 con 0x55c05a36e390 2024-09-21T06:00:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.844+0000 7fe2af83e740 10 client.17274 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.844+0000 7fe2af83e740 10 client.17274 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:00:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.844+0000 7fe2af83e740 20 client.17274 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.844+0000 7fe2af83e740 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c05a34d9f0 0x55c05a7540c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.844+0000 7fe2af83e740 4 client.17274 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.844+0000 7fe2af83e740 1 -- 172.21.15.7:0/3883033435 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c05a6aedf0 con 0x55c05a34d9f0 2024-09-21T06:00:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.844+0000 7fe2a2ffd640 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c05a34d9f0 0x55c05a7540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.845+0000 7fe2a2ffd640 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c05a34d9f0 0x55c05a7540c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8781d3fe9b457a server_cookie=22ece25f5050b395 in_seq=0 out_seq=0 2024-09-21T06:00:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.845+0000 7fe286ff5640 10 client.17274 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe286ff5640 1 -- 172.21.15.7:0/3883033435 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c05a6aedf0 con 0x55c05a34d9f0 2024-09-21T06:00:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe286ff5640 10 client.17274 handle_command_reply: tid=0 2024-09-21T06:00:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe2af83e740 1 client.17274 shutdown 2024-09-21T06:00:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe2af83e740 1 -- 172.21.15.7:0/3883033435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 msgr2=0x55c05a742250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe2af83e740 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a742250 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fe298000c00 tx=0x7fe29802a410 comp rx=0 tx=0).stop 2024-09-21T06:00:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe2af83e740 1 -- 172.21.15.7:0/3883033435 shutdown_connections 2024-09-21T06:00:35.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe2af83e740 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c05a34d9f0 0x55c05a7540c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe2af83e740 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a742250 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe2af83e740 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 0x55c05a7427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe2af83e740 1 --2- 172.21.15.7:0/3883033435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a3661b0 0x55c05a741d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe2af83e740 1 -- 172.21.15.7:0/3883033435 >> 172.21.15.7:0/3883033435 conn(0x55c05a383460 msgr2=0x55c05a739830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:35.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe286ff5640 0 client.17274 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:35.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe2af83e740 1 -- 172.21.15.7:0/3883033435 shutdown_connections 2024-09-21T06:00:35.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe2af83e740 1 -- 172.21.15.7:0/3883033435 wait complete. 2024-09-21T06:00:35.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.846+0000 7fe2af83e740 20 client.17274 trim_cache size 0 max 16384 2024-09-21T06:00:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.859+0000 7fe2af83e740 1 Processor -- start 2024-09-21T06:00:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.859+0000 7fe2af83e740 1 -- start start 2024-09-21T06:00:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2af83e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a3661b0 0x55c05a738090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2af83e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a743940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2af83e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a38f070 0x55c05a733bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2af83e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a41b4170 con 0x55c05a36e390 2024-09-21T06:00:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2af83e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a41b1a40 con 0x55c05a38f070 2024-09-21T06:00:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2af83e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a41af8b0 con 0x55c05a3661b0 2024-09-21T06:00:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a743940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a743940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39840/0 (socket says 172.21.15.7:39840) 2024-09-21T06:00:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2a27fc640 1 -- 172.21.15.7:0/3704066400 learned_addr learned my addr 172.21.15.7:0/3704066400 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2a2ffd640 1 --2- 172.21.15.7:0/3704066400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a3661b0 0x55c05a738090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2a27fc640 1 -- 172.21.15.7:0/3704066400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a3661b0 msgr2=0x55c05a738090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/3704066400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a3661b0 0x55c05a738090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2a37fe640 1 --2- 172.21.15.7:0/3704066400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a38f070 0x55c05a733bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2a27fc640 1 -- 172.21.15.7:0/3704066400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a38f070 msgr2=0x55c05a733bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/3704066400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a38f070 0x55c05a733bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2a27fc640 1 -- 172.21.15.7:0/3704066400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05a74e0a0 con 0x55c05a36e390 2024-09-21T06:00:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.860+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/3704066400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a743940 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fe298006010 tx=0x7fe298031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2566d19e6cfd9eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.861+0000 7fe288ff9640 1 -- 172.21.15.7:0/3704066400 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29804f070 con 0x55c05a36e390 2024-09-21T06:00:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.861+0000 7fe288ff9640 1 -- 172.21.15.7:0/3704066400 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe29805dcc0 con 0x55c05a36e390 2024-09-21T06:00:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.861+0000 7fe288ff9640 1 -- 172.21.15.7:0/3704066400 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298045070 con 0x55c05a36e390 2024-09-21T06:00:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.861+0000 7fe2af83e740 1 -- 172.21.15.7:0/3704066400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 msgr2=0x55c05a743940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.861+0000 7fe2af83e740 1 --2- 172.21.15.7:0/3704066400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a743940 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fe298006010 tx=0x7fe298031400 comp rx=0 tx=0).stop 2024-09-21T06:00:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.861+0000 7fe2af83e740 1 -- 172.21.15.7:0/3704066400 shutdown_connections 2024-09-21T06:00:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.861+0000 7fe2af83e740 1 --2- 172.21.15.7:0/3704066400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a743940 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.861+0000 7fe2af83e740 1 --2- 172.21.15.7:0/3704066400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a38f070 0x55c05a733bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.861+0000 7fe2af83e740 1 --2- 172.21.15.7:0/3704066400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a3661b0 0x55c05a738090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.861+0000 7fe2af83e740 1 -- 172.21.15.7:0/3704066400 >> 172.21.15.7:0/3704066400 conn(0x55c05a383460 msgr2=0x55c05a743230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.861+0000 7fe2af83e740 1 -- 172.21.15.7:0/3704066400 shutdown_connections 2024-09-21T06:00:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.861+0000 7fe2af83e740 1 -- 172.21.15.7:0/3704066400 wait complete. 2024-09-21T06:00:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2af83e740 1 -- start start 2024-09-21T06:00:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2af83e740 1 Processor -- start 2024-09-21T06:00:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2af83e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a3661b0 0x55c05a74a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2af83e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a74ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2af83e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 0x55c05a745bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2af83e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a41aff00 con 0x55c05a36e390 2024-09-21T06:00:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2af83e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a41b1370 con 0x55c05a3661b0 2024-09-21T06:00:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2af83e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a41b05d0 con 0x55c05a38f070 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2af83e740 10 client.0 _ll_register_callbacks cb 0x7fe298032c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a74ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2a2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a3661b0 0x55c05a74a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a74ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39856/0 (socket says 172.21.15.7:39856) 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2a37fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 0x55c05a745bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.862+0000 7fe2a27fc640 1 -- 172.21.15.7:0/1152195758 learned_addr learned my addr 172.21.15.7:0/1152195758 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe2a2ffd640 1 -- 172.21.15.7:0/1152195758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 msgr2=0x55c05a745bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe2a2ffd640 1 --2- 172.21.15.7:0/1152195758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 0x55c05a745bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe2a2ffd640 1 -- 172.21.15.7:0/1152195758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 msgr2=0x55c05a74ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe2a2ffd640 1 --2- 172.21.15.7:0/1152195758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a74ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe2a2ffd640 1 -- 172.21.15.7:0/1152195758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05a746380 con 0x55c05a3661b0 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/1152195758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a74ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe2a2ffd640 1 --2- 172.21.15.7:0/1152195758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a3661b0 0x55c05a74a570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe29401b8e0 tx=0x7fe29401b540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=645e8ac7e459e35d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe286ff5640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T06:00:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe286ff5640 1 -- 172.21.15.7:0/1152195758 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294016040 con 0x55c05a3661b0 2024-09-21T06:00:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe2af83e740 1 -- 172.21.15.7:0/1152195758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe29805dcc0 con 0x55c05a3661b0 2024-09-21T06:00:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe286ff5640 1 -- 172.21.15.7:0/1152195758 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fe29401b910 con 0x55c05a3661b0 2024-09-21T06:00:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe286ff5640 1 -- 172.21.15.7:0/1152195758 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe294003e40 con 0x55c05a3661b0 2024-09-21T06:00:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe2af83e740 10 client.26711 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.863+0000 7fe2af83e740 1 -- 172.21.15.7:0/1152195758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c05a7be660 con 0x55c05a3661b0 2024-09-21T06:00:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.864+0000 7fe286ff5640 1 -- 172.21.15.7:0/1152195758 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe29805dcc0 con 0x55c05a3661b0 2024-09-21T06:00:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.864+0000 7fe286ff5640 1 -- 172.21.15.7:0/1152195758 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe29400f040 con 0x55c05a3661b0 2024-09-21T06:00:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.864+0000 7fe2af83e740 10 client.26711 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.864+0000 7fe2af83e740 10 client.26711 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:00:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.864+0000 7fe2af83e740 20 client.26711 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.864+0000 7fe2af83e740 1 --2- 172.21.15.7:0/1152195758 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c05a322da0 0x55c05a7c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.864+0000 7fe2af83e740 4 client.26711 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.864+0000 7fe2af83e740 1 -- 172.21.15.7:0/1152195758 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c05a6aa8a0 con 0x55c05a322da0 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.864+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/1152195758 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c05a322da0 0x55c05a7c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe2a27fc640 1 --2- 172.21.15.7:0/1152195758 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c05a322da0 0x55c05a7c0bf0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=138c6838ffeba12e server_cookie=6fe82afa271c154c in_seq=0 out_seq=0 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe286ff5640 10 client.26711 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe286ff5640 1 -- 172.21.15.7:0/1152195758 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c05a6aa8a0 con 0x55c05a322da0 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe286ff5640 10 client.26711 handle_command_reply: tid=0 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe2af83e740 1 client.26711 shutdown 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe2af83e740 1 -- 172.21.15.7:0/1152195758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a3661b0 msgr2=0x55c05a74a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe2af83e740 1 --2- 172.21.15.7:0/1152195758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a3661b0 0x55c05a74a570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe29401b8e0 tx=0x7fe29401b540 comp rx=0 tx=0).stop 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe2af83e740 1 -- 172.21.15.7:0/1152195758 shutdown_connections 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe2af83e740 1 --2- 172.21.15.7:0/1152195758 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55c05a322da0 0x55c05a7c0bf0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe2af83e740 1 --2- 172.21.15.7:0/1152195758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c05a36e390 0x55c05a74ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe286ff5640 0 client.26711 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe2af83e740 1 --2- 172.21.15.7:0/1152195758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c05a38f070 0x55c05a745bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe2af83e740 1 --2- 172.21.15.7:0/1152195758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c05a3661b0 0x55c05a74a570 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe2af83e740 1 -- 172.21.15.7:0/1152195758 >> 172.21.15.7:0/1152195758 conn(0x55c05a383460 msgr2=0x55c05a737e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe2af83e740 1 -- 172.21.15.7:0/1152195758 shutdown_connections 2024-09-21T06:00:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe2af83e740 1 -- 172.21.15.7:0/1152195758 wait complete. 2024-09-21T06:00:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.865+0000 7fe2af83e740 20 client.26711 trim_cache size 0 max 16384 2024-09-21T06:00:35.873 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:35.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.866+0000 7fe2a92ca640 1 -- 172.21.15.7:0/3718329689 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe28c0b6680 msgr2=0x7fe28c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:35.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.866+0000 7fe2a92ca640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe28c0b6680 0x7fe28c0b8b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe298009230 tx=0x7fe298040040 comp rx=0 tx=0).stop 2024-09-21T06:00:35.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.866+0000 7fe2a92ca640 1 -- 172.21.15.7:0/3718329689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a4108d00 msgr2=0x7fe2a4100070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:35.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.866+0000 7fe2a92ca640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a4108d00 0x7fe2a4100070 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00c970 tx=0x7fe29c00ce30 comp rx=0 tx=0).stop 2024-09-21T06:00:35.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.866+0000 7fe2a92ca640 1 -- 172.21.15.7:0/3718329689 shutdown_connections 2024-09-21T06:00:35.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.866+0000 7fe2a92ca640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe28c0b6680 0x7fe28c0b8b90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.866+0000 7fe2a92ca640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a4108d00 0x7fe2a4100070 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.866+0000 7fe2a92ca640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2a41083b0 0x7fe2a40ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.866+0000 7fe2a92ca640 1 --2- 172.21.15.7:0/3718329689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a4102a70 0x7fe2a40ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:35.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.866+0000 7fe2a92ca640 1 -- 172.21.15.7:0/3718329689 >> 172.21.15.7:0/3718329689 conn(0x7fe2a4079710 msgr2=0x7fe2a4101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:35.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.866+0000 7fe2a92ca640 1 -- 172.21.15.7:0/3718329689 shutdown_connections 2024-09-21T06:00:35.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:35.866+0000 7fe2a92ca640 1 -- 172.21.15.7:0/3718329689 wait complete. 2024-09-21T06:00:36.500 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:00:36.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:36 smithi007 ceph-mon[30983]: pgmap v521: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8 op/s 2024-09-21T06:00:36.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:36 smithi119 ceph-mon[34833]: pgmap v521: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8 op/s 2024-09-21T06:00:36.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:36 smithi027 ceph-mon[34364]: pgmap v521: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8 op/s 2024-09-21T06:00:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:37.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.275+0000 7f8e7a7d2640 1 -- 172.21.15.7:0/4075917600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e741094a0 msgr2=0x7f8e741098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:37.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.275+0000 7f8e7a7d2640 1 --2- 172.21.15.7:0/4075917600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e741094a0 0x7f8e741098b0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f8e68009900 tx=0x7f8e6802a410 comp rx=0 tx=0).stop 2024-09-21T06:00:37.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.275+0000 7f8e7a7d2640 1 -- 172.21.15.7:0/4075917600 shutdown_connections 2024-09-21T06:00:37.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.275+0000 7f8e7a7d2640 1 --2- 172.21.15.7:0/4075917600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e741094a0 0x7f8e741098b0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.275+0000 7f8e7a7d2640 1 --2- 172.21.15.7:0/4075917600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e74109df0 0x7f8e74110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.275+0000 7f8e7a7d2640 1 --2- 172.21.15.7:0/4075917600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e74103b60 0x7f8e74103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.275+0000 7f8e7a7d2640 1 -- 172.21.15.7:0/4075917600 >> 172.21.15.7:0/4075917600 conn(0x7f8e7407b850 msgr2=0x7f8e7407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:37.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.275+0000 7f8e7a7d2640 1 -- 172.21.15.7:0/4075917600 shutdown_connections 2024-09-21T06:00:37.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.275+0000 7f8e7a7d2640 1 -- 172.21.15.7:0/4075917600 wait complete. 2024-09-21T06:00:37.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.275+0000 7f8e7a7d2640 1 Processor -- start 2024-09-21T06:00:37.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.275+0000 7f8e7a7d2640 1 -- start start 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.276+0000 7f8e7a7d2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e74103b60 0x7f8e7419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.276+0000 7f8e7a7d2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e741094a0 0x7f8e7419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.276+0000 7f8e7a7d2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e74109df0 0x7f8e7419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.276+0000 7f8e7a7d2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8e74113ab0 con 0x7f8e741094a0 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.276+0000 7f8e7a7d2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8e74113930 con 0x7f8e74103b60 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.276+0000 7f8e7a7d2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8e74113c30 con 0x7f8e74109df0 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.276+0000 7f8e737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e741094a0 0x7f8e7419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.276+0000 7f8e737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e741094a0 0x7f8e7419aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39872/0 (socket says 172.21.15.7:39872) 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.276+0000 7f8e737fe640 1 -- 172.21.15.7:0/2264149426 learned_addr learned my addr 172.21.15.7:0/2264149426 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.276+0000 7f8e73fff640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e74103b60 0x7f8e7419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.276+0000 7f8e78d6f640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e74109df0 0x7f8e7419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.276+0000 7f8e737fe640 1 -- 172.21.15.7:0/2264149426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e74109df0 msgr2=0x7f8e7419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.276+0000 7f8e737fe640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e74109df0 0x7f8e7419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.277+0000 7f8e737fe640 1 -- 172.21.15.7:0/2264149426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e74103b60 msgr2=0x7f8e7419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:37.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.277+0000 7f8e737fe640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e74103b60 0x7f8e7419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.277+0000 7f8e737fe640 1 -- 172.21.15.7:0/2264149426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e741a03f0 con 0x7f8e741094a0 2024-09-21T06:00:37.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.277+0000 7f8e73fff640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e74103b60 0x7f8e7419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:37.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.277+0000 7f8e737fe640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e741094a0 0x7f8e7419aa20 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f8e6802a930 tx=0x7f8e68031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:37.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.277+0000 7f8e717fa640 1 -- 172.21.15.7:0/2264149426 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6803f030 con 0x7f8e741094a0 2024-09-21T06:00:37.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.277+0000 7f8e717fa640 1 -- 172.21.15.7:0/2264149426 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e68004490 con 0x7f8e741094a0 2024-09-21T06:00:37.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.277+0000 7f8e7a7d2640 1 -- 172.21.15.7:0/2264149426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e741a0680 con 0x7f8e741094a0 2024-09-21T06:00:37.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.277+0000 7f8e717fa640 1 -- 172.21.15.7:0/2264149426 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e68035070 con 0x7f8e741094a0 2024-09-21T06:00:37.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.277+0000 7f8e7a7d2640 1 -- 172.21.15.7:0/2264149426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e741a6e40 con 0x7f8e741094a0 2024-09-21T06:00:37.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e80d46740 1 Processor -- start 2024-09-21T06:00:37.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e80d46740 1 -- start start 2024-09-21T06:00:37.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e717fa640 1 -- 172.21.15.7:0/2264149426 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8e68042030 con 0x7f8e741094a0 2024-09-21T06:00:37.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e80d46740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cda3070 0x55a27d14a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e80d46740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd7a1b0 0x55a27d14a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e80d46740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd82390 0x55a27d14ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e80d46740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a27d0c0ea0 con 0x55a27cd82390 2024-09-21T06:00:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e80d46740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a27d0b02d0 con 0x55a27cd7a1b0 2024-09-21T06:00:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e80d46740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a27d0b40e0 con 0x55a27cda3070 2024-09-21T06:00:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd82390 0x55a27d14ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd82390 0x55a27d14ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39886/0 (socket says 172.21.15.7:39886) 2024-09-21T06:00:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e737fe640 1 -- 172.21.15.7:0/2414053666 learned_addr learned my addr 172.21.15.7:0/2414053666 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e73fff640 1 --2- 172.21.15.7:0/2414053666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd7a1b0 0x55a27d14a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.280+0000 7f8e78d6f640 1 --2- 172.21.15.7:0/2414053666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cda3070 0x55a27d14a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.281+0000 7f8e73fff640 1 -- 172.21.15.7:0/2414053666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cda3070 msgr2=0x55a27d14a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.281+0000 7f8e73fff640 1 --2- 172.21.15.7:0/2414053666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cda3070 0x55a27d14a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.281+0000 7f8e73fff640 1 -- 172.21.15.7:0/2414053666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd82390 msgr2=0x55a27d14ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:37.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.281+0000 7f8e73fff640 1 --2- 172.21.15.7:0/2414053666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd82390 0x55a27d14ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.281+0000 7f8e73fff640 1 -- 172.21.15.7:0/2414053666 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a27ce0e650 con 0x55a27cd7a1b0 2024-09-21T06:00:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.281+0000 7f8e73fff640 1 --2- 172.21.15.7:0/2414053666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd7a1b0 0x55a27d14a800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009fd0 tx=0x7f8e640118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5619a88d04ac3eac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.281+0000 7f8e717fa640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8e5c0b6680 0x7f8e5c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.281+0000 7f8e5a7fc640 1 -- 172.21.15.7:0/2414053666 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64004030 con 0x55a27cd7a1b0 2024-09-21T06:00:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.281+0000 7f8e5a7fc640 1 -- 172.21.15.7:0/2414053666 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e640054d0 con 0x55a27cd7a1b0 2024-09-21T06:00:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.281+0000 7f8e5a7fc640 1 -- 172.21.15.7:0/2414053666 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64004c10 con 0x55a27cd7a1b0 2024-09-21T06:00:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.281+0000 7f8e78d6f640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8e5c0b6680 0x7f8e5c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.281+0000 7f8e717fa640 1 -- 172.21.15.7:0/2264149426 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f8e68107aa0 con 0x7f8e741094a0 2024-09-21T06:00:37.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.282+0000 7f8e80d46740 1 -- 172.21.15.7:0/2414053666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd7a1b0 msgr2=0x55a27d14a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:37.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.282+0000 7f8e80d46740 1 --2- 172.21.15.7:0/2414053666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd7a1b0 0x55a27d14a800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009fd0 tx=0x7f8e640118d0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.282+0000 7f8e78d6f640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8e5c0b6680 0x7f8e5c0b8b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c005fd0 tx=0x7f8e6c009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:37.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.282+0000 7f8e80d46740 1 -- 172.21.15.7:0/2414053666 shutdown_connections 2024-09-21T06:00:37.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.282+0000 7f8e80d46740 1 --2- 172.21.15.7:0/2414053666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd82390 0x55a27d14ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.282+0000 7f8e80d46740 1 --2- 172.21.15.7:0/2414053666 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd7a1b0 0x55a27d14a800 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.282+0000 7f8e80d46740 1 --2- 172.21.15.7:0/2414053666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cda3070 0x55a27d14a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.282+0000 7f8e80d46740 1 -- 172.21.15.7:0/2414053666 >> 172.21.15.7:0/2414053666 conn(0x55a27cd97460 msgr2=0x55a27d1481b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.282+0000 7f8e80d46740 1 -- 172.21.15.7:0/2414053666 shutdown_connections 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.282+0000 7f8e80d46740 1 -- 172.21.15.7:0/2414053666 wait complete. 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.283+0000 7f8e80d46740 1 -- start start 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.283+0000 7f8e80d46740 1 Processor -- start 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.283+0000 7f8e80d46740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cd7a1b0 0x55a27d1558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.283+0000 7f8e80d46740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd82390 0x55a27d155df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.283+0000 7f8e80d46740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cda3070 0x55a27d156330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.283+0000 7f8e80d46740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a27cf11700 con 0x55a27cd82390 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.283+0000 7f8e80d46740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55a27d04b160 con 0x55a27cda3070 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.283+0000 7f8e80d46740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55a27d158aa0 con 0x55a27cd7a1b0 2024-09-21T06:00:37.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.283+0000 7f8e80d46740 10 client.0 _ll_register_callbacks cb 0x55a27d0649e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.283+0000 7f8e737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd82390 0x55a27d155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.283+0000 7f8e737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd82390 0x55a27d155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39888/0 (socket says 172.21.15.7:39888) 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.283+0000 7f8e737fe640 1 -- 172.21.15.7:0/1155298763 learned_addr learned my addr 172.21.15.7:0/1155298763 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.283+0000 7f8e73fff640 1 --2- 172.21.15.7:0/1155298763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cd7a1b0 0x55a27d1558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e78d6f640 1 --2- 172.21.15.7:0/1155298763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cda3070 0x55a27d156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e737fe640 1 -- 172.21.15.7:0/1155298763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cd7a1b0 msgr2=0x55a27d1558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e737fe640 1 --2- 172.21.15.7:0/1155298763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cd7a1b0 0x55a27d1558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e737fe640 1 -- 172.21.15.7:0/1155298763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cda3070 msgr2=0x55a27d156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e737fe640 1 --2- 172.21.15.7:0/1155298763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cda3070 0x55a27d156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e737fe640 1 -- 172.21.15.7:0/1155298763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a27d078c90 con 0x55a27cd82390 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e737fe640 1 --2- 172.21.15.7:0/1155298763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd82390 0x55a27d155df0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f8e680cd8d0 tx=0x7f8e68003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4125afcd1e13e91 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e537fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e537fe640 1 -- 172.21.15.7:0/1155298763 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e68049070 con 0x55a27cd82390 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e537fe640 1 -- 172.21.15.7:0/1155298763 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f8e680d70d0 con 0x55a27cd82390 2024-09-21T06:00:37.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e80d46740 1 -- 172.21.15.7:0/1155298763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e640054d0 con 0x55a27cd82390 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e537fe640 1 -- 172.21.15.7:0/1155298763 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8e680c9f90 con 0x55a27cd82390 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e80d46740 10 client.17292 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.284+0000 7f8e80d46740 1 -- 172.21.15.7:0/1155298763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a27d164720 con 0x55a27cd82390 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.285+0000 7f8e537fe640 1 -- 172.21.15.7:0/1155298763 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e640054d0 con 0x55a27cd82390 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.285+0000 7f8e537fe640 1 -- 172.21.15.7:0/1155298763 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8e680c9290 con 0x55a27cd82390 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.285+0000 7f8e80d46740 10 client.17292 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.285+0000 7f8e80d46740 10 client.17292 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.285+0000 7f8e80d46740 20 client.17292 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.285+0000 7f8e80d46740 1 --2- 172.21.15.7:0/1155298763 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a27cd619f0 0x55a27d167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.285+0000 7f8e80d46740 4 client.17292 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.285+0000 7f8e80d46740 1 -- 172.21.15.7:0/1155298763 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a27d0c2df0 con 0x55a27cd619f0 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.285+0000 7f8e73fff640 1 --2- 172.21.15.7:0/1155298763 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a27cd619f0 0x55a27d167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.286+0000 7f8e537fe640 10 client.17292 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.286+0000 7f8e73fff640 1 --2- 172.21.15.7:0/1155298763 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a27cd619f0 0x55a27d167b90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20c092c182c41554 server_cookie=b401f2a287bc104e in_seq=0 out_seq=0 2024-09-21T06:00:37.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.286+0000 7f8e537fe640 1 -- 172.21.15.7:0/1155298763 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a27d0c2df0 con 0x55a27cd619f0 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.286+0000 7f8e537fe640 10 client.17292 handle_command_reply: tid=0 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.286+0000 7f8e80d46740 1 client.17292 shutdown 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.287+0000 7f8e80d46740 1 -- 172.21.15.7:0/1155298763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd82390 msgr2=0x55a27d155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.287+0000 7f8e80d46740 1 --2- 172.21.15.7:0/1155298763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd82390 0x55a27d155df0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f8e680cd8d0 tx=0x7f8e68003f60 comp rx=0 tx=0).stop 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.287+0000 7f8e80d46740 1 -- 172.21.15.7:0/1155298763 shutdown_connections 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.287+0000 7f8e80d46740 1 --2- 172.21.15.7:0/1155298763 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a27cd619f0 0x55a27d167b90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.287+0000 7f8e80d46740 1 --2- 172.21.15.7:0/1155298763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd82390 0x55a27d155df0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.287+0000 7f8e80d46740 1 --2- 172.21.15.7:0/1155298763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cda3070 0x55a27d156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.287+0000 7f8e537fe640 0 client.17292 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.287+0000 7f8e80d46740 1 --2- 172.21.15.7:0/1155298763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cd7a1b0 0x55a27d1558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.287+0000 7f8e80d46740 1 -- 172.21.15.7:0/1155298763 >> 172.21.15.7:0/1155298763 conn(0x55a27cd97460 msgr2=0x55a27d14d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.287+0000 7f8e80d46740 1 -- 172.21.15.7:0/1155298763 shutdown_connections 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.287+0000 7f8e80d46740 1 -- 172.21.15.7:0/1155298763 wait complete. 2024-09-21T06:00:37.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.287+0000 7f8e80d46740 20 client.17292 trim_cache size 0 max 16384 2024-09-21T06:00:37.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.300+0000 7f8e80d46740 1 Processor -- start 2024-09-21T06:00:37.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.300+0000 7f8e80d46740 1 -- start start 2024-09-21T06:00:37.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.300+0000 7f8e80d46740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cd7a1b0 0x55a27d1578a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.300+0000 7f8e80d46740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd82390 0x55a27d152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.300+0000 7f8e80d46740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cda3070 0x55a27d152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.300+0000 7f8e80d46740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8e741b40f0 con 0x55a27cda3070 2024-09-21T06:00:37.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.300+0000 7f8e80d46740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8e741b19c0 con 0x55a27cd82390 2024-09-21T06:00:37.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.300+0000 7f8e80d46740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8e741af830 con 0x55a27cd7a1b0 2024-09-21T06:00:37.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.300+0000 7f8e78d6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cda3070 0x55a27d152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.300+0000 7f8e78d6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cda3070 0x55a27d152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39902/0 (socket says 172.21.15.7:39902) 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.300+0000 7f8e78d6f640 1 -- 172.21.15.7:0/580060511 learned_addr learned my addr 172.21.15.7:0/580060511 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.301+0000 7f8e737fe640 1 --2- 172.21.15.7:0/580060511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd82390 0x55a27d152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.301+0000 7f8e73fff640 1 --2- 172.21.15.7:0/580060511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cd7a1b0 0x55a27d1578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.301+0000 7f8e78d6f640 1 -- 172.21.15.7:0/580060511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cd7a1b0 msgr2=0x55a27d1578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.301+0000 7f8e78d6f640 1 --2- 172.21.15.7:0/580060511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cd7a1b0 0x55a27d1578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.301+0000 7f8e78d6f640 1 -- 172.21.15.7:0/580060511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd82390 msgr2=0x55a27d152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.301+0000 7f8e78d6f640 1 --2- 172.21.15.7:0/580060511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd82390 0x55a27d152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.301+0000 7f8e78d6f640 1 -- 172.21.15.7:0/580060511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a27d1503e0 con 0x55a27cda3070 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.301+0000 7f8e73fff640 1 --2- 172.21.15.7:0/580060511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cd7a1b0 0x55a27d1578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.301+0000 7f8e737fe640 1 --2- 172.21.15.7:0/580060511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd82390 0x55a27d152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.301+0000 7f8e78d6f640 1 --2- 172.21.15.7:0/580060511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cda3070 0x55a27d152fe0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c01e770 tx=0x7f8e6c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc2d496e11e2ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.301+0000 7f8e59ffb640 1 -- 172.21.15.7:0/580060511 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c011580 con 0x55a27cda3070 2024-09-21T06:00:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.301+0000 7f8e59ffb640 1 -- 172.21.15.7:0/580060511 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e6c011bd0 con 0x55a27cda3070 2024-09-21T06:00:37.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.301+0000 7f8e59ffb640 1 -- 172.21.15.7:0/580060511 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c01cd60 con 0x55a27cda3070 2024-09-21T06:00:37.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.302+0000 7f8e80d46740 1 -- 172.21.15.7:0/580060511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cda3070 msgr2=0x55a27d152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:37.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.302+0000 7f8e80d46740 1 --2- 172.21.15.7:0/580060511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cda3070 0x55a27d152fe0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c01e770 tx=0x7f8e6c019000 comp rx=0 tx=0).stop 2024-09-21T06:00:37.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.302+0000 7f8e80d46740 1 -- 172.21.15.7:0/580060511 shutdown_connections 2024-09-21T06:00:37.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.302+0000 7f8e80d46740 1 --2- 172.21.15.7:0/580060511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cda3070 0x55a27d152fe0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.302+0000 7f8e80d46740 1 --2- 172.21.15.7:0/580060511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd82390 0x55a27d152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.302+0000 7f8e80d46740 1 --2- 172.21.15.7:0/580060511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cd7a1b0 0x55a27d1578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.302+0000 7f8e80d46740 1 -- 172.21.15.7:0/580060511 >> 172.21.15.7:0/580060511 conn(0x55a27cd97460 msgr2=0x55a27d14bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.302+0000 7f8e80d46740 1 -- 172.21.15.7:0/580060511 shutdown_connections 2024-09-21T06:00:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.302+0000 7f8e80d46740 1 -- 172.21.15.7:0/580060511 wait complete. 2024-09-21T06:00:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.302+0000 7f8e80d46740 1 -- start start 2024-09-21T06:00:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.303+0000 7f8e80d46740 1 Processor -- start 2024-09-21T06:00:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.303+0000 7f8e80d46740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd7a1b0 0x55a27d15a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.303+0000 7f8e80d46740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd82390 0x55a27d15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.303+0000 7f8e80d46740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cda3070 0x55a27d1d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.303+0000 7f8e80d46740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8e741afe80 con 0x55a27cd7a1b0 2024-09-21T06:00:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.303+0000 7f8e80d46740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8e741b12f0 con 0x55a27cd82390 2024-09-21T06:00:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.303+0000 7f8e80d46740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8e741b0550 con 0x55a27cda3070 2024-09-21T06:00:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.303+0000 7f8e80d46740 10 client.0 _ll_register_callbacks cb 0x7f8e68005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.303+0000 7f8e73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd7a1b0 0x55a27d15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.303+0000 7f8e73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd7a1b0 0x55a27d15a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39908/0 (socket says 172.21.15.7:39908) 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.303+0000 7f8e73fff640 1 -- 172.21.15.7:0/532555631 learned_addr learned my addr 172.21.15.7:0/532555631 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.303+0000 7f8e78d6f640 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cda3070 0x55a27d1d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.303+0000 7f8e737fe640 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd82390 0x55a27d15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e73fff640 1 -- 172.21.15.7:0/532555631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cda3070 msgr2=0x55a27d1d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e73fff640 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cda3070 0x55a27d1d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e73fff640 1 -- 172.21.15.7:0/532555631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd82390 msgr2=0x55a27d15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e73fff640 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd82390 0x55a27d15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e73fff640 1 -- 172.21.15.7:0/532555631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a27d1d1a90 con 0x55a27cd7a1b0 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e737fe640 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd82390 0x55a27d15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e73fff640 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd7a1b0 0x55a27d15a160 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009d60 tx=0x7f8e64009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91272a0bffd8abe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e537fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e537fe640 1 -- 172.21.15.7:0/532555631 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64004630 con 0x55a27cd7a1b0 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e537fe640 1 -- 172.21.15.7:0/532555631 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f8e6400f9a0 con 0x55a27cd7a1b0 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e80d46740 1 -- 172.21.15.7:0/532555631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e6c011bd0 con 0x55a27cd7a1b0 2024-09-21T06:00:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e537fe640 1 -- 172.21.15.7:0/532555631 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8e6400fba0 con 0x55a27cd7a1b0 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e80d46740 10 client.17298 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e80d46740 1 -- 172.21.15.7:0/532555631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a27d1d2be0 con 0x55a27cd7a1b0 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.304+0000 7f8e537fe640 1 -- 172.21.15.7:0/532555631 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e6c011bd0 con 0x55a27cd7a1b0 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.305+0000 7f8e537fe640 1 -- 172.21.15.7:0/532555631 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8e64019450 con 0x55a27cd7a1b0 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.305+0000 7f8e80d46740 10 client.17298 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.305+0000 7f8e80d46740 10 client.17298 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.305+0000 7f8e80d46740 20 client.17298 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.305+0000 7f8e80d46740 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a27cd36da0 0x55a27d1d5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.305+0000 7f8e80d46740 4 client.17298 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.305+0000 7f8e80d46740 1 -- 172.21.15.7:0/532555631 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a27d0be8a0 con 0x55a27cd36da0 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.305+0000 7f8e737fe640 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a27cd36da0 0x55a27d1d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.305+0000 7f8e537fe640 10 client.17298 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.305+0000 7f8e737fe640 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a27cd36da0 0x55a27d1d5240 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e37787276ab9c1bb server_cookie=62f57fce3b5f094c in_seq=0 out_seq=0 2024-09-21T06:00:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e537fe640 1 -- 172.21.15.7:0/532555631 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a27d0be8a0 con 0x55a27cd36da0 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e537fe640 10 client.17298 handle_command_reply: tid=0 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e80d46740 1 client.17298 shutdown 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e80d46740 1 -- 172.21.15.7:0/532555631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd7a1b0 msgr2=0x55a27d15a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e80d46740 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd7a1b0 0x55a27d15a160 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009d60 tx=0x7f8e64009ef0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e80d46740 1 -- 172.21.15.7:0/532555631 shutdown_connections 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e80d46740 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55a27cd36da0 0x55a27d1d5240 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e537fe640 0 client.17298 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e80d46740 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a27cda3070 0x55a27d1d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e80d46740 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55a27cd82390 0x55a27d15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e80d46740 1 --2- 172.21.15.7:0/532555631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a27cd7a1b0 0x55a27d15a160 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e80d46740 1 -- 172.21.15.7:0/532555631 >> 172.21.15.7:0/532555631 conn(0x55a27cd97460 msgr2=0x55a27d14bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e80d46740 1 -- 172.21.15.7:0/532555631 shutdown_connections 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e80d46740 1 -- 172.21.15.7:0/532555631 wait complete. 2024-09-21T06:00:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.306+0000 7f8e80d46740 20 client.17298 trim_cache size 0 max 16384 2024-09-21T06:00:37.314 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.307+0000 7f8e7a7d2640 1 -- 172.21.15.7:0/2264149426 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8e5c0b6680 msgr2=0x7f8e5c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.307+0000 7f8e7a7d2640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8e5c0b6680 0x7f8e5c0b8b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c005fd0 tx=0x7f8e6c009500 comp rx=0 tx=0).stop 2024-09-21T06:00:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.307+0000 7f8e7a7d2640 1 -- 172.21.15.7:0/2264149426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e741094a0 msgr2=0x7f8e7419aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.307+0000 7f8e7a7d2640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e741094a0 0x7f8e7419aa20 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f8e6802a930 tx=0x7f8e68031a20 comp rx=0 tx=0).stop 2024-09-21T06:00:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.307+0000 7f8e7a7d2640 1 -- 172.21.15.7:0/2264149426 shutdown_connections 2024-09-21T06:00:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.307+0000 7f8e7a7d2640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8e5c0b6680 0x7f8e5c0b8b90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.307+0000 7f8e7a7d2640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e741094a0 0x7f8e7419aa20 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.307+0000 7f8e7a7d2640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e74109df0 0x7f8e7419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.307+0000 7f8e7a7d2640 1 --2- 172.21.15.7:0/2264149426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e74103b60 0x7f8e7419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.307+0000 7f8e7a7d2640 1 -- 172.21.15.7:0/2264149426 >> 172.21.15.7:0/2264149426 conn(0x7f8e7407b850 msgr2=0x7f8e74107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.307+0000 7f8e7a7d2640 1 -- 172.21.15.7:0/2264149426 shutdown_connections 2024-09-21T06:00:37.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:37.307+0000 7f8e7a7d2640 1 -- 172.21.15.7:0/2264149426 wait complete. 2024-09-21T06:00:37.995 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:00:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:38.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:38 smithi007 ceph-mon[30983]: pgmap v522: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:00:38.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:38 smithi119 ceph-mon[34833]: pgmap v522: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:00:38.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:38 smithi027 ceph-mon[34364]: pgmap v522: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:00:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.733+0000 7f06fa0c0640 1 -- 172.21.15.7:0/221439159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06f4104880 msgr2=0x7f06f4104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.733+0000 7f06fa0c0640 1 --2- 172.21.15.7:0/221439159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06f4104880 0x7f06f4104c90 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009900 tx=0x7f06e402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.733+0000 7f06fa0c0640 1 -- 172.21.15.7:0/221439159 shutdown_connections 2024-09-21T06:00:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.733+0000 7f06fa0c0640 1 --2- 172.21.15.7:0/221439159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06f410de30 0x7f06f4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.733+0000 7f06fa0c0640 1 --2- 172.21.15.7:0/221439159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06f41052b0 0x7f06f410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.733+0000 7f06fa0c0640 1 --2- 172.21.15.7:0/221439159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06f4104880 0x7f06f4104c90 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.733+0000 7f06fa0c0640 1 -- 172.21.15.7:0/221439159 >> 172.21.15.7:0/221439159 conn(0x7f06f4079730 msgr2=0x7f06f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.733+0000 7f06fa0c0640 1 -- 172.21.15.7:0/221439159 shutdown_connections 2024-09-21T06:00:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.733+0000 7f06fa0c0640 1 -- 172.21.15.7:0/221439159 wait complete. 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.734+0000 7f06fa0c0640 1 Processor -- start 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.734+0000 7f06fa0c0640 1 -- start start 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06fa0c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06f4104880 0x7f06f419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06fa0c0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06f41052b0 0x7f06f419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06fa0c0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06f410de30 0x7f06f419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06fa0c0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4113a70 con 0x7f06f4104880 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06fa0c0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f06f41138f0 con 0x7f06f41052b0 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06fa0c0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4113bf0 con 0x7f06f410de30 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06f37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06f4104880 0x7f06f419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06f37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06f4104880 0x7f06f419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50632/0 (socket says 172.21.15.7:50632) 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06f37fe640 1 -- 172.21.15.7:0/3278646978 learned_addr learned my addr 172.21.15.7:0/3278646978 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06eaffd640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06f41052b0 0x7f06f419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06f3fff640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06f410de30 0x7f06f419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06f37fe640 1 -- 172.21.15.7:0/3278646978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06f410de30 msgr2=0x7f06f419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06f37fe640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06f410de30 0x7f06f419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06f37fe640 1 -- 172.21.15.7:0/3278646978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06f41052b0 msgr2=0x7f06f419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06f37fe640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06f41052b0 0x7f06f419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06f37fe640 1 -- 172.21.15.7:0/3278646978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f41a0350 con 0x7f06f4104880 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06f3fff640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06f410de30 0x7f06f419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06eaffd640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06f41052b0 0x7f06f419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.735+0000 7f06f37fe640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06f4104880 0x7f06f419a4a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f06e4032fd0 tx=0x7f06e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.736+0000 7f06f17fa640 1 -- 172.21.15.7:0/3278646978 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e403f030 con 0x7f06f4104880 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.736+0000 7f06fa0c0640 1 -- 172.21.15.7:0/3278646978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f41a05e0 con 0x7f06f4104880 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.736+0000 7f06f17fa640 1 -- 172.21.15.7:0/3278646978 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e4004490 con 0x7f06f4104880 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.736+0000 7f06f17fa640 1 -- 172.21.15.7:0/3278646978 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4035070 con 0x7f06f4104880 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.736+0000 7f06fa0c0640 1 -- 172.21.15.7:0/3278646978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f41a0b10 con 0x7f06f4104880 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.738+0000 7f0700634740 1 Processor -- start 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.738+0000 7f0700634740 1 -- start start 2024-09-21T06:00:38.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.738+0000 7f06f17fa640 1 -- 172.21.15.7:0/3278646978 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f06e4042030 con 0x7f06f4104880 2024-09-21T06:00:38.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f0700634740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 0x5631585476a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f0700634740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631581771b0 0x563158547be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f0700634740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56315817f390 0x563158548120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f0700634740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5631584bdea0 con 0x5631581a0070 2024-09-21T06:00:38.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f0700634740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5631584ad2d0 con 0x56315817f390 2024-09-21T06:00:38.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f0700634740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5631584b10e0 con 0x5631581771b0 2024-09-21T06:00:38.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f06f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 0x5631585476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f06f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 0x5631585476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50642/0 (socket says 172.21.15.7:50642) 2024-09-21T06:00:38.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f06f3fff640 1 -- 172.21.15.7:0/3509037414 learned_addr learned my addr 172.21.15.7:0/3509037414 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:38.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f06f37fe640 1 --2- 172.21.15.7:0/3509037414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631581771b0 0x563158547be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f06eaffd640 1 --2- 172.21.15.7:0/3509037414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56315817f390 0x563158548120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f06f3fff640 1 -- 172.21.15.7:0/3509037414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631581771b0 msgr2=0x563158547be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:38.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f06f3fff640 1 --2- 172.21.15.7:0/3509037414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631581771b0 0x563158547be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f06f3fff640 1 -- 172.21.15.7:0/3509037414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56315817f390 msgr2=0x563158548120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f06f3fff640 1 --2- 172.21.15.7:0/3509037414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56315817f390 0x563158548120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f06f3fff640 1 -- 172.21.15.7:0/3509037414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56315820b650 con 0x5631581a0070 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f06eaffd640 1 --2- 172.21.15.7:0/3509037414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56315817f390 0x563158548120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.739+0000 7f06f3fff640 1 --2- 172.21.15.7:0/3509037414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 0x5631585476a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f06ec008e60 tx=0x7f06ec00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7563dbad8849094f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.740+0000 7f06f17fa640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f06e00b66b0 0x7f06e00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.740+0000 7f06e9ffb640 1 -- 172.21.15.7:0/3509037414 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec012bd0 con 0x5631581a0070 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.740+0000 7f06e9ffb640 1 -- 172.21.15.7:0/3509037414 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06ec012d70 con 0x5631581a0070 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.740+0000 7f06e9ffb640 1 -- 172.21.15.7:0/3509037414 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec019600 con 0x5631581a0070 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.740+0000 7f06f37fe640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f06e00b66b0 0x7f06e00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.740+0000 7f06f17fa640 1 -- 172.21.15.7:0/3278646978 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f06e4107c50 con 0x7f06f4104880 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.741+0000 7f0700634740 1 -- 172.21.15.7:0/3509037414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 msgr2=0x5631585476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.741+0000 7f06f37fe640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f06e00b66b0 0x7f06e00b8bc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f06e41054a0 tx=0x7f06e40f1040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:38.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.741+0000 7f0700634740 1 --2- 172.21.15.7:0/3509037414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 0x5631585476a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f06ec008e60 tx=0x7f06ec00d710 comp rx=0 tx=0).stop 2024-09-21T06:00:38.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.741+0000 7f0700634740 1 -- 172.21.15.7:0/3509037414 shutdown_connections 2024-09-21T06:00:38.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.741+0000 7f0700634740 1 --2- 172.21.15.7:0/3509037414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56315817f390 0x563158548120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.741+0000 7f0700634740 1 --2- 172.21.15.7:0/3509037414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631581771b0 0x563158547be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.741+0000 7f0700634740 1 --2- 172.21.15.7:0/3509037414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 0x5631585476a0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.741+0000 7f0700634740 1 -- 172.21.15.7:0/3509037414 >> 172.21.15.7:0/3509037414 conn(0x563158194460 msgr2=0x563158545590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:38.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.741+0000 7f0700634740 1 -- 172.21.15.7:0/3509037414 shutdown_connections 2024-09-21T06:00:38.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.741+0000 7f0700634740 1 -- 172.21.15.7:0/3509037414 wait complete. 2024-09-21T06:00:38.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.741+0000 7f0700634740 1 -- start start 2024-09-21T06:00:38.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f0700634740 1 Processor -- start 2024-09-21T06:00:38.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f0700634740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581771b0 0x563158552d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f0700634740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56315817f390 0x563158553280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f0700634740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631581a0070 0x563158553800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f0700634740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56315830e700 con 0x56315817f390 2024-09-21T06:00:38.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f0700634740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x563158448160 con 0x5631581771b0 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f0700634740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x563158555e80 con 0x5631581a0070 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f0700634740 10 client.0 _ll_register_callbacks cb 0x5631584619e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f06eaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56315817f390 0x563158553280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f06eaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56315817f390 0x563158553280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50652/0 (socket says 172.21.15.7:50652) 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f06eaffd640 1 -- 172.21.15.7:0/3147816686 learned_addr learned my addr 172.21.15.7:0/3147816686 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f06f3fff640 1 --2- 172.21.15.7:0/3147816686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631581a0070 0x563158553800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f06f3fff640 1 --2- 172.21.15.7:0/3147816686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581771b0 0x563158552d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f06eaffd640 1 -- 172.21.15.7:0/3147816686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631581a0070 msgr2=0x563158553800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f06eaffd640 1 --2- 172.21.15.7:0/3147816686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631581a0070 0x563158553800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f06eaffd640 1 -- 172.21.15.7:0/3147816686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581771b0 msgr2=0x563158552d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f06eaffd640 1 --2- 172.21.15.7:0/3147816686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581771b0 0x563158552d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.742+0000 7f06eaffd640 1 -- 172.21.15.7:0/3147816686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563158475c90 con 0x56315817f390 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.743+0000 7f06eaffd640 1 --2- 172.21.15.7:0/3147816686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56315817f390 0x563158553280 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00de80 tx=0x7f06dc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99c15dd86527cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.743+0000 7f06d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.743+0000 7f06d2ffd640 1 -- 172.21.15.7:0/3147816686 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc004220 con 0x56315817f390 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.743+0000 7f06d2ffd640 1 -- 172.21.15.7:0/3147816686 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f06dc0043c0 con 0x56315817f390 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.743+0000 7f0700634740 1 -- 172.21.15.7:0/3147816686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06ec012d70 con 0x56315817f390 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.743+0000 7f06d2ffd640 1 -- 172.21.15.7:0/3147816686 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f06dc011650 con 0x56315817f390 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.743+0000 7f0700634740 10 client.17310 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.743+0000 7f0700634740 1 -- 172.21.15.7:0/3147816686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563158561c00 con 0x56315817f390 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.743+0000 7f06d2ffd640 1 -- 172.21.15.7:0/3147816686 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06ec012d70 con 0x56315817f390 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.744+0000 7f06d2ffd640 1 -- 172.21.15.7:0/3147816686 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f06dc003a60 con 0x56315817f390 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.744+0000 7f0700634740 10 client.17310 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.744+0000 7f0700634740 10 client.17310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.744+0000 7f0700634740 20 client.17310 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.744+0000 7f0700634740 1 --2- 172.21.15.7:0/3147816686 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56315815e9f0 0x5631585650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.744+0000 7f0700634740 4 client.17310 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.744+0000 7f0700634740 1 -- 172.21.15.7:0/3147816686 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631584bfdf0 con 0x56315815e9f0 2024-09-21T06:00:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.744+0000 7f06f3fff640 1 --2- 172.21.15.7:0/3147816686 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56315815e9f0 0x5631585650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.744+0000 7f06f3fff640 1 --2- 172.21.15.7:0/3147816686 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56315815e9f0 0x5631585650c0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cc2d03a40dfe8a1 server_cookie=4404195d422b383f in_seq=0 out_seq=0 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.744+0000 7f06d2ffd640 10 client.17310 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.745+0000 7f06d2ffd640 1 -- 172.21.15.7:0/3147816686 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5631584bfdf0 con 0x56315815e9f0 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.745+0000 7f06d2ffd640 10 client.17310 handle_command_reply: tid=0 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.745+0000 7f0700634740 1 client.17310 shutdown 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.745+0000 7f0700634740 1 -- 172.21.15.7:0/3147816686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56315817f390 msgr2=0x563158553280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.745+0000 7f0700634740 1 --2- 172.21.15.7:0/3147816686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56315817f390 0x563158553280 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00de80 tx=0x7f06dc00f730 comp rx=0 tx=0).stop 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.746+0000 7f0700634740 1 -- 172.21.15.7:0/3147816686 shutdown_connections 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.746+0000 7f0700634740 1 --2- 172.21.15.7:0/3147816686 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56315815e9f0 0x5631585650c0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.746+0000 7f06d2ffd640 0 client.17310 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.746+0000 7f0700634740 1 --2- 172.21.15.7:0/3147816686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56315817f390 0x563158553280 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.746+0000 7f0700634740 1 --2- 172.21.15.7:0/3147816686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631581a0070 0x563158553800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.746+0000 7f0700634740 1 --2- 172.21.15.7:0/3147816686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581771b0 0x563158552d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.746+0000 7f0700634740 1 -- 172.21.15.7:0/3147816686 >> 172.21.15.7:0/3147816686 conn(0x563158194460 msgr2=0x56315854a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:38.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.746+0000 7f0700634740 1 -- 172.21.15.7:0/3147816686 shutdown_connections 2024-09-21T06:00:38.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.746+0000 7f0700634740 1 -- 172.21.15.7:0/3147816686 wait complete. 2024-09-21T06:00:38.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.746+0000 7f0700634740 20 client.17310 trim_cache size 0 max 16384 2024-09-21T06:00:38.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.759+0000 7f0700634740 1 Processor -- start 2024-09-21T06:00:38.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.759+0000 7f0700634740 1 -- start start 2024-09-21T06:00:38.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.759+0000 7f0700634740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581771b0 0x5631585491d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.759+0000 7f0700634740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56315817f390 0x563158554c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.759+0000 7f0700634740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 0x56315855e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.759+0000 7f0700634740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06f41afc40 con 0x5631581a0070 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.759+0000 7f0700634740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f06f41ad510 con 0x5631581771b0 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.759+0000 7f0700634740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f06f41ab380 con 0x56315817f390 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.759+0000 7f06f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 0x56315855e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.759+0000 7f06f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 0x56315855e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50660/0 (socket says 172.21.15.7:50660) 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.759+0000 7f06f3fff640 1 -- 172.21.15.7:0/3607511651 learned_addr learned my addr 172.21.15.7:0/3607511651 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.760+0000 7f06f3fff640 1 --2- 172.21.15.7:0/3607511651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581771b0 0x5631585491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.760+0000 7f06eaffd640 1 --2- 172.21.15.7:0/3607511651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56315817f390 0x563158554c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.760+0000 7f06f3fff640 1 -- 172.21.15.7:0/3607511651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56315817f390 msgr2=0x563158554c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.760+0000 7f06f3fff640 1 --2- 172.21.15.7:0/3607511651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56315817f390 0x563158554c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.760+0000 7f06f3fff640 1 -- 172.21.15.7:0/3607511651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581771b0 msgr2=0x5631585491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.760+0000 7f06f3fff640 1 --2- 172.21.15.7:0/3607511651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581771b0 0x5631585491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.760+0000 7f06f3fff640 1 -- 172.21.15.7:0/3607511651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563158553de0 con 0x5631581a0070 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.760+0000 7f06f3fff640 1 --2- 172.21.15.7:0/3607511651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 0x56315855e7a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f06ec01ad50 tx=0x7f06ec00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c645ed8f98ca75d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.760+0000 7f06e97fa640 1 -- 172.21.15.7:0/3607511651 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec036070 con 0x5631581a0070 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.760+0000 7f06e97fa640 1 -- 172.21.15.7:0/3607511651 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06ec008580 con 0x5631581a0070 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.760+0000 7f06e97fa640 1 -- 172.21.15.7:0/3607511651 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec01a850 con 0x5631581a0070 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.761+0000 7f0700634740 1 -- 172.21.15.7:0/3607511651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 msgr2=0x56315855e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.761+0000 7f0700634740 1 --2- 172.21.15.7:0/3607511651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 0x56315855e7a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f06ec01ad50 tx=0x7f06ec00d710 comp rx=0 tx=0).stop 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.761+0000 7f0700634740 1 -- 172.21.15.7:0/3607511651 shutdown_connections 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.761+0000 7f0700634740 1 --2- 172.21.15.7:0/3607511651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581a0070 0x56315855e7a0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.761+0000 7f0700634740 1 --2- 172.21.15.7:0/3607511651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56315817f390 0x563158554c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.761+0000 7f0700634740 1 --2- 172.21.15.7:0/3607511651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581771b0 0x5631585491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.761+0000 7f0700634740 1 -- 172.21.15.7:0/3607511651 >> 172.21.15.7:0/3607511651 conn(0x563158194460 msgr2=0x56315855e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.761+0000 7f0700634740 1 -- 172.21.15.7:0/3607511651 shutdown_connections 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.761+0000 7f0700634740 1 -- 172.21.15.7:0/3607511651 wait complete. 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.761+0000 7f0700634740 1 -- start start 2024-09-21T06:00:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f0700634740 1 Processor -- start 2024-09-21T06:00:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f0700634740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581771b0 0x563158557130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f0700634740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56315817f390 0x563158557670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f0700634740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581a0070 0x563158557bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f0700634740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06f41ab9d0 con 0x5631581771b0 2024-09-21T06:00:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f0700634740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f06f41ace40 con 0x5631581a0070 2024-09-21T06:00:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f0700634740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f06f41ac0a0 con 0x56315817f390 2024-09-21T06:00:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f0700634740 10 client.0 _ll_register_callbacks cb 0x7f06dc00d3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f06f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581771b0 0x563158557130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f06f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581771b0 0x563158557130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50674/0 (socket says 172.21.15.7:50674) 2024-09-21T06:00:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f06f3fff640 1 -- 172.21.15.7:0/186732311 learned_addr learned my addr 172.21.15.7:0/186732311 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f06f3fff640 1 --2- 172.21.15.7:0/186732311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581a0070 0x563158557bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f06eaffd640 1 --2- 172.21.15.7:0/186732311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56315817f390 0x563158557670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f06f3fff640 1 -- 172.21.15.7:0/186732311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56315817f390 msgr2=0x563158557670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f06f3fff640 1 --2- 172.21.15.7:0/186732311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56315817f390 0x563158557670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f06f3fff640 1 -- 172.21.15.7:0/186732311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581a0070 msgr2=0x563158557bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f06f3fff640 1 --2- 172.21.15.7:0/186732311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581a0070 0x563158557bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.762+0000 7f06f3fff640 1 -- 172.21.15.7:0/186732311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631585cead0 con 0x5631581771b0 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.763+0000 7f06f3fff640 1 --2- 172.21.15.7:0/186732311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581771b0 0x563158557130 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0089d0 tx=0x7f06ec008230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb3dac688f497dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.763+0000 7f06d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.763+0000 7f06d2ffd640 1 -- 172.21.15.7:0/186732311 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec036070 con 0x5631581771b0 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.763+0000 7f06d2ffd640 1 -- 172.21.15.7:0/186732311 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f06ec01a3f0 con 0x5631581771b0 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.763+0000 7f0700634740 1 -- 172.21.15.7:0/186732311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06ec008580 con 0x5631581771b0 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.763+0000 7f06d2ffd640 1 -- 172.21.15.7:0/186732311 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f06ec004e10 con 0x5631581771b0 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.763+0000 7f0700634740 10 client.17316 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.763+0000 7f0700634740 1 -- 172.21.15.7:0/186732311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5631585cfd50 con 0x5631581771b0 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.763+0000 7f06d2ffd640 1 -- 172.21.15.7:0/186732311 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06ec008580 con 0x5631581771b0 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.764+0000 7f06d2ffd640 1 -- 172.21.15.7:0/186732311 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f06ec026040 con 0x5631581771b0 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.764+0000 7f0700634740 10 client.17316 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.764+0000 7f0700634740 10 client.17316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:38.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.764+0000 7f0700634740 20 client.17316 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.764+0000 7f0700634740 1 --2- 172.21.15.7:0/186732311 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563158133da0 0x5631585d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.764+0000 7f0700634740 4 client.17316 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.764+0000 7f0700634740 1 -- 172.21.15.7:0/186732311 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631584bb8a0 con 0x563158133da0 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.764+0000 7f06eaffd640 1 --2- 172.21.15.7:0/186732311 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563158133da0 0x5631585d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.764+0000 7f06d2ffd640 10 client.17316 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.764+0000 7f06eaffd640 1 --2- 172.21.15.7:0/186732311 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563158133da0 0x5631585d2170 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9657417e1bbece2d server_cookie=9ed3023ee32751ab in_seq=0 out_seq=0 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f06d2ffd640 1 -- 172.21.15.7:0/186732311 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631584bb8a0 con 0x563158133da0 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f06d2ffd640 10 client.17316 handle_command_reply: tid=0 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f0700634740 1 client.17316 shutdown 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f0700634740 1 -- 172.21.15.7:0/186732311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581771b0 msgr2=0x563158557130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f0700634740 1 --2- 172.21.15.7:0/186732311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581771b0 0x563158557130 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0089d0 tx=0x7f06ec008230 comp rx=0 tx=0).stop 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f0700634740 1 -- 172.21.15.7:0/186732311 shutdown_connections 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f0700634740 1 --2- 172.21.15.7:0/186732311 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x563158133da0 0x5631585d2170 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f0700634740 1 --2- 172.21.15.7:0/186732311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631581a0070 0x563158557bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f0700634740 1 --2- 172.21.15.7:0/186732311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56315817f390 0x563158557670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f06d2ffd640 0 client.17316 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:38.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f0700634740 1 --2- 172.21.15.7:0/186732311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631581771b0 0x563158557130 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f0700634740 1 -- 172.21.15.7:0/186732311 >> 172.21.15.7:0/186732311 conn(0x563158194460 msgr2=0x563158554980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:38.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f0700634740 1 -- 172.21.15.7:0/186732311 shutdown_connections 2024-09-21T06:00:38.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f0700634740 1 -- 172.21.15.7:0/186732311 wait complete. 2024-09-21T06:00:38.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.765+0000 7f0700634740 20 client.17316 trim_cache size 0 max 16384 2024-09-21T06:00:38.772 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:38.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.766+0000 7f06fa0c0640 1 -- 172.21.15.7:0/3278646978 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f06e00b66b0 msgr2=0x7f06e00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:38.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.766+0000 7f06fa0c0640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f06e00b66b0 0x7f06e00b8bc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f06e41054a0 tx=0x7f06e40f1040 comp rx=0 tx=0).stop 2024-09-21T06:00:38.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.766+0000 7f06fa0c0640 1 -- 172.21.15.7:0/3278646978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06f4104880 msgr2=0x7f06f419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:38.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.766+0000 7f06fa0c0640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06f4104880 0x7f06f419a4a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f06e4032fd0 tx=0x7f06e4004270 comp rx=0 tx=0).stop 2024-09-21T06:00:38.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.766+0000 7f06fa0c0640 1 -- 172.21.15.7:0/3278646978 shutdown_connections 2024-09-21T06:00:38.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.766+0000 7f06fa0c0640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f06e00b66b0 0x7f06e00b8bc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.766+0000 7f06fa0c0640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06f410de30 0x7f06f419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.766+0000 7f06fa0c0640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06f41052b0 0x7f06f419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.766+0000 7f06fa0c0640 1 --2- 172.21.15.7:0/3278646978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06f4104880 0x7f06f419a4a0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:38.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.766+0000 7f06fa0c0640 1 -- 172.21.15.7:0/3278646978 >> 172.21.15.7:0/3278646978 conn(0x7f06f4079730 msgr2=0x7f06f4100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:38.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.766+0000 7f06fa0c0640 1 -- 172.21.15.7:0/3278646978 shutdown_connections 2024-09-21T06:00:38.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:38.766+0000 7f06fa0c0640 1 -- 172.21.15.7:0/3278646978 wait complete. 2024-09-21T06:00:40.441 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:00:40.441 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:00:40.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:40 smithi007 ceph-mon[30983]: pgmap v523: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:00:40.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:40 smithi119 ceph-mon[34833]: pgmap v523: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:00:40.713 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:40.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:40 smithi027 ceph-mon[34364]: pgmap v523: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:00:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.215+0000 7f905db16640 1 -- 172.21.15.7:0/358977511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90581094c0 msgr2=0x7f90581098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.215+0000 7f905db16640 1 --2- 172.21.15.7:0/358977511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90581094c0 0x7f90581098d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f904c009900 tx=0x7f904c02a410 comp rx=0 tx=0).stop 2024-09-21T06:00:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.215+0000 7f905db16640 1 -- 172.21.15.7:0/358977511 shutdown_connections 2024-09-21T06:00:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.215+0000 7f905db16640 1 --2- 172.21.15.7:0/358977511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90581094c0 0x7f90581098d0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.215+0000 7f905db16640 1 --2- 172.21.15.7:0/358977511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9058109e10 0x7f90581106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.215+0000 7f905db16640 1 --2- 172.21.15.7:0/358977511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9058102010 0x7f9058102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.215+0000 7f905db16640 1 -- 172.21.15.7:0/358977511 >> 172.21.15.7:0/358977511 conn(0x7f9058077c60 msgr2=0x7f90580780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.215+0000 7f905db16640 1 -- 172.21.15.7:0/358977511 shutdown_connections 2024-09-21T06:00:41.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.215+0000 7f905db16640 1 -- 172.21.15.7:0/358977511 wait complete. 2024-09-21T06:00:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.216+0000 7f905db16640 1 Processor -- start 2024-09-21T06:00:41.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.216+0000 7f905db16640 1 -- start start 2024-09-21T06:00:41.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.216+0000 7f905db16640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9058102010 0x7f905819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.216+0000 7f905db16640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90581094c0 0x7f905819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.216+0000 7f905db16640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9058109e10 0x7f905819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.216+0000 7f905db16640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9058113ac0 con 0x7f9058109e10 2024-09-21T06:00:41.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.216+0000 7f905db16640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9058113940 con 0x7f9058102010 2024-09-21T06:00:41.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.217+0000 7f905db16640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9058113c40 con 0x7f90581094c0 2024-09-21T06:00:41.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.217+0000 7f9057fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9058109e10 0x7f905819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.217+0000 7f9057fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9058109e10 0x7f905819fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50686/0 (socket says 172.21.15.7:50686) 2024-09-21T06:00:41.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.217+0000 7f9057fff640 1 -- 172.21.15.7:0/2501239504 learned_addr learned my addr 172.21.15.7:0/2501239504 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:41.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.217+0000 7f9056ffd640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90581094c0 0x7f905819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.217+0000 7f90577fe640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9058102010 0x7f905819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.217+0000 7f90577fe640 1 -- 172.21.15.7:0/2501239504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90581094c0 msgr2=0x7f905819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:41.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.217+0000 7f90577fe640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90581094c0 0x7f905819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.217+0000 7f90577fe640 1 -- 172.21.15.7:0/2501239504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9058109e10 msgr2=0x7f905819fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:41.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.217+0000 7f90577fe640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9058109e10 0x7f905819fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.217+0000 7f90577fe640 1 -- 172.21.15.7:0/2501239504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90581a0520 con 0x7f9058102010 2024-09-21T06:00:41.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.217+0000 7f9057fff640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9058109e10 0x7f905819fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:41.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.217+0000 7f90577fe640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9058102010 0x7f905819a5b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f904800d720 tx=0x7f904800dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:41.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.218+0000 7f9054ff9640 1 -- 172.21.15.7:0/2501239504 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048017070 con 0x7f9058102010 2024-09-21T06:00:41.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.218+0000 7f905db16640 1 -- 172.21.15.7:0/2501239504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90581a0810 con 0x7f9058102010 2024-09-21T06:00:41.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.218+0000 7f9054ff9640 1 -- 172.21.15.7:0/2501239504 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f904800de30 con 0x7f9058102010 2024-09-21T06:00:41.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.218+0000 7f9054ff9640 1 -- 172.21.15.7:0/2501239504 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90480047a0 con 0x7f9058102010 2024-09-21T06:00:41.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.218+0000 7f905db16640 1 -- 172.21.15.7:0/2501239504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90581a6f70 con 0x7f9058102010 2024-09-21T06:00:41.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.221+0000 7f906408a740 1 Processor -- start 2024-09-21T06:00:41.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.221+0000 7f906408a740 1 -- start start 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.221+0000 7f9054ff9640 1 -- 172.21.15.7:0/2501239504 <== mon.2 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f90480099d0 con 0x7f9058102010 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.221+0000 7f906408a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c122a350 0x5605c15d1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.221+0000 7f906408a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 0x5605c15d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.221+0000 7f906408a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 0x5605c15d1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.221+0000 7f906408a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5605c1547e60 con 0x5605c1201490 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.221+0000 7f906408a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5605c1537290 con 0x5605c122a350 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.221+0000 7f906408a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5605c153b0a0 con 0x5605c1209670 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.221+0000 7f90577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 0x5605c15d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.221+0000 7f90577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 0x5605c15d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50698/0 (socket says 172.21.15.7:50698) 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.221+0000 7f9057fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c122a350 0x5605c15d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.221+0000 7f90577fe640 1 -- 172.21.15.7:0/2057286706 learned_addr learned my addr 172.21.15.7:0/2057286706 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.222+0000 7f9056ffd640 1 --2- 172.21.15.7:0/2057286706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 0x5605c15d1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.222+0000 7f90577fe640 1 -- 172.21.15.7:0/2057286706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 msgr2=0x5605c15d1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:41.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.222+0000 7f90577fe640 1 --2- 172.21.15.7:0/2057286706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 0x5605c15d1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.222+0000 7f90577fe640 1 -- 172.21.15.7:0/2057286706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c122a350 msgr2=0x5605c15d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:41.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.222+0000 7f90577fe640 1 --2- 172.21.15.7:0/2057286706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c122a350 0x5605c15d1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.222+0000 7f90577fe640 1 -- 172.21.15.7:0/2057286706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c1295930 con 0x5605c1201490 2024-09-21T06:00:41.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.222+0000 7f90577fe640 1 --2- 172.21.15.7:0/2057286706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 0x5605c15d1970 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f90480e4960 tx=0x7f90480ef930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c775512830744aa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:41.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.222+0000 7f9054ff9640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f90400b6680 0x7f90400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.222+0000 7f903dffb640 1 -- 172.21.15.7:0/2057286706 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90480fa070 con 0x5605c1201490 2024-09-21T06:00:41.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.222+0000 7f9057fff640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f90400b6680 0x7f90400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.222+0000 7f903dffb640 1 -- 172.21.15.7:0/2057286706 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9048005020 con 0x5605c1201490 2024-09-21T06:00:41.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.222+0000 7f903dffb640 1 -- 172.21.15.7:0/2057286706 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90480ac860 con 0x5605c1201490 2024-09-21T06:00:41.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.223+0000 7f9054ff9640 1 -- 172.21.15.7:0/2501239504 <== mon.2 v2:172.21.15.27:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f90480e7250 con 0x7f9058102010 2024-09-21T06:00:41.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.223+0000 7f906408a740 1 -- 172.21.15.7:0/2057286706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 msgr2=0x5605c15d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:41.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.223+0000 7f906408a740 1 --2- 172.21.15.7:0/2057286706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 0x5605c15d1970 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f90480e4960 tx=0x7f90480ef930 comp rx=0 tx=0).stop 2024-09-21T06:00:41.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.223+0000 7f9057fff640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f90400b6680 0x7f90400b8b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9050005c40 tx=0x7f9050009760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:41.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.223+0000 7f906408a740 1 -- 172.21.15.7:0/2057286706 shutdown_connections 2024-09-21T06:00:41.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.223+0000 7f906408a740 1 --2- 172.21.15.7:0/2057286706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 0x5605c15d1970 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.223+0000 7f906408a740 1 --2- 172.21.15.7:0/2057286706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 0x5605c15d1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.223+0000 7f906408a740 1 --2- 172.21.15.7:0/2057286706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c122a350 0x5605c15d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.223+0000 7f906408a740 1 -- 172.21.15.7:0/2057286706 >> 172.21.15.7:0/2057286706 conn(0x5605c121e740 msgr2=0x5605c15cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:41.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.223+0000 7f906408a740 1 -- 172.21.15.7:0/2057286706 shutdown_connections 2024-09-21T06:00:41.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.223+0000 7f906408a740 1 -- 172.21.15.7:0/2057286706 wait complete. 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.224+0000 7f906408a740 1 -- start start 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.224+0000 7f906408a740 1 Processor -- start 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.224+0000 7f906408a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c1201490 0x5605c15dd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.224+0000 7f906408a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1209670 0x5605c15dd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.224+0000 7f906408a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c122a350 0x5605c15e8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f906408a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5605c1398890 con 0x5605c1209670 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f906408a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5605c14d1d40 con 0x5605c1201490 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f906408a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5605c15dfc10 con 0x5605c122a350 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f906408a740 10 client.0 _ll_register_callbacks cb 0x5605c1535c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f9056ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1209670 0x5605c15dd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f9056ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1209670 0x5605c15dd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50702/0 (socket says 172.21.15.7:50702) 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f9056ffd640 1 -- 172.21.15.7:0/2293239022 learned_addr learned my addr 172.21.15.7:0/2293239022 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f9057fff640 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c122a350 0x5605c15e8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f90577fe640 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c1201490 0x5605c15dd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f9056ffd640 1 -- 172.21.15.7:0/2293239022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c122a350 msgr2=0x5605c15e8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f9056ffd640 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c122a350 0x5605c15e8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f9056ffd640 1 -- 172.21.15.7:0/2293239022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c1201490 msgr2=0x5605c15dd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f9056ffd640 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c1201490 0x5605c15dd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f9056ffd640 1 -- 172.21.15.7:0/2293239022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c15e9490 con 0x5605c1209670 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f90577fe640 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c1201490 0x5605c15dd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f9056ffd640 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1209670 0x5605c15dd550 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f904c009900 tx=0x7f904c0314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8068dd02c76b802 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f9036ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.225+0000 7f9036ffd640 1 -- 172.21.15.7:0/2293239022 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c035040 con 0x5605c1209670 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.226+0000 7f9036ffd640 1 -- 172.21.15.7:0/2293239022 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f904c031810 con 0x5605c1209670 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.226+0000 7f906408a740 1 -- 172.21.15.7:0/2293239022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5605c1549db0 con 0x5605c1209670 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.226+0000 7f9036ffd640 1 -- 172.21.15.7:0/2293239022 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f904c004040 con 0x5605c1209670 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.226+0000 7f906408a740 10 client.17328 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.226+0000 7f906408a740 1 -- 172.21.15.7:0/2293239022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5605c15ebdc0 con 0x5605c1209670 2024-09-21T06:00:41.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.226+0000 7f9036ffd640 1 -- 172.21.15.7:0/2293239022 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5605c1549db0 con 0x5605c1209670 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.226+0000 7f9036ffd640 1 -- 172.21.15.7:0/2293239022 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f904c004870 con 0x5605c1209670 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.226+0000 7f906408a740 10 client.17328 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.226+0000 7f906408a740 10 client.17328 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.226+0000 7f906408a740 20 client.17328 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.226+0000 7f906408a740 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605c11e8cd0 0x5605c15ef270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.226+0000 7f906408a740 4 client.17328 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.226+0000 7f906408a740 1 -- 172.21.15.7:0/2293239022 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605c1545860 con 0x5605c11e8cd0 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.227+0000 7f90577fe640 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605c11e8cd0 0x5605c15ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.227+0000 7f9036ffd640 10 client.17328 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.227+0000 7f90577fe640 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605c11e8cd0 0x5605c15ef270 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2dd3f14cb3e6dac server_cookie=ab1cf8edc9c439dc in_seq=0 out_seq=0 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f9036ffd640 1 -- 172.21.15.7:0/2293239022 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605c1545860 con 0x5605c11e8cd0 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f9036ffd640 10 client.17328 handle_command_reply: tid=0 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f906408a740 1 client.17328 shutdown 2024-09-21T06:00:41.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f906408a740 1 -- 172.21.15.7:0/2293239022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1209670 msgr2=0x5605c15dd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:41.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f906408a740 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1209670 0x5605c15dd550 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f904c009900 tx=0x7f904c0314a0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f906408a740 1 -- 172.21.15.7:0/2293239022 shutdown_connections 2024-09-21T06:00:41.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f906408a740 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605c11e8cd0 0x5605c15ef270 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f906408a740 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1209670 0x5605c15dd550 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f9036ffd640 0 client.17328 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:41.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f906408a740 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c122a350 0x5605c15e8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f906408a740 1 --2- 172.21.15.7:0/2293239022 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c1201490 0x5605c15dd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f906408a740 1 -- 172.21.15.7:0/2293239022 >> 172.21.15.7:0/2293239022 conn(0x5605c121e740 msgr2=0x5605c15d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:41.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f906408a740 1 -- 172.21.15.7:0/2293239022 shutdown_connections 2024-09-21T06:00:41.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f906408a740 1 -- 172.21.15.7:0/2293239022 wait complete. 2024-09-21T06:00:41.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.228+0000 7f906408a740 20 client.17328 trim_cache size 0 max 16384 2024-09-21T06:00:41.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.246+0000 7f906408a740 1 Processor -- start 2024-09-21T06:00:41.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.246+0000 7f906408a740 1 -- start start 2024-09-21T06:00:41.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.246+0000 7f906408a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c11e8cd0 0x5605c15e8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.246+0000 7f906408a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c1201490 0x5605c15dc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.246+0000 7f906408a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 0x5605c15d6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.246+0000 7f906408a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90581b1f30 con 0x5605c11e8cd0 2024-09-21T06:00:41.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.246+0000 7f906408a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f90581af800 con 0x5605c1201490 2024-09-21T06:00:41.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.246+0000 7f906408a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90581ad670 con 0x5605c1209670 2024-09-21T06:00:41.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.246+0000 7f90577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c11e8cd0 0x5605c15e8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.246+0000 7f90577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c11e8cd0 0x5605c15e8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50710/0 (socket says 172.21.15.7:50710) 2024-09-21T06:00:41.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.246+0000 7f90577fe640 1 -- 172.21.15.7:0/1143491392 learned_addr learned my addr 172.21.15.7:0/1143491392 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:41.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.246+0000 7f9056ffd640 1 --2- 172.21.15.7:0/1143491392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c1201490 0x5605c15dc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.246+0000 7f9057fff640 1 --2- 172.21.15.7:0/1143491392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 0x5605c15d6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.247+0000 7f90577fe640 1 -- 172.21.15.7:0/1143491392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 msgr2=0x5605c15d6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:41.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.247+0000 7f90577fe640 1 --2- 172.21.15.7:0/1143491392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 0x5605c15d6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.247+0000 7f90577fe640 1 -- 172.21.15.7:0/1143491392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c1201490 msgr2=0x5605c15dc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:41.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.247+0000 7f90577fe640 1 --2- 172.21.15.7:0/1143491392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c1201490 0x5605c15dc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.247+0000 7f90577fe640 1 -- 172.21.15.7:0/1143491392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c15d3720 con 0x5605c11e8cd0 2024-09-21T06:00:41.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.247+0000 7f9056ffd640 1 --2- 172.21.15.7:0/1143491392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c1201490 0x5605c15dc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:41.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.247+0000 7f90577fe640 1 --2- 172.21.15.7:0/1143491392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c11e8cd0 0x5605c15e8e00 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f90480ad080 tx=0x7f90480057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d046aeb0606f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:41.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.247+0000 7f903d7fa640 1 -- 172.21.15.7:0/1143491392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904800fdb0 con 0x5605c11e8cd0 2024-09-21T06:00:41.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.247+0000 7f903d7fa640 1 -- 172.21.15.7:0/1143491392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90480acc00 con 0x5605c11e8cd0 2024-09-21T06:00:41.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.247+0000 7f903d7fa640 1 -- 172.21.15.7:0/1143491392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904800e350 con 0x5605c11e8cd0 2024-09-21T06:00:41.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.248+0000 7f906408a740 1 -- 172.21.15.7:0/1143491392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c11e8cd0 msgr2=0x5605c15e8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:41.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.248+0000 7f906408a740 1 --2- 172.21.15.7:0/1143491392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c11e8cd0 0x5605c15e8e00 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f90480ad080 tx=0x7f90480057c0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.248+0000 7f906408a740 1 -- 172.21.15.7:0/1143491392 shutdown_connections 2024-09-21T06:00:41.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.248+0000 7f906408a740 1 --2- 172.21.15.7:0/1143491392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 0x5605c15d6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.248+0000 7f906408a740 1 --2- 172.21.15.7:0/1143491392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c1201490 0x5605c15dc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.248+0000 7f906408a740 1 --2- 172.21.15.7:0/1143491392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c11e8cd0 0x5605c15e8e00 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.248+0000 7f906408a740 1 -- 172.21.15.7:0/1143491392 >> 172.21.15.7:0/1143491392 conn(0x5605c121e740 msgr2=0x5605c15d4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:41.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.248+0000 7f906408a740 1 -- 172.21.15.7:0/1143491392 shutdown_connections 2024-09-21T06:00:41.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.248+0000 7f906408a740 1 -- 172.21.15.7:0/1143491392 wait complete. 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.248+0000 7f906408a740 1 -- start start 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f906408a740 1 Processor -- start 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f906408a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c11e8cd0 0x5605c15e5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f906408a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 0x5605c15e55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f906408a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 0x5605c15dfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f906408a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90581adcc0 con 0x5605c1201490 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f906408a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f90581af130 con 0x5605c11e8cd0 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f906408a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90581ae390 con 0x5605c1209670 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f906408a740 10 client.0 _ll_register_callbacks cb 0x7f904c005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f9056ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 0x5605c15e55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f9056ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 0x5605c15e55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50712/0 (socket says 172.21.15.7:50712) 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f9056ffd640 1 -- 172.21.15.7:0/2412383965 learned_addr learned my addr 172.21.15.7:0/2412383965 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f9057fff640 1 --2- 172.21.15.7:0/2412383965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 0x5605c15dfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f90577fe640 1 --2- 172.21.15.7:0/2412383965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c11e8cd0 0x5605c15e5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f9056ffd640 1 -- 172.21.15.7:0/2412383965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 msgr2=0x5605c15dfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f9056ffd640 1 --2- 172.21.15.7:0/2412383965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 0x5605c15dfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f9056ffd640 1 -- 172.21.15.7:0/2412383965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c11e8cd0 msgr2=0x5605c15e5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f9056ffd640 1 --2- 172.21.15.7:0/2412383965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c11e8cd0 0x5605c15e5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.249+0000 7f9056ffd640 1 -- 172.21.15.7:0/2412383965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c15e0410 con 0x5605c1201490 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.250+0000 7f9056ffd640 1 --2- 172.21.15.7:0/2412383965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 0x5605c15e55b0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f904c006010 tx=0x7f904c02aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8734ec2f2c19d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.250+0000 7f9036ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.250+0000 7f9036ffd640 1 -- 172.21.15.7:0/2412383965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c035070 con 0x5605c1201490 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.250+0000 7f9036ffd640 1 -- 172.21.15.7:0/2412383965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f904c031510 con 0x5605c1201490 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.250+0000 7f906408a740 1 -- 172.21.15.7:0/2412383965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90480acc00 con 0x5605c1201490 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.250+0000 7f9036ffd640 1 -- 172.21.15.7:0/2412383965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f904c003870 con 0x5605c1201490 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.250+0000 7f906408a740 10 client.17334 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.250+0000 7f906408a740 1 -- 172.21.15.7:0/2412383965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5605c165a4d0 con 0x5605c1201490 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.250+0000 7f9036ffd640 1 -- 172.21.15.7:0/2412383965 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90480acc00 con 0x5605c1201490 2024-09-21T06:00:41.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.251+0000 7f9036ffd640 1 -- 172.21.15.7:0/2412383965 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f904c004e30 con 0x5605c1201490 2024-09-21T06:00:41.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.251+0000 7f906408a740 10 client.17334 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:41.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.251+0000 7f906408a740 10 client.17334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:41.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.251+0000 7f906408a740 20 client.17334 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:41.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.251+0000 7f906408a740 1 --2- 172.21.15.7:0/2412383965 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605c122a350 0x5605c165cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:41.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.251+0000 7f906408a740 4 client.17334 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:00:41.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.251+0000 7f906408a740 1 -- 172.21.15.7:0/2412383965 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5605c1542c90 con 0x5605c122a350 2024-09-21T06:00:41.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.251+0000 7f90577fe640 1 --2- 172.21.15.7:0/2412383965 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605c122a350 0x5605c165cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:41.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.251+0000 7f90577fe640 1 --2- 172.21.15.7:0/2412383965 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605c122a350 0x5605c165cbf0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa4e2ef7dca64e93 server_cookie=c8bf0be24a5173bb in_seq=0 out_seq=0 2024-09-21T06:00:41.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.251+0000 7f9036ffd640 10 client.17334 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:41.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f9036ffd640 1 -- 172.21.15.7:0/2412383965 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5605c1542c90 con 0x5605c122a350 2024-09-21T06:00:41.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f9036ffd640 10 client.17334 handle_command_reply: tid=0 2024-09-21T06:00:41.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f906408a740 1 client.17334 shutdown 2024-09-21T06:00:41.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f906408a740 1 -- 172.21.15.7:0/2412383965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 msgr2=0x5605c15e55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:41.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f906408a740 1 --2- 172.21.15.7:0/2412383965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 0x5605c15e55b0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f904c006010 tx=0x7f904c02aba0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f906408a740 1 -- 172.21.15.7:0/2412383965 shutdown_connections 2024-09-21T06:00:41.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f906408a740 1 --2- 172.21.15.7:0/2412383965 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605c122a350 0x5605c165cbf0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f906408a740 1 --2- 172.21.15.7:0/2412383965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605c1201490 0x5605c15e55b0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f906408a740 1 --2- 172.21.15.7:0/2412383965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605c1209670 0x5605c15dfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f9036ffd640 0 client.17334 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:41.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f906408a740 1 --2- 172.21.15.7:0/2412383965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605c11e8cd0 0x5605c15e5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f906408a740 1 -- 172.21.15.7:0/2412383965 >> 172.21.15.7:0/2412383965 conn(0x5605c121e740 msgr2=0x5605c15d4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:41.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f906408a740 1 -- 172.21.15.7:0/2412383965 shutdown_connections 2024-09-21T06:00:41.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f906408a740 1 -- 172.21.15.7:0/2412383965 wait complete. 2024-09-21T06:00:41.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.253+0000 7f906408a740 20 client.17334 trim_cache size 0 max 16384 2024-09-21T06:00:41.258 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:00:41.258 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:00:41.259 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "960318d1-28a1-4ab7-bf0e-c215d0fb4f21", 2024-09-21T06:00:41.259 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:00:41.259 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:00:41.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.254+0000 7f905db16640 1 -- 172.21.15.7:0/2501239504 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f90400b6680 msgr2=0x7f90400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:41.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.254+0000 7f905db16640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f90400b6680 0x7f90400b8b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9050005c40 tx=0x7f9050009760 comp rx=0 tx=0).stop 2024-09-21T06:00:41.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.254+0000 7f905db16640 1 -- 172.21.15.7:0/2501239504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9058102010 msgr2=0x7f905819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:41.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.254+0000 7f905db16640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9058102010 0x7f905819a5b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f904800d720 tx=0x7f904800dbe0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.254+0000 7f905db16640 1 -- 172.21.15.7:0/2501239504 shutdown_connections 2024-09-21T06:00:41.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.254+0000 7f905db16640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f90400b6680 0x7f90400b8b90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.254+0000 7f905db16640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9058109e10 0x7f905819fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.254+0000 7f905db16640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90581094c0 0x7f905819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.254+0000 7f905db16640 1 --2- 172.21.15.7:0/2501239504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9058102010 0x7f905819a5b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:41.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.254+0000 7f905db16640 1 -- 172.21.15.7:0/2501239504 >> 172.21.15.7:0/2501239504 conn(0x7f9058077c60 msgr2=0x7f90581055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:41.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.254+0000 7f905db16640 1 -- 172.21.15.7:0/2501239504 shutdown_connections 2024-09-21T06:00:41.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:41.254+0000 7f905db16640 1 -- 172.21.15.7:0/2501239504 wait complete. 2024-09-21T06:00:41.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:41 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:00:41.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:41 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:41.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:41 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:00:41.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:41 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:41.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:41 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:00:41.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:41 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:41.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:41 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:00:41.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:41 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:41.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:41 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:00:41.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:41 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:41.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:41 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:00:41.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:41 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:42.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:00:42.339 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:42.448 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:42 smithi007 ceph-mon[30983]: pgmap v524: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:00:42.448 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:42 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:00:42.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:42 smithi119 ceph-mon[34833]: pgmap v524: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:00:42.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:42 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:00:42.627 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:42 smithi027 ceph-mon[34364]: pgmap v524: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:00:42.628 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:42 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:00:42.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.776+0000 7f2763bbf640 1 -- 172.21.15.7:0/655988026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275c103b80 msgr2=0x7f275c103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:42.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.776+0000 7f2763bbf640 1 --2- 172.21.15.7:0/655988026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275c103b80 0x7f275c103f90 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f2754009ca0 tx=0x7f275402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.777+0000 7f2763bbf640 1 -- 172.21.15.7:0/655988026 shutdown_connections 2024-09-21T06:00:42.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.777+0000 7f2763bbf640 1 --2- 172.21.15.7:0/655988026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f275c109e10 0x7f275c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.777+0000 7f2763bbf640 1 --2- 172.21.15.7:0/655988026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f275c1094c0 0x7f275c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.777+0000 7f2763bbf640 1 --2- 172.21.15.7:0/655988026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275c103b80 0x7f275c103f90 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.777+0000 7f2763bbf640 1 -- 172.21.15.7:0/655988026 >> 172.21.15.7:0/655988026 conn(0x7f275c0ff5d0 msgr2=0x7f275c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:42.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.777+0000 7f2763bbf640 1 -- 172.21.15.7:0/655988026 shutdown_connections 2024-09-21T06:00:42.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.777+0000 7f2763bbf640 1 -- 172.21.15.7:0/655988026 wait complete. 2024-09-21T06:00:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.777+0000 7f2763bbf640 1 Processor -- start 2024-09-21T06:00:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.777+0000 7f2763bbf640 1 -- start start 2024-09-21T06:00:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f2763bbf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f275c103b80 0x7f275c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f2763bbf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f275c1094c0 0x7f275c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f2763bbf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275c109e10 0x7f275c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f2763bbf640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f275c113ad0 con 0x7f275c109e10 2024-09-21T06:00:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f2763bbf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f275c113950 con 0x7f275c103b80 2024-09-21T06:00:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f2763bbf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f275c113c50 con 0x7f275c1094c0 2024-09-21T06:00:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f276215c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275c109e10 0x7f275c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f276195b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f275c103b80 0x7f275c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f276215c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275c109e10 0x7f275c076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50740/0 (socket says 172.21.15.7:50740) 2024-09-21T06:00:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f276195b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f275c103b80 0x7f275c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:35334/0 (socket says 172.21.15.7:35334) 2024-09-21T06:00:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f276215c640 1 -- 172.21.15.7:0/4169051604 learned_addr learned my addr 172.21.15.7:0/4169051604 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f276115a640 1 --2- 172.21.15.7:0/4169051604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f275c1094c0 0x7f275c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f276215c640 1 -- 172.21.15.7:0/4169051604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f275c1094c0 msgr2=0x7f275c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f276215c640 1 --2- 172.21.15.7:0/4169051604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f275c1094c0 0x7f275c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f276215c640 1 -- 172.21.15.7:0/4169051604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f275c103b80 msgr2=0x7f275c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f276215c640 1 --2- 172.21.15.7:0/4169051604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f275c103b80 0x7f275c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f276215c640 1 -- 172.21.15.7:0/4169051604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275c1a8760 con 0x7f275c109e10 2024-09-21T06:00:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.778+0000 7f276215c640 1 --2- 172.21.15.7:0/4169051604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275c109e10 0x7f275c076190 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f275800d750 tx=0x7f275800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.779+0000 7f2752ffd640 1 -- 172.21.15.7:0/4169051604 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2758017070 con 0x7f275c109e10 2024-09-21T06:00:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.779+0000 7f2752ffd640 1 -- 172.21.15.7:0/4169051604 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27580054d0 con 0x7f275c109e10 2024-09-21T06:00:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.779+0000 7f2763bbf640 1 -- 172.21.15.7:0/4169051604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275c1a8a50 con 0x7f275c109e10 2024-09-21T06:00:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.779+0000 7f2752ffd640 1 -- 172.21.15.7:0/4169051604 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2758004c60 con 0x7f275c109e10 2024-09-21T06:00:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.779+0000 7f2763bbf640 1 -- 172.21.15.7:0/4169051604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275c1a8f40 con 0x7f275c109e10 2024-09-21T06:00:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.781+0000 7f276a133740 1 Processor -- start 2024-09-21T06:00:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.782+0000 7f2752ffd640 1 -- 172.21.15.7:0/4169051604 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f2758009bd0 con 0x7f275c109e10 2024-09-21T06:00:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.782+0000 7f276a133740 1 -- start start 2024-09-21T06:00:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.782+0000 7f276a133740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894dc070 0x561689883650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.782+0000 7f276a133740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894b31b0 0x561689883b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.782+0000 7f276a133740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x5616898840d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.782+0000 7f276a133740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5616897f9e50 con 0x5616894bb390 2024-09-21T06:00:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.782+0000 7f276a133740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5616897e9280 con 0x5616894dc070 2024-09-21T06:00:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.782+0000 7f276a133740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5616897ed090 con 0x5616894b31b0 2024-09-21T06:00:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.782+0000 7f276195b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894b31b0 0x561689883b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.782+0000 7f276115a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x5616898840d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.783+0000 7f276195b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894b31b0 0x561689883b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:41106/0 (socket says 172.21.15.7:41106) 2024-09-21T06:00:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.783+0000 7f276195b640 1 -- 172.21.15.7:0/1064298834 learned_addr learned my addr 172.21.15.7:0/1064298834 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.783+0000 7f276115a640 1 --2- 172.21.15.7:0/1064298834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894dc070 0x561689883650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.783+0000 7f2752ffd640 1 --2- 172.21.15.7:0/4169051604 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27480b6680 0x7f27480b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.783+0000 7f276195b640 1 -- 172.21.15.7:0/1064298834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894dc070 msgr2=0x561689883650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.783+0000 7f276195b640 1 --2- 172.21.15.7:0/1064298834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894dc070 0x561689883650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.783+0000 7f276195b640 1 -- 172.21.15.7:0/1064298834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 msgr2=0x5616898840d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.783+0000 7f276195b640 1 --2- 172.21.15.7:0/1064298834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x5616898840d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.783+0000 7f276195b640 1 -- 172.21.15.7:0/1064298834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561689547650 con 0x5616894b31b0 2024-09-21T06:00:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.783+0000 7f276215c640 1 --2- 172.21.15.7:0/4169051604 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27480b6680 0x7f27480b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.783+0000 7f2752ffd640 1 -- 172.21.15.7:0/4169051604 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f27580e6ff0 con 0x7f275c109e10 2024-09-21T06:00:42.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.783+0000 7f276195b640 1 --2- 172.21.15.7:0/1064298834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894b31b0 0x561689883b90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2754009ca0 tx=0x7f2754009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1df763764168c425 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:42.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.784+0000 7f276215c640 1 --2- 172.21.15.7:0/4169051604 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27480b6680 0x7f27480b8b90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f27580e4d90 tx=0x7f275807a220 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:42.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.784+0000 7f2747fff640 1 -- 172.21.15.7:0/1064298834 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754031db0 con 0x5616894b31b0 2024-09-21T06:00:42.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.784+0000 7f2747fff640 1 -- 172.21.15.7:0/1064298834 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2754036030 con 0x5616894b31b0 2024-09-21T06:00:42.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.784+0000 7f2747fff640 1 -- 172.21.15.7:0/1064298834 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27540042a0 con 0x5616894b31b0 2024-09-21T06:00:42.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.785+0000 7f276a133740 1 -- 172.21.15.7:0/1064298834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894b31b0 msgr2=0x561689883b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:42.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.785+0000 7f276a133740 1 --2- 172.21.15.7:0/1064298834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894b31b0 0x561689883b90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2754009ca0 tx=0x7f2754009800 comp rx=0 tx=0).stop 2024-09-21T06:00:42.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.785+0000 7f276a133740 1 -- 172.21.15.7:0/1064298834 shutdown_connections 2024-09-21T06:00:42.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.785+0000 7f276a133740 1 --2- 172.21.15.7:0/1064298834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x5616898840d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.785+0000 7f276a133740 1 --2- 172.21.15.7:0/1064298834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894b31b0 0x561689883b90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.785+0000 7f276a133740 1 --2- 172.21.15.7:0/1064298834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894dc070 0x561689883650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.785+0000 7f276a133740 1 -- 172.21.15.7:0/1064298834 >> 172.21.15.7:0/1064298834 conn(0x5616894d0460 msgr2=0x561689881540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:42.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.785+0000 7f276a133740 1 -- 172.21.15.7:0/1064298834 shutdown_connections 2024-09-21T06:00:42.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.785+0000 7f276a133740 1 -- 172.21.15.7:0/1064298834 wait complete. 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.785+0000 7f276a133740 1 -- start start 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.785+0000 7f276a133740 1 Processor -- start 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276a133740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894b31b0 0x56168988ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276a133740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x56168988f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276a133740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894dc070 0x56168988f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276a133740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56168964a700 con 0x5616894bb390 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276a133740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x561689784110 con 0x5616894dc070 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276a133740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x561689891c50 con 0x5616894b31b0 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276a133740 10 client.0 _ll_register_callbacks cb 0x56168979d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276195b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x56168988f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276195b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x56168988f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50750/0 (socket says 172.21.15.7:50750) 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276195b640 1 -- 172.21.15.7:0/187112250 learned_addr learned my addr 172.21.15.7:0/187112250 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276115a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894b31b0 0x56168988ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276115a640 1 --2- 172.21.15.7:0/187112250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894dc070 0x56168988f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276195b640 1 -- 172.21.15.7:0/187112250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894b31b0 msgr2=0x56168988ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276195b640 1 --2- 172.21.15.7:0/187112250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894b31b0 0x56168988ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276195b640 1 -- 172.21.15.7:0/187112250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894dc070 msgr2=0x56168988f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276195b640 1 --2- 172.21.15.7:0/187112250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894dc070 0x56168988f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276195b640 1 -- 172.21.15.7:0/187112250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616897b1c40 con 0x5616894bb390 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276115a640 1 --2- 172.21.15.7:0/187112250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894dc070 0x56168988f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f276195b640 1 --2- 172.21.15.7:0/187112250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x56168988f200 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f2754003cc0 tx=0x7f27540099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3352c389affc9a30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.786+0000 7f27457fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f27457fa640 1 -- 172.21.15.7:0/187112250 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275404a040 con 0x5616894bb390 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f27457fa640 1 -- 172.21.15.7:0/187112250 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f2754031650 con 0x5616894bb390 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f276a133740 1 -- 172.21.15.7:0/187112250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2754036030 con 0x5616894bb390 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f27457fa640 1 -- 172.21.15.7:0/187112250 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f275405e050 con 0x5616894bb390 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f276a133740 10 client.17346 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f276a133740 1 -- 172.21.15.7:0/187112250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56168989d920 con 0x5616894bb390 2024-09-21T06:00:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f27457fa640 1 -- 172.21.15.7:0/187112250 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2754036030 con 0x5616894bb390 2024-09-21T06:00:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f27457fa640 1 -- 172.21.15.7:0/187112250 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f275404d030 con 0x5616894bb390 2024-09-21T06:00:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f276a133740 10 client.17346 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f276a133740 10 client.17346 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f276a133740 20 client.17346 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f276a133740 1 --2- 172.21.15.7:0/187112250 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56168949a9f0 0x5616898a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f276a133740 4 client.17346 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.787+0000 7f276a133740 1 -- 172.21.15.7:0/187112250 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616897fbda0 con 0x56168949a9f0 2024-09-21T06:00:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.788+0000 7f276115a640 1 --2- 172.21.15.7:0/187112250 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56168949a9f0 0x5616898a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.788+0000 7f27457fa640 10 client.17346 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.788+0000 7f276115a640 1 --2- 172.21.15.7:0/187112250 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56168949a9f0 0x5616898a0c80 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa8f6057abc15bef server_cookie=3fc0a3f38196053a in_seq=0 out_seq=0 2024-09-21T06:00:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f27457fa640 1 -- 172.21.15.7:0/187112250 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616897fbda0 con 0x56168949a9f0 2024-09-21T06:00:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f27457fa640 10 client.17346 handle_command_reply: tid=0 2024-09-21T06:00:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f276a133740 1 client.17346 shutdown 2024-09-21T06:00:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f276a133740 1 -- 172.21.15.7:0/187112250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 msgr2=0x56168988f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f276a133740 1 --2- 172.21.15.7:0/187112250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x56168988f200 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f2754003cc0 tx=0x7f27540099f0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f276a133740 1 -- 172.21.15.7:0/187112250 shutdown_connections 2024-09-21T06:00:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f276a133740 1 --2- 172.21.15.7:0/187112250 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56168949a9f0 0x5616898a0c80 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f276a133740 1 --2- 172.21.15.7:0/187112250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x56168988f200 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f276a133740 1 --2- 172.21.15.7:0/187112250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894dc070 0x56168988f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f27457fa640 0 client.17346 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f276a133740 1 --2- 172.21.15.7:0/187112250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894b31b0 0x56168988ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f276a133740 1 -- 172.21.15.7:0/187112250 >> 172.21.15.7:0/187112250 conn(0x5616894d0460 msgr2=0x5616898867e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f276a133740 1 -- 172.21.15.7:0/187112250 shutdown_connections 2024-09-21T06:00:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f276a133740 1 -- 172.21.15.7:0/187112250 wait complete. 2024-09-21T06:00:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.789+0000 7f276a133740 20 client.17346 trim_cache size 0 max 16384 2024-09-21T06:00:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276a133740 1 Processor -- start 2024-09-21T06:00:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276a133740 1 -- start start 2024-09-21T06:00:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276a133740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894b31b0 0x56168988f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276a133740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894bb390 0x56168988beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276a133740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894dc070 0x56168988c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276a133740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f275c1b3fe0 con 0x5616894b31b0 2024-09-21T06:00:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276a133740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f275c1b18b0 con 0x5616894bb390 2024-09-21T06:00:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276a133740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f275c1af720 con 0x5616894dc070 2024-09-21T06:00:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276115a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894b31b0 0x56168988f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276115a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894b31b0 0x56168988f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50760/0 (socket says 172.21.15.7:50760) 2024-09-21T06:00:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276115a640 1 -- 172.21.15.7:0/364773715 learned_addr learned my addr 172.21.15.7:0/364773715 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276115a640 1 -- 172.21.15.7:0/364773715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894dc070 msgr2=0x56168988c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276115a640 1 --2- 172.21.15.7:0/364773715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894dc070 0x56168988c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276195b640 1 --2- 172.21.15.7:0/364773715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894bb390 0x56168988beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276115a640 1 -- 172.21.15.7:0/364773715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894bb390 msgr2=0x56168988beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.807+0000 7f276115a640 1 --2- 172.21.15.7:0/364773715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894bb390 0x56168988beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.808+0000 7f276115a640 1 -- 172.21.15.7:0/364773715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561689884470 con 0x5616894b31b0 2024-09-21T06:00:42.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.808+0000 7f276115a640 1 --2- 172.21.15.7:0/364773715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894b31b0 0x56168988f180 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f274c010690 tx=0x7f274c009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2b4285318e0843 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:42.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.808+0000 7f27477fe640 1 -- 172.21.15.7:0/364773715 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c019040 con 0x5616894b31b0 2024-09-21T06:00:42.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.808+0000 7f27477fe640 1 -- 172.21.15.7:0/364773715 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f274c0054d0 con 0x5616894b31b0 2024-09-21T06:00:42.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.808+0000 7f27477fe640 1 -- 172.21.15.7:0/364773715 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c004a00 con 0x5616894b31b0 2024-09-21T06:00:42.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.809+0000 7f276a133740 1 -- 172.21.15.7:0/364773715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894b31b0 msgr2=0x56168988f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:42.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.809+0000 7f276a133740 1 --2- 172.21.15.7:0/364773715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894b31b0 0x56168988f180 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f274c010690 tx=0x7f274c009b40 comp rx=0 tx=0).stop 2024-09-21T06:00:42.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.809+0000 7f276a133740 1 -- 172.21.15.7:0/364773715 shutdown_connections 2024-09-21T06:00:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.809+0000 7f276a133740 1 --2- 172.21.15.7:0/364773715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894dc070 0x56168988c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.809+0000 7f276a133740 1 --2- 172.21.15.7:0/364773715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894bb390 0x56168988beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.809+0000 7f276a133740 1 --2- 172.21.15.7:0/364773715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894b31b0 0x56168988f180 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.809+0000 7f276a133740 1 -- 172.21.15.7:0/364773715 >> 172.21.15.7:0/364773715 conn(0x5616894d0460 msgr2=0x56168988ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.809+0000 7f276a133740 1 -- 172.21.15.7:0/364773715 shutdown_connections 2024-09-21T06:00:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.809+0000 7f276a133740 1 -- 172.21.15.7:0/364773715 wait complete. 2024-09-21T06:00:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.809+0000 7f276a133740 1 -- start start 2024-09-21T06:00:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.809+0000 7f276a133740 1 Processor -- start 2024-09-21T06:00:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276a133740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894b31b0 0x5616898937e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276a133740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x561689893da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276a133740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894dc070 0x561689904490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276a133740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f275c1afd70 con 0x5616894bb390 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276a133740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f275c1b11e0 con 0x5616894b31b0 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276a133740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f275c1b0440 con 0x5616894dc070 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276a133740 10 client.0 _ll_register_callbacks cb 0x7f274c009dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276195b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x561689893da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276195b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x561689893da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50772/0 (socket says 172.21.15.7:50772) 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276195b640 1 -- 172.21.15.7:0/1969719875 learned_addr learned my addr 172.21.15.7:0/1969719875 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276115a640 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894b31b0 0x5616898937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276115a640 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894dc070 0x561689904490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276195b640 1 -- 172.21.15.7:0/1969719875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894dc070 msgr2=0x561689904490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276195b640 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894dc070 0x561689904490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276195b640 1 -- 172.21.15.7:0/1969719875 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894b31b0 msgr2=0x5616898937e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276195b640 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894b31b0 0x5616898937e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276195b640 1 -- 172.21.15.7:0/1969719875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561689904b00 con 0x5616894bb390 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276115a640 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894dc070 0x561689904490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f276195b640 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x561689893da0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2754031700 tx=0x7f2754031730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b9d35ea6e122ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.810+0000 7f27457fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f27457fa640 1 -- 172.21.15.7:0/1969719875 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754009360 con 0x5616894bb390 2024-09-21T06:00:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f27457fa640 1 -- 172.21.15.7:0/1969719875 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f2754030800 con 0x5616894bb390 2024-09-21T06:00:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f276a133740 1 -- 172.21.15.7:0/1969719875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f274c0054d0 con 0x5616894bb390 2024-09-21T06:00:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f27457fa640 1 -- 172.21.15.7:0/1969719875 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2754009540 con 0x5616894bb390 2024-09-21T06:00:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f276a133740 10 client.17352 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f276a133740 1 -- 172.21.15.7:0/1969719875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56168990be10 con 0x5616894bb390 2024-09-21T06:00:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f27457fa640 1 -- 172.21.15.7:0/1969719875 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f274c0054d0 con 0x5616894bb390 2024-09-21T06:00:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f27457fa640 1 -- 172.21.15.7:0/1969719875 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f275404d040 con 0x5616894bb390 2024-09-21T06:00:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f276a133740 10 client.17352 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f276a133740 10 client.17352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f276a133740 20 client.17352 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f276a133740 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56168946fda0 0x56168990e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:42.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f276a133740 4 client.17352 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:00:42.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f276a133740 1 -- 172.21.15.7:0/1969719875 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56168988a870 con 0x56168946fda0 2024-09-21T06:00:42.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.811+0000 7f276115a640 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56168946fda0 0x56168990e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.812+0000 7f27457fa640 10 client.17352 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.812+0000 7f276115a640 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56168946fda0 0x56168990e510 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51956197061fd4ee server_cookie=7cc28d229e777d56 in_seq=0 out_seq=0 2024-09-21T06:00:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.812+0000 7f27457fa640 1 -- 172.21.15.7:0/1969719875 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x56168988a870 con 0x56168946fda0 2024-09-21T06:00:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.812+0000 7f27457fa640 10 client.17352 handle_command_reply: tid=0 2024-09-21T06:00:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.812+0000 7f276a133740 1 client.17352 shutdown 2024-09-21T06:00:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.812+0000 7f276a133740 1 -- 172.21.15.7:0/1969719875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 msgr2=0x561689893da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.812+0000 7f276a133740 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x561689893da0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2754031700 tx=0x7f2754031730 comp rx=0 tx=0).stop 2024-09-21T06:00:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f276a133740 1 -- 172.21.15.7:0/1969719875 shutdown_connections 2024-09-21T06:00:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f276a133740 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56168946fda0 0x56168990e510 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f276a133740 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5616894bb390 0x561689893da0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f27457fa640 0 client.17352 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f276a133740 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5616894dc070 0x561689904490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f276a133740 1 --2- 172.21.15.7:0/1969719875 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5616894b31b0 0x5616898937e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f276a133740 1 -- 172.21.15.7:0/1969719875 >> 172.21.15.7:0/1969719875 conn(0x5616894d0460 msgr2=0x56168988d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f276a133740 1 -- 172.21.15.7:0/1969719875 shutdown_connections 2024-09-21T06:00:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f276a133740 1 -- 172.21.15.7:0/1969719875 wait complete. 2024-09-21T06:00:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f276a133740 20 client.17352 trim_cache size 0 max 16384 2024-09-21T06:00:42.819 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:00:42.819 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:00:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:00:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:00:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:00:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:00:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:00:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:00:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:00:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:00:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:00:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:00:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:00:42.829 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:00:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f2763bbf640 1 -- 172.21.15.7:0/4169051604 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27480b6680 msgr2=0x7f27480b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f2763bbf640 1 --2- 172.21.15.7:0/4169051604 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27480b6680 0x7f27480b8b90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f27580e4d90 tx=0x7f275807a220 comp rx=0 tx=0).stop 2024-09-21T06:00:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f2763bbf640 1 -- 172.21.15.7:0/4169051604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275c109e10 msgr2=0x7f275c076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f2763bbf640 1 --2- 172.21.15.7:0/4169051604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275c109e10 0x7f275c076190 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f275800d750 tx=0x7f275800dc10 comp rx=0 tx=0).stop 2024-09-21T06:00:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f2763bbf640 1 -- 172.21.15.7:0/4169051604 shutdown_connections 2024-09-21T06:00:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f2763bbf640 1 --2- 172.21.15.7:0/4169051604 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27480b6680 0x7f27480b8b90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f2763bbf640 1 --2- 172.21.15.7:0/4169051604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275c109e10 0x7f275c076190 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f2763bbf640 1 --2- 172.21.15.7:0/4169051604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f275c1094c0 0x7f275c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f2763bbf640 1 --2- 172.21.15.7:0/4169051604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f275c103b80 0x7f275c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f2763bbf640 1 -- 172.21.15.7:0/4169051604 >> 172.21.15.7:0/4169051604 conn(0x7f275c0ff5d0 msgr2=0x7f275c1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.813+0000 7f2763bbf640 1 -- 172.21.15.7:0/4169051604 shutdown_connections 2024-09-21T06:00:42.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:42.814+0000 7f2763bbf640 1 -- 172.21.15.7:0/4169051604 wait complete. 2024-09-21T06:00:43.609 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:00:43.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:00:43.869 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:44.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.318+0000 7fafa725c640 1 -- 172.21.15.7:0/2206057648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafa0103b60 msgr2=0x7fafa0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:44.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.318+0000 7fafa725c640 1 --2- 172.21.15.7:0/2206057648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafa0103b60 0x7fafa0103f70 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7faf90009900 tx=0x7faf9002a410 comp rx=0 tx=0).stop 2024-09-21T06:00:44.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.318+0000 7fafa725c640 1 -- 172.21.15.7:0/2206057648 shutdown_connections 2024-09-21T06:00:44.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.318+0000 7fafa725c640 1 --2- 172.21.15.7:0/2206057648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafa0109df0 0x7fafa0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:44.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.318+0000 7fafa725c640 1 --2- 172.21.15.7:0/2206057648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafa01094a0 0x7fafa01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:44.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.318+0000 7fafa725c640 1 --2- 172.21.15.7:0/2206057648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafa0103b60 0x7fafa0103f70 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:44.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.318+0000 7fafa725c640 1 -- 172.21.15.7:0/2206057648 >> 172.21.15.7:0/2206057648 conn(0x7fafa007b850 msgr2=0x7fafa007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:44.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.318+0000 7fafa725c640 1 -- 172.21.15.7:0/2206057648 shutdown_connections 2024-09-21T06:00:44.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.318+0000 7fafa725c640 1 -- 172.21.15.7:0/2206057648 wait complete. 2024-09-21T06:00:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.319+0000 7fafa725c640 1 Processor -- start 2024-09-21T06:00:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.319+0000 7fafa725c640 1 -- start start 2024-09-21T06:00:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.319+0000 7fafa725c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafa0103b60 0x7fafa019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa725c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafa01094a0 0x7fafa019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa725c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafa0109df0 0x7fafa01a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa725c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fafa0113ab0 con 0x7fafa0109df0 2024-09-21T06:00:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa725c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fafa0113930 con 0x7fafa0103b60 2024-09-21T06:00:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa725c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fafa0113c30 con 0x7fafa01094a0 2024-09-21T06:00:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa4ff8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafa0103b60 0x7fafa019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa57f9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafa0109df0 0x7fafa01a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa4ff8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafa0103b60 0x7fafa019c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:35392/0 (socket says 172.21.15.7:35392) 2024-09-21T06:00:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa57f9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafa0109df0 0x7fafa01a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50798/0 (socket says 172.21.15.7:50798) 2024-09-21T06:00:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa4ff8640 1 -- 172.21.15.7:0/2929651455 learned_addr learned my addr 172.21.15.7:0/2929651455 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7faf9ffff640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafa01094a0 0x7fafa019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa57f9640 1 -- 172.21.15.7:0/2929651455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafa01094a0 msgr2=0x7fafa019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa57f9640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafa01094a0 0x7fafa019cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa57f9640 1 -- 172.21.15.7:0/2929651455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafa0103b60 msgr2=0x7fafa019c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa57f9640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafa0103b60 0x7fafa019c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa57f9640 1 -- 172.21.15.7:0/2929651455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa01a25f0 con 0x7fafa0109df0 2024-09-21T06:00:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7faf9ffff640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafa01094a0 0x7fafa019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa4ff8640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafa0103b60 0x7fafa019c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.320+0000 7fafa57f9640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafa0109df0 0x7fafa01a1ec0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7faf98009fd0 tx=0x7faf9800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.321+0000 7faf9dffb640 1 -- 172.21.15.7:0/2929651455 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9800ce20 con 0x7fafa0109df0 2024-09-21T06:00:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.321+0000 7faf9dffb640 1 -- 172.21.15.7:0/2929651455 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf98005020 con 0x7fafa0109df0 2024-09-21T06:00:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.321+0000 7faf9dffb640 1 -- 172.21.15.7:0/2929651455 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98010690 con 0x7fafa0109df0 2024-09-21T06:00:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.321+0000 7fafa725c640 1 -- 172.21.15.7:0/2929651455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa01a28e0 con 0x7fafa0109df0 2024-09-21T06:00:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.321+0000 7fafa725c640 1 -- 172.21.15.7:0/2929651455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa01a9040 con 0x7fafa0109df0 2024-09-21T06:00:44.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.322+0000 7fafa725c640 1 -- 172.21.15.7:0/2929651455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa0103f70 con 0x7fafa0109df0 2024-09-21T06:00:44.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.324+0000 7faf9dffb640 1 -- 172.21.15.7:0/2929651455 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7faf980054d0 con 0x7fafa0109df0 2024-09-21T06:00:44.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.325+0000 7faf9dffb640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7faf880b6700 0x7faf880b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:44.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.325+0000 7fafa4ff8640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7faf880b6700 0x7faf880b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:44.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.325+0000 7faf9dffb640 1 -- 172.21.15.7:0/2929651455 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7faf980e7e20 con 0x7fafa0109df0 2024-09-21T06:00:44.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.325+0000 7fafa4ff8640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7faf880b6700 0x7faf880b8c10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faf90031440 tx=0x7faf900058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.330+0000 7faf9dffb640 1 -- 172.21.15.7:0/2929651455 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf980ae360 con 0x7fafa0109df0 2024-09-21T06:00:44.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.554+0000 7fafa725c640 1 -- 172.21.15.7:0/2929651455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafa019d7b0 con 0x7fafa0109df0 2024-09-21T06:00:44.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.555+0000 7faf9dffb640 1 -- 172.21.15.7:0/2929651455 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7fafa019d7b0 con 0x7fafa0109df0 2024-09-21T06:00:44.558 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:00:44.558 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:00:44.558 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:00:44.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.558+0000 7fafa725c640 1 -- 172.21.15.7:0/2929651455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7faf880b6700 msgr2=0x7faf880b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:44.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.558+0000 7fafa725c640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7faf880b6700 0x7faf880b8c10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faf90031440 tx=0x7faf900058d0 comp rx=0 tx=0).stop 2024-09-21T06:00:44.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.558+0000 7fafa725c640 1 -- 172.21.15.7:0/2929651455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafa0109df0 msgr2=0x7fafa01a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:44.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.558+0000 7fafa725c640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafa0109df0 0x7fafa01a1ec0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7faf98009fd0 tx=0x7faf9800ef10 comp rx=0 tx=0).stop 2024-09-21T06:00:44.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.558+0000 7fafa725c640 1 -- 172.21.15.7:0/2929651455 shutdown_connections 2024-09-21T06:00:44.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.558+0000 7fafa725c640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7faf880b6700 0x7faf880b8c10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:44.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.558+0000 7fafa725c640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafa0109df0 0x7fafa01a1ec0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:44.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.558+0000 7fafa725c640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafa01094a0 0x7fafa019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:44.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.558+0000 7fafa725c640 1 --2- 172.21.15.7:0/2929651455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fafa0103b60 0x7fafa019c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:44.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.558+0000 7fafa725c640 1 -- 172.21.15.7:0/2929651455 >> 172.21.15.7:0/2929651455 conn(0x7fafa007b850 msgr2=0x7fafa01072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:44.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.558+0000 7fafa725c640 1 -- 172.21.15.7:0/2929651455 shutdown_connections 2024-09-21T06:00:44.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:44.558+0000 7fafa725c640 1 -- 172.21.15.7:0/2929651455 wait complete. 2024-09-21T06:00:44.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:44 smithi007 ceph-mon[30983]: pgmap v525: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:00:44.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:44 smithi119 ceph-mon[34833]: pgmap v525: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:00:44.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:44 smithi027 ceph-mon[34364]: pgmap v525: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:00:45.301 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:00:45.567 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:45.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:45 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2929651455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:45.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:45 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2929651455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:45.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:45 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2929651455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.994+0000 7f0cdf70c640 1 -- 172.21.15.7:0/75222289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd8103b60 msgr2=0x7f0cd8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.994+0000 7f0cdf70c640 1 --2- 172.21.15.7:0/75222289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd8103b60 0x7f0cd8103f70 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009900 tx=0x7f0cd402a410 comp rx=0 tx=0).stop 2024-09-21T06:00:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.994+0000 7f0cdf70c640 1 -- 172.21.15.7:0/75222289 shutdown_connections 2024-09-21T06:00:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.994+0000 7f0cdf70c640 1 --2- 172.21.15.7:0/75222289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd8109df0 0x7f0cd8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.994+0000 7f0cdf70c640 1 --2- 172.21.15.7:0/75222289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0cd81094a0 0x7f0cd81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.994+0000 7f0cdf70c640 1 --2- 172.21.15.7:0/75222289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd8103b60 0x7f0cd8103f70 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.994+0000 7f0cdf70c640 1 -- 172.21.15.7:0/75222289 >> 172.21.15.7:0/75222289 conn(0x7f0cd807b850 msgr2=0x7f0cd807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.994+0000 7f0cdf70c640 1 -- 172.21.15.7:0/75222289 shutdown_connections 2024-09-21T06:00:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.994+0000 7f0cdf70c640 1 -- 172.21.15.7:0/75222289 wait complete. 2024-09-21T06:00:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.995+0000 7f0cdf70c640 1 Processor -- start 2024-09-21T06:00:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.995+0000 7f0cdf70c640 1 -- start start 2024-09-21T06:00:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.995+0000 7f0cdf70c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0cd8103b60 0x7f0cd819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.995+0000 7f0cdf70c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd81094a0 0x7f0cd819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.995+0000 7f0cdf70c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd8109df0 0x7f0cd819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.995+0000 7f0cdf70c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd8113ab0 con 0x7f0cd81094a0 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.995+0000 7f0cdf70c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd8113930 con 0x7f0cd8103b60 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.995+0000 7f0cdf70c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd8113c30 con 0x7f0cd8109df0 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.995+0000 7f0cdcca7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd81094a0 0x7f0cd819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cdcca7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd81094a0 0x7f0cd819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50824/0 (socket says 172.21.15.7:50824) 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cdcca7640 1 -- 172.21.15.7:0/821328690 learned_addr learned my addr 172.21.15.7:0/821328690 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0cd8103b60 0x7f0cd819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cddca9640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd8109df0 0x7f0cd819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cdcca7640 1 -- 172.21.15.7:0/821328690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd8109df0 msgr2=0x7f0cd819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cdcca7640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd8109df0 0x7f0cd819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cdcca7640 1 -- 172.21.15.7:0/821328690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0cd8103b60 msgr2=0x7f0cd819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cdcca7640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0cd8103b60 0x7f0cd819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cdcca7640 1 -- 172.21.15.7:0/821328690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd81a0330 con 0x7f0cd81094a0 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cdcca7640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd81094a0 0x7f0cd819aa20 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800c8c0 tx=0x7f0cc800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cce7fc640 1 -- 172.21.15.7:0/821328690 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8007bb0 con 0x7f0cd81094a0 2024-09-21T06:00:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cce7fc640 1 -- 172.21.15.7:0/821328690 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc8007d50 con 0x7f0cd81094a0 2024-09-21T06:00:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cdf70c640 1 -- 172.21.15.7:0/821328690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd81a0620 con 0x7f0cd81094a0 2024-09-21T06:00:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cdf70c640 1 -- 172.21.15.7:0/821328690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd81a6e40 con 0x7f0cd81094a0 2024-09-21T06:00:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.996+0000 7f0cce7fc640 1 -- 172.21.15.7:0/821328690 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80187c0 con 0x7f0cd81094a0 2024-09-21T06:00:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.999+0000 7f0ce5c80740 1 Processor -- start 2024-09-21T06:00:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:45.999+0000 7f0ce5c80740 1 -- start start 2024-09-21T06:00:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0cce7fc640 1 -- 172.21.15.7:0/821328690 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0cc800fa20 con 0x7f0cd81094a0 2024-09-21T06:00:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0ce5c80740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 0x560d144f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0ce5c80740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 0x560d144f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0ce5c80740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d1412b390 0x560d144f4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0ce5c80740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d14469ea0 con 0x560d141231b0 2024-09-21T06:00:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0ce5c80740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560d144592d0 con 0x560d1412b390 2024-09-21T06:00:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0ce5c80740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560d1445d0e0 con 0x560d1414c070 2024-09-21T06:00:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0cdd4a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 0x560d144f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0cdd4a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 0x560d144f3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50832/0 (socket says 172.21.15.7:50832) 2024-09-21T06:00:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0cdd4a8640 1 -- 172.21.15.7:0/2714352770 learned_addr learned my addr 172.21.15.7:0/2714352770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0cddca9640 1 --2- 172.21.15.7:0/2714352770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 0x560d144f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0cdcca7640 1 --2- 172.21.15.7:0/2714352770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d1412b390 0x560d144f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0cdd4a8640 1 -- 172.21.15.7:0/2714352770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 msgr2=0x560d144f36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/2714352770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 0x560d144f36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0cdd4a8640 1 -- 172.21.15.7:0/2714352770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d1412b390 msgr2=0x560d144f4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/2714352770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d1412b390 0x560d144f4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.000+0000 7f0cdd4a8640 1 -- 172.21.15.7:0/2714352770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d141b7650 con 0x560d141231b0 2024-09-21T06:00:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.001+0000 7f0cce7fc640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0cc40b66b0 0x7f0cc40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.001+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/2714352770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 0x560d144f3be0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009900 tx=0x7f0cd4032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb1073e57e2dab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.001+0000 7f0cddca9640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0cc40b66b0 0x7f0cc40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.001+0000 7f0cce7fc640 1 -- 172.21.15.7:0/821328690 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f0cc80e76f0 con 0x7f0cd81094a0 2024-09-21T06:00:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.001+0000 7f0cc37fe640 1 -- 172.21.15.7:0/2714352770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4040070 con 0x560d141231b0 2024-09-21T06:00:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.001+0000 7f0cc37fe640 1 -- 172.21.15.7:0/2714352770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cd40316a0 con 0x560d141231b0 2024-09-21T06:00:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.001+0000 7f0cc37fe640 1 -- 172.21.15.7:0/2714352770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4035040 con 0x560d141231b0 2024-09-21T06:00:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.002+0000 7f0ce5c80740 1 -- 172.21.15.7:0/2714352770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 msgr2=0x560d144f3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.002+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/2714352770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 0x560d144f3be0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009900 tx=0x7f0cd4032e60 comp rx=0 tx=0).stop 2024-09-21T06:00:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.002+0000 7f0cddca9640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0cc40b66b0 0x7f0cc40b8bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0005fd0 tx=0x7f0cd0009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.002+0000 7f0ce5c80740 1 -- 172.21.15.7:0/2714352770 shutdown_connections 2024-09-21T06:00:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.002+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/2714352770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 0x560d144f3be0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.002+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/2714352770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d1412b390 0x560d144f4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.002+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/2714352770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 0x560d144f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.002+0000 7f0ce5c80740 1 -- 172.21.15.7:0/2714352770 >> 172.21.15.7:0/2714352770 conn(0x560d14140460 msgr2=0x560d144f1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.002+0000 7f0ce5c80740 1 -- 172.21.15.7:0/2714352770 shutdown_connections 2024-09-21T06:00:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.002+0000 7f0ce5c80740 1 -- 172.21.15.7:0/2714352770 wait complete. 2024-09-21T06:00:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.002+0000 7f0ce5c80740 1 -- start start 2024-09-21T06:00:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.003+0000 7f0ce5c80740 1 Processor -- start 2024-09-21T06:00:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.003+0000 7f0ce5c80740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d141231b0 0x560d14503120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.003+0000 7f0ce5c80740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 0x560d14503660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.003+0000 7f0ce5c80740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 0x560d14503be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.003+0000 7f0ce5c80740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d142ba700 con 0x560d1412b390 2024-09-21T06:00:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.003+0000 7f0ce5c80740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560d143f4160 con 0x560d141231b0 2024-09-21T06:00:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.003+0000 7f0ce5c80740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560d14506180 con 0x560d1414c070 2024-09-21T06:00:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.003+0000 7f0ce5c80740 10 client.0 _ll_register_callbacks cb 0x560d1440d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.003+0000 7f0cdcca7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 0x560d14503660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.003+0000 7f0cdcca7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 0x560d14503660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50838/0 (socket says 172.21.15.7:50838) 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.003+0000 7f0cdcca7640 1 -- 172.21.15.7:0/378446397 learned_addr learned my addr 172.21.15.7:0/378446397 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.003+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d141231b0 0x560d14503120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.003+0000 7f0cddca9640 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 0x560d14503be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0cdcca7640 1 -- 172.21.15.7:0/378446397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 msgr2=0x560d14503be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0cdcca7640 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 0x560d14503be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0cdcca7640 1 -- 172.21.15.7:0/378446397 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d141231b0 msgr2=0x560d14503120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0cdcca7640 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d141231b0 0x560d14503120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0cdcca7640 1 -- 172.21.15.7:0/378446397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d14421c90 con 0x560d1412b390 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0cddca9640 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 0x560d14503be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d141231b0 0x560d14503120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0cdcca7640 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 0x560d14503660 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80e4ef0 tx=0x7f0cc80b6e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68194d5309e38604 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0cc0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0cc0ff9640 1 -- 172.21.15.7:0/378446397 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80a9430 con 0x560d1412b390 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0ce5c80740 1 -- 172.21.15.7:0/378446397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cd40316a0 con 0x560d1412b390 2024-09-21T06:00:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0cc0ff9640 1 -- 172.21.15.7:0/378446397 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f0cc80ac7f0 con 0x560d1412b390 2024-09-21T06:00:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0cc0ff9640 1 -- 172.21.15.7:0/378446397 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0cc80acd00 con 0x560d1412b390 2024-09-21T06:00:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0ce5c80740 10 client.17370 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0ce5c80740 1 -- 172.21.15.7:0/378446397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560d14511ee0 con 0x560d1412b390 2024-09-21T06:00:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.004+0000 7f0cc0ff9640 1 -- 172.21.15.7:0/378446397 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cd40316a0 con 0x560d1412b390 2024-09-21T06:00:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.005+0000 7f0cc0ff9640 1 -- 172.21.15.7:0/378446397 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0cc80e9ce0 con 0x560d1412b390 2024-09-21T06:00:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.005+0000 7f0ce5c80740 10 client.17370 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.005+0000 7f0ce5c80740 10 client.17370 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:00:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.005+0000 7f0ce5c80740 20 client.17370 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.005+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560d1410a9f0 0x560d14515370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.005+0000 7f0ce5c80740 4 client.17370 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.005+0000 7f0ce5c80740 1 -- 172.21.15.7:0/378446397 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d1446bdf0 con 0x560d1410a9f0 2024-09-21T06:00:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.005+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560d1410a9f0 0x560d14515370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.006+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560d1410a9f0 0x560d14515370 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c89d463ef86be97b server_cookie=1293a1deea823c2b in_seq=0 out_seq=0 2024-09-21T06:00:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.006+0000 7f0cc0ff9640 10 client.17370 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.006+0000 7f0cc0ff9640 1 -- 172.21.15.7:0/378446397 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d1446bdf0 con 0x560d1410a9f0 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.006+0000 7f0cc0ff9640 10 client.17370 handle_command_reply: tid=0 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.006+0000 7f0ce5c80740 1 client.17370 shutdown 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.006+0000 7f0ce5c80740 1 -- 172.21.15.7:0/378446397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 msgr2=0x560d14503660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.006+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 0x560d14503660 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80e4ef0 tx=0x7f0cc80b6e60 comp rx=0 tx=0).stop 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.006+0000 7f0ce5c80740 1 -- 172.21.15.7:0/378446397 shutdown_connections 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.006+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560d1410a9f0 0x560d14515370 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.007+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 0x560d14503660 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.007+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 0x560d14503be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.007+0000 7f0cc0ff9640 0 client.17370 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.007+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/378446397 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d141231b0 0x560d14503120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.007+0000 7f0ce5c80740 1 -- 172.21.15.7:0/378446397 >> 172.21.15.7:0/378446397 conn(0x560d14140460 msgr2=0x560d144efbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.007+0000 7f0ce5c80740 1 -- 172.21.15.7:0/378446397 shutdown_connections 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.007+0000 7f0ce5c80740 1 -- 172.21.15.7:0/378446397 wait complete. 2024-09-21T06:00:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.007+0000 7f0ce5c80740 20 client.17370 trim_cache size 0 max 16384 2024-09-21T06:00:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.020+0000 7f0ce5c80740 1 Processor -- start 2024-09-21T06:00:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.020+0000 7f0ce5c80740 1 -- start start 2024-09-21T06:00:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.020+0000 7f0ce5c80740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 0x560d144f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.020+0000 7f0ce5c80740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1412b390 0x560d14500310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.020+0000 7f0ce5c80740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d1414c070 0x560d14500850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.020+0000 7f0ce5c80740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81afb90 con 0x560d141231b0 2024-09-21T06:00:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.020+0000 7f0ce5c80740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81ad460 con 0x560d1414c070 2024-09-21T06:00:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.020+0000 7f0ce5c80740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81ab2d0 con 0x560d1412b390 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.020+0000 7f0cdd4a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 0x560d144f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.020+0000 7f0cdd4a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 0x560d144f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50842/0 (socket says 172.21.15.7:50842) 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.020+0000 7f0cdd4a8640 1 -- 172.21.15.7:0/392304973 learned_addr learned my addr 172.21.15.7:0/392304973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.021+0000 7f0cddca9640 1 --2- 172.21.15.7:0/392304973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d1414c070 0x560d14500850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.021+0000 7f0cdcca7640 1 --2- 172.21.15.7:0/392304973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1412b390 0x560d14500310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.021+0000 7f0cdd4a8640 1 -- 172.21.15.7:0/392304973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1412b390 msgr2=0x560d14500310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.021+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/392304973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1412b390 0x560d14500310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.021+0000 7f0cdd4a8640 1 -- 172.21.15.7:0/392304973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d1414c070 msgr2=0x560d14500850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.021+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/392304973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d1414c070 0x560d14500850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.021+0000 7f0cdd4a8640 1 -- 172.21.15.7:0/392304973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d145043e0 con 0x560d141231b0 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.021+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/392304973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 0x560d144f8f50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x560d144f2320 tx=0x7f0cd4005340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88bfb72da26075 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.021+0000 7f0cc2ffd640 1 -- 172.21.15.7:0/392304973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4035040 con 0x560d141231b0 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.021+0000 7f0cc2ffd640 1 -- 172.21.15.7:0/392304973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cd4031e40 con 0x560d141231b0 2024-09-21T06:00:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.021+0000 7f0cc2ffd640 1 -- 172.21.15.7:0/392304973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4040040 con 0x560d141231b0 2024-09-21T06:00:46.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.022+0000 7f0ce5c80740 1 -- 172.21.15.7:0/392304973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 msgr2=0x560d144f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:46.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.022+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/392304973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 0x560d144f8f50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x560d144f2320 tx=0x7f0cd4005340 comp rx=0 tx=0).stop 2024-09-21T06:00:46.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.022+0000 7f0ce5c80740 1 -- 172.21.15.7:0/392304973 shutdown_connections 2024-09-21T06:00:46.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.022+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/392304973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d1414c070 0x560d14500850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.022+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/392304973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1412b390 0x560d14500310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.022+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/392304973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d141231b0 0x560d144f8f50 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.022+0000 7f0ce5c80740 1 -- 172.21.15.7:0/392304973 >> 172.21.15.7:0/392304973 conn(0x560d14140460 msgr2=0x560d144f8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.022+0000 7f0ce5c80740 1 -- 172.21.15.7:0/392304973 shutdown_connections 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.022+0000 7f0ce5c80740 1 -- 172.21.15.7:0/392304973 wait complete. 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.022+0000 7f0ce5c80740 1 -- start start 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0ce5c80740 1 Processor -- start 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0ce5c80740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d141231b0 0x560d1450bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0ce5c80740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 0x560d14509340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0ce5c80740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 0x560d14509a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0ce5c80740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81ab920 con 0x560d1412b390 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0ce5c80740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81acd90 con 0x560d141231b0 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0ce5c80740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81abff0 con 0x560d1414c070 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0ce5c80740 10 client.0 _ll_register_callbacks cb 0x7f0cc800c810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0cdcca7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 0x560d14509340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0cdcca7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 0x560d14509340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50848/0 (socket says 172.21.15.7:50848) 2024-09-21T06:00:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0cdcca7640 1 -- 172.21.15.7:0/774368147 learned_addr learned my addr 172.21.15.7:0/774368147 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d141231b0 0x560d1450bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0cdcca7640 1 -- 172.21.15.7:0/774368147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 msgr2=0x560d14509a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0cddca9640 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 0x560d14509a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.023+0000 7f0cdcca7640 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 0x560d14509a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0cdcca7640 1 -- 172.21.15.7:0/774368147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d141231b0 msgr2=0x560d1450bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0cdcca7640 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d141231b0 0x560d1450bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0cdcca7640 1 -- 172.21.15.7:0/774368147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d1457ed40 con 0x560d1412b390 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d141231b0 0x560d1450bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0cdcca7640 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 0x560d14509340 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0cc801f000 tx=0x7f0cc80aca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06b55cd4bf26c97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0cc0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0cc0ff9640 1 -- 172.21.15.7:0/774368147 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80acee0 con 0x560d1412b390 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0ce5c80740 1 -- 172.21.15.7:0/774368147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d144678a0 con 0x560d1412b390 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0cc0ff9640 1 -- 172.21.15.7:0/774368147 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f0cc80b3200 con 0x560d1412b390 2024-09-21T06:00:46.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0cc0ff9640 1 -- 172.21.15.7:0/774368147 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0cc805c030 con 0x560d1412b390 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0ce5c80740 10 client.17376 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0ce5c80740 1 -- 172.21.15.7:0/774368147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560d1457fe30 con 0x560d1412b390 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0cc0ff9640 1 -- 172.21.15.7:0/774368147 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560d144678a0 con 0x560d1412b390 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.024+0000 7f0cc0ff9640 1 -- 172.21.15.7:0/774368147 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0cc80b3400 con 0x560d1412b390 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.025+0000 7f0ce5c80740 10 client.17376 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.025+0000 7f0ce5c80740 10 client.17376 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.025+0000 7f0ce5c80740 20 client.17376 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.025+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560d140dfda0 0x560d14582380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.025+0000 7f0ce5c80740 4 client.17376 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.025+0000 7f0ce5c80740 1 -- 172.21.15.7:0/774368147 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d14464cd0 con 0x560d140dfda0 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.025+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560d140dfda0 0x560d14582380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.025+0000 7f0cdd4a8640 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560d140dfda0 0x560d14582380 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d9e1b770fc2149a5 server_cookie=5b5c1d210b89b2d9 in_seq=0 out_seq=0 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.025+0000 7f0cc0ff9640 10 client.17376 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0cc0ff9640 1 -- 172.21.15.7:0/774368147 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d14464cd0 con 0x560d140dfda0 2024-09-21T06:00:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0cc0ff9640 10 client.17376 handle_command_reply: tid=0 2024-09-21T06:00:46.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0ce5c80740 1 client.17376 shutdown 2024-09-21T06:00:46.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0ce5c80740 1 -- 172.21.15.7:0/774368147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 msgr2=0x560d14509340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:46.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 0x560d14509340 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0cc801f000 tx=0x7f0cc80aca20 comp rx=0 tx=0).stop 2024-09-21T06:00:46.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0ce5c80740 1 -- 172.21.15.7:0/774368147 shutdown_connections 2024-09-21T06:00:46.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x560d140dfda0 0x560d14582380 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d1412b390 0x560d14509340 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d1414c070 0x560d14509a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0ce5c80740 1 --2- 172.21.15.7:0/774368147 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d141231b0 0x560d1450bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0ce5c80740 1 -- 172.21.15.7:0/774368147 >> 172.21.15.7:0/774368147 conn(0x560d14140460 msgr2=0x560d144f46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:46.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0cc0ff9640 0 client.17376 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:46.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0ce5c80740 1 -- 172.21.15.7:0/774368147 shutdown_connections 2024-09-21T06:00:46.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0ce5c80740 1 -- 172.21.15.7:0/774368147 wait complete. 2024-09-21T06:00:46.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.026+0000 7f0ce5c80740 20 client.17376 trim_cache size 0 max 16384 2024-09-21T06:00:46.033 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:46.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.027+0000 7f0cdf70c640 1 -- 172.21.15.7:0/821328690 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0cc40b66b0 msgr2=0x7f0cc40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:46.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.027+0000 7f0cdf70c640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0cc40b66b0 0x7f0cc40b8bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0005fd0 tx=0x7f0cd0009600 comp rx=0 tx=0).stop 2024-09-21T06:00:46.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.027+0000 7f0cdf70c640 1 -- 172.21.15.7:0/821328690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd81094a0 msgr2=0x7f0cd819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:46.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.027+0000 7f0cdf70c640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd81094a0 0x7f0cd819aa20 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800c8c0 tx=0x7f0cc800cd80 comp rx=0 tx=0).stop 2024-09-21T06:00:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.027+0000 7f0cdf70c640 1 -- 172.21.15.7:0/821328690 shutdown_connections 2024-09-21T06:00:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.027+0000 7f0cdf70c640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0cc40b66b0 0x7f0cc40b8bc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.027+0000 7f0cdf70c640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cd81094a0 0x7f0cd819aa20 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.027+0000 7f0cdf70c640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd8109df0 0x7f0cd819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.027+0000 7f0cdf70c640 1 --2- 172.21.15.7:0/821328690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0cd8103b60 0x7f0cd819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.027+0000 7f0cdf70c640 1 -- 172.21.15.7:0/821328690 >> 172.21.15.7:0/821328690 conn(0x7f0cd807b850 msgr2=0x7f0cd8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.027+0000 7f0cdf70c640 1 -- 172.21.15.7:0/821328690 shutdown_connections 2024-09-21T06:00:46.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:46.027+0000 7f0cdf70c640 1 -- 172.21.15.7:0/821328690 wait complete. 2024-09-21T06:00:46.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:46 smithi119 ceph-mon[34833]: pgmap v526: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8 op/s 2024-09-21T06:00:46.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:46 smithi007 ceph-mon[30983]: pgmap v526: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8 op/s 2024-09-21T06:00:46.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:46 smithi027 ceph-mon[34364]: pgmap v526: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8 op/s 2024-09-21T06:00:46.830 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:00:47.092 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:47.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.585+0000 7f38e7e14640 1 -- 172.21.15.7:0/2190516063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38e01094b0 msgr2=0x7f38e01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:47.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.585+0000 7f38e7e14640 1 --2- 172.21.15.7:0/2190516063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38e01094b0 0x7f38e01098c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f38d0009900 tx=0x7f38d002a410 comp rx=0 tx=0).stop 2024-09-21T06:00:47.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.585+0000 7f38e7e14640 1 -- 172.21.15.7:0/2190516063 shutdown_connections 2024-09-21T06:00:47.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.585+0000 7f38e7e14640 1 --2- 172.21.15.7:0/2190516063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38e01094b0 0x7f38e01098c0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.585+0000 7f38e7e14640 1 --2- 172.21.15.7:0/2190516063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38e0109e00 0x7f38e0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.585+0000 7f38e7e14640 1 --2- 172.21.15.7:0/2190516063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38e0101f70 0x7f38e0102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.585+0000 7f38e7e14640 1 -- 172.21.15.7:0/2190516063 >> 172.21.15.7:0/2190516063 conn(0x7f38e0077c60 msgr2=0x7f38e00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:47.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.585+0000 7f38e7e14640 1 -- 172.21.15.7:0/2190516063 shutdown_connections 2024-09-21T06:00:47.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.585+0000 7f38e7e14640 1 -- 172.21.15.7:0/2190516063 wait complete. 2024-09-21T06:00:47.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.586+0000 7f38e7e14640 1 Processor -- start 2024-09-21T06:00:47.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.586+0000 7f38e7e14640 1 -- start start 2024-09-21T06:00:47.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.586+0000 7f38e7e14640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38e0101f70 0x7f38e019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.586+0000 7f38e7e14640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38e01094b0 0x7f38e019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.586+0000 7f38e7e14640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38e0109e00 0x7f38e019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.586+0000 7f38e7e14640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0113ac0 con 0x7f38e0101f70 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.586+0000 7f38e7e14640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0113940 con 0x7f38e0109e00 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.586+0000 7f38e7e14640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0113c40 con 0x7f38e01094b0 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38e5bb0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38e0101f70 0x7f38e019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38e5bb0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38e0101f70 0x7f38e019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50866/0 (socket says 172.21.15.7:50866) 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38e5bb0640 1 -- 172.21.15.7:0/4247800379 learned_addr learned my addr 172.21.15.7:0/4247800379 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38e53af640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38e01094b0 0x7f38e019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38e63b1640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38e0109e00 0x7f38e019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38e5bb0640 1 -- 172.21.15.7:0/4247800379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38e01094b0 msgr2=0x7f38e019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38e5bb0640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38e01094b0 0x7f38e019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38e5bb0640 1 -- 172.21.15.7:0/4247800379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38e0109e00 msgr2=0x7f38e019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38e5bb0640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38e0109e00 0x7f38e019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38e5bb0640 1 -- 172.21.15.7:0/4247800379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e01a03c0 con 0x7f38e0101f70 2024-09-21T06:00:47.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38e5bb0640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38e0101f70 0x7f38e019a450 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00d950 tx=0x7f38dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:47.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38d6ffd640 1 -- 172.21.15.7:0/4247800379 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc017070 con 0x7f38e0101f70 2024-09-21T06:00:47.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38d6ffd640 1 -- 172.21.15.7:0/4247800379 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38dc009c30 con 0x7f38e0101f70 2024-09-21T06:00:47.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38d6ffd640 1 -- 172.21.15.7:0/4247800379 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc00f620 con 0x7f38e0101f70 2024-09-21T06:00:47.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.587+0000 7f38e7e14640 1 -- 172.21.15.7:0/4247800379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e01a06b0 con 0x7f38e0101f70 2024-09-21T06:00:47.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.588+0000 7f38e7e14640 1 -- 172.21.15.7:0/4247800379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e01a6e10 con 0x7f38e0101f70 2024-09-21T06:00:47.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.590+0000 7f38ee388740 1 Processor -- start 2024-09-21T06:00:47.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.590+0000 7f38ee388740 1 -- start start 2024-09-21T06:00:47.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.590+0000 7f38d6ffd640 1 -- 172.21.15.7:0/4247800379 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f38dc010460 con 0x7f38e0101f70 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38ee388740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ec1b070 0x559d6efc22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38ee388740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 0x559d6efc2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38ee388740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebfa390 0x559d6efc2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38ee388740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559d6ef38ea0 con 0x559d6ec1b070 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38ee388740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559d6ef282d0 con 0x559d6ebfa390 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38ee388740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559d6ef2c0e0 con 0x559d6ebf21b0 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38e63b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ec1b070 0x559d6efc22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38e63b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ec1b070 0x559d6efc22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50868/0 (socket says 172.21.15.7:50868) 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38e63b1640 1 -- 172.21.15.7:0/520585208 learned_addr learned my addr 172.21.15.7:0/520585208 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38e5bb0640 1 --2- 172.21.15.7:0/520585208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 0x559d6efc2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38e63b1640 1 -- 172.21.15.7:0/520585208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 msgr2=0x559d6efc2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38e53af640 1 --2- 172.21.15.7:0/520585208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebfa390 0x559d6efc2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38e63b1640 1 --2- 172.21.15.7:0/520585208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 0x559d6efc2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38e63b1640 1 -- 172.21.15.7:0/520585208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebfa390 msgr2=0x559d6efc2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:47.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38e63b1640 1 --2- 172.21.15.7:0/520585208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebfa390 0x559d6efc2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38e63b1640 1 -- 172.21.15.7:0/520585208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d6ec86650 con 0x559d6ec1b070 2024-09-21T06:00:47.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38e53af640 1 --2- 172.21.15.7:0/520585208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebfa390 0x559d6efc2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:47.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38d6ffd640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38cc0b6680 0x7f38cc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.591+0000 7f38e63b1640 1 --2- 172.21.15.7:0/520585208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ec1b070 0x559d6efc22c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f38d8010370 tx=0x7f38d8010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4139d0207037d2c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:47.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.592+0000 7f38cbfff640 1 -- 172.21.15.7:0/520585208 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8016070 con 0x559d6ec1b070 2024-09-21T06:00:47.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.592+0000 7f38e5bb0640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38cc0b6680 0x7f38cc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.592+0000 7f38cbfff640 1 -- 172.21.15.7:0/520585208 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38d8004d20 con 0x559d6ec1b070 2024-09-21T06:00:47.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.592+0000 7f38d6ffd640 1 -- 172.21.15.7:0/4247800379 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f38dc0e7290 con 0x7f38e0101f70 2024-09-21T06:00:47.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.592+0000 7f38cbfff640 1 -- 172.21.15.7:0/520585208 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d80127d0 con 0x559d6ec1b070 2024-09-21T06:00:47.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.593+0000 7f38ee388740 1 -- 172.21.15.7:0/520585208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ec1b070 msgr2=0x559d6efc22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:47.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.593+0000 7f38e5bb0640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38cc0b6680 0x7f38cc0b8b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0e4ae0 tx=0x7f38dc005880 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:47.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.593+0000 7f38ee388740 1 --2- 172.21.15.7:0/520585208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ec1b070 0x559d6efc22c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f38d8010370 tx=0x7f38d8010830 comp rx=0 tx=0).stop 2024-09-21T06:00:47.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.593+0000 7f38ee388740 1 -- 172.21.15.7:0/520585208 shutdown_connections 2024-09-21T06:00:47.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.593+0000 7f38ee388740 1 --2- 172.21.15.7:0/520585208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebfa390 0x559d6efc2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.593+0000 7f38ee388740 1 --2- 172.21.15.7:0/520585208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 0x559d6efc2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.593+0000 7f38ee388740 1 --2- 172.21.15.7:0/520585208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ec1b070 0x559d6efc22c0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.593+0000 7f38ee388740 1 -- 172.21.15.7:0/520585208 >> 172.21.15.7:0/520585208 conn(0x559d6ec0f460 msgr2=0x559d6efc01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.593+0000 7f38ee388740 1 -- 172.21.15.7:0/520585208 shutdown_connections 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.593+0000 7f38ee388740 1 -- 172.21.15.7:0/520585208 wait complete. 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.593+0000 7f38ee388740 1 -- start start 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.593+0000 7f38ee388740 1 Processor -- start 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38ee388740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 0x559d6efd1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38ee388740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebfa390 0x559d6efd2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38ee388740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ec1b070 0x559d6efde130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38ee388740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559d6ed89700 con 0x559d6ebfa390 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38ee388740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559d6eec3160 con 0x559d6ec1b070 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38ee388740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559d6efd4e00 con 0x559d6ebf21b0 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38ee388740 10 client.0 _ll_register_callbacks cb 0x559d6eedc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38e53af640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebfa390 0x559d6efd2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38e53af640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebfa390 0x559d6efd2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50882/0 (socket says 172.21.15.7:50882) 2024-09-21T06:00:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38e53af640 1 -- 172.21.15.7:0/616706749 learned_addr learned my addr 172.21.15.7:0/616706749 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38e63b1640 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 0x559d6efd1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38e63b1640 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ec1b070 0x559d6efde130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38e53af640 1 -- 172.21.15.7:0/616706749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 msgr2=0x559d6efd1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38e53af640 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 0x559d6efd1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38e53af640 1 -- 172.21.15.7:0/616706749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ec1b070 msgr2=0x559d6efde130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38e53af640 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ec1b070 0x559d6efde130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38e53af640 1 -- 172.21.15.7:0/616706749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d6eef0c90 con 0x559d6ebfa390 2024-09-21T06:00:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.594+0000 7f38e63b1640 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ec1b070 0x559d6efde130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.595+0000 7f38e53af640 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebfa390 0x559d6efd2320 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f38e0075ab0 tx=0x7f38d0032dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d8936fae10bdb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.595+0000 7f38c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.595+0000 7f38c97fa640 1 -- 172.21.15.7:0/616706749 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0040070 con 0x559d6ebfa390 2024-09-21T06:00:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.595+0000 7f38c97fa640 1 -- 172.21.15.7:0/616706749 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f38d00318b0 con 0x559d6ebfa390 2024-09-21T06:00:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.595+0000 7f38ee388740 1 -- 172.21.15.7:0/616706749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38d8004d20 con 0x559d6ebfa390 2024-09-21T06:00:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.595+0000 7f38c97fa640 1 -- 172.21.15.7:0/616706749 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f38d0035040 con 0x559d6ebfa390 2024-09-21T06:00:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.595+0000 7f38ee388740 10 client.17388 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.595+0000 7f38ee388740 1 -- 172.21.15.7:0/616706749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559d6efe0af0 con 0x559d6ebfa390 2024-09-21T06:00:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.595+0000 7f38c97fa640 1 -- 172.21.15.7:0/616706749 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38d8004d20 con 0x559d6ebfa390 2024-09-21T06:00:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.595+0000 7f38c97fa640 1 -- 172.21.15.7:0/616706749 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f38d00047e0 con 0x559d6ebfa390 2024-09-21T06:00:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.595+0000 7f38ee388740 10 client.17388 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.595+0000 7f38ee388740 10 client.17388 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:00:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.595+0000 7f38ee388740 20 client.17388 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.596+0000 7f38ee388740 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559d6ebd99f0 0x559d6efe3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.596+0000 7f38ee388740 4 client.17388 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:47.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.596+0000 7f38ee388740 1 -- 172.21.15.7:0/616706749 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d6ef3adf0 con 0x559d6ebd99f0 2024-09-21T06:00:47.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.596+0000 7f38e63b1640 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559d6ebd99f0 0x559d6efe3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.596+0000 7f38c97fa640 10 client.17388 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:47.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.596+0000 7f38e63b1640 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559d6ebd99f0 0x559d6efe3fe0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=666375fa7e20fb2e server_cookie=caa4f21cfb99479 in_seq=0 out_seq=0 2024-09-21T06:00:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.597+0000 7f38c97fa640 1 -- 172.21.15.7:0/616706749 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559d6ef3adf0 con 0x559d6ebd99f0 2024-09-21T06:00:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.597+0000 7f38c97fa640 10 client.17388 handle_command_reply: tid=0 2024-09-21T06:00:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.597+0000 7f38ee388740 1 client.17388 shutdown 2024-09-21T06:00:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.597+0000 7f38ee388740 1 -- 172.21.15.7:0/616706749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebfa390 msgr2=0x559d6efd2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.597+0000 7f38ee388740 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebfa390 0x559d6efd2320 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f38e0075ab0 tx=0x7f38d0032dc0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.597+0000 7f38ee388740 1 -- 172.21.15.7:0/616706749 shutdown_connections 2024-09-21T06:00:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.597+0000 7f38ee388740 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559d6ebd99f0 0x559d6efe3fe0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.597+0000 7f38ee388740 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebfa390 0x559d6efd2320 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.597+0000 7f38ee388740 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ec1b070 0x559d6efde130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.597+0000 7f38c97fa640 0 client.17388 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:47.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.597+0000 7f38ee388740 1 --2- 172.21.15.7:0/616706749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 0x559d6efd1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.597+0000 7f38ee388740 1 -- 172.21.15.7:0/616706749 >> 172.21.15.7:0/616706749 conn(0x559d6ec0f460 msgr2=0x559d6efc3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:47.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.598+0000 7f38ee388740 1 -- 172.21.15.7:0/616706749 shutdown_connections 2024-09-21T06:00:47.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.598+0000 7f38ee388740 1 -- 172.21.15.7:0/616706749 wait complete. 2024-09-21T06:00:47.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.598+0000 7f38ee388740 20 client.17388 trim_cache size 0 max 16384 2024-09-21T06:00:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.611+0000 7f38ee388740 1 Processor -- start 2024-09-21T06:00:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.611+0000 7f38ee388740 1 -- start start 2024-09-21T06:00:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.611+0000 7f38ee388740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebd99f0 0x559d6efc01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.611+0000 7f38ee388740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebf21b0 0x559d6efde030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.611+0000 7f38ee388740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebfa390 0x559d6efcefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.611+0000 7f38ee388740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01afd00 con 0x559d6ebf21b0 2024-09-21T06:00:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.611+0000 7f38ee388740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01ad5d0 con 0x559d6ebd99f0 2024-09-21T06:00:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.611+0000 7f38ee388740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01ab440 con 0x559d6ebfa390 2024-09-21T06:00:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.611+0000 7f38e53af640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebf21b0 0x559d6efde030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38e53af640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebf21b0 0x559d6efde030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50896/0 (socket says 172.21.15.7:50896) 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38e53af640 1 -- 172.21.15.7:0/524768893 learned_addr learned my addr 172.21.15.7:0/524768893 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38e63b1640 1 --2- 172.21.15.7:0/524768893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebd99f0 0x559d6efc01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38e63b1640 1 --2- 172.21.15.7:0/524768893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebfa390 0x559d6efcefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38e53af640 1 -- 172.21.15.7:0/524768893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebfa390 msgr2=0x559d6efcefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38e53af640 1 --2- 172.21.15.7:0/524768893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebfa390 0x559d6efcefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38e53af640 1 -- 172.21.15.7:0/524768893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebd99f0 msgr2=0x559d6efc01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38e53af640 1 --2- 172.21.15.7:0/524768893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebd99f0 0x559d6efc01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38e53af640 1 -- 172.21.15.7:0/524768893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d6efe4550 con 0x559d6ebf21b0 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38e63b1640 1 --2- 172.21.15.7:0/524768893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebfa390 0x559d6efcefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38e53af640 1 --2- 172.21.15.7:0/524768893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebf21b0 0x559d6efde030 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f38d0031440 tx=0x7f38d0032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b92db1afe948184 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38cb7fe640 1 -- 172.21.15.7:0/524768893 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0040070 con 0x559d6ebf21b0 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38cb7fe640 1 -- 172.21.15.7:0/524768893 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38d0004950 con 0x559d6ebf21b0 2024-09-21T06:00:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.612+0000 7f38cb7fe640 1 -- 172.21.15.7:0/524768893 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d003c440 con 0x559d6ebf21b0 2024-09-21T06:00:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.613+0000 7f38ee388740 1 -- 172.21.15.7:0/524768893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebf21b0 msgr2=0x559d6efde030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.613+0000 7f38ee388740 1 --2- 172.21.15.7:0/524768893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebf21b0 0x559d6efde030 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f38d0031440 tx=0x7f38d0032b20 comp rx=0 tx=0).stop 2024-09-21T06:00:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.613+0000 7f38ee388740 1 -- 172.21.15.7:0/524768893 shutdown_connections 2024-09-21T06:00:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.613+0000 7f38ee388740 1 --2- 172.21.15.7:0/524768893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebf21b0 0x559d6efde030 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.613+0000 7f38ee388740 1 --2- 172.21.15.7:0/524768893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebfa390 0x559d6efcefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.613+0000 7f38ee388740 1 --2- 172.21.15.7:0/524768893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebd99f0 0x559d6efc01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.613+0000 7f38ee388740 1 -- 172.21.15.7:0/524768893 >> 172.21.15.7:0/524768893 conn(0x559d6ec0f460 msgr2=0x559d6efbfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.613+0000 7f38ee388740 1 -- 172.21.15.7:0/524768893 shutdown_connections 2024-09-21T06:00:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.613+0000 7f38ee388740 1 -- 172.21.15.7:0/524768893 wait complete. 2024-09-21T06:00:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.613+0000 7f38ee388740 1 -- start start 2024-09-21T06:00:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.614+0000 7f38ee388740 1 Processor -- start 2024-09-21T06:00:47.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.614+0000 7f38ee388740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebd99f0 0x559d6efd5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.614+0000 7f38ee388740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 0x559d6efd6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.614+0000 7f38ee388740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebfa390 0x559d6efd6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.614+0000 7f38ee388740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01aba90 con 0x559d6ebd99f0 2024-09-21T06:00:47.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.614+0000 7f38ee388740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01acf00 con 0x559d6ebfa390 2024-09-21T06:00:47.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.614+0000 7f38ee388740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01ac160 con 0x559d6ebf21b0 2024-09-21T06:00:47.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.614+0000 7f38ee388740 10 client.0 _ll_register_callbacks cb 0x7f38d0005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:47.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.614+0000 7f38e63b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebd99f0 0x559d6efd5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.614+0000 7f38e63b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebd99f0 0x559d6efd5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50904/0 (socket says 172.21.15.7:50904) 2024-09-21T06:00:47.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.614+0000 7f38e63b1640 1 -- 172.21.15.7:0/1396566017 learned_addr learned my addr 172.21.15.7:0/1396566017 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.614+0000 7f38e63b1640 1 --2- 172.21.15.7:0/1396566017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebfa390 0x559d6efd6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.614+0000 7f38e53af640 1 --2- 172.21.15.7:0/1396566017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 0x559d6efd6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38e63b1640 1 -- 172.21.15.7:0/1396566017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 msgr2=0x559d6efd6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38e63b1640 1 --2- 172.21.15.7:0/1396566017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 0x559d6efd6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38e63b1640 1 -- 172.21.15.7:0/1396566017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebfa390 msgr2=0x559d6efd6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38e63b1640 1 --2- 172.21.15.7:0/1396566017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebfa390 0x559d6efd6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38e63b1640 1 -- 172.21.15.7:0/1396566017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d6f04d9a0 con 0x559d6ebd99f0 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38e63b1640 1 --2- 172.21.15.7:0/1396566017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebd99f0 0x559d6efd5ff0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f38d8010d30 tx=0x7f38d8009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7686dd1ec62489c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38c97fa640 1 -- 172.21.15.7:0/1396566017 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8016070 con 0x559d6ebd99f0 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38c97fa640 1 -- 172.21.15.7:0/1396566017 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f38d8012bd0 con 0x559d6ebd99f0 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38ee388740 1 -- 172.21.15.7:0/1396566017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38d0004950 con 0x559d6ebd99f0 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38c97fa640 1 -- 172.21.15.7:0/1396566017 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f38d8012dd0 con 0x559d6ebd99f0 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38ee388740 10 client.17394 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38ee388740 1 -- 172.21.15.7:0/1396566017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559d6f04ebb0 con 0x559d6ebd99f0 2024-09-21T06:00:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.615+0000 7f38c97fa640 1 -- 172.21.15.7:0/1396566017 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38d0004950 con 0x559d6ebd99f0 2024-09-21T06:00:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.616+0000 7f38c97fa640 1 -- 172.21.15.7:0/1396566017 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f38d802e030 con 0x559d6ebd99f0 2024-09-21T06:00:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.616+0000 7f38ee388740 10 client.17394 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.616+0000 7f38ee388740 10 client.17394 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:00:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.616+0000 7f38ee388740 20 client.17394 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.616+0000 7f38ee388740 1 --2- 172.21.15.7:0/1396566017 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559d6ec1b070 0x559d6f051370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.616+0000 7f38ee388740 4 client.17394 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.616+0000 7f38ee388740 1 -- 172.21.15.7:0/1396566017 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d6ef368a0 con 0x559d6ec1b070 2024-09-21T06:00:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.616+0000 7f38e53af640 1 --2- 172.21.15.7:0/1396566017 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559d6ec1b070 0x559d6f051370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.616+0000 7f38c97fa640 10 client.17394 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.616+0000 7f38e53af640 1 --2- 172.21.15.7:0/1396566017 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559d6ec1b070 0x559d6f051370 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=76f8279de0030ff3 server_cookie=74c3aa2c60a5b661 in_seq=0 out_seq=0 2024-09-21T06:00:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38c97fa640 1 -- 172.21.15.7:0/1396566017 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559d6ef368a0 con 0x559d6ec1b070 2024-09-21T06:00:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38c97fa640 10 client.17394 handle_command_reply: tid=0 2024-09-21T06:00:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38ee388740 1 client.17394 shutdown 2024-09-21T06:00:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38ee388740 1 -- 172.21.15.7:0/1396566017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebd99f0 msgr2=0x559d6efd5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38ee388740 1 --2- 172.21.15.7:0/1396566017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebd99f0 0x559d6efd5ff0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f38d8010d30 tx=0x7f38d8009600 comp rx=0 tx=0).stop 2024-09-21T06:00:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38ee388740 1 -- 172.21.15.7:0/1396566017 shutdown_connections 2024-09-21T06:00:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38ee388740 1 --2- 172.21.15.7:0/1396566017 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x559d6ec1b070 0x559d6f051370 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38ee388740 1 --2- 172.21.15.7:0/1396566017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559d6ebfa390 0x559d6efd6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38ee388740 1 --2- 172.21.15.7:0/1396566017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559d6ebf21b0 0x559d6efd6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38ee388740 1 --2- 172.21.15.7:0/1396566017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559d6ebd99f0 0x559d6efd5ff0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38ee388740 1 -- 172.21.15.7:0/1396566017 >> 172.21.15.7:0/1396566017 conn(0x559d6ec0f460 msgr2=0x559d6efc3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38c97fa640 0 client.17394 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38ee388740 1 -- 172.21.15.7:0/1396566017 shutdown_connections 2024-09-21T06:00:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38ee388740 1 -- 172.21.15.7:0/1396566017 wait complete. 2024-09-21T06:00:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.617+0000 7f38ee388740 20 client.17394 trim_cache size 0 max 16384 2024-09-21T06:00:47.624 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.618+0000 7f38e7e14640 1 -- 172.21.15.7:0/4247800379 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38cc0b6680 msgr2=0x7f38cc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.618+0000 7f38e7e14640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38cc0b6680 0x7f38cc0b8b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0e4ae0 tx=0x7f38dc005880 comp rx=0 tx=0).stop 2024-09-21T06:00:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.618+0000 7f38e7e14640 1 -- 172.21.15.7:0/4247800379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38e0101f70 msgr2=0x7f38e019a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.618+0000 7f38e7e14640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38e0101f70 0x7f38e019a450 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00d950 tx=0x7f38dc00de10 comp rx=0 tx=0).stop 2024-09-21T06:00:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.618+0000 7f38e7e14640 1 -- 172.21.15.7:0/4247800379 shutdown_connections 2024-09-21T06:00:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.618+0000 7f38e7e14640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f38cc0b6680 0x7f38cc0b8b90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.618+0000 7f38e7e14640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38e0109e00 0x7f38e019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.618+0000 7f38e7e14640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38e01094b0 0x7f38e019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.618+0000 7f38e7e14640 1 --2- 172.21.15.7:0/4247800379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38e0101f70 0x7f38e019a450 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.618+0000 7f38e7e14640 1 -- 172.21.15.7:0/4247800379 >> 172.21.15.7:0/4247800379 conn(0x7f38e0077c60 msgr2=0x7f38e01054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.618+0000 7f38e7e14640 1 -- 172.21.15.7:0/4247800379 shutdown_connections 2024-09-21T06:00:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:47.618+0000 7f38e7e14640 1 -- 172.21.15.7:0/4247800379 wait complete. 2024-09-21T06:00:48.296 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:00:48.559 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:48.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:48 smithi007 ceph-mon[30983]: pgmap v527: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:00:48.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:48 smithi119 ceph-mon[34833]: pgmap v527: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:00:48.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:48 smithi027 ceph-mon[34364]: pgmap v527: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:00:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.085+0000 7f148aeee640 1 -- 172.21.15.7:0/1463755232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484108d10 msgr2=0x7f148410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.085+0000 7f148aeee640 1 --2- 172.21.15.7:0/1463755232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484108d10 0x7f148410f540 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f147c009ca0 tx=0x7f147c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.085+0000 7f148aeee640 1 -- 172.21.15.7:0/1463755232 shutdown_connections 2024-09-21T06:00:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.085+0000 7f148aeee640 1 --2- 172.21.15.7:0/1463755232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484108d10 0x7f148410f540 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.085+0000 7f148aeee640 1 --2- 172.21.15.7:0/1463755232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14841083c0 0x7f14841087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.085+0000 7f148aeee640 1 --2- 172.21.15.7:0/1463755232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1484102a80 0x7f1484102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.085+0000 7f148aeee640 1 -- 172.21.15.7:0/1463755232 >> 172.21.15.7:0/1463755232 conn(0x7f1484079740 msgr2=0x7f1484079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.085+0000 7f148aeee640 1 -- 172.21.15.7:0/1463755232 shutdown_connections 2024-09-21T06:00:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.085+0000 7f148aeee640 1 -- 172.21.15.7:0/1463755232 wait complete. 2024-09-21T06:00:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.085+0000 7f148aeee640 1 Processor -- start 2024-09-21T06:00:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.085+0000 7f148aeee640 1 -- start start 2024-09-21T06:00:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148aeee640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1484102a80 0x7f148419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148aeee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14841083c0 0x7f148419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148aeee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484108d10 0x7f148419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148aeee640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1484112980 con 0x7f1484108d10 2024-09-21T06:00:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148aeee640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1484112800 con 0x7f1484102a80 2024-09-21T06:00:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148aeee640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1484112b00 con 0x7f14841083c0 2024-09-21T06:00:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148948b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484108d10 0x7f148419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148948b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484108d10 0x7f148419fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60756/0 (socket says 172.21.15.7:60756) 2024-09-21T06:00:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148948b640 1 -- 172.21.15.7:0/239554176 learned_addr learned my addr 172.21.15.7:0/239554176 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f1488c8a640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1484102a80 0x7f148419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f1483fff640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14841083c0 0x7f148419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148948b640 1 -- 172.21.15.7:0/239554176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14841083c0 msgr2=0x7f148419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148948b640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14841083c0 0x7f148419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148948b640 1 -- 172.21.15.7:0/239554176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1484102a80 msgr2=0x7f148419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148948b640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1484102a80 0x7f148419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148948b640 1 -- 172.21.15.7:0/239554176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14841a0330 con 0x7f1484108d10 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f1483fff640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14841083c0 0x7f148419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.086+0000 7f148948b640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484108d10 0x7f148419fcc0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f147c005cc0 tx=0x7f147c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.087+0000 7f1481ffb640 1 -- 172.21.15.7:0/239554176 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c003bf0 con 0x7f1484108d10 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.087+0000 7f1481ffb640 1 -- 172.21.15.7:0/239554176 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f147c003d90 con 0x7f1484108d10 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.087+0000 7f148aeee640 1 -- 172.21.15.7:0/239554176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14841a05c0 con 0x7f1484108d10 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.087+0000 7f1481ffb640 1 -- 172.21.15.7:0/239554176 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c02fbc0 con 0x7f1484108d10 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.087+0000 7f148aeee640 1 -- 172.21.15.7:0/239554176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14841a6e40 con 0x7f1484108d10 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.090+0000 7f1491462740 1 Processor -- start 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.090+0000 7f1481ffb640 1 -- 172.21.15.7:0/239554176 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f147c02fd60 con 0x7f1484108d10 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.090+0000 7f1491462740 1 -- start start 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.090+0000 7f1491462740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e31070 0x5611641d82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.090+0000 7f1491462740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e081b0 0x5611641d8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.090+0000 7f1491462740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 0x5611641d8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.090+0000 7f1491462740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56116414eea0 con 0x561163e10390 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.090+0000 7f1491462740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56116413e2d0 con 0x561163e081b0 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.090+0000 7f1491462740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5611641420e0 con 0x561163e31070 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.090+0000 7f1483fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 0x5611641d8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.090+0000 7f1483fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 0x5611641d8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60768/0 (socket says 172.21.15.7:60768) 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.090+0000 7f1483fff640 1 -- 172.21.15.7:0/2548606996 learned_addr learned my addr 172.21.15.7:0/2548606996 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f1488c8a640 1 --2- 172.21.15.7:0/2548606996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e081b0 0x5611641d8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f1483fff640 1 --2- 172.21.15.7:0/2548606996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e31070 0x5611641d82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f1481ffb640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f146c0b6730 0x7f146c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f148948b640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f146c0b6730 0x7f146c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f1488c8a640 1 -- 172.21.15.7:0/2548606996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e31070 msgr2=0x5611641d82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f1488c8a640 1 --2- 172.21.15.7:0/2548606996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e31070 0x5611641d82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f1488c8a640 1 -- 172.21.15.7:0/2548606996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 msgr2=0x5611641d8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f1488c8a640 1 --2- 172.21.15.7:0/2548606996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 0x5611641d8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f1488c8a640 1 -- 172.21.15.7:0/2548606996 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561163e9c650 con 0x561163e081b0 2024-09-21T06:00:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f1483fff640 1 --2- 172.21.15.7:0/2548606996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 0x5611641d8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f1481ffb640 1 -- 172.21.15.7:0/239554176 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f147c108a40 con 0x7f1484108d10 2024-09-21T06:00:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f1488c8a640 1 --2- 172.21.15.7:0/2548606996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e081b0 0x5611641d8800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f147400ba70 tx=0x7f147400bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8165127a1fae1589 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f148948b640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f146c0b6730 0x7f146c0b8c40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f147c106290 tx=0x7f147c097510 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f146affd640 1 -- 172.21.15.7:0/2548606996 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474017420 con 0x561163e081b0 2024-09-21T06:00:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f146affd640 1 -- 172.21.15.7:0/2548606996 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1474017a70 con 0x561163e081b0 2024-09-21T06:00:49.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.091+0000 7f146affd640 1 -- 172.21.15.7:0/2548606996 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147400f960 con 0x561163e081b0 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.092+0000 7f1491462740 1 -- 172.21.15.7:0/2548606996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e081b0 msgr2=0x5611641d8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.092+0000 7f1491462740 1 --2- 172.21.15.7:0/2548606996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e081b0 0x5611641d8800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f147400ba70 tx=0x7f147400bf30 comp rx=0 tx=0).stop 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.092+0000 7f1491462740 1 -- 172.21.15.7:0/2548606996 shutdown_connections 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.092+0000 7f1491462740 1 --2- 172.21.15.7:0/2548606996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 0x5611641d8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.092+0000 7f1491462740 1 --2- 172.21.15.7:0/2548606996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e081b0 0x5611641d8800 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.092+0000 7f1491462740 1 --2- 172.21.15.7:0/2548606996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e31070 0x5611641d82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.092+0000 7f1491462740 1 -- 172.21.15.7:0/2548606996 >> 172.21.15.7:0/2548606996 conn(0x561163e25460 msgr2=0x5611641d61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.092+0000 7f1491462740 1 -- 172.21.15.7:0/2548606996 shutdown_connections 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.092+0000 7f1491462740 1 -- 172.21.15.7:0/2548606996 wait complete. 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.093+0000 7f1491462740 1 -- start start 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.093+0000 7f1491462740 1 Processor -- start 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.093+0000 7f1491462740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e081b0 0x5611641e3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.093+0000 7f1491462740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e10390 0x5611641e3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.093+0000 7f1491462740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e31070 0x5611641efd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.093+0000 7f1491462740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561163f9f700 con 0x561163e081b0 2024-09-21T06:00:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.093+0000 7f1491462740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5611640d9160 con 0x561163e10390 2024-09-21T06:00:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.093+0000 7f1491462740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5611641e6aa0 con 0x561163e31070 2024-09-21T06:00:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1491462740 10 client.0 _ll_register_callbacks cb 0x5611640f29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1483fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e081b0 0x5611641e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1483fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e081b0 0x5611641e3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60784/0 (socket says 172.21.15.7:60784) 2024-09-21T06:00:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1483fff640 1 -- 172.21.15.7:0/58016269 learned_addr learned my addr 172.21.15.7:0/58016269 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1488c8a640 1 --2- 172.21.15.7:0/58016269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e10390 0x5611641e3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1483fff640 1 --2- 172.21.15.7:0/58016269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e31070 0x5611641efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1483fff640 1 -- 172.21.15.7:0/58016269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e31070 msgr2=0x5611641efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1483fff640 1 --2- 172.21.15.7:0/58016269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e31070 0x5611641efd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1483fff640 1 -- 172.21.15.7:0/58016269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e10390 msgr2=0x5611641e3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1483fff640 1 --2- 172.21.15.7:0/58016269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e10390 0x5611641e3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1483fff640 1 -- 172.21.15.7:0/58016269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561164106c90 con 0x561163e081b0 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1483fff640 1 --2- 172.21.15.7:0/58016269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e081b0 0x5611641e3910 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f1478013f10 tx=0x7f1478004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239856febe8e08e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1463fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1463fff640 1 -- 172.21.15.7:0/58016269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1478004020 con 0x561163e081b0 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1463fff640 1 -- 172.21.15.7:0/58016269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f14780041c0 con 0x561163e081b0 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.094+0000 7f1491462740 1 -- 172.21.15.7:0/58016269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1474017a70 con 0x561163e081b0 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.095+0000 7f1463fff640 1 -- 172.21.15.7:0/58016269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f14780043c0 con 0x561163e081b0 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.095+0000 7f1491462740 10 client.17406 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.095+0000 7f1491462740 1 -- 172.21.15.7:0/58016269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5611641f2750 con 0x561163e081b0 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.095+0000 7f1463fff640 1 -- 172.21.15.7:0/58016269 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1474017a70 con 0x561163e081b0 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.095+0000 7f1463fff640 1 -- 172.21.15.7:0/58016269 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f147800f040 con 0x561163e081b0 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.095+0000 7f1491462740 10 client.17406 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.095+0000 7f1491462740 10 client.17406 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.095+0000 7f1491462740 20 client.17406 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.095+0000 7f1491462740 1 --2- 172.21.15.7:0/58016269 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561163def9f0 0x5611641f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.095+0000 7f1491462740 4 client.17406 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.095+0000 7f1491462740 1 -- 172.21.15.7:0/58016269 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561164150df0 con 0x561163def9f0 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.095+0000 7f1488c8a640 1 --2- 172.21.15.7:0/58016269 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561163def9f0 0x5611641f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.096+0000 7f1463fff640 10 client.17406 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.096+0000 7f1488c8a640 1 --2- 172.21.15.7:0/58016269 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561163def9f0 0x5611641f5cf0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adfb5af96a38b846 server_cookie=cbd2473e8540f520 in_seq=0 out_seq=0 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1463fff640 1 -- 172.21.15.7:0/58016269 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561164150df0 con 0x561163def9f0 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1463fff640 10 client.17406 handle_command_reply: tid=0 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1491462740 1 client.17406 shutdown 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1491462740 1 -- 172.21.15.7:0/58016269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e081b0 msgr2=0x5611641e3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1491462740 1 --2- 172.21.15.7:0/58016269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e081b0 0x5611641e3910 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f1478013f10 tx=0x7f1478004730 comp rx=0 tx=0).stop 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1491462740 1 -- 172.21.15.7:0/58016269 shutdown_connections 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1491462740 1 --2- 172.21.15.7:0/58016269 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561163def9f0 0x5611641f5cf0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1491462740 1 --2- 172.21.15.7:0/58016269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e31070 0x5611641efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1491462740 1 --2- 172.21.15.7:0/58016269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e10390 0x5611641e3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1463fff640 0 client.17406 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:49.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1491462740 1 --2- 172.21.15.7:0/58016269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e081b0 0x5611641e3910 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1491462740 1 -- 172.21.15.7:0/58016269 >> 172.21.15.7:0/58016269 conn(0x561163e25460 msgr2=0x5611641db450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:49.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1491462740 1 -- 172.21.15.7:0/58016269 shutdown_connections 2024-09-21T06:00:49.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.097+0000 7f1491462740 1 -- 172.21.15.7:0/58016269 wait complete. 2024-09-21T06:00:49.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.098+0000 7f1491462740 20 client.17406 trim_cache size 0 max 16384 2024-09-21T06:00:49.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.111+0000 7f1491462740 1 Processor -- start 2024-09-21T06:00:49.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1491462740 1 -- start start 2024-09-21T06:00:49.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1491462740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e081b0 0x5611641e57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1491462740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e10390 0x5611641efc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1491462740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e31070 0x5611641ddae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1491462740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14841b1ec0 con 0x561163e31070 2024-09-21T06:00:49.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1491462740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f14841af790 con 0x561163e081b0 2024-09-21T06:00:49.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1491462740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f14841ad600 con 0x561163e10390 2024-09-21T06:00:49.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1483fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e31070 0x5611641ddae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1483fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e31070 0x5611641ddae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60788/0 (socket says 172.21.15.7:60788) 2024-09-21T06:00:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1483fff640 1 -- 172.21.15.7:0/1213727996 learned_addr learned my addr 172.21.15.7:0/1213727996 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1483fff640 1 --2- 172.21.15.7:0/1213727996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e081b0 0x5611641e57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1488c8a640 1 --2- 172.21.15.7:0/1213727996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e10390 0x5611641efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1483fff640 1 -- 172.21.15.7:0/1213727996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e10390 msgr2=0x5611641efc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1483fff640 1 --2- 172.21.15.7:0/1213727996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e10390 0x5611641efc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1483fff640 1 -- 172.21.15.7:0/1213727996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e081b0 msgr2=0x5611641e57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1483fff640 1 --2- 172.21.15.7:0/1213727996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e081b0 0x5611641e57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.112+0000 7f1483fff640 1 -- 172.21.15.7:0/1213727996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611641e1e10 con 0x561163e31070 2024-09-21T06:00:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.113+0000 7f1483fff640 1 --2- 172.21.15.7:0/1213727996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e31070 0x5611641ddae0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f1478004610 tx=0x7f14780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d3149820907e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.113+0000 7f146a7fc640 1 -- 172.21.15.7:0/1213727996 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147802d040 con 0x561163e31070 2024-09-21T06:00:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.113+0000 7f146a7fc640 1 -- 172.21.15.7:0/1213727996 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14780035f0 con 0x561163e31070 2024-09-21T06:00:49.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.113+0000 7f146a7fc640 1 -- 172.21.15.7:0/1213727996 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1478010ae0 con 0x561163e31070 2024-09-21T06:00:49.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.114+0000 7f1491462740 1 -- 172.21.15.7:0/1213727996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e31070 msgr2=0x5611641ddae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:49.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.114+0000 7f1491462740 1 --2- 172.21.15.7:0/1213727996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e31070 0x5611641ddae0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f1478004610 tx=0x7f14780046c0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.114+0000 7f1491462740 1 -- 172.21.15.7:0/1213727996 shutdown_connections 2024-09-21T06:00:49.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.114+0000 7f1491462740 1 --2- 172.21.15.7:0/1213727996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e31070 0x5611641ddae0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.114+0000 7f1491462740 1 --2- 172.21.15.7:0/1213727996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e10390 0x5611641efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.114+0000 7f1491462740 1 --2- 172.21.15.7:0/1213727996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e081b0 0x5611641e57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.114+0000 7f1491462740 1 -- 172.21.15.7:0/1213727996 >> 172.21.15.7:0/1213727996 conn(0x561163e25460 msgr2=0x5611641dd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:49.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.114+0000 7f1491462740 1 -- 172.21.15.7:0/1213727996 shutdown_connections 2024-09-21T06:00:49.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.114+0000 7f1491462740 1 -- 172.21.15.7:0/1213727996 wait complete. 2024-09-21T06:00:49.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.114+0000 7f1491462740 1 -- start start 2024-09-21T06:00:49.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.114+0000 7f1491462740 1 Processor -- start 2024-09-21T06:00:49.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1491462740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e081b0 0x5611641e9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1491462740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 0x5611641ea510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1491462740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e31070 0x56116425f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1491462740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14841adc50 con 0x561163e10390 2024-09-21T06:00:49.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1491462740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f14841af0c0 con 0x561163e31070 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1491462740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f14841ae320 con 0x561163e081b0 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1491462740 10 client.0 _ll_register_callbacks cb 0x7f1478013b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1488c8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 0x5611641ea510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1488c8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 0x5611641ea510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60790/0 (socket says 172.21.15.7:60790) 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1488c8a640 1 -- 172.21.15.7:0/4120288353 learned_addr learned my addr 172.21.15.7:0/4120288353 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1483fff640 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e081b0 0x5611641e9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1483fff640 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e31070 0x56116425f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1488c8a640 1 -- 172.21.15.7:0/4120288353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e081b0 msgr2=0x5611641e9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1488c8a640 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e081b0 0x5611641e9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1488c8a640 1 -- 172.21.15.7:0/4120288353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e31070 msgr2=0x56116425f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1488c8a640 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e31070 0x56116425f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1488c8a640 1 -- 172.21.15.7:0/4120288353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611641ead90 con 0x561163e10390 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.115+0000 7f1483fff640 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e31070 0x56116425f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:49.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1488c8a640 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 0x5611641ea510 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f147400f570 tx=0x7f147400b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed82ddea9f7d7c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:49.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1463fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:49.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1463fff640 1 -- 172.21.15.7:0/4120288353 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474005250 con 0x561163e10390 2024-09-21T06:00:49.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1463fff640 1 -- 172.21.15.7:0/4120288353 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f14740053f0 con 0x561163e10390 2024-09-21T06:00:49.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1491462740 1 -- 172.21.15.7:0/4120288353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14780035f0 con 0x561163e10390 2024-09-21T06:00:49.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1463fff640 1 -- 172.21.15.7:0/4120288353 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1474037050 con 0x561163e10390 2024-09-21T06:00:49.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1491462740 10 client.17412 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:49.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1491462740 1 -- 172.21.15.7:0/4120288353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561164260c40 con 0x561163e10390 2024-09-21T06:00:49.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1463fff640 1 -- 172.21.15.7:0/4120288353 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14780035f0 con 0x561163e10390 2024-09-21T06:00:49.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1463fff640 1 -- 172.21.15.7:0/4120288353 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f147400f5a0 con 0x561163e10390 2024-09-21T06:00:49.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1491462740 10 client.17412 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:49.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1491462740 10 client.17412 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:49.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1491462740 20 client.17412 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1491462740 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561163dc4da0 0x5611642631a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1491462740 4 client.17412 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.116+0000 7f1491462740 1 -- 172.21.15.7:0/4120288353 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56116414c8a0 con 0x561163dc4da0 2024-09-21T06:00:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.117+0000 7f1483fff640 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561163dc4da0 0x5611642631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.117+0000 7f1463fff640 10 client.17412 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.117+0000 7f1483fff640 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561163dc4da0 0x5611642631a0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6d4967c6278a257 server_cookie=e86271820c8e1615 in_seq=0 out_seq=0 2024-09-21T06:00:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.117+0000 7f1463fff640 1 -- 172.21.15.7:0/4120288353 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56116414c8a0 con 0x561163dc4da0 2024-09-21T06:00:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.117+0000 7f1463fff640 10 client.17412 handle_command_reply: tid=0 2024-09-21T06:00:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.117+0000 7f1491462740 1 client.17412 shutdown 2024-09-21T06:00:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.118+0000 7f1491462740 1 -- 172.21.15.7:0/4120288353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 msgr2=0x5611641ea510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.118+0000 7f1491462740 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 0x5611641ea510 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f147400f570 tx=0x7f147400b680 comp rx=0 tx=0).stop 2024-09-21T06:00:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.118+0000 7f1491462740 1 -- 172.21.15.7:0/4120288353 shutdown_connections 2024-09-21T06:00:49.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.118+0000 7f1491462740 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x561163dc4da0 0x5611642631a0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.118+0000 7f1491462740 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561163e10390 0x5611641ea510 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.118+0000 7f1491462740 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561163e31070 0x56116425f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.118+0000 7f1491462740 1 --2- 172.21.15.7:0/4120288353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x561163e081b0 0x5611641e9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.118+0000 7f1491462740 1 -- 172.21.15.7:0/4120288353 >> 172.21.15.7:0/4120288353 conn(0x561163e25460 msgr2=0x5611641dd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:49.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.118+0000 7f1463fff640 0 client.17412 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:49.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.118+0000 7f1491462740 1 -- 172.21.15.7:0/4120288353 shutdown_connections 2024-09-21T06:00:49.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.118+0000 7f1491462740 1 -- 172.21.15.7:0/4120288353 wait complete. 2024-09-21T06:00:49.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.118+0000 7f1491462740 20 client.17412 trim_cache size 0 max 16384 2024-09-21T06:00:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:49.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.119+0000 7f148aeee640 1 -- 172.21.15.7:0/239554176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f146c0b6730 msgr2=0x7f146c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:49.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.119+0000 7f148aeee640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f146c0b6730 0x7f146c0b8c40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f147c106290 tx=0x7f147c097510 comp rx=0 tx=0).stop 2024-09-21T06:00:49.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.119+0000 7f148aeee640 1 -- 172.21.15.7:0/239554176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484108d10 msgr2=0x7f148419fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:49.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.119+0000 7f148aeee640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484108d10 0x7f148419fcc0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f147c005cc0 tx=0x7f147c02f380 comp rx=0 tx=0).stop 2024-09-21T06:00:49.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.119+0000 7f148aeee640 1 -- 172.21.15.7:0/239554176 shutdown_connections 2024-09-21T06:00:49.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.119+0000 7f148aeee640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f146c0b6730 0x7f146c0b8c40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.119+0000 7f148aeee640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484108d10 0x7f148419fcc0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.119+0000 7f148aeee640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14841083c0 0x7f148419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.119+0000 7f148aeee640 1 --2- 172.21.15.7:0/239554176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1484102a80 0x7f148419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:49.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.119+0000 7f148aeee640 1 -- 172.21.15.7:0/239554176 >> 172.21.15.7:0/239554176 conn(0x7f1484079740 msgr2=0x7f148406be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:49.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.119+0000 7f148aeee640 1 -- 172.21.15.7:0/239554176 shutdown_connections 2024-09-21T06:00:49.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:49.119+0000 7f148aeee640 1 -- 172.21.15.7:0/239554176 wait complete. 2024-09-21T06:00:50.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:50 smithi119 ceph-mon[34833]: pgmap v528: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:00:50.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:50 smithi027 ceph-mon[34364]: pgmap v528: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:00:50.778 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:00:50.778 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:00:50.806 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:50 smithi007 ceph-mon[30983]: pgmap v528: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:00:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:51.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.519+0000 7fcc3a43a640 1 -- 172.21.15.7:0/245751750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc341052a0 msgr2=0x7fcc3410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:51.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.519+0000 7fcc3a43a640 1 --2- 172.21.15.7:0/245751750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc341052a0 0x7fcc3410d930 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009900 tx=0x7fcc2802a410 comp rx=0 tx=0).stop 2024-09-21T06:00:51.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.519+0000 7fcc3a43a640 1 -- 172.21.15.7:0/245751750 shutdown_connections 2024-09-21T06:00:51.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.519+0000 7fcc3a43a640 1 --2- 172.21.15.7:0/245751750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc341052a0 0x7fcc3410d930 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.519+0000 7fcc3a43a640 1 --2- 172.21.15.7:0/245751750 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc3410de70 0x7fcc34110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.519+0000 7fcc3a43a640 1 --2- 172.21.15.7:0/245751750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc341048c0 0x7fcc34104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.519+0000 7fcc3a43a640 1 -- 172.21.15.7:0/245751750 >> 172.21.15.7:0/245751750 conn(0x7fcc34079760 msgr2=0x7fcc34079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:51.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.519+0000 7fcc3a43a640 1 -- 172.21.15.7:0/245751750 shutdown_connections 2024-09-21T06:00:51.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.519+0000 7fcc3a43a640 1 -- 172.21.15.7:0/245751750 wait complete. 2024-09-21T06:00:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.520+0000 7fcc3a43a640 1 Processor -- start 2024-09-21T06:00:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.520+0000 7fcc3a43a640 1 -- start start 2024-09-21T06:00:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc3a43a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc341048c0 0x7fcc3419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc3a43a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc341052a0 0x7fcc3419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc3a43a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc3410de70 0x7fcc341a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc3a43a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcc34113ab0 con 0x7fcc341048c0 2024-09-21T06:00:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc3a43a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcc34113930 con 0x7fcc341052a0 2024-09-21T06:00:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc3a43a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcc34113c30 con 0x7fcc3410de70 2024-09-21T06:00:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc33fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc341048c0 0x7fcc3419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc33fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc341048c0 0x7fcc3419c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60804/0 (socket says 172.21.15.7:60804) 2024-09-21T06:00:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc33fff640 1 -- 172.21.15.7:0/23046734 learned_addr learned my addr 172.21.15.7:0/23046734 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc337fe640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc341052a0 0x7fcc3419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc389d7640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc3410de70 0x7fcc341a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc33fff640 1 -- 172.21.15.7:0/23046734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc3410de70 msgr2=0x7fcc341a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc33fff640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc3410de70 0x7fcc341a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc33fff640 1 -- 172.21.15.7:0/23046734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc341052a0 msgr2=0x7fcc3419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc33fff640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc341052a0 0x7fcc3419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc33fff640 1 -- 172.21.15.7:0/23046734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc341a2670 con 0x7fcc341048c0 2024-09-21T06:00:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc337fe640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc341052a0 0x7fcc3419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc33fff640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc341048c0 0x7fcc3419c700 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400e9c0 tx=0x7fcc2400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.521+0000 7fcc317fa640 1 -- 172.21.15.7:0/23046734 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2400cd80 con 0x7fcc341048c0 2024-09-21T06:00:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.522+0000 7fcc317fa640 1 -- 172.21.15.7:0/23046734 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc240035f0 con 0x7fcc341048c0 2024-09-21T06:00:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.522+0000 7fcc3a43a640 1 -- 172.21.15.7:0/23046734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc341a2960 con 0x7fcc341048c0 2024-09-21T06:00:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.522+0000 7fcc317fa640 1 -- 172.21.15.7:0/23046734 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24010690 con 0x7fcc341048c0 2024-09-21T06:00:51.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.522+0000 7fcc3a43a640 1 -- 172.21.15.7:0/23046734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc341a90c0 con 0x7fcc341048c0 2024-09-21T06:00:51.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.525+0000 7fcc409ae740 1 Processor -- start 2024-09-21T06:00:51.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.525+0000 7fcc409ae740 1 -- start start 2024-09-21T06:00:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.525+0000 7fcc409ae740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 0x56153c593430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.525+0000 7fcc409ae740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1c3490 0x56153c593970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.525+0000 7fcc409ae740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 0x56153c593eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.525+0000 7fcc409ae740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56153c509e60 con 0x56153c1cb670 2024-09-21T06:00:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.525+0000 7fcc409ae740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56153c4f9290 con 0x56153c1ec350 2024-09-21T06:00:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.525+0000 7fcc409ae740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56153c4fd0a0 con 0x56153c1c3490 2024-09-21T06:00:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.525+0000 7fcc317fa640 1 -- 172.21.15.7:0/23046734 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fcc24004000 con 0x7fcc341048c0 2024-09-21T06:00:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.525+0000 7fcc337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 0x56153c593eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.525+0000 7fcc337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 0x56153c593eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60810/0 (socket says 172.21.15.7:60810) 2024-09-21T06:00:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.525+0000 7fcc337fe640 1 -- 172.21.15.7:0/49956988 learned_addr learned my addr 172.21.15.7:0/49956988 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:51.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.525+0000 7fcc389d7640 1 --2- 172.21.15.7:0/49956988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 0x56153c593430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.526+0000 7fcc33fff640 1 --2- 172.21.15.7:0/49956988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1c3490 0x56153c593970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.526+0000 7fcc337fe640 1 -- 172.21.15.7:0/49956988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1c3490 msgr2=0x56153c593970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:51.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.526+0000 7fcc337fe640 1 --2- 172.21.15.7:0/49956988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1c3490 0x56153c593970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.526+0000 7fcc337fe640 1 -- 172.21.15.7:0/49956988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 msgr2=0x56153c593430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:51.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.526+0000 7fcc337fe640 1 --2- 172.21.15.7:0/49956988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 0x56153c593430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.526+0000 7fcc337fe640 1 -- 172.21.15.7:0/49956988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56153c257930 con 0x56153c1cb670 2024-09-21T06:00:51.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.526+0000 7fcc337fe640 1 --2- 172.21.15.7:0/49956988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 0x56153c593eb0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fcc28031440 tx=0x7fcc28032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592adc9235441be9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:51.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.526+0000 7fcc317fa640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcc1c0b6700 0x7fcc1c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.526+0000 7fcc1a7fc640 1 -- 172.21.15.7:0/49956988 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2803f070 con 0x56153c1cb670 2024-09-21T06:00:51.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.526+0000 7fcc389d7640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcc1c0b6700 0x7fcc1c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.526+0000 7fcc1a7fc640 1 -- 172.21.15.7:0/49956988 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc280316a0 con 0x56153c1cb670 2024-09-21T06:00:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.526+0000 7fcc1a7fc640 1 -- 172.21.15.7:0/49956988 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28035070 con 0x56153c1cb670 2024-09-21T06:00:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.526+0000 7fcc317fa640 1 -- 172.21.15.7:0/23046734 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fcc240e7ca0 con 0x7fcc341048c0 2024-09-21T06:00:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.527+0000 7fcc409ae740 1 -- 172.21.15.7:0/49956988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 msgr2=0x56153c593eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.527+0000 7fcc389d7640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcc1c0b6700 0x7fcc1c0b8c10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c005fd0 tx=0x7fcc2c009740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.527+0000 7fcc409ae740 1 --2- 172.21.15.7:0/49956988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 0x56153c593eb0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fcc28031440 tx=0x7fcc28032c50 comp rx=0 tx=0).stop 2024-09-21T06:00:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.527+0000 7fcc409ae740 1 -- 172.21.15.7:0/49956988 shutdown_connections 2024-09-21T06:00:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.527+0000 7fcc409ae740 1 --2- 172.21.15.7:0/49956988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 0x56153c593eb0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.527+0000 7fcc409ae740 1 --2- 172.21.15.7:0/49956988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1c3490 0x56153c593970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.527+0000 7fcc409ae740 1 --2- 172.21.15.7:0/49956988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 0x56153c593430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.527+0000 7fcc409ae740 1 -- 172.21.15.7:0/49956988 >> 172.21.15.7:0/49956988 conn(0x56153c1e0740 msgr2=0x56153c591320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.527+0000 7fcc409ae740 1 -- 172.21.15.7:0/49956988 shutdown_connections 2024-09-21T06:00:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.527+0000 7fcc409ae740 1 -- 172.21.15.7:0/49956988 wait complete. 2024-09-21T06:00:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.528+0000 7fcc409ae740 1 -- start start 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.528+0000 7fcc409ae740 1 Processor -- start 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.528+0000 7fcc409ae740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1c3490 0x56153c59f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.528+0000 7fcc409ae740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1cb670 0x56153c59f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.528+0000 7fcc409ae740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1ec350 0x56153c5aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.528+0000 7fcc409ae740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56153c35a890 con 0x56153c1ec350 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.528+0000 7fcc409ae740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56153c493d40 con 0x56153c1c3490 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.528+0000 7fcc409ae740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56153c5a1bb0 con 0x56153c1cb670 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.528+0000 7fcc409ae740 10 client.0 _ll_register_callbacks cb 0x56153c4f7c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.528+0000 7fcc389d7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1ec350 0x56153c5aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.528+0000 7fcc389d7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1ec350 0x56153c5aaea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60826/0 (socket says 172.21.15.7:60826) 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc389d7640 1 -- 172.21.15.7:0/1078944680 learned_addr learned my addr 172.21.15.7:0/1078944680 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc33fff640 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1c3490 0x56153c59f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc337fe640 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1cb670 0x56153c59f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc33fff640 1 -- 172.21.15.7:0/1078944680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1cb670 msgr2=0x56153c59f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc33fff640 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1cb670 0x56153c59f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc33fff640 1 -- 172.21.15.7:0/1078944680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1ec350 msgr2=0x56153c5aaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc33fff640 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1ec350 0x56153c5aaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc33fff640 1 -- 172.21.15.7:0/1078944680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56153c5ab490 con 0x56153c1c3490 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc389d7640 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1ec350 0x56153c5aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc33fff640 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1c3490 0x56153c59f000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc240e5440 tx=0x7fcc240039d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=383e58882957837 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc137fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc137fe640 1 -- 172.21.15.7:0/1078944680 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc240ad910 con 0x56153c1c3490 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc137fe640 1 -- 172.21.15.7:0/1078944680 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fcc240042f0 con 0x56153c1c3490 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.529+0000 7fcc409ae740 1 -- 172.21.15.7:0/1078944680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc280316a0 con 0x56153c1c3490 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.530+0000 7fcc137fe640 1 -- 172.21.15.7:0/1078944680 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcc240ad2b0 con 0x56153c1c3490 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.530+0000 7fcc409ae740 10 client.26828 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.530+0000 7fcc409ae740 1 -- 172.21.15.7:0/1078944680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56153c5ade10 con 0x56153c1c3490 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.530+0000 7fcc137fe640 1 -- 172.21.15.7:0/1078944680 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc280316a0 con 0x56153c1c3490 2024-09-21T06:00:51.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.530+0000 7fcc137fe640 1 -- 172.21.15.7:0/1078944680 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcc240b20d0 con 0x56153c1c3490 2024-09-21T06:00:51.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.530+0000 7fcc409ae740 10 client.26828 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:51.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.530+0000 7fcc409ae740 10 client.26828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:51.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.530+0000 7fcc409ae740 20 client.26828 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:51.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.530+0000 7fcc409ae740 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56153c1aacd0 0x56153c5b1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.530+0000 7fcc409ae740 4 client.26828 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:51.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.530+0000 7fcc409ae740 1 -- 172.21.15.7:0/1078944680 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56153c50bdb0 con 0x56153c1aacd0 2024-09-21T06:00:51.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.530+0000 7fcc337fe640 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56153c1aacd0 0x56153c5b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.531+0000 7fcc337fe640 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56153c1aacd0 0x56153c5b1270 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2653efae07e9fce9 server_cookie=472d118ca30347b8 in_seq=0 out_seq=0 2024-09-21T06:00:51.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.531+0000 7fcc137fe640 10 client.26828 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:51.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc137fe640 1 -- 172.21.15.7:0/1078944680 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56153c50bdb0 con 0x56153c1aacd0 2024-09-21T06:00:51.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc137fe640 10 client.26828 handle_command_reply: tid=0 2024-09-21T06:00:51.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc409ae740 1 client.26828 shutdown 2024-09-21T06:00:51.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc409ae740 1 -- 172.21.15.7:0/1078944680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1c3490 msgr2=0x56153c59f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:51.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc409ae740 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1c3490 0x56153c59f000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc240e5440 tx=0x7fcc240039d0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc409ae740 1 -- 172.21.15.7:0/1078944680 shutdown_connections 2024-09-21T06:00:51.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc409ae740 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56153c1aacd0 0x56153c5b1270 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc409ae740 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1ec350 0x56153c5aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc409ae740 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1cb670 0x56153c59f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc409ae740 1 --2- 172.21.15.7:0/1078944680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1c3490 0x56153c59f000 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc137fe640 0 client.26828 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:51.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc409ae740 1 -- 172.21.15.7:0/1078944680 >> 172.21.15.7:0/1078944680 conn(0x56153c1e0740 msgr2=0x56153c596610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:51.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc409ae740 1 -- 172.21.15.7:0/1078944680 shutdown_connections 2024-09-21T06:00:51.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc409ae740 1 -- 172.21.15.7:0/1078944680 wait complete. 2024-09-21T06:00:51.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.532+0000 7fcc409ae740 20 client.26828 trim_cache size 0 max 16384 2024-09-21T06:00:51.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.550+0000 7fcc409ae740 1 Processor -- start 2024-09-21T06:00:51.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.550+0000 7fcc409ae740 1 -- start start 2024-09-21T06:00:51.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.550+0000 7fcc409ae740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1c3490 0x56153c59a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.550+0000 7fcc409ae740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 0x56153c5aada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.550+0000 7fcc409ae740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 0x56153c594e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.550+0000 7fcc409ae740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341b4020 con 0x56153c1cb670 2024-09-21T06:00:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.550+0000 7fcc409ae740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341b18f0 con 0x56153c1ec350 2024-09-21T06:00:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.550+0000 7fcc409ae740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341af760 con 0x56153c1c3490 2024-09-21T06:00:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.550+0000 7fcc337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 0x56153c5aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.550+0000 7fcc337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 0x56153c5aada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60830/0 (socket says 172.21.15.7:60830) 2024-09-21T06:00:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.550+0000 7fcc337fe640 1 -- 172.21.15.7:0/2160290822 learned_addr learned my addr 172.21.15.7:0/2160290822 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.550+0000 7fcc389d7640 1 --2- 172.21.15.7:0/2160290822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 0x56153c594e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.550+0000 7fcc33fff640 1 --2- 172.21.15.7:0/2160290822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1c3490 0x56153c59a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.551+0000 7fcc337fe640 1 -- 172.21.15.7:0/2160290822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1c3490 msgr2=0x56153c59a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.551+0000 7fcc337fe640 1 --2- 172.21.15.7:0/2160290822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1c3490 0x56153c59a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.551+0000 7fcc337fe640 1 -- 172.21.15.7:0/2160290822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 msgr2=0x56153c594e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.551+0000 7fcc337fe640 1 --2- 172.21.15.7:0/2160290822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 0x56153c594e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.551+0000 7fcc337fe640 1 -- 172.21.15.7:0/2160290822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56153c595720 con 0x56153c1cb670 2024-09-21T06:00:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.551+0000 7fcc33fff640 1 --2- 172.21.15.7:0/2160290822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1c3490 0x56153c59a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:51.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.551+0000 7fcc337fe640 1 --2- 172.21.15.7:0/2160290822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 0x56153c5aada0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fcc28005310 tx=0x7fcc28005340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62cb09107490b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:51.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.551+0000 7fcc19ffb640 1 -- 172.21.15.7:0/2160290822 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2803f040 con 0x56153c1cb670 2024-09-21T06:00:51.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.551+0000 7fcc19ffb640 1 -- 172.21.15.7:0/2160290822 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc28004040 con 0x56153c1cb670 2024-09-21T06:00:51.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.551+0000 7fcc19ffb640 1 -- 172.21.15.7:0/2160290822 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28035040 con 0x56153c1cb670 2024-09-21T06:00:51.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.552+0000 7fcc409ae740 1 -- 172.21.15.7:0/2160290822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 msgr2=0x56153c5aada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:51.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.552+0000 7fcc409ae740 1 --2- 172.21.15.7:0/2160290822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 0x56153c5aada0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fcc28005310 tx=0x7fcc28005340 comp rx=0 tx=0).stop 2024-09-21T06:00:51.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.552+0000 7fcc409ae740 1 -- 172.21.15.7:0/2160290822 shutdown_connections 2024-09-21T06:00:51.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.552+0000 7fcc409ae740 1 --2- 172.21.15.7:0/2160290822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1cb670 0x56153c5aada0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.552+0000 7fcc409ae740 1 --2- 172.21.15.7:0/2160290822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 0x56153c594e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.552+0000 7fcc409ae740 1 --2- 172.21.15.7:0/2160290822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1c3490 0x56153c59a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.552+0000 7fcc409ae740 1 -- 172.21.15.7:0/2160290822 >> 172.21.15.7:0/2160290822 conn(0x56153c1e0740 msgr2=0x56153c5a0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.552+0000 7fcc409ae740 1 -- 172.21.15.7:0/2160290822 shutdown_connections 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.552+0000 7fcc409ae740 1 -- 172.21.15.7:0/2160290822 wait complete. 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.552+0000 7fcc409ae740 1 -- start start 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc409ae740 1 Processor -- start 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc409ae740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1c3490 0x56153c5a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc409ae740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1cb670 0x56153c5a3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc409ae740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 0x56153c5a3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc409ae740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341afdb0 con 0x56153c1c3490 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc409ae740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341b1220 con 0x56153c1ec350 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc409ae740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341b0480 con 0x56153c1cb670 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc409ae740 10 client.0 _ll_register_callbacks cb 0x7fcc24003d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc33fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1c3490 0x56153c5a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc33fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1c3490 0x56153c5a2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60840/0 (socket says 172.21.15.7:60840) 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc33fff640 1 -- 172.21.15.7:0/2225286885 learned_addr learned my addr 172.21.15.7:0/2225286885 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc389d7640 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 0x56153c5a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc337fe640 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1cb670 0x56153c5a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc33fff640 1 -- 172.21.15.7:0/2225286885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1cb670 msgr2=0x56153c5a3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc33fff640 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1cb670 0x56153c5a3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc33fff640 1 -- 172.21.15.7:0/2225286885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 msgr2=0x56153c5a3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc33fff640 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 0x56153c5a3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc33fff640 1 -- 172.21.15.7:0/2225286885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56153c61ace0 con 0x56153c1c3490 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.553+0000 7fcc389d7640 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 0x56153c5a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.554+0000 7fcc33fff640 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1c3490 0x56153c5a2ee0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fcc240adad0 tx=0x7fcc240a9fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7d07676af1e12f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.554+0000 7fcc137fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.554+0000 7fcc137fe640 1 -- 172.21.15.7:0/2225286885 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc240ad490 con 0x56153c1c3490 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.554+0000 7fcc137fe640 1 -- 172.21.15.7:0/2225286885 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fcc240a9560 con 0x56153c1c3490 2024-09-21T06:00:51.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.554+0000 7fcc409ae740 1 -- 172.21.15.7:0/2225286885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc28004040 con 0x56153c1c3490 2024-09-21T06:00:51.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.554+0000 7fcc137fe640 1 -- 172.21.15.7:0/2225286885 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcc240ad910 con 0x56153c1c3490 2024-09-21T06:00:51.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.554+0000 7fcc409ae740 10 client.17430 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:51.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.554+0000 7fcc409ae740 1 -- 172.21.15.7:0/2225286885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56153c61bfa0 con 0x56153c1c3490 2024-09-21T06:00:51.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.554+0000 7fcc137fe640 1 -- 172.21.15.7:0/2225286885 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc28004040 con 0x56153c1c3490 2024-09-21T06:00:51.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.554+0000 7fcc137fe640 1 -- 172.21.15.7:0/2225286885 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcc240e5b90 con 0x56153c1c3490 2024-09-21T06:00:51.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.554+0000 7fcc409ae740 10 client.17430 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:51.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.554+0000 7fcc409ae740 10 client.17430 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:51.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.554+0000 7fcc409ae740 20 client.17430 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:51.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.555+0000 7fcc409ae740 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56153c180080 0x56153c61e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:51.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.555+0000 7fcc409ae740 4 client.17430 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:00:51.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.555+0000 7fcc409ae740 1 -- 172.21.15.7:0/2225286885 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56153c507860 con 0x56153c180080 2024-09-21T06:00:51.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.555+0000 7fcc337fe640 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56153c180080 0x56153c61e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:51.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.555+0000 7fcc337fe640 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56153c180080 0x56153c61e590 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=181f1255df5da941 server_cookie=4fa50f7f7ca611a6 in_seq=0 out_seq=0 2024-09-21T06:00:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.555+0000 7fcc137fe640 10 client.17430 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.557+0000 7fcc137fe640 1 -- 172.21.15.7:0/2225286885 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56153c507860 con 0x56153c180080 2024-09-21T06:00:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.557+0000 7fcc137fe640 10 client.17430 handle_command_reply: tid=0 2024-09-21T06:00:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.557+0000 7fcc409ae740 1 client.17430 shutdown 2024-09-21T06:00:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.557+0000 7fcc409ae740 1 -- 172.21.15.7:0/2225286885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1c3490 msgr2=0x56153c5a2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.557+0000 7fcc409ae740 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1c3490 0x56153c5a2ee0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fcc240adad0 tx=0x7fcc240a9fe0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.557+0000 7fcc409ae740 1 -- 172.21.15.7:0/2225286885 shutdown_connections 2024-09-21T06:00:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.557+0000 7fcc409ae740 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56153c180080 0x56153c61e590 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.557+0000 7fcc409ae740 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56153c1ec350 0x56153c5a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.557+0000 7fcc409ae740 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56153c1cb670 0x56153c5a3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.557+0000 7fcc409ae740 1 --2- 172.21.15.7:0/2225286885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56153c1c3490 0x56153c5a2ee0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.557+0000 7fcc137fe640 0 client.17430 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:51.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.557+0000 7fcc409ae740 1 -- 172.21.15.7:0/2225286885 >> 172.21.15.7:0/2225286885 conn(0x56153c1e0740 msgr2=0x56153c594bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:51.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc409ae740 1 -- 172.21.15.7:0/2225286885 shutdown_connections 2024-09-21T06:00:51.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc409ae740 1 -- 172.21.15.7:0/2225286885 wait complete. 2024-09-21T06:00:51.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc409ae740 20 client.17430 trim_cache size 0 max 16384 2024-09-21T06:00:51.563 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:00:51.563 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:00:51.563 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "3bd778db-a0ed-42ad-8a79-14a200f0734e", 2024-09-21T06:00:51.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:00:51.563 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:00:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc3a43a640 1 -- 172.21.15.7:0/23046734 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcc1c0b6700 msgr2=0x7fcc1c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc3a43a640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcc1c0b6700 0x7fcc1c0b8c10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c005fd0 tx=0x7fcc2c009740 comp rx=0 tx=0).stop 2024-09-21T06:00:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc3a43a640 1 -- 172.21.15.7:0/23046734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc341048c0 msgr2=0x7fcc3419c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc3a43a640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc341048c0 0x7fcc3419c700 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400e9c0 tx=0x7fcc2400ee80 comp rx=0 tx=0).stop 2024-09-21T06:00:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc3a43a640 1 -- 172.21.15.7:0/23046734 shutdown_connections 2024-09-21T06:00:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc3a43a640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fcc1c0b6700 0x7fcc1c0b8c10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc3a43a640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc3410de70 0x7fcc341a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc3a43a640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcc341052a0 0x7fcc3419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc3a43a640 1 --2- 172.21.15.7:0/23046734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc341048c0 0x7fcc3419c700 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc3a43a640 1 -- 172.21.15.7:0/23046734 >> 172.21.15.7:0/23046734 conn(0x7fcc34079760 msgr2=0x7fcc340ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc3a43a640 1 -- 172.21.15.7:0/23046734 shutdown_connections 2024-09-21T06:00:51.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:51.558+0000 7fcc3a43a640 1 -- 172.21.15.7:0/23046734 wait complete. 2024-09-21T06:00:52.372 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:00:52.675 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:52.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:52 smithi027 ceph-mon[34364]: pgmap v529: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:00:52.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:52 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:00:52.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:52 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:52.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:52 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:00:52.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:52 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:52.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:52 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:00:52.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:52 smithi007 ceph-mon[30983]: pgmap v529: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:00:52.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:52 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:00:52.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:52 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:52.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:52 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:00:52.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:52 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:52.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:52 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:00:52.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:52 smithi119 ceph-mon[34833]: pgmap v529: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:00:52.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:52 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:00:52.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:52 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:52.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:52 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:00:52.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:52 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:00:52.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:52 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:00:53.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.161+0000 7f81b58e9640 1 -- 172.21.15.7:0/2734280001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b0109e10 msgr2=0x7f81b0110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.161+0000 7f81b58e9640 1 --2- 172.21.15.7:0/2734280001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b0109e10 0x7f81b0110640 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f81a8009900 tx=0x7f81a802a410 comp rx=0 tx=0).stop 2024-09-21T06:00:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.161+0000 7f81b58e9640 1 -- 172.21.15.7:0/2734280001 shutdown_connections 2024-09-21T06:00:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.161+0000 7f81b58e9640 1 --2- 172.21.15.7:0/2734280001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b0109e10 0x7f81b0110640 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.161+0000 7f81b58e9640 1 --2- 172.21.15.7:0/2734280001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81b01094c0 0x7f81b01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.161+0000 7f81b58e9640 1 --2- 172.21.15.7:0/2734280001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81b0103b80 0x7f81b0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.161+0000 7f81b58e9640 1 -- 172.21.15.7:0/2734280001 >> 172.21.15.7:0/2734280001 conn(0x7f81b00ff610 msgr2=0x7f81b0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.161+0000 7f81b58e9640 1 -- 172.21.15.7:0/2734280001 shutdown_connections 2024-09-21T06:00:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.161+0000 7f81b58e9640 1 -- 172.21.15.7:0/2734280001 wait complete. 2024-09-21T06:00:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.162+0000 7f81b58e9640 1 Processor -- start 2024-09-21T06:00:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.162+0000 7f81b58e9640 1 -- start start 2024-09-21T06:00:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.162+0000 7f81b58e9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81b0103b80 0x7f81b019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.162+0000 7f81b58e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b01094c0 0x7f81b019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.162+0000 7f81b58e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81b0109e10 0x7f81b019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.162+0000 7f81b58e9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0113ad0 con 0x7f81b01094c0 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.162+0000 7f81b58e9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0113950 con 0x7f81b0103b80 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.162+0000 7f81b58e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0113c50 con 0x7f81b0109e10 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81ae7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b01094c0 0x7f81b019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81ae7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b01094c0 0x7f81b019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60862/0 (socket says 172.21.15.7:60862) 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81ae7fc640 1 -- 172.21.15.7:0/175688387 learned_addr learned my addr 172.21.15.7:0/175688387 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81af7fe640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81b0109e10 0x7f81b019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81aeffd640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81b0103b80 0x7f81b019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81ae7fc640 1 -- 172.21.15.7:0/175688387 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81b0109e10 msgr2=0x7f81b019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81ae7fc640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81b0109e10 0x7f81b019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81ae7fc640 1 -- 172.21.15.7:0/175688387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81b0103b80 msgr2=0x7f81b019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81ae7fc640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81b0103b80 0x7f81b019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81ae7fc640 1 -- 172.21.15.7:0/175688387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b01a03b0 con 0x7f81b01094c0 2024-09-21T06:00:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81aeffd640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81b0103b80 0x7f81b019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81ae7fc640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b01094c0 0x7f81b019a9e0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f81a400d950 tx=0x7f81a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81b48e7640 1 -- 172.21.15.7:0/175688387 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4017070 con 0x7f81b01094c0 2024-09-21T06:00:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81b48e7640 1 -- 172.21.15.7:0/175688387 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81a4009c30 con 0x7f81b01094c0 2024-09-21T06:00:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81b58e9640 1 -- 172.21.15.7:0/175688387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b01a06a0 con 0x7f81b01094c0 2024-09-21T06:00:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81b48e7640 1 -- 172.21.15.7:0/175688387 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a40047a0 con 0x7f81b01094c0 2024-09-21T06:00:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.163+0000 7f81b58e9640 1 -- 172.21.15.7:0/175688387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b01a6e00 con 0x7f81b01094c0 2024-09-21T06:00:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.166+0000 7f81bbe5d740 1 Processor -- start 2024-09-21T06:00:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.166+0000 7f81bbe5d740 1 -- start start 2024-09-21T06:00:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.166+0000 7f81bbe5d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da96a070 0x5600dad11270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.166+0000 7f81bbe5d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da9411b0 0x5600dad117b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.166+0000 7f81bbe5d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da949390 0x5600dad11cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.166+0000 7f81bbe5d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5600dac87e50 con 0x5600da949390 2024-09-21T06:00:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.166+0000 7f81bbe5d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5600dac77280 con 0x5600da96a070 2024-09-21T06:00:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.166+0000 7f81bbe5d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5600dac7b090 con 0x5600da9411b0 2024-09-21T06:00:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81af7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da96a070 0x5600dad11270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81aeffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da9411b0 0x5600dad117b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81af7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da96a070 0x5600dad11270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:53586/0 (socket says 172.21.15.7:53586) 2024-09-21T06:00:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81af7fe640 1 -- 172.21.15.7:0/512465333 learned_addr learned my addr 172.21.15.7:0/512465333 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81aeffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da9411b0 0x5600dad117b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:34292/0 (socket says 172.21.15.7:34292) 2024-09-21T06:00:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81b48e7640 1 -- 172.21.15.7:0/175688387 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f81a4004020 con 0x7f81b01094c0 2024-09-21T06:00:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81ae7fc640 1 --2- 172.21.15.7:0/512465333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da949390 0x5600dad11cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81af7fe640 1 -- 172.21.15.7:0/512465333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da9411b0 msgr2=0x5600dad117b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81af7fe640 1 --2- 172.21.15.7:0/512465333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da9411b0 0x5600dad117b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81af7fe640 1 -- 172.21.15.7:0/512465333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da949390 msgr2=0x5600dad11cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81af7fe640 1 --2- 172.21.15.7:0/512465333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da949390 0x5600dad11cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81af7fe640 1 -- 172.21.15.7:0/512465333 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600da9d5650 con 0x5600da96a070 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81ae7fc640 1 --2- 172.21.15.7:0/512465333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da949390 0x5600dad11cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81aeffd640 1 --2- 172.21.15.7:0/512465333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da9411b0 0x5600dad117b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.167+0000 7f81af7fe640 1 --2- 172.21.15.7:0/512465333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da96a070 0x5600dad11270 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f81a8009900 tx=0x7f81a8032bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4017a2649f2cf0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.168+0000 7f8195ffb640 1 -- 172.21.15.7:0/512465333 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8040070 con 0x5600da96a070 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.168+0000 7f8195ffb640 1 -- 172.21.15.7:0/512465333 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81a8004030 con 0x5600da96a070 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.168+0000 7f8195ffb640 1 -- 172.21.15.7:0/512465333 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8035040 con 0x5600da96a070 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.168+0000 7f81b48e7640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f81980b6680 0x7f81980b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.168+0000 7f81aeffd640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f81980b6680 0x7f81980b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.168+0000 7f81b48e7640 1 -- 172.21.15.7:0/175688387 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f81a40e7340 con 0x7f81b01094c0 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.168+0000 7f81aeffd640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f81980b6680 0x7f81980b8b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009fd0 tx=0x7f81a0009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.168+0000 7f81bbe5d740 1 -- 172.21.15.7:0/512465333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da96a070 msgr2=0x5600dad11270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.168+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/512465333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da96a070 0x5600dad11270 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f81a8009900 tx=0x7f81a8032bd0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.169+0000 7f81bbe5d740 1 -- 172.21.15.7:0/512465333 shutdown_connections 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.169+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/512465333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da949390 0x5600dad11cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.169+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/512465333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da9411b0 0x5600dad117b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.169+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/512465333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da96a070 0x5600dad11270 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.169+0000 7f81bbe5d740 1 -- 172.21.15.7:0/512465333 >> 172.21.15.7:0/512465333 conn(0x5600da95e460 msgr2=0x5600dad0f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.169+0000 7f81bbe5d740 1 -- 172.21.15.7:0/512465333 shutdown_connections 2024-09-21T06:00:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.169+0000 7f81bbe5d740 1 -- 172.21.15.7:0/512465333 wait complete. 2024-09-21T06:00:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.169+0000 7f81bbe5d740 1 -- start start 2024-09-21T06:00:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.169+0000 7f81bbe5d740 1 Processor -- start 2024-09-21T06:00:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81bbe5d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da9411b0 0x5600dad1c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81bbe5d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da949390 0x5600dad1cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81bbe5d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da96a070 0x5600dad1d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81bbe5d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5600daad8700 con 0x5600da949390 2024-09-21T06:00:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81bbe5d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5600dac12110 con 0x5600da96a070 2024-09-21T06:00:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81bbe5d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5600dad1f9f0 con 0x5600da9411b0 2024-09-21T06:00:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81bbe5d740 10 client.0 _ll_register_callbacks cb 0x5600dac2b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81ae7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da949390 0x5600dad1cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81ae7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da949390 0x5600dad1cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60886/0 (socket says 172.21.15.7:60886) 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81ae7fc640 1 -- 172.21.15.7:0/3878233647 learned_addr learned my addr 172.21.15.7:0/3878233647 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81aeffd640 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da9411b0 0x5600dad1c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81af7fe640 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da96a070 0x5600dad1d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81ae7fc640 1 -- 172.21.15.7:0/3878233647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da9411b0 msgr2=0x5600dad1c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81ae7fc640 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da9411b0 0x5600dad1c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81ae7fc640 1 -- 172.21.15.7:0/3878233647 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da96a070 msgr2=0x5600dad1d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81ae7fc640 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da96a070 0x5600dad1d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81ae7fc640 1 -- 172.21.15.7:0/3878233647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600dac3fc40 con 0x5600da949390 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81aeffd640 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da9411b0 0x5600dad1c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81af7fe640 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da96a070 0x5600dad1d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f81ae7fc640 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da949390 0x5600dad1cdd0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f81a4005fd0 tx=0x7f81a40a9960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7b32e8d2ac6cc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:53.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.170+0000 7f818effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.171+0000 7f818effd640 1 -- 172.21.15.7:0/3878233647 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a40acb30 con 0x5600da949390 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.171+0000 7f81bbe5d740 1 -- 172.21.15.7:0/3878233647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81a8004030 con 0x5600da949390 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.171+0000 7f818effd640 1 -- 172.21.15.7:0/3878233647 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f81a40a8d30 con 0x5600da949390 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.171+0000 7f818effd640 1 -- 172.21.15.7:0/3878233647 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81a40ac950 con 0x5600da949390 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.171+0000 7f81bbe5d740 10 client.17439 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.171+0000 7f81bbe5d740 1 -- 172.21.15.7:0/3878233647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5600dad2fad0 con 0x5600da949390 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.171+0000 7f818effd640 1 -- 172.21.15.7:0/3878233647 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81a8004030 con 0x5600da949390 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.171+0000 7f818effd640 1 -- 172.21.15.7:0/3878233647 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f81a40981b0 con 0x5600da949390 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.171+0000 7f81bbe5d740 10 client.17439 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.171+0000 7f81bbe5d740 10 client.17439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.171+0000 7f81bbe5d740 20 client.17439 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.171+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5600da9289f0 0x5600dad32fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.172+0000 7f81bbe5d740 4 client.17439 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.172+0000 7f81bbe5d740 1 -- 172.21.15.7:0/3878233647 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600dac89da0 con 0x5600da9289f0 2024-09-21T06:00:53.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.172+0000 7f81aeffd640 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5600da9289f0 0x5600dad32fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.172+0000 7f81aeffd640 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5600da9289f0 0x5600dad32fa0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f47df914a2e34a59 server_cookie=9c259c4d61dd429d in_seq=0 out_seq=0 2024-09-21T06:00:53.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.172+0000 7f818effd640 10 client.17439 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.173+0000 7f818effd640 1 -- 172.21.15.7:0/3878233647 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5600dac89da0 con 0x5600da9289f0 2024-09-21T06:00:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.173+0000 7f818effd640 10 client.17439 handle_command_reply: tid=0 2024-09-21T06:00:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.173+0000 7f81bbe5d740 1 client.17439 shutdown 2024-09-21T06:00:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.173+0000 7f81bbe5d740 1 -- 172.21.15.7:0/3878233647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da949390 msgr2=0x5600dad1cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.173+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da949390 0x5600dad1cdd0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f81a4005fd0 tx=0x7f81a40a9960 comp rx=0 tx=0).stop 2024-09-21T06:00:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.173+0000 7f81bbe5d740 1 -- 172.21.15.7:0/3878233647 shutdown_connections 2024-09-21T06:00:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.173+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5600da9289f0 0x5600dad32fa0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.173+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da949390 0x5600dad1cdd0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.173+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da96a070 0x5600dad1d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.173+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/3878233647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da9411b0 0x5600dad1c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.173+0000 7f81bbe5d740 1 -- 172.21.15.7:0/3878233647 >> 172.21.15.7:0/3878233647 conn(0x5600da95e460 msgr2=0x5600dad14400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.173+0000 7f818effd640 0 client.17439 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.174+0000 7f81bbe5d740 1 -- 172.21.15.7:0/3878233647 shutdown_connections 2024-09-21T06:00:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.174+0000 7f81bbe5d740 1 -- 172.21.15.7:0/3878233647 wait complete. 2024-09-21T06:00:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.174+0000 7f81bbe5d740 20 client.17439 trim_cache size 0 max 16384 2024-09-21T06:00:53.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.191+0000 7f81bbe5d740 1 Processor -- start 2024-09-21T06:00:53.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.191+0000 7f81bbe5d740 1 -- start start 2024-09-21T06:00:53.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81bbe5d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da9411b0 0x5600dad1cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81bbe5d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da949390 0x5600dad0ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81bbe5d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da96a070 0x5600dad19a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81bbe5d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81b01afc70 con 0x5600da96a070 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81bbe5d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f81b01ad540 con 0x5600da9411b0 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81bbe5d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f81b01ab3d0 con 0x5600da949390 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81af7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da96a070 0x5600dad19a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81aeffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da9411b0 0x5600dad1cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81af7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da96a070 0x5600dad19a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60888/0 (socket says 172.21.15.7:60888) 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81aeffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da9411b0 0x5600dad1cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:53614/0 (socket says 172.21.15.7:53614) 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81af7fe640 1 -- 172.21.15.7:0/43041871 learned_addr learned my addr 172.21.15.7:0/43041871 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81ae7fc640 1 --2- 172.21.15.7:0/43041871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da949390 0x5600dad0ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81aeffd640 1 -- 172.21.15.7:0/43041871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da949390 msgr2=0x5600dad0ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81aeffd640 1 --2- 172.21.15.7:0/43041871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da949390 0x5600dad0ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81aeffd640 1 -- 172.21.15.7:0/43041871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da96a070 msgr2=0x5600dad19a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81aeffd640 1 --2- 172.21.15.7:0/43041871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da96a070 0x5600dad19a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81aeffd640 1 -- 172.21.15.7:0/43041871 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600dad1b7f0 con 0x5600da9411b0 2024-09-21T06:00:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.192+0000 7f81af7fe640 1 --2- 172.21.15.7:0/43041871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da96a070 0x5600dad19a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.193+0000 7f81aeffd640 1 --2- 172.21.15.7:0/43041871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da9411b0 0x5600dad1cd50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5600dad33670 tx=0x7f81a0015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6caf66972c34a460 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.193+0000 7f81957fa640 1 -- 172.21.15.7:0/43041871 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a002e070 con 0x5600da9411b0 2024-09-21T06:00:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.193+0000 7f81957fa640 1 -- 172.21.15.7:0/43041871 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81a0003e20 con 0x5600da9411b0 2024-09-21T06:00:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.193+0000 7f81957fa640 1 -- 172.21.15.7:0/43041871 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a001f420 con 0x5600da9411b0 2024-09-21T06:00:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.194+0000 7f81bbe5d740 1 -- 172.21.15.7:0/43041871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da9411b0 msgr2=0x5600dad1cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.194+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/43041871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da9411b0 0x5600dad1cd50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5600dad33670 tx=0x7f81a0015000 comp rx=0 tx=0).stop 2024-09-21T06:00:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.194+0000 7f81bbe5d740 1 -- 172.21.15.7:0/43041871 shutdown_connections 2024-09-21T06:00:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.194+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/43041871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da96a070 0x5600dad19a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.194+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/43041871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da949390 0x5600dad0ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.194+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/43041871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da9411b0 0x5600dad1cd50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.194+0000 7f81bbe5d740 1 -- 172.21.15.7:0/43041871 >> 172.21.15.7:0/43041871 conn(0x5600da95e460 msgr2=0x5600dad1c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:53.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.194+0000 7f81bbe5d740 1 -- 172.21.15.7:0/43041871 shutdown_connections 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.194+0000 7f81bbe5d740 1 -- 172.21.15.7:0/43041871 wait complete. 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.194+0000 7f81bbe5d740 1 -- start start 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.194+0000 7f81bbe5d740 1 Processor -- start 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81bbe5d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da9411b0 0x5600dad255f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81bbe5d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da949390 0x5600dad20aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81bbe5d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da96a070 0x5600dad21170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81bbe5d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81b01aba20 con 0x5600da9411b0 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81bbe5d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f81b01ace70 con 0x5600da949390 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81bbe5d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f81b01ac0d0 con 0x5600da96a070 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81bbe5d740 10 client.0 _ll_register_callbacks cb 0x7f81a4005760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81aeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da9411b0 0x5600dad255f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81aeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da9411b0 0x5600dad255f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60894/0 (socket says 172.21.15.7:60894) 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81aeffd640 1 -- 172.21.15.7:0/4103445752 learned_addr learned my addr 172.21.15.7:0/4103445752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81af7fe640 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da96a070 0x5600dad21170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81ae7fc640 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da949390 0x5600dad20aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81aeffd640 1 -- 172.21.15.7:0/4103445752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da96a070 msgr2=0x5600dad21170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81aeffd640 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da96a070 0x5600dad21170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81aeffd640 1 -- 172.21.15.7:0/4103445752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da949390 msgr2=0x5600dad20aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81aeffd640 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da949390 0x5600dad20aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81aeffd640 1 -- 172.21.15.7:0/4103445752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600dad9c8d0 con 0x5600da9411b0 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.195+0000 7f81ae7fc640 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da949390 0x5600dad20aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f81aeffd640 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da9411b0 0x5600dad255f0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f81a0010820 tx=0x7f81a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2bb05013da1a966 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f818effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f818effd640 1 -- 172.21.15.7:0/4103445752 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a002e040 con 0x5600da9411b0 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f818effd640 1 -- 172.21.15.7:0/4103445752 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f81a0027070 con 0x5600da9411b0 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f81bbe5d740 1 -- 172.21.15.7:0/4103445752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81a0003e20 con 0x5600da9411b0 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f818effd640 1 -- 172.21.15.7:0/4103445752 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81a0024040 con 0x5600da9411b0 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f81bbe5d740 10 client.17445 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:53.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f81bbe5d740 1 -- 172.21.15.7:0/4103445752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5600dad9d9b0 con 0x5600da9411b0 2024-09-21T06:00:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f818effd640 1 -- 172.21.15.7:0/4103445752 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81a0003e20 con 0x5600da9411b0 2024-09-21T06:00:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f818effd640 1 -- 172.21.15.7:0/4103445752 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f81a0031070 con 0x5600da9411b0 2024-09-21T06:00:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f81bbe5d740 10 client.17445 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f81bbe5d740 10 client.17445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f81bbe5d740 20 client.17445 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.196+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5600da8fdda0 0x5600dada00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.197+0000 7f81bbe5d740 4 client.17445 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:00:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.197+0000 7f81bbe5d740 1 -- 172.21.15.7:0/4103445752 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5600dac85850 con 0x5600da8fdda0 2024-09-21T06:00:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.197+0000 7f81ae7fc640 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5600da8fdda0 0x5600dada00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.197+0000 7f81ae7fc640 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5600da8fdda0 0x5600dada00e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e7c421045ba9fba server_cookie=74cb3283bd97e634 in_seq=0 out_seq=0 2024-09-21T06:00:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.197+0000 7f818effd640 10 client.17445 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:53.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.197+0000 7f818effd640 1 -- 172.21.15.7:0/4103445752 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x5600dac85850 con 0x5600da8fdda0 2024-09-21T06:00:53.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f818effd640 10 client.17445 handle_command_reply: tid=0 2024-09-21T06:00:53.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f81bbe5d740 1 client.17445 shutdown 2024-09-21T06:00:53.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f81bbe5d740 1 -- 172.21.15.7:0/4103445752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da9411b0 msgr2=0x5600dad255f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:53.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da9411b0 0x5600dad255f0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f81a0010820 tx=0x7f81a0004750 comp rx=0 tx=0).stop 2024-09-21T06:00:53.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f81bbe5d740 1 -- 172.21.15.7:0/4103445752 shutdown_connections 2024-09-21T06:00:53.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5600da8fdda0 0x5600dada00e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5600da96a070 0x5600dad21170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f818effd640 0 client.17445 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:53.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5600da949390 0x5600dad20aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f81bbe5d740 1 --2- 172.21.15.7:0/4103445752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5600da9411b0 0x5600dad255f0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f81bbe5d740 1 -- 172.21.15.7:0/4103445752 >> 172.21.15.7:0/4103445752 conn(0x5600da95e460 msgr2=0x5600dad12250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:53.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f81bbe5d740 1 -- 172.21.15.7:0/4103445752 shutdown_connections 2024-09-21T06:00:53.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f81bbe5d740 1 -- 172.21.15.7:0/4103445752 wait complete. 2024-09-21T06:00:53.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.198+0000 7f81bbe5d740 20 client.17445 trim_cache size 0 max 16384 2024-09-21T06:00:53.205 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:00:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:00:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:00:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:00:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "3bd778db-a0ed-42ad-8a79-14a200f0734e": { 2024-09-21T06:00:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:51.556015+0000", 2024-09-21T06:00:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:00:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:00:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:00:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:00:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:00:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:00:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:00:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:00:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:00:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:00:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:00:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:00:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:00:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:00:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:00:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:00:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:00:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:00:53.215 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:00:53.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.199+0000 7f81b58e9640 1 -- 172.21.15.7:0/175688387 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f81980b6680 msgr2=0x7f81980b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:53.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.199+0000 7f81b58e9640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f81980b6680 0x7f81980b8b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009fd0 tx=0x7f81a0009500 comp rx=0 tx=0).stop 2024-09-21T06:00:53.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.199+0000 7f81b58e9640 1 -- 172.21.15.7:0/175688387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b01094c0 msgr2=0x7f81b019a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:53.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.199+0000 7f81b58e9640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b01094c0 0x7f81b019a9e0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f81a400d950 tx=0x7f81a400de10 comp rx=0 tx=0).stop 2024-09-21T06:00:53.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.199+0000 7f81b58e9640 1 -- 172.21.15.7:0/175688387 shutdown_connections 2024-09-21T06:00:53.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.199+0000 7f81b58e9640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f81980b6680 0x7f81980b8b90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.199+0000 7f81b58e9640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b01094c0 0x7f81b019a9e0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.199+0000 7f81b58e9640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81b0109e10 0x7f81b019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.199+0000 7f81b58e9640 1 --2- 172.21.15.7:0/175688387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81b0103b80 0x7f81b019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.199+0000 7f81b58e9640 1 -- 172.21.15.7:0/175688387 >> 172.21.15.7:0/175688387 conn(0x7f81b00ff610 msgr2=0x7f81b0106ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.199+0000 7f81b58e9640 1 -- 172.21.15.7:0/175688387 shutdown_connections 2024-09-21T06:00:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:53.199+0000 7f81b58e9640 1 -- 172.21.15.7:0/175688387 wait complete. 2024-09-21T06:00:54.125 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:00:54.125 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:00:54.393 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:54.652 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:54 smithi007 ceph-mon[30983]: pgmap v530: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:00:54.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:54 smithi027 ceph-mon[34364]: pgmap v530: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:00:54.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:54 smithi119 ceph-mon[34833]: pgmap v530: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:00:54.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.883+0000 7f2518209640 1 -- 172.21.15.7:0/734318531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25101083d0 msgr2=0x7f25101087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:54.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.883+0000 7f2518209640 1 --2- 172.21.15.7:0/734318531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25101083d0 0x7f25101087e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f2500009900 tx=0x7f250002a410 comp rx=0 tx=0).stop 2024-09-21T06:00:54.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.883+0000 7f2518209640 1 -- 172.21.15.7:0/734318531 shutdown_connections 2024-09-21T06:00:54.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.883+0000 7f2518209640 1 --2- 172.21.15.7:0/734318531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25101083d0 0x7f25101087e0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:54.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.883+0000 7f2518209640 1 --2- 172.21.15.7:0/734318531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2510108d20 0x7f251010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:54.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.883+0000 7f2518209640 1 --2- 172.21.15.7:0/734318531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2510102ae0 0x7f2510102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:54.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.883+0000 7f2518209640 1 -- 172.21.15.7:0/734318531 >> 172.21.15.7:0/734318531 conn(0x7f25100797b0 msgr2=0x7f2510079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:54.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.883+0000 7f2518209640 1 -- 172.21.15.7:0/734318531 shutdown_connections 2024-09-21T06:00:54.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.883+0000 7f2518209640 1 -- 172.21.15.7:0/734318531 wait complete. 2024-09-21T06:00:54.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.884+0000 7f2518209640 1 Processor -- start 2024-09-21T06:00:54.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.884+0000 7f2518209640 1 -- start start 2024-09-21T06:00:54.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.884+0000 7f2518209640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2510102ae0 0x7f25100ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:54.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.884+0000 7f2518209640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25101083d0 0x7f25100ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:54.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.884+0000 7f2518209640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2510108d20 0x7f25101000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:54.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2518209640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25101129e0 con 0x7f2510102ae0 2024-09-21T06:00:54.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2518209640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2510112860 con 0x7f2510108d20 2024-09-21T06:00:54.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2518209640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2510112b60 con 0x7f25101083d0 2024-09-21T06:00:54.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2515fa5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2510102ae0 0x7f25100ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:54.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2515fa5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2510102ae0 0x7f25100ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60914/0 (socket says 172.21.15.7:60914) 2024-09-21T06:00:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2515fa5640 1 -- 172.21.15.7:0/4173038609 learned_addr learned my addr 172.21.15.7:0/4173038609 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f25157a4640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25101083d0 0x7f25100ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f25167a6640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2510108d20 0x7f25101000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2515fa5640 1 -- 172.21.15.7:0/4173038609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25101083d0 msgr2=0x7f25100ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2515fa5640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25101083d0 0x7f25100ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2515fa5640 1 -- 172.21.15.7:0/4173038609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2510108d20 msgr2=0x7f25101000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2515fa5640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2510108d20 0x7f25101000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2515fa5640 1 -- 172.21.15.7:0/4173038609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25101a8760 con 0x7f2510102ae0 2024-09-21T06:00:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f25157a4640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25101083d0 0x7f25100ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f25167a6640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2510108d20 0x7f25101000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2515fa5640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2510102ae0 0x7f25100ff670 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f250c00c890 tx=0x7f250c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2506ffd640 1 -- 172.21.15.7:0/4173038609 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c004220 con 0x7f2510102ae0 2024-09-21T06:00:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2518209640 1 -- 172.21.15.7:0/4173038609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25101a8a50 con 0x7f2510102ae0 2024-09-21T06:00:54.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2506ffd640 1 -- 172.21.15.7:0/4173038609 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f250c0043c0 con 0x7f2510102ae0 2024-09-21T06:00:54.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.885+0000 7f2506ffd640 1 -- 172.21.15.7:0/4173038609 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c004a00 con 0x7f2510102ae0 2024-09-21T06:00:54.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.886+0000 7f2518209640 1 -- 172.21.15.7:0/4173038609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25101a8fb0 con 0x7f2510102ae0 2024-09-21T06:00:54.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.886+0000 7f2518209640 1 -- 172.21.15.7:0/4173038609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2510102ef0 con 0x7f2510102ae0 2024-09-21T06:00:54.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.888+0000 7f2506ffd640 1 -- 172.21.15.7:0/4173038609 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f250c0079b0 con 0x7f2510102ae0 2024-09-21T06:00:54.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.889+0000 7f2506ffd640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f24fc0b6680 0x7f24fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:54.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.889+0000 7f25157a4640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f24fc0b6680 0x7f24fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:54.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.889+0000 7f2506ffd640 1 -- 172.21.15.7:0/4173038609 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f250c0e7960 con 0x7f2510102ae0 2024-09-21T06:00:54.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.890+0000 7f25157a4640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f24fc0b6680 0x7f24fc0b8b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2500009230 tx=0x7f2500000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:54.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:54.892+0000 7f2506ffd640 1 -- 172.21.15.7:0/4173038609 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f250c014030 con 0x7f2510102ae0 2024-09-21T06:00:55.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.119+0000 7f2518209640 1 -- 172.21.15.7:0/4173038609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2510100970 con 0x7f2510102ae0 2024-09-21T06:00:55.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.120+0000 7f2506ffd640 1 -- 172.21.15.7:0/4173038609 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f2510100970 con 0x7f2510102ae0 2024-09-21T06:00:55.123 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:00:55.123 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:00:55.123 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:00:55.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.122+0000 7f2518209640 1 -- 172.21.15.7:0/4173038609 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f24fc0b6680 msgr2=0x7f24fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:55.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.122+0000 7f2518209640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f24fc0b6680 0x7f24fc0b8b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2500009230 tx=0x7f2500000bc0 comp rx=0 tx=0).stop 2024-09-21T06:00:55.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.122+0000 7f2518209640 1 -- 172.21.15.7:0/4173038609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2510102ae0 msgr2=0x7f25100ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:55.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.122+0000 7f2518209640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2510102ae0 0x7f25100ff670 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f250c00c890 tx=0x7f250c00cd50 comp rx=0 tx=0).stop 2024-09-21T06:00:55.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.122+0000 7f2518209640 1 -- 172.21.15.7:0/4173038609 shutdown_connections 2024-09-21T06:00:55.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.122+0000 7f2518209640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f24fc0b6680 0x7f24fc0b8b90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:55.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.122+0000 7f2518209640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2510108d20 0x7f25101000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:55.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.122+0000 7f2518209640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25101083d0 0x7f25100ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:55.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.122+0000 7f2518209640 1 --2- 172.21.15.7:0/4173038609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2510102ae0 0x7f25100ff670 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:55.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.122+0000 7f2518209640 1 -- 172.21.15.7:0/4173038609 >> 172.21.15.7:0/4173038609 conn(0x7f25100797b0 msgr2=0x7f2510101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:55.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.122+0000 7f2518209640 1 -- 172.21.15.7:0/4173038609 shutdown_connections 2024-09-21T06:00:55.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:55.122+0000 7f2518209640 1 -- 172.21.15.7:0/4173038609 wait complete. 2024-09-21T06:00:55.429 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:55 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4173038609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:55.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:55 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/4173038609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:55.727 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:00:55.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:55 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/4173038609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:00:55.986 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:56.446 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:56 smithi007 ceph-mon[30983]: pgmap v531: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8 op/s 2024-09-21T06:00:56.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.443+0000 7fa7db177640 1 -- 172.21.15.7:0/3798164092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d4109df0 msgr2=0x7fa7d4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:56.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.443+0000 7fa7db177640 1 --2- 172.21.15.7:0/3798164092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d4109df0 0x7fa7d4110620 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009ca0 tx=0x7fa7cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.443+0000 7fa7db177640 1 -- 172.21.15.7:0/3798164092 shutdown_connections 2024-09-21T06:00:56.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.443+0000 7fa7db177640 1 --2- 172.21.15.7:0/3798164092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d4109df0 0x7fa7d4110620 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.443+0000 7fa7db177640 1 --2- 172.21.15.7:0/3798164092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d41094a0 0x7fa7d41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.443+0000 7fa7db177640 1 --2- 172.21.15.7:0/3798164092 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d4103b60 0x7fa7d4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.443+0000 7fa7db177640 1 -- 172.21.15.7:0/3798164092 >> 172.21.15.7:0/3798164092 conn(0x7fa7d407b850 msgr2=0x7fa7d407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.443+0000 7fa7db177640 1 -- 172.21.15.7:0/3798164092 shutdown_connections 2024-09-21T06:00:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.444+0000 7fa7db177640 1 -- 172.21.15.7:0/3798164092 wait complete. 2024-09-21T06:00:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.444+0000 7fa7db177640 1 Processor -- start 2024-09-21T06:00:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.444+0000 7fa7db177640 1 -- start start 2024-09-21T06:00:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7db177640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d4103b60 0x7fa7d419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7db177640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d41094a0 0x7fa7d419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7db177640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d4109df0 0x7fa7d41a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7db177640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d4113ab0 con 0x7fa7d4109df0 2024-09-21T06:00:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7db177640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d4113930 con 0x7fa7d4103b60 2024-09-21T06:00:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7db177640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d4113c30 con 0x7fa7d41094a0 2024-09-21T06:00:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7d9714640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d4109df0 0x7fa7d41a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7d9714640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d4109df0 0x7fa7d41a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60930/0 (socket says 172.21.15.7:60930) 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7d9714640 1 -- 172.21.15.7:0/469117502 learned_addr learned my addr 172.21.15.7:0/469117502 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7d8f13640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d4103b60 0x7fa7d419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d41094a0 0x7fa7d419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7d9714640 1 -- 172.21.15.7:0/469117502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d41094a0 msgr2=0x7fa7d419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7d9714640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d41094a0 0x7fa7d419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7d9714640 1 -- 172.21.15.7:0/469117502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d4103b60 msgr2=0x7fa7d419c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7d9714640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d4103b60 0x7fa7d419c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7d9714640 1 -- 172.21.15.7:0/469117502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d41a25f0 con 0x7fa7d4109df0 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d41094a0 0x7fa7d419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.445+0000 7fa7d9714640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d4109df0 0x7fa7d41a1ec0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0098d0 tx=0x7fa7cc0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.446+0000 7fa7c9ffb640 1 -- 172.21.15.7:0/469117502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc003b70 con 0x7fa7d4109df0 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.446+0000 7fa7c9ffb640 1 -- 172.21.15.7:0/469117502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7cc003d10 con 0x7fa7d4109df0 2024-09-21T06:00:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.446+0000 7fa7db177640 1 -- 172.21.15.7:0/469117502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d41a2880 con 0x7fa7d4109df0 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.446+0000 7fa7c9ffb640 1 -- 172.21.15.7:0/469117502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc02fa20 con 0x7fa7d4109df0 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.446+0000 7fa7db177640 1 -- 172.21.15.7:0/469117502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d41a9040 con 0x7fa7d4109df0 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7e16eb740 1 Processor -- start 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7c9ffb640 1 -- 172.21.15.7:0/469117502 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa7cc02fc40 con 0x7fa7d4109df0 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7e16eb740 1 -- start start 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7e16eb740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac310070 0x5645ac6b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7e16eb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac2e71b0 0x5645ac6b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7e16eb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 0x5645ac6b8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7e16eb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5645ac62dea0 con 0x5645ac2ef390 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7e16eb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5645ac61d2d0 con 0x5645ac2e71b0 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7e16eb740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5645ac6210e0 con 0x5645ac310070 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7cbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 0x5645ac6b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7cbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 0x5645ac6b8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60936/0 (socket says 172.21.15.7:60936) 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7cbfff640 1 -- 172.21.15.7:0/998025430 learned_addr learned my addr 172.21.15.7:0/998025430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/998025430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac310070 0x5645ac6b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.449+0000 7fa7d8f13640 1 --2- 172.21.15.7:0/998025430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac2e71b0 0x5645ac6b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.450+0000 7fa7cbfff640 1 -- 172.21.15.7:0/998025430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac310070 msgr2=0x5645ac6b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.450+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/998025430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac310070 0x5645ac6b76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.450+0000 7fa7cbfff640 1 -- 172.21.15.7:0/998025430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac2e71b0 msgr2=0x5645ac6b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.450+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/998025430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac2e71b0 0x5645ac6b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.450+0000 7fa7cbfff640 1 -- 172.21.15.7:0/998025430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645ac37b650 con 0x5645ac2ef390 2024-09-21T06:00:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.450+0000 7fa7c9ffb640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa7bc0b6700 0x7fa7bc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.450+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/998025430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 0x5645ac6b8120 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009fc0 tx=0x7fa7c4009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc99b6b1ad1c17e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.450+0000 7fa7d8f13640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa7bc0b6700 0x7fa7bc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.450+0000 7fa7c9ffb640 1 -- 172.21.15.7:0/469117502 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fa7cc108960 con 0x7fa7d4109df0 2024-09-21T06:00:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.450+0000 7fa7baffd640 1 -- 172.21.15.7:0/998025430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4011470 con 0x5645ac2ef390 2024-09-21T06:00:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.450+0000 7fa7baffd640 1 -- 172.21.15.7:0/998025430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7c4011ac0 con 0x5645ac2ef390 2024-09-21T06:00:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.450+0000 7fa7baffd640 1 -- 172.21.15.7:0/998025430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c400fa40 con 0x5645ac2ef390 2024-09-21T06:00:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.451+0000 7fa7e16eb740 1 -- 172.21.15.7:0/998025430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 msgr2=0x5645ac6b8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.451+0000 7fa7d8f13640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa7bc0b6700 0x7fa7bc0b8c10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x5645ac6b6320 tx=0x7fa7d000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.451+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/998025430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 0x5645ac6b8120 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009fc0 tx=0x7fa7c4009660 comp rx=0 tx=0).stop 2024-09-21T06:00:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.452+0000 7fa7e16eb740 1 -- 172.21.15.7:0/998025430 shutdown_connections 2024-09-21T06:00:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.452+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/998025430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 0x5645ac6b8120 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.452+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/998025430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac2e71b0 0x5645ac6b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.452+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/998025430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac310070 0x5645ac6b76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.452+0000 7fa7e16eb740 1 -- 172.21.15.7:0/998025430 >> 172.21.15.7:0/998025430 conn(0x5645ac304460 msgr2=0x5645ac6b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.452+0000 7fa7e16eb740 1 -- 172.21.15.7:0/998025430 shutdown_connections 2024-09-21T06:00:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.452+0000 7fa7e16eb740 1 -- 172.21.15.7:0/998025430 wait complete. 2024-09-21T06:00:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.452+0000 7fa7e16eb740 1 -- start start 2024-09-21T06:00:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.452+0000 7fa7e16eb740 1 Processor -- start 2024-09-21T06:00:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7e16eb740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2e71b0 0x5645ac6c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7e16eb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac2ef390 0x5645ac6c3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7e16eb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac310070 0x5645ac6cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7e16eb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5645ac47e700 con 0x5645ac310070 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7e16eb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5645ac5b8160 con 0x5645ac2ef390 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7e16eb740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5645ac6c5e80 con 0x5645ac2e71b0 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7e16eb740 10 client.0 _ll_register_callbacks cb 0x5645ac5d19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7d9714640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac310070 0x5645ac6cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7d9714640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac310070 0x5645ac6cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60940/0 (socket says 172.21.15.7:60940) 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7d9714640 1 -- 172.21.15.7:0/4038385740 learned_addr learned my addr 172.21.15.7:0/4038385740 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac2ef390 0x5645ac6c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7d8f13640 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2e71b0 0x5645ac6c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7d9714640 1 -- 172.21.15.7:0/4038385740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2e71b0 msgr2=0x5645ac6c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7d9714640 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2e71b0 0x5645ac6c2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7d9714640 1 -- 172.21.15.7:0/4038385740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac2ef390 msgr2=0x5645ac6c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7d9714640 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac2ef390 0x5645ac6c3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.453+0000 7fa7d9714640 1 -- 172.21.15.7:0/4038385740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645ac5e5c90 con 0x5645ac310070 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.454+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac2ef390 0x5645ac6c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.454+0000 7fa7d9714640 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac310070 0x5645ac6cf1a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0ce790 tx=0x7fa7cc0cad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41b0aff467566d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.454+0000 7fa7b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.454+0000 7fa7b3fff640 1 -- 172.21.15.7:0/4038385740 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0d3020 con 0x5645ac310070 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.454+0000 7fa7b3fff640 1 -- 172.21.15.7:0/4038385740 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fa7cc004b40 con 0x5645ac310070 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.454+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4038385740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7c4011ac0 con 0x5645ac310070 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.454+0000 7fa7b3fff640 1 -- 172.21.15.7:0/4038385740 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa7cc0e9050 con 0x5645ac310070 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.454+0000 7fa7e16eb740 10 client.17463 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.454+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4038385740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5645ac6d1b80 con 0x5645ac310070 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.454+0000 7fa7b3fff640 1 -- 172.21.15.7:0/4038385740 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7cc0e9e50 con 0x5645ac310070 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.455+0000 7fa7b3fff640 1 -- 172.21.15.7:0/4038385740 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa7cc0cda60 con 0x5645ac310070 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.455+0000 7fa7e16eb740 10 client.17463 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.455+0000 7fa7e16eb740 10 client.17463 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.455+0000 7fa7e16eb740 20 client.17463 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.455+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5645ac2ce9f0 0x5645ac6d5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.455+0000 7fa7e16eb740 4 client.17463 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.455+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4038385740 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645ac62fdf0 con 0x5645ac2ce9f0 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.455+0000 7fa7d8f13640 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5645ac2ce9f0 0x5645ac6d5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.455+0000 7fa7d8f13640 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5645ac2ce9f0 0x5645ac6d5110 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d8f99a91f242d341 server_cookie=dfa3c7e174a4669 in_seq=0 out_seq=0 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.455+0000 7fa7b3fff640 10 client.17463 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.456+0000 7fa7b3fff640 1 -- 172.21.15.7:0/4038385740 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5645ac62fdf0 con 0x5645ac2ce9f0 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.456+0000 7fa7b3fff640 10 client.17463 handle_command_reply: tid=0 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.456+0000 7fa7e16eb740 1 client.17463 shutdown 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.456+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4038385740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac310070 msgr2=0x5645ac6cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.456+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac310070 0x5645ac6cf1a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0ce790 tx=0x7fa7cc0cad20 comp rx=0 tx=0).stop 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.456+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4038385740 shutdown_connections 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.456+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5645ac2ce9f0 0x5645ac6d5110 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.456+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac310070 0x5645ac6cf1a0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.457+0000 7fa7b3fff640 0 client.17463 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.456+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac2ef390 0x5645ac6c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.457+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/4038385740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2e71b0 0x5645ac6c2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.457+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4038385740 >> 172.21.15.7:0/4038385740 conn(0x5645ac304460 msgr2=0x5645ac6ba830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.457+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4038385740 shutdown_connections 2024-09-21T06:00:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.457+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4038385740 wait complete. 2024-09-21T06:00:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.457+0000 7fa7e16eb740 20 client.17463 trim_cache size 0 max 16384 2024-09-21T06:00:56.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.470+0000 7fa7e16eb740 1 Processor -- start 2024-09-21T06:00:56.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.470+0000 7fa7e16eb740 1 -- start start 2024-09-21T06:00:56.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.470+0000 7fa7e16eb740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2e71b0 0x5645ac6c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.470+0000 7fa7e16eb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 0x5645ac6b8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.470+0000 7fa7e16eb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac310070 0x5645ac6cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.470+0000 7fa7e16eb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d41b3f50 con 0x5645ac2ef390 2024-09-21T06:00:56.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.470+0000 7fa7e16eb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d41b1820 con 0x5645ac310070 2024-09-21T06:00:56.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.470+0000 7fa7e16eb740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d41af690 con 0x5645ac2e71b0 2024-09-21T06:00:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7cbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 0x5645ac6b8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7cbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 0x5645ac6b8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60942/0 (socket says 172.21.15.7:60942) 2024-09-21T06:00:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7cbfff640 1 -- 172.21.15.7:0/2524764550 learned_addr learned my addr 172.21.15.7:0/2524764550 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7d8f13640 1 --2- 172.21.15.7:0/2524764550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2e71b0 0x5645ac6c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7d9714640 1 --2- 172.21.15.7:0/2524764550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac310070 0x5645ac6cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7cbfff640 1 -- 172.21.15.7:0/2524764550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2e71b0 msgr2=0x5645ac6c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/2524764550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2e71b0 0x5645ac6c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7cbfff640 1 -- 172.21.15.7:0/2524764550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac310070 msgr2=0x5645ac6cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/2524764550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac310070 0x5645ac6cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7cbfff640 1 -- 172.21.15.7:0/2524764550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645ac6b5780 con 0x5645ac2ef390 2024-09-21T06:00:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7d9714640 1 --2- 172.21.15.7:0/2524764550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac310070 0x5645ac6cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/2524764550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 0x5645ac6b8de0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009e30 tx=0x7fa7c4009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626f4636e519dc77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7ba7fc640 1 -- 172.21.15.7:0/2524764550 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4013190 con 0x5645ac2ef390 2024-09-21T06:00:56.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7ba7fc640 1 -- 172.21.15.7:0/2524764550 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7c4005040 con 0x5645ac2ef390 2024-09-21T06:00:56.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.471+0000 7fa7ba7fc640 1 -- 172.21.15.7:0/2524764550 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40048c0 con 0x5645ac2ef390 2024-09-21T06:00:56.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.472+0000 7fa7e16eb740 1 -- 172.21.15.7:0/2524764550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 msgr2=0x5645ac6b8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:56.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.472+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/2524764550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 0x5645ac6b8de0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009e30 tx=0x7fa7c4009e60 comp rx=0 tx=0).stop 2024-09-21T06:00:56.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.472+0000 7fa7e16eb740 1 -- 172.21.15.7:0/2524764550 shutdown_connections 2024-09-21T06:00:56.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.472+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/2524764550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2ef390 0x5645ac6b8de0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.472+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/2524764550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac310070 0x5645ac6cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.472+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/2524764550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2e71b0 0x5645ac6c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.472+0000 7fa7e16eb740 1 -- 172.21.15.7:0/2524764550 >> 172.21.15.7:0/2524764550 conn(0x5645ac304460 msgr2=0x5645ac6b86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.472+0000 7fa7e16eb740 1 -- 172.21.15.7:0/2524764550 shutdown_connections 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.472+0000 7fa7e16eb740 1 -- 172.21.15.7:0/2524764550 wait complete. 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.473+0000 7fa7e16eb740 1 -- start start 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.473+0000 7fa7e16eb740 1 Processor -- start 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.473+0000 7fa7e16eb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2e71b0 0x5645ac6c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.473+0000 7fa7e16eb740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2ef390 0x5645ac6c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.473+0000 7fa7e16eb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac310070 0x5645ac73eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.473+0000 7fa7e16eb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d41afce0 con 0x5645ac2e71b0 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.473+0000 7fa7e16eb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d41b1150 con 0x5645ac310070 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.473+0000 7fa7e16eb740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d41b03b0 con 0x5645ac2ef390 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.473+0000 7fa7e16eb740 10 client.0 _ll_register_callbacks cb 0x7fa7cc009430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.473+0000 7fa7d8f13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2e71b0 0x5645ac6c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.473+0000 7fa7d8f13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2e71b0 0x5645ac6c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60952/0 (socket says 172.21.15.7:60952) 2024-09-21T06:00:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.473+0000 7fa7d8f13640 1 -- 172.21.15.7:0/4204106271 learned_addr learned my addr 172.21.15.7:0/4204106271 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/4204106271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2ef390 0x5645ac6c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7d9714640 1 --2- 172.21.15.7:0/4204106271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac310070 0x5645ac73eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7d8f13640 1 -- 172.21.15.7:0/4204106271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2ef390 msgr2=0x5645ac6c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7d8f13640 1 --2- 172.21.15.7:0/4204106271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2ef390 0x5645ac6c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7d8f13640 1 -- 172.21.15.7:0/4204106271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac310070 msgr2=0x5645ac73eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7d8f13640 1 --2- 172.21.15.7:0/4204106271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac310070 0x5645ac73eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7d8f13640 1 -- 172.21.15.7:0/4204106271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645ac73f050 con 0x5645ac2e71b0 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7d8f13640 1 --2- 172.21.15.7:0/4204106271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2e71b0 0x5645ac6c77b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00043f0 tx=0x7fa7d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76e1c573e576f14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7b3fff640 1 -- 172.21.15.7:0/4204106271 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0005020 con 0x5645ac2e71b0 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7b3fff640 1 -- 172.21.15.7:0/4204106271 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fa7d00051c0 con 0x5645ac2e71b0 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4204106271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7c4005040 con 0x5645ac2e71b0 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7b3fff640 1 -- 172.21.15.7:0/4204106271 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa7d00053c0 con 0x5645ac2e71b0 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7e16eb740 10 client.17469 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.474+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4204106271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5645ac7402f0 con 0x5645ac2e71b0 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.475+0000 7fa7b3fff640 1 -- 172.21.15.7:0/4204106271 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7c4005040 con 0x5645ac2e71b0 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.475+0000 7fa7b3fff640 1 -- 172.21.15.7:0/4204106271 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa7d0019040 con 0x5645ac2e71b0 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.475+0000 7fa7e16eb740 10 client.17469 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.475+0000 7fa7e16eb740 10 client.17469 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.475+0000 7fa7e16eb740 20 client.17469 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.475+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/4204106271 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5645ac2a3da0 0x5645ac742ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.475+0000 7fa7e16eb740 4 client.17469 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.475+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4204106271 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5645ac62b8a0 con 0x5645ac2a3da0 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.475+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/4204106271 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5645ac2a3da0 0x5645ac742ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.475+0000 7fa7b3fff640 10 client.17469 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.475+0000 7fa7cbfff640 1 --2- 172.21.15.7:0/4204106271 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5645ac2a3da0 0x5645ac742ae0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0a086f8737b93d2 server_cookie=72bf8138aa7d01c7 in_seq=0 out_seq=0 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7b3fff640 1 -- 172.21.15.7:0/4204106271 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5645ac62b8a0 con 0x5645ac2a3da0 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7b3fff640 10 client.17469 handle_command_reply: tid=0 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7e16eb740 1 client.17469 shutdown 2024-09-21T06:00:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4204106271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2e71b0 msgr2=0x5645ac6c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:56.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/4204106271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2e71b0 0x5645ac6c77b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00043f0 tx=0x7fa7d00046c0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4204106271 shutdown_connections 2024-09-21T06:00:56.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/4204106271 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5645ac2a3da0 0x5645ac742ae0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7b3fff640 0 client.17469 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:00:56.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/4204106271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5645ac310070 0x5645ac73eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/4204106271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645ac2ef390 0x5645ac6c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7e16eb740 1 --2- 172.21.15.7:0/4204106271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645ac2e71b0 0x5645ac6c77b0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4204106271 >> 172.21.15.7:0/4204106271 conn(0x5645ac304460 msgr2=0x5645ac6c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:56.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4204106271 shutdown_connections 2024-09-21T06:00:56.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7e16eb740 1 -- 172.21.15.7:0/4204106271 wait complete. 2024-09-21T06:00:56.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.476+0000 7fa7e16eb740 20 client.17469 trim_cache size 0 max 16384 2024-09-21T06:00:56.483 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:56.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.477+0000 7fa7db177640 1 -- 172.21.15.7:0/469117502 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa7bc0b6700 msgr2=0x7fa7bc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:56.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.477+0000 7fa7db177640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa7bc0b6700 0x7fa7bc0b8c10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x5645ac6b6320 tx=0x7fa7d000b390 comp rx=0 tx=0).stop 2024-09-21T06:00:56.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.477+0000 7fa7db177640 1 -- 172.21.15.7:0/469117502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d4109df0 msgr2=0x7fa7d41a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:56.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.477+0000 7fa7db177640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d4109df0 0x7fa7d41a1ec0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0098d0 tx=0x7fa7cc0317b0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.477+0000 7fa7db177640 1 -- 172.21.15.7:0/469117502 shutdown_connections 2024-09-21T06:00:56.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.477+0000 7fa7db177640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa7bc0b6700 0x7fa7bc0b8c10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.477+0000 7fa7db177640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d4109df0 0x7fa7d41a1ec0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.477+0000 7fa7db177640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d41094a0 0x7fa7d419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.477+0000 7fa7db177640 1 --2- 172.21.15.7:0/469117502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa7d4103b60 0x7fa7d419c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:56.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.477+0000 7fa7db177640 1 -- 172.21.15.7:0/469117502 >> 172.21.15.7:0/469117502 conn(0x7fa7d407b850 msgr2=0x7fa7d41072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:56.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.477+0000 7fa7db177640 1 -- 172.21.15.7:0/469117502 shutdown_connections 2024-09-21T06:00:56.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:56.477+0000 7fa7db177640 1 -- 172.21.15.7:0/469117502 wait complete. 2024-09-21T06:00:56.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:56 smithi027 ceph-mon[34364]: pgmap v531: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8 op/s 2024-09-21T06:00:56.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:56 smithi119 ceph-mon[34833]: pgmap v531: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8 op/s 2024-09-21T06:00:57.152 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:00:57.425 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:57.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.879+0000 7fbfd1e27640 1 -- 172.21.15.7:0/522776864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfcc1084c0 msgr2=0x7fbfcc10ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:57.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.879+0000 7fbfd1e27640 1 --2- 172.21.15.7:0/522776864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfcc1084c0 0x7fbfcc10ecf0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009ca0 tx=0x7fbfc402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.879+0000 7fbfd1e27640 1 -- 172.21.15.7:0/522776864 shutdown_connections 2024-09-21T06:00:57.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.879+0000 7fbfd1e27640 1 --2- 172.21.15.7:0/522776864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfcc1084c0 0x7fbfcc10ecf0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.879+0000 7fbfd1e27640 1 --2- 172.21.15.7:0/522776864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfcc107b70 0x7fbfcc107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.879+0000 7fbfd1e27640 1 --2- 172.21.15.7:0/522776864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfcc102230 0x7fbfcc102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.879+0000 7fbfd1e27640 1 -- 172.21.15.7:0/522776864 >> 172.21.15.7:0/522776864 conn(0x7fbfcc079e40 msgr2=0x7fbfcc07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:57.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.879+0000 7fbfd1e27640 1 -- 172.21.15.7:0/522776864 shutdown_connections 2024-09-21T06:00:57.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.880+0000 7fbfd1e27640 1 -- 172.21.15.7:0/522776864 wait complete. 2024-09-21T06:00:57.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.880+0000 7fbfd1e27640 1 Processor -- start 2024-09-21T06:00:57.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.880+0000 7fbfd1e27640 1 -- start start 2024-09-21T06:00:57.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfd1e27640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfcc102230 0x7fbfcc19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfd1e27640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfcc107b70 0x7fbfcc19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfd1e27640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfcc1084c0 0x7fbfcc19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfd1e27640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc111900 con 0x7fbfcc102230 2024-09-21T06:00:57.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfd1e27640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc111780 con 0x7fbfcc107b70 2024-09-21T06:00:57.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfd1e27640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc111a80 con 0x7fbfcc1084c0 2024-09-21T06:00:57.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfcb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfcc102230 0x7fbfcc19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfcb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfcc102230 0x7fbfcc19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60970/0 (socket says 172.21.15.7:60970) 2024-09-21T06:00:57.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfcb7fe640 1 -- 172.21.15.7:0/619774361 learned_addr learned my addr 172.21.15.7:0/619774361 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:57.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfcaffd640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfcc107b70 0x7fbfcc19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfcc1084c0 0x7fbfcc19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfcb7fe640 1 -- 172.21.15.7:0/619774361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfcc1084c0 msgr2=0x7fbfcc19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:57.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfcb7fe640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfcc1084c0 0x7fbfcc19fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfcb7fe640 1 -- 172.21.15.7:0/619774361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfcc107b70 msgr2=0x7fbfcc19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:57.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfcb7fe640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfcc107b70 0x7fbfcc19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfcb7fe640 1 -- 172.21.15.7:0/619774361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfcc1a0300 con 0x7fbfcc102230 2024-09-21T06:00:57.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfcaffd640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfcc107b70 0x7fbfcc19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:57.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.881+0000 7fbfcb7fe640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfcc102230 0x7fbfcc19a450 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c920 tx=0x7fbfbc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:57.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.882+0000 7fbfc8ff9640 1 -- 172.21.15.7:0/619774361 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc007c70 con 0x7fbfcc102230 2024-09-21T06:00:57.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.882+0000 7fbfd1e27640 1 -- 172.21.15.7:0/619774361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfcc1a05f0 con 0x7fbfcc102230 2024-09-21T06:00:57.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.882+0000 7fbfc8ff9640 1 -- 172.21.15.7:0/619774361 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfbc007e10 con 0x7fbfcc102230 2024-09-21T06:00:57.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.882+0000 7fbfc8ff9640 1 -- 172.21.15.7:0/619774361 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc018820 con 0x7fbfcc102230 2024-09-21T06:00:57.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.882+0000 7fbfd1e27640 1 -- 172.21.15.7:0/619774361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfcc1a6e10 con 0x7fbfcc102230 2024-09-21T06:00:57.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.884+0000 7fbfd839b740 1 Processor -- start 2024-09-21T06:00:57.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.884+0000 7fbfd839b740 1 -- start start 2024-09-21T06:00:57.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfd839b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9cc96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfd839b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a98f91b0 0x5633a9cc9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfd839b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a9901390 0x5633a9cca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfd839b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5633a9c3fea0 con 0x5633a98f91b0 2024-09-21T06:00:57.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfd839b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5633a9c2f2d0 con 0x5633a9922070 2024-09-21T06:00:57.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfd839b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5633a9c330e0 con 0x5633a9901390 2024-09-21T06:00:57.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfc8ff9640 1 -- 172.21.15.7:0/619774361 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fbfbc0189c0 con 0x7fbfcc102230 2024-09-21T06:00:57.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfcb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a98f91b0 0x5633a9cc9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfcbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9cc96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a9901390 0x5633a9cca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfcbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9cc96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:53698/0 (socket says 172.21.15.7:53698) 2024-09-21T06:00:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a9901390 0x5633a9cca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:34464/0 (socket says 172.21.15.7:34464) 2024-09-21T06:00:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfcbfff640 1 -- 172.21.15.7:0/3282688160 learned_addr learned my addr 172.21.15.7:0/3282688160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfcb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a98f91b0 0x5633a9cc9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60974/0 (socket says 172.21.15.7:60974) 2024-09-21T06:00:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfcbfff640 1 -- 172.21.15.7:0/3282688160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a9901390 msgr2=0x5633a9cca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/3282688160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a9901390 0x5633a9cca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfcbfff640 1 -- 172.21.15.7:0/3282688160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a98f91b0 msgr2=0x5633a9cc9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/3282688160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a98f91b0 0x5633a9cc9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.885+0000 7fbfcbfff640 1 -- 172.21.15.7:0/3282688160 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633a998d650 con 0x5633a9922070 2024-09-21T06:00:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.886+0000 7fbfc8ff9640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbfb40b66b0 0x7fbfb40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.886+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/3282688160 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9cc96a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4005cc0 tx=0x7fbfc4009800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d59e74bdd5b1c81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.886+0000 7fbfcb7fe640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbfb40b66b0 0x7fbfb40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.886+0000 7fbfc8ff9640 1 -- 172.21.15.7:0/619774361 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fbfbc0e78a0 con 0x7fbfcc102230 2024-09-21T06:00:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.886+0000 7fbfb1ffb640 1 -- 172.21.15.7:0/3282688160 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4031cf0 con 0x5633a9922070 2024-09-21T06:00:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.886+0000 7fbfb1ffb640 1 -- 172.21.15.7:0/3282688160 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfc4036070 con 0x5633a9922070 2024-09-21T06:00:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.886+0000 7fbfb1ffb640 1 -- 172.21.15.7:0/3282688160 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4003e60 con 0x5633a9922070 2024-09-21T06:00:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.887+0000 7fbfd839b740 1 -- 172.21.15.7:0/3282688160 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 msgr2=0x5633a9cc96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.887+0000 7fbfcb7fe640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbfb40b66b0 0x7fbfb40b8bc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0e50f0 tx=0x7fbfbc0ed630 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.887+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3282688160 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9cc96a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4005cc0 tx=0x7fbfc4009800 comp rx=0 tx=0).stop 2024-09-21T06:00:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.887+0000 7fbfd839b740 1 -- 172.21.15.7:0/3282688160 shutdown_connections 2024-09-21T06:00:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.887+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3282688160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a98f91b0 0x5633a9cc9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.887+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3282688160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a9901390 0x5633a9cca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.887+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3282688160 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9cc96a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.887+0000 7fbfd839b740 1 -- 172.21.15.7:0/3282688160 >> 172.21.15.7:0/3282688160 conn(0x5633a9916460 msgr2=0x5633a9cc7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.887+0000 7fbfd839b740 1 -- 172.21.15.7:0/3282688160 shutdown_connections 2024-09-21T06:00:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.887+0000 7fbfd839b740 1 -- 172.21.15.7:0/3282688160 wait complete. 2024-09-21T06:00:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.887+0000 7fbfd839b740 1 -- start start 2024-09-21T06:00:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.888+0000 7fbfd839b740 1 Processor -- start 2024-09-21T06:00:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.888+0000 7fbfd839b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 0x5633a9cd4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.888+0000 7fbfd839b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9901390 0x5633a9cd52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.888+0000 7fbfd839b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9922070 0x5633a9ce1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.888+0000 7fbfd839b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5633a9a90700 con 0x5633a9922070 2024-09-21T06:00:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.888+0000 7fbfd839b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5633a9bca160 con 0x5633a9901390 2024-09-21T06:00:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.888+0000 7fbfd839b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5633a9cd7e20 con 0x5633a98f91b0 2024-09-21T06:00:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.888+0000 7fbfd839b740 10 client.0 _ll_register_callbacks cb 0x5633a9be39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.888+0000 7fbfcbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9922070 0x5633a9ce1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.888+0000 7fbfcbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9922070 0x5633a9ce1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60984/0 (socket says 172.21.15.7:60984) 2024-09-21T06:00:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.888+0000 7fbfcbfff640 1 -- 172.21.15.7:0/1150632089 learned_addr learned my addr 172.21.15.7:0/1150632089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.888+0000 7fbfcaffd640 1 --2- 172.21.15.7:0/1150632089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9901390 0x5633a9cd52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.888+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/1150632089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 0x5633a9cd4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.889+0000 7fbfcaffd640 1 -- 172.21.15.7:0/1150632089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 msgr2=0x5633a9cd4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.889+0000 7fbfcaffd640 1 --2- 172.21.15.7:0/1150632089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 0x5633a9cd4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.889+0000 7fbfcaffd640 1 -- 172.21.15.7:0/1150632089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9922070 msgr2=0x5633a9ce1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.889+0000 7fbfcaffd640 1 --2- 172.21.15.7:0/1150632089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9922070 0x5633a9ce1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.889+0000 7fbfcaffd640 1 -- 172.21.15.7:0/1150632089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633a9bf7c90 con 0x5633a9901390 2024-09-21T06:00:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.889+0000 7fbfcaffd640 1 --2- 172.21.15.7:0/1150632089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9901390 0x5633a9cd52f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0005fd0 tx=0x7fbfc000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1d8bbf3d0d7fabe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.889+0000 7fbfaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T06:00:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.889+0000 7fbfaaffd640 1 -- 172.21.15.7:0/1150632089 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc001c020 con 0x5633a9901390 2024-09-21T06:00:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.889+0000 7fbfaaffd640 1 -- 172.21.15.7:0/1150632089 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fbfc000dd20 con 0x5633a9901390 2024-09-21T06:00:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.889+0000 7fbfd839b740 1 -- 172.21.15.7:0/1150632089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfc4036070 con 0x5633a9901390 2024-09-21T06:00:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.889+0000 7fbfaaffd640 1 -- 172.21.15.7:0/1150632089 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbfc0004020 con 0x5633a9901390 2024-09-21T06:00:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.889+0000 7fbfd839b740 10 client.26876 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.889+0000 7fbfd839b740 1 -- 172.21.15.7:0/1150632089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5633a9ce3bf0 con 0x5633a9901390 2024-09-21T06:00:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.890+0000 7fbfaaffd640 1 -- 172.21.15.7:0/1150632089 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfc4036070 con 0x5633a9901390 2024-09-21T06:00:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.890+0000 7fbfaaffd640 1 -- 172.21.15.7:0/1150632089 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbfc000b040 con 0x5633a9901390 2024-09-21T06:00:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.890+0000 7fbfd839b740 10 client.26876 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.890+0000 7fbfd839b740 10 client.26876 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:00:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.890+0000 7fbfd839b740 20 client.26876 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.890+0000 7fbfd839b740 1 --2- 172.21.15.7:0/1150632089 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5633a98e09f0 0x5633a9ce7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.890+0000 7fbfd839b740 4 client.26876 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.890+0000 7fbfd839b740 1 -- 172.21.15.7:0/1150632089 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633a9c41df0 con 0x5633a98e09f0 2024-09-21T06:00:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.890+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/1150632089 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5633a98e09f0 0x5633a9ce7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.891+0000 7fbfaaffd640 10 client.26876 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.891+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/1150632089 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5633a98e09f0 0x5633a9ce7160 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5d42e9b432f051f0 server_cookie=100622e445a155a4 in_seq=0 out_seq=0 2024-09-21T06:00:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfaaffd640 1 -- 172.21.15.7:0/1150632089 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5633a9c41df0 con 0x5633a98e09f0 2024-09-21T06:00:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfaaffd640 10 client.26876 handle_command_reply: tid=0 2024-09-21T06:00:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfd839b740 1 client.26876 shutdown 2024-09-21T06:00:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfd839b740 1 -- 172.21.15.7:0/1150632089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9901390 msgr2=0x5633a9cd52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfd839b740 1 --2- 172.21.15.7:0/1150632089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9901390 0x5633a9cd52f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0005fd0 tx=0x7fbfc000ec80 comp rx=0 tx=0).stop 2024-09-21T06:00:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfd839b740 1 -- 172.21.15.7:0/1150632089 shutdown_connections 2024-09-21T06:00:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfd839b740 1 --2- 172.21.15.7:0/1150632089 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5633a98e09f0 0x5633a9ce7160 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfd839b740 1 --2- 172.21.15.7:0/1150632089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9922070 0x5633a9ce1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfd839b740 1 --2- 172.21.15.7:0/1150632089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9901390 0x5633a9cd52f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfd839b740 1 --2- 172.21.15.7:0/1150632089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 0x5633a9cd4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfaaffd640 0 client.26876 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfd839b740 1 -- 172.21.15.7:0/1150632089 >> 172.21.15.7:0/1150632089 conn(0x5633a9916460 msgr2=0x5633a9ccc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfd839b740 1 -- 172.21.15.7:0/1150632089 shutdown_connections 2024-09-21T06:00:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfd839b740 1 -- 172.21.15.7:0/1150632089 wait complete. 2024-09-21T06:00:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.892+0000 7fbfd839b740 20 client.26876 trim_cache size 0 max 16384 2024-09-21T06:00:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.905+0000 7fbfd839b740 1 Processor -- start 2024-09-21T06:00:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.905+0000 7fbfd839b740 1 -- start start 2024-09-21T06:00:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.905+0000 7fbfd839b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 0x5633a9cd5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.905+0000 7fbfd839b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 0x5633a9cc75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.905+0000 7fbfd839b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9ce1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.905+0000 7fbfd839b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc1b1e60 con 0x5633a9901390 2024-09-21T06:00:57.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.905+0000 7fbfd839b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc1af730 con 0x5633a9922070 2024-09-21T06:00:57.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.905+0000 7fbfd839b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc1ad5a0 con 0x5633a98f91b0 2024-09-21T06:00:57.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 0x5633a9cc75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 0x5633a9cc75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60994/0 (socket says 172.21.15.7:60994) 2024-09-21T06:00:57.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfcaffd640 1 -- 172.21.15.7:0/3920399986 learned_addr learned my addr 172.21.15.7:0/3920399986 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:57.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/3920399986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 0x5633a9cd5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/3920399986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9ce1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfcaffd640 1 -- 172.21.15.7:0/3920399986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 msgr2=0x5633a9cd5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfcaffd640 1 --2- 172.21.15.7:0/3920399986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 0x5633a9cd5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfcaffd640 1 -- 172.21.15.7:0/3920399986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 msgr2=0x5633a9ce1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfcaffd640 1 --2- 172.21.15.7:0/3920399986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9ce1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfcaffd640 1 -- 172.21.15.7:0/3920399986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633a9cd32b0 con 0x5633a9901390 2024-09-21T06:00:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/3920399986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9ce1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfcaffd640 1 --2- 172.21.15.7:0/3920399986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 0x5633a9cc75e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000c360 tx=0x7fbfc00187c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2832ae918dfb9717 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfb17fa640 1 -- 172.21.15.7:0/3920399986 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc001c070 con 0x5633a9901390 2024-09-21T06:00:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfb17fa640 1 -- 172.21.15.7:0/3920399986 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfc002f070 con 0x5633a9901390 2024-09-21T06:00:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.906+0000 7fbfb17fa640 1 -- 172.21.15.7:0/3920399986 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0018bc0 con 0x5633a9901390 2024-09-21T06:00:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.907+0000 7fbfd839b740 1 -- 172.21.15.7:0/3920399986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 msgr2=0x5633a9cc75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.907+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3920399986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 0x5633a9cc75e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000c360 tx=0x7fbfc00187c0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.907+0000 7fbfd839b740 1 -- 172.21.15.7:0/3920399986 shutdown_connections 2024-09-21T06:00:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.907+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3920399986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 0x5633a9cc75e0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.907+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3920399986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9ce1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.907+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3920399986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 0x5633a9cd5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.907+0000 7fbfd839b740 1 -- 172.21.15.7:0/3920399986 >> 172.21.15.7:0/3920399986 conn(0x5633a9916460 msgr2=0x5633a9cc6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.907+0000 7fbfd839b740 1 -- 172.21.15.7:0/3920399986 shutdown_connections 2024-09-21T06:00:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.907+0000 7fbfd839b740 1 -- 172.21.15.7:0/3920399986 wait complete. 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.908+0000 7fbfd839b740 1 -- start start 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.908+0000 7fbfd839b740 1 Processor -- start 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.908+0000 7fbfd839b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 0x5633a9cdd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.908+0000 7fbfd839b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 0x5633a9cd8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.908+0000 7fbfd839b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9cd9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.908+0000 7fbfd839b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc1adbf0 con 0x5633a9901390 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.908+0000 7fbfd839b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc1af060 con 0x5633a9922070 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.908+0000 7fbfd839b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc1ae2c0 con 0x5633a98f91b0 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.908+0000 7fbfd839b740 10 client.0 _ll_register_callbacks cb 0x7fbfc000c8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.908+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 0x5633a9cd8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.908+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 0x5633a9cd8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32770/0 (socket says 172.21.15.7:32770) 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.908+0000 7fbfcaffd640 1 -- 172.21.15.7:0/3291045467 learned_addr learned my addr 172.21.15.7:0/3291045467 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.908+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 0x5633a9cdd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9cd9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfcaffd640 1 -- 172.21.15.7:0/3291045467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 msgr2=0x5633a9cdd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfcaffd640 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 0x5633a9cdd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfcaffd640 1 -- 172.21.15.7:0/3291045467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 msgr2=0x5633a9cd9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfcaffd640 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9cd9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfcaffd640 1 -- 172.21.15.7:0/3291045467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633a9cd97f0 con 0x5633a9901390 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9cd9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfcaffd640 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 0x5633a9cd8c40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000c720 tx=0x7fbfc00057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767d60b5e8bcd865 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfaaffd640 1 -- 172.21.15.7:0/3291045467 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc001c070 con 0x5633a9901390 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfaaffd640 1 -- 172.21.15.7:0/3291045467 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fbfc000dd20 con 0x5633a9901390 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfd839b740 1 -- 172.21.15.7:0/3291045467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfc002f070 con 0x5633a9901390 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfaaffd640 1 -- 172.21.15.7:0/3291045467 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbfc0041050 con 0x5633a9901390 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfd839b740 10 client.17487 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.909+0000 7fbfd839b740 1 -- 172.21.15.7:0/3291045467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5633a9d518b0 con 0x5633a9901390 2024-09-21T06:00:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.910+0000 7fbfaaffd640 1 -- 172.21.15.7:0/3291045467 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfc002f070 con 0x5633a9901390 2024-09-21T06:00:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.910+0000 7fbfaaffd640 1 -- 172.21.15.7:0/3291045467 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbfc0003b20 con 0x5633a9901390 2024-09-21T06:00:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.910+0000 7fbfd839b740 10 client.17487 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.910+0000 7fbfd839b740 10 client.17487 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:00:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.910+0000 7fbfd839b740 20 client.17487 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.910+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5633a98b5da0 0x5633a9d53f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.910+0000 7fbfd839b740 4 client.17487 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.910+0000 7fbfd839b740 1 -- 172.21.15.7:0/3291045467 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5633a9c3d8a0 con 0x5633a98b5da0 2024-09-21T06:00:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.910+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5633a98b5da0 0x5633a9d53f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.910+0000 7fbfcbfff640 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5633a98b5da0 0x5633a9d53f70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5bfea13be41db44e server_cookie=b9c272f4330b23e9 in_seq=0 out_seq=0 2024-09-21T06:00:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.910+0000 7fbfaaffd640 10 client.17487 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfaaffd640 1 -- 172.21.15.7:0/3291045467 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5633a9c3d8a0 con 0x5633a98b5da0 2024-09-21T06:00:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfaaffd640 10 client.17487 handle_command_reply: tid=0 2024-09-21T06:00:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfd839b740 1 client.17487 shutdown 2024-09-21T06:00:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfd839b740 1 -- 172.21.15.7:0/3291045467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 msgr2=0x5633a9cd8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 0x5633a9cd8c40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000c720 tx=0x7fbfc00057a0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfd839b740 1 -- 172.21.15.7:0/3291045467 shutdown_connections 2024-09-21T06:00:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x5633a98b5da0 0x5633a9d53f70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633a9901390 0x5633a9cd8c40 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5633a9922070 0x5633a9cd9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfaaffd640 0 client.17487 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:00:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfd839b740 1 --2- 172.21.15.7:0/3291045467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5633a98f91b0 0x5633a9cdd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfd839b740 1 -- 172.21.15.7:0/3291045467 >> 172.21.15.7:0/3291045467 conn(0x5633a9916460 msgr2=0x5633a9cca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfd839b740 1 -- 172.21.15.7:0/3291045467 shutdown_connections 2024-09-21T06:00:57.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfd839b740 1 -- 172.21.15.7:0/3291045467 wait complete. 2024-09-21T06:00:57.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.911+0000 7fbfd839b740 20 client.17487 trim_cache size 0 max 16384 2024-09-21T06:00:57.919 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:57.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.912+0000 7fbfd1e27640 1 -- 172.21.15.7:0/619774361 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbfb40b66b0 msgr2=0x7fbfb40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:57.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.912+0000 7fbfd1e27640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbfb40b66b0 0x7fbfb40b8bc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0e50f0 tx=0x7fbfbc0ed630 comp rx=0 tx=0).stop 2024-09-21T06:00:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.912+0000 7fbfd1e27640 1 -- 172.21.15.7:0/619774361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfcc102230 msgr2=0x7fbfcc19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.912+0000 7fbfd1e27640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfcc102230 0x7fbfcc19a450 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c920 tx=0x7fbfbc00cde0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.912+0000 7fbfd1e27640 1 -- 172.21.15.7:0/619774361 shutdown_connections 2024-09-21T06:00:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.912+0000 7fbfd1e27640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbfb40b66b0 0x7fbfb40b8bc0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.912+0000 7fbfd1e27640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfcc1084c0 0x7fbfcc19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.912+0000 7fbfd1e27640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfcc107b70 0x7fbfcc19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.912+0000 7fbfd1e27640 1 --2- 172.21.15.7:0/619774361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfcc102230 0x7fbfcc19a450 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.912+0000 7fbfd1e27640 1 -- 172.21.15.7:0/619774361 >> 172.21.15.7:0/619774361 conn(0x7fbfcc079e40 msgr2=0x7fbfcc101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.912+0000 7fbfd1e27640 1 -- 172.21.15.7:0/619774361 shutdown_connections 2024-09-21T06:00:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:57.912+0000 7fbfd1e27640 1 -- 172.21.15.7:0/619774361 wait complete. 2024-09-21T06:00:58.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:00:58 smithi007 ceph-mon[30983]: pgmap v532: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:00:58.637 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:00:58.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:00:58 smithi027 ceph-mon[34364]: pgmap v532: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:00:58.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:00:58 smithi119 ceph-mon[34833]: pgmap v532: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:00:58.897 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:00:59.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.446+0000 7efc03f1a640 1 -- 172.21.15.7:0/3656872997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efbfc1094a0 msgr2=0x7efbfc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:59.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.446+0000 7efc03f1a640 1 --2- 172.21.15.7:0/3656872997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efbfc1094a0 0x7efbfc1098b0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7efbec009900 tx=0x7efbec02a410 comp rx=0 tx=0).stop 2024-09-21T06:00:59.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.446+0000 7efc03f1a640 1 -- 172.21.15.7:0/3656872997 shutdown_connections 2024-09-21T06:00:59.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.446+0000 7efc03f1a640 1 --2- 172.21.15.7:0/3656872997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efbfc1094a0 0x7efbfc1098b0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.447+0000 7efc03f1a640 1 --2- 172.21.15.7:0/3656872997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efbfc109df0 0x7efbfc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.447+0000 7efc03f1a640 1 --2- 172.21.15.7:0/3656872997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efbfc103b60 0x7efbfc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.447+0000 7efc03f1a640 1 -- 172.21.15.7:0/3656872997 >> 172.21.15.7:0/3656872997 conn(0x7efbfc07b850 msgr2=0x7efbfc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:59.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.447+0000 7efc03f1a640 1 -- 172.21.15.7:0/3656872997 shutdown_connections 2024-09-21T06:00:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.447+0000 7efc03f1a640 1 -- 172.21.15.7:0/3656872997 wait complete. 2024-09-21T06:00:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.447+0000 7efc03f1a640 1 Processor -- start 2024-09-21T06:00:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.447+0000 7efc03f1a640 1 -- start start 2024-09-21T06:00:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc03f1a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efbfc103b60 0x7efbfc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc03f1a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efbfc1094a0 0x7efbfc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc03f1a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efbfc109df0 0x7efbfc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc03f1a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc113ab0 con 0x7efbfc1094a0 2024-09-21T06:00:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc03f1a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc113930 con 0x7efbfc109df0 2024-09-21T06:00:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc03f1a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc113c30 con 0x7efbfc103b60 2024-09-21T06:00:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc014b5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efbfc1094a0 0x7efbfc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc014b5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efbfc1094a0 0x7efbfc075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40208/0 (socket says 172.21.15.7:40208) 2024-09-21T06:00:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc014b5640 1 -- 172.21.15.7:0/2270401136 learned_addr learned my addr 172.21.15.7:0/2270401136 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc01cb6640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efbfc103b60 0x7efbfc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc024b7640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efbfc109df0 0x7efbfc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc014b5640 1 -- 172.21.15.7:0/2270401136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efbfc103b60 msgr2=0x7efbfc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc014b5640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efbfc103b60 0x7efbfc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc014b5640 1 -- 172.21.15.7:0/2270401136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efbfc109df0 msgr2=0x7efbfc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc014b5640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efbfc109df0 0x7efbfc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc014b5640 1 -- 172.21.15.7:0/2270401136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc1a8740 con 0x7efbfc1094a0 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc01cb6640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efbfc103b60 0x7efbfc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc024b7640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efbfc109df0 0x7efbfc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc014b5640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efbfc1094a0 0x7efbfc075c50 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7efbec02a930 tx=0x7efbec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efbf2ffd640 1 -- 172.21.15.7:0/2270401136 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec03f030 con 0x7efbfc1094a0 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.448+0000 7efc03f1a640 1 -- 172.21.15.7:0/2270401136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbfc1a89d0 con 0x7efbfc1094a0 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.449+0000 7efbf2ffd640 1 -- 172.21.15.7:0/2270401136 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efbec003aa0 con 0x7efbfc1094a0 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.449+0000 7efbf2ffd640 1 -- 172.21.15.7:0/2270401136 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec035070 con 0x7efbfc1094a0 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.449+0000 7efc03f1a640 1 -- 172.21.15.7:0/2270401136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbfc1a8eb0 con 0x7efbfc1094a0 2024-09-21T06:00:59.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.451+0000 7efc0a48e740 1 Processor -- start 2024-09-21T06:00:59.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.452+0000 7efc0a48e740 1 -- start start 2024-09-21T06:00:59.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.452+0000 7efbf2ffd640 1 -- 172.21.15.7:0/2270401136 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7efbec042030 con 0x7efbfc1094a0 2024-09-21T06:00:59.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.452+0000 7efc0a48e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42be9070 0x55da42f906a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.452+0000 7efc0a48e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc01b0 0x55da42f90be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.452+0000 7efc0a48e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 0x55da42f91120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.452+0000 7efc0a48e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55da42f06ea0 con 0x55da42bc8390 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.452+0000 7efc0a48e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55da42ef62d0 con 0x55da42be9070 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.452+0000 7efc0a48e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55da42efa0e0 con 0x55da42bc01b0 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.452+0000 7efc014b5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 0x55da42f91120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.452+0000 7efc014b5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 0x55da42f91120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40210/0 (socket says 172.21.15.7:40210) 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.452+0000 7efc014b5640 1 -- 172.21.15.7:0/223777870 learned_addr learned my addr 172.21.15.7:0/223777870 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.452+0000 7efc01cb6640 1 --2- 172.21.15.7:0/223777870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc01b0 0x55da42f90be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.452+0000 7efc024b7640 1 --2- 172.21.15.7:0/223777870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42be9070 0x55da42f906a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efc014b5640 1 -- 172.21.15.7:0/223777870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc01b0 msgr2=0x55da42f90be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efc014b5640 1 --2- 172.21.15.7:0/223777870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc01b0 0x55da42f90be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efc014b5640 1 -- 172.21.15.7:0/223777870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42be9070 msgr2=0x55da42f906a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efc014b5640 1 --2- 172.21.15.7:0/223777870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42be9070 0x55da42f906a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efc014b5640 1 -- 172.21.15.7:0/223777870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da42c54650 con 0x55da42bc8390 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efc024b7640 1 --2- 172.21.15.7:0/223777870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42be9070 0x55da42f906a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efc01cb6640 1 --2- 172.21.15.7:0/223777870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc01b0 0x55da42f90be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:59.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efc014b5640 1 --2- 172.21.15.7:0/223777870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 0x55da42f91120 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7efbec105230 tx=0x7efbec10bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed55c5018025e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efbf2ffd640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efbe80b6680 0x7efbe80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efc024b7640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efbe80b6680 0x7efbe80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efbe7fff640 1 -- 172.21.15.7:0/223777870 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec117020 con 0x55da42bc8390 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efbf2ffd640 1 -- 172.21.15.7:0/2270401136 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7efbec107b20 con 0x7efbfc1094a0 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efbe7fff640 1 -- 172.21.15.7:0/223777870 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efbec10c040 con 0x55da42bc8390 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.453+0000 7efbe7fff640 1 -- 172.21.15.7:0/223777870 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec0ca010 con 0x55da42bc8390 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.454+0000 7efc0a48e740 1 -- 172.21.15.7:0/223777870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 msgr2=0x55da42f91120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.454+0000 7efc0a48e740 1 --2- 172.21.15.7:0/223777870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 0x55da42f91120 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7efbec105230 tx=0x7efbec10bdf0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.454+0000 7efc024b7640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efbe80b6680 0x7efbe80b8b90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efbf4005fd0 tx=0x7efbf4009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.454+0000 7efc0a48e740 1 -- 172.21.15.7:0/223777870 shutdown_connections 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.454+0000 7efc0a48e740 1 --2- 172.21.15.7:0/223777870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 0x55da42f91120 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.454+0000 7efc0a48e740 1 --2- 172.21.15.7:0/223777870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc01b0 0x55da42f90be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.454+0000 7efc0a48e740 1 --2- 172.21.15.7:0/223777870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42be9070 0x55da42f906a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.454+0000 7efc0a48e740 1 -- 172.21.15.7:0/223777870 >> 172.21.15.7:0/223777870 conn(0x55da42bdd460 msgr2=0x55da42f8e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.454+0000 7efc0a48e740 1 -- 172.21.15.7:0/223777870 shutdown_connections 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.454+0000 7efc0a48e740 1 -- 172.21.15.7:0/223777870 wait complete. 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.455+0000 7efc0a48e740 1 -- start start 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.455+0000 7efc0a48e740 1 Processor -- start 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.455+0000 7efc0a48e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 0x55da42f9bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.455+0000 7efc0a48e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc8390 0x55da42f9c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.455+0000 7efc0a48e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 0x55da42fa7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.455+0000 7efc0a48e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55da42d57700 con 0x55da42be9070 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.455+0000 7efc0a48e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55da42e91160 con 0x55da42bc01b0 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.455+0000 7efc0a48e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55da42f9ec40 con 0x55da42bc8390 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc0a48e740 10 client.0 _ll_register_callbacks cb 0x55da42eaa9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc024b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 0x55da42fa7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc024b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 0x55da42fa7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40220/0 (socket says 172.21.15.7:40220) 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc024b7640 1 -- 172.21.15.7:0/4258446657 learned_addr learned my addr 172.21.15.7:0/4258446657 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc01cb6640 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 0x55da42f9bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc014b5640 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc8390 0x55da42f9c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc024b7640 1 -- 172.21.15.7:0/4258446657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc8390 msgr2=0x55da42f9c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc024b7640 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc8390 0x55da42f9c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc024b7640 1 -- 172.21.15.7:0/4258446657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 msgr2=0x55da42f9bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc024b7640 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 0x55da42f9bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc024b7640 1 -- 172.21.15.7:0/4258446657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da42ebec90 con 0x55da42be9070 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc014b5640 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc8390 0x55da42f9c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc01cb6640 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 0x55da42f9bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efc024b7640 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 0x55da42fa7ea0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7efbf40128f0 tx=0x7efbf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a6d2082db3210b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.456+0000 7efbe57fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efbe57fa640 1 -- 172.21.15.7:0/4258446657 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf400fdb0 con 0x55da42be9070 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efbe57fa640 1 -- 172.21.15.7:0/4258446657 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7efbf401f420 con 0x55da42be9070 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efc0a48e740 1 -- 172.21.15.7:0/4258446657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efbec10c040 con 0x55da42be9070 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efbe57fa640 1 -- 172.21.15.7:0/4258446657 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efbf401f620 con 0x55da42be9070 2024-09-21T06:00:59.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efc0a48e740 10 client.17499 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efc0a48e740 1 -- 172.21.15.7:0/4258446657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55da42faa8e0 con 0x55da42be9070 2024-09-21T06:00:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efbe57fa640 1 -- 172.21.15.7:0/4258446657 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efbec10c040 con 0x55da42be9070 2024-09-21T06:00:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efbe57fa640 1 -- 172.21.15.7:0/4258446657 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efbf40306d0 con 0x55da42be9070 2024-09-21T06:00:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efc0a48e740 10 client.17499 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efc0a48e740 10 client.17499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efc0a48e740 20 client.17499 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efc0a48e740 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55da42ba79f0 0x55da42fadda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efc0a48e740 4 client.17499 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:00:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.457+0000 7efc0a48e740 1 -- 172.21.15.7:0/4258446657 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da42f08df0 con 0x55da42ba79f0 2024-09-21T06:00:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.458+0000 7efc01cb6640 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55da42ba79f0 0x55da42fadda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.458+0000 7efc01cb6640 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55da42ba79f0 0x55da42fadda0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c78a65ad800f5c0 server_cookie=ec95b019fc65fa54 in_seq=0 out_seq=0 2024-09-21T06:00:59.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.458+0000 7efbe57fa640 10 client.17499 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:59.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.459+0000 7efbe57fa640 1 -- 172.21.15.7:0/4258446657 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da42f08df0 con 0x55da42ba79f0 2024-09-21T06:00:59.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.459+0000 7efbe57fa640 10 client.17499 handle_command_reply: tid=0 2024-09-21T06:00:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.459+0000 7efc0a48e740 1 client.17499 shutdown 2024-09-21T06:00:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.459+0000 7efc0a48e740 1 -- 172.21.15.7:0/4258446657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 msgr2=0x55da42fa7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.459+0000 7efc0a48e740 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 0x55da42fa7ea0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7efbf40128f0 tx=0x7efbf4004a40 comp rx=0 tx=0).stop 2024-09-21T06:00:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.459+0000 7efc0a48e740 1 -- 172.21.15.7:0/4258446657 shutdown_connections 2024-09-21T06:00:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.459+0000 7efc0a48e740 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55da42ba79f0 0x55da42fadda0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.459+0000 7efc0a48e740 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 0x55da42fa7ea0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.459+0000 7efc0a48e740 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc8390 0x55da42f9c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.459+0000 7efbe57fa640 0 client.17499 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.459+0000 7efc0a48e740 1 --2- 172.21.15.7:0/4258446657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 0x55da42f9bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.459+0000 7efc0a48e740 1 -- 172.21.15.7:0/4258446657 >> 172.21.15.7:0/4258446657 conn(0x55da42bdd460 msgr2=0x55da42f93830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.459+0000 7efc0a48e740 1 -- 172.21.15.7:0/4258446657 shutdown_connections 2024-09-21T06:00:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.460+0000 7efc0a48e740 1 -- 172.21.15.7:0/4258446657 wait complete. 2024-09-21T06:00:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.460+0000 7efc0a48e740 20 client.17499 trim_cache size 0 max 16384 2024-09-21T06:00:59.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.473+0000 7efc0a48e740 1 Processor -- start 2024-09-21T06:00:59.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.473+0000 7efc0a48e740 1 -- start start 2024-09-21T06:00:59.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.473+0000 7efc0a48e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 0x55da42f9dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.473+0000 7efc0a48e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 0x55da42f91d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.473+0000 7efc0a48e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42be9070 0x55da42fa7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.473+0000 7efc0a48e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc1b4110 con 0x55da42bc8390 2024-09-21T06:00:59.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.473+0000 7efc0a48e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc1b19e0 con 0x55da42bc01b0 2024-09-21T06:00:59.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.473+0000 7efc0a48e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc1af850 con 0x55da42be9070 2024-09-21T06:00:59.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efc014b5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 0x55da42f91d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efc014b5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 0x55da42f91d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40234/0 (socket says 172.21.15.7:40234) 2024-09-21T06:00:59.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efc014b5640 1 -- 172.21.15.7:0/1835753741 learned_addr learned my addr 172.21.15.7:0/1835753741 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:59.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efc01cb6640 1 --2- 172.21.15.7:0/1835753741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 0x55da42f9dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efc024b7640 1 --2- 172.21.15.7:0/1835753741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42be9070 0x55da42fa7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efc014b5640 1 -- 172.21.15.7:0/1835753741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42be9070 msgr2=0x55da42fa7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:59.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efc014b5640 1 --2- 172.21.15.7:0/1835753741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42be9070 0x55da42fa7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efc014b5640 1 -- 172.21.15.7:0/1835753741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 msgr2=0x55da42f9dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:59.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efc014b5640 1 --2- 172.21.15.7:0/1835753741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 0x55da42f9dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efc014b5640 1 -- 172.21.15.7:0/1835753741 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da42f8f350 con 0x55da42bc8390 2024-09-21T06:00:59.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efc014b5640 1 --2- 172.21.15.7:0/1835753741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 0x55da42f91d90 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7efbec107fd0 tx=0x7efbec03b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f0efa40a4a03eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:59.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efbe77fe640 1 -- 172.21.15.7:0/1835753741 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec117070 con 0x55da42bc8390 2024-09-21T06:00:59.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efbe77fe640 1 -- 172.21.15.7:0/1835753741 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efbec10b440 con 0x55da42bc8390 2024-09-21T06:00:59.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.474+0000 7efbe77fe640 1 -- 172.21.15.7:0/1835753741 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec049070 con 0x55da42bc8390 2024-09-21T06:00:59.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.475+0000 7efc0a48e740 1 -- 172.21.15.7:0/1835753741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 msgr2=0x55da42f91d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:59.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.475+0000 7efc0a48e740 1 --2- 172.21.15.7:0/1835753741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 0x55da42f91d90 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7efbec107fd0 tx=0x7efbec03b6b0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.475+0000 7efc0a48e740 1 -- 172.21.15.7:0/1835753741 shutdown_connections 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.475+0000 7efc0a48e740 1 --2- 172.21.15.7:0/1835753741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42bc8390 0x55da42f91d90 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.475+0000 7efc0a48e740 1 --2- 172.21.15.7:0/1835753741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42be9070 0x55da42fa7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.475+0000 7efc0a48e740 1 --2- 172.21.15.7:0/1835753741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 0x55da42f9dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.475+0000 7efc0a48e740 1 -- 172.21.15.7:0/1835753741 >> 172.21.15.7:0/1835753741 conn(0x55da42bdd460 msgr2=0x55da42f91680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.475+0000 7efc0a48e740 1 -- 172.21.15.7:0/1835753741 shutdown_connections 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.475+0000 7efc0a48e740 1 -- 172.21.15.7:0/1835753741 wait complete. 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc0a48e740 1 -- start start 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc0a48e740 1 Processor -- start 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc0a48e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 0x55da42f9ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc0a48e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc8390 0x55da42fa0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc0a48e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 0x55da42fa0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc0a48e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc1afea0 con 0x55da42be9070 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc0a48e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc1b1310 con 0x55da42bc01b0 2024-09-21T06:00:59.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc0a48e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc1b0570 con 0x55da42bc8390 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc0a48e740 10 client.0 _ll_register_callbacks cb 0x7efbf4012570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc024b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 0x55da42fa0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc024b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 0x55da42fa0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40236/0 (socket says 172.21.15.7:40236) 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc024b7640 1 -- 172.21.15.7:0/1443595671 learned_addr learned my addr 172.21.15.7:0/1443595671 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc01cb6640 1 --2- 172.21.15.7:0/1443595671 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 0x55da42f9ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.476+0000 7efc014b5640 1 --2- 172.21.15.7:0/1443595671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc8390 0x55da42fa0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.477+0000 7efc024b7640 1 -- 172.21.15.7:0/1443595671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc8390 msgr2=0x55da42fa0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.477+0000 7efc024b7640 1 --2- 172.21.15.7:0/1443595671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc8390 0x55da42fa0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.477+0000 7efc024b7640 1 -- 172.21.15.7:0/1443595671 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 msgr2=0x55da42f9ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.477+0000 7efc024b7640 1 --2- 172.21.15.7:0/1443595671 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 0x55da42f9ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.477+0000 7efc024b7640 1 -- 172.21.15.7:0/1443595671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da43017850 con 0x55da42be9070 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.477+0000 7efc024b7640 1 --2- 172.21.15.7:0/1443595671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 0x55da42fa0980 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7efbf4030b20 tx=0x7efbf40306e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35f8df21f459951 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.477+0000 7efbe57fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.477+0000 7efbe57fa640 1 -- 172.21.15.7:0/1443595671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4036070 con 0x55da42be9070 2024-09-21T06:00:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.477+0000 7efbe57fa640 1 -- 172.21.15.7:0/1443595671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7efbf401f9d0 con 0x55da42be9070 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.477+0000 7efc0a48e740 1 -- 172.21.15.7:0/1443595671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efbec10b440 con 0x55da42be9070 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.477+0000 7efbe57fa640 1 -- 172.21.15.7:0/1443595671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efbf4049050 con 0x55da42be9070 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.477+0000 7efc0a48e740 10 client.17505 fetch_fsmap learned FSMap version 25 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.477+0000 7efc0a48e740 1 -- 172.21.15.7:0/1443595671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55da43018ad0 con 0x55da42be9070 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.478+0000 7efbe57fa640 1 -- 172.21.15.7:0/1443595671 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efbec10b440 con 0x55da42be9070 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.478+0000 7efbe57fa640 1 -- 172.21.15.7:0/1443595671 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efbf403b8f0 con 0x55da42be9070 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.478+0000 7efc0a48e740 10 client.17505 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.478+0000 7efc0a48e740 10 client.17505 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.478+0000 7efc0a48e740 20 client.17505 populate_metadata read hostname 'smithi007' 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.478+0000 7efc0a48e740 1 --2- 172.21.15.7:0/1443595671 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55da42b7cda0 0x55da4301b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.478+0000 7efc0a48e740 4 client.17505 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.478+0000 7efc0a48e740 1 -- 172.21.15.7:0/1443595671 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55da42f048a0 con 0x55da42b7cda0 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.478+0000 7efc01cb6640 1 --2- 172.21.15.7:0/1443595671 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55da42b7cda0 0x55da4301b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:00:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efbe57fa640 10 client.17505 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efc01cb6640 1 --2- 172.21.15.7:0/1443595671 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55da42b7cda0 0x55da4301b340 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d87197d7b18cdaf2 server_cookie=f6fcde84cafa30ee in_seq=0 out_seq=0 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efbe57fa640 1 -- 172.21.15.7:0/1443595671 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55da42f048a0 con 0x55da42b7cda0 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efbe57fa640 10 client.17505 handle_command_reply: tid=0 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efc0a48e740 1 client.17505 shutdown 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efc0a48e740 1 -- 172.21.15.7:0/1443595671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 msgr2=0x55da42fa0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efc0a48e740 1 --2- 172.21.15.7:0/1443595671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 0x55da42fa0980 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7efbf4030b20 tx=0x7efbf40306e0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efc0a48e740 1 -- 172.21.15.7:0/1443595671 shutdown_connections 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efc0a48e740 1 --2- 172.21.15.7:0/1443595671 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55da42b7cda0 0x55da4301b340 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efc0a48e740 1 --2- 172.21.15.7:0/1443595671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da42be9070 0x55da42fa0980 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efc0a48e740 1 --2- 172.21.15.7:0/1443595671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55da42bc8390 0x55da42fa0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efc0a48e740 1 --2- 172.21.15.7:0/1443595671 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55da42bc01b0 0x55da42f9ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efbe57fa640 0 client.17505 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efc0a48e740 1 -- 172.21.15.7:0/1443595671 >> 172.21.15.7:0/1443595671 conn(0x55da42bdd460 msgr2=0x55da42f9dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efc0a48e740 1 -- 172.21.15.7:0/1443595671 shutdown_connections 2024-09-21T06:00:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.479+0000 7efc0a48e740 1 -- 172.21.15.7:0/1443595671 wait complete. 2024-09-21T06:00:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.480+0000 7efc0a48e740 20 client.17505 trim_cache size 0 max 16384 2024-09-21T06:00:59.486 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:00:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.480+0000 7efc03f1a640 1 -- 172.21.15.7:0/2270401136 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efbe80b6680 msgr2=0x7efbe80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.480+0000 7efc03f1a640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efbe80b6680 0x7efbe80b8b90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efbf4005fd0 tx=0x7efbf4009680 comp rx=0 tx=0).stop 2024-09-21T06:00:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.480+0000 7efc03f1a640 1 -- 172.21.15.7:0/2270401136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efbfc1094a0 msgr2=0x7efbfc075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:00:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.480+0000 7efc03f1a640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efbfc1094a0 0x7efbfc075c50 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7efbec02a930 tx=0x7efbec004270 comp rx=0 tx=0).stop 2024-09-21T06:00:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.480+0000 7efc03f1a640 1 -- 172.21.15.7:0/2270401136 shutdown_connections 2024-09-21T06:00:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.480+0000 7efc03f1a640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efbe80b6680 0x7efbe80b8b90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.480+0000 7efc03f1a640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efbfc1094a0 0x7efbfc075c50 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.480+0000 7efc03f1a640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efbfc109df0 0x7efbfc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.480+0000 7efc03f1a640 1 --2- 172.21.15.7:0/2270401136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efbfc103b60 0x7efbfc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:00:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.480+0000 7efc03f1a640 1 -- 172.21.15.7:0/2270401136 >> 172.21.15.7:0/2270401136 conn(0x7efbfc07b850 msgr2=0x7efbfc107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:00:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.480+0000 7efc03f1a640 1 -- 172.21.15.7:0/2270401136 shutdown_connections 2024-09-21T06:00:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:00:59.480+0000 7efc03f1a640 1 -- 172.21.15.7:0/2270401136 wait complete. 2024-09-21T06:01:00.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:00 smithi007 ceph-mon[30983]: pgmap v533: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:01:00.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:00 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:01:00.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:00 smithi027 ceph-mon[34364]: pgmap v533: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:01:00.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:00 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:01:00.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:00 smithi119 ceph-mon[34833]: pgmap v533: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:01:00.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:00 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:01:01.149 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:01:01.149 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:01:01.408 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:01.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:01:01.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:01:01.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:01:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:01:01.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:01:01.593 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:01:01.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:01:01.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:01:01.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:01:01.728 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:01:01.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.874+0000 7fbe2fb20640 1 -- 172.21.15.7:0/357001916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe28107bf0 msgr2=0x7fbe281080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:01.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.874+0000 7fbe2fb20640 1 --2- 172.21.15.7:0/357001916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe28107bf0 0x7fbe281080d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009cd0 tx=0x7fbe2002a8e0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.874+0000 7fbe2fb20640 1 -- 172.21.15.7:0/357001916 shutdown_connections 2024-09-21T06:01:01.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.874+0000 7fbe2fb20640 1 --2- 172.21.15.7:0/357001916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe28107bf0 0x7fbe281080d0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.874+0000 7fbe2fb20640 1 --2- 172.21.15.7:0/357001916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe28103100 0x7fbe28107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.874+0000 7fbe2fb20640 1 --2- 172.21.15.7:0/357001916 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe281027b0 0x7fbe28102bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.874+0000 7fbe2fb20640 1 -- 172.21.15.7:0/357001916 >> 172.21.15.7:0/357001916 conn(0x7fbe28079730 msgr2=0x7fbe28079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:01.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.874+0000 7fbe2fb20640 1 -- 172.21.15.7:0/357001916 shutdown_connections 2024-09-21T06:01:01.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.874+0000 7fbe2fb20640 1 -- 172.21.15.7:0/357001916 wait complete. 2024-09-21T06:01:01.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2fb20640 1 Processor -- start 2024-09-21T06:01:01.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2fb20640 1 -- start start 2024-09-21T06:01:01.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2fb20640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe281027b0 0x7fbe281a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2fb20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe28103100 0x7fbe281a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2fb20640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe28107bf0 0x7fbe281a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2fb20640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2811a090 con 0x7fbe28103100 2024-09-21T06:01:01.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2fb20640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbe28119f10 con 0x7fbe281027b0 2024-09-21T06:01:01.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2fb20640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2811a210 con 0x7fbe28107bf0 2024-09-21T06:01:01.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2d0bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe28103100 0x7fbe281a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2d0bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe28103100 0x7fbe281a1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40254/0 (socket says 172.21.15.7:40254) 2024-09-21T06:01:01.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2d0bb640 1 -- 172.21.15.7:0/922009988 learned_addr learned my addr 172.21.15.7:0/922009988 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:01.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2d8bc640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe281027b0 0x7fbe281a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe28107bf0 0x7fbe281a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.875+0000 7fbe2d0bb640 1 -- 172.21.15.7:0/922009988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe28107bf0 msgr2=0x7fbe281a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:01.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.876+0000 7fbe2d0bb640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe28107bf0 0x7fbe281a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.876+0000 7fbe2d0bb640 1 -- 172.21.15.7:0/922009988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe281027b0 msgr2=0x7fbe281a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:01.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.876+0000 7fbe2d0bb640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe281027b0 0x7fbe281a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.876+0000 7fbe2d0bb640 1 -- 172.21.15.7:0/922009988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe281a6a50 con 0x7fbe28103100 2024-09-21T06:01:01.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.876+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe28107bf0 0x7fbe281a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:01.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.876+0000 7fbe2d0bb640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe28103100 0x7fbe281a1080 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800d950 tx=0x7fbe1800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:01.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.876+0000 7fbe1effd640 1 -- 172.21.15.7:0/922009988 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18017070 con 0x7fbe28103100 2024-09-21T06:01:01.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.876+0000 7fbe2fb20640 1 -- 172.21.15.7:0/922009988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe281a6d40 con 0x7fbe28103100 2024-09-21T06:01:01.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.876+0000 7fbe1effd640 1 -- 172.21.15.7:0/922009988 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe18009c30 con 0x7fbe28103100 2024-09-21T06:01:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.876+0000 7fbe1effd640 1 -- 172.21.15.7:0/922009988 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe180047a0 con 0x7fbe28103100 2024-09-21T06:01:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.876+0000 7fbe2fb20640 1 -- 172.21.15.7:0/922009988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe281ad4a0 con 0x7fbe28103100 2024-09-21T06:01:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.879+0000 7fbe36094740 1 Processor -- start 2024-09-21T06:01:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.879+0000 7fbe36094740 1 -- start start 2024-09-21T06:01:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.879+0000 7fbe1effd640 1 -- 172.21.15.7:0/922009988 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fbe18004020 con 0x7fbe28103100 2024-09-21T06:01:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe36094740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc43b350 0x560fcc7e2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe36094740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 0x560fcc7e2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe36094740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc41a670 0x560fcc7e2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe36094740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560fcc758e60 con 0x560fcc412490 2024-09-21T06:01:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe36094740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560fcc748290 con 0x560fcc43b350 2024-09-21T06:01:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe36094740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560fcc74c0a0 con 0x560fcc41a670 2024-09-21T06:01:01.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe2d8bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 0x560fcc7e2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe2d8bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 0x560fcc7e2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40270/0 (socket says 172.21.15.7:40270) 2024-09-21T06:01:01.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe2d8bc640 1 -- 172.21.15.7:0/2569817662 learned_addr learned my addr 172.21.15.7:0/2569817662 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:01.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/2569817662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc43b350 0x560fcc7e2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe2d0bb640 1 --2- 172.21.15.7:0/2569817662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc41a670 0x560fcc7e2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe2d8bc640 1 -- 172.21.15.7:0/2569817662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc41a670 msgr2=0x560fcc7e2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:01.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe2d8bc640 1 --2- 172.21.15.7:0/2569817662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc41a670 0x560fcc7e2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe2d8bc640 1 -- 172.21.15.7:0/2569817662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc43b350 msgr2=0x560fcc7e2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:01.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe2d8bc640 1 --2- 172.21.15.7:0/2569817662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc43b350 0x560fcc7e2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe2d8bc640 1 -- 172.21.15.7:0/2569817662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fcc4a6930 con 0x560fcc412490 2024-09-21T06:01:01.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/2569817662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc43b350 0x560fcc7e2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:01.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe2d8bc640 1 --2- 172.21.15.7:0/2569817662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 0x560fcc7e2970 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400b7d0 tx=0x7fbe24004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7e9fc5725efebe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:01.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.880+0000 7fbe1effd640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbe140b6680 0x7fbe140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.881+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbe140b6680 0x7fbe140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.881+0000 7fbe13fff640 1 -- 172.21.15.7:0/2569817662 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe24003dd0 con 0x560fcc412490 2024-09-21T06:01:01.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.881+0000 7fbe13fff640 1 -- 172.21.15.7:0/2569817662 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe24015070 con 0x560fcc412490 2024-09-21T06:01:01.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.881+0000 7fbe13fff640 1 -- 172.21.15.7:0/2569817662 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe24011730 con 0x560fcc412490 2024-09-21T06:01:01.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.881+0000 7fbe1effd640 1 -- 172.21.15.7:0/922009988 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fbe180e72f0 con 0x7fbe28103100 2024-09-21T06:01:01.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.882+0000 7fbe36094740 1 -- 172.21.15.7:0/2569817662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 msgr2=0x560fcc7e2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:01.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.882+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbe140b6680 0x7fbe140b8b90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbe20004af0 tx=0x7fbe20005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:01.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.882+0000 7fbe36094740 1 --2- 172.21.15.7:0/2569817662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 0x560fcc7e2970 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400b7d0 tx=0x7fbe24004610 comp rx=0 tx=0).stop 2024-09-21T06:01:01.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.882+0000 7fbe36094740 1 -- 172.21.15.7:0/2569817662 shutdown_connections 2024-09-21T06:01:01.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.882+0000 7fbe36094740 1 --2- 172.21.15.7:0/2569817662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 0x560fcc7e2970 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.882+0000 7fbe36094740 1 --2- 172.21.15.7:0/2569817662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc41a670 0x560fcc7e2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.882+0000 7fbe36094740 1 --2- 172.21.15.7:0/2569817662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc43b350 0x560fcc7e2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.882+0000 7fbe36094740 1 -- 172.21.15.7:0/2569817662 >> 172.21.15.7:0/2569817662 conn(0x560fcc42f740 msgr2=0x560fcc7e0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:01.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.882+0000 7fbe36094740 1 -- 172.21.15.7:0/2569817662 shutdown_connections 2024-09-21T06:01:01.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.882+0000 7fbe36094740 1 -- 172.21.15.7:0/2569817662 wait complete. 2024-09-21T06:01:01.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.882+0000 7fbe36094740 1 -- start start 2024-09-21T06:01:01.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.882+0000 7fbe36094740 1 Processor -- start 2024-09-21T06:01:01.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe36094740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 0x560fcc7ee080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe36094740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc41a670 0x560fcc7ee600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe36094740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc43b350 0x560fcc7f9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe36094740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560fcc5a9890 con 0x560fcc412490 2024-09-21T06:01:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe36094740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560fcc6e2d40 con 0x560fcc41a670 2024-09-21T06:01:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe36094740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560fcc7f0c10 con 0x560fcc43b350 2024-09-21T06:01:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe36094740 10 client.0 _ll_register_callbacks cb 0x560fcc746c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe2d8bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 0x560fcc7ee080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe2d8bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 0x560fcc7ee080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40274/0 (socket says 172.21.15.7:40274) 2024-09-21T06:01:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe2d8bc640 1 -- 172.21.15.7:0/833893335 learned_addr learned my addr 172.21.15.7:0/833893335 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc43b350 0x560fcc7f9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe2d0bb640 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc41a670 0x560fcc7ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe2d8bc640 1 -- 172.21.15.7:0/833893335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc43b350 msgr2=0x560fcc7f9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe2d8bc640 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc43b350 0x560fcc7f9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe2d8bc640 1 -- 172.21.15.7:0/833893335 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc41a670 msgr2=0x560fcc7ee600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe2d8bc640 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc41a670 0x560fcc7ee600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe2d8bc640 1 -- 172.21.15.7:0/833893335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fcc7fa540 con 0x560fcc412490 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.883+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc43b350 0x560fcc7f9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.884+0000 7fbe2d8bc640 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 0x560fcc7ee080 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fbe2401aed0 tx=0x7fbe24003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db469d8485176bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.884+0000 7fbe117fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.884+0000 7fbe117fa640 1 -- 172.21.15.7:0/833893335 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe24027020 con 0x560fcc412490 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.884+0000 7fbe117fa640 1 -- 172.21.15.7:0/833893335 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fbe2401a880 con 0x560fcc412490 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.884+0000 7fbe36094740 1 -- 172.21.15.7:0/833893335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe24015070 con 0x560fcc412490 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.884+0000 7fbe117fa640 1 -- 172.21.15.7:0/833893335 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbe24032050 con 0x560fcc412490 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.884+0000 7fbe36094740 10 client.17517 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.884+0000 7fbe36094740 1 -- 172.21.15.7:0/833893335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560fcc7fce70 con 0x560fcc412490 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.884+0000 7fbe117fa640 1 -- 172.21.15.7:0/833893335 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe24015070 con 0x560fcc412490 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.884+0000 7fbe117fa640 1 -- 172.21.15.7:0/833893335 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbe24011cc0 con 0x560fcc412490 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.884+0000 7fbe36094740 10 client.17517 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.884+0000 7fbe36094740 10 client.17517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:01.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.884+0000 7fbe36094740 20 client.17517 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.885+0000 7fbe36094740 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560fcc3f9cd0 0x560fcc800280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.885+0000 7fbe36094740 4 client.17517 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.885+0000 7fbe36094740 1 -- 172.21.15.7:0/833893335 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fcc75adb0 con 0x560fcc3f9cd0 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.885+0000 7fbe2d0bb640 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560fcc3f9cd0 0x560fcc800280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.885+0000 7fbe2d0bb640 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560fcc3f9cd0 0x560fcc800280 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=480a02d6f25a27a4 server_cookie=817f43580e41cfd0 in_seq=0 out_seq=0 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.885+0000 7fbe117fa640 10 client.17517 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe117fa640 1 -- 172.21.15.7:0/833893335 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560fcc75adb0 con 0x560fcc3f9cd0 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe117fa640 10 client.17517 handle_command_reply: tid=0 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe36094740 1 client.17517 shutdown 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe36094740 1 -- 172.21.15.7:0/833893335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 msgr2=0x560fcc7ee080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe36094740 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 0x560fcc7ee080 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fbe2401aed0 tx=0x7fbe24003e00 comp rx=0 tx=0).stop 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe36094740 1 -- 172.21.15.7:0/833893335 shutdown_connections 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe36094740 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560fcc3f9cd0 0x560fcc800280 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe36094740 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc43b350 0x560fcc7f9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe36094740 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc41a670 0x560fcc7ee600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe117fa640 0 client.17517 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe36094740 1 --2- 172.21.15.7:0/833893335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc412490 0x560fcc7ee080 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe36094740 1 -- 172.21.15.7:0/833893335 >> 172.21.15.7:0/833893335 conn(0x560fcc42f740 msgr2=0x560fcc7e55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe36094740 1 -- 172.21.15.7:0/833893335 shutdown_connections 2024-09-21T06:01:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe36094740 1 -- 172.21.15.7:0/833893335 wait complete. 2024-09-21T06:01:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.886+0000 7fbe36094740 20 client.17517 trim_cache size 0 max 16384 2024-09-21T06:01:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.904+0000 7fbe36094740 1 Processor -- start 2024-09-21T06:01:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.904+0000 7fbe36094740 1 -- start start 2024-09-21T06:01:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.904+0000 7fbe36094740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc412490 0x560fcc7f9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.904+0000 7fbe36094740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc41a670 0x560fcc7e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.904+0000 7fbe36094740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 0x560fcc7e7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.904+0000 7fbe36094740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281b85d0 con 0x560fcc43b350 2024-09-21T06:01:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.904+0000 7fbe36094740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281b5ea0 con 0x560fcc41a670 2024-09-21T06:01:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.904+0000 7fbe36094740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281b3d10 con 0x560fcc412490 2024-09-21T06:01:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe2e0bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 0x560fcc7e7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe2e0bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 0x560fcc7e7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40288/0 (socket says 172.21.15.7:40288) 2024-09-21T06:01:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe2e0bd640 1 -- 172.21.15.7:0/1674454261 learned_addr learned my addr 172.21.15.7:0/1674454261 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe2d0bb640 1 --2- 172.21.15.7:0/1674454261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc41a670 0x560fcc7e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe2d8bc640 1 --2- 172.21.15.7:0/1674454261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc412490 0x560fcc7f9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe2e0bd640 1 -- 172.21.15.7:0/1674454261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc412490 msgr2=0x560fcc7f9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/1674454261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc412490 0x560fcc7f9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe2e0bd640 1 -- 172.21.15.7:0/1674454261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc41a670 msgr2=0x560fcc7e5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/1674454261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc41a670 0x560fcc7e5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe2e0bd640 1 -- 172.21.15.7:0/1674454261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fcc7e0860 con 0x560fcc43b350 2024-09-21T06:01:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/1674454261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 0x560fcc7e7690 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fbe20035000 tx=0x7fbe20040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d2c73112df798e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe137fe640 1 -- 172.21.15.7:0/1674454261 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20031c30 con 0x560fcc43b350 2024-09-21T06:01:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe137fe640 1 -- 172.21.15.7:0/1674454261 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe20036040 con 0x560fcc43b350 2024-09-21T06:01:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.905+0000 7fbe137fe640 1 -- 172.21.15.7:0/1674454261 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20030740 con 0x560fcc43b350 2024-09-21T06:01:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.906+0000 7fbe36094740 1 -- 172.21.15.7:0/1674454261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 msgr2=0x560fcc7e7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.906+0000 7fbe36094740 1 --2- 172.21.15.7:0/1674454261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 0x560fcc7e7690 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fbe20035000 tx=0x7fbe20040000 comp rx=0 tx=0).stop 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.906+0000 7fbe36094740 1 -- 172.21.15.7:0/1674454261 shutdown_connections 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.906+0000 7fbe36094740 1 --2- 172.21.15.7:0/1674454261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 0x560fcc7e7690 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.906+0000 7fbe36094740 1 --2- 172.21.15.7:0/1674454261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc41a670 0x560fcc7e5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.906+0000 7fbe36094740 1 --2- 172.21.15.7:0/1674454261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc412490 0x560fcc7f9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.906+0000 7fbe36094740 1 -- 172.21.15.7:0/1674454261 >> 172.21.15.7:0/1674454261 conn(0x560fcc42f740 msgr2=0x560fcc7e3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.906+0000 7fbe36094740 1 -- 172.21.15.7:0/1674454261 shutdown_connections 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.906+0000 7fbe36094740 1 -- 172.21.15.7:0/1674454261 wait complete. 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.906+0000 7fbe36094740 1 -- start start 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe36094740 1 Processor -- start 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe36094740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc412490 0x560fcc801490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe36094740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc41a670 0x560fcc8019d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe36094740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 0x560fcc801f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe36094740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281b4360 con 0x560fcc43b350 2024-09-21T06:01:01.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe36094740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281b57d0 con 0x560fcc412490 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe36094740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281b4a30 con 0x560fcc41a670 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe36094740 10 client.0 _ll_register_callbacks cb 0x7fbe20009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe2e0bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 0x560fcc801f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe2e0bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 0x560fcc801f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40298/0 (socket says 172.21.15.7:40298) 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe2e0bd640 1 -- 172.21.15.7:0/1252634439 learned_addr learned my addr 172.21.15.7:0/1252634439 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe2d0bb640 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc41a670 0x560fcc8019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe2d8bc640 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc412490 0x560fcc801490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe2e0bd640 1 -- 172.21.15.7:0/1252634439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc41a670 msgr2=0x560fcc8019d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc41a670 0x560fcc8019d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe2e0bd640 1 -- 172.21.15.7:0/1252634439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc412490 msgr2=0x560fcc801490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc412490 0x560fcc801490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.907+0000 7fbe2e0bd640 1 -- 172.21.15.7:0/1252634439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fcc869bb0 con 0x560fcc43b350 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.908+0000 7fbe2d8bc640 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc412490 0x560fcc801490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.908+0000 7fbe2e0bd640 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 0x560fcc801f10 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fbe20042040 tx=0x7fbe20004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24a8804cd28f695 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.908+0000 7fbe117fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.908+0000 7fbe117fa640 1 -- 172.21.15.7:0/1252634439 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe200044d0 con 0x560fcc43b350 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.908+0000 7fbe36094740 1 -- 172.21.15.7:0/1252634439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe20036040 con 0x560fcc43b350 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.908+0000 7fbe117fa640 1 -- 172.21.15.7:0/1252634439 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fbe20056040 con 0x560fcc43b350 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.908+0000 7fbe117fa640 1 -- 172.21.15.7:0/1252634439 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbe20030680 con 0x560fcc43b350 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.908+0000 7fbe36094740 10 client.17523 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.908+0000 7fbe36094740 1 -- 172.21.15.7:0/1252634439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560fcc86ae50 con 0x560fcc43b350 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.908+0000 7fbe117fa640 1 -- 172.21.15.7:0/1252634439 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe20036040 con 0x560fcc43b350 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.909+0000 7fbe117fa640 1 -- 172.21.15.7:0/1252634439 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbe20030070 con 0x560fcc43b350 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.909+0000 7fbe36094740 10 client.17523 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.909+0000 7fbe36094740 10 client.17523 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.909+0000 7fbe36094740 20 client.17523 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.909+0000 7fbe36094740 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560fcc3cf080 0x560fcc86d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.909+0000 7fbe36094740 4 client.17523 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:01:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.909+0000 7fbe36094740 1 -- 172.21.15.7:0/1252634439 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560fcc756860 con 0x560fcc3cf080 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.909+0000 7fbe2d8bc640 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560fcc3cf080 0x560fcc86d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.909+0000 7fbe117fa640 10 client.17523 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.909+0000 7fbe2d8bc640 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560fcc3cf080 0x560fcc86d610 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b35f6bbbadc4661 server_cookie=5e6357e29eb1f809 in_seq=0 out_seq=0 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe117fa640 1 -- 172.21.15.7:0/1252634439 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560fcc756860 con 0x560fcc3cf080 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe117fa640 10 client.17523 handle_command_reply: tid=0 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe36094740 1 client.17523 shutdown 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe36094740 1 -- 172.21.15.7:0/1252634439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 msgr2=0x560fcc801f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe36094740 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 0x560fcc801f10 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fbe20042040 tx=0x7fbe20004360 comp rx=0 tx=0).stop 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe36094740 1 -- 172.21.15.7:0/1252634439 shutdown_connections 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe36094740 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560fcc3cf080 0x560fcc86d610 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe36094740 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560fcc43b350 0x560fcc801f10 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe117fa640 0 client.17523 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe36094740 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560fcc41a670 0x560fcc8019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe36094740 1 --2- 172.21.15.7:0/1252634439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560fcc412490 0x560fcc801490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe36094740 1 -- 172.21.15.7:0/1252634439 >> 172.21.15.7:0/1252634439 conn(0x560fcc42f740 msgr2=0x560fcc7e3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:01.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe36094740 1 -- 172.21.15.7:0/1252634439 shutdown_connections 2024-09-21T06:01:01.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe36094740 1 -- 172.21.15.7:0/1252634439 wait complete. 2024-09-21T06:01:01.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.911+0000 7fbe36094740 20 client.17523 trim_cache size 0 max 16384 2024-09-21T06:01:01.931 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:01:01.931 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:01:01.931 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "ecf3518d-a174-4cee-89a1-6aa26e1b3442", 2024-09-21T06:01:01.931 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:01:01.931 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:01:01.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.912+0000 7fbe2fb20640 1 -- 172.21.15.7:0/922009988 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbe140b6680 msgr2=0x7fbe140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:01.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.912+0000 7fbe2fb20640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbe140b6680 0x7fbe140b8b90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbe20004af0 tx=0x7fbe20005c30 comp rx=0 tx=0).stop 2024-09-21T06:01:01.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.912+0000 7fbe2fb20640 1 -- 172.21.15.7:0/922009988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe28103100 msgr2=0x7fbe281a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:01.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.912+0000 7fbe2fb20640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe28103100 0x7fbe281a1080 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800d950 tx=0x7fbe1800de10 comp rx=0 tx=0).stop 2024-09-21T06:01:01.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.912+0000 7fbe2fb20640 1 -- 172.21.15.7:0/922009988 shutdown_connections 2024-09-21T06:01:01.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.912+0000 7fbe2fb20640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbe140b6680 0x7fbe140b8b90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.912+0000 7fbe2fb20640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe28103100 0x7fbe281a1080 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.912+0000 7fbe2fb20640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe28107bf0 0x7fbe281a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.912+0000 7fbe2fb20640 1 --2- 172.21.15.7:0/922009988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe281027b0 0x7fbe281a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:01.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.912+0000 7fbe2fb20640 1 -- 172.21.15.7:0/922009988 >> 172.21.15.7:0/922009988 conn(0x7fbe28079730 msgr2=0x7fbe28105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:01.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.912+0000 7fbe2fb20640 1 -- 172.21.15.7:0/922009988 shutdown_connections 2024-09-21T06:01:01.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:01.912+0000 7fbe2fb20640 1 -- 172.21.15.7:0/922009988 wait complete. 2024-09-21T06:01:02.493 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:02 smithi007 ceph-mon[30983]: pgmap v534: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:01:02.493 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:02 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-21T06:01:02.493 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:02 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi119 to 176.0M 2024-09-21T06:01:02.495 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:02 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi027 to 176.0M 2024-09-21T06:01:02.495 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:02 smithi007 ceph-mon[30983]: Unable to set osd_memory_target on smithi007 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-21T06:01:02.496 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:02 smithi007 ceph-mon[30983]: Unable to set osd_memory_target on smithi119 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:01:02.496 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:02 smithi007 ceph-mon[30983]: Unable to set osd_memory_target on smithi027 to 184567398: error parsing value: Value '184567398' is below minimum 939524096 2024-09-21T06:01:02.497 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:02 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:01:02.498 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:02 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:02.500 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:02 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:01:02.500 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:02 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:02.500 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:02 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:01:02.521 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:01:02.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:02 smithi027 ceph-mon[34364]: pgmap v534: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:01:02.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:02 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-21T06:01:02.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:02 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi119 to 176.0M 2024-09-21T06:01:02.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:02 smithi027 ceph-mon[34364]: Adjusting osd_memory_target on smithi027 to 176.0M 2024-09-21T06:01:02.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:02 smithi027 ceph-mon[34364]: Unable to set osd_memory_target on smithi007 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-21T06:01:02.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:02 smithi027 ceph-mon[34364]: Unable to set osd_memory_target on smithi119 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:01:02.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:02 smithi027 ceph-mon[34364]: Unable to set osd_memory_target on smithi027 to 184567398: error parsing value: Value '184567398' is below minimum 939524096 2024-09-21T06:01:02.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:02 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:01:02.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:02 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:02.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:02 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:01:02.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:02 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:02.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:02 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:01:02.784 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:02.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:02 smithi119 ceph-mon[34833]: pgmap v534: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:01:02.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:02 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-21T06:01:02.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:02 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi119 to 176.0M 2024-09-21T06:01:02.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:02 smithi119 ceph-mon[34833]: Adjusting osd_memory_target on smithi027 to 176.0M 2024-09-21T06:01:02.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:02 smithi119 ceph-mon[34833]: Unable to set osd_memory_target on smithi007 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-21T06:01:02.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:02 smithi119 ceph-mon[34833]: Unable to set osd_memory_target on smithi119 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:01:02.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:02 smithi119 ceph-mon[34833]: Unable to set osd_memory_target on smithi027 to 184567398: error parsing value: Value '184567398' is below minimum 939524096 2024-09-21T06:01:02.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:02 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:01:02.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:02 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:02.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:02 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:01:02.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:02 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:02.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:02 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:01:03.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.264+0000 7fa86d223640 1 -- 172.21.15.7:0/209266781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa86810fad0 msgr2=0x7fa86810fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:03.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.264+0000 7fa86d223640 1 --2- 172.21.15.7:0/209266781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa86810fad0 0x7fa86810fee0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009900 tx=0x7fa85c02a410 comp rx=0 tx=0).stop 2024-09-21T06:01:03.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.264+0000 7fa86d223640 1 -- 172.21.15.7:0/209266781 shutdown_connections 2024-09-21T06:01:03.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.264+0000 7fa86d223640 1 --2- 172.21.15.7:0/209266781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa86810fad0 0x7fa86810fee0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.264+0000 7fa86d223640 1 --2- 172.21.15.7:0/209266781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa868110420 0x7fa868116c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.264+0000 7fa86d223640 1 --2- 172.21.15.7:0/209266781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa86810a190 0x7fa86810a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.264+0000 7fa86d223640 1 -- 172.21.15.7:0/209266781 >> 172.21.15.7:0/209266781 conn(0x7fa8680780f0 msgr2=0x7fa8681081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:03.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.264+0000 7fa86d223640 1 -- 172.21.15.7:0/209266781 shutdown_connections 2024-09-21T06:01:03.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.264+0000 7fa86d223640 1 -- 172.21.15.7:0/209266781 wait complete. 2024-09-21T06:01:03.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.265+0000 7fa86d223640 1 Processor -- start 2024-09-21T06:01:03.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.265+0000 7fa86d223640 1 -- start start 2024-09-21T06:01:03.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.265+0000 7fa86d223640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa86810a190 0x7fa8681a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.265+0000 7fa86d223640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa86810fad0 0x7fa8681a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.265+0000 7fa86d223640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868110420 0x7fa8681a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.265+0000 7fa86d223640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa86811a0b0 con 0x7fa868110420 2024-09-21T06:01:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.265+0000 7fa86d223640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa868119f30 con 0x7fa86810a190 2024-09-21T06:01:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.265+0000 7fa86d223640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa86811a230 con 0x7fa86810fad0 2024-09-21T06:01:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.266+0000 7fa86759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868110420 0x7fa8681a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.266+0000 7fa866d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa86810a190 0x7fa8681a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.266+0000 7fa86759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868110420 0x7fa8681a62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40316/0 (socket says 172.21.15.7:40316) 2024-09-21T06:01:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.266+0000 7fa86759e640 1 -- 172.21.15.7:0/4136416951 learned_addr learned my addr 172.21.15.7:0/4136416951 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.266+0000 7fa86659c640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa86810fad0 0x7fa8681a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.266+0000 7fa86759e640 1 -- 172.21.15.7:0/4136416951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa86810fad0 msgr2=0x7fa8681a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.266+0000 7fa86759e640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa86810fad0 0x7fa8681a1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.266+0000 7fa86759e640 1 -- 172.21.15.7:0/4136416951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa86810a190 msgr2=0x7fa8681a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.266+0000 7fa86759e640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa86810a190 0x7fa8681a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.266+0000 7fa86759e640 1 -- 172.21.15.7:0/4136416951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8681a6930 con 0x7fa868110420 2024-09-21T06:01:03.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.266+0000 7fa866d9d640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa86810a190 0x7fa8681a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:03.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.266+0000 7fa86759e640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868110420 0x7fa8681a62c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fa86000cad0 tx=0x7fa86000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:03.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.266+0000 7fa84ffff640 1 -- 172.21.15.7:0/4136416951 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86000ad60 con 0x7fa868110420 2024-09-21T06:01:03.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.267+0000 7fa84ffff640 1 -- 172.21.15.7:0/4136416951 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa860005020 con 0x7fa868110420 2024-09-21T06:01:03.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.267+0000 7fa86d223640 1 -- 172.21.15.7:0/4136416951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8681a6c20 con 0x7fa868110420 2024-09-21T06:01:03.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.267+0000 7fa84ffff640 1 -- 172.21.15.7:0/4136416951 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86000f6b0 con 0x7fa868110420 2024-09-21T06:01:03.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.267+0000 7fa86d223640 1 -- 172.21.15.7:0/4136416951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8681ad440 con 0x7fa868110420 2024-09-21T06:01:03.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.269+0000 7fa873797740 1 Processor -- start 2024-09-21T06:01:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.269+0000 7fa84ffff640 1 -- 172.21.15.7:0/4136416951 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa86000f850 con 0x7fa868110420 2024-09-21T06:01:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.269+0000 7fa873797740 1 -- start start 2024-09-21T06:01:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa873797740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 0x55abee04f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa873797740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee04fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa873797740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee0500d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa873797740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55abedfc5e50 con 0x55abedc87390 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa873797740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55abedfb5280 con 0x55abedca8070 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa873797740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55abedfb9090 con 0x55abedc7f1b0 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa86659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee0500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa86659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee0500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40326/0 (socket says 172.21.15.7:40326) 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa86659c640 1 -- 172.21.15.7:0/2705196514 learned_addr learned my addr 172.21.15.7:0/2705196514 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa866d9d640 1 --2- 172.21.15.7:0/2705196514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee04fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa86659c640 1 --2- 172.21.15.7:0/2705196514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 0x55abee04f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa86659c640 1 -- 172.21.15.7:0/2705196514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 msgr2=0x55abee04fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa86659c640 1 --2- 172.21.15.7:0/2705196514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee04fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa86659c640 1 -- 172.21.15.7:0/2705196514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 msgr2=0x55abee04f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa86659c640 1 --2- 172.21.15.7:0/2705196514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 0x55abee04f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa86659c640 1 -- 172.21.15.7:0/2705196514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abedd13650 con 0x55abedc87390 2024-09-21T06:01:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.270+0000 7fa84ffff640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa8500b66b0 0x7fa8500b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.271+0000 7fa866d9d640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa8500b66b0 0x7fa8500b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.271+0000 7fa86659c640 1 --2- 172.21.15.7:0/2705196514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee0500d0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009900 tx=0x7fa85c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f252d0bdecc55b9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.271+0000 7fa84ffff640 1 -- 172.21.15.7:0/4136416951 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fa8600e7600 con 0x7fa868110420 2024-09-21T06:01:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.271+0000 7fa84d7fa640 1 -- 172.21.15.7:0/2705196514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c035070 con 0x55abedc87390 2024-09-21T06:01:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.271+0000 7fa84d7fa640 1 -- 172.21.15.7:0/2705196514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa85c0316f0 con 0x55abedc87390 2024-09-21T06:01:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.271+0000 7fa84d7fa640 1 -- 172.21.15.7:0/2705196514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0047a0 con 0x55abedc87390 2024-09-21T06:01:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.272+0000 7fa873797740 1 -- 172.21.15.7:0/2705196514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 msgr2=0x55abee0500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.272+0000 7fa866d9d640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa8500b66b0 0x7fa8500b8bc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55abee04e2d0 tx=0x7fa85800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.272+0000 7fa873797740 1 --2- 172.21.15.7:0/2705196514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee0500d0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009900 tx=0x7fa85c000bc0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.272+0000 7fa873797740 1 -- 172.21.15.7:0/2705196514 shutdown_connections 2024-09-21T06:01:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.272+0000 7fa873797740 1 --2- 172.21.15.7:0/2705196514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee0500d0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.272+0000 7fa873797740 1 --2- 172.21.15.7:0/2705196514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee04fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.272+0000 7fa873797740 1 --2- 172.21.15.7:0/2705196514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 0x55abee04f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.272+0000 7fa873797740 1 -- 172.21.15.7:0/2705196514 >> 172.21.15.7:0/2705196514 conn(0x55abedc9c460 msgr2=0x55abee04d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.272+0000 7fa873797740 1 -- 172.21.15.7:0/2705196514 shutdown_connections 2024-09-21T06:01:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.272+0000 7fa873797740 1 -- 172.21.15.7:0/2705196514 wait complete. 2024-09-21T06:01:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.272+0000 7fa873797740 1 -- start start 2024-09-21T06:01:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.272+0000 7fa873797740 1 Processor -- start 2024-09-21T06:01:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa873797740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee05acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa873797740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee05b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa873797740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 0x55abee0670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa873797740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55abede16700 con 0x55abedc87390 2024-09-21T06:01:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa873797740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55abedf50110 con 0x55abedca8070 2024-09-21T06:01:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa873797740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55abee05ddd0 con 0x55abedc7f1b0 2024-09-21T06:01:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa873797740 10 client.0 _ll_register_callbacks cb 0x55abedf69990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa86659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee05b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa86659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee05b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40342/0 (socket says 172.21.15.7:40342) 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa86659c640 1 -- 172.21.15.7:0/921919016 learned_addr learned my addr 172.21.15.7:0/921919016 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa866d9d640 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee05acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa86759e640 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 0x55abee0670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa86659c640 1 -- 172.21.15.7:0/921919016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 msgr2=0x55abee05acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa86659c640 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee05acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa86659c640 1 -- 172.21.15.7:0/921919016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 msgr2=0x55abee0670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa86659c640 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 0x55abee0670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa86659c640 1 -- 172.21.15.7:0/921919016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abedf7dc40 con 0x55abedc87390 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa86759e640 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 0x55abee0670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.273+0000 7fa866d9d640 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee05acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa86659c640 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee05b200 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fa85c001eb0 tx=0x7fa85c0052b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae69591f5311a1b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa84aff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:03.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa84aff5640 1 -- 172.21.15.7:0/921919016 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c04d070 con 0x55abedc87390 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa84aff5640 1 -- 172.21.15.7:0/921919016 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fa85c004240 con 0x55abedc87390 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa873797740 1 -- 172.21.15.7:0/921919016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa85c0316f0 con 0x55abedc87390 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa84aff5640 1 -- 172.21.15.7:0/921919016 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa85c035040 con 0x55abedc87390 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa873797740 10 client.17535 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa873797740 1 -- 172.21.15.7:0/921919016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55abee069ad0 con 0x55abedc87390 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa84aff5640 1 -- 172.21.15.7:0/921919016 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa85c0316f0 con 0x55abedc87390 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa84aff5640 1 -- 172.21.15.7:0/921919016 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa85c0035f0 con 0x55abedc87390 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa873797740 10 client.17535 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa873797740 10 client.17535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa873797740 20 client.17535 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.274+0000 7fa873797740 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55abedc669f0 0x55abee06ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.275+0000 7fa873797740 4 client.17535 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.275+0000 7fa873797740 1 -- 172.21.15.7:0/921919016 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abedfc7da0 con 0x55abedc669f0 2024-09-21T06:01:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.275+0000 7fa866d9d640 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55abedc669f0 0x55abee06ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.275+0000 7fa866d9d640 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55abedc669f0 0x55abee06ce30 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f20015517ef2a86d server_cookie=4b65c552df65d6ee in_seq=0 out_seq=0 2024-09-21T06:01:03.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.275+0000 7fa84aff5640 10 client.17535 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:03.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.276+0000 7fa84aff5640 1 -- 172.21.15.7:0/921919016 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55abedfc7da0 con 0x55abedc669f0 2024-09-21T06:01:03.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.276+0000 7fa84aff5640 10 client.17535 handle_command_reply: tid=0 2024-09-21T06:01:03.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.276+0000 7fa873797740 1 client.17535 shutdown 2024-09-21T06:01:03.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.276+0000 7fa873797740 1 -- 172.21.15.7:0/921919016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 msgr2=0x55abee05b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:03.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.276+0000 7fa873797740 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee05b200 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fa85c001eb0 tx=0x7fa85c0052b0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.277+0000 7fa873797740 1 -- 172.21.15.7:0/921919016 shutdown_connections 2024-09-21T06:01:03.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.277+0000 7fa873797740 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55abedc669f0 0x55abee06ce30 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.277+0000 7fa873797740 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee05b200 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.277+0000 7fa873797740 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 0x55abee0670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.277+0000 7fa873797740 1 --2- 172.21.15.7:0/921919016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee05acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.277+0000 7fa873797740 1 -- 172.21.15.7:0/921919016 >> 172.21.15.7:0/921919016 conn(0x55abedc9c460 msgr2=0x55abee0527e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:03.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.277+0000 7fa84aff5640 0 client.17535 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:03.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.277+0000 7fa873797740 1 -- 172.21.15.7:0/921919016 shutdown_connections 2024-09-21T06:01:03.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.277+0000 7fa873797740 1 -- 172.21.15.7:0/921919016 wait complete. 2024-09-21T06:01:03.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.277+0000 7fa873797740 20 client.17535 trim_cache size 0 max 16384 2024-09-21T06:01:03.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.294+0000 7fa873797740 1 Processor -- start 2024-09-21T06:01:03.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.294+0000 7fa873797740 1 -- start start 2024-09-21T06:01:03.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa873797740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee05b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa873797740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee067060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa873797740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 0x55abee057eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa873797740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681b8410 con 0x55abedc87390 2024-09-21T06:01:03.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa873797740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681b5ce0 con 0x55abedca8070 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa873797740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681b3b50 con 0x55abedc7f1b0 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa86659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa86659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee067060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40352/0 (socket says 172.21.15.7:40352) 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa86659c640 1 -- 172.21.15.7:0/787702738 learned_addr learned my addr 172.21.15.7:0/787702738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa86759e640 1 --2- 172.21.15.7:0/787702738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 0x55abee057eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa86659c640 1 -- 172.21.15.7:0/787702738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 msgr2=0x55abee05b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa866d9d640 1 --2- 172.21.15.7:0/787702738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee05b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa86659c640 1 --2- 172.21.15.7:0/787702738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee05b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa86659c640 1 -- 172.21.15.7:0/787702738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 msgr2=0x55abee057eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa86659c640 1 --2- 172.21.15.7:0/787702738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 0x55abee057eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa86659c640 1 -- 172.21.15.7:0/787702738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abee0591c0 con 0x55abedc87390 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa866d9d640 1 --2- 172.21.15.7:0/787702738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee05b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa86659c640 1 --2- 172.21.15.7:0/787702738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee067060 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0054a0 tx=0x7fa85c0050a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a88501bcc7880f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.295+0000 7fa84cff9640 1 -- 172.21.15.7:0/787702738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c04d070 con 0x55abedc87390 2024-09-21T06:01:03.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.296+0000 7fa84cff9640 1 -- 172.21.15.7:0/787702738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa85c032d70 con 0x55abedc87390 2024-09-21T06:01:03.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.296+0000 7fa84cff9640 1 -- 172.21.15.7:0/787702738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c003e90 con 0x55abedc87390 2024-09-21T06:01:03.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.296+0000 7fa873797740 1 -- 172.21.15.7:0/787702738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 msgr2=0x55abee067060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:03.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.296+0000 7fa873797740 1 --2- 172.21.15.7:0/787702738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee067060 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0054a0 tx=0x7fa85c0050a0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.296+0000 7fa873797740 1 -- 172.21.15.7:0/787702738 shutdown_connections 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.296+0000 7fa873797740 1 --2- 172.21.15.7:0/787702738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedc87390 0x55abee067060 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.296+0000 7fa873797740 1 --2- 172.21.15.7:0/787702738 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedca8070 0x55abee057eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.296+0000 7fa873797740 1 --2- 172.21.15.7:0/787702738 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc7f1b0 0x55abee05b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.296+0000 7fa873797740 1 -- 172.21.15.7:0/787702738 >> 172.21.15.7:0/787702738 conn(0x55abedc9c460 msgr2=0x55abee05aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.296+0000 7fa873797740 1 -- 172.21.15.7:0/787702738 shutdown_connections 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.296+0000 7fa873797740 1 -- 172.21.15.7:0/787702738 wait complete. 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa873797740 1 -- start start 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa873797740 1 Processor -- start 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa873797740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedc7f1b0 0x55abee06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa873797740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc87390 0x55abee06e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa873797740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedca8070 0x55abee06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa873797740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681b41a0 con 0x55abedca8070 2024-09-21T06:01:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa873797740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681b5610 con 0x55abedc7f1b0 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa873797740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681b4870 con 0x55abedc87390 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa873797740 10 client.0 _ll_register_callbacks cb 0x7fa85800a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa866d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedc7f1b0 0x55abee06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa86759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedca8070 0x55abee06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa866d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedc7f1b0 0x55abee06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:42816/0 (socket says 172.21.15.7:42816) 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa866d9d640 1 -- 172.21.15.7:0/2973823599 learned_addr learned my addr 172.21.15.7:0/2973823599 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.297+0000 7fa86659c640 1 --2- 172.21.15.7:0/2973823599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc87390 0x55abee06e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa866d9d640 1 -- 172.21.15.7:0/2973823599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc87390 msgr2=0x55abee06e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa866d9d640 1 --2- 172.21.15.7:0/2973823599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc87390 0x55abee06e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa866d9d640 1 -- 172.21.15.7:0/2973823599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedca8070 msgr2=0x55abee06ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa866d9d640 1 --2- 172.21.15.7:0/2973823599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedca8070 0x55abee06ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa866d9d640 1 -- 172.21.15.7:0/2973823599 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abee0d6760 con 0x55abedc7f1b0 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa86759e640 1 --2- 172.21.15.7:0/2973823599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedca8070 0x55abee06ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa866d9d640 1 --2- 172.21.15.7:0/2973823599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedc7f1b0 0x55abee06e000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa858011010 tx=0x7fa8580046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60de67074f0408a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa84aff5640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa84aff5640 1 -- 172.21.15.7:0/2973823599 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858005020 con 0x55abedc7f1b0 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa84aff5640 1 -- 172.21.15.7:0/2973823599 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fa8580051c0 con 0x55abedc7f1b0 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa873797740 1 -- 172.21.15.7:0/2973823599 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa85c032d70 con 0x55abedc7f1b0 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa84aff5640 1 -- 172.21.15.7:0/2973823599 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa8580053c0 con 0x55abedc7f1b0 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa873797740 10 client.26918 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.298+0000 7fa873797740 1 -- 172.21.15.7:0/2973823599 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55abee0d79f0 con 0x55abedc7f1b0 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.299+0000 7fa84aff5640 1 -- 172.21.15.7:0/2973823599 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa85c032d70 con 0x55abedc7f1b0 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.299+0000 7fa84aff5640 1 -- 172.21.15.7:0/2973823599 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa85801b980 con 0x55abedc7f1b0 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.299+0000 7fa873797740 10 client.26918 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.299+0000 7fa873797740 10 client.26918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.299+0000 7fa873797740 20 client.26918 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.299+0000 7fa873797740 1 --2- 172.21.15.7:0/2973823599 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55abedc3bda0 0x55abee0da1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:03.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.299+0000 7fa873797740 4 client.26918 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:01:03.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.299+0000 7fa873797740 1 -- 172.21.15.7:0/2973823599 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55abedfc3850 con 0x55abedc3bda0 2024-09-21T06:01:03.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.299+0000 7fa86659c640 1 --2- 172.21.15.7:0/2973823599 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55abedc3bda0 0x55abee0da1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:03.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa86659c640 1 --2- 172.21.15.7:0/2973823599 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55abedc3bda0 0x55abee0da1e0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4eaa6e51f3ed815 server_cookie=7294e65a50eca370 in_seq=0 out_seq=0 2024-09-21T06:01:03.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa84aff5640 10 client.26918 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa84aff5640 1 -- 172.21.15.7:0/2973823599 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x55abedfc3850 con 0x55abedc3bda0 2024-09-21T06:01:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa84aff5640 10 client.26918 handle_command_reply: tid=0 2024-09-21T06:01:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa873797740 1 client.26918 shutdown 2024-09-21T06:01:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa873797740 1 -- 172.21.15.7:0/2973823599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedc7f1b0 msgr2=0x55abee06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa873797740 1 --2- 172.21.15.7:0/2973823599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedc7f1b0 0x55abee06e000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa858011010 tx=0x7fa8580046c0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa873797740 1 -- 172.21.15.7:0/2973823599 shutdown_connections 2024-09-21T06:01:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa873797740 1 --2- 172.21.15.7:0/2973823599 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55abedc3bda0 0x55abee0da1e0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa873797740 1 --2- 172.21.15.7:0/2973823599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abedca8070 0x55abee06ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa873797740 1 --2- 172.21.15.7:0/2973823599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55abedc87390 0x55abee06e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa84aff5640 0 client.26918 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa873797740 1 --2- 172.21.15.7:0/2973823599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55abedc7f1b0 0x55abee06e000 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa873797740 1 -- 172.21.15.7:0/2973823599 >> 172.21.15.7:0/2973823599 conn(0x55abedc9c460 msgr2=0x55abee050610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:03.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa873797740 1 -- 172.21.15.7:0/2973823599 shutdown_connections 2024-09-21T06:01:03.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa873797740 1 -- 172.21.15.7:0/2973823599 wait complete. 2024-09-21T06:01:03.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.300+0000 7fa873797740 20 client.26918 trim_cache size 0 max 16384 2024-09-21T06:01:03.307 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:01:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:01:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:01:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:01:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "3bd778db-a0ed-42ad-8a79-14a200f0734e": { 2024-09-21T06:01:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:51.556015+0000", 2024-09-21T06:01:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:01:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "ecf3518d-a174-4cee-89a1-6aa26e1b3442": { 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:01.909762+0000", 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:01:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:01:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:01:03.318 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:01:03.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.301+0000 7fa86d223640 1 -- 172.21.15.7:0/4136416951 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa8500b66b0 msgr2=0x7fa8500b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:03.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.301+0000 7fa86d223640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa8500b66b0 0x7fa8500b8bc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55abee04e2d0 tx=0x7fa85800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.301+0000 7fa86d223640 1 -- 172.21.15.7:0/4136416951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868110420 msgr2=0x7fa8681a62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:03.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.301+0000 7fa86d223640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868110420 0x7fa8681a62c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fa86000cad0 tx=0x7fa86000ced0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.301+0000 7fa86d223640 1 -- 172.21.15.7:0/4136416951 shutdown_connections 2024-09-21T06:01:03.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.301+0000 7fa86d223640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa8500b66b0 0x7fa8500b8bc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.301+0000 7fa86d223640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868110420 0x7fa8681a62c0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.301+0000 7fa86d223640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa86810fad0 0x7fa8681a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.301+0000 7fa86d223640 1 --2- 172.21.15.7:0/4136416951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa86810a190 0x7fa8681a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:03.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.301+0000 7fa86d223640 1 -- 172.21.15.7:0/4136416951 >> 172.21.15.7:0/4136416951 conn(0x7fa8680780f0 msgr2=0x7fa86810ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:03.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.301+0000 7fa86d223640 1 -- 172.21.15.7:0/4136416951 shutdown_connections 2024-09-21T06:01:03.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:03.301+0000 7fa86d223640 1 -- 172.21.15.7:0/4136416951 wait complete. 2024-09-21T06:01:04.041 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:01:04.041 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:01:04.301 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:04.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:04 smithi007 ceph-mon[30983]: pgmap v535: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:01:04.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:04 smithi027 ceph-mon[34364]: pgmap v535: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:01:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.745+0000 7f028be4a640 1 -- 172.21.15.7:0/156371275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0284103b60 msgr2=0x7f0284103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.745+0000 7f028be4a640 1 --2- 172.21.15.7:0/156371275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0284103b60 0x7f0284103f70 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f0280009900 tx=0x7f028002a410 comp rx=0 tx=0).stop 2024-09-21T06:01:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.745+0000 7f028be4a640 1 -- 172.21.15.7:0/156371275 shutdown_connections 2024-09-21T06:01:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.745+0000 7f028be4a640 1 --2- 172.21.15.7:0/156371275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0284109df0 0x7f0284110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.745+0000 7f028be4a640 1 --2- 172.21.15.7:0/156371275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02841094a0 0x7f02841098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.745+0000 7f028be4a640 1 --2- 172.21.15.7:0/156371275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0284103b60 0x7f0284103f70 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.745+0000 7f028be4a640 1 -- 172.21.15.7:0/156371275 >> 172.21.15.7:0/156371275 conn(0x7f028407b850 msgr2=0x7f028407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.745+0000 7f028be4a640 1 -- 172.21.15.7:0/156371275 shutdown_connections 2024-09-21T06:01:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.745+0000 7f028be4a640 1 -- 172.21.15.7:0/156371275 wait complete. 2024-09-21T06:01:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.746+0000 7f028be4a640 1 Processor -- start 2024-09-21T06:01:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.746+0000 7f028be4a640 1 -- start start 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.746+0000 7f028be4a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0284103b60 0x7f028419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.746+0000 7f028be4a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02841094a0 0x7f028419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.746+0000 7f028be4a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0284109df0 0x7f028419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.746+0000 7f028be4a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0284113ab0 con 0x7f02841094a0 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.746+0000 7f028be4a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0284113930 con 0x7f0284103b60 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.746+0000 7f028be4a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0284113c30 con 0x7f0284109df0 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f02893e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02841094a0 0x7f028419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f0289be6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0284103b60 0x7f028419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f02893e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02841094a0 0x7f028419aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40386/0 (socket says 172.21.15.7:40386) 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f02893e5640 1 -- 172.21.15.7:0/251711932 learned_addr learned my addr 172.21.15.7:0/251711932 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f028a3e7640 1 --2- 172.21.15.7:0/251711932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0284109df0 0x7f028419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f02893e5640 1 -- 172.21.15.7:0/251711932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0284109df0 msgr2=0x7f028419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f02893e5640 1 --2- 172.21.15.7:0/251711932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0284109df0 0x7f028419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f02893e5640 1 -- 172.21.15.7:0/251711932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0284103b60 msgr2=0x7f028419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f02893e5640 1 --2- 172.21.15.7:0/251711932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0284103b60 0x7f028419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f02893e5640 1 -- 172.21.15.7:0/251711932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02841a03b0 con 0x7f02841094a0 2024-09-21T06:01:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f02893e5640 1 --2- 172.21.15.7:0/251711932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02841094a0 0x7f028419aaa0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f027400c8c0 tx=0x7f027400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f027affd640 1 -- 172.21.15.7:0/251711932 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0274007bb0 con 0x7f02841094a0 2024-09-21T06:01:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f027affd640 1 -- 172.21.15.7:0/251711932 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0274007d50 con 0x7f02841094a0 2024-09-21T06:01:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f027affd640 1 -- 172.21.15.7:0/251711932 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02740187c0 con 0x7f02841094a0 2024-09-21T06:01:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.747+0000 7f028be4a640 1 -- 172.21.15.7:0/251711932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02841a06a0 con 0x7f02841094a0 2024-09-21T06:01:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.748+0000 7f028be4a640 1 -- 172.21.15.7:0/251711932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02841a6ec0 con 0x7f02841094a0 2024-09-21T06:01:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.749+0000 7f028be4a640 1 -- 172.21.15.7:0/251711932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0284103f70 con 0x7f02841094a0 2024-09-21T06:01:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.750+0000 7f027affd640 1 -- 172.21.15.7:0/251711932 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f027400fa20 con 0x7f02841094a0 2024-09-21T06:01:04.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.751+0000 7f027affd640 1 --2- 172.21.15.7:0/251711932 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f02700b6730 0x7f02700b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:04.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.751+0000 7f0289be6640 1 --2- 172.21.15.7:0/251711932 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f02700b6730 0x7f02700b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:04.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.751+0000 7f027affd640 1 -- 172.21.15.7:0/251711932 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7f02740e7910 con 0x7f02841094a0 2024-09-21T06:01:04.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.752+0000 7f0289be6640 1 --2- 172.21.15.7:0/251711932 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f02700b6730 0x7f02700b8c40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0280031440 tx=0x7f0280009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:04.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.754+0000 7f027affd640 1 -- 172.21.15.7:0/251711932 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0274014030 con 0x7f02841094a0 2024-09-21T06:01:04.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:04 smithi119 ceph-mon[34833]: pgmap v535: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:01:04.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.979+0000 7f028be4a640 1 -- 172.21.15.7:0/251711932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f028410bc20 con 0x7f02841094a0 2024-09-21T06:01:04.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.980+0000 7f027affd640 1 -- 172.21.15.7:0/251711932 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f02740adf60 con 0x7f02841094a0 2024-09-21T06:01:04.982 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:01:04.982 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:01:04.982 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:01:04.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.982+0000 7f028be4a640 1 -- 172.21.15.7:0/251711932 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f02700b6730 msgr2=0x7f02700b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:04.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.982+0000 7f028be4a640 1 --2- 172.21.15.7:0/251711932 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f02700b6730 0x7f02700b8c40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0280031440 tx=0x7f0280009560 comp rx=0 tx=0).stop 2024-09-21T06:01:04.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.982+0000 7f028be4a640 1 -- 172.21.15.7:0/251711932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02841094a0 msgr2=0x7f028419aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.982+0000 7f028be4a640 1 --2- 172.21.15.7:0/251711932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02841094a0 0x7f028419aaa0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f027400c8c0 tx=0x7f027400cd80 comp rx=0 tx=0).stop 2024-09-21T06:01:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.982+0000 7f028be4a640 1 -- 172.21.15.7:0/251711932 shutdown_connections 2024-09-21T06:01:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.982+0000 7f028be4a640 1 --2- 172.21.15.7:0/251711932 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f02700b6730 0x7f02700b8c40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.982+0000 7f028be4a640 1 --2- 172.21.15.7:0/251711932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02841094a0 0x7f028419aaa0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.982+0000 7f028be4a640 1 --2- 172.21.15.7:0/251711932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0284109df0 0x7f028419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.982+0000 7f028be4a640 1 --2- 172.21.15.7:0/251711932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0284103b60 0x7f028419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.982+0000 7f028be4a640 1 -- 172.21.15.7:0/251711932 >> 172.21.15.7:0/251711932 conn(0x7f028407b850 msgr2=0x7f02841075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.982+0000 7f028be4a640 1 -- 172.21.15.7:0/251711932 shutdown_connections 2024-09-21T06:01:04.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:04.982+0000 7f028be4a640 1 -- 172.21.15.7:0/251711932 wait complete. 2024-09-21T06:01:05.551 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:05 smithi007 ceph-mon[30983]: pgmap v536: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T06:01:05.551 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:05 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/251711932' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:05.580 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:01:05.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:05 smithi027 ceph-mon[34364]: pgmap v536: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T06:01:05.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:05 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/251711932' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:05.837 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:05.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:05 smithi119 ceph-mon[34833]: pgmap v536: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T06:01:05.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:05 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/251711932' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:06.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.330+0000 7fd581809640 1 -- 172.21.15.7:0/2397312100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd57c102ae0 msgr2=0x7fd57c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:06.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.330+0000 7fd581809640 1 --2- 172.21.15.7:0/2397312100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd57c102ae0 0x7fd57c102ef0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd56c009900 tx=0x7fd56c02a410 comp rx=0 tx=0).stop 2024-09-21T06:01:06.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.330+0000 7fd581809640 1 -- 172.21.15.7:0/2397312100 shutdown_connections 2024-09-21T06:01:06.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.330+0000 7fd581809640 1 --2- 172.21.15.7:0/2397312100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c108d20 0x7fd57c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.330+0000 7fd581809640 1 --2- 172.21.15.7:0/2397312100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd57c1083d0 0x7fd57c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.330+0000 7fd581809640 1 --2- 172.21.15.7:0/2397312100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd57c102ae0 0x7fd57c102ef0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.330+0000 7fd581809640 1 -- 172.21.15.7:0/2397312100 >> 172.21.15.7:0/2397312100 conn(0x7fd57c079760 msgr2=0x7fd57c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:06.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.330+0000 7fd581809640 1 -- 172.21.15.7:0/2397312100 shutdown_connections 2024-09-21T06:01:06.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.330+0000 7fd581809640 1 -- 172.21.15.7:0/2397312100 wait complete. 2024-09-21T06:01:06.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.330+0000 7fd581809640 1 Processor -- start 2024-09-21T06:01:06.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd581809640 1 -- start start 2024-09-21T06:01:06.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd581809640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd57c102ae0 0x7fd57c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd581809640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c1083d0 0x7fd57c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd581809640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd57c108d20 0x7fd57c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd581809640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c113aa0 con 0x7fd57c108d20 2024-09-21T06:01:06.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd581809640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c113920 con 0x7fd57c102ae0 2024-09-21T06:01:06.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd581809640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c113c20 con 0x7fd57c1083d0 2024-09-21T06:01:06.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd57b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd57c108d20 0x7fd57c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd57b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd57c108d20 0x7fd57c19fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40406/0 (socket says 172.21.15.7:40406) 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd57b7fe640 1 -- 172.21.15.7:0/2456887091 learned_addr learned my addr 172.21.15.7:0/2456887091 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c1083d0 0x7fd57c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd57affd640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd57c102ae0 0x7fd57c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd57b7fe640 1 -- 172.21.15.7:0/2456887091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c1083d0 msgr2=0x7fd57c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd57b7fe640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c1083d0 0x7fd57c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd57b7fe640 1 -- 172.21.15.7:0/2456887091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd57c102ae0 msgr2=0x7fd57c19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd57b7fe640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd57c102ae0 0x7fd57c19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd57b7fe640 1 -- 172.21.15.7:0/2456887091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c1a0400 con 0x7fd57c108d20 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c1083d0 0x7fd57c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.331+0000 7fd57affd640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd57c102ae0 0x7fd57c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.332+0000 7fd57b7fe640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd57c108d20 0x7fd57c19fcd0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd57400cad0 tx=0x7fd57400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.332+0000 7fd580807640 1 -- 172.21.15.7:0/2456887091 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57400ae20 con 0x7fd57c108d20 2024-09-21T06:01:06.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.332+0000 7fd581809640 1 -- 172.21.15.7:0/2456887091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd57c1a06f0 con 0x7fd57c108d20 2024-09-21T06:01:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.332+0000 7fd580807640 1 -- 172.21.15.7:0/2456887091 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd574005020 con 0x7fd57c108d20 2024-09-21T06:01:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.332+0000 7fd580807640 1 -- 172.21.15.7:0/2456887091 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57400f6b0 con 0x7fd57c108d20 2024-09-21T06:01:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.332+0000 7fd581809640 1 -- 172.21.15.7:0/2456887091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd57c1a6e50 con 0x7fd57c108d20 2024-09-21T06:01:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.334+0000 7fd587d7d740 1 Processor -- start 2024-09-21T06:01:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.335+0000 7fd580807640 1 -- 172.21.15.7:0/2456887091 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd5740051d0 con 0x7fd57c108d20 2024-09-21T06:01:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.335+0000 7fd587d7d740 1 -- start start 2024-09-21T06:01:06.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.335+0000 7fd587d7d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 0x55f2dca256a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.335+0000 7fd587d7d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca25be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.335+0000 7fd587d7d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc65d390 0x55f2dca26120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.335+0000 7fd587d7d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f2dc99bea0 con 0x55f2dc67e070 2024-09-21T06:01:06.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.335+0000 7fd587d7d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f2dc98b2d0 con 0x55f2dc6551b0 2024-09-21T06:01:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.335+0000 7fd587d7d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f2dc98f0e0 con 0x55f2dc65d390 2024-09-21T06:01:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.335+0000 7fd57a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 0x55f2dca256a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.335+0000 7fd57a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 0x55f2dca256a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40410/0 (socket says 172.21.15.7:40410) 2024-09-21T06:01:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.335+0000 7fd57a7fc640 1 -- 172.21.15.7:0/3414852069 learned_addr learned my addr 172.21.15.7:0/3414852069 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.335+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/3414852069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc65d390 0x55f2dca26120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.335+0000 7fd57affd640 1 --2- 172.21.15.7:0/3414852069 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca25be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.336+0000 7fd57a7fc640 1 -- 172.21.15.7:0/3414852069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc65d390 msgr2=0x55f2dca26120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.336+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/3414852069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc65d390 0x55f2dca26120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.336+0000 7fd57a7fc640 1 -- 172.21.15.7:0/3414852069 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 msgr2=0x55f2dca25be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.336+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/3414852069 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca25be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.336+0000 7fd57a7fc640 1 -- 172.21.15.7:0/3414852069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2dc6e9650 con 0x55f2dc67e070 2024-09-21T06:01:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.336+0000 7fd57affd640 1 --2- 172.21.15.7:0/3414852069 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca25be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.336+0000 7fd580807640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd5640b6680 0x7fd5640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.336+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/3414852069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 0x55f2dca256a0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd5700135b0 tx=0x7fd57000b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc0c3f63201e61b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.336+0000 7fd57affd640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd5640b6680 0x7fd5640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.336+0000 7fd580807640 1 -- 172.21.15.7:0/2456887091 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fd5740e7710 con 0x7fd57c108d20 2024-09-21T06:01:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.336+0000 7fd561ffb640 1 -- 172.21.15.7:0/3414852069 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570019070 con 0x55f2dc67e070 2024-09-21T06:01:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.336+0000 7fd561ffb640 1 -- 172.21.15.7:0/3414852069 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5700054d0 con 0x55f2dc67e070 2024-09-21T06:01:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.336+0000 7fd561ffb640 1 -- 172.21.15.7:0/3414852069 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570004dd0 con 0x55f2dc67e070 2024-09-21T06:01:06.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.337+0000 7fd587d7d740 1 -- 172.21.15.7:0/3414852069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 msgr2=0x55f2dca256a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:06.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.337+0000 7fd57affd640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd5640b6680 0x7fd5640b8b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd56c031440 tx=0x7fd56c0058b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:06.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.337+0000 7fd587d7d740 1 --2- 172.21.15.7:0/3414852069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 0x55f2dca256a0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd5700135b0 tx=0x7fd57000b710 comp rx=0 tx=0).stop 2024-09-21T06:01:06.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.337+0000 7fd587d7d740 1 -- 172.21.15.7:0/3414852069 shutdown_connections 2024-09-21T06:01:06.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.337+0000 7fd587d7d740 1 --2- 172.21.15.7:0/3414852069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc65d390 0x55f2dca26120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.337+0000 7fd587d7d740 1 --2- 172.21.15.7:0/3414852069 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca25be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.337+0000 7fd587d7d740 1 --2- 172.21.15.7:0/3414852069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 0x55f2dca256a0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.337+0000 7fd587d7d740 1 -- 172.21.15.7:0/3414852069 >> 172.21.15.7:0/3414852069 conn(0x55f2dc672460 msgr2=0x55f2dca23590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:06.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.337+0000 7fd587d7d740 1 -- 172.21.15.7:0/3414852069 shutdown_connections 2024-09-21T06:01:06.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.337+0000 7fd587d7d740 1 -- 172.21.15.7:0/3414852069 wait complete. 2024-09-21T06:01:06.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.338+0000 7fd587d7d740 1 -- start start 2024-09-21T06:01:06.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.338+0000 7fd587d7d740 1 Processor -- start 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.338+0000 7fd587d7d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca350c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.338+0000 7fd587d7d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc65d390 0x55f2dca35600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.338+0000 7fd587d7d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 0x55f2dca35b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.338+0000 7fd587d7d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f2dc7ec700 con 0x55f2dc67e070 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.338+0000 7fd587d7d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f2dc926160 con 0x55f2dc6551b0 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.338+0000 7fd587d7d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f2dca38180 con 0x55f2dc65d390 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.338+0000 7fd587d7d740 10 client.0 _ll_register_callbacks cb 0x55f2dc93f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.338+0000 7fd57b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 0x55f2dca35b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.338+0000 7fd57b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 0x55f2dca35b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40420/0 (socket says 172.21.15.7:40420) 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.338+0000 7fd57b7fe640 1 -- 172.21.15.7:0/1097452206 learned_addr learned my addr 172.21.15.7:0/1097452206 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.338+0000 7fd57affd640 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca350c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc65d390 0x55f2dca35600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd57b7fe640 1 -- 172.21.15.7:0/1097452206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc65d390 msgr2=0x55f2dca35600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd57b7fe640 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc65d390 0x55f2dca35600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd57b7fe640 1 -- 172.21.15.7:0/1097452206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 msgr2=0x55f2dca350c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd57b7fe640 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca350c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd57b7fe640 1 -- 172.21.15.7:0/1097452206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2dc953c90 con 0x55f2dc67e070 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc65d390 0x55f2dca35600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd57b7fe640 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 0x55f2dca35b40 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd5740ad2b0 tx=0x7fd5740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff1bac9ee76c567 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd55affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd55affd640 1 -- 172.21.15.7:0/1097452206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57401d040 con 0x55f2dc67e070 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd55affd640 1 -- 172.21.15.7:0/1097452206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fd5740ac280 con 0x55f2dc67e070 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd587d7d740 1 -- 172.21.15.7:0/1097452206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5700054d0 con 0x55f2dc67e070 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd55affd640 1 -- 172.21.15.7:0/1097452206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd5740d4030 con 0x55f2dc67e070 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd587d7d740 10 client.17559 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.339+0000 7fd587d7d740 1 -- 172.21.15.7:0/1097452206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f2dca43df0 con 0x55f2dc67e070 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.340+0000 7fd55affd640 1 -- 172.21.15.7:0/1097452206 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5700054d0 con 0x55f2dc67e070 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.340+0000 7fd55affd640 1 -- 172.21.15.7:0/1097452206 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd574004a40 con 0x55f2dc67e070 2024-09-21T06:01:06.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.340+0000 7fd587d7d740 10 client.17559 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:06.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.340+0000 7fd587d7d740 10 client.17559 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:01:06.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.340+0000 7fd587d7d740 20 client.17559 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:06.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.340+0000 7fd587d7d740 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55f2dc63c9f0 0x55f2dca47290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.340+0000 7fd587d7d740 4 client.17559 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:06.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.340+0000 7fd587d7d740 1 -- 172.21.15.7:0/1097452206 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2dc99ddf0 con 0x55f2dc63c9f0 2024-09-21T06:01:06.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.340+0000 7fd57affd640 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55f2dc63c9f0 0x55f2dca47290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.341+0000 7fd55affd640 10 client.17559 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:01:06.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.341+0000 7fd57affd640 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55f2dc63c9f0 0x55f2dca47290 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e11230115dde50ea server_cookie=c70978a8617e3536 in_seq=0 out_seq=0 2024-09-21T06:01:06.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.341+0000 7fd55affd640 1 -- 172.21.15.7:0/1097452206 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2dc99ddf0 con 0x55f2dc63c9f0 2024-09-21T06:01:06.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.341+0000 7fd55affd640 10 client.17559 handle_command_reply: tid=0 2024-09-21T06:01:06.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.341+0000 7fd587d7d740 1 client.17559 shutdown 2024-09-21T06:01:06.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.342+0000 7fd587d7d740 1 -- 172.21.15.7:0/1097452206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 msgr2=0x55f2dca35b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:06.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.342+0000 7fd587d7d740 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 0x55f2dca35b40 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd5740ad2b0 tx=0x7fd5740057f0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.342+0000 7fd587d7d740 1 -- 172.21.15.7:0/1097452206 shutdown_connections 2024-09-21T06:01:06.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.342+0000 7fd587d7d740 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55f2dc63c9f0 0x55f2dca47290 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.342+0000 7fd587d7d740 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc67e070 0x55f2dca35b40 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.342+0000 7fd587d7d740 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc65d390 0x55f2dca35600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.342+0000 7fd587d7d740 1 --2- 172.21.15.7:0/1097452206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca350c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.342+0000 7fd587d7d740 1 -- 172.21.15.7:0/1097452206 >> 172.21.15.7:0/1097452206 conn(0x55f2dc672460 msgr2=0x55f2dca27090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:06.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.342+0000 7fd55affd640 0 client.17559 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:01:06.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.342+0000 7fd587d7d740 1 -- 172.21.15.7:0/1097452206 shutdown_connections 2024-09-21T06:01:06.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.342+0000 7fd587d7d740 1 -- 172.21.15.7:0/1097452206 wait complete. 2024-09-21T06:01:06.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.342+0000 7fd587d7d740 20 client.17559 trim_cache size 0 max 16384 2024-09-21T06:01:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.355+0000 7fd587d7d740 1 Processor -- start 2024-09-21T06:01:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.355+0000 7fd587d7d740 1 -- start start 2024-09-21T06:01:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.355+0000 7fd587d7d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca22eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.355+0000 7fd587d7d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 0x55f2dca233f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.355+0000 7fd587d7d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc67e070 0x55f2dca322b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.355+0000 7fd587d7d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c1afd40 con 0x55f2dc65d390 2024-09-21T06:01:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.355+0000 7fd587d7d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c1ad610 con 0x55f2dc6551b0 2024-09-21T06:01:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.355+0000 7fd587d7d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c1ab480 con 0x55f2dc67e070 2024-09-21T06:01:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd57a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 0x55f2dca233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd57a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 0x55f2dca233f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40426/0 (socket says 172.21.15.7:40426) 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd57a7fc640 1 -- 172.21.15.7:0/2522537476 learned_addr learned my addr 172.21.15.7:0/2522537476 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd57affd640 1 --2- 172.21.15.7:0/2522537476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca22eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd57b7fe640 1 --2- 172.21.15.7:0/2522537476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc67e070 0x55f2dca322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd57a7fc640 1 -- 172.21.15.7:0/2522537476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc67e070 msgr2=0x55f2dca322b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/2522537476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc67e070 0x55f2dca322b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd57a7fc640 1 -- 172.21.15.7:0/2522537476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 msgr2=0x55f2dca22eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/2522537476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca22eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd57a7fc640 1 -- 172.21.15.7:0/2522537476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2dca37800 con 0x55f2dc65d390 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd57b7fe640 1 --2- 172.21.15.7:0/2522537476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc67e070 0x55f2dca322b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd57affd640 1 --2- 172.21.15.7:0/2522537476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca22eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/2522537476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 0x55f2dca233f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd57000b610 tx=0x7fd5700040a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b374775ef8c2e3ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd5617fa640 1 -- 172.21.15.7:0/2522537476 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57002b070 con 0x55f2dc65d390 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd5617fa640 1 -- 172.21.15.7:0/2522537476 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5700035f0 con 0x55f2dc65d390 2024-09-21T06:01:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.356+0000 7fd5617fa640 1 -- 172.21.15.7:0/2522537476 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570019040 con 0x55f2dc65d390 2024-09-21T06:01:06.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.357+0000 7fd587d7d740 1 -- 172.21.15.7:0/2522537476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 msgr2=0x55f2dca233f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:06.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.357+0000 7fd587d7d740 1 --2- 172.21.15.7:0/2522537476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 0x55f2dca233f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd57000b610 tx=0x7fd5700040a0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.357+0000 7fd587d7d740 1 -- 172.21.15.7:0/2522537476 shutdown_connections 2024-09-21T06:01:06.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.357+0000 7fd587d7d740 1 --2- 172.21.15.7:0/2522537476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 0x55f2dca233f0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.357+0000 7fd587d7d740 1 --2- 172.21.15.7:0/2522537476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc67e070 0x55f2dca322b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.357+0000 7fd587d7d740 1 --2- 172.21.15.7:0/2522537476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc6551b0 0x55f2dca22eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.357+0000 7fd587d7d740 1 -- 172.21.15.7:0/2522537476 >> 172.21.15.7:0/2522537476 conn(0x55f2dc672460 msgr2=0x55f2dca33940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:06.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.357+0000 7fd587d7d740 1 -- 172.21.15.7:0/2522537476 shutdown_connections 2024-09-21T06:01:06.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.357+0000 7fd587d7d740 1 -- 172.21.15.7:0/2522537476 wait complete. 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd587d7d740 1 -- start start 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd587d7d740 1 Processor -- start 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd587d7d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc6551b0 0x55f2dca3dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd587d7d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 0x55f2dca391b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd587d7d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc67e070 0x55f2dca39770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd587d7d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c1abad0 con 0x55f2dc65d390 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd587d7d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c1acf40 con 0x55f2dc67e070 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd587d7d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c1ac1a0 con 0x55f2dc6551b0 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd587d7d740 10 client.0 _ll_register_callbacks cb 0x7fd5740a9c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd57a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 0x55f2dca391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd57a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 0x55f2dca391b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40436/0 (socket says 172.21.15.7:40436) 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd57a7fc640 1 -- 172.21.15.7:0/2210863931 learned_addr learned my addr 172.21.15.7:0/2210863931 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd57b7fe640 1 --2- 172.21.15.7:0/2210863931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc67e070 0x55f2dca39770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.358+0000 7fd57affd640 1 --2- 172.21.15.7:0/2210863931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc6551b0 0x55f2dca3dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd57a7fc640 1 -- 172.21.15.7:0/2210863931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc6551b0 msgr2=0x55f2dca3dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/2210863931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc6551b0 0x55f2dca3dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd57a7fc640 1 -- 172.21.15.7:0/2210863931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc67e070 msgr2=0x55f2dca39770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/2210863931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc67e070 0x55f2dca39770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd57a7fc640 1 -- 172.21.15.7:0/2210863931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2dca39f00 con 0x55f2dc65d390 2024-09-21T06:01:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd57a7fc640 1 --2- 172.21.15.7:0/2210863931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 0x55f2dca391b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd570016040 tx=0x7fd5700133b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e844a99f46a92558 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd55affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd55affd640 1 -- 172.21.15.7:0/2210863931 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57002b040 con 0x55f2dc65d390 2024-09-21T06:01:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd587d7d740 1 -- 172.21.15.7:0/2210863931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5700035f0 con 0x55f2dc65d390 2024-09-21T06:01:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd55affd640 1 -- 172.21.15.7:0/2210863931 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8441+0+0 (secure 0 0 0) 0x7fd570005510 con 0x55f2dc65d390 2024-09-21T06:01:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd55affd640 1 -- 172.21.15.7:0/2210863931 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd570019040 con 0x55f2dc65d390 2024-09-21T06:01:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd587d7d740 10 client.17565 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd587d7d740 1 -- 172.21.15.7:0/2210863931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f2dcab1b10 con 0x55f2dc65d390 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.359+0000 7fd55affd640 1 -- 172.21.15.7:0/2210863931 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5700035f0 con 0x55f2dc65d390 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.360+0000 7fd55affd640 1 -- 172.21.15.7:0/2210863931 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd57002e070 con 0x55f2dc65d390 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.360+0000 7fd587d7d740 10 client.17565 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.360+0000 7fd587d7d740 10 client.17565 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.360+0000 7fd587d7d740 20 client.17565 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.360+0000 7fd587d7d740 1 --2- 172.21.15.7:0/2210863931 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55f2dc611da0 0x55f2dcab3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.360+0000 7fd587d7d740 4 client.17565 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.360+0000 7fd587d7d740 1 -- 172.21.15.7:0/2210863931 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f2dc9998a0 con 0x55f2dc611da0 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.360+0000 7fd57affd640 1 --2- 172.21.15.7:0/2210863931 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55f2dc611da0 0x55f2dcab3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.360+0000 7fd57affd640 1 --2- 172.21.15.7:0/2210863931 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55f2dc611da0 0x55f2dcab3fa0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=31d4161b6e9f2cdc server_cookie=4e2b3d7638f47ce3 in_seq=0 out_seq=0 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.360+0000 7fd55affd640 10 client.17565 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd55affd640 1 -- 172.21.15.7:0/2210863931 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f2dc9998a0 con 0x55f2dc611da0 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd55affd640 10 client.17565 handle_command_reply: tid=0 2024-09-21T06:01:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd587d7d740 1 client.17565 shutdown 2024-09-21T06:01:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd587d7d740 1 -- 172.21.15.7:0/2210863931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 msgr2=0x55f2dca391b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd587d7d740 1 --2- 172.21.15.7:0/2210863931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 0x55f2dca391b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd570016040 tx=0x7fd5700133b0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd587d7d740 1 -- 172.21.15.7:0/2210863931 shutdown_connections 2024-09-21T06:01:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd587d7d740 1 --2- 172.21.15.7:0/2210863931 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55f2dc611da0 0x55f2dcab3fa0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd587d7d740 1 --2- 172.21.15.7:0/2210863931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f2dc65d390 0x55f2dca391b0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd587d7d740 1 --2- 172.21.15.7:0/2210863931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f2dc67e070 0x55f2dca39770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd587d7d740 1 --2- 172.21.15.7:0/2210863931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f2dc6551b0 0x55f2dca3dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd587d7d740 1 -- 172.21.15.7:0/2210863931 >> 172.21.15.7:0/2210863931 conn(0x55f2dc672460 msgr2=0x55f2dca266d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd55affd640 0 client.17565 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:01:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd587d7d740 1 -- 172.21.15.7:0/2210863931 shutdown_connections 2024-09-21T06:01:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd587d7d740 1 -- 172.21.15.7:0/2210863931 wait complete. 2024-09-21T06:01:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.361+0000 7fd587d7d740 20 client.17565 trim_cache size 0 max 16384 2024-09-21T06:01:06.369 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:01:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.362+0000 7fd581809640 1 -- 172.21.15.7:0/2456887091 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd5640b6680 msgr2=0x7fd5640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.362+0000 7fd581809640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd5640b6680 0x7fd5640b8b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd56c031440 tx=0x7fd56c0058b0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.362+0000 7fd581809640 1 -- 172.21.15.7:0/2456887091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd57c108d20 msgr2=0x7fd57c19fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.362+0000 7fd581809640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd57c108d20 0x7fd57c19fcd0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd57400cad0 tx=0x7fd57400cf90 comp rx=0 tx=0).stop 2024-09-21T06:01:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.362+0000 7fd581809640 1 -- 172.21.15.7:0/2456887091 shutdown_connections 2024-09-21T06:01:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.362+0000 7fd581809640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd5640b6680 0x7fd5640b8b90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.362+0000 7fd581809640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd57c108d20 0x7fd57c19fcd0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.362+0000 7fd581809640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd57c1083d0 0x7fd57c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.362+0000 7fd581809640 1 --2- 172.21.15.7:0/2456887091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd57c102ae0 0x7fd57c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.362+0000 7fd581809640 1 -- 172.21.15.7:0/2456887091 >> 172.21.15.7:0/2456887091 conn(0x7fd57c079760 msgr2=0x7fd57c101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.362+0000 7fd581809640 1 -- 172.21.15.7:0/2456887091 shutdown_connections 2024-09-21T06:01:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:06.362+0000 7fd581809640 1 -- 172.21.15.7:0/2456887091 wait complete. 2024-09-21T06:01:07.031 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:01:07.289 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:07.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.846+0000 7fa3385fa640 1 -- 172.21.15.7:0/3203537891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3301049b0 msgr2=0x7fa330104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:07.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.846+0000 7fa3385fa640 1 --2- 172.21.15.7:0/3203537891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3301049b0 0x7fa330104dc0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009900 tx=0x7fa32c02a410 comp rx=0 tx=0).stop 2024-09-21T06:01:07.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.846+0000 7fa3385fa640 1 -- 172.21.15.7:0/3203537891 shutdown_connections 2024-09-21T06:01:07.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.846+0000 7fa3385fa640 1 --2- 172.21.15.7:0/3203537891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa33010de10 0x7fa330110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.846+0000 7fa3385fa640 1 --2- 172.21.15.7:0/3203537891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa330105300 0x7fa33010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.846+0000 7fa3385fa640 1 --2- 172.21.15.7:0/3203537891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3301049b0 0x7fa330104dc0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.846+0000 7fa3385fa640 1 -- 172.21.15.7:0/3203537891 >> 172.21.15.7:0/3203537891 conn(0x7fa330079730 msgr2=0x7fa330079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:07.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.846+0000 7fa3385fa640 1 -- 172.21.15.7:0/3203537891 shutdown_connections 2024-09-21T06:01:07.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.846+0000 7fa3385fa640 1 -- 172.21.15.7:0/3203537891 wait complete. 2024-09-21T06:01:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.847+0000 7fa3385fa640 1 Processor -- start 2024-09-21T06:01:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.847+0000 7fa3385fa640 1 -- start start 2024-09-21T06:01:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa3385fa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3301049b0 0x7fa33019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa3385fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa330105300 0x7fa33019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa3385fa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa33010de10 0x7fa33019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa3385fa640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa330113ae0 con 0x7fa33010de10 2024-09-21T06:01:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa3385fa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa330113960 con 0x7fa3301049b0 2024-09-21T06:01:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa3385fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa330113c60 con 0x7fa330105300 2024-09-21T06:01:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa336b97640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa33010de10 0x7fa33019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa336b97640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa33010de10 0x7fa33019fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40450/0 (socket says 172.21.15.7:40450) 2024-09-21T06:01:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa336b97640 1 -- 172.21.15.7:0/3730176984 learned_addr learned my addr 172.21.15.7:0/3730176984 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa336396640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3301049b0 0x7fa33019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa335b95640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa330105300 0x7fa33019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa336b97640 1 -- 172.21.15.7:0/3730176984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa330105300 msgr2=0x7fa33019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa336b97640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa330105300 0x7fa33019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa336b97640 1 -- 172.21.15.7:0/3730176984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3301049b0 msgr2=0x7fa33019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa336b97640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3301049b0 0x7fa33019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa336b97640 1 -- 172.21.15.7:0/3730176984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3301a0460 con 0x7fa33010de10 2024-09-21T06:01:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa335b95640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa330105300 0x7fa33019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.848+0000 7fa336b97640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa33010de10 0x7fa33019fd30 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa328009fd0 tx=0x7fa32800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.849+0000 7fa3277fe640 1 -- 172.21.15.7:0/3730176984 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa328017070 con 0x7fa33010de10 2024-09-21T06:01:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.849+0000 7fa3277fe640 1 -- 172.21.15.7:0/3730176984 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa328003e20 con 0x7fa33010de10 2024-09-21T06:01:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.849+0000 7fa3385fa640 1 -- 172.21.15.7:0/3730176984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3301a0750 con 0x7fa33010de10 2024-09-21T06:01:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.849+0000 7fa3277fe640 1 -- 172.21.15.7:0/3730176984 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa328010460 con 0x7fa33010de10 2024-09-21T06:01:07.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.849+0000 7fa3385fa640 1 -- 172.21.15.7:0/3730176984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3301a6eb0 con 0x7fa33010de10 2024-09-21T06:01:07.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.852+0000 7fa3277fe640 1 -- 172.21.15.7:0/3730176984 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa328003970 con 0x7fa33010de10 2024-09-21T06:01:07.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.852+0000 7fa33eb6e740 1 Processor -- start 2024-09-21T06:01:07.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.852+0000 7fa33eb6e740 1 -- start start 2024-09-21T06:01:07.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.852+0000 7fa33eb6e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85335c070 0x55e8537032c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.852+0000 7fa33eb6e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8533331b0 0x55e853703800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.852+0000 7fa33eb6e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e85333b390 0x55e853703d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.852+0000 7fa33eb6e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e853679ea0 con 0x55e8533331b0 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.852+0000 7fa33eb6e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e8536692d0 con 0x55e85335c070 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.852+0000 7fa33eb6e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e85366d0e0 con 0x55e85333b390 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa336396640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8533331b0 0x55e853703800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa335b95640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85335c070 0x55e8537032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa336396640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8533331b0 0x55e853703800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40454/0 (socket says 172.21.15.7:40454) 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa335b95640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85335c070 0x55e8537032c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:42900/0 (socket says 172.21.15.7:42900) 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa336396640 1 -- 172.21.15.7:0/1244453701 learned_addr learned my addr 172.21.15.7:0/1244453701 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa335b95640 1 --2- 172.21.15.7:0/1244453701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e85333b390 0x55e853703d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa3277fe640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa31c0b6680 0x7fa31c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa335b95640 1 -- 172.21.15.7:0/1244453701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e85333b390 msgr2=0x55e853703d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa335b95640 1 --2- 172.21.15.7:0/1244453701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e85333b390 0x55e853703d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa335b95640 1 -- 172.21.15.7:0/1244453701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8533331b0 msgr2=0x55e853703800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa335b95640 1 --2- 172.21.15.7:0/1244453701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8533331b0 0x55e853703800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa335b95640 1 -- 172.21.15.7:0/1244453701 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8533c7650 con 0x55e85335c070 2024-09-21T06:01:07.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa3277fe640 1 -- 172.21.15.7:0/3730176984 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fa3280e73c0 con 0x7fa33010de10 2024-09-21T06:01:07.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa336b97640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa31c0b6680 0x7fa31c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.853+0000 7fa335b95640 1 --2- 172.21.15.7:0/1244453701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85335c070 0x55e8537032c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa330079fb0 tx=0x7fa320005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be37bd85821e3ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:07.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.854+0000 7fa324ff9640 1 -- 172.21.15.7:0/1244453701 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320011050 con 0x55e85335c070 2024-09-21T06:01:07.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.854+0000 7fa324ff9640 1 -- 172.21.15.7:0/1244453701 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3200054d0 con 0x55e85335c070 2024-09-21T06:01:07.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.854+0000 7fa324ff9640 1 -- 172.21.15.7:0/1244453701 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32000fe50 con 0x55e85335c070 2024-09-21T06:01:07.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.854+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1244453701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85335c070 msgr2=0x55e8537032c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:07.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.854+0000 7fa336b97640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa31c0b6680 0x7fa31c0b8b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa328005c40 tx=0x7fa328004020 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:07.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.854+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1244453701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85335c070 0x55e8537032c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa330079fb0 tx=0x7fa320005850 comp rx=0 tx=0).stop 2024-09-21T06:01:07.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.855+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1244453701 shutdown_connections 2024-09-21T06:01:07.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.855+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1244453701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8533331b0 0x55e853703800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.855+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1244453701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e85333b390 0x55e853703d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.855+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1244453701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85335c070 0x55e8537032c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.855+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1244453701 >> 172.21.15.7:0/1244453701 conn(0x55e853350460 msgr2=0x55e8537011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:07.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.855+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1244453701 shutdown_connections 2024-09-21T06:01:07.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.855+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1244453701 wait complete. 2024-09-21T06:01:07.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.855+0000 7fa33eb6e740 1 -- start start 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.855+0000 7fa33eb6e740 1 Processor -- start 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa33eb6e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e8533331b0 0x55e85370e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa33eb6e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 0x55e85370eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa33eb6e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85335c070 0x55e85370f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa33eb6e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e8534ca700 con 0x55e85333b390 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa33eb6e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e853604160 con 0x55e85335c070 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa33eb6e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e853711aa0 con 0x55e8533331b0 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa33eb6e740 10 client.0 _ll_register_callbacks cb 0x55e85361d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa336396640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 0x55e85370eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa336396640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 0x55e85370eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40462/0 (socket says 172.21.15.7:40462) 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa336396640 1 -- 172.21.15.7:0/262920790 learned_addr learned my addr 172.21.15.7:0/262920790 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa335b95640 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e8533331b0 0x55e85370e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa335b95640 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85335c070 0x55e85370f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa336396640 1 -- 172.21.15.7:0/262920790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e8533331b0 msgr2=0x55e85370e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa336396640 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e8533331b0 0x55e85370e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa336396640 1 -- 172.21.15.7:0/262920790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85335c070 msgr2=0x55e85370f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa336396640 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85335c070 0x55e85370f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa336396640 1 -- 172.21.15.7:0/262920790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e853631c90 con 0x55e85333b390 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa335b95640 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e8533331b0 0x55e85370e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa336396640 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 0x55e85370eef0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa32c02aa00 tx=0x7fa32c004510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0ef14c9fce95f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.856+0000 7fa319ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa319ffb640 1 -- 172.21.15.7:0/262920790 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c035040 con 0x55e85333b390 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa319ffb640 1 -- 172.21.15.7:0/262920790 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fa32c0054d0 con 0x55e85333b390 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa33eb6e740 1 -- 172.21.15.7:0/262920790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3200054d0 con 0x55e85333b390 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa319ffb640 1 -- 172.21.15.7:0/262920790 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa32c004750 con 0x55e85333b390 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa33eb6e740 10 client.17577 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa33eb6e740 1 -- 172.21.15.7:0/262920790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e85371d750 con 0x55e85333b390 2024-09-21T06:01:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa319ffb640 1 -- 172.21.15.7:0/262920790 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3200054d0 con 0x55e85333b390 2024-09-21T06:01:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa319ffb640 1 -- 172.21.15.7:0/262920790 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa32c04d020 con 0x55e85333b390 2024-09-21T06:01:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa33eb6e740 10 client.17577 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa33eb6e740 10 client.17577 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:01:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa33eb6e740 20 client.17577 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e85331a9f0 0x55e853720bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa33eb6e740 4 client.17577 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.857+0000 7fa33eb6e740 1 -- 172.21.15.7:0/262920790 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e85367bdf0 con 0x55e85331a9f0 2024-09-21T06:01:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.858+0000 7fa335b95640 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e85331a9f0 0x55e853720bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.858+0000 7fa335b95640 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e85331a9f0 0x55e853720bc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=26dff19a555e4fb0 server_cookie=c7124fb1ea167c24 in_seq=0 out_seq=0 2024-09-21T06:01:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.858+0000 7fa319ffb640 10 client.17577 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:01:07.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa319ffb640 1 -- 172.21.15.7:0/262920790 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e85367bdf0 con 0x55e85331a9f0 2024-09-21T06:01:07.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa319ffb640 10 client.17577 handle_command_reply: tid=0 2024-09-21T06:01:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa33eb6e740 1 client.17577 shutdown 2024-09-21T06:01:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa33eb6e740 1 -- 172.21.15.7:0/262920790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 msgr2=0x55e85370eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 0x55e85370eef0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa32c02aa00 tx=0x7fa32c004510 comp rx=0 tx=0).stop 2024-09-21T06:01:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa33eb6e740 1 -- 172.21.15.7:0/262920790 shutdown_connections 2024-09-21T06:01:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e85331a9f0 0x55e853720bc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 0x55e85370eef0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa319ffb640 0 client.17577 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:01:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85335c070 0x55e85370f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/262920790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e8533331b0 0x55e85370e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa33eb6e740 1 -- 172.21.15.7:0/262920790 >> 172.21.15.7:0/262920790 conn(0x55e853350460 msgr2=0x55e853706450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa33eb6e740 1 -- 172.21.15.7:0/262920790 shutdown_connections 2024-09-21T06:01:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa33eb6e740 1 -- 172.21.15.7:0/262920790 wait complete. 2024-09-21T06:01:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.859+0000 7fa33eb6e740 20 client.17577 trim_cache size 0 max 16384 2024-09-21T06:01:07.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa33eb6e740 1 Processor -- start 2024-09-21T06:01:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa33eb6e740 1 -- start start 2024-09-21T06:01:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa33eb6e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e8533331b0 0x55e85370ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa33eb6e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 0x55e85370bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa33eb6e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e85335c070 0x55e85370c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa33eb6e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3301b1f60 con 0x55e85333b390 2024-09-21T06:01:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa33eb6e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa3301af830 con 0x55e8533331b0 2024-09-21T06:01:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa33eb6e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa3301ad6a0 con 0x55e85335c070 2024-09-21T06:01:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa336396640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 0x55e85370bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa336396640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 0x55e85370bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40472/0 (socket says 172.21.15.7:40472) 2024-09-21T06:01:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa336396640 1 -- 172.21.15.7:0/1564467669 learned_addr learned my addr 172.21.15.7:0/1564467669 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa335b95640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e8533331b0 0x55e85370ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa335b95640 1 --2- 172.21.15.7:0/1564467669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e85335c070 0x55e85370c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa336396640 1 -- 172.21.15.7:0/1564467669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e85335c070 msgr2=0x55e85370c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:07.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa336396640 1 --2- 172.21.15.7:0/1564467669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e85335c070 0x55e85370c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa336396640 1 -- 172.21.15.7:0/1564467669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e8533331b0 msgr2=0x55e85370ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:07.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa336396640 1 --2- 172.21.15.7:0/1564467669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e8533331b0 0x55e85370ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.873+0000 7fa336396640 1 -- 172.21.15.7:0/1564467669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e85371acc0 con 0x55e85333b390 2024-09-21T06:01:07.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.874+0000 7fa336396640 1 --2- 172.21.15.7:0/1564467669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 0x55e85370bba0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fa32c005ab0 tx=0x7fa32c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4c69a31e27af04 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:07.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.874+0000 7fa31bfff640 1 -- 172.21.15.7:0/1564467669 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c035070 con 0x55e85333b390 2024-09-21T06:01:07.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.874+0000 7fa31bfff640 1 -- 172.21.15.7:0/1564467669 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa32c054070 con 0x55e85333b390 2024-09-21T06:01:07.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.874+0000 7fa31bfff640 1 -- 172.21.15.7:0/1564467669 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c004dc0 con 0x55e85333b390 2024-09-21T06:01:07.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.874+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1564467669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 msgr2=0x55e85370bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:07.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1564467669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 0x55e85370bba0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fa32c005ab0 tx=0x7fa32c001e70 comp rx=0 tx=0).stop 2024-09-21T06:01:07.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1564467669 shutdown_connections 2024-09-21T06:01:07.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1564467669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85333b390 0x55e85370bba0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1564467669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e85335c070 0x55e85370c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1564467669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e8533331b0 0x55e85370ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1564467669 >> 172.21.15.7:0/1564467669 conn(0x55e853350460 msgr2=0x55e85370e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:07.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1564467669 shutdown_connections 2024-09-21T06:01:07.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1564467669 wait complete. 2024-09-21T06:01:07.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 -- start start 2024-09-21T06:01:07.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 Processor -- start 2024-09-21T06:01:07.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e8533331b0 0x55e853712110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85333b390 0x55e853712650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85335c070 0x55e85378d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3301adcf0 con 0x55e85335c070 2024-09-21T06:01:07.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa3301af160 con 0x55e85333b390 2024-09-21T06:01:07.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa3301ae3c0 con 0x55e8533331b0 2024-09-21T06:01:07.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.875+0000 7fa33eb6e740 10 client.0 _ll_register_callbacks cb 0x7fa32c0041a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:07.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa336396640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85333b390 0x55e853712650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa335b95640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85335c070 0x55e85378d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa336396640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85333b390 0x55e853712650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:42934/0 (socket says 172.21.15.7:42934) 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa336396640 1 -- 172.21.15.7:0/1737787455 learned_addr learned my addr 172.21.15.7:0/1737787455 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa335b95640 1 --2- 172.21.15.7:0/1737787455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e8533331b0 0x55e853712110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa336396640 1 -- 172.21.15.7:0/1737787455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e8533331b0 msgr2=0x55e853712110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa336396640 1 --2- 172.21.15.7:0/1737787455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e8533331b0 0x55e853712110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa336396640 1 -- 172.21.15.7:0/1737787455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85335c070 msgr2=0x55e85378d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa336396640 1 --2- 172.21.15.7:0/1737787455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85335c070 0x55e85378d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa336396640 1 -- 172.21.15.7:0/1737787455 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e853712e40 con 0x55e85333b390 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa335b95640 1 --2- 172.21.15.7:0/1737787455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85335c070 0x55e85378d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa336396640 1 --2- 172.21.15.7:0/1737787455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85333b390 0x55e853712650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa32c005ff0 tx=0x7fa32c005580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=916a3f336710837 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa319ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa319ffb640 1 -- 172.21.15.7:0/1737787455 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c035070 con 0x55e85333b390 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa319ffb640 1 -- 172.21.15.7:0/1737787455 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fa32c031700 con 0x55e85333b390 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.876+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1737787455 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa32c054070 con 0x55e85333b390 2024-09-21T06:01:07.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.877+0000 7fa319ffb640 1 -- 172.21.15.7:0/1737787455 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa32c003eb0 con 0x55e85333b390 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.877+0000 7fa33eb6e740 10 client.26954 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.877+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1737787455 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e85378ee70 con 0x55e85333b390 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.877+0000 7fa319ffb640 1 -- 172.21.15.7:0/1737787455 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa32c054070 con 0x55e85333b390 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.877+0000 7fa319ffb640 1 -- 172.21.15.7:0/1737787455 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa32c060030 con 0x55e85333b390 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.877+0000 7fa33eb6e740 10 client.26954 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.877+0000 7fa33eb6e740 10 client.26954 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.877+0000 7fa33eb6e740 20 client.26954 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.877+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1737787455 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e8532efda0 0x55e853791560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.877+0000 7fa33eb6e740 4 client.26954 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.877+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1737787455 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e8536778a0 con 0x55e8532efda0 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.877+0000 7fa335b95640 1 --2- 172.21.15.7:0/1737787455 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e8532efda0 0x55e853791560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa335b95640 1 --2- 172.21.15.7:0/1737787455 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e8532efda0 0x55e853791560 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=207975998a4a2f7b server_cookie=f65e58a97ea82c58 in_seq=0 out_seq=0 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa319ffb640 10 client.26954 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa319ffb640 1 -- 172.21.15.7:0/1737787455 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e8536778a0 con 0x55e8532efda0 2024-09-21T06:01:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa319ffb640 10 client.26954 handle_command_reply: tid=0 2024-09-21T06:01:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa33eb6e740 1 client.26954 shutdown 2024-09-21T06:01:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1737787455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85333b390 msgr2=0x55e853712650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1737787455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85333b390 0x55e853712650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa32c005ff0 tx=0x7fa32c005580 comp rx=0 tx=0).stop 2024-09-21T06:01:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1737787455 shutdown_connections 2024-09-21T06:01:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1737787455 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e8532efda0 0x55e853791560 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1737787455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e85335c070 0x55e85378d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1737787455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e85333b390 0x55e853712650 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa319ffb640 0 client.26954 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:01:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa33eb6e740 1 --2- 172.21.15.7:0/1737787455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e8533331b0 0x55e853712110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1737787455 >> 172.21.15.7:0/1737787455 conn(0x55e853350460 msgr2=0x55e853719cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1737787455 shutdown_connections 2024-09-21T06:01:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.878+0000 7fa33eb6e740 1 -- 172.21.15.7:0/1737787455 wait complete. 2024-09-21T06:01:07.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.879+0000 7fa33eb6e740 20 client.26954 trim_cache size 0 max 16384 2024-09-21T06:01:07.886 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:01:07.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.879+0000 7fa3385fa640 1 -- 172.21.15.7:0/3730176984 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa31c0b6680 msgr2=0x7fa31c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:07.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.879+0000 7fa3385fa640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa31c0b6680 0x7fa31c0b8b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa328005c40 tx=0x7fa328004020 comp rx=0 tx=0).stop 2024-09-21T06:01:07.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.879+0000 7fa3385fa640 1 -- 172.21.15.7:0/3730176984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa33010de10 msgr2=0x7fa33019fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:07.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.879+0000 7fa3385fa640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa33010de10 0x7fa33019fd30 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa328009fd0 tx=0x7fa32800b260 comp rx=0 tx=0).stop 2024-09-21T06:01:07.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.879+0000 7fa3385fa640 1 -- 172.21.15.7:0/3730176984 shutdown_connections 2024-09-21T06:01:07.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.879+0000 7fa3385fa640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa31c0b6680 0x7fa31c0b8b90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.879+0000 7fa3385fa640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa33010de10 0x7fa33019fd30 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.879+0000 7fa3385fa640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa330105300 0x7fa33019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.879+0000 7fa3385fa640 1 --2- 172.21.15.7:0/3730176984 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3301049b0 0x7fa33019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:07.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.879+0000 7fa3385fa640 1 -- 172.21.15.7:0/3730176984 >> 172.21.15.7:0/3730176984 conn(0x7fa330079730 msgr2=0x7fa3301007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:07.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.879+0000 7fa3385fa640 1 -- 172.21.15.7:0/3730176984 shutdown_connections 2024-09-21T06:01:07.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:07.879+0000 7fa3385fa640 1 -- 172.21.15.7:0/3730176984 wait complete. 2024-09-21T06:01:07.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:07 smithi027 ceph-mon[34364]: pgmap v537: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:01:08.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:07 smithi007 ceph-mon[30983]: pgmap v537: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:01:08.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:07 smithi119 ceph-mon[34833]: pgmap v537: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:01:08.514 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:01:08.774 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:08.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:08 smithi027 ceph-mon[34364]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:01:09.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:08 smithi007 ceph-mon[30983]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:01:09.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:08 smithi119 ceph-mon[34833]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:01:09.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.257+0000 7f005b316640 1 -- 172.21.15.7:0/1173183719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0054102ae0 msgr2=0x7f0054102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:09.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.257+0000 7f005b316640 1 --2- 172.21.15.7:0/1173183719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0054102ae0 0x7f0054102ef0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f0050009900 tx=0x7f005002a410 comp rx=0 tx=0).stop 2024-09-21T06:01:09.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.257+0000 7f005b316640 1 -- 172.21.15.7:0/1173183719 shutdown_connections 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.257+0000 7f005b316640 1 --2- 172.21.15.7:0/1173183719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054108d20 0x7f005410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.257+0000 7f005b316640 1 --2- 172.21.15.7:0/1173183719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00541083d0 0x7f00541087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.257+0000 7f005b316640 1 --2- 172.21.15.7:0/1173183719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0054102ae0 0x7f0054102ef0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.257+0000 7f005b316640 1 -- 172.21.15.7:0/1173183719 >> 172.21.15.7:0/1173183719 conn(0x7f0054079760 msgr2=0x7f0054079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.257+0000 7f005b316640 1 -- 172.21.15.7:0/1173183719 shutdown_connections 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.257+0000 7f005b316640 1 -- 172.21.15.7:0/1173183719 wait complete. 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.258+0000 7f005b316640 1 Processor -- start 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.258+0000 7f005b316640 1 -- start start 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.258+0000 7f005b316640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054102ae0 0x7f005419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.258+0000 7f005b316640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541083d0 0x7f005419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.258+0000 7f005b316640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0054108d20 0x7f005419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.258+0000 7f005b316640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0054112990 con 0x7f00541083d0 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.258+0000 7f005b316640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0054112810 con 0x7f0054102ae0 2024-09-21T06:01:09.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.258+0000 7f005b316640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0054112b10 con 0x7f0054108d20 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.258+0000 7f00588b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541083d0 0x7f005419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.258+0000 7f00588b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541083d0 0x7f005419aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51206/0 (socket says 172.21.15.7:51206) 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.258+0000 7f00588b1640 1 -- 172.21.15.7:0/3553833101 learned_addr learned my addr 172.21.15.7:0/3553833101 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.258+0000 7f00590b2640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054102ae0 0x7f005419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.258+0000 7f00598b3640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0054108d20 0x7f005419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.259+0000 7f00588b1640 1 -- 172.21.15.7:0/3553833101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0054108d20 msgr2=0x7f005419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.259+0000 7f00588b1640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0054108d20 0x7f005419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.259+0000 7f00588b1640 1 -- 172.21.15.7:0/3553833101 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054102ae0 msgr2=0x7f005419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.259+0000 7f00588b1640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054102ae0 0x7f005419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.259+0000 7f00588b1640 1 -- 172.21.15.7:0/3553833101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00541a0400 con 0x7f00541083d0 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.259+0000 7f00588b1640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541083d0 0x7f005419aa30 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f004400e9f0 tx=0x7f004400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.259+0000 7f004a7fc640 1 -- 172.21.15.7:0/3553833101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004400ccc0 con 0x7f00541083d0 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.259+0000 7f005b316640 1 -- 172.21.15.7:0/3553833101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00541a06f0 con 0x7f00541083d0 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.259+0000 7f004a7fc640 1 -- 172.21.15.7:0/3553833101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00440054d0 con 0x7f00541083d0 2024-09-21T06:01:09.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.259+0000 7f004a7fc640 1 -- 172.21.15.7:0/3553833101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044010430 con 0x7f00541083d0 2024-09-21T06:01:09.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.259+0000 7f005b316640 1 -- 172.21.15.7:0/3553833101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00541a6e50 con 0x7f00541083d0 2024-09-21T06:01:09.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.262+0000 7f006188a740 1 Processor -- start 2024-09-21T06:01:09.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.262+0000 7f006188a740 1 -- start start 2024-09-21T06:01:09.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.262+0000 7f006188a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733216a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.262+0000 7f006188a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 0x557d73321be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.262+0000 7f006188a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f59390 0x557d73322120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.262+0000 7f006188a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557d73297ea0 con 0x557d72f59390 2024-09-21T06:01:09.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.262+0000 7f006188a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x557d732872d0 con 0x557d72f511b0 2024-09-21T06:01:09.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.262+0000 7f006188a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557d7328b0e0 con 0x557d72f7a070 2024-09-21T06:01:09.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f00598b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f00590b2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 0x557d73321be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f00598b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733216a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:35378/0 (socket says 172.21.15.7:35378) 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f00598b3640 1 -- 172.21.15.7:0/1264162705 learned_addr learned my addr 172.21.15.7:0/1264162705 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f00598b3640 1 -- 172.21.15.7:0/1264162705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 msgr2=0x557d73321be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f00598b3640 1 --2- 172.21.15.7:0/1264162705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 0x557d73321be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f00598b3640 1 -- 172.21.15.7:0/1264162705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f59390 msgr2=0x557d73322120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f00598b3640 1 --2- 172.21.15.7:0/1264162705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f59390 0x557d73322120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f00598b3640 1 -- 172.21.15.7:0/1264162705 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d72fe5650 con 0x557d72f7a070 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f00598b3640 1 --2- 172.21.15.7:0/1264162705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733216a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f004c0039f0 tx=0x7f004c003eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d148f520d48a25b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f004a7fc640 1 -- 172.21.15.7:0/3553833101 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f00440046c0 con 0x7f00541083d0 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f003f7fe640 1 -- 172.21.15.7:0/1264162705 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c01a470 con 0x557d72f7a070 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f003f7fe640 1 -- 172.21.15.7:0/1264162705 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f004c015070 con 0x557d72f7a070 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.263+0000 7f003f7fe640 1 -- 172.21.15.7:0/1264162705 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c010780 con 0x557d72f7a070 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.264+0000 7f004a7fc640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00400b6680 0x7f00400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.264+0000 7f006188a740 1 -- 172.21.15.7:0/1264162705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 msgr2=0x557d733216a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.264+0000 7f006188a740 1 --2- 172.21.15.7:0/1264162705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733216a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f004c0039f0 tx=0x7f004c003eb0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.264+0000 7f00590b2640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00400b6680 0x7f00400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.264+0000 7f004a7fc640 1 -- 172.21.15.7:0/3553833101 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f00440e7a50 con 0x7f00541083d0 2024-09-21T06:01:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.264+0000 7f006188a740 1 -- 172.21.15.7:0/1264162705 shutdown_connections 2024-09-21T06:01:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.264+0000 7f006188a740 1 --2- 172.21.15.7:0/1264162705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f59390 0x557d73322120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.264+0000 7f006188a740 1 --2- 172.21.15.7:0/1264162705 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 0x557d73321be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.264+0000 7f006188a740 1 --2- 172.21.15.7:0/1264162705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733216a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.264+0000 7f006188a740 1 -- 172.21.15.7:0/1264162705 >> 172.21.15.7:0/1264162705 conn(0x557d72f6e460 msgr2=0x557d7331f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.265+0000 7f006188a740 1 -- 172.21.15.7:0/1264162705 shutdown_connections 2024-09-21T06:01:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.265+0000 7f006188a740 1 -- 172.21.15.7:0/1264162705 wait complete. 2024-09-21T06:01:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.265+0000 7f00590b2640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00400b6680 0x7f00400b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0050031440 tx=0x7f0050009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.265+0000 7f006188a740 1 -- start start 2024-09-21T06:01:09.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.265+0000 7f006188a740 1 Processor -- start 2024-09-21T06:01:09.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f006188a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 0x557d73331150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f006188a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f59390 0x557d73331690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f006188a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f7a070 0x557d7333d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f006188a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557d730e8700 con 0x557d72f7a070 2024-09-21T06:01:09.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f006188a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x557d73222160 con 0x557d72f511b0 2024-09-21T06:01:09.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f006188a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557d733341e0 con 0x557d72f59390 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f006188a740 10 client.0 _ll_register_callbacks cb 0x557d7323b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f00588b1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f59390 0x557d73331690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f00588b1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f59390 0x557d73331690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:35386/0 (socket says 172.21.15.7:35386) 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f00588b1640 1 -- 172.21.15.7:0/2615681995 learned_addr learned my addr 172.21.15.7:0/2615681995 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f00598b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f7a070 0x557d7333d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f00590b2640 1 --2- 172.21.15.7:0/2615681995 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 0x557d73331150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f00588b1640 1 -- 172.21.15.7:0/2615681995 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 msgr2=0x557d73331150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f00588b1640 1 --2- 172.21.15.7:0/2615681995 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 0x557d73331150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f00588b1640 1 -- 172.21.15.7:0/2615681995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f7a070 msgr2=0x557d7333d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f00588b1640 1 --2- 172.21.15.7:0/2615681995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f7a070 0x557d7333d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f00588b1640 1 -- 172.21.15.7:0/2615681995 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d7324fc90 con 0x557d72f59390 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f00588b1640 1 --2- 172.21.15.7:0/2615681995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f59390 0x557d73331690 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f00440e57c0 tx=0x7f00440b71f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed6bcefd4c195373 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.266+0000 7f003cff9640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f003cff9640 1 -- 172.21.15.7:0/2615681995 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00440ad030 con 0x557d72f59390 2024-09-21T06:01:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f003cff9640 1 -- 172.21.15.7:0/2615681995 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f00440a9210 con 0x557d72f59390 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f006188a740 1 -- 172.21.15.7:0/2615681995 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f004c015070 con 0x557d72f59390 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f003cff9640 1 -- 172.21.15.7:0/2615681995 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f00440b2180 con 0x557d72f59390 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f006188a740 10 client.26890 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f006188a740 1 -- 172.21.15.7:0/2615681995 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557d7333ff20 con 0x557d72f59390 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f003cff9640 1 -- 172.21.15.7:0/2615681995 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f004c015070 con 0x557d72f59390 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f003cff9640 1 -- 172.21.15.7:0/2615681995 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f00440a9410 con 0x557d72f59390 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f006188a740 10 client.26890 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f006188a740 10 client.26890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f006188a740 20 client.26890 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f006188a740 1 --2- 172.21.15.7:0/2615681995 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557d72f389f0 0x557d73343410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f006188a740 4 client.26890 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.267+0000 7f006188a740 1 -- 172.21.15.7:0/2615681995 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d73299df0 con 0x557d72f389f0 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.268+0000 7f00590b2640 1 --2- 172.21.15.7:0/2615681995 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557d72f389f0 0x557d73343410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.268+0000 7f003cff9640 10 client.26890 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:09.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.268+0000 7f00590b2640 1 --2- 172.21.15.7:0/2615681995 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557d72f389f0 0x557d73343410 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4c6253e06593ab9 server_cookie=e0cd936a2ddfd51 in_seq=0 out_seq=0 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f003cff9640 1 -- 172.21.15.7:0/2615681995 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d73299df0 con 0x557d72f389f0 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f003cff9640 10 client.26890 handle_command_reply: tid=0 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f006188a740 1 client.26890 shutdown 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f006188a740 1 -- 172.21.15.7:0/2615681995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f59390 msgr2=0x557d73331690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f006188a740 1 --2- 172.21.15.7:0/2615681995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f59390 0x557d73331690 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f00440e57c0 tx=0x7f00440b71f0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f006188a740 1 -- 172.21.15.7:0/2615681995 shutdown_connections 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f006188a740 1 --2- 172.21.15.7:0/2615681995 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557d72f389f0 0x557d73343410 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f006188a740 1 --2- 172.21.15.7:0/2615681995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f7a070 0x557d7333d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f003cff9640 0 client.26890 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f006188a740 1 --2- 172.21.15.7:0/2615681995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f59390 0x557d73331690 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f006188a740 1 --2- 172.21.15.7:0/2615681995 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 0x557d73331150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f006188a740 1 -- 172.21.15.7:0/2615681995 >> 172.21.15.7:0/2615681995 conn(0x557d72f6e460 msgr2=0x557d7331dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f006188a740 1 -- 172.21.15.7:0/2615681995 shutdown_connections 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f006188a740 1 -- 172.21.15.7:0/2615681995 wait complete. 2024-09-21T06:01:09.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.269+0000 7f006188a740 20 client.26890 trim_cache size 0 max 16384 2024-09-21T06:01:09.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.286+0000 7f006188a740 1 Processor -- start 2024-09-21T06:01:09.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.286+0000 7f006188a740 1 -- start start 2024-09-21T06:01:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.286+0000 7f006188a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f511b0 0x557d73333030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.286+0000 7f006188a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f59390 0x557d7333d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.286+0000 7f006188a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733300e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.286+0000 7f006188a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f00541afc90 con 0x557d72f511b0 2024-09-21T06:01:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.286+0000 7f006188a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f00541ad560 con 0x557d72f59390 2024-09-21T06:01:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.286+0000 7f006188a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f00541ab3f0 con 0x557d72f7a070 2024-09-21T06:01:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.286+0000 7f00590b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f511b0 0x557d73333030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.286+0000 7f00590b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f511b0 0x557d73333030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51222/0 (socket says 172.21.15.7:51222) 2024-09-21T06:01:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.286+0000 7f00590b2640 1 -- 172.21.15.7:0/2797065317 learned_addr learned my addr 172.21.15.7:0/2797065317 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.286+0000 7f00588b1640 1 --2- 172.21.15.7:0/2797065317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f59390 0x557d7333d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.286+0000 7f00598b3640 1 --2- 172.21.15.7:0/2797065317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733300e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.287+0000 7f00590b2640 1 -- 172.21.15.7:0/2797065317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 msgr2=0x557d733300e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.287+0000 7f00590b2640 1 --2- 172.21.15.7:0/2797065317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733300e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.287+0000 7f00590b2640 1 -- 172.21.15.7:0/2797065317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f59390 msgr2=0x557d7333d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.287+0000 7f00590b2640 1 --2- 172.21.15.7:0/2797065317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f59390 0x557d7333d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.287+0000 7f00590b2640 1 -- 172.21.15.7:0/2797065317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d733321f0 con 0x557d72f511b0 2024-09-21T06:01:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.287+0000 7f00588b1640 1 --2- 172.21.15.7:0/2797065317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f59390 0x557d7333d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.287+0000 7f00590b2640 1 --2- 172.21.15.7:0/2797065317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f511b0 0x557d73333030 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f0050009900 tx=0x7f005003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119855dd89f97e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.287+0000 7f003effd640 1 -- 172.21.15.7:0/2797065317 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050035040 con 0x557d72f511b0 2024-09-21T06:01:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.287+0000 7f003effd640 1 -- 172.21.15.7:0/2797065317 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0050056030 con 0x557d72f511b0 2024-09-21T06:01:09.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.287+0000 7f003effd640 1 -- 172.21.15.7:0/2797065317 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050004d80 con 0x557d72f511b0 2024-09-21T06:01:09.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.288+0000 7f006188a740 1 -- 172.21.15.7:0/2797065317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f511b0 msgr2=0x557d73333030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.288+0000 7f006188a740 1 --2- 172.21.15.7:0/2797065317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f511b0 0x557d73333030 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f0050009900 tx=0x7f005003f000 comp rx=0 tx=0).stop 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.288+0000 7f006188a740 1 -- 172.21.15.7:0/2797065317 shutdown_connections 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.288+0000 7f006188a740 1 --2- 172.21.15.7:0/2797065317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733300e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.288+0000 7f006188a740 1 --2- 172.21.15.7:0/2797065317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f59390 0x557d7333d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.288+0000 7f006188a740 1 --2- 172.21.15.7:0/2797065317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f511b0 0x557d73333030 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.288+0000 7f006188a740 1 -- 172.21.15.7:0/2797065317 >> 172.21.15.7:0/2797065317 conn(0x557d72f6e460 msgr2=0x557d7332f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.288+0000 7f006188a740 1 -- 172.21.15.7:0/2797065317 shutdown_connections 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.288+0000 7f006188a740 1 -- 172.21.15.7:0/2797065317 wait complete. 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.288+0000 7f006188a740 1 -- start start 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.289+0000 7f006188a740 1 Processor -- start 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.289+0000 7f006188a740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 0x557d73337ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.289+0000 7f006188a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f59390 0x557d733380e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.289+0000 7f006188a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733acd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.289+0000 7f006188a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f00541aba40 con 0x557d72f59390 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.289+0000 7f006188a740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f00541ace90 con 0x557d72f511b0 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.289+0000 7f006188a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f00541ac0f0 con 0x557d72f7a070 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.289+0000 7f006188a740 10 client.0 _ll_register_callbacks cb 0x7f004400cef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.289+0000 7f00588b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f59390 0x557d733380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.289+0000 7f00588b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f59390 0x557d733380e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51236/0 (socket says 172.21.15.7:51236) 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.289+0000 7f00588b1640 1 -- 172.21.15.7:0/3834378837 learned_addr learned my addr 172.21.15.7:0/3834378837 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.289+0000 7f00598b3640 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.289+0000 7f00590b2640 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 0x557d73337ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f00588b1640 1 -- 172.21.15.7:0/3834378837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 msgr2=0x557d733acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f00588b1640 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f00588b1640 1 -- 172.21.15.7:0/3834378837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 msgr2=0x557d73337ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f00588b1640 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 0x557d73337ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f00588b1640 1 -- 172.21.15.7:0/3834378837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d733ad2c0 con 0x557d72f59390 2024-09-21T06:01:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f00598b3640 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f00588b1640 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f59390 0x557d733380e0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f00440a9e90 tx=0x7f00440b39b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1593c2ead9a982b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f003cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f003cff9640 1 -- 172.21.15.7:0/3834378837 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00440ad030 con 0x557d72f59390 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f003cff9640 1 -- 172.21.15.7:0/3834378837 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f00440a9410 con 0x557d72f59390 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f006188a740 1 -- 172.21.15.7:0/3834378837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0050056030 con 0x557d72f59390 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f003cff9640 1 -- 172.21.15.7:0/3834378837 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0044005680 con 0x557d72f59390 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f006188a740 10 client.17598 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f006188a740 1 -- 172.21.15.7:0/3834378837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557d733ae540 con 0x557d72f59390 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.290+0000 7f003cff9640 1 -- 172.21.15.7:0/3834378837 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0050056030 con 0x557d72f59390 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.291+0000 7f003cff9640 1 -- 172.21.15.7:0/3834378837 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f00440ac590 con 0x557d72f59390 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.291+0000 7f006188a740 10 client.17598 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.291+0000 7f006188a740 10 client.17598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.291+0000 7f006188a740 20 client.17598 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.291+0000 7f006188a740 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557d72f0dda0 0x557d733b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.291+0000 7f006188a740 4 client.17598 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:01:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.291+0000 7f006188a740 1 -- 172.21.15.7:0/3834378837 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d732958a0 con 0x557d72f0dda0 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.291+0000 7f00590b2640 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557d72f0dda0 0x557d733b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.291+0000 7f00590b2640 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557d72f0dda0 0x557d733b0bc0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28602ad961ba5c16 server_cookie=fbc3dfd8822e5277 in_seq=0 out_seq=0 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.291+0000 7f003cff9640 10 client.17598 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.291+0000 7f003cff9640 1 -- 172.21.15.7:0/3834378837 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d732958a0 con 0x557d72f0dda0 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.291+0000 7f003cff9640 10 client.17598 handle_command_reply: tid=0 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.291+0000 7f006188a740 1 client.17598 shutdown 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f006188a740 1 -- 172.21.15.7:0/3834378837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f59390 msgr2=0x557d733380e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f006188a740 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f59390 0x557d733380e0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f00440a9e90 tx=0x7f00440b39b0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f006188a740 1 -- 172.21.15.7:0/3834378837 shutdown_connections 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f006188a740 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557d72f0dda0 0x557d733b0bc0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f006188a740 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557d72f59390 0x557d733380e0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f006188a740 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557d72f7a070 0x557d733acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f003cff9640 0 client.17598 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f006188a740 1 --2- 172.21.15.7:0/3834378837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557d72f511b0 0x557d73337ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f006188a740 1 -- 172.21.15.7:0/3834378837 >> 172.21.15.7:0/3834378837 conn(0x557d72f6e460 msgr2=0x557d73332520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f006188a740 1 -- 172.21.15.7:0/3834378837 shutdown_connections 2024-09-21T06:01:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f006188a740 1 -- 172.21.15.7:0/3834378837 wait complete. 2024-09-21T06:01:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f006188a740 20 client.17598 trim_cache size 0 max 16384 2024-09-21T06:01:09.298 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:01:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f005b316640 1 -- 172.21.15.7:0/3553833101 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00400b6680 msgr2=0x7f00400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f005b316640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00400b6680 0x7f00400b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0050031440 tx=0x7f0050009560 comp rx=0 tx=0).stop 2024-09-21T06:01:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f005b316640 1 -- 172.21.15.7:0/3553833101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541083d0 msgr2=0x7f005419aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.292+0000 7f005b316640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541083d0 0x7f005419aa30 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f004400e9f0 tx=0x7f004400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.293+0000 7f005b316640 1 -- 172.21.15.7:0/3553833101 shutdown_connections 2024-09-21T06:01:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.293+0000 7f005b316640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00400b6680 0x7f00400b8b90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.293+0000 7f005b316640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00541083d0 0x7f005419aa30 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.293+0000 7f005b316640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0054108d20 0x7f005419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.293+0000 7f005b316640 1 --2- 172.21.15.7:0/3553833101 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054102ae0 0x7f005419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.293+0000 7f005b316640 1 -- 172.21.15.7:0/3553833101 >> 172.21.15.7:0/3553833101 conn(0x7f0054079760 msgr2=0x7f0054101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.293+0000 7f005b316640 1 -- 172.21.15.7:0/3553833101 shutdown_connections 2024-09-21T06:01:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:09.293+0000 7f005b316640 1 -- 172.21.15.7:0/3553833101 wait complete. 2024-09-21T06:01:09.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:09 smithi007 ceph-mon[30983]: pgmap v539: 97 pgs: 5 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 87 active+clean; 251 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:01:09.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:09 smithi027 ceph-mon[34364]: pgmap v539: 97 pgs: 5 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 87 active+clean; 251 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:01:10.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:09 smithi119 ceph-mon[34833]: pgmap v539: 97 pgs: 5 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 87 active+clean; 251 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:01:10.975 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:01:10.975 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:01:11.249 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:11.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.718+0000 7fb039087640 1 -- 172.21.15.7:0/75353435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb034102a60 msgr2=0x7fb034102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:11.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.718+0000 7fb039087640 1 --2- 172.21.15.7:0/75353435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb034102a60 0x7fb034102e70 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fb024009900 tx=0x7fb02402a410 comp rx=0 tx=0).stop 2024-09-21T06:01:11.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.718+0000 7fb039087640 1 -- 172.21.15.7:0/75353435 shutdown_connections 2024-09-21T06:01:11.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.718+0000 7fb039087640 1 --2- 172.21.15.7:0/75353435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb034108cf0 0x7fb03410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.718+0000 7fb039087640 1 --2- 172.21.15.7:0/75353435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0341083a0 0x7fb0341087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.718+0000 7fb039087640 1 --2- 172.21.15.7:0/75353435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb034102a60 0x7fb034102e70 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.718+0000 7fb039087640 1 -- 172.21.15.7:0/75353435 >> 172.21.15.7:0/75353435 conn(0x7fb034079730 msgr2=0x7fb034079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:11.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.719+0000 7fb039087640 1 -- 172.21.15.7:0/75353435 shutdown_connections 2024-09-21T06:01:11.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.719+0000 7fb039087640 1 -- 172.21.15.7:0/75353435 wait complete. 2024-09-21T06:01:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.719+0000 7fb039087640 1 Processor -- start 2024-09-21T06:01:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.720+0000 7fb039087640 1 -- start start 2024-09-21T06:01:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.720+0000 7fb039087640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb034102a60 0x7fb03419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.720+0000 7fb039087640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0341083a0 0x7fb03419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.720+0000 7fb039087640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb034108cf0 0x7fb03419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.720+0000 7fb039087640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb034112960 con 0x7fb034102a60 2024-09-21T06:01:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.720+0000 7fb039087640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341127e0 con 0x7fb0341083a0 2024-09-21T06:01:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.720+0000 7fb039087640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb034112ae0 con 0x7fb034108cf0 2024-09-21T06:01:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.720+0000 7fb032d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb034102a60 0x7fb03419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.720+0000 7fb032d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb034102a60 0x7fb03419a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51248/0 (socket says 172.21.15.7:51248) 2024-09-21T06:01:11.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.720+0000 7fb032d9d640 1 -- 172.21.15.7:0/1570303606 learned_addr learned my addr 172.21.15.7:0/1570303606 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.720+0000 7fb03259c640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0341083a0 0x7fb03419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.720+0000 7fb03359e640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb034108cf0 0x7fb03419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.721+0000 7fb032d9d640 1 -- 172.21.15.7:0/1570303606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb034108cf0 msgr2=0x7fb03419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.721+0000 7fb032d9d640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb034108cf0 0x7fb03419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.721+0000 7fb032d9d640 1 -- 172.21.15.7:0/1570303606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0341083a0 msgr2=0x7fb03419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.721+0000 7fb032d9d640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0341083a0 0x7fb03419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.721+0000 7fb032d9d640 1 -- 172.21.15.7:0/1570303606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0341a03b0 con 0x7fb034102a60 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.721+0000 7fb03259c640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0341083a0 0x7fb03419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.721+0000 7fb032d9d640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb034102a60 0x7fb03419a440 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fb024005940 tx=0x7fb0240040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.721+0000 7fb01bfff640 1 -- 172.21.15.7:0/1570303606 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02403f030 con 0x7fb034102a60 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.721+0000 7fb039087640 1 -- 172.21.15.7:0/1570303606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0341a0640 con 0x7fb034102a60 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.721+0000 7fb01bfff640 1 -- 172.21.15.7:0/1570303606 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0240044c0 con 0x7fb034102a60 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.721+0000 7fb01bfff640 1 -- 172.21.15.7:0/1570303606 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024035070 con 0x7fb034102a60 2024-09-21T06:01:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.721+0000 7fb039087640 1 -- 172.21.15.7:0/1570303606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0341a6e00 con 0x7fb034102a60 2024-09-21T06:01:11.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb03f5fb740 1 Processor -- start 2024-09-21T06:01:11.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb03f5fb740 1 -- start start 2024-09-21T06:01:11.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb01bfff640 1 -- 172.21.15.7:0/1570303606 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb024042030 con 0x7fb034102a60 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb03f5fb740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599602c7350 0x55996066e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb03f5fb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 0x55996066e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb03f5fb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602a6670 0x55996066eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb03f5fb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5599605e4e60 con 0x55996029e490 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb03f5fb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5599605d4290 con 0x5599602a6670 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb03f5fb740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5599605d80a0 con 0x5599602c7350 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb032d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 0x55996066e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb032d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 0x55996066e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51260/0 (socket says 172.21.15.7:51260) 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb032d9d640 1 -- 172.21.15.7:0/3194544896 learned_addr learned my addr 172.21.15.7:0/3194544896 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb03259c640 1 --2- 172.21.15.7:0/3194544896 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602a6670 0x55996066eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.724+0000 7fb03359e640 1 --2- 172.21.15.7:0/3194544896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599602c7350 0x55996066e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.725+0000 7fb03259c640 1 -- 172.21.15.7:0/3194544896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599602c7350 msgr2=0x55996066e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.725+0000 7fb03259c640 1 --2- 172.21.15.7:0/3194544896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599602c7350 0x55996066e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.725+0000 7fb03259c640 1 -- 172.21.15.7:0/3194544896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 msgr2=0x55996066e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:11.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.725+0000 7fb03259c640 1 --2- 172.21.15.7:0/3194544896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 0x55996066e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.725+0000 7fb03259c640 1 -- 172.21.15.7:0/3194544896 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559960332930 con 0x5599602a6670 2024-09-21T06:01:11.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.725+0000 7fb032d9d640 1 --2- 172.21.15.7:0/3194544896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 0x55996066e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.725+0000 7fb01bfff640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb01c0b6680 0x7fb01c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.725+0000 7fb03259c640 1 --2- 172.21.15.7:0/3194544896 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602a6670 0x55996066eeb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb03406aaa0 tx=0x7fb0280118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbe5b89efde41c99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.725+0000 7fb03359e640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb01c0b6680 0x7fb01c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.725+0000 7fb01bfff640 1 -- 172.21.15.7:0/1570303606 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fb024107a80 con 0x7fb034102a60 2024-09-21T06:01:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.725+0000 7fb0197fa640 1 -- 172.21.15.7:0/3194544896 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028004030 con 0x5599602a6670 2024-09-21T06:01:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.725+0000 7fb0197fa640 1 -- 172.21.15.7:0/3194544896 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0280054d0 con 0x5599602a6670 2024-09-21T06:01:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.725+0000 7fb0197fa640 1 -- 172.21.15.7:0/3194544896 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028004ca0 con 0x5599602a6670 2024-09-21T06:01:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.726+0000 7fb03f5fb740 1 -- 172.21.15.7:0/3194544896 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602a6670 msgr2=0x55996066eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.726+0000 7fb03359e640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb01c0b6680 0x7fb01c0b8b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb02c005fd0 tx=0x7fb02c009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.726+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/3194544896 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602a6670 0x55996066eeb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb03406aaa0 tx=0x7fb0280118d0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.726+0000 7fb03f5fb740 1 -- 172.21.15.7:0/3194544896 shutdown_connections 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.726+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/3194544896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 0x55996066e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.726+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/3194544896 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602a6670 0x55996066eeb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.726+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/3194544896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599602c7350 0x55996066e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.726+0000 7fb03f5fb740 1 -- 172.21.15.7:0/3194544896 >> 172.21.15.7:0/3194544896 conn(0x5599602bb740 msgr2=0x55996066c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.726+0000 7fb03f5fb740 1 -- 172.21.15.7:0/3194544896 shutdown_connections 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.726+0000 7fb03f5fb740 1 -- 172.21.15.7:0/3194544896 wait complete. 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.727+0000 7fb03f5fb740 1 -- start start 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.727+0000 7fb03f5fb740 1 Processor -- start 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.727+0000 7fb03f5fb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 0x55996067a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.727+0000 7fb03f5fb740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599602a6670 0x55996067a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.727+0000 7fb03f5fb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602c7350 0x559960685f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.727+0000 7fb03f5fb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559960435890 con 0x55996029e490 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.727+0000 7fb03f5fb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55996056ed40 con 0x5599602c7350 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.727+0000 7fb03f5fb740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55996067cc10 con 0x5599602a6670 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.727+0000 7fb03f5fb740 10 client.0 _ll_register_callbacks cb 0x5599605d2c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.727+0000 7fb032d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 0x55996067a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.727+0000 7fb032d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 0x55996067a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51276/0 (socket says 172.21.15.7:51276) 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.727+0000 7fb032d9d640 1 -- 172.21.15.7:0/3076836665 learned_addr learned my addr 172.21.15.7:0/3076836665 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.727+0000 7fb03359e640 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602c7350 0x559960685f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb03259c640 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599602a6670 0x55996067a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb032d9d640 1 -- 172.21.15.7:0/3076836665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599602a6670 msgr2=0x55996067a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb032d9d640 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599602a6670 0x55996067a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb032d9d640 1 -- 172.21.15.7:0/3076836665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602c7350 msgr2=0x559960685f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb032d9d640 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602c7350 0x559960685f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb032d9d640 1 -- 172.21.15.7:0/3076836665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599606864a0 con 0x55996029e490 2024-09-21T06:01:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb03259c640 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599602a6670 0x55996067a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb032d9d640 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 0x55996067a060 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fb0240cd6a0 tx=0x7fb024005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db41a86b7a2d22f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb016ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb016ff5640 1 -- 172.21.15.7:0/3076836665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024049070 con 0x55996029e490 2024-09-21T06:01:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb016ff5640 1 -- 172.21.15.7:0/3076836665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fb0240d6e80 con 0x55996029e490 2024-09-21T06:01:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb03f5fb740 1 -- 172.21.15.7:0/3076836665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0280054d0 con 0x55996029e490 2024-09-21T06:01:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb016ff5640 1 -- 172.21.15.7:0/3076836665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb02410f040 con 0x55996029e490 2024-09-21T06:01:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb03f5fb740 10 client.17610 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.728+0000 7fb03f5fb740 1 -- 172.21.15.7:0/3076836665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559960688dd0 con 0x55996029e490 2024-09-21T06:01:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.729+0000 7fb016ff5640 1 -- 172.21.15.7:0/3076836665 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0280054d0 con 0x55996029e490 2024-09-21T06:01:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.729+0000 7fb016ff5640 1 -- 172.21.15.7:0/3076836665 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb0240c92f0 con 0x55996029e490 2024-09-21T06:01:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.729+0000 7fb03f5fb740 10 client.17610 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.729+0000 7fb03f5fb740 10 client.17610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.729+0000 7fb03f5fb740 20 client.17610 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.729+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559960285cd0 0x55996068c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.729+0000 7fb03f5fb740 4 client.17610 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.729+0000 7fb03f5fb740 1 -- 172.21.15.7:0/3076836665 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599605e6db0 con 0x559960285cd0 2024-09-21T06:01:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.729+0000 7fb03259c640 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559960285cd0 0x55996068c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.730+0000 7fb03259c640 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559960285cd0 0x55996068c2f0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c514933dff4ea491 server_cookie=9601919629f9924 in_seq=0 out_seq=0 2024-09-21T06:01:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.730+0000 7fb016ff5640 10 client.17610 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb016ff5640 1 -- 172.21.15.7:0/3076836665 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599605e6db0 con 0x559960285cd0 2024-09-21T06:01:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb016ff5640 10 client.17610 handle_command_reply: tid=0 2024-09-21T06:01:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb03f5fb740 1 client.17610 shutdown 2024-09-21T06:01:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb03f5fb740 1 -- 172.21.15.7:0/3076836665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 msgr2=0x55996067a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 0x55996067a060 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fb0240cd6a0 tx=0x7fb024005c90 comp rx=0 tx=0).stop 2024-09-21T06:01:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb03f5fb740 1 -- 172.21.15.7:0/3076836665 shutdown_connections 2024-09-21T06:01:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559960285cd0 0x55996068c2f0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602c7350 0x559960685f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5599602a6670 0x55996067a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb016ff5640 0 client.17610 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/3076836665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55996029e490 0x55996067a060 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb03f5fb740 1 -- 172.21.15.7:0/3076836665 >> 172.21.15.7:0/3076836665 conn(0x5599602bb740 msgr2=0x5599606715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb03f5fb740 1 -- 172.21.15.7:0/3076836665 shutdown_connections 2024-09-21T06:01:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb03f5fb740 1 -- 172.21.15.7:0/3076836665 wait complete. 2024-09-21T06:01:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.731+0000 7fb03f5fb740 20 client.17610 trim_cache size 0 max 16384 2024-09-21T06:01:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03f5fb740 1 Processor -- start 2024-09-21T06:01:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03f5fb740 1 -- start start 2024-09-21T06:01:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03f5fb740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55996029e490 0x559960685e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03f5fb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602a6670 0x559960671530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03f5fb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602c7350 0x559960671a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03f5fb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341b1ec0 con 0x5599602a6670 2024-09-21T06:01:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03f5fb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341af790 con 0x5599602c7350 2024-09-21T06:01:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03f5fb740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341ad600 con 0x55996029e490 2024-09-21T06:01:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602a6670 0x559960671530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602a6670 0x559960671530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51284/0 (socket says 172.21.15.7:51284) 2024-09-21T06:01:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03259c640 1 -- 172.21.15.7:0/664816411 learned_addr learned my addr 172.21.15.7:0/664816411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03359e640 1 --2- 172.21.15.7:0/664816411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602c7350 0x559960671a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb032d9d640 1 --2- 172.21.15.7:0/664816411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55996029e490 0x559960685e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03259c640 1 -- 172.21.15.7:0/664816411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55996029e490 msgr2=0x559960685e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03259c640 1 --2- 172.21.15.7:0/664816411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55996029e490 0x559960685e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03259c640 1 -- 172.21.15.7:0/664816411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602c7350 msgr2=0x559960671a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.749+0000 7fb03259c640 1 --2- 172.21.15.7:0/664816411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602c7350 0x559960671a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.750+0000 7fb03259c640 1 -- 172.21.15.7:0/664816411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559960670720 con 0x5599602a6670 2024-09-21T06:01:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.750+0000 7fb03259c640 1 --2- 172.21.15.7:0/664816411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602a6670 0x559960671530 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fb028009380 tx=0x7fb028009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03328599c733ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.750+0000 7fb018ff9640 1 -- 172.21.15.7:0/664816411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028033070 con 0x5599602a6670 2024-09-21T06:01:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.750+0000 7fb018ff9640 1 -- 172.21.15.7:0/664816411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb028005100 con 0x5599602a6670 2024-09-21T06:01:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.750+0000 7fb018ff9640 1 -- 172.21.15.7:0/664816411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02800f540 con 0x5599602a6670 2024-09-21T06:01:11.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.751+0000 7fb03f5fb740 1 -- 172.21.15.7:0/664816411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602a6670 msgr2=0x559960671530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:11.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.751+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/664816411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602a6670 0x559960671530 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fb028009380 tx=0x7fb028009310 comp rx=0 tx=0).stop 2024-09-21T06:01:11.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.751+0000 7fb03f5fb740 1 -- 172.21.15.7:0/664816411 shutdown_connections 2024-09-21T06:01:11.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.751+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/664816411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602a6670 0x559960671530 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.751+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/664816411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602c7350 0x559960671a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.751+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/664816411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55996029e490 0x559960685e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.751+0000 7fb03f5fb740 1 -- 172.21.15.7:0/664816411 >> 172.21.15.7:0/664816411 conn(0x5599602bb740 msgr2=0x5599606786e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.751+0000 7fb03f5fb740 1 -- 172.21.15.7:0/664816411 shutdown_connections 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.751+0000 7fb03f5fb740 1 -- 172.21.15.7:0/664816411 wait complete. 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.751+0000 7fb03f5fb740 1 -- start start 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.751+0000 7fb03f5fb740 1 Processor -- start 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03f5fb740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55996029e490 0x55996067e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03f5fb740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602a6670 0x55996067ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03f5fb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602c7350 0x5599606fa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03f5fb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341adc50 con 0x5599602c7350 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03f5fb740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341af0c0 con 0x5599602a6670 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03f5fb740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341ae320 con 0x55996029e490 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03f5fb740 10 client.0 _ll_register_callbacks cb 0x7fb024003f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:11.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03359e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602c7350 0x5599606fa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03359e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602c7350 0x5599606fa0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51288/0 (socket says 172.21.15.7:51288) 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03359e640 1 -- 172.21.15.7:0/2362491441 learned_addr learned my addr 172.21.15.7:0/2362491441 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03259c640 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602a6670 0x55996067ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb032d9d640 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55996029e490 0x55996067e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03359e640 1 -- 172.21.15.7:0/2362491441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55996029e490 msgr2=0x55996067e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03359e640 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55996029e490 0x55996067e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03359e640 1 -- 172.21.15.7:0/2362491441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602a6670 msgr2=0x55996067ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03359e640 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602a6670 0x55996067ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03359e640 1 -- 172.21.15.7:0/2362491441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599606fa6d0 con 0x5599602c7350 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb032d9d640 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55996029e490 0x55996067e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.752+0000 7fb03259c640 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602a6670 0x55996067ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb03359e640 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602c7350 0x5599606fa0c0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fb02c004610 tx=0x7fb02c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d112f71f27b0bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb016ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb016ff5640 1 -- 172.21.15.7:0/2362491441 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c004640 con 0x5599602c7350 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb016ff5640 1 -- 172.21.15.7:0/2362491441 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fb02c0047e0 con 0x5599602c7350 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb03f5fb740 1 -- 172.21.15.7:0/2362491441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb028005100 con 0x5599602c7350 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb016ff5640 1 -- 172.21.15.7:0/2362491441 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb02c004b20 con 0x5599602c7350 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb03f5fb740 10 client.17616 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb03f5fb740 1 -- 172.21.15.7:0/2362491441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5599606fba20 con 0x5599602c7350 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb016ff5640 1 -- 172.21.15.7:0/2362491441 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb028005100 con 0x5599602c7350 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb016ff5640 1 -- 172.21.15.7:0/2362491441 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb02c02f020 con 0x5599602c7350 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb03f5fb740 10 client.17616 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb03f5fb740 10 client.17616 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb03f5fb740 20 client.17616 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55996025b080 0x5599606fe290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb03f5fb740 4 client.17616 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.753+0000 7fb03f5fb740 1 -- 172.21.15.7:0/2362491441 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5599605e2860 con 0x55996025b080 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.754+0000 7fb032d9d640 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55996025b080 0x5599606fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.754+0000 7fb032d9d640 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55996025b080 0x5599606fe290 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b187f95de5f00ce server_cookie=efb706bcf35e71a8 in_seq=0 out_seq=0 2024-09-21T06:01:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.754+0000 7fb016ff5640 10 client.17616 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.756+0000 7fb016ff5640 1 -- 172.21.15.7:0/2362491441 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5599605e2860 con 0x55996025b080 2024-09-21T06:01:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.756+0000 7fb016ff5640 10 client.17616 handle_command_reply: tid=0 2024-09-21T06:01:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.756+0000 7fb03f5fb740 1 client.17616 shutdown 2024-09-21T06:01:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.756+0000 7fb03f5fb740 1 -- 172.21.15.7:0/2362491441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602c7350 msgr2=0x5599606fa0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.756+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602c7350 0x5599606fa0c0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fb02c004610 tx=0x7fb02c004a40 comp rx=0 tx=0).stop 2024-09-21T06:01:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.756+0000 7fb03f5fb740 1 -- 172.21.15.7:0/2362491441 shutdown_connections 2024-09-21T06:01:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.756+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55996025b080 0x5599606fe290 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.756+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599602c7350 0x5599606fa0c0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.756+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5599602a6670 0x55996067ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.756+0000 7fb016ff5640 0 client.17616 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.756+0000 7fb03f5fb740 1 --2- 172.21.15.7:0/2362491441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55996029e490 0x55996067e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.756+0000 7fb03f5fb740 1 -- 172.21.15.7:0/2362491441 >> 172.21.15.7:0/2362491441 conn(0x5599602bb740 msgr2=0x559960678470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb03f5fb740 1 -- 172.21.15.7:0/2362491441 shutdown_connections 2024-09-21T06:01:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb03f5fb740 1 -- 172.21.15.7:0/2362491441 wait complete. 2024-09-21T06:01:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb03f5fb740 20 client.17616 trim_cache size 0 max 16384 2024-09-21T06:01:11.762 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:01:11.762 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:01:11.762 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "fd9e7ebd-b70a-487f-937b-80b64378d04b", 2024-09-21T06:01:11.762 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:01:11.762 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:01:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb039087640 1 -- 172.21.15.7:0/1570303606 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb01c0b6680 msgr2=0x7fb01c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb039087640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb01c0b6680 0x7fb01c0b8b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb02c005fd0 tx=0x7fb02c009500 comp rx=0 tx=0).stop 2024-09-21T06:01:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb039087640 1 -- 172.21.15.7:0/1570303606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb034102a60 msgr2=0x7fb03419a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb039087640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb034102a60 0x7fb03419a440 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fb024005940 tx=0x7fb0240040c0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb039087640 1 -- 172.21.15.7:0/1570303606 shutdown_connections 2024-09-21T06:01:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb039087640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb01c0b6680 0x7fb01c0b8b90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb039087640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb034108cf0 0x7fb03419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb039087640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0341083a0 0x7fb03419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb039087640 1 --2- 172.21.15.7:0/1570303606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb034102a60 0x7fb03419a440 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb039087640 1 -- 172.21.15.7:0/1570303606 >> 172.21.15.7:0/1570303606 conn(0x7fb034079730 msgr2=0x7fb034101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb039087640 1 -- 172.21.15.7:0/1570303606 shutdown_connections 2024-09-21T06:01:11.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:11.757+0000 7fb039087640 1 -- 172.21.15.7:0/1570303606 wait complete. 2024-09-21T06:01:11.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:11 smithi027 ceph-mon[34364]: pgmap v540: 97 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 71 active+clean; 131 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:01:12.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:11 smithi007 ceph-mon[30983]: pgmap v540: 97 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 71 active+clean; 131 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:01:12.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:11 smithi119 ceph-mon[34833]: pgmap v540: 97 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 71 active+clean; 131 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:01:12.484 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:01:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:12.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:12 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:01:12.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:12 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:12.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:12 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:01:12.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:12 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:12.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:12 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:01:12.993 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:12 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:01:12.993 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:12 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:12.993 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:12 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:01:12.993 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:12 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:12.993 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:12 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:01:12.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:12 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:01:12.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:12 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:12.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:12 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:01:12.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:12 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:12.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:12 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:01:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.215+0000 7ff51d213640 1 -- 172.21.15.7:0/257425504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5181094a0 msgr2=0x7ff5181098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.216+0000 7ff51d213640 1 --2- 172.21.15.7:0/257425504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5181094a0 0x7ff5181098b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ff500009900 tx=0x7ff50002a410 comp rx=0 tx=0).stop 2024-09-21T06:01:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.216+0000 7ff51d213640 1 -- 172.21.15.7:0/257425504 shutdown_connections 2024-09-21T06:01:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.216+0000 7ff51d213640 1 --2- 172.21.15.7:0/257425504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5181094a0 0x7ff5181098b0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.216+0000 7ff51d213640 1 --2- 172.21.15.7:0/257425504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff518109df0 0x7ff518110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.216+0000 7ff51d213640 1 --2- 172.21.15.7:0/257425504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff518103b60 0x7ff518103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.216+0000 7ff51d213640 1 -- 172.21.15.7:0/257425504 >> 172.21.15.7:0/257425504 conn(0x7ff51807b850 msgr2=0x7ff51807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.216+0000 7ff51d213640 1 -- 172.21.15.7:0/257425504 shutdown_connections 2024-09-21T06:01:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.216+0000 7ff51d213640 1 -- 172.21.15.7:0/257425504 wait complete. 2024-09-21T06:01:13.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.216+0000 7ff51d213640 1 Processor -- start 2024-09-21T06:01:13.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff51d213640 1 -- start start 2024-09-21T06:01:13.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff51d213640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff518103b60 0x7ff51819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff51d213640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5181094a0 0x7ff51819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff51d213640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff518109df0 0x7ff5181a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff51d213640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff518113ab0 con 0x7ff518103b60 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff51d213640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff518113930 con 0x7ff518109df0 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff51d213640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff518113c30 con 0x7ff5181094a0 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff516d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff518103b60 0x7ff51819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff516d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff518103b60 0x7ff51819c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51300/0 (socket says 172.21.15.7:51300) 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff516d9d640 1 -- 172.21.15.7:0/2390390261 learned_addr learned my addr 172.21.15.7:0/2390390261 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff51759e640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff518109df0 0x7ff5181a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff50ffff640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5181094a0 0x7ff51819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff516d9d640 1 -- 172.21.15.7:0/2390390261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5181094a0 msgr2=0x7ff51819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff516d9d640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5181094a0 0x7ff51819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff516d9d640 1 -- 172.21.15.7:0/2390390261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff518109df0 msgr2=0x7ff5181a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff516d9d640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff518109df0 0x7ff5181a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff516d9d640 1 -- 172.21.15.7:0/2390390261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5181a2610 con 0x7ff518103b60 2024-09-21T06:01:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.217+0000 7ff51759e640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff518109df0 0x7ff5181a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.218+0000 7ff516d9d640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff518103b60 0x7ff51819c6a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7ff50800d770 tx=0x7ff50800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.218+0000 7ff514d99640 1 -- 172.21.15.7:0/2390390261 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff508017070 con 0x7ff518103b60 2024-09-21T06:01:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.218+0000 7ff514d99640 1 -- 172.21.15.7:0/2390390261 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5080054d0 con 0x7ff518103b60 2024-09-21T06:01:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.218+0000 7ff514d99640 1 -- 172.21.15.7:0/2390390261 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff508004c30 con 0x7ff518103b60 2024-09-21T06:01:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.218+0000 7ff51d213640 1 -- 172.21.15.7:0/2390390261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5181a2900 con 0x7ff518103b60 2024-09-21T06:01:13.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.218+0000 7ff51d213640 1 -- 172.21.15.7:0/2390390261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5181a9060 con 0x7ff518103b60 2024-09-21T06:01:13.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.221+0000 7ff523787740 1 Processor -- start 2024-09-21T06:01:13.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.221+0000 7ff523787740 1 -- start start 2024-09-21T06:01:13.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.221+0000 7ff514d99640 1 -- 172.21.15.7:0/2390390261 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff508004e10 con 0x7ff518103b60 2024-09-21T06:01:13.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.221+0000 7ff523787740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86728c070 0x55b867633650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.221+0000 7ff523787740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 0x55b867633b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.221+0000 7ff523787740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 0x55b8676340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.221+0000 7ff523787740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b8675a9e50 con 0x55b86726b390 2024-09-21T06:01:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.221+0000 7ff523787740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b867599280 con 0x55b8672631b0 2024-09-21T06:01:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.221+0000 7ff523787740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b86759d090 con 0x55b86728c070 2024-09-21T06:01:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.221+0000 7ff50ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 0x55b8676340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.221+0000 7ff50ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 0x55b8676340d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51314/0 (socket says 172.21.15.7:51314) 2024-09-21T06:01:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.221+0000 7ff50ffff640 1 -- 172.21.15.7:0/3529672367 learned_addr learned my addr 172.21.15.7:0/3529672367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.221+0000 7ff51759e640 1 --2- 172.21.15.7:0/3529672367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86728c070 0x55b867633650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.222+0000 7ff516d9d640 1 --2- 172.21.15.7:0/3529672367 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 0x55b867633b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.222+0000 7ff50ffff640 1 -- 172.21.15.7:0/3529672367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86728c070 msgr2=0x55b867633650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.222+0000 7ff50ffff640 1 --2- 172.21.15.7:0/3529672367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86728c070 0x55b867633650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.222+0000 7ff50ffff640 1 -- 172.21.15.7:0/3529672367 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 msgr2=0x55b867633b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.222+0000 7ff50ffff640 1 --2- 172.21.15.7:0/3529672367 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 0x55b867633b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.222+0000 7ff50ffff640 1 -- 172.21.15.7:0/3529672367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8672f7650 con 0x55b86726b390 2024-09-21T06:01:13.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.222+0000 7ff514d99640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5040b6700 0x7ff5040b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.222+0000 7ff50ffff640 1 --2- 172.21.15.7:0/3529672367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 0x55b8676340d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7ff500000c00 tx=0x7ff500032ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0c90e6c7c96f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:13.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.222+0000 7ff51759e640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5040b6700 0x7ff5040b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.222+0000 7ff50d7fa640 1 -- 172.21.15.7:0/3529672367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50003f070 con 0x55b86726b390 2024-09-21T06:01:13.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.222+0000 7ff514d99640 1 -- 172.21.15.7:0/2390390261 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7ff5080e70e0 con 0x7ff518103b60 2024-09-21T06:01:13.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.223+0000 7ff50d7fa640 1 -- 172.21.15.7:0/3529672367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff500004030 con 0x55b86726b390 2024-09-21T06:01:13.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.223+0000 7ff50d7fa640 1 -- 172.21.15.7:0/3529672367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500035070 con 0x55b86726b390 2024-09-21T06:01:13.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.223+0000 7ff523787740 1 -- 172.21.15.7:0/3529672367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 msgr2=0x55b8676340d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.223+0000 7ff51759e640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5040b6700 0x7ff5040b8c10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff510009fd0 tx=0x7ff510009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.223+0000 7ff523787740 1 --2- 172.21.15.7:0/3529672367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 0x55b8676340d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7ff500000c00 tx=0x7ff500032ba0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 -- 172.21.15.7:0/3529672367 shutdown_connections 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 --2- 172.21.15.7:0/3529672367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 0x55b8676340d0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 --2- 172.21.15.7:0/3529672367 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 0x55b867633b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 --2- 172.21.15.7:0/3529672367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86728c070 0x55b867633650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 -- 172.21.15.7:0/3529672367 >> 172.21.15.7:0/3529672367 conn(0x55b867280460 msgr2=0x55b867631540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 -- 172.21.15.7:0/3529672367 shutdown_connections 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 -- 172.21.15.7:0/3529672367 wait complete. 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 -- start start 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 Processor -- start 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 0x55b86763ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86726b390 0x55b86763f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 0x55b86764b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b8673fa700 con 0x55b86728c070 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55b867534110 con 0x55b8672631b0 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55b867641dd0 con 0x55b86726b390 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.224+0000 7ff523787740 10 client.0 _ll_register_callbacks cb 0x55b86754d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff51759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 0x55b86764b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff51759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 0x55b86764b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51330/0 (socket says 172.21.15.7:51330) 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff51759e640 1 -- 172.21.15.7:0/2287280529 learned_addr learned my addr 172.21.15.7:0/2287280529 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff516d9d640 1 --2- 172.21.15.7:0/2287280529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 0x55b86763ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff50ffff640 1 --2- 172.21.15.7:0/2287280529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86726b390 0x55b86763f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff51759e640 1 -- 172.21.15.7:0/2287280529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86726b390 msgr2=0x55b86763f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff51759e640 1 --2- 172.21.15.7:0/2287280529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86726b390 0x55b86763f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff51759e640 1 -- 172.21.15.7:0/2287280529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 msgr2=0x55b86763ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff51759e640 1 --2- 172.21.15.7:0/2287280529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 0x55b86763ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff51759e640 1 -- 172.21.15.7:0/2287280529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b867561c40 con 0x55b86728c070 2024-09-21T06:01:13.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff51759e640 1 --2- 172.21.15.7:0/2287280529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 0x55b86764b0c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff510003e20 tx=0x7ff510004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3103fad0347fa5b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff4fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/2287280529 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510004550 con 0x55b86728c070 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/2287280529 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7ff510018030 con 0x55b86728c070 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.225+0000 7ff523787740 1 -- 172.21.15.7:0/2287280529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff500004030 con 0x55b86728c070 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.226+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/2287280529 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff5100046f0 con 0x55b86728c070 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.226+0000 7ff523787740 10 client.17628 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.226+0000 7ff523787740 1 -- 172.21.15.7:0/2287280529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b86764dba0 con 0x55b86728c070 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.226+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/2287280529 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff500004030 con 0x55b86728c070 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.226+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/2287280529 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff51002f070 con 0x55b86728c070 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.226+0000 7ff523787740 10 client.17628 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.226+0000 7ff523787740 10 client.17628 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.226+0000 7ff523787740 20 client.17628 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.226+0000 7ff523787740 1 --2- 172.21.15.7:0/2287280529 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b86724a9f0 0x55b8676511a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.226+0000 7ff523787740 4 client.17628 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:13.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.226+0000 7ff523787740 1 -- 172.21.15.7:0/2287280529 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8675abda0 con 0x55b86724a9f0 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.226+0000 7ff516d9d640 1 --2- 172.21.15.7:0/2287280529 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b86724a9f0 0x55b8676511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.227+0000 7ff4fe7fc640 10 client.17628 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.227+0000 7ff516d9d640 1 --2- 172.21.15.7:0/2287280529 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b86724a9f0 0x55b8676511a0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91f640f1b46cbb92 server_cookie=64da294eca34cbe2 in_seq=0 out_seq=0 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/2287280529 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b8675abda0 con 0x55b86724a9f0 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff4fe7fc640 10 client.17628 handle_command_reply: tid=0 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff523787740 1 client.17628 shutdown 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff523787740 1 -- 172.21.15.7:0/2287280529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 msgr2=0x55b86764b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff523787740 1 --2- 172.21.15.7:0/2287280529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 0x55b86764b0c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff510003e20 tx=0x7ff510004ab0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff523787740 1 -- 172.21.15.7:0/2287280529 shutdown_connections 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff523787740 1 --2- 172.21.15.7:0/2287280529 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b86724a9f0 0x55b8676511a0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff523787740 1 --2- 172.21.15.7:0/2287280529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 0x55b86764b0c0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff523787740 1 --2- 172.21.15.7:0/2287280529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86726b390 0x55b86763f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff4fe7fc640 0 client.17628 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff523787740 1 --2- 172.21.15.7:0/2287280529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 0x55b86763ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff523787740 1 -- 172.21.15.7:0/2287280529 >> 172.21.15.7:0/2287280529 conn(0x55b867280460 msgr2=0x55b8676367e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:13.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff523787740 1 -- 172.21.15.7:0/2287280529 shutdown_connections 2024-09-21T06:01:13.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff523787740 1 -- 172.21.15.7:0/2287280529 wait complete. 2024-09-21T06:01:13.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.228+0000 7ff523787740 20 client.17628 trim_cache size 0 max 16384 2024-09-21T06:01:13.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.245+0000 7ff523787740 1 Processor -- start 2024-09-21T06:01:13.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.246+0000 7ff523787740 1 -- start start 2024-09-21T06:01:13.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.246+0000 7ff523787740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 0x55b867635040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.246+0000 7ff523787740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86726b390 0x55b867640980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.246+0000 7ff523787740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 0x55b867630b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.246+0000 7ff523787740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5181b4140 con 0x55b86728c070 2024-09-21T06:01:13.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.246+0000 7ff523787740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff5181b1a10 con 0x55b8672631b0 2024-09-21T06:01:13.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.246+0000 7ff523787740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff5181af880 con 0x55b86726b390 2024-09-21T06:01:13.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.246+0000 7ff51759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 0x55b867630b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.246+0000 7ff51759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 0x55b867630b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51346/0 (socket says 172.21.15.7:51346) 2024-09-21T06:01:13.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.246+0000 7ff51759e640 1 -- 172.21.15.7:0/1570650665 learned_addr learned my addr 172.21.15.7:0/1570650665 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:13.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.246+0000 7ff516d9d640 1 --2- 172.21.15.7:0/1570650665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 0x55b867635040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.246+0000 7ff50ffff640 1 --2- 172.21.15.7:0/1570650665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86726b390 0x55b867640980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.247+0000 7ff51759e640 1 -- 172.21.15.7:0/1570650665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86726b390 msgr2=0x55b867640980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.247+0000 7ff51759e640 1 --2- 172.21.15.7:0/1570650665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86726b390 0x55b867640980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.247+0000 7ff51759e640 1 -- 172.21.15.7:0/1570650665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 msgr2=0x55b867635040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.247+0000 7ff51759e640 1 --2- 172.21.15.7:0/1570650665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 0x55b867635040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.247+0000 7ff51759e640 1 -- 172.21.15.7:0/1570650665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b867635c10 con 0x55b86728c070 2024-09-21T06:01:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.247+0000 7ff516d9d640 1 --2- 172.21.15.7:0/1570650665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 0x55b867635040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.247+0000 7ff51759e640 1 --2- 172.21.15.7:0/1570650665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 0x55b867630b70 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff510028470 tx=0x7ff510005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6536c1764700d81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.247+0000 7ff50cff9640 1 -- 172.21.15.7:0/1570650665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510035030 con 0x55b86728c070 2024-09-21T06:01:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.247+0000 7ff50cff9640 1 -- 172.21.15.7:0/1570650665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff510004890 con 0x55b86728c070 2024-09-21T06:01:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.247+0000 7ff50cff9640 1 -- 172.21.15.7:0/1570650665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5100115c0 con 0x55b86728c070 2024-09-21T06:01:13.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.248+0000 7ff523787740 1 -- 172.21.15.7:0/1570650665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 msgr2=0x55b867630b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.248+0000 7ff523787740 1 --2- 172.21.15.7:0/1570650665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 0x55b867630b70 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff510028470 tx=0x7ff510005f90 comp rx=0 tx=0).stop 2024-09-21T06:01:13.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.248+0000 7ff523787740 1 -- 172.21.15.7:0/1570650665 shutdown_connections 2024-09-21T06:01:13.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.248+0000 7ff523787740 1 --2- 172.21.15.7:0/1570650665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86728c070 0x55b867630b70 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.248+0000 7ff523787740 1 --2- 172.21.15.7:0/1570650665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b86726b390 0x55b867640980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.248+0000 7ff523787740 1 --2- 172.21.15.7:0/1570650665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8672631b0 0x55b867635040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.248+0000 7ff523787740 1 -- 172.21.15.7:0/1570650665 >> 172.21.15.7:0/1570650665 conn(0x55b867280460 msgr2=0x55b867640270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.248+0000 7ff523787740 1 -- 172.21.15.7:0/1570650665 shutdown_connections 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.248+0000 7ff523787740 1 -- 172.21.15.7:0/1570650665 wait complete. 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.248+0000 7ff523787740 1 -- start start 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.249+0000 7ff523787740 1 Processor -- start 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.249+0000 7ff523787740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8672631b0 0x55b867647720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.249+0000 7ff523787740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 0x55b867642bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.249+0000 7ff523787740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b86728c070 0x55b867643110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.249+0000 7ff523787740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5181afed0 con 0x55b86726b390 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.249+0000 7ff523787740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff5181b1340 con 0x55b86728c070 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.249+0000 7ff523787740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff5181b05a0 con 0x55b8672631b0 2024-09-21T06:01:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.249+0000 7ff523787740 10 client.0 _ll_register_callbacks cb 0x7ff510012070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.249+0000 7ff50ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 0x55b867642bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.249+0000 7ff50ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 0x55b867642bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51358/0 (socket says 172.21.15.7:51358) 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.249+0000 7ff50ffff640 1 -- 172.21.15.7:0/2683358706 learned_addr learned my addr 172.21.15.7:0/2683358706 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.249+0000 7ff516d9d640 1 --2- 172.21.15.7:0/2683358706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8672631b0 0x55b867647720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.249+0000 7ff51759e640 1 --2- 172.21.15.7:0/2683358706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b86728c070 0x55b867643110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff50ffff640 1 -- 172.21.15.7:0/2683358706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8672631b0 msgr2=0x55b867647720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff50ffff640 1 --2- 172.21.15.7:0/2683358706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8672631b0 0x55b867647720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff50ffff640 1 -- 172.21.15.7:0/2683358706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b86728c070 msgr2=0x55b867643110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff50ffff640 1 --2- 172.21.15.7:0/2683358706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b86728c070 0x55b867643110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff50ffff640 1 -- 172.21.15.7:0/2683358706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8676437b0 con 0x55b86726b390 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff50ffff640 1 --2- 172.21.15.7:0/2683358706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 0x55b867642bd0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff500031440 tx=0x7ff500032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f128fb7daeb117d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff4fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/2683358706 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500052060 con 0x55b86726b390 2024-09-21T06:01:13.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/2683358706 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7ff5000318b0 con 0x55b86726b390 2024-09-21T06:01:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff523787740 1 -- 172.21.15.7:0/2683358706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff510004890 con 0x55b86726b390 2024-09-21T06:01:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/2683358706 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff500035050 con 0x55b86726b390 2024-09-21T06:01:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff523787740 10 client.17634 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff523787740 1 -- 172.21.15.7:0/2683358706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b8676bb9c0 con 0x55b86726b390 2024-09-21T06:01:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.250+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/2683358706 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff510004890 con 0x55b86726b390 2024-09-21T06:01:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.251+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/2683358706 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff50004c070 con 0x55b86726b390 2024-09-21T06:01:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.251+0000 7ff523787740 10 client.17634 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.251+0000 7ff523787740 10 client.17634 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.251+0000 7ff523787740 20 client.17634 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.251+0000 7ff523787740 1 --2- 172.21.15.7:0/2683358706 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b86721fda0 0x55b8676bdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.251+0000 7ff523787740 4 client.17634 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.251+0000 7ff523787740 1 -- 172.21.15.7:0/2683358706 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b8675a7850 con 0x55b86721fda0 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.251+0000 7ff516d9d640 1 --2- 172.21.15.7:0/2683358706 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b86721fda0 0x55b8676bdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff516d9d640 1 --2- 172.21.15.7:0/2683358706 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b86721fda0 0x55b8676bdd00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12d012aa69b2f9bc server_cookie=5cac8bcf157053a in_seq=0 out_seq=0 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff4fe7fc640 10 client.17634 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/2683358706 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x55b8675a7850 con 0x55b86721fda0 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff4fe7fc640 10 client.17634 handle_command_reply: tid=0 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff523787740 1 client.17634 shutdown 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff523787740 1 -- 172.21.15.7:0/2683358706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 msgr2=0x55b867642bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff523787740 1 --2- 172.21.15.7:0/2683358706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 0x55b867642bd0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff500031440 tx=0x7ff500032fc0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff523787740 1 -- 172.21.15.7:0/2683358706 shutdown_connections 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff523787740 1 --2- 172.21.15.7:0/2683358706 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55b86721fda0 0x55b8676bdd00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff523787740 1 --2- 172.21.15.7:0/2683358706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b86726b390 0x55b867642bd0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff523787740 1 --2- 172.21.15.7:0/2683358706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b86728c070 0x55b867643110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff523787740 1 --2- 172.21.15.7:0/2683358706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55b8672631b0 0x55b867647720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff523787740 1 -- 172.21.15.7:0/2683358706 >> 172.21.15.7:0/2683358706 conn(0x55b867280460 msgr2=0x55b867634e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:13.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff4fe7fc640 0 client.17634 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:13.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff523787740 1 -- 172.21.15.7:0/2683358706 shutdown_connections 2024-09-21T06:01:13.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff523787740 1 -- 172.21.15.7:0/2683358706 wait complete. 2024-09-21T06:01:13.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.252+0000 7ff523787740 20 client.17634 trim_cache size 0 max 16384 2024-09-21T06:01:13.260 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:01:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:01:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:01:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:01:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "fd9e7ebd-b70a-487f-937b-80b64378d04b": { 2024-09-21T06:01:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:11.755521+0000", 2024-09-21T06:01:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "3bd778db-a0ed-42ad-8a79-14a200f0734e": { 2024-09-21T06:01:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:51.556015+0000", 2024-09-21T06:01:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:01:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:01:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:01:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:01:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:01:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "ecf3518d-a174-4cee-89a1-6aa26e1b3442": { 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:01.909762+0000", 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:01:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:01:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:01:13.272 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:01:13.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.253+0000 7ff51d213640 1 -- 172.21.15.7:0/2390390261 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5040b6700 msgr2=0x7ff5040b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.253+0000 7ff51d213640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5040b6700 0x7ff5040b8c10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff510009fd0 tx=0x7ff510009500 comp rx=0 tx=0).stop 2024-09-21T06:01:13.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.253+0000 7ff51d213640 1 -- 172.21.15.7:0/2390390261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff518103b60 msgr2=0x7ff51819c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.253+0000 7ff51d213640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff518103b60 0x7ff51819c6a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7ff50800d770 tx=0x7ff50800dc30 comp rx=0 tx=0).stop 2024-09-21T06:01:13.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.253+0000 7ff51d213640 1 -- 172.21.15.7:0/2390390261 shutdown_connections 2024-09-21T06:01:13.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.253+0000 7ff51d213640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5040b6700 0x7ff5040b8c10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.253+0000 7ff51d213640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff518109df0 0x7ff5181a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.253+0000 7ff51d213640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5181094a0 0x7ff51819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.253+0000 7ff51d213640 1 --2- 172.21.15.7:0/2390390261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff518103b60 0x7ff51819c6a0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.253+0000 7ff51d213640 1 -- 172.21.15.7:0/2390390261 >> 172.21.15.7:0/2390390261 conn(0x7ff51807b850 msgr2=0x7ff518105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:13.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.253+0000 7ff51d213640 1 -- 172.21.15.7:0/2390390261 shutdown_connections 2024-09-21T06:01:13.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:13.253+0000 7ff51d213640 1 -- 172.21.15.7:0/2390390261 wait complete. 2024-09-21T06:01:13.976 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:13 smithi027 ceph-mon[34364]: pgmap v541: 97 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 71 active+clean; 111 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:01:14.003 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:13 smithi007 ceph-mon[30983]: pgmap v541: 97 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 71 active+clean; 111 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:01:14.035 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:01:14.036 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:01:14.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:13 smithi119 ceph-mon[34833]: pgmap v541: 97 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 71 active+clean; 111 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:01:14.296 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.782+0000 7f7fe819e640 1 -- 172.21.15.7:0/3681203083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe0108cf0 msgr2=0x7f7fe010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.782+0000 7f7fe819e640 1 --2- 172.21.15.7:0/3681203083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe0108cf0 0x7f7fe010f520 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009ca0 tx=0x7f7fd802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.782+0000 7f7fe819e640 1 -- 172.21.15.7:0/3681203083 shutdown_connections 2024-09-21T06:01:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.782+0000 7f7fe819e640 1 --2- 172.21.15.7:0/3681203083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe0108cf0 0x7f7fe010f520 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.782+0000 7f7fe819e640 1 --2- 172.21.15.7:0/3681203083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01083a0 0x7f7fe01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.782+0000 7f7fe819e640 1 --2- 172.21.15.7:0/3681203083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fe0102a60 0x7f7fe0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.782+0000 7f7fe819e640 1 -- 172.21.15.7:0/3681203083 >> 172.21.15.7:0/3681203083 conn(0x7f7fe0079730 msgr2=0x7f7fe0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.782+0000 7f7fe819e640 1 -- 172.21.15.7:0/3681203083 shutdown_connections 2024-09-21T06:01:14.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.782+0000 7f7fe819e640 1 -- 172.21.15.7:0/3681203083 wait complete. 2024-09-21T06:01:14.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe819e640 1 Processor -- start 2024-09-21T06:01:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe819e640 1 -- start start 2024-09-21T06:01:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe819e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fe0102a60 0x7f7fe0199000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe819e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01083a0 0x7f7fe0199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe819e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe0108cf0 0x7f7fe0199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe819e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe0112960 con 0x7f7fe0108cf0 2024-09-21T06:01:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe819e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe01127e0 con 0x7f7fe0102a60 2024-09-21T06:01:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe819e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe0112ae0 con 0x7f7fe01083a0 2024-09-21T06:01:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe673b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe0108cf0 0x7f7fe0199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe673b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe0108cf0 0x7f7fe0199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51372/0 (socket says 172.21.15.7:51372) 2024-09-21T06:01:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe673b640 1 -- 172.21.15.7:0/911239501 learned_addr learned my addr 172.21.15.7:0/911239501 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe5f3a640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fe0102a60 0x7f7fe0199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe5739640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01083a0 0x7f7fe0199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe673b640 1 -- 172.21.15.7:0/911239501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01083a0 msgr2=0x7f7fe0199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe673b640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01083a0 0x7f7fe0199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe673b640 1 -- 172.21.15.7:0/911239501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fe0102a60 msgr2=0x7f7fe0199000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe673b640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fe0102a60 0x7f7fe0199000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe673b640 1 -- 172.21.15.7:0/911239501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe01a86b0 con 0x7f7fe0108cf0 2024-09-21T06:01:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.783+0000 7f7fe5739640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01083a0 0x7f7fe0199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.784+0000 7f7fe673b640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe0108cf0 0x7f7fe0199a80 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8005cc0 tx=0x7f7fd802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.784+0000 7f7fd6ffd640 1 -- 172.21.15.7:0/911239501 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8003bf0 con 0x7f7fe0108cf0 2024-09-21T06:01:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.784+0000 7f7fd6ffd640 1 -- 172.21.15.7:0/911239501 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fd8003d90 con 0x7f7fe0108cf0 2024-09-21T06:01:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.784+0000 7f7fe819e640 1 -- 172.21.15.7:0/911239501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe01a8940 con 0x7f7fe0108cf0 2024-09-21T06:01:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.784+0000 7f7fd6ffd640 1 -- 172.21.15.7:0/911239501 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd802fbc0 con 0x7f7fe0108cf0 2024-09-21T06:01:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.784+0000 7f7fe819e640 1 -- 172.21.15.7:0/911239501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe01a8e80 con 0x7f7fe0108cf0 2024-09-21T06:01:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.785+0000 7f7fe819e640 1 -- 172.21.15.7:0/911239501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe0102e70 con 0x7f7fe0108cf0 2024-09-21T06:01:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.787+0000 7f7fd6ffd640 1 -- 172.21.15.7:0/911239501 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7fd802fd60 con 0x7f7fe0108cf0 2024-09-21T06:01:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.788+0000 7f7fd6ffd640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7fcc0b6680 0x7f7fcc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.788+0000 7f7fe5f3a640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7fcc0b6680 0x7f7fcc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.788+0000 7f7fd6ffd640 1 -- 172.21.15.7:0/911239501 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f7fd8108e30 con 0x7f7fe0108cf0 2024-09-21T06:01:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.788+0000 7f7fe5f3a640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7fcc0b6680 0x7f7fcc0b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0106000 tx=0x7f7fdc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:14.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:14.791+0000 7f7fd6ffd640 1 -- 172.21.15.7:0/911239501 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7fd80cf340 con 0x7f7fe0108cf0 2024-09-21T06:01:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.018+0000 7f7fe819e640 1 -- 172.21.15.7:0/911239501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fe006b270 con 0x7f7fe0108cf0 2024-09-21T06:01:15.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.019+0000 7f7fd6ffd640 1 -- 172.21.15.7:0/911239501 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f7fe006b270 con 0x7f7fe0108cf0 2024-09-21T06:01:15.021 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:01:15.021 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:01:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:01:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.021+0000 7f7fe819e640 1 -- 172.21.15.7:0/911239501 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7fcc0b6680 msgr2=0x7f7fcc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.021+0000 7f7fe819e640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7fcc0b6680 0x7f7fcc0b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0106000 tx=0x7f7fdc00b390 comp rx=0 tx=0).stop 2024-09-21T06:01:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.021+0000 7f7fe819e640 1 -- 172.21.15.7:0/911239501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe0108cf0 msgr2=0x7f7fe0199a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.021+0000 7f7fe819e640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe0108cf0 0x7f7fe0199a80 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8005cc0 tx=0x7f7fd802f380 comp rx=0 tx=0).stop 2024-09-21T06:01:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.021+0000 7f7fe819e640 1 -- 172.21.15.7:0/911239501 shutdown_connections 2024-09-21T06:01:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.021+0000 7f7fe819e640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7fcc0b6680 0x7f7fcc0b8b90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.021+0000 7f7fe819e640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fe0108cf0 0x7f7fe0199a80 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.021+0000 7f7fe819e640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01083a0 0x7f7fe0199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.021+0000 7f7fe819e640 1 --2- 172.21.15.7:0/911239501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7fe0102a60 0x7f7fe0199000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.021+0000 7f7fe819e640 1 -- 172.21.15.7:0/911239501 >> 172.21.15.7:0/911239501 conn(0x7f7fe0079730 msgr2=0x7f7fe01043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.021+0000 7f7fe819e640 1 -- 172.21.15.7:0/911239501 shutdown_connections 2024-09-21T06:01:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:15.021+0000 7f7fe819e640 1 -- 172.21.15.7:0/911239501 wait complete. 2024-09-21T06:01:15.626 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:01:15.887 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:16.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:15 smithi007 ceph-mon[30983]: pgmap v542: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 14 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:01:16.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:15 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/911239501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:16.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:15 smithi119 ceph-mon[34833]: pgmap v542: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 14 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:01:16.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:15 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/911239501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:16.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:15 smithi027 ceph-mon[34364]: pgmap v542: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 14 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:01:16.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:15 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/911239501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.332+0000 7f9f16536640 1 -- 172.21.15.7:0/3866905449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f10103b80 msgr2=0x7f9f10103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.332+0000 7f9f16536640 1 --2- 172.21.15.7:0/3866905449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f10103b80 0x7f9f10103f90 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009900 tx=0x7f9f0002a410 comp rx=0 tx=0).stop 2024-09-21T06:01:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.332+0000 7f9f16536640 1 -- 172.21.15.7:0/3866905449 shutdown_connections 2024-09-21T06:01:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.332+0000 7f9f16536640 1 --2- 172.21.15.7:0/3866905449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f10109e10 0x7f9f10110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.332+0000 7f9f16536640 1 --2- 172.21.15.7:0/3866905449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f101094c0 0x7f9f101098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.332+0000 7f9f16536640 1 --2- 172.21.15.7:0/3866905449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f10103b80 0x7f9f10103f90 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.332+0000 7f9f16536640 1 -- 172.21.15.7:0/3866905449 >> 172.21.15.7:0/3866905449 conn(0x7f9f100ff5d0 msgr2=0x7f9f10101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.332+0000 7f9f16536640 1 -- 172.21.15.7:0/3866905449 shutdown_connections 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.333+0000 7f9f16536640 1 -- 172.21.15.7:0/3866905449 wait complete. 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.333+0000 7f9f16536640 1 Processor -- start 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.333+0000 7f9f16536640 1 -- start start 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f16536640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f10103b80 0x7f9f1019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f16536640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f101094c0 0x7f9f1019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f16536640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f10109e10 0x7f9f1019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f16536640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f10113b50 con 0x7f9f10109e10 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f16536640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9f101139d0 con 0x7f9f101094c0 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f16536640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9f10113cd0 con 0x7f9f10103b80 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f14ad3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f10109e10 0x7f9f1019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f14ad3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f10109e10 0x7f9f1019fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51390/0 (socket says 172.21.15.7:51390) 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f14ad3640 1 -- 172.21.15.7:0/3483456339 learned_addr learned my addr 172.21.15.7:0/3483456339 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f0ffff640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f10103b80 0x7f9f1019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f101094c0 0x7f9f1019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f14ad3640 1 -- 172.21.15.7:0/3483456339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f10103b80 msgr2=0x7f9f1019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f14ad3640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f10103b80 0x7f9f1019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f14ad3640 1 -- 172.21.15.7:0/3483456339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f101094c0 msgr2=0x7f9f1019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f14ad3640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f101094c0 0x7f9f1019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f14ad3640 1 -- 172.21.15.7:0/3483456339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f101a0490 con 0x7f9f10109e10 2024-09-21T06:01:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f0ffff640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f10103b80 0x7f9f1019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f14ad3640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f10109e10 0x7f9f1019fd60 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800b970 tx=0x7f9f0800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.334+0000 7f9f0d7fa640 1 -- 172.21.15.7:0/3483456339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08019070 con 0x7f9f10109e10 2024-09-21T06:01:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.335+0000 7f9f0d7fa640 1 -- 172.21.15.7:0/3483456339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f08014440 con 0x7f9f10109e10 2024-09-21T06:01:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.335+0000 7f9f16536640 1 -- 172.21.15.7:0/3483456339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f101a0780 con 0x7f9f10109e10 2024-09-21T06:01:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.335+0000 7f9f0d7fa640 1 -- 172.21.15.7:0/3483456339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f080075d0 con 0x7f9f10109e10 2024-09-21T06:01:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.335+0000 7f9f16536640 1 -- 172.21.15.7:0/3483456339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f101a6ee0 con 0x7f9f10109e10 2024-09-21T06:01:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.337+0000 7f9f1caaa740 1 Processor -- start 2024-09-21T06:01:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.337+0000 7f9f0d7fa640 1 -- 172.21.15.7:0/3483456339 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9f0801c070 con 0x7f9f10109e10 2024-09-21T06:01:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.337+0000 7f9f1caaa740 1 -- start start 2024-09-21T06:01:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f1caaa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade263070 0x558ade60a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f1caaa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade23a1b0 0x558ade60a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f1caaa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade242390 0x558ade60ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f1caaa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558ade580ea0 con 0x558ade242390 2024-09-21T06:01:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f1caaa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558ade5702d0 con 0x558ade23a1b0 2024-09-21T06:01:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f1caaa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558ade5740e0 con 0x558ade263070 2024-09-21T06:01:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade242390 0x558ade60ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade242390 0x558ade60ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51406/0 (socket says 172.21.15.7:51406) 2024-09-21T06:01:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/2034001034 learned_addr learned my addr 172.21.15.7:0/2034001034 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f0ffff640 1 --2- 172.21.15.7:0/2034001034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade23a1b0 0x558ade60a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/2034001034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade263070 0x558ade60a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f0d7fa640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9ef80b6680 0x7f9ef80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/2034001034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade263070 msgr2=0x558ade60a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/2034001034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade263070 0x558ade60a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/2034001034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade23a1b0 msgr2=0x558ade60a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/2034001034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade23a1b0 0x558ade60a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/2034001034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ade2ce650 con 0x558ade242390 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.338+0000 7f9f14ad3640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9ef80b6680 0x7f9ef80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.339+0000 7f9f0d7fa640 1 -- 172.21.15.7:0/3483456339 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f9f080e6cb0 con 0x7f9f10109e10 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.339+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/2034001034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade242390 0x558ade60ad40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f9f04010370 tx=0x7f9f0400e590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbda64c02eb2c117 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.339+0000 7f9ef67fc640 1 -- 172.21.15.7:0/2034001034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04018030 con 0x558ade242390 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.339+0000 7f9ef67fc640 1 -- 172.21.15.7:0/2034001034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f040054d0 con 0x558ade242390 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.339+0000 7f9ef67fc640 1 -- 172.21.15.7:0/2034001034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04012450 con 0x558ade242390 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.340+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2034001034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade242390 msgr2=0x558ade60ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.340+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2034001034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade242390 0x558ade60ad40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f9f04010370 tx=0x7f9f0400e590 comp rx=0 tx=0).stop 2024-09-21T06:01:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.340+0000 7f9f14ad3640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9ef80b6680 0x7f9ef80b8b90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9f080e44d0 tx=0x7f9f08094040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.340+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2034001034 shutdown_connections 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.340+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2034001034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade242390 0x558ade60ad40 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.340+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2034001034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade23a1b0 0x558ade60a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.340+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2034001034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade263070 0x558ade60a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.340+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2034001034 >> 172.21.15.7:0/2034001034 conn(0x558ade257460 msgr2=0x558ade6081b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.340+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2034001034 shutdown_connections 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.340+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2034001034 wait complete. 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.340+0000 7f9f1caaa740 1 -- start start 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.340+0000 7f9f1caaa740 1 Processor -- start 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f1caaa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade615930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f1caaa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 0x558ade615e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f1caaa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 0x558ade621d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f1caaa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558ade3d1700 con 0x558ade23a1b0 2024-09-21T06:01:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f1caaa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x558ade50b160 con 0x558ade263070 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f1caaa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x558ade618aa0 con 0x558ade242390 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f1caaa740 10 client.0 _ll_register_callbacks cb 0x558ade5249e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade615930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade615930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51410/0 (socket says 172.21.15.7:51410) 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/2902030981 learned_addr learned my addr 172.21.15.7:0/2902030981 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/2902030981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 0x558ade621d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f0ffff640 1 --2- 172.21.15.7:0/2902030981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 0x558ade615e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/2902030981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 msgr2=0x558ade615e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/2902030981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 0x558ade615e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/2902030981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 msgr2=0x558ade621d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/2902030981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 0x558ade621d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.341+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/2902030981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ade538c90 con 0x558ade23a1b0 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/2902030981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade615930 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f9f04005930 tx=0x7f9f04004bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1af2c97c0781383 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9eef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9eef7fe640 1 -- 172.21.15.7:0/2902030981 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04018040 con 0x558ade23a1b0 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9eef7fe640 1 -- 172.21.15.7:0/2902030981 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f9f04005200 con 0x558ade23a1b0 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2902030981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f040054d0 con 0x558ade23a1b0 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9eef7fe640 1 -- 172.21.15.7:0/2902030981 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9f04004970 con 0x558ade23a1b0 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9f1caaa740 10 client.17652 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2902030981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558ade624770 con 0x558ade23a1b0 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9eef7fe640 1 -- 172.21.15.7:0/2902030981 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f040054d0 con 0x558ade23a1b0 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9eef7fe640 1 -- 172.21.15.7:0/2902030981 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9f0402a060 con 0x558ade23a1b0 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9f1caaa740 10 client.17652 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9f1caaa740 10 client.17652 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9f1caaa740 20 client.17652 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2902030981 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x558ade2219f0 0x558ade627b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.342+0000 7f9f1caaa740 4 client.17652 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.343+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2902030981 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ade582df0 con 0x558ade2219f0 2024-09-21T06:01:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.343+0000 7f9f0ffff640 1 --2- 172.21.15.7:0/2902030981 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x558ade2219f0 0x558ade627b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.343+0000 7f9eef7fe640 10 client.17652 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:01:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.343+0000 7f9f0ffff640 1 --2- 172.21.15.7:0/2902030981 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x558ade2219f0 0x558ade627b80 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=27cc1a20f25f1ca9 server_cookie=7bcc542f58266b76 in_seq=0 out_seq=0 2024-09-21T06:01:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9eef7fe640 1 -- 172.21.15.7:0/2902030981 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ade582df0 con 0x558ade2219f0 2024-09-21T06:01:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9eef7fe640 10 client.17652 handle_command_reply: tid=0 2024-09-21T06:01:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9f1caaa740 1 client.17652 shutdown 2024-09-21T06:01:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2902030981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 msgr2=0x558ade615930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2902030981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade615930 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f9f04005930 tx=0x7f9f04004bf0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2902030981 shutdown_connections 2024-09-21T06:01:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2902030981 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x558ade2219f0 0x558ade627b80 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2902030981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 0x558ade621d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2902030981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 0x558ade615e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9eef7fe640 0 client.17652 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:01:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2902030981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade615930 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2902030981 >> 172.21.15.7:0/2902030981 conn(0x558ade257460 msgr2=0x558ade60d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2902030981 shutdown_connections 2024-09-21T06:01:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.344+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2902030981 wait complete. 2024-09-21T06:01:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.345+0000 7f9f1caaa740 20 client.17652 trim_cache size 0 max 16384 2024-09-21T06:01:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.358+0000 7f9f1caaa740 1 Processor -- start 2024-09-21T06:01:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.358+0000 7f9f1caaa740 1 -- start start 2024-09-21T06:01:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f1caaa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade60b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f1caaa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 0x558ade607760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f1caaa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 0x558ade607ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f1caaa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f101b2010 con 0x558ade23a1b0 2024-09-21T06:01:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f1caaa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9f101af8e0 con 0x558ade263070 2024-09-21T06:01:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f1caaa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9f101ad750 con 0x558ade242390 2024-09-21T06:01:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade60b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f0ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 0x558ade607760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade60b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51426/0 (socket says 172.21.15.7:51426) 2024-09-21T06:01:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/3999516783 learned_addr learned my addr 172.21.15.7:0/3999516783 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/3999516783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 0x558ade607ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/3999516783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 msgr2=0x558ade607760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/3999516783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 0x558ade607760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/3999516783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 msgr2=0x558ade607ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/3999516783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 0x558ade607ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/3999516783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ade6169d0 con 0x558ade23a1b0 2024-09-21T06:01:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.359+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/3999516783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade60b9b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9f04005900 tx=0x7f9f04005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2701901d135b2be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.360+0000 7f9ef5ffb640 1 -- 172.21.15.7:0/3999516783 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400ec20 con 0x558ade23a1b0 2024-09-21T06:01:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.360+0000 7f9ef5ffb640 1 -- 172.21.15.7:0/3999516783 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f0400edc0 con 0x558ade23a1b0 2024-09-21T06:01:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.360+0000 7f9ef5ffb640 1 -- 172.21.15.7:0/3999516783 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f040040e0 con 0x558ade23a1b0 2024-09-21T06:01:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.360+0000 7f9f1caaa740 1 -- 172.21.15.7:0/3999516783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 msgr2=0x558ade60b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.360+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/3999516783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade60b9b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9f04005900 tx=0x7f9f04005c50 comp rx=0 tx=0).stop 2024-09-21T06:01:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.360+0000 7f9f1caaa740 1 -- 172.21.15.7:0/3999516783 shutdown_connections 2024-09-21T06:01:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.360+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/3999516783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 0x558ade607ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.360+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/3999516783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 0x558ade607760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.360+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/3999516783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade60b9b0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.360+0000 7f9f1caaa740 1 -- 172.21.15.7:0/3999516783 >> 172.21.15.7:0/3999516783 conn(0x558ade257460 msgr2=0x558ade60b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.361+0000 7f9f1caaa740 1 -- 172.21.15.7:0/3999516783 shutdown_connections 2024-09-21T06:01:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.361+0000 7f9f1caaa740 1 -- 172.21.15.7:0/3999516783 wait complete. 2024-09-21T06:01:16.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.361+0000 7f9f1caaa740 1 -- start start 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.361+0000 7f9f1caaa740 1 Processor -- start 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f1caaa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade61e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f1caaa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 0x558ade6196c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f1caaa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 0x558ade619c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f1caaa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f101adda0 con 0x558ade23a1b0 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f1caaa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9f101af210 con 0x558ade263070 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f1caaa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9f101ae470 con 0x558ade242390 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f1caaa740 10 client.0 _ll_register_callbacks cb 0x7f9f00009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade61e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade61e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51438/0 (socket says 172.21.15.7:51438) 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/2381726785 learned_addr learned my addr 172.21.15.7:0/2381726785 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f0ffff640 1 --2- 172.21.15.7:0/2381726785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 0x558ade6196c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/2381726785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 0x558ade619c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/2381726785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 msgr2=0x558ade6196c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/2381726785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 0x558ade6196c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/2381726785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 msgr2=0x558ade619c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/2381726785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 0x558ade619c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f0f7fe640 1 -- 172.21.15.7:0/2381726785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ade61a140 con 0x558ade23a1b0 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9f0f7fe640 1 --2- 172.21.15.7:0/2381726785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade61e210 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f9f04004ac0 tx=0x7f9f04010fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854b7efc29cffd1d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.362+0000 7f9eef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9eef7fe640 1 -- 172.21.15.7:0/2381726785 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f040035f0 con 0x558ade23a1b0 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9eef7fe640 1 -- 172.21.15.7:0/2381726785 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f9f04003790 con 0x558ade23a1b0 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2381726785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f0400edc0 con 0x558ade23a1b0 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9eef7fe640 1 -- 172.21.15.7:0/2381726785 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9f0404d050 con 0x558ade23a1b0 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9f1caaa740 10 client.17658 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2381726785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558ade692070 con 0x558ade23a1b0 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9eef7fe640 1 -- 172.21.15.7:0/2381726785 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f0400edc0 con 0x558ade23a1b0 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9eef7fe640 1 -- 172.21.15.7:0/2381726785 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9f0402a040 con 0x558ade23a1b0 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9f1caaa740 10 client.17658 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9f1caaa740 10 client.17658 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:01:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9f1caaa740 20 client.17658 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2381726785 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x558ade1f6da0 0x558ade694610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9f1caaa740 4 client.17658 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:01:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.363+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2381726785 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558ade57e8a0 con 0x558ade1f6da0 2024-09-21T06:01:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.364+0000 7f9f0ffff640 1 --2- 172.21.15.7:0/2381726785 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x558ade1f6da0 0x558ade694610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.364+0000 7f9f0ffff640 1 --2- 172.21.15.7:0/2381726785 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x558ade1f6da0 0x558ade694610 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a0e2dcb2188593ac server_cookie=c60ddaced6fc46d5 in_seq=0 out_seq=0 2024-09-21T06:01:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.364+0000 7f9eef7fe640 10 client.17658 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:01:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.364+0000 7f9eef7fe640 1 -- 172.21.15.7:0/2381726785 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558ade57e8a0 con 0x558ade1f6da0 2024-09-21T06:01:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.364+0000 7f9eef7fe640 10 client.17658 handle_command_reply: tid=0 2024-09-21T06:01:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.364+0000 7f9f1caaa740 1 client.17658 shutdown 2024-09-21T06:01:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.364+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2381726785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 msgr2=0x558ade61e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:16.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.364+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2381726785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade61e210 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f9f04004ac0 tx=0x7f9f04010fb0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.364+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2381726785 shutdown_connections 2024-09-21T06:01:16.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2381726785 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x558ade1f6da0 0x558ade694610 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2381726785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x558ade263070 0x558ade619c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2381726785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558ade242390 0x558ade6196c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f1caaa740 1 --2- 172.21.15.7:0/2381726785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ade23a1b0 0x558ade61e210 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2381726785 >> 172.21.15.7:0/2381726785 conn(0x558ade257460 msgr2=0x558ade616bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:16.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9eef7fe640 0 client.17658 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:01:16.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2381726785 shutdown_connections 2024-09-21T06:01:16.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f1caaa740 1 -- 172.21.15.7:0/2381726785 wait complete. 2024-09-21T06:01:16.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f1caaa740 20 client.17658 trim_cache size 0 max 16384 2024-09-21T06:01:16.371 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:01:16.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f16536640 1 -- 172.21.15.7:0/3483456339 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9ef80b6680 msgr2=0x7f9ef80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:16.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f16536640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9ef80b6680 0x7f9ef80b8b90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9f080e44d0 tx=0x7f9f08094040 comp rx=0 tx=0).stop 2024-09-21T06:01:16.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f16536640 1 -- 172.21.15.7:0/3483456339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f10109e10 msgr2=0x7f9f1019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:16.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f16536640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f10109e10 0x7f9f1019fd60 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800b970 tx=0x7f9f0800be30 comp rx=0 tx=0).stop 2024-09-21T06:01:16.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f16536640 1 -- 172.21.15.7:0/3483456339 shutdown_connections 2024-09-21T06:01:16.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f16536640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9ef80b6680 0x7f9ef80b8b90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f16536640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f10109e10 0x7f9f1019fd60 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f16536640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f101094c0 0x7f9f1019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f16536640 1 --2- 172.21.15.7:0/3483456339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f10103b80 0x7f9f1019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.365+0000 7f9f16536640 1 -- 172.21.15.7:0/3483456339 >> 172.21.15.7:0/3483456339 conn(0x7f9f100ff5d0 msgr2=0x7f9f101019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.366+0000 7f9f16536640 1 -- 172.21.15.7:0/3483456339 shutdown_connections 2024-09-21T06:01:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:16.366+0000 7f9f16536640 1 -- 172.21.15.7:0/3483456339 wait complete. 2024-09-21T06:01:17.112 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:01:17.373 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:17.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:17 smithi007 ceph-mon[30983]: pgmap v543: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:01:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.858+0000 7f4ef015c640 1 -- 172.21.15.7:0/743612255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee810dec0 msgr2=0x7f4ee81103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.858+0000 7f4ef015c640 1 --2- 172.21.15.7:0/743612255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee810dec0 0x7f4ee81103b0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009ca0 tx=0x7f4ee002a8e0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.858+0000 7f4ef015c640 1 -- 172.21.15.7:0/743612255 shutdown_connections 2024-09-21T06:01:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.858+0000 7f4ef015c640 1 --2- 172.21.15.7:0/743612255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee810dec0 0x7f4ee81103b0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.858+0000 7f4ef015c640 1 --2- 172.21.15.7:0/743612255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ee81053b0 0x7f4ee810d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.858+0000 7f4ef015c640 1 --2- 172.21.15.7:0/743612255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee8104a60 0x7f4ee8104e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.858+0000 7f4ef015c640 1 -- 172.21.15.7:0/743612255 >> 172.21.15.7:0/743612255 conn(0x7f4ee80796d0 msgr2=0x7f4ee8079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.858+0000 7f4ef015c640 1 -- 172.21.15.7:0/743612255 shutdown_connections 2024-09-21T06:01:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.858+0000 7f4ef015c640 1 -- 172.21.15.7:0/743612255 wait complete. 2024-09-21T06:01:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.859+0000 7f4ef015c640 1 Processor -- start 2024-09-21T06:01:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.859+0000 7f4ef015c640 1 -- start start 2024-09-21T06:01:17.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.859+0000 7f4ef015c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ee8104a60 0x7f4ee819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.859+0000 7f4ef015c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee81053b0 0x7f4ee819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.859+0000 7f4ef015c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee810dec0 0x7f4ee819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.859+0000 7f4ef015c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee8113b80 con 0x7f4ee81053b0 2024-09-21T06:01:17.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.859+0000 7f4ef015c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee8113a00 con 0x7f4ee810dec0 2024-09-21T06:01:17.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.859+0000 7f4ef015c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee8113d00 con 0x7f4ee8104a60 2024-09-21T06:01:17.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.859+0000 7f4eed6f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee81053b0 0x7f4ee819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4eed6f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee81053b0 0x7f4ee819aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51450/0 (socket says 172.21.15.7:51450) 2024-09-21T06:01:17.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4eed6f7640 1 -- 172.21.15.7:0/2086059152 learned_addr learned my addr 172.21.15.7:0/2086059152 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:17.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4eedef8640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ee8104a60 0x7f4ee819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4eee6f9640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee810dec0 0x7f4ee819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4eed6f7640 1 -- 172.21.15.7:0/2086059152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ee8104a60 msgr2=0x7f4ee819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4eed6f7640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ee8104a60 0x7f4ee819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4eed6f7640 1 -- 172.21.15.7:0/2086059152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee810dec0 msgr2=0x7f4ee819fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4eed6f7640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee810dec0 0x7f4ee819fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4eed6f7640 1 -- 172.21.15.7:0/2086059152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee81a04a0 con 0x7f4ee81053b0 2024-09-21T06:01:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4eee6f9640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee810dec0 0x7f4ee819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4eed6f7640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee81053b0 0x7f4ee819aad0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8006fd0 tx=0x7f4ed800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4edeffd640 1 -- 172.21.15.7:0/2086059152 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8011830 con 0x7f4ee81053b0 2024-09-21T06:01:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4edeffd640 1 -- 172.21.15.7:0/2086059152 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ed8016070 con 0x7f4ee81053b0 2024-09-21T06:01:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4ef015c640 1 -- 172.21.15.7:0/2086059152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee81a0790 con 0x7f4ee81053b0 2024-09-21T06:01:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4edeffd640 1 -- 172.21.15.7:0/2086059152 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8010e00 con 0x7f4ee81053b0 2024-09-21T06:01:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.860+0000 7f4ef015c640 1 -- 172.21.15.7:0/2086059152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee81a6ef0 con 0x7f4ee81053b0 2024-09-21T06:01:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.863+0000 7f4ef66d0740 1 Processor -- start 2024-09-21T06:01:17.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.863+0000 7f4ef66d0740 1 -- start start 2024-09-21T06:01:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.863+0000 7f4edeffd640 1 -- 172.21.15.7:0/2086059152 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f4ed801b480 con 0x7f4ee81053b0 2024-09-21T06:01:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4ef66d0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90528070 0x556d908cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4ef66d0740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d904ff1b0 0x556d908cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4ef66d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90507390 0x556d908d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4ef66d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556d90845ea0 con 0x556d90507390 2024-09-21T06:01:17.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4ef66d0740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556d908352d0 con 0x556d904ff1b0 2024-09-21T06:01:17.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4ef66d0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556d908390e0 con 0x556d90528070 2024-09-21T06:01:17.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4eed6f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90507390 0x556d908d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4eed6f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90507390 0x556d908d0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51452/0 (socket says 172.21.15.7:51452) 2024-09-21T06:01:17.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4eed6f7640 1 -- 172.21.15.7:0/679411654 learned_addr learned my addr 172.21.15.7:0/679411654 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:17.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4eee6f9640 1 --2- 172.21.15.7:0/679411654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90528070 0x556d908cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4eedef8640 1 --2- 172.21.15.7:0/679411654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d904ff1b0 0x556d908cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4eee6f9640 1 -- 172.21.15.7:0/679411654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d904ff1b0 msgr2=0x556d908cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:17.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4eee6f9640 1 --2- 172.21.15.7:0/679411654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d904ff1b0 0x556d908cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4eee6f9640 1 -- 172.21.15.7:0/679411654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90507390 msgr2=0x556d908d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:17.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4eee6f9640 1 --2- 172.21.15.7:0/679411654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90507390 0x556d908d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4eee6f9640 1 -- 172.21.15.7:0/679411654 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d90593650 con 0x556d90528070 2024-09-21T06:01:17.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4eed6f7640 1 --2- 172.21.15.7:0/679411654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90507390 0x556d908d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:17.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.864+0000 7f4edeffd640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4ed40b6700 0x7f4ed40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.865+0000 7f4eee6f9640 1 --2- 172.21.15.7:0/679411654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90528070 0x556d908cf6a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4ee002ae00 tx=0x7f4ee0031630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=172246f53a39838 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.865+0000 7f4eedef8640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4ed40b6700 0x7f4ed40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.865+0000 7f4edeffd640 1 -- 172.21.15.7:0/2086059152 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f4ed80e6c00 con 0x7f4ee81053b0 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.865+0000 7f4ed3fff640 1 -- 172.21.15.7:0/679411654 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0031ad0 con 0x556d90528070 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.865+0000 7f4ed3fff640 1 -- 172.21.15.7:0/679411654 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ee0036040 con 0x556d90528070 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.865+0000 7f4ed3fff640 1 -- 172.21.15.7:0/679411654 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0004670 con 0x556d90528070 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.866+0000 7f4ef66d0740 1 -- 172.21.15.7:0/679411654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90528070 msgr2=0x556d908cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.866+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/679411654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90528070 0x556d908cf6a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4ee002ae00 tx=0x7f4ee0031630 comp rx=0 tx=0).stop 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.866+0000 7f4eedef8640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4ed40b6700 0x7f4ed40b8c10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40058c0 tx=0x7f4ee400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.866+0000 7f4ef66d0740 1 -- 172.21.15.7:0/679411654 shutdown_connections 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.866+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/679411654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90507390 0x556d908d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.866+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/679411654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d904ff1b0 0x556d908cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.866+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/679411654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90528070 0x556d908cf6a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.866+0000 7f4ef66d0740 1 -- 172.21.15.7:0/679411654 >> 172.21.15.7:0/679411654 conn(0x556d9051c460 msgr2=0x556d908cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.866+0000 7f4ef66d0740 1 -- 172.21.15.7:0/679411654 shutdown_connections 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.866+0000 7f4ef66d0740 1 -- 172.21.15.7:0/679411654 wait complete. 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.866+0000 7f4ef66d0740 1 -- start start 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4ef66d0740 1 Processor -- start 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4ef66d0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d904ff1b0 0x556d908df130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4ef66d0740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90507390 0x556d908df670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4ef66d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90528070 0x556d908eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4ef66d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556d90696700 con 0x556d90528070 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4ef66d0740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556d907d0160 con 0x556d90507390 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4ef66d0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556d908e2150 con 0x556d904ff1b0 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4ef66d0740 10 client.0 _ll_register_callbacks cb 0x556d907e99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4eee6f9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90528070 0x556d908eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4eedef8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d904ff1b0 0x556d908df130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4eee6f9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90528070 0x556d908eb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51468/0 (socket says 172.21.15.7:51468) 2024-09-21T06:01:17.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4eedef8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d904ff1b0 0x556d908df130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:35620/0 (socket says 172.21.15.7:35620) 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4eee6f9640 1 -- 172.21.15.7:0/370027400 learned_addr learned my addr 172.21.15.7:0/370027400 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.867+0000 7f4eed6f7640 1 --2- 172.21.15.7:0/370027400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90507390 0x556d908df670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4eedef8640 1 -- 172.21.15.7:0/370027400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90507390 msgr2=0x556d908df670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4eedef8640 1 --2- 172.21.15.7:0/370027400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90507390 0x556d908df670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4eedef8640 1 -- 172.21.15.7:0/370027400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90528070 msgr2=0x556d908eb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4eedef8640 1 --2- 172.21.15.7:0/370027400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90528070 0x556d908eb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4eedef8640 1 -- 172.21.15.7:0/370027400 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d907fdc90 con 0x556d904ff1b0 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4eee6f9640 1 --2- 172.21.15.7:0/370027400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90528070 0x556d908eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4eedef8640 1 --2- 172.21.15.7:0/370027400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d904ff1b0 0x556d908df130 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4010c90 tx=0x7f4ee4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24208c19991a343a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4ed17fa640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4ed17fa640 1 -- 172.21.15.7:0/370027400 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee402c060 con 0x556d904ff1b0 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4ef66d0740 1 -- 172.21.15.7:0/370027400 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ee0036040 con 0x556d904ff1b0 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4ed17fa640 1 -- 172.21.15.7:0/370027400 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f4ee4016030 con 0x556d904ff1b0 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4ed17fa640 1 -- 172.21.15.7:0/370027400 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4ee4031460 con 0x556d904ff1b0 2024-09-21T06:01:17.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4ef66d0740 10 client.26956 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.868+0000 7f4ef66d0740 1 -- 172.21.15.7:0/370027400 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556d908edf40 con 0x556d904ff1b0 2024-09-21T06:01:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.869+0000 7f4ed17fa640 1 -- 172.21.15.7:0/370027400 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ee0036040 con 0x556d904ff1b0 2024-09-21T06:01:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.869+0000 7f4ed17fa640 1 -- 172.21.15.7:0/370027400 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4ee401a3a0 con 0x556d904ff1b0 2024-09-21T06:01:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.869+0000 7f4ef66d0740 10 client.26956 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.869+0000 7f4ef66d0740 10 client.26956 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:01:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.869+0000 7f4ef66d0740 20 client.26956 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.869+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/370027400 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556d904e69f0 0x556d908f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.869+0000 7f4ef66d0740 4 client.26956 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.869+0000 7f4ef66d0740 1 -- 172.21.15.7:0/370027400 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d90847df0 con 0x556d904e69f0 2024-09-21T06:01:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.869+0000 7f4eed6f7640 1 --2- 172.21.15.7:0/370027400 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556d904e69f0 0x556d908f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.870+0000 7f4eed6f7640 1 --2- 172.21.15.7:0/370027400 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556d904e69f0 0x556d908f13f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=75fce103823f96c8 server_cookie=38d00a6d6179c9ba in_seq=0 out_seq=0 2024-09-21T06:01:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.870+0000 7f4ed17fa640 10 client.26956 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:01:17.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ed17fa640 1 -- 172.21.15.7:0/370027400 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556d90847df0 con 0x556d904e69f0 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ed17fa640 10 client.26956 handle_command_reply: tid=0 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ef66d0740 1 client.26956 shutdown 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ef66d0740 1 -- 172.21.15.7:0/370027400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d904ff1b0 msgr2=0x556d908df130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/370027400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d904ff1b0 0x556d908df130 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4010c90 tx=0x7f4ee4004730 comp rx=0 tx=0).stop 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ef66d0740 1 -- 172.21.15.7:0/370027400 shutdown_connections 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/370027400 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556d904e69f0 0x556d908f13f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/370027400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d90528070 0x556d908eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/370027400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90507390 0x556d908df670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/370027400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d904ff1b0 0x556d908df130 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ed17fa640 0 client.26956 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ef66d0740 1 -- 172.21.15.7:0/370027400 >> 172.21.15.7:0/370027400 conn(0x556d9051c460 msgr2=0x556d908d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ef66d0740 1 -- 172.21.15.7:0/370027400 shutdown_connections 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.871+0000 7f4ef66d0740 1 -- 172.21.15.7:0/370027400 wait complete. 2024-09-21T06:01:17.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.872+0000 7f4ef66d0740 20 client.26956 trim_cache size 0 max 16384 2024-09-21T06:01:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.885+0000 7f4ef66d0740 1 Processor -- start 2024-09-21T06:01:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.885+0000 7f4ef66d0740 1 -- start start 2024-09-21T06:01:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.885+0000 7f4ef66d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 0x556d908d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.885+0000 7f4ef66d0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90507390 0x556d908ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.885+0000 7f4ef66d0740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90528070 0x556d908cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.885+0000 7f4ef66d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee81afda0 con 0x556d904ff1b0 2024-09-21T06:01:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.885+0000 7f4ef66d0740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee81ad670 con 0x556d90528070 2024-09-21T06:01:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.885+0000 7f4ef66d0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee81ab500 con 0x556d90507390 2024-09-21T06:01:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.885+0000 7f4eedef8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 0x556d908d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.885+0000 7f4eedef8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 0x556d908d0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51474/0 (socket says 172.21.15.7:51474) 2024-09-21T06:01:17.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.885+0000 7f4eedef8640 1 -- 172.21.15.7:0/2149569969 learned_addr learned my addr 172.21.15.7:0/2149569969 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:17.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.886+0000 7f4eed6f7640 1 --2- 172.21.15.7:0/2149569969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90507390 0x556d908ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.886+0000 7f4eee6f9640 1 --2- 172.21.15.7:0/2149569969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90528070 0x556d908cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.886+0000 7f4eedef8640 1 -- 172.21.15.7:0/2149569969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90507390 msgr2=0x556d908ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:17.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.886+0000 7f4eedef8640 1 --2- 172.21.15.7:0/2149569969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90507390 0x556d908ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.886+0000 7f4eedef8640 1 -- 172.21.15.7:0/2149569969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90528070 msgr2=0x556d908cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:17.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.886+0000 7f4eedef8640 1 --2- 172.21.15.7:0/2149569969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90528070 0x556d908cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.886+0000 7f4eedef8640 1 -- 172.21.15.7:0/2149569969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d908e2090 con 0x556d904ff1b0 2024-09-21T06:01:17.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.886+0000 7f4eedef8640 1 --2- 172.21.15.7:0/2149569969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 0x556d908d0de0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4017040 tx=0x7f4ee4005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2744139f2fb8b489 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:17.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.886+0000 7f4ed37fe640 1 -- 172.21.15.7:0/2149569969 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4040070 con 0x556d904ff1b0 2024-09-21T06:01:17.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.886+0000 7f4ed37fe640 1 -- 172.21.15.7:0/2149569969 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ee401ae90 con 0x556d904ff1b0 2024-09-21T06:01:17.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.886+0000 7f4ed37fe640 1 -- 172.21.15.7:0/2149569969 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4031e00 con 0x556d904ff1b0 2024-09-21T06:01:17.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.887+0000 7f4ef66d0740 1 -- 172.21.15.7:0/2149569969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 msgr2=0x556d908d0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:17.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.887+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/2149569969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 0x556d908d0de0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4017040 tx=0x7f4ee4005a70 comp rx=0 tx=0).stop 2024-09-21T06:01:17.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.887+0000 7f4ef66d0740 1 -- 172.21.15.7:0/2149569969 shutdown_connections 2024-09-21T06:01:17.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.887+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/2149569969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90528070 0x556d908cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.887+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/2149569969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90507390 0x556d908ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.887+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/2149569969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 0x556d908d0de0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.887+0000 7f4ef66d0740 1 -- 172.21.15.7:0/2149569969 >> 172.21.15.7:0/2149569969 conn(0x556d9051c460 msgr2=0x556d908d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:17.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.887+0000 7f4ef66d0740 1 -- 172.21.15.7:0/2149569969 shutdown_connections 2024-09-21T06:01:17.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.887+0000 7f4ef66d0740 1 -- 172.21.15.7:0/2149569969 wait complete. 2024-09-21T06:01:17.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.887+0000 7f4ef66d0740 1 -- start start 2024-09-21T06:01:17.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.888+0000 7f4ef66d0740 1 Processor -- start 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.888+0000 7f4ef66d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 0x556d908e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.888+0000 7f4ef66d0740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90507390 0x556d908e3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.888+0000 7f4ef66d0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90528070 0x556d908e3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.888+0000 7f4ef66d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee81abb50 con 0x556d904ff1b0 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.888+0000 7f4ef66d0740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee81acfa0 con 0x556d90507390 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.888+0000 7f4ef66d0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee81ac200 con 0x556d90528070 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.888+0000 7f4ef66d0740 10 client.0 _ll_register_callbacks cb 0x7f4ee400a9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.888+0000 7f4eedef8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 0x556d908e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.888+0000 7f4eedef8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 0x556d908e7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51480/0 (socket says 172.21.15.7:51480) 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.888+0000 7f4eedef8640 1 -- 172.21.15.7:0/1589560150 learned_addr learned my addr 172.21.15.7:0/1589560150 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.888+0000 7f4eed6f7640 1 --2- 172.21.15.7:0/1589560150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90507390 0x556d908e3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.888+0000 7f4eee6f9640 1 --2- 172.21.15.7:0/1589560150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90528070 0x556d908e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.889+0000 7f4eedef8640 1 -- 172.21.15.7:0/1589560150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90528070 msgr2=0x556d908e3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.889+0000 7f4eedef8640 1 --2- 172.21.15.7:0/1589560150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90528070 0x556d908e3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.889+0000 7f4eedef8640 1 -- 172.21.15.7:0/1589560150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90507390 msgr2=0x556d908e3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.889+0000 7f4eedef8640 1 --2- 172.21.15.7:0/1589560150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90507390 0x556d908e3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.889+0000 7f4eedef8640 1 -- 172.21.15.7:0/1589560150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d9095adb0 con 0x556d904ff1b0 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.889+0000 7f4eedef8640 1 --2- 172.21.15.7:0/1589560150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 0x556d908e7db0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f4ee401a9e0 tx=0x7f4ee401aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43e9391ff9e1a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.889+0000 7f4ed17fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.889+0000 7f4ed17fa640 1 -- 172.21.15.7:0/1589560150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4049060 con 0x556d904ff1b0 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.889+0000 7f4ef66d0740 1 -- 172.21.15.7:0/1589560150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ee401ae90 con 0x556d904ff1b0 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.889+0000 7f4ed17fa640 1 -- 172.21.15.7:0/1589560150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f4ee4031a40 con 0x556d904ff1b0 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.889+0000 7f4ed17fa640 1 -- 172.21.15.7:0/1589560150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4ee4040050 con 0x556d904ff1b0 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.889+0000 7f4ef66d0740 10 client.17676 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.889+0000 7f4ef66d0740 1 -- 172.21.15.7:0/1589560150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556d9095bea0 con 0x556d904ff1b0 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.890+0000 7f4ed17fa640 1 -- 172.21.15.7:0/1589560150 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ee401ae90 con 0x556d904ff1b0 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.890+0000 7f4ed17fa640 1 -- 172.21.15.7:0/1589560150 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4ee403a030 con 0x556d904ff1b0 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.890+0000 7f4ef66d0740 10 client.17676 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.890+0000 7f4ef66d0740 10 client.17676 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:01:17.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.890+0000 7f4ef66d0740 20 client.17676 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:17.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.890+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/1589560150 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556d904bbda0 0x556d9095e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:17.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.890+0000 7f4ef66d0740 4 client.17676 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:01:17.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.890+0000 7f4ef66d0740 1 -- 172.21.15.7:0/1589560150 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556d908438a0 con 0x556d904bbda0 2024-09-21T06:01:17.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.890+0000 7f4eed6f7640 1 --2- 172.21.15.7:0/1589560150 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556d904bbda0 0x556d9095e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4eed6f7640 1 --2- 172.21.15.7:0/1589560150 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556d904bbda0 0x556d9095e540 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4d288b6c8d12289b server_cookie=3f4623a2ae837a52 in_seq=0 out_seq=0 2024-09-21T06:01:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ed17fa640 10 client.17676 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:01:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ed17fa640 1 -- 172.21.15.7:0/1589560150 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556d908438a0 con 0x556d904bbda0 2024-09-21T06:01:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ed17fa640 10 client.17676 handle_command_reply: tid=0 2024-09-21T06:01:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ef66d0740 1 client.17676 shutdown 2024-09-21T06:01:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ef66d0740 1 -- 172.21.15.7:0/1589560150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 msgr2=0x556d908e7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/1589560150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 0x556d908e7db0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f4ee401a9e0 tx=0x7f4ee401aa10 comp rx=0 tx=0).stop 2024-09-21T06:01:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ef66d0740 1 -- 172.21.15.7:0/1589560150 shutdown_connections 2024-09-21T06:01:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/1589560150 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x556d904bbda0 0x556d9095e540 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/1589560150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556d90528070 0x556d908e3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ed17fa640 0 client.17676 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:01:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/1589560150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556d90507390 0x556d908e3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ef66d0740 1 --2- 172.21.15.7:0/1589560150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d904ff1b0 0x556d908e7db0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ef66d0740 1 -- 172.21.15.7:0/1589560150 >> 172.21.15.7:0/1589560150 conn(0x556d9051c460 msgr2=0x556d908d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ef66d0740 1 -- 172.21.15.7:0/1589560150 shutdown_connections 2024-09-21T06:01:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ef66d0740 1 -- 172.21.15.7:0/1589560150 wait complete. 2024-09-21T06:01:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.891+0000 7f4ef66d0740 20 client.17676 trim_cache size 0 max 16384 2024-09-21T06:01:17.897 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:01:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.892+0000 7f4ef015c640 1 -- 172.21.15.7:0/2086059152 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4ed40b6700 msgr2=0x7f4ed40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.892+0000 7f4ef015c640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4ed40b6700 0x7f4ed40b8c10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40058c0 tx=0x7f4ee400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.892+0000 7f4ef015c640 1 -- 172.21.15.7:0/2086059152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee81053b0 msgr2=0x7f4ee819aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.892+0000 7f4ef015c640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee81053b0 0x7f4ee819aad0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8006fd0 tx=0x7f4ed800b8e0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.892+0000 7f4ef015c640 1 -- 172.21.15.7:0/2086059152 shutdown_connections 2024-09-21T06:01:17.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.892+0000 7f4ef015c640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4ed40b6700 0x7f4ed40b8c10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.892+0000 7f4ef015c640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ee81053b0 0x7f4ee819aad0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.892+0000 7f4ef015c640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee810dec0 0x7f4ee819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.892+0000 7f4ef015c640 1 --2- 172.21.15.7:0/2086059152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ee8104a60 0x7f4ee819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:17.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.892+0000 7f4ef015c640 1 -- 172.21.15.7:0/2086059152 >> 172.21.15.7:0/2086059152 conn(0x7f4ee80796d0 msgr2=0x7f4ee8107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:17.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.892+0000 7f4ef015c640 1 -- 172.21.15.7:0/2086059152 shutdown_connections 2024-09-21T06:01:17.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:17.892+0000 7f4ef015c640 1 -- 172.21.15.7:0/2086059152 wait complete. 2024-09-21T06:01:18.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:17 smithi119 ceph-mon[34833]: pgmap v543: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:01:18.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:17 smithi027 ceph-mon[34364]: pgmap v543: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:01:18.515 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:01:18.771 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:19.045 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:18 smithi007 ceph-mon[30983]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:01:19.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:18 smithi119 ceph-mon[34833]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:01:19.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:18 smithi027 ceph-mon[34364]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:01:19.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.291+0000 7f0b93135640 1 -- 172.21.15.7:0/2852062530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b8c103250 msgr2=0x7f0b8c103660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.291+0000 7f0b93135640 1 --2- 172.21.15.7:0/2852062530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b8c103250 0x7f0b8c103660 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009900 tx=0x7f0b7c02a410 comp rx=0 tx=0).stop 2024-09-21T06:01:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.291+0000 7f0b93135640 1 -- 172.21.15.7:0/2852062530 shutdown_connections 2024-09-21T06:01:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.291+0000 7f0b93135640 1 --2- 172.21.15.7:0/2852062530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b8c105b70 0x7f0b8c10f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.291+0000 7f0b93135640 1 --2- 172.21.15.7:0/2852062530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c105220 0x7f0b8c105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.291+0000 7f0b93135640 1 --2- 172.21.15.7:0/2852062530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b8c103250 0x7f0b8c103660 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.291+0000 7f0b93135640 1 -- 172.21.15.7:0/2852062530 >> 172.21.15.7:0/2852062530 conn(0x7f0b8c079ea0 msgr2=0x7f0b8c07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.291+0000 7f0b93135640 1 -- 172.21.15.7:0/2852062530 shutdown_connections 2024-09-21T06:01:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.291+0000 7f0b93135640 1 -- 172.21.15.7:0/2852062530 wait complete. 2024-09-21T06:01:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.291+0000 7f0b93135640 1 Processor -- start 2024-09-21T06:01:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.291+0000 7f0b93135640 1 -- start start 2024-09-21T06:01:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b93135640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b8c103250 0x7f0b8c1100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b93135640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c105220 0x7f0b8c110620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b93135640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b8c105b70 0x7f0b8c110b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b93135640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c113b50 con 0x7f0b8c103250 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b93135640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c1139d0 con 0x7f0b8c105220 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b93135640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c113cd0 con 0x7f0b8c105b70 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b90ed1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b8c103250 0x7f0b8c1100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b90ed1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b8c103250 0x7f0b8c1100e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47172/0 (socket says 172.21.15.7:47172) 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b90ed1640 1 -- 172.21.15.7:0/1265669043 learned_addr learned my addr 172.21.15.7:0/1265669043 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b916d2640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b8c105b70 0x7f0b8c110b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c105220 0x7f0b8c110620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b90ed1640 1 -- 172.21.15.7:0/1265669043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b8c105b70 msgr2=0x7f0b8c110b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b90ed1640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b8c105b70 0x7f0b8c110b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b90ed1640 1 -- 172.21.15.7:0/1265669043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c105220 msgr2=0x7f0b8c110620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b90ed1640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c105220 0x7f0b8c110620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b90ed1640 1 -- 172.21.15.7:0/1265669043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8c1a8840 con 0x7f0b8c103250 2024-09-21T06:01:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b916d2640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b8c105b70 0x7f0b8c110b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c105220 0x7f0b8c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.292+0000 7f0b90ed1640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b8c103250 0x7f0b8c1100e0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c005940 tx=0x7f0b7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.293+0000 7f0b89ffb640 1 -- 172.21.15.7:0/1265669043 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c03f030 con 0x7f0b8c103250 2024-09-21T06:01:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.293+0000 7f0b93135640 1 -- 172.21.15.7:0/1265669043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b8c1a8ad0 con 0x7f0b8c103250 2024-09-21T06:01:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.293+0000 7f0b89ffb640 1 -- 172.21.15.7:0/1265669043 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b7c003cb0 con 0x7f0b8c103250 2024-09-21T06:01:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.293+0000 7f0b89ffb640 1 -- 172.21.15.7:0/1265669043 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c035070 con 0x7f0b8c103250 2024-09-21T06:01:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.293+0000 7f0b93135640 1 -- 172.21.15.7:0/1265669043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b8c1a8fb0 con 0x7f0b8c103250 2024-09-21T06:01:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.295+0000 7f0b996a9740 1 Processor -- start 2024-09-21T06:01:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.296+0000 7f0b996a9740 1 -- start start 2024-09-21T06:01:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.296+0000 7f0b89ffb640 1 -- 172.21.15.7:0/1265669043 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0b7c042030 con 0x7f0b8c103250 2024-09-21T06:01:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.296+0000 7f0b996a9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bf2070 0x559339f992c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.296+0000 7f0b996a9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bc91b0 0x559339f99800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.296+0000 7f0b996a9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bd1390 0x559339f99d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.296+0000 7f0b996a9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559339f0fea0 con 0x559339bd1390 2024-09-21T06:01:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.296+0000 7f0b996a9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559339eff2d0 con 0x559339bc91b0 2024-09-21T06:01:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.296+0000 7f0b996a9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559339f030e0 con 0x559339bf2070 2024-09-21T06:01:19.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.296+0000 7f0b8bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bd1390 0x559339f99d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.296+0000 7f0b8bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bd1390 0x559339f99d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47182/0 (socket says 172.21.15.7:47182) 2024-09-21T06:01:19.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.296+0000 7f0b8bfff640 1 -- 172.21.15.7:0/1307544637 learned_addr learned my addr 172.21.15.7:0/1307544637 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:19.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.296+0000 7f0b90ed1640 1 --2- 172.21.15.7:0/1307544637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bc91b0 0x559339f99800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.296+0000 7f0b916d2640 1 --2- 172.21.15.7:0/1307544637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bf2070 0x559339f992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.297+0000 7f0b8bfff640 1 -- 172.21.15.7:0/1307544637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bf2070 msgr2=0x559339f992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.297+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/1307544637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bf2070 0x559339f992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.297+0000 7f0b8bfff640 1 -- 172.21.15.7:0/1307544637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bc91b0 msgr2=0x559339f99800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.297+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/1307544637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bc91b0 0x559339f99800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.297+0000 7f0b8bfff640 1 -- 172.21.15.7:0/1307544637 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559339c5d650 con 0x559339bd1390 2024-09-21T06:01:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.297+0000 7f0b89ffb640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0b740b6680 0x7f0b740b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.297+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/1307544637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bd1390 0x559339f99d40 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000bae0 tx=0x7f0b8000d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5008d5112796a29b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.297+0000 7f0b916d2640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0b740b6680 0x7f0b740b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.297+0000 7f0b89ffb640 1 -- 172.21.15.7:0/1265669043 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f0b7c107ca0 con 0x7f0b8c103250 2024-09-21T06:01:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.297+0000 7f0b72ffd640 1 -- 172.21.15.7:0/1307544637 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b80017420 con 0x559339bd1390 2024-09-21T06:01:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.297+0000 7f0b72ffd640 1 -- 172.21.15.7:0/1307544637 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b80017a70 con 0x559339bd1390 2024-09-21T06:01:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.297+0000 7f0b72ffd640 1 -- 172.21.15.7:0/1307544637 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8000fa10 con 0x559339bd1390 2024-09-21T06:01:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.298+0000 7f0b996a9740 1 -- 172.21.15.7:0/1307544637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bd1390 msgr2=0x559339f99d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:19.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.298+0000 7f0b996a9740 1 --2- 172.21.15.7:0/1307544637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bd1390 0x559339f99d40 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000bae0 tx=0x7f0b8000d340 comp rx=0 tx=0).stop 2024-09-21T06:01:19.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.298+0000 7f0b916d2640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0b740b6680 0x7f0b740b8b90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0b84005fd0 tx=0x7f0b84009800 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:19.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.298+0000 7f0b996a9740 1 -- 172.21.15.7:0/1307544637 shutdown_connections 2024-09-21T06:01:19.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.298+0000 7f0b996a9740 1 --2- 172.21.15.7:0/1307544637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bd1390 0x559339f99d40 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.298+0000 7f0b996a9740 1 --2- 172.21.15.7:0/1307544637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bc91b0 0x559339f99800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.298+0000 7f0b996a9740 1 --2- 172.21.15.7:0/1307544637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bf2070 0x559339f992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.298+0000 7f0b996a9740 1 -- 172.21.15.7:0/1307544637 >> 172.21.15.7:0/1307544637 conn(0x559339be6460 msgr2=0x559339f971b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:19.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.298+0000 7f0b996a9740 1 -- 172.21.15.7:0/1307544637 shutdown_connections 2024-09-21T06:01:19.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.298+0000 7f0b996a9740 1 -- 172.21.15.7:0/1307544637 wait complete. 2024-09-21T06:01:19.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.299+0000 7f0b996a9740 1 -- start start 2024-09-21T06:01:19.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.299+0000 7f0b996a9740 1 Processor -- start 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.299+0000 7f0b996a9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 0x559339fa4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.299+0000 7f0b996a9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bd1390 0x559339fa4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.299+0000 7f0b996a9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bf2070 0x559339fa52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.299+0000 7f0b996a9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559339d60700 con 0x559339bc91b0 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.299+0000 7f0b996a9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559339e9a160 con 0x559339bf2070 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.299+0000 7f0b996a9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559339fa7aa0 con 0x559339bd1390 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b996a9740 10 client.0 _ll_register_callbacks cb 0x559339eb39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b90ed1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 0x559339fa4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b90ed1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 0x559339fa4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47186/0 (socket says 172.21.15.7:47186) 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b90ed1640 1 -- 172.21.15.7:0/1984972533 learned_addr learned my addr 172.21.15.7:0/1984972533 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b916d2640 1 --2- 172.21.15.7:0/1984972533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bf2070 0x559339fa52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/1984972533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bd1390 0x559339fa4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b90ed1640 1 -- 172.21.15.7:0/1984972533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bd1390 msgr2=0x559339fa4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b90ed1640 1 --2- 172.21.15.7:0/1984972533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bd1390 0x559339fa4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b90ed1640 1 -- 172.21.15.7:0/1984972533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bf2070 msgr2=0x559339fa52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b90ed1640 1 --2- 172.21.15.7:0/1984972533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bf2070 0x559339fa52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b90ed1640 1 -- 172.21.15.7:0/1984972533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559339ec7c90 con 0x559339bc91b0 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b90ed1640 1 --2- 172.21.15.7:0/1984972533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 0x559339fa4870 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c0cadb0 tx=0x7f0b7c10b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe584680b1bdd35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.300+0000 7f0b6bfff640 1 -- 172.21.15.7:0/1984972533 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c049030 con 0x559339bc91b0 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.301+0000 7f0b6bfff640 1 -- 172.21.15.7:0/1984972533 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f0b7c0d70d0 con 0x559339bc91b0 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.301+0000 7f0b996a9740 1 -- 172.21.15.7:0/1984972533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b80017a70 con 0x559339bc91b0 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.301+0000 7f0b6bfff640 1 -- 172.21.15.7:0/1984972533 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0b7c0c99e0 con 0x559339bc91b0 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.301+0000 7f0b996a9740 10 client.17688 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.301+0000 7f0b996a9740 1 -- 172.21.15.7:0/1984972533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559339fb36b0 con 0x559339bc91b0 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.301+0000 7f0b6bfff640 1 -- 172.21.15.7:0/1984972533 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b80017a70 con 0x559339bc91b0 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.301+0000 7f0b6bfff640 1 -- 172.21.15.7:0/1984972533 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0b7c0d21a0 con 0x559339bc91b0 2024-09-21T06:01:19.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.301+0000 7f0b996a9740 10 client.17688 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.301+0000 7f0b996a9740 10 client.17688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.301+0000 7f0b996a9740 20 client.17688 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.301+0000 7f0b996a9740 1 --2- 172.21.15.7:0/1984972533 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559339bb09f0 0x559339fb6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.301+0000 7f0b996a9740 4 client.17688 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.301+0000 7f0b996a9740 1 -- 172.21.15.7:0/1984972533 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559339f11df0 con 0x559339bb09f0 2024-09-21T06:01:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.302+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/1984972533 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559339bb09f0 0x559339fb6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.302+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/1984972533 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559339bb09f0 0x559339fb6c70 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a95390eab5598ab server_cookie=3b9a60eb3a394703 in_seq=0 out_seq=0 2024-09-21T06:01:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.302+0000 7f0b6bfff640 10 client.17688 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b6bfff640 1 -- 172.21.15.7:0/1984972533 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559339f11df0 con 0x559339bb09f0 2024-09-21T06:01:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b6bfff640 10 client.17688 handle_command_reply: tid=0 2024-09-21T06:01:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b996a9740 1 client.17688 shutdown 2024-09-21T06:01:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b996a9740 1 -- 172.21.15.7:0/1984972533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 msgr2=0x559339fa4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:19.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b996a9740 1 --2- 172.21.15.7:0/1984972533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 0x559339fa4870 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c0cadb0 tx=0x7f0b7c10b3e0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b996a9740 1 -- 172.21.15.7:0/1984972533 shutdown_connections 2024-09-21T06:01:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b996a9740 1 --2- 172.21.15.7:0/1984972533 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559339bb09f0 0x559339fb6c70 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b996a9740 1 --2- 172.21.15.7:0/1984972533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bf2070 0x559339fa52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b996a9740 1 --2- 172.21.15.7:0/1984972533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bd1390 0x559339fa4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b6bfff640 0 client.17688 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b996a9740 1 --2- 172.21.15.7:0/1984972533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 0x559339fa4870 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b996a9740 1 -- 172.21.15.7:0/1984972533 >> 172.21.15.7:0/1984972533 conn(0x559339be6460 msgr2=0x559339f9c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:19.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b996a9740 1 -- 172.21.15.7:0/1984972533 shutdown_connections 2024-09-21T06:01:19.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.303+0000 7f0b996a9740 1 -- 172.21.15.7:0/1984972533 wait complete. 2024-09-21T06:01:19.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.304+0000 7f0b996a9740 20 client.17688 trim_cache size 0 max 16384 2024-09-21T06:01:19.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b996a9740 1 Processor -- start 2024-09-21T06:01:19.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b996a9740 1 -- start start 2024-09-21T06:01:19.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b996a9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bc91b0 0x559339f9acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b996a9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bd1390 0x559339fb03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b996a9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bf2070 0x559339f96760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b996a9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c1b4120 con 0x559339bf2070 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b996a9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c1b19f0 con 0x559339bc91b0 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b996a9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c1af860 con 0x559339bd1390 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b916d2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bf2070 0x559339f96760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b916d2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bf2070 0x559339f96760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47196/0 (socket says 172.21.15.7:47196) 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b916d2640 1 -- 172.21.15.7:0/3939656637 learned_addr learned my addr 172.21.15.7:0/3939656637 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b90ed1640 1 --2- 172.21.15.7:0/3939656637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bc91b0 0x559339f9acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/3939656637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bd1390 0x559339fb03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b916d2640 1 -- 172.21.15.7:0/3939656637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bd1390 msgr2=0x559339fb03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b916d2640 1 --2- 172.21.15.7:0/3939656637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bd1390 0x559339fb03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b916d2640 1 -- 172.21.15.7:0/3939656637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bc91b0 msgr2=0x559339f9acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b916d2640 1 --2- 172.21.15.7:0/3939656637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bc91b0 0x559339f9acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.317+0000 7f0b916d2640 1 -- 172.21.15.7:0/3939656637 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559339f91440 con 0x559339bf2070 2024-09-21T06:01:19.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.318+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/3939656637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bd1390 0x559339fb03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:19.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.318+0000 7f0b916d2640 1 --2- 172.21.15.7:0/3939656637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bf2070 0x559339f96760 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f0b84011830 tx=0x7f0b84016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c609a314ad3ffd0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:19.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.318+0000 7f0b727fc640 1 -- 172.21.15.7:0/3939656637 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84004b20 con 0x559339bf2070 2024-09-21T06:01:19.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.318+0000 7f0b727fc640 1 -- 172.21.15.7:0/3939656637 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b84004cc0 con 0x559339bf2070 2024-09-21T06:01:19.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.318+0000 7f0b727fc640 1 -- 172.21.15.7:0/3939656637 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84028670 con 0x559339bf2070 2024-09-21T06:01:19.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.319+0000 7f0b996a9740 1 -- 172.21.15.7:0/3939656637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bf2070 msgr2=0x559339f96760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:19.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.319+0000 7f0b996a9740 1 --2- 172.21.15.7:0/3939656637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bf2070 0x559339f96760 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f0b84011830 tx=0x7f0b84016000 comp rx=0 tx=0).stop 2024-09-21T06:01:19.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.319+0000 7f0b996a9740 1 -- 172.21.15.7:0/3939656637 shutdown_connections 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.319+0000 7f0b996a9740 1 --2- 172.21.15.7:0/3939656637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bf2070 0x559339f96760 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.319+0000 7f0b996a9740 1 --2- 172.21.15.7:0/3939656637 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bd1390 0x559339fb03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.319+0000 7f0b996a9740 1 --2- 172.21.15.7:0/3939656637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bc91b0 0x559339f9acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.319+0000 7f0b996a9740 1 -- 172.21.15.7:0/3939656637 >> 172.21.15.7:0/3939656637 conn(0x559339be6460 msgr2=0x559339fafce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.319+0000 7f0b996a9740 1 -- 172.21.15.7:0/3939656637 shutdown_connections 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.319+0000 7f0b996a9740 1 -- 172.21.15.7:0/3939656637 wait complete. 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.319+0000 7f0b996a9740 1 -- start start 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.319+0000 7f0b996a9740 1 Processor -- start 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b996a9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 0x559339fa91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b996a9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bd1390 0x559339fa9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b996a9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bf2070 0x55933a020630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b996a9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c1afeb0 con 0x559339bc91b0 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b996a9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c1b1320 con 0x559339bd1390 2024-09-21T06:01:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b996a9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c1b0580 con 0x559339bf2070 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b996a9740 10 client.0 _ll_register_callbacks cb 0x7f0b7c005780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b90ed1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 0x559339fa91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b90ed1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 0x559339fa91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47208/0 (socket says 172.21.15.7:47208) 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b90ed1640 1 -- 172.21.15.7:0/2730246495 learned_addr learned my addr 172.21.15.7:0/2730246495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bd1390 0x559339fa9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b916d2640 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bf2070 0x55933a020630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b8bfff640 1 -- 172.21.15.7:0/2730246495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bf2070 msgr2=0x55933a020630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bf2070 0x55933a020630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b8bfff640 1 -- 172.21.15.7:0/2730246495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 msgr2=0x559339fa91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 0x559339fa91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b8bfff640 1 -- 172.21.15.7:0/2730246495 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55933a020b70 con 0x559339bd1390 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.320+0000 7f0b90ed1640 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 0x559339fa91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.321+0000 7f0b8bfff640 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bd1390 0x559339fa9780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000f630 tx=0x7f0b8000f420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8dbb357bc4b5ec8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.321+0000 7f0b6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T06:01:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.321+0000 7f0b6bfff640 1 -- 172.21.15.7:0/2730246495 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8000f920 con 0x559339bd1390 2024-09-21T06:01:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.321+0000 7f0b996a9740 1 -- 172.21.15.7:0/2730246495 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b84004cc0 con 0x559339bd1390 2024-09-21T06:01:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.321+0000 7f0b6bfff640 1 -- 172.21.15.7:0/2730246495 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f0b8000fac0 con 0x559339bd1390 2024-09-21T06:01:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.321+0000 7f0b6bfff640 1 -- 172.21.15.7:0/2730246495 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0b8000b590 con 0x559339bd1390 2024-09-21T06:01:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.321+0000 7f0b996a9740 10 client.27050 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.321+0000 7f0b996a9740 1 -- 172.21.15.7:0/2730246495 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55933a021d20 con 0x559339bd1390 2024-09-21T06:01:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.321+0000 7f0b6bfff640 1 -- 172.21.15.7:0/2730246495 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b84004cc0 con 0x559339bd1390 2024-09-21T06:01:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.321+0000 7f0b6bfff640 1 -- 172.21.15.7:0/2730246495 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0b8003cbd0 con 0x559339bd1390 2024-09-21T06:01:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.322+0000 7f0b996a9740 10 client.27050 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.322+0000 7f0b996a9740 10 client.27050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.322+0000 7f0b996a9740 20 client.27050 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.322+0000 7f0b996a9740 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559339b85da0 0x55933a0242d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.322+0000 7f0b996a9740 4 client.27050 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:01:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.322+0000 7f0b996a9740 1 -- 172.21.15.7:0/2730246495 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559339f0d8a0 con 0x559339b85da0 2024-09-21T06:01:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.322+0000 7f0b90ed1640 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559339b85da0 0x55933a0242d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.322+0000 7f0b90ed1640 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559339b85da0 0x55933a0242d0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2d2b77ce4d17a49 server_cookie=e513de56628803f8 in_seq=0 out_seq=0 2024-09-21T06:01:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.322+0000 7f0b6bfff640 10 client.27050 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b6bfff640 1 -- 172.21.15.7:0/2730246495 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559339f0d8a0 con 0x559339b85da0 2024-09-21T06:01:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b6bfff640 10 client.27050 handle_command_reply: tid=0 2024-09-21T06:01:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b996a9740 1 client.27050 shutdown 2024-09-21T06:01:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b996a9740 1 -- 172.21.15.7:0/2730246495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bd1390 msgr2=0x559339fa9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b996a9740 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bd1390 0x559339fa9780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000f630 tx=0x7f0b8000f420 comp rx=0 tx=0).stop 2024-09-21T06:01:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b996a9740 1 -- 172.21.15.7:0/2730246495 shutdown_connections 2024-09-21T06:01:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b996a9740 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559339b85da0 0x55933a0242d0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b996a9740 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559339bf2070 0x55933a020630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b6bfff640 0 client.27050 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:19.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b996a9740 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559339bd1390 0x559339fa9780 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b996a9740 1 --2- 172.21.15.7:0/2730246495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559339bc91b0 0x559339fa91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b996a9740 1 -- 172.21.15.7:0/2730246495 >> 172.21.15.7:0/2730246495 conn(0x559339be6460 msgr2=0x559339f9aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:19.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b996a9740 1 -- 172.21.15.7:0/2730246495 shutdown_connections 2024-09-21T06:01:19.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b996a9740 1 -- 172.21.15.7:0/2730246495 wait complete. 2024-09-21T06:01:19.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.323+0000 7f0b996a9740 20 client.27050 trim_cache size 0 max 16384 2024-09-21T06:01:19.329 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:01:19.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.324+0000 7f0b93135640 1 -- 172.21.15.7:0/1265669043 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0b740b6680 msgr2=0x7f0b740b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:19.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.324+0000 7f0b93135640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0b740b6680 0x7f0b740b8b90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0b84005fd0 tx=0x7f0b84009800 comp rx=0 tx=0).stop 2024-09-21T06:01:19.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.324+0000 7f0b93135640 1 -- 172.21.15.7:0/1265669043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b8c103250 msgr2=0x7f0b8c1100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:19.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.324+0000 7f0b93135640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b8c103250 0x7f0b8c1100e0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c005940 tx=0x7f0b7c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.324+0000 7f0b93135640 1 -- 172.21.15.7:0/1265669043 shutdown_connections 2024-09-21T06:01:19.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.324+0000 7f0b93135640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0b740b6680 0x7f0b740b8b90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.324+0000 7f0b93135640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b8c105b70 0x7f0b8c110b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.324+0000 7f0b93135640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b8c105220 0x7f0b8c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.324+0000 7f0b93135640 1 --2- 172.21.15.7:0/1265669043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b8c103250 0x7f0b8c1100e0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:19.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.324+0000 7f0b93135640 1 -- 172.21.15.7:0/1265669043 >> 172.21.15.7:0/1265669043 conn(0x7f0b8c079ea0 msgr2=0x7f0b8c1064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:19.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.324+0000 7f0b93135640 1 -- 172.21.15.7:0/1265669043 shutdown_connections 2024-09-21T06:01:19.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:19.324+0000 7f0b93135640 1 -- 172.21.15.7:0/1265669043 wait complete. 2024-09-21T06:01:19.963 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:19 smithi007 ceph-mon[30983]: pgmap v545: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:01:20.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:19 smithi119 ceph-mon[34833]: pgmap v545: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:01:20.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:19 smithi027 ceph-mon[34364]: pgmap v545: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:01:20.997 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:01:20.998 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:01:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.737+0000 7fbb422ea640 1 -- 172.21.15.7:0/1790017530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c105380 msgr2=0x7fbb3c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.737+0000 7fbb422ea640 1 --2- 172.21.15.7:0/1790017530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c105380 0x7fbb3c10d8d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009900 tx=0x7fbb3002a410 comp rx=0 tx=0).stop 2024-09-21T06:01:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.737+0000 7fbb422ea640 1 -- 172.21.15.7:0/1790017530 shutdown_connections 2024-09-21T06:01:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.737+0000 7fbb422ea640 1 --2- 172.21.15.7:0/1790017530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c105380 0x7fbb3c10d8d0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.737+0000 7fbb422ea640 1 --2- 172.21.15.7:0/1790017530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c10de90 0x7fbb3c110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.737+0000 7fbb422ea640 1 --2- 172.21.15.7:0/1790017530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb3c104a30 0x7fbb3c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.737+0000 7fbb422ea640 1 -- 172.21.15.7:0/1790017530 >> 172.21.15.7:0/1790017530 conn(0x7fbb3c079770 msgr2=0x7fbb3c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.737+0000 7fbb422ea640 1 -- 172.21.15.7:0/1790017530 shutdown_connections 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.737+0000 7fbb422ea640 1 -- 172.21.15.7:0/1790017530 wait complete. 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.738+0000 7fbb422ea640 1 Processor -- start 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.738+0000 7fbb422ea640 1 -- start start 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.738+0000 7fbb422ea640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb3c104a30 0x7fbb3c102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.738+0000 7fbb422ea640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c105380 0x7fbb3c102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.738+0000 7fbb422ea640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c10de90 0x7fbb3c1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.738+0000 7fbb422ea640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c113af0 con 0x7fbb3c105380 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.738+0000 7fbb422ea640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c113970 con 0x7fbb3c10de90 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.738+0000 7fbb422ea640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c113c70 con 0x7fbb3c104a30 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.738+0000 7fbb3b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c105380 0x7fbb3c102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.738+0000 7fbb3b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c105380 0x7fbb3c102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47224/0 (socket says 172.21.15.7:47224) 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.738+0000 7fbb3b7fe640 1 -- 172.21.15.7:0/940064565 learned_addr learned my addr 172.21.15.7:0/940064565 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.738+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb3c104a30 0x7fbb3c102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.738+0000 7fbb40887640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c10de90 0x7fbb3c1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.739+0000 7fbb3b7fe640 1 -- 172.21.15.7:0/940064565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb3c104a30 msgr2=0x7fbb3c102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.739+0000 7fbb3b7fe640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb3c104a30 0x7fbb3c102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.739+0000 7fbb3b7fe640 1 -- 172.21.15.7:0/940064565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c10de90 msgr2=0x7fbb3c1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.739+0000 7fbb3b7fe640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c10de90 0x7fbb3c1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.739+0000 7fbb3b7fe640 1 -- 172.21.15.7:0/940064565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3c1a8800 con 0x7fbb3c105380 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.739+0000 7fbb3b7fe640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c105380 0x7fbb3c102cb0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fbb3002a930 tx=0x7fbb30004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.739+0000 7fbb397fa640 1 -- 172.21.15.7:0/940064565 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3003f030 con 0x7fbb3c105380 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.739+0000 7fbb397fa640 1 -- 172.21.15.7:0/940064565 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb30003aa0 con 0x7fbb3c105380 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.739+0000 7fbb397fa640 1 -- 172.21.15.7:0/940064565 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30035070 con 0x7fbb3c105380 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.739+0000 7fbb422ea640 1 -- 172.21.15.7:0/940064565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3c1a8a90 con 0x7fbb3c105380 2024-09-21T06:01:21.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.739+0000 7fbb422ea640 1 -- 172.21.15.7:0/940064565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3c1a8f20 con 0x7fbb3c105380 2024-09-21T06:01:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.742+0000 7fbb4885e740 1 Processor -- start 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.742+0000 7fbb397fa640 1 -- 172.21.15.7:0/940064565 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fbb30042030 con 0x7fbb3c105380 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.742+0000 7fbb4885e740 1 -- start start 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.742+0000 7fbb4885e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d02430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.742+0000 7fbb4885e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 0x556475d02970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.742+0000 7fbb4885e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d02eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.742+0000 7fbb4885e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556475c78e60 con 0x55647595b350 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.742+0000 7fbb4885e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556475c68290 con 0x556475932490 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.742+0000 7fbb4885e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556475c6c0a0 con 0x55647593a670 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.742+0000 7fbb40887640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d02430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.742+0000 7fbb40887640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d02430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47232/0 (socket says 172.21.15.7:47232) 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.742+0000 7fbb40887640 1 -- 172.21.15.7:0/1390555204 learned_addr learned my addr 172.21.15.7:0/1390555204 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.742+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/1390555204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 0x556475d02970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb3b7fe640 1 --2- 172.21.15.7:0/1390555204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d02eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb40887640 1 -- 172.21.15.7:0/1390555204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 msgr2=0x556475d02eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb40887640 1 --2- 172.21.15.7:0/1390555204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d02eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb40887640 1 -- 172.21.15.7:0/1390555204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 msgr2=0x556475d02970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb40887640 1 --2- 172.21.15.7:0/1390555204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 0x556475d02970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb40887640 1 -- 172.21.15.7:0/1390555204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564759c6930 con 0x55647595b350 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb3b7fe640 1 --2- 172.21.15.7:0/1390555204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d02eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/1390555204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 0x556475d02970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb40887640 1 --2- 172.21.15.7:0/1390555204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d02430 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009fa0 tx=0x7fbb3400f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c22c75a4e1202b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb397fa640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbb240b6700 0x7fbb240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb227fc640 1 -- 172.21.15.7:0/1390555204 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34015070 con 0x55647595b350 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbb240b6700 0x7fbb240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb397fa640 1 -- 172.21.15.7:0/940064565 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fbb30107c00 con 0x7fbb3c105380 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb227fc640 1 -- 172.21.15.7:0/1390555204 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3401ab10 con 0x55647595b350 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.743+0000 7fbb227fc640 1 -- 172.21.15.7:0/1390555204 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34011d00 con 0x55647595b350 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.744+0000 7fbb4885e740 1 -- 172.21.15.7:0/1390555204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 msgr2=0x556475d02430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.744+0000 7fbb4885e740 1 --2- 172.21.15.7:0/1390555204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d02430 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009fa0 tx=0x7fbb3400f7f0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.744+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbb240b6700 0x7fbb240b8c10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x556475d010b0 tx=0x7fbb2c00b500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:21.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.744+0000 7fbb4885e740 1 -- 172.21.15.7:0/1390555204 shutdown_connections 2024-09-21T06:01:21.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.744+0000 7fbb4885e740 1 --2- 172.21.15.7:0/1390555204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d02eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.744+0000 7fbb4885e740 1 --2- 172.21.15.7:0/1390555204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 0x556475d02970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.744+0000 7fbb4885e740 1 --2- 172.21.15.7:0/1390555204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d02430 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.744+0000 7fbb4885e740 1 -- 172.21.15.7:0/1390555204 >> 172.21.15.7:0/1390555204 conn(0x55647594f740 msgr2=0x556475d00320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:21.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.744+0000 7fbb4885e740 1 -- 172.21.15.7:0/1390555204 shutdown_connections 2024-09-21T06:01:21.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.744+0000 7fbb4885e740 1 -- 172.21.15.7:0/1390555204 wait complete. 2024-09-21T06:01:21.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.745+0000 7fbb4885e740 1 -- start start 2024-09-21T06:01:21.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.745+0000 7fbb4885e740 1 Processor -- start 2024-09-21T06:01:21.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.745+0000 7fbb4885e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 0x556475d0e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.745+0000 7fbb4885e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d0e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.745+0000 7fbb4885e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d19f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.745+0000 7fbb4885e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556475ac9890 con 0x55647595b350 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.745+0000 7fbb4885e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556475c02d40 con 0x556475932490 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.745+0000 7fbb4885e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556475d10c10 con 0x55647593a670 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb4885e740 10 client.0 _ll_register_callbacks cb 0x556475c66c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb40887640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d19f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb40887640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d19f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47238/0 (socket says 172.21.15.7:47238) 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb40887640 1 -- 172.21.15.7:0/842558629 learned_addr learned my addr 172.21.15.7:0/842558629 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb3b7fe640 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d0e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 0x556475d0e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb40887640 1 -- 172.21.15.7:0/842558629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 msgr2=0x556475d0e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb40887640 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d0e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb40887640 1 -- 172.21.15.7:0/842558629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 msgr2=0x556475d0e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb40887640 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 0x556475d0e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb40887640 1 -- 172.21.15.7:0/842558629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556475d1a540 con 0x55647595b350 2024-09-21T06:01:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb3b7fe640 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d0e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb40887640 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d19f30 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fbb34011780 tx=0x7fbb34009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747fa360fd819cc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.746+0000 7fbb1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb1b7fe640 1 -- 172.21.15.7:0/842558629 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34029060 con 0x55647595b350 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb4885e740 1 -- 172.21.15.7:0/842558629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb3401ab10 con 0x55647595b350 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb1b7fe640 1 -- 172.21.15.7:0/842558629 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fbb34004a40 con 0x55647595b350 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb1b7fe640 1 -- 172.21.15.7:0/842558629 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbb34015050 con 0x55647595b350 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb4885e740 10 client.17706 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb4885e740 1 -- 172.21.15.7:0/842558629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556475d1ce70 con 0x55647595b350 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb1b7fe640 1 -- 172.21.15.7:0/842558629 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3401ab10 con 0x55647595b350 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb1b7fe640 1 -- 172.21.15.7:0/842558629 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbb340051e0 con 0x55647595b350 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb4885e740 10 client.17706 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb4885e740 10 client.17706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb4885e740 20 client.17706 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:21.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb4885e740 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556475919cd0 0x556475d20230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb4885e740 4 client.17706 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.747+0000 7fbb4885e740 1 -- 172.21.15.7:0/842558629 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556475c7adb0 con 0x556475919cd0 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.748+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556475919cd0 0x556475d20230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.748+0000 7fbb1b7fe640 10 client.17706 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.748+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556475919cd0 0x556475d20230 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=269f970dd46e3d51 server_cookie=b7bd140eddee42ff in_seq=0 out_seq=0 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.749+0000 7fbb1b7fe640 1 -- 172.21.15.7:0/842558629 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556475c7adb0 con 0x556475919cd0 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.749+0000 7fbb1b7fe640 10 client.17706 handle_command_reply: tid=0 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.749+0000 7fbb4885e740 1 client.17706 shutdown 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.749+0000 7fbb4885e740 1 -- 172.21.15.7:0/842558629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 msgr2=0x556475d19f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.749+0000 7fbb4885e740 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d19f30 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fbb34011780 tx=0x7fbb34009ce0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.750+0000 7fbb4885e740 1 -- 172.21.15.7:0/842558629 shutdown_connections 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.750+0000 7fbb4885e740 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556475919cd0 0x556475d20230 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.750+0000 7fbb4885e740 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d19f30 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.750+0000 7fbb4885e740 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d0e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.750+0000 7fbb4885e740 1 --2- 172.21.15.7:0/842558629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 0x556475d0e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.750+0000 7fbb4885e740 1 -- 172.21.15.7:0/842558629 >> 172.21.15.7:0/842558629 conn(0x55647594f740 msgr2=0x556475d05610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:21.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.750+0000 7fbb1b7fe640 0 client.17706 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:21.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.750+0000 7fbb4885e740 1 -- 172.21.15.7:0/842558629 shutdown_connections 2024-09-21T06:01:21.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.750+0000 7fbb4885e740 1 -- 172.21.15.7:0/842558629 wait complete. 2024-09-21T06:01:21.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.750+0000 7fbb4885e740 20 client.17706 trim_cache size 0 max 16384 2024-09-21T06:01:21.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb4885e740 1 Processor -- start 2024-09-21T06:01:21.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb4885e740 1 -- start start 2024-09-21T06:01:21.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb4885e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 0x556475d07bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb4885e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d0d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb4885e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d0fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb4885e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c1b4190 con 0x55647595b350 2024-09-21T06:01:21.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb4885e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c1b1a60 con 0x556475932490 2024-09-21T06:01:21.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb4885e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c1af8d0 con 0x55647593a670 2024-09-21T06:01:21.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb40887640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d0fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb40887640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d0fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47250/0 (socket says 172.21.15.7:47250) 2024-09-21T06:01:21.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb40887640 1 -- 172.21.15.7:0/1766390827 learned_addr learned my addr 172.21.15.7:0/1766390827 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:21.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb3b7fe640 1 --2- 172.21.15.7:0/1766390827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d0d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/1766390827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 0x556475d07bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb40887640 1 -- 172.21.15.7:0/1766390827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 msgr2=0x556475d0d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:21.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb40887640 1 --2- 172.21.15.7:0/1766390827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d0d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb40887640 1 -- 172.21.15.7:0/1766390827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 msgr2=0x556475d07bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:21.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.768+0000 7fbb40887640 1 --2- 172.21.15.7:0/1766390827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 0x556475d07bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.769+0000 7fbb40887640 1 -- 172.21.15.7:0/1766390827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556475d0e980 con 0x55647595b350 2024-09-21T06:01:21.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.769+0000 7fbb40887640 1 --2- 172.21.15.7:0/1766390827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d0fac0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fbb34006010 tx=0x7fbb34009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77a536da20fef8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:21.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.769+0000 7fbb21ffb640 1 -- 172.21.15.7:0/1766390827 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34029040 con 0x55647595b350 2024-09-21T06:01:21.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.769+0000 7fbb21ffb640 1 -- 172.21.15.7:0/1766390827 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb34003970 con 0x55647595b350 2024-09-21T06:01:21.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.769+0000 7fbb21ffb640 1 -- 172.21.15.7:0/1766390827 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34011aa0 con 0x55647595b350 2024-09-21T06:01:21.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.770+0000 7fbb4885e740 1 -- 172.21.15.7:0/1766390827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 msgr2=0x556475d0fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:21.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.770+0000 7fbb4885e740 1 --2- 172.21.15.7:0/1766390827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d0fac0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fbb34006010 tx=0x7fbb34009e20 comp rx=0 tx=0).stop 2024-09-21T06:01:21.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.770+0000 7fbb4885e740 1 -- 172.21.15.7:0/1766390827 shutdown_connections 2024-09-21T06:01:21.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.770+0000 7fbb4885e740 1 --2- 172.21.15.7:0/1766390827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d0fac0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.770+0000 7fbb4885e740 1 --2- 172.21.15.7:0/1766390827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55647593a670 0x556475d0d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.770+0000 7fbb4885e740 1 --2- 172.21.15.7:0/1766390827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556475932490 0x556475d07bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.770+0000 7fbb4885e740 1 -- 172.21.15.7:0/1766390827 >> 172.21.15.7:0/1766390827 conn(0x55647594f740 msgr2=0x556475d0f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.770+0000 7fbb4885e740 1 -- 172.21.15.7:0/1766390827 shutdown_connections 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.770+0000 7fbb4885e740 1 -- 172.21.15.7:0/1766390827 wait complete. 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.770+0000 7fbb4885e740 1 -- start start 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.770+0000 7fbb4885e740 1 Processor -- start 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb4885e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556475932490 0x556475d216f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb4885e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55647593a670 0x556475d21cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb4885e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d899b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb4885e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c1aff20 con 0x55647595b350 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb4885e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c1b1390 con 0x55647593a670 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb4885e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c1b05f0 con 0x556475932490 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb4885e740 10 client.0 _ll_register_callbacks cb 0x7fbb2c00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:21.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb40887640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d899b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb40887640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d899b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47258/0 (socket says 172.21.15.7:47258) 2024-09-21T06:01:21.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb40887640 1 -- 172.21.15.7:0/3009983909 learned_addr learned my addr 172.21.15.7:0/3009983909 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:21.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556475932490 0x556475d216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb3b7fe640 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55647593a670 0x556475d21cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb40887640 1 -- 172.21.15.7:0/3009983909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556475932490 msgr2=0x556475d216f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:21.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb40887640 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556475932490 0x556475d216f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb40887640 1 -- 172.21.15.7:0/3009983909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55647593a670 msgr2=0x556475d21cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:21.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb40887640 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55647593a670 0x556475d21cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb40887640 1 -- 172.21.15.7:0/3009983909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556475d89ef0 con 0x55647595b350 2024-09-21T06:01:21.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.771+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556475932490 0x556475d216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:21.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.772+0000 7fbb40887640 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d899b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fbb34003dd0 tx=0x7fbb34003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89756d3fd2db6b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:21.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.772+0000 7fbb1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:21.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.772+0000 7fbb1b7fe640 1 -- 172.21.15.7:0/3009983909 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34029070 con 0x55647595b350 2024-09-21T06:01:21.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.772+0000 7fbb1b7fe640 1 -- 172.21.15.7:0/3009983909 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fbb34005250 con 0x55647595b350 2024-09-21T06:01:21.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.772+0000 7fbb4885e740 1 -- 172.21.15.7:0/3009983909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb34003970 con 0x55647595b350 2024-09-21T06:01:21.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.772+0000 7fbb1b7fe640 1 -- 172.21.15.7:0/3009983909 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbb34045050 con 0x55647595b350 2024-09-21T06:01:21.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.772+0000 7fbb4885e740 10 client.17712 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:21.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.772+0000 7fbb4885e740 1 -- 172.21.15.7:0/3009983909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556475d8b0c0 con 0x55647595b350 2024-09-21T06:01:21.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.772+0000 7fbb1b7fe640 1 -- 172.21.15.7:0/3009983909 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb34003970 con 0x55647595b350 2024-09-21T06:01:21.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.772+0000 7fbb1b7fe640 1 -- 172.21.15.7:0/3009983909 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbb340117b0 con 0x55647595b350 2024-09-21T06:01:21.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.772+0000 7fbb4885e740 10 client.17712 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:21.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.772+0000 7fbb4885e740 10 client.17712 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:21.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.772+0000 7fbb4885e740 20 client.17712 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:21.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.773+0000 7fbb4885e740 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5564758ef080 0x556475d8d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:21.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.773+0000 7fbb4885e740 4 client.17712 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:01:21.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.773+0000 7fbb4885e740 1 -- 172.21.15.7:0/3009983909 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556475c76860 con 0x5564758ef080 2024-09-21T06:01:21.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.773+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5564758ef080 0x556475d8d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:21.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.773+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5564758ef080 0x556475d8d7b0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4804d04747fd712 server_cookie=8d2d3f95f6a07fb7 in_seq=0 out_seq=0 2024-09-21T06:01:21.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.773+0000 7fbb1b7fe640 10 client.17712 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:21.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.775+0000 7fbb1b7fe640 1 -- 172.21.15.7:0/3009983909 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556475c76860 con 0x5564758ef080 2024-09-21T06:01:21.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.775+0000 7fbb1b7fe640 10 client.17712 handle_command_reply: tid=0 2024-09-21T06:01:21.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.775+0000 7fbb4885e740 1 client.17712 shutdown 2024-09-21T06:01:21.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb4885e740 1 -- 172.21.15.7:0/3009983909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 msgr2=0x556475d899b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:21.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb4885e740 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d899b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fbb34003dd0 tx=0x7fbb34003e00 comp rx=0 tx=0).stop 2024-09-21T06:01:21.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb4885e740 1 -- 172.21.15.7:0/3009983909 shutdown_connections 2024-09-21T06:01:21.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb4885e740 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5564758ef080 0x556475d8d7b0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb4885e740 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55647595b350 0x556475d899b0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb4885e740 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55647593a670 0x556475d21cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb4885e740 1 --2- 172.21.15.7:0/3009983909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556475932490 0x556475d216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb4885e740 1 -- 172.21.15.7:0/3009983909 >> 172.21.15.7:0/3009983909 conn(0x55647594f740 msgr2=0x556475cfe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:21.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb1b7fe640 0 client.17712 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:21.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb4885e740 1 -- 172.21.15.7:0/3009983909 shutdown_connections 2024-09-21T06:01:21.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb4885e740 1 -- 172.21.15.7:0/3009983909 wait complete. 2024-09-21T06:01:21.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb4885e740 20 client.17712 trim_cache size 0 max 16384 2024-09-21T06:01:21.780 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:01:21.780 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:01:21.780 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "d9b96838-732e-40a1-9fad-f54faef73b59", 2024-09-21T06:01:21.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:01:21.781 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:01:21.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb422ea640 1 -- 172.21.15.7:0/940064565 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbb240b6700 msgr2=0x7fbb240b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:21.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb422ea640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbb240b6700 0x7fbb240b8c10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x556475d010b0 tx=0x7fbb2c00b500 comp rx=0 tx=0).stop 2024-09-21T06:01:21.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb422ea640 1 -- 172.21.15.7:0/940064565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c105380 msgr2=0x7fbb3c102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:21.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.776+0000 7fbb422ea640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c105380 0x7fbb3c102cb0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fbb3002a930 tx=0x7fbb30004270 comp rx=0 tx=0).stop 2024-09-21T06:01:21.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.777+0000 7fbb422ea640 1 -- 172.21.15.7:0/940064565 shutdown_connections 2024-09-21T06:01:21.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.777+0000 7fbb422ea640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fbb240b6700 0x7fbb240b8c10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.777+0000 7fbb422ea640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c105380 0x7fbb3c102cb0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.777+0000 7fbb422ea640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb3c10de90 0x7fbb3c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.777+0000 7fbb422ea640 1 --2- 172.21.15.7:0/940064565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb3c104a30 0x7fbb3c102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:21.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.777+0000 7fbb422ea640 1 -- 172.21.15.7:0/940064565 >> 172.21.15.7:0/940064565 conn(0x7fbb3c079770 msgr2=0x7fbb3c1008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:21.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.777+0000 7fbb422ea640 1 -- 172.21.15.7:0/940064565 shutdown_connections 2024-09-21T06:01:21.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:21.777+0000 7fbb422ea640 1 -- 172.21.15.7:0/940064565 wait complete. 2024-09-21T06:01:22.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:21 smithi007 ceph-mon[30983]: pgmap v546: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:01:22.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:21 smithi119 ceph-mon[34833]: pgmap v546: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:01:22.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:21 smithi027 ceph-mon[34364]: pgmap v546: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:01:22.426 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:01:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:23.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:22 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:01:23.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:22 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:23.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:22 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:01:23.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:22 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:23.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:22 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:01:23.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:22 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:01:23.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:22 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:23.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:22 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:01:23.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:22 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:23.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:22 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:01:23.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.211+0000 7f26b047e640 1 -- 172.21.15.7:0/1967910794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a8102a80 msgr2=0x7f26a8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:23.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.211+0000 7f26b047e640 1 --2- 172.21.15.7:0/1967910794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a8102a80 0x7f26a8102e90 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009900 tx=0x7f26a402a410 comp rx=0 tx=0).stop 2024-09-21T06:01:23.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.211+0000 7f26b047e640 1 -- 172.21.15.7:0/1967910794 shutdown_connections 2024-09-21T06:01:23.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.211+0000 7f26b047e640 1 --2- 172.21.15.7:0/1967910794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26a8108d10 0x7f26a810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.211+0000 7f26b047e640 1 --2- 172.21.15.7:0/1967910794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26a81083c0 0x7f26a81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.211+0000 7f26b047e640 1 --2- 172.21.15.7:0/1967910794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a8102a80 0x7f26a8102e90 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.211+0000 7f26b047e640 1 -- 172.21.15.7:0/1967910794 >> 172.21.15.7:0/1967910794 conn(0x7f26a8079740 msgr2=0x7f26a8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:23.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.211+0000 7f26b047e640 1 -- 172.21.15.7:0/1967910794 shutdown_connections 2024-09-21T06:01:23.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.211+0000 7f26b047e640 1 -- 172.21.15.7:0/1967910794 wait complete. 2024-09-21T06:01:23.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.212+0000 7f26b047e640 1 Processor -- start 2024-09-21T06:01:23.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.212+0000 7f26b047e640 1 -- start start 2024-09-21T06:01:23.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.212+0000 7f26b047e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a8102a80 0x7f26a8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.212+0000 7f26b047e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26a81083c0 0x7f26a81998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.212+0000 7f26b047e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26a8108d10 0x7f26a819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.212+0000 7f26b047e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26a8112980 con 0x7f26a8102a80 2024-09-21T06:01:23.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.212+0000 7f26b047e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f26a8112800 con 0x7f26a8108d10 2024-09-21T06:01:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.212+0000 7f26b047e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f26a8112b00 con 0x7f26a81083c0 2024-09-21T06:01:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.212+0000 7f26ae21a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a8102a80 0x7f26a8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.212+0000 7f26ae21a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a8102a80 0x7f26a8199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47290/0 (socket says 172.21.15.7:47290) 2024-09-21T06:01:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.212+0000 7f26ae21a640 1 -- 172.21.15.7:0/3712106898 learned_addr learned my addr 172.21.15.7:0/3712106898 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.212+0000 7f26ada19640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26a81083c0 0x7f26a81998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.213+0000 7f26aea1b640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26a8108d10 0x7f26a819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.213+0000 7f26ae21a640 1 -- 172.21.15.7:0/3712106898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26a81083c0 msgr2=0x7f26a81998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.213+0000 7f26ae21a640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26a81083c0 0x7f26a81998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.213+0000 7f26ae21a640 1 -- 172.21.15.7:0/3712106898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26a8108d10 msgr2=0x7f26a819eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.213+0000 7f26ae21a640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26a8108d10 0x7f26a819eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.213+0000 7f26ae21a640 1 -- 172.21.15.7:0/3712106898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a819f1e0 con 0x7f26a8102a80 2024-09-21T06:01:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.213+0000 7f26ae21a640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a8102a80 0x7f26a8199330 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f26a4005940 tx=0x7f26a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:23.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.213+0000 7f269f7fe640 1 -- 172.21.15.7:0/3712106898 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a403f030 con 0x7f26a8102a80 2024-09-21T06:01:23.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.213+0000 7f269f7fe640 1 -- 172.21.15.7:0/3712106898 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26a4003cb0 con 0x7f26a8102a80 2024-09-21T06:01:23.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.213+0000 7f26b047e640 1 -- 172.21.15.7:0/3712106898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a819f470 con 0x7f26a8102a80 2024-09-21T06:01:23.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.213+0000 7f269f7fe640 1 -- 172.21.15.7:0/3712106898 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4035070 con 0x7f26a8102a80 2024-09-21T06:01:23.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.213+0000 7f26b047e640 1 -- 172.21.15.7:0/3712106898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a819f950 con 0x7f26a8102a80 2024-09-21T06:01:23.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.216+0000 7f269f7fe640 1 -- 172.21.15.7:0/3712106898 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f26a4042030 con 0x7f26a8102a80 2024-09-21T06:01:23.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.216+0000 7f26b69f2740 1 Processor -- start 2024-09-21T06:01:23.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.216+0000 7f26b69f2740 1 -- start start 2024-09-21T06:01:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26b69f2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 0x5605bee8a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26b69f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 0x5605bee8a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26b69f2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beac0390 0x5605bee8af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26b69f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5605bedfee50 con 0x5605beab81b0 2024-09-21T06:01:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26b69f2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5605bedee280 con 0x5605beae1070 2024-09-21T06:01:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26b69f2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5605bedf2090 con 0x5605beac0390 2024-09-21T06:01:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26ae21a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 0x5605bee8a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26ae21a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 0x5605bee8a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47306/0 (socket says 172.21.15.7:47306) 2024-09-21T06:01:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26aea1b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 0x5605bee8a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26ae21a640 1 -- 172.21.15.7:0/1096298599 learned_addr learned my addr 172.21.15.7:0/1096298599 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26ada19640 1 --2- 172.21.15.7:0/1096298599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beac0390 0x5605bee8af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26aea1b640 1 -- 172.21.15.7:0/1096298599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beac0390 msgr2=0x5605bee8af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:23.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26aea1b640 1 --2- 172.21.15.7:0/1096298599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beac0390 0x5605bee8af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26aea1b640 1 -- 172.21.15.7:0/1096298599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 msgr2=0x5605bee8a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26aea1b640 1 --2- 172.21.15.7:0/1096298599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 0x5605bee8a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26aea1b640 1 -- 172.21.15.7:0/1096298599 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605beb4c650 con 0x5605beae1070 2024-09-21T06:01:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f269f7fe640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26940b6730 0x7f26940b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.217+0000 7f26ae21a640 1 --2- 172.21.15.7:0/1096298599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 0x5605bee8a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.218+0000 7f26aea1b640 1 --2- 172.21.15.7:0/1096298599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 0x5605bee8a480 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009f30 tx=0x7f26a0010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ff085020f9885b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.218+0000 7f269f7fe640 1 -- 172.21.15.7:0/3712106898 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f26a4107ad0 con 0x7f26a8102a80 2024-09-21T06:01:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.218+0000 7f26ae21a640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26940b6730 0x7f26940b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.218+0000 7f269cd9a640 1 -- 172.21.15.7:0/1096298599 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0016070 con 0x5605beae1070 2024-09-21T06:01:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.218+0000 7f269cd9a640 1 -- 172.21.15.7:0/1096298599 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26a0004d20 con 0x5605beae1070 2024-09-21T06:01:23.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.218+0000 7f269cd9a640 1 -- 172.21.15.7:0/1096298599 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0012720 con 0x5605beae1070 2024-09-21T06:01:23.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.219+0000 7f26b69f2740 1 -- 172.21.15.7:0/1096298599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 msgr2=0x5605bee8a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:23.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.219+0000 7f26ae21a640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26940b6730 0x7f26940b8c40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f26a40cd670 tx=0x7f26a410b620 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:23.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.219+0000 7f26b69f2740 1 --2- 172.21.15.7:0/1096298599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 0x5605bee8a480 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009f30 tx=0x7f26a0010800 comp rx=0 tx=0).stop 2024-09-21T06:01:23.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.219+0000 7f26b69f2740 1 -- 172.21.15.7:0/1096298599 shutdown_connections 2024-09-21T06:01:23.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.219+0000 7f26b69f2740 1 --2- 172.21.15.7:0/1096298599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 0x5605bee8a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.219+0000 7f26b69f2740 1 --2- 172.21.15.7:0/1096298599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beac0390 0x5605bee8af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.219+0000 7f26b69f2740 1 --2- 172.21.15.7:0/1096298599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 0x5605bee8a480 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.219+0000 7f26b69f2740 1 -- 172.21.15.7:0/1096298599 >> 172.21.15.7:0/1096298599 conn(0x5605bead5460 msgr2=0x5605bee88370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.219+0000 7f26b69f2740 1 -- 172.21.15.7:0/1096298599 shutdown_connections 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.219+0000 7f26b69f2740 1 -- 172.21.15.7:0/1096298599 wait complete. 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.219+0000 7f26b69f2740 1 -- start start 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.219+0000 7f26b69f2740 1 Processor -- start 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26b69f2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beab81b0 0x5605bee95b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26b69f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 0x5605bee96060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26b69f2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beae1070 0x5605bee965e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26b69f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5605bec4f700 con 0x5605beac0390 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26b69f2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5605bed89110 con 0x5605beab81b0 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26b69f2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5605bee98c60 con 0x5605beae1070 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26b69f2740 10 client.0 _ll_register_callbacks cb 0x5605beda2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26ada19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 0x5605bee96060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26ada19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 0x5605bee96060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47312/0 (socket says 172.21.15.7:47312) 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26ada19640 1 -- 172.21.15.7:0/2880488380 learned_addr learned my addr 172.21.15.7:0/2880488380 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26aea1b640 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beab81b0 0x5605bee95b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26aea1b640 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beae1070 0x5605bee965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26ada19640 1 -- 172.21.15.7:0/2880488380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beae1070 msgr2=0x5605bee965e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26ada19640 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beae1070 0x5605bee965e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26ada19640 1 -- 172.21.15.7:0/2880488380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beab81b0 msgr2=0x5605bee95b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26ada19640 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beab81b0 0x5605bee95b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26ada19640 1 -- 172.21.15.7:0/2880488380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605bedb6c40 con 0x5605beac0390 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.220+0000 7f26aea1b640 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beab81b0 0x5605bee95b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.221+0000 7f26ada19640 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 0x5605bee96060 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2698010820 tx=0x7f2698010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629e565f07f941dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.221+0000 7f2691ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.221+0000 7f2691ffb640 1 -- 172.21.15.7:0/2880488380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269800fb90 con 0x5605beac0390 2024-09-21T06:01:23.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.221+0000 7f2691ffb640 1 -- 172.21.15.7:0/2880488380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f269800fd30 con 0x5605beac0390 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.221+0000 7f26b69f2740 1 -- 172.21.15.7:0/2880488380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26a0004d20 con 0x5605beac0390 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.221+0000 7f2691ffb640 1 -- 172.21.15.7:0/2880488380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2698005020 con 0x5605beac0390 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.221+0000 7f26b69f2740 10 client.17724 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.221+0000 7f26b69f2740 1 -- 172.21.15.7:0/2880488380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5605beea49e0 con 0x5605beac0390 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.221+0000 7f2691ffb640 1 -- 172.21.15.7:0/2880488380 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26a0004d20 con 0x5605beac0390 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.221+0000 7f2691ffb640 1 -- 172.21.15.7:0/2880488380 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2698019410 con 0x5605beac0390 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.222+0000 7f26b69f2740 10 client.17724 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.222+0000 7f26b69f2740 10 client.17724 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.222+0000 7f26b69f2740 20 client.17724 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.222+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605bea9f9f0 0x5605beea8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.222+0000 7f26b69f2740 4 client.17724 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.222+0000 7f26b69f2740 1 -- 172.21.15.7:0/2880488380 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605bee00da0 con 0x5605bea9f9f0 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.222+0000 7f26aea1b640 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605bea9f9f0 0x5605beea8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.222+0000 7f26aea1b640 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605bea9f9f0 0x5605beea8040 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=237f17a2cbd5a42e server_cookie=70965f557e420b0 in_seq=0 out_seq=0 2024-09-21T06:01:23.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.222+0000 7f2691ffb640 10 client.17724 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:23.228 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:22 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:01:23.228 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:22 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:23.228 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:22 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:01:23.228 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:22 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:23.228 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:22 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:01:23.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f2691ffb640 1 -- 172.21.15.7:0/2880488380 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605bee00da0 con 0x5605bea9f9f0 2024-09-21T06:01:23.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f2691ffb640 10 client.17724 handle_command_reply: tid=0 2024-09-21T06:01:23.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f26b69f2740 1 client.17724 shutdown 2024-09-21T06:01:23.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f26b69f2740 1 -- 172.21.15.7:0/2880488380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 msgr2=0x5605bee96060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:23.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 0x5605bee96060 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2698010820 tx=0x7f2698010ce0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f26b69f2740 1 -- 172.21.15.7:0/2880488380 shutdown_connections 2024-09-21T06:01:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605bea9f9f0 0x5605beea8040 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 0x5605bee96060 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beae1070 0x5605bee965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2880488380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beab81b0 0x5605bee95b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f2691ffb640 0 client.17724 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f26b69f2740 1 -- 172.21.15.7:0/2880488380 >> 172.21.15.7:0/2880488380 conn(0x5605bead5460 msgr2=0x5605bee8d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f26b69f2740 1 -- 172.21.15.7:0/2880488380 shutdown_connections 2024-09-21T06:01:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f26b69f2740 1 -- 172.21.15.7:0/2880488380 wait complete. 2024-09-21T06:01:23.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.223+0000 7f26b69f2740 20 client.17724 trim_cache size 0 max 16384 2024-09-21T06:01:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.241+0000 7f26b69f2740 1 Processor -- start 2024-09-21T06:01:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.241+0000 7f26b69f2740 1 -- start start 2024-09-21T06:01:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.241+0000 7f26b69f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 0x5605bee8bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.241+0000 7f26b69f2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beac0390 0x5605bee95030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.241+0000 7f26b69f2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 0x5605bee97a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.241+0000 7f26b69f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26a81afae0 con 0x5605beab81b0 2024-09-21T06:01:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.241+0000 7f26b69f2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f26a81ad3b0 con 0x5605beae1070 2024-09-21T06:01:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.241+0000 7f26b69f2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f26a81ab220 con 0x5605beac0390 2024-09-21T06:01:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.241+0000 7f26aea1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 0x5605bee8bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.241+0000 7f26aea1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 0x5605bee8bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47322/0 (socket says 172.21.15.7:47322) 2024-09-21T06:01:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.241+0000 7f26aea1b640 1 -- 172.21.15.7:0/2394163969 learned_addr learned my addr 172.21.15.7:0/2394163969 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.242+0000 7f26ada19640 1 --2- 172.21.15.7:0/2394163969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beac0390 0x5605bee95030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.242+0000 7f26aea1b640 1 -- 172.21.15.7:0/2394163969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beac0390 msgr2=0x5605bee95030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:23.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.242+0000 7f26aea1b640 1 --2- 172.21.15.7:0/2394163969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beac0390 0x5605bee95030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.242+0000 7f26aea1b640 1 -- 172.21.15.7:0/2394163969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 msgr2=0x5605bee97a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:23.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.242+0000 7f26aea1b640 1 --2- 172.21.15.7:0/2394163969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 0x5605bee97a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.242+0000 7f26aea1b640 1 -- 172.21.15.7:0/2394163969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605bee8d2e0 con 0x5605beab81b0 2024-09-21T06:01:23.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.242+0000 7f26ada19640 1 --2- 172.21.15.7:0/2394163969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beac0390 0x5605bee95030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:23.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.242+0000 7f26aea1b640 1 --2- 172.21.15.7:0/2394163969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 0x5605bee8bf80 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f26a0005af0 tx=0x7f26a0009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70044e2c1540d7dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:23.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.242+0000 7f2693fff640 1 -- 172.21.15.7:0/2394163969 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0016030 con 0x5605beab81b0 2024-09-21T06:01:23.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.242+0000 7f2693fff640 1 -- 172.21.15.7:0/2394163969 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26a0003e20 con 0x5605beab81b0 2024-09-21T06:01:23.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.242+0000 7f2693fff640 1 -- 172.21.15.7:0/2394163969 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0023040 con 0x5605beab81b0 2024-09-21T06:01:23.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.243+0000 7f26b69f2740 1 -- 172.21.15.7:0/2394163969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 msgr2=0x5605bee8bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:23.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.243+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2394163969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 0x5605bee8bf80 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f26a0005af0 tx=0x7f26a0009600 comp rx=0 tx=0).stop 2024-09-21T06:01:23.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.243+0000 7f26b69f2740 1 -- 172.21.15.7:0/2394163969 shutdown_connections 2024-09-21T06:01:23.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.243+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2394163969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 0x5605bee97a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.243+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2394163969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beac0390 0x5605bee95030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.243+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2394163969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beab81b0 0x5605bee8bf80 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.243+0000 7f26b69f2740 1 -- 172.21.15.7:0/2394163969 >> 172.21.15.7:0/2394163969 conn(0x5605bead5460 msgr2=0x5605beea0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:23.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.243+0000 7f26b69f2740 1 -- 172.21.15.7:0/2394163969 shutdown_connections 2024-09-21T06:01:23.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.243+0000 7f26b69f2740 1 -- 172.21.15.7:0/2394163969 wait complete. 2024-09-21T06:01:23.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.243+0000 7f26b69f2740 1 -- start start 2024-09-21T06:01:23.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.243+0000 7f26b69f2740 1 Processor -- start 2024-09-21T06:01:23.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26b69f2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beab81b0 0x5605bee99f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26b69f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 0x5605bee9a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26b69f2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 0x5605bee9a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26b69f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26a81ab870 con 0x5605beac0390 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26b69f2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f26a81acce0 con 0x5605beae1070 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26b69f2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f26a81abf40 con 0x5605beab81b0 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26b69f2740 10 client.0 _ll_register_callbacks cb 0x7f269800a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26ada19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 0x5605bee9a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26ada19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 0x5605bee9a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47338/0 (socket says 172.21.15.7:47338) 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26ada19640 1 -- 172.21.15.7:0/2895263173 learned_addr learned my addr 172.21.15.7:0/2895263173 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26aea1b640 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beab81b0 0x5605bee99f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26aea1b640 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 0x5605bee9a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26ada19640 1 -- 172.21.15.7:0/2895263173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beab81b0 msgr2=0x5605bee99f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26ada19640 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beab81b0 0x5605bee99f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26ada19640 1 -- 172.21.15.7:0/2895263173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 msgr2=0x5605bee9a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26ada19640 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 0x5605bee9a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26ada19640 1 -- 172.21.15.7:0/2895263173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605bef11ab0 con 0x5605beac0390 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26aea1b640 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beab81b0 0x5605bee99f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f26ada19640 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 0x5605bee9a4a0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f2698010820 tx=0x7f2698019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7236e05f18e9ef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.244+0000 7f2691ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f2691ffb640 1 -- 172.21.15.7:0/2895263173 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269800fda0 con 0x5605beac0390 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f2691ffb640 1 -- 172.21.15.7:0/2895263173 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f26980051c0 con 0x5605beac0390 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f26b69f2740 1 -- 172.21.15.7:0/2895263173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26a0003e20 con 0x5605beac0390 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f2691ffb640 1 -- 172.21.15.7:0/2895263173 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f26980053c0 con 0x5605beac0390 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f26b69f2740 10 client.17730 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f26b69f2740 1 -- 172.21.15.7:0/2895263173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5605bef12d40 con 0x5605beac0390 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f2691ffb640 1 -- 172.21.15.7:0/2895263173 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26a0003e20 con 0x5605beac0390 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f2691ffb640 1 -- 172.21.15.7:0/2895263173 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2698023450 con 0x5605beac0390 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f26b69f2740 10 client.17730 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:23.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f26b69f2740 10 client.17730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f26b69f2740 20 client.17730 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605bea74da0 0x5605bef15570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f26b69f2740 4 client.17730 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.245+0000 7f26b69f2740 1 -- 172.21.15.7:0/2895263173 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5605bedfc850 con 0x5605bea74da0 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.246+0000 7f26aea1b640 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605bea74da0 0x5605bef15570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.246+0000 7f26aea1b640 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605bea74da0 0x5605bef15570 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42a73ce1d88048a6 server_cookie=7f48047e251fd2df in_seq=0 out_seq=0 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.246+0000 7f2691ffb640 10 client.17730 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.246+0000 7f2691ffb640 1 -- 172.21.15.7:0/2895263173 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6054 (crc 0 0 0) 0x5605bedfc850 con 0x5605bea74da0 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.246+0000 7f2691ffb640 10 client.17730 handle_command_reply: tid=0 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.246+0000 7f26b69f2740 1 client.17730 shutdown 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.247+0000 7f26b69f2740 1 -- 172.21.15.7:0/2895263173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 msgr2=0x5605bee9a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.247+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 0x5605bee9a4a0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f2698010820 tx=0x7f2698019740 comp rx=0 tx=0).stop 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.247+0000 7f26b69f2740 1 -- 172.21.15.7:0/2895263173 shutdown_connections 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.247+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5605bea74da0 0x5605bef15570 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.247+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5605beac0390 0x5605bee9a4a0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.247+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5605beae1070 0x5605bee9a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.247+0000 7f26b69f2740 1 --2- 172.21.15.7:0/2895263173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605beab81b0 0x5605bee99f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.247+0000 7f26b69f2740 1 -- 172.21.15.7:0/2895263173 >> 172.21.15.7:0/2895263173 conn(0x5605bead5460 msgr2=0x5605beea1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:23.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.247+0000 7f2691ffb640 0 client.17730 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:23.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.247+0000 7f26b69f2740 1 -- 172.21.15.7:0/2895263173 shutdown_connections 2024-09-21T06:01:23.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.247+0000 7f26b69f2740 1 -- 172.21.15.7:0/2895263173 wait complete. 2024-09-21T06:01:23.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.247+0000 7f26b69f2740 20 client.17730 trim_cache size 0 max 16384 2024-09-21T06:01:23.253 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:01:23.253 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:01:23.254 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:01:23.254 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:01:23.254 INFO:teuthology.orchestra.run.smithi007.stdout: "d9b96838-732e-40a1-9fad-f54faef73b59": { 2024-09-21T06:01:23.254 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:21.774276+0000", 2024-09-21T06:01:23.254 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.254 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.254 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.254 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.254 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.254 INFO:teuthology.orchestra.run.smithi007.stdout: "fd9e7ebd-b70a-487f-937b-80b64378d04b": { 2024-09-21T06:01:23.254 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:11.755521+0000", 2024-09-21T06:01:23.254 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: "3bd778db-a0ed-42ad-8a79-14a200f0734e": { 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:51.556015+0000", 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:01:23.255 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:01:23.256 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:01:23.257 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: "ecf3518d-a174-4cee-89a1-6aa26e1b3442": { 2024-09-21T06:01:23.258 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:01.909762+0000", 2024-09-21T06:01:23.259 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.259 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.259 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.259 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.259 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.259 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:01:23.259 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:01:23.259 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.259 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.259 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.259 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.259 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.260 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.261 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.261 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:01:23.261 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:01:23.261 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.261 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.261 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.261 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.261 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.262 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:01:23.262 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:01:23.262 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.262 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.262 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.262 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.262 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.262 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:01:23.263 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:01:23.263 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.263 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.263 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.263 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.263 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.263 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:01:23.264 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:01:23.264 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.264 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.264 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.264 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.264 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.264 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:01:23.264 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:01:23.265 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.265 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.265 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.265 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.265 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.265 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:01:23.265 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:01:23.266 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.266 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.266 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.266 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.266 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.266 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:01:23.266 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:01:23.266 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.267 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.267 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.267 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.267 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:23.267 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:01:23.267 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:01:23.267 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:23.268 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:23.268 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:23.268 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:23.268 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:23.268 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:01:23.268 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:01:23.268 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:01:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.248+0000 7f26b047e640 1 -- 172.21.15.7:0/3712106898 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26940b6730 msgr2=0x7f26940b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.248+0000 7f26b047e640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26940b6730 0x7f26940b8c40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f26a40cd670 tx=0x7f26a410b620 comp rx=0 tx=0).stop 2024-09-21T06:01:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.248+0000 7f26b047e640 1 -- 172.21.15.7:0/3712106898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a8102a80 msgr2=0x7f26a8199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.248+0000 7f26b047e640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a8102a80 0x7f26a8199330 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f26a4005940 tx=0x7f26a40042f0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.248+0000 7f26b047e640 1 -- 172.21.15.7:0/3712106898 shutdown_connections 2024-09-21T06:01:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.248+0000 7f26b047e640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f26940b6730 0x7f26940b8c40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.248+0000 7f26b047e640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26a8108d10 0x7f26a819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.248+0000 7f26b047e640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26a81083c0 0x7f26a81998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.248+0000 7f26b047e640 1 --2- 172.21.15.7:0/3712106898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a8102a80 0x7f26a8199330 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:23.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.248+0000 7f26b047e640 1 -- 172.21.15.7:0/3712106898 >> 172.21.15.7:0/3712106898 conn(0x7f26a8079740 msgr2=0x7f26a8101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:23.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.248+0000 7f26b047e640 1 -- 172.21.15.7:0/3712106898 shutdown_connections 2024-09-21T06:01:23.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:23.248+0000 7f26b047e640 1 -- 172.21.15.7:0/3712106898 wait complete. 2024-09-21T06:01:23.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:23 smithi007 ceph-mon[30983]: pgmap v547: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:01:23.971 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:01:23.971 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:01:24.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:23 smithi119 ceph-mon[34833]: pgmap v547: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:01:24.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:23 smithi027 ceph-mon[34364]: pgmap v547: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:01:24.227 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:24.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.844+0000 7fa52f1db640 1 -- 172.21.15.7:0/3469310993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa528109df0 msgr2=0x7fa528110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:24.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.844+0000 7fa52f1db640 1 --2- 172.21.15.7:0/3469310993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa528109df0 0x7fa528110620 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fa520009900 tx=0x7fa52002a410 comp rx=0 tx=0).stop 2024-09-21T06:01:24.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.844+0000 7fa52f1db640 1 -- 172.21.15.7:0/3469310993 shutdown_connections 2024-09-21T06:01:24.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.844+0000 7fa52f1db640 1 --2- 172.21.15.7:0/3469310993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa528109df0 0x7fa528110620 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:24.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.844+0000 7fa52f1db640 1 --2- 172.21.15.7:0/3469310993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5281094a0 0x7fa5281098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:24.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.844+0000 7fa52f1db640 1 --2- 172.21.15.7:0/3469310993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa528103b60 0x7fa528103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:24.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.844+0000 7fa52f1db640 1 -- 172.21.15.7:0/3469310993 >> 172.21.15.7:0/3469310993 conn(0x7fa52807b850 msgr2=0x7fa52807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:24.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.844+0000 7fa52f1db640 1 -- 172.21.15.7:0/3469310993 shutdown_connections 2024-09-21T06:01:24.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.844+0000 7fa52f1db640 1 -- 172.21.15.7:0/3469310993 wait complete. 2024-09-21T06:01:24.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.845+0000 7fa52f1db640 1 Processor -- start 2024-09-21T06:01:24.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.845+0000 7fa52f1db640 1 -- start start 2024-09-21T06:01:24.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.845+0000 7fa52f1db640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa528103b60 0x7fa52819c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:24.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.845+0000 7fa52f1db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5281094a0 0x7fa52819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:24.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.845+0000 7fa52f1db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa528109df0 0x7fa5281a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:24.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.845+0000 7fa52f1db640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa528113ab0 con 0x7fa528109df0 2024-09-21T06:01:24.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.845+0000 7fa52f1db640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa528113930 con 0x7fa528103b60 2024-09-21T06:01:24.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.845+0000 7fa52f1db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa528113c30 con 0x7fa5281094a0 2024-09-21T06:01:24.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.845+0000 7fa52d778640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa528109df0 0x7fa5281a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:24.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.845+0000 7fa52d778640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa528109df0 0x7fa5281a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47360/0 (socket says 172.21.15.7:47360) 2024-09-21T06:01:24.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.845+0000 7fa52d778640 1 -- 172.21.15.7:0/2848542223 learned_addr learned my addr 172.21.15.7:0/2848542223 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:24.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.845+0000 7fa52cf77640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa528103b60 0x7fa52819c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:24.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.845+0000 7fa527fff640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5281094a0 0x7fa52819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:24.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.846+0000 7fa52d778640 1 -- 172.21.15.7:0/2848542223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5281094a0 msgr2=0x7fa52819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:24.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.846+0000 7fa52d778640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5281094a0 0x7fa52819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:24.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.846+0000 7fa52d778640 1 -- 172.21.15.7:0/2848542223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa528103b60 msgr2=0x7fa52819c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:24.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.846+0000 7fa52d778640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa528103b60 0x7fa52819c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.846+0000 7fa52d778640 1 -- 172.21.15.7:0/2848542223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5281a25f0 con 0x7fa528109df0 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.846+0000 7fa52cf77640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa528103b60 0x7fa52819c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.846+0000 7fa52d778640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa528109df0 0x7fa5281a1ec0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fa520004770 tx=0x7fa520004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.846+0000 7fa525ffb640 1 -- 172.21.15.7:0/2848542223 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52003f030 con 0x7fa528109df0 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.846+0000 7fa52f1db640 1 -- 172.21.15.7:0/2848542223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5281a2880 con 0x7fa528109df0 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.846+0000 7fa525ffb640 1 -- 172.21.15.7:0/2848542223 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa520003aa0 con 0x7fa528109df0 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.846+0000 7fa525ffb640 1 -- 172.21.15.7:0/2848542223 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa520035070 con 0x7fa528109df0 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.846+0000 7fa52f1db640 1 -- 172.21.15.7:0/2848542223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5281a9040 con 0x7fa528109df0 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.847+0000 7fa52f1db640 1 -- 172.21.15.7:0/2848542223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa528104de0 con 0x7fa528109df0 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.849+0000 7fa525ffb640 1 -- 172.21.15.7:0/2848542223 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fa520042030 con 0x7fa528109df0 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.850+0000 7fa525ffb640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5140b6680 0x7fa5140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.850+0000 7fa525ffb640 1 -- 172.21.15.7:0/2848542223 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fa520108010 con 0x7fa528109df0 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.850+0000 7fa52cf77640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5140b6680 0x7fa5140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:24.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.850+0000 7fa52cf77640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5140b6680 0x7fa5140b8b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa510009c20 tx=0x7fa510005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:24.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:24.853+0000 7fa525ffb640 1 -- 172.21.15.7:0/2848542223 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5200ce5b0 con 0x7fa528109df0 2024-09-21T06:01:25.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.083+0000 7fa52f1db640 1 -- 172.21.15.7:0/2848542223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa528103f70 con 0x7fa528109df0 2024-09-21T06:01:25.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.083+0000 7fa525ffb640 1 -- 172.21.15.7:0/2848542223 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7fa528103f70 con 0x7fa528109df0 2024-09-21T06:01:25.085 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:01:25.085 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:01:25.086 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:01:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.086+0000 7fa52f1db640 1 -- 172.21.15.7:0/2848542223 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5140b6680 msgr2=0x7fa5140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.086+0000 7fa52f1db640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5140b6680 0x7fa5140b8b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa510009c20 tx=0x7fa510005f90 comp rx=0 tx=0).stop 2024-09-21T06:01:25.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.086+0000 7fa52f1db640 1 -- 172.21.15.7:0/2848542223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa528109df0 msgr2=0x7fa5281a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.086+0000 7fa52f1db640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa528109df0 0x7fa5281a1ec0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fa520004770 tx=0x7fa520004270 comp rx=0 tx=0).stop 2024-09-21T06:01:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.086+0000 7fa52f1db640 1 -- 172.21.15.7:0/2848542223 shutdown_connections 2024-09-21T06:01:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.086+0000 7fa52f1db640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fa5140b6680 0x7fa5140b8b90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.086+0000 7fa52f1db640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa528109df0 0x7fa5281a1ec0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.086+0000 7fa52f1db640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5281094a0 0x7fa52819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.086+0000 7fa52f1db640 1 --2- 172.21.15.7:0/2848542223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa528103b60 0x7fa52819c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.086+0000 7fa52f1db640 1 -- 172.21.15.7:0/2848542223 >> 172.21.15.7:0/2848542223 conn(0x7fa52807b850 msgr2=0x7fa5281072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:25.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.086+0000 7fa52f1db640 1 -- 172.21.15.7:0/2848542223 shutdown_connections 2024-09-21T06:01:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:25.086+0000 7fa52f1db640 1 -- 172.21.15.7:0/2848542223 wait complete. 2024-09-21T06:01:25.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:01:26.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:25 smithi007 ceph-mon[30983]: pgmap v548: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:01:26.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:25 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2848542223' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:26.078 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:26.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:25 smithi119 ceph-mon[34833]: pgmap v548: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:01:26.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:25 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2848542223' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:26.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:25 smithi027 ceph-mon[34364]: pgmap v548: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:01:26.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:25 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2848542223' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.562+0000 7fd664a4c640 1 -- 172.21.15.7:0/2354104154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd660102a60 msgr2=0x7fd660102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.562+0000 7fd664a4c640 1 --2- 172.21.15.7:0/2354104154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd660102a60 0x7fd660102e70 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fd650009900 tx=0x7fd65002a410 comp rx=0 tx=0).stop 2024-09-21T06:01:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.562+0000 7fd664a4c640 1 -- 172.21.15.7:0/2354104154 shutdown_connections 2024-09-21T06:01:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.562+0000 7fd664a4c640 1 --2- 172.21.15.7:0/2354104154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd660108cf0 0x7fd66010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.562+0000 7fd664a4c640 1 --2- 172.21.15.7:0/2354104154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6601083a0 0x7fd6601087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.562+0000 7fd664a4c640 1 --2- 172.21.15.7:0/2354104154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd660102a60 0x7fd660102e70 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.562+0000 7fd664a4c640 1 -- 172.21.15.7:0/2354104154 >> 172.21.15.7:0/2354104154 conn(0x7fd660079730 msgr2=0x7fd660079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.563+0000 7fd664a4c640 1 -- 172.21.15.7:0/2354104154 shutdown_connections 2024-09-21T06:01:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.563+0000 7fd664a4c640 1 -- 172.21.15.7:0/2354104154 wait complete. 2024-09-21T06:01:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.563+0000 7fd664a4c640 1 Processor -- start 2024-09-21T06:01:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.563+0000 7fd664a4c640 1 -- start start 2024-09-21T06:01:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd664a4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd660102a60 0x7fd66010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd664a4c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6601083a0 0x7fd6601104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd664a4c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd660108cf0 0x7fd660110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd664a4c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd660113a80 con 0x7fd660102a60 2024-09-21T06:01:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd664a4c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd660113900 con 0x7fd660108cf0 2024-09-21T06:01:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd664a4c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd660113c00 con 0x7fd6601083a0 2024-09-21T06:01:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd65e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd660102a60 0x7fd66010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd65e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd660102a60 0x7fd66010ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47382/0 (socket says 172.21.15.7:47382) 2024-09-21T06:01:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd65e59c640 1 -- 172.21.15.7:0/2099640102 learned_addr learned my addr 172.21.15.7:0/2099640102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd65ed9d640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd660108cf0 0x7fd660110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6601083a0 0x7fd6601104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd65e59c640 1 -- 172.21.15.7:0/2099640102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6601083a0 msgr2=0x7fd6601104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd65e59c640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6601083a0 0x7fd6601104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd65e59c640 1 -- 172.21.15.7:0/2099640102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd660108cf0 msgr2=0x7fd660110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd65e59c640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd660108cf0 0x7fd660110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd65e59c640 1 -- 172.21.15.7:0/2099640102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6601a8710 con 0x7fd660102a60 2024-09-21T06:01:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6601083a0 0x7fd6601104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.564+0000 7fd65e59c640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd660102a60 0x7fd66010ffb0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fd650005940 tx=0x7fd650004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.565+0000 7fd6577fe640 1 -- 172.21.15.7:0/2099640102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65003f030 con 0x7fd660102a60 2024-09-21T06:01:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.565+0000 7fd664a4c640 1 -- 172.21.15.7:0/2099640102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6601a89a0 con 0x7fd660102a60 2024-09-21T06:01:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.565+0000 7fd6577fe640 1 -- 172.21.15.7:0/2099640102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd650003aa0 con 0x7fd660102a60 2024-09-21T06:01:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.565+0000 7fd6577fe640 1 -- 172.21.15.7:0/2099640102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650035070 con 0x7fd660102a60 2024-09-21T06:01:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.565+0000 7fd664a4c640 1 -- 172.21.15.7:0/2099640102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6601a8ed0 con 0x7fd660102a60 2024-09-21T06:01:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.567+0000 7fd66afc0740 1 Processor -- start 2024-09-21T06:01:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.567+0000 7fd66afc0740 1 -- start start 2024-09-21T06:01:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd6577fe640 1 -- 172.21.15.7:0/2099640102 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd650042030 con 0x7fd660102a60 2024-09-21T06:01:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd66afc0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 0x556486f102c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd66afc0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 0x556486f10800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd66afc0740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f10d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd66afc0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556486e86ea0 con 0x556486b401b0 2024-09-21T06:01:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd66afc0740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556486e762d0 con 0x556486b48390 2024-09-21T06:01:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd66afc0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556486e7a0e0 con 0x556486b69070 2024-09-21T06:01:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd65e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 0x556486f10800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd65e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 0x556486f10800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47388/0 (socket says 172.21.15.7:47388) 2024-09-21T06:01:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd65e59c640 1 -- 172.21.15.7:0/482132687 learned_addr learned my addr 172.21.15.7:0/482132687 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/482132687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f10d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd65ed9d640 1 --2- 172.21.15.7:0/482132687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 0x556486f102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd65dd9b640 1 -- 172.21.15.7:0/482132687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 msgr2=0x556486f102c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/482132687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 0x556486f102c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd65dd9b640 1 -- 172.21.15.7:0/482132687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 msgr2=0x556486f10800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/482132687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 0x556486f10800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd65dd9b640 1 -- 172.21.15.7:0/482132687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556486bd4650 con 0x556486b48390 2024-09-21T06:01:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.568+0000 7fd65e59c640 1 --2- 172.21.15.7:0/482132687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 0x556486f10800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.569+0000 7fd6577fe640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd64c0b6680 0x7fd64c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.569+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/482132687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f10d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd660100cc0 tx=0x7fd64800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43b7be731993324d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.569+0000 7fd65ed9d640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd64c0b6680 0x7fd64c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.569+0000 7fd6577fe640 1 -- 172.21.15.7:0/2099640102 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fd650107d80 con 0x7fd660102a60 2024-09-21T06:01:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.569+0000 7fd654ff9640 1 -- 172.21.15.7:0/482132687 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648015070 con 0x556486b48390 2024-09-21T06:01:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.569+0000 7fd654ff9640 1 -- 172.21.15.7:0/482132687 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd64801a910 con 0x556486b48390 2024-09-21T06:01:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.569+0000 7fd654ff9640 1 -- 172.21.15.7:0/482132687 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6480118e0 con 0x556486b48390 2024-09-21T06:01:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.570+0000 7fd66afc0740 1 -- 172.21.15.7:0/482132687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 msgr2=0x556486f10d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.570+0000 7fd65ed9d640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd64c0b6680 0x7fd64c0b8b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd658005fd0 tx=0x7fd658009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.570+0000 7fd66afc0740 1 --2- 172.21.15.7:0/482132687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f10d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd660100cc0 tx=0x7fd64800f730 comp rx=0 tx=0).stop 2024-09-21T06:01:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.570+0000 7fd66afc0740 1 -- 172.21.15.7:0/482132687 shutdown_connections 2024-09-21T06:01:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.570+0000 7fd66afc0740 1 --2- 172.21.15.7:0/482132687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 0x556486f10800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.570+0000 7fd66afc0740 1 --2- 172.21.15.7:0/482132687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f10d40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.570+0000 7fd66afc0740 1 --2- 172.21.15.7:0/482132687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 0x556486f102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.570+0000 7fd66afc0740 1 -- 172.21.15.7:0/482132687 >> 172.21.15.7:0/482132687 conn(0x556486b5d460 msgr2=0x556486f0e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.570+0000 7fd66afc0740 1 -- 172.21.15.7:0/482132687 shutdown_connections 2024-09-21T06:01:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.570+0000 7fd66afc0740 1 -- 172.21.15.7:0/482132687 wait complete. 2024-09-21T06:01:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.570+0000 7fd66afc0740 1 -- start start 2024-09-21T06:01:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd66afc0740 1 Processor -- start 2024-09-21T06:01:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd66afc0740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b401b0 0x556486f1b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd66afc0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b48390 0x556486f1bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd66afc0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 0x556486f27dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd66afc0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556486cd7700 con 0x556486b48390 2024-09-21T06:01:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd66afc0740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556486e11160 con 0x556486b401b0 2024-09-21T06:01:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd66afc0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556486f1eaa0 con 0x556486b69070 2024-09-21T06:01:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd66afc0740 10 client.0 _ll_register_callbacks cb 0x556486e2a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd65dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b48390 0x556486f1bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd65dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b48390 0x556486f1bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47398/0 (socket says 172.21.15.7:47398) 2024-09-21T06:01:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd65dd9b640 1 -- 172.21.15.7:0/1648752430 learned_addr learned my addr 172.21.15.7:0/1648752430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd65e59c640 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b401b0 0x556486f1b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd65ed9d640 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 0x556486f27dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd65dd9b640 1 -- 172.21.15.7:0/1648752430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 msgr2=0x556486f27dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 0x556486f27dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd65dd9b640 1 -- 172.21.15.7:0/1648752430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b401b0 msgr2=0x556486f1b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b401b0 0x556486f1b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd65dd9b640 1 -- 172.21.15.7:0/1648752430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556486e3ec90 con 0x556486b48390 2024-09-21T06:01:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.571+0000 7fd65ed9d640 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 0x556486f27dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b48390 0x556486f1bec0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fd648006010 tx=0x7fd64800bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14e3f65cb134f24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:26.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd645ffb640 1 -- 172.21.15.7:0/1648752430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648029060 con 0x556486b48390 2024-09-21T06:01:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd645ffb640 1 -- 172.21.15.7:0/1648752430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fd64801acc0 con 0x556486b48390 2024-09-21T06:01:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd66afc0740 1 -- 172.21.15.7:0/1648752430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd64801a910 con 0x556486b48390 2024-09-21T06:01:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd645ffb640 1 -- 172.21.15.7:0/1648752430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd648015050 con 0x556486b48390 2024-09-21T06:01:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd66afc0740 10 client.17748 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd66afc0740 1 -- 172.21.15.7:0/1648752430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556486f2a780 con 0x556486b48390 2024-09-21T06:01:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd645ffb640 1 -- 172.21.15.7:0/1648752430 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd64801a910 con 0x556486b48390 2024-09-21T06:01:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd645ffb640 1 -- 172.21.15.7:0/1648752430 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd648023030 con 0x556486b48390 2024-09-21T06:01:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd66afc0740 10 client.17748 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd66afc0740 10 client.17748 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:01:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd66afc0740 20 client.17748 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.572+0000 7fd66afc0740 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x556486b279f0 0x556486f2db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.573+0000 7fd66afc0740 4 client.17748 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.573+0000 7fd66afc0740 1 -- 172.21.15.7:0/1648752430 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556486e88df0 con 0x556486b279f0 2024-09-21T06:01:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.573+0000 7fd65e59c640 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x556486b279f0 0x556486f2db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.573+0000 7fd645ffb640 10 client.17748 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:01:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.573+0000 7fd65e59c640 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x556486b279f0 0x556486f2db90 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=564a8f7198f5ea6b server_cookie=439baea63560b9ee in_seq=0 out_seq=0 2024-09-21T06:01:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd645ffb640 1 -- 172.21.15.7:0/1648752430 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556486e88df0 con 0x556486b279f0 2024-09-21T06:01:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd645ffb640 10 client.17748 handle_command_reply: tid=0 2024-09-21T06:01:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd66afc0740 1 client.17748 shutdown 2024-09-21T06:01:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd66afc0740 1 -- 172.21.15.7:0/1648752430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b48390 msgr2=0x556486f1bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd66afc0740 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b48390 0x556486f1bec0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fd648006010 tx=0x7fd64800bf70 comp rx=0 tx=0).stop 2024-09-21T06:01:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd66afc0740 1 -- 172.21.15.7:0/1648752430 shutdown_connections 2024-09-21T06:01:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd66afc0740 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x556486b279f0 0x556486f2db90 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd66afc0740 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b48390 0x556486f1bec0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd66afc0740 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 0x556486f27dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd645ffb640 0 client.17748 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:01:26.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd66afc0740 1 --2- 172.21.15.7:0/1648752430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b401b0 0x556486f1b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd66afc0740 1 -- 172.21.15.7:0/1648752430 >> 172.21.15.7:0/1648752430 conn(0x556486b5d460 msgr2=0x556486f13450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:26.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd66afc0740 1 -- 172.21.15.7:0/1648752430 shutdown_connections 2024-09-21T06:01:26.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.574+0000 7fd66afc0740 1 -- 172.21.15.7:0/1648752430 wait complete. 2024-09-21T06:01:26.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.575+0000 7fd66afc0740 20 client.17748 trim_cache size 0 max 16384 2024-09-21T06:01:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.588+0000 7fd66afc0740 1 Processor -- start 2024-09-21T06:01:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.588+0000 7fd66afc0740 1 -- start start 2024-09-21T06:01:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.588+0000 7fd66afc0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b401b0 0x556486f1a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.588+0000 7fd66afc0740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f27d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.588+0000 7fd66afc0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b69070 0x556486f11a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.588+0000 7fd66afc0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6601b4080 con 0x556486b69070 2024-09-21T06:01:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.588+0000 7fd66afc0740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd6601b1950 con 0x556486b48390 2024-09-21T06:01:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.588+0000 7fd66afc0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd6601af7c0 con 0x556486b401b0 2024-09-21T06:01:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.588+0000 7fd65ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b69070 0x556486f11a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd65ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b69070 0x556486f11a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47410/0 (socket says 172.21.15.7:47410) 2024-09-21T06:01:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd65ed9d640 1 -- 172.21.15.7:0/3294112677 learned_addr learned my addr 172.21.15.7:0/3294112677 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd65e59c640 1 --2- 172.21.15.7:0/3294112677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b401b0 0x556486f1a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/3294112677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f27d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd65ed9d640 1 -- 172.21.15.7:0/3294112677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b401b0 msgr2=0x556486f1a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd65ed9d640 1 --2- 172.21.15.7:0/3294112677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b401b0 0x556486f1a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd65ed9d640 1 -- 172.21.15.7:0/3294112677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 msgr2=0x556486f27d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd65ed9d640 1 --2- 172.21.15.7:0/3294112677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f27d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd65ed9d640 1 -- 172.21.15.7:0/3294112677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556486f13120 con 0x556486b69070 2024-09-21T06:01:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd65e59c640 1 --2- 172.21.15.7:0/3294112677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b401b0 0x556486f1a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd65ed9d640 1 --2- 172.21.15.7:0/3294112677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b69070 0x556486f11a00 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fd658003e40 tx=0x7fd658009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332f1725e475dac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd647fff640 1 -- 172.21.15.7:0/3294112677 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65800f5a0 con 0x556486b69070 2024-09-21T06:01:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd647fff640 1 -- 172.21.15.7:0/3294112677 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd65800fbf0 con 0x556486b69070 2024-09-21T06:01:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.589+0000 7fd647fff640 1 -- 172.21.15.7:0/3294112677 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65801ea60 con 0x556486b69070 2024-09-21T06:01:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.590+0000 7fd66afc0740 1 -- 172.21.15.7:0/3294112677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b69070 msgr2=0x556486f11a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.590+0000 7fd66afc0740 1 --2- 172.21.15.7:0/3294112677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b69070 0x556486f11a00 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fd658003e40 tx=0x7fd658009f90 comp rx=0 tx=0).stop 2024-09-21T06:01:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.590+0000 7fd66afc0740 1 -- 172.21.15.7:0/3294112677 shutdown_connections 2024-09-21T06:01:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.590+0000 7fd66afc0740 1 --2- 172.21.15.7:0/3294112677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b69070 0x556486f11a00 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.590+0000 7fd66afc0740 1 --2- 172.21.15.7:0/3294112677 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f27d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.590+0000 7fd66afc0740 1 --2- 172.21.15.7:0/3294112677 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b401b0 0x556486f1a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.590+0000 7fd66afc0740 1 -- 172.21.15.7:0/3294112677 >> 172.21.15.7:0/3294112677 conn(0x556486b5d460 msgr2=0x556486f112f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.590+0000 7fd66afc0740 1 -- 172.21.15.7:0/3294112677 shutdown_connections 2024-09-21T06:01:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.590+0000 7fd66afc0740 1 -- 172.21.15.7:0/3294112677 wait complete. 2024-09-21T06:01:26.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.591+0000 7fd66afc0740 1 -- start start 2024-09-21T06:01:26.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.591+0000 7fd66afc0740 1 Processor -- start 2024-09-21T06:01:26.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.591+0000 7fd66afc0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 0x556486f2ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.591+0000 7fd66afc0740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f2f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.591+0000 7fd66afc0740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 0x556486f2f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.591+0000 7fd66afc0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6601afe10 con 0x556486b401b0 2024-09-21T06:01:26.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.591+0000 7fd66afc0740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd6601b1280 con 0x556486b48390 2024-09-21T06:01:26.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.591+0000 7fd66afc0740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd6601b04e0 con 0x556486b69070 2024-09-21T06:01:26.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.591+0000 7fd66afc0740 10 client.0 _ll_register_callbacks cb 0x7fd65010b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:26.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.591+0000 7fd65e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 0x556486f2ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.591+0000 7fd65e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 0x556486f2ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47418/0 (socket says 172.21.15.7:47418) 2024-09-21T06:01:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.591+0000 7fd65e59c640 1 -- 172.21.15.7:0/729435517 learned_addr learned my addr 172.21.15.7:0/729435517 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.591+0000 7fd65ed9d640 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 0x556486f2f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f2f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd65e59c640 1 -- 172.21.15.7:0/729435517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 msgr2=0x556486f2f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd65e59c640 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 0x556486f2f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd65e59c640 1 -- 172.21.15.7:0/729435517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 msgr2=0x556486f2f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd65e59c640 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f2f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd65e59c640 1 -- 172.21.15.7:0/729435517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556486f97470 con 0x556486b401b0 2024-09-21T06:01:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f2f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd65e59c640 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 0x556486f2ed10 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fd6500ca1f0 tx=0x7fd65003bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa025b92798e426e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd645ffb640 1 -- 172.21.15.7:0/729435517 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650049040 con 0x556486b401b0 2024-09-21T06:01:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd645ffb640 1 -- 172.21.15.7:0/729435517 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fd650003c50 con 0x556486b401b0 2024-09-21T06:01:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd66afc0740 1 -- 172.21.15.7:0/729435517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd65800fbf0 con 0x556486b401b0 2024-09-21T06:01:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd645ffb640 1 -- 172.21.15.7:0/729435517 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd6500cd9f0 con 0x556486b401b0 2024-09-21T06:01:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd66afc0740 10 client.17754 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd66afc0740 1 -- 172.21.15.7:0/729435517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556486f98750 con 0x556486b401b0 2024-09-21T06:01:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.592+0000 7fd645ffb640 1 -- 172.21.15.7:0/729435517 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd65800fbf0 con 0x556486b401b0 2024-09-21T06:01:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.593+0000 7fd645ffb640 1 -- 172.21.15.7:0/729435517 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd6500f10b0 con 0x556486b401b0 2024-09-21T06:01:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.593+0000 7fd66afc0740 10 client.17754 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.593+0000 7fd66afc0740 10 client.17754 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:01:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.593+0000 7fd66afc0740 20 client.17754 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.593+0000 7fd66afc0740 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x556486afcda0 0x556486f9aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.593+0000 7fd66afc0740 4 client.17754 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:01:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.593+0000 7fd66afc0740 1 -- 172.21.15.7:0/729435517 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556486e848a0 con 0x556486afcda0 2024-09-21T06:01:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.593+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x556486afcda0 0x556486f9aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.593+0000 7fd645ffb640 10 client.17754 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:01:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.593+0000 7fd65dd9b640 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x556486afcda0 0x556486f9aef0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a1d6f68dc85ae43 server_cookie=5115c09d11db5e27 in_seq=0 out_seq=0 2024-09-21T06:01:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd645ffb640 1 -- 172.21.15.7:0/729435517 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556486e848a0 con 0x556486afcda0 2024-09-21T06:01:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd645ffb640 10 client.17754 handle_command_reply: tid=0 2024-09-21T06:01:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd66afc0740 1 client.17754 shutdown 2024-09-21T06:01:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd66afc0740 1 -- 172.21.15.7:0/729435517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 msgr2=0x556486f2ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd66afc0740 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 0x556486f2ed10 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fd6500ca1f0 tx=0x7fd65003bf30 comp rx=0 tx=0).stop 2024-09-21T06:01:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd66afc0740 1 -- 172.21.15.7:0/729435517 shutdown_connections 2024-09-21T06:01:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd66afc0740 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x556486afcda0 0x556486f9aef0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd66afc0740 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556486b69070 0x556486f2f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd66afc0740 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556486b48390 0x556486f2f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd645ffb640 0 client.17754 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:01:26.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd66afc0740 1 --2- 172.21.15.7:0/729435517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556486b401b0 0x556486f2ed10 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd66afc0740 1 -- 172.21.15.7:0/729435517 >> 172.21.15.7:0/729435517 conn(0x556486b5d460 msgr2=0x556486f11cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:26.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd66afc0740 1 -- 172.21.15.7:0/729435517 shutdown_connections 2024-09-21T06:01:26.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd66afc0740 1 -- 172.21.15.7:0/729435517 wait complete. 2024-09-21T06:01:26.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.594+0000 7fd66afc0740 20 client.17754 trim_cache size 0 max 16384 2024-09-21T06:01:26.603 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:01:26.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.595+0000 7fd664a4c640 1 -- 172.21.15.7:0/2099640102 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd64c0b6680 msgr2=0x7fd64c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:26.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.595+0000 7fd664a4c640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd64c0b6680 0x7fd64c0b8b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd658005fd0 tx=0x7fd658009500 comp rx=0 tx=0).stop 2024-09-21T06:01:26.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.595+0000 7fd664a4c640 1 -- 172.21.15.7:0/2099640102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd660102a60 msgr2=0x7fd66010ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:26.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.595+0000 7fd664a4c640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd660102a60 0x7fd66010ffb0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fd650005940 tx=0x7fd650004270 comp rx=0 tx=0).stop 2024-09-21T06:01:26.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.595+0000 7fd664a4c640 1 -- 172.21.15.7:0/2099640102 shutdown_connections 2024-09-21T06:01:26.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.595+0000 7fd664a4c640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd64c0b6680 0x7fd64c0b8b90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.595+0000 7fd664a4c640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd660108cf0 0x7fd660110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.595+0000 7fd664a4c640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6601083a0 0x7fd6601104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.595+0000 7fd664a4c640 1 --2- 172.21.15.7:0/2099640102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd660102a60 0x7fd66010ffb0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:26.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.595+0000 7fd664a4c640 1 -- 172.21.15.7:0/2099640102 >> 172.21.15.7:0/2099640102 conn(0x7fd660079730 msgr2=0x7fd660101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:26.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.595+0000 7fd664a4c640 1 -- 172.21.15.7:0/2099640102 shutdown_connections 2024-09-21T06:01:26.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:26.595+0000 7fd664a4c640 1 -- 172.21.15.7:0/2099640102 wait complete. 2024-09-21T06:01:27.391 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:01:27.649 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:28.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:27 smithi007 ceph-mon[30983]: pgmap v549: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:01:28.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:27 smithi119 ceph-mon[34833]: pgmap v549: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:01:28.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.131+0000 7f6f956e3640 1 -- 172.21.15.7:0/4185688722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f90108d00 msgr2=0x7f6f9010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:28.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.131+0000 7f6f956e3640 1 --2- 172.21.15.7:0/4185688722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f90108d00 0x7f6f9010f530 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009ca0 tx=0x7f6f8802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.131+0000 7f6f956e3640 1 -- 172.21.15.7:0/4185688722 shutdown_connections 2024-09-21T06:01:28.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.131+0000 7f6f956e3640 1 --2- 172.21.15.7:0/4185688722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f90108d00 0x7f6f9010f530 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.131+0000 7f6f956e3640 1 --2- 172.21.15.7:0/4185688722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f901083b0 0x7f6f901087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.131+0000 7f6f956e3640 1 --2- 172.21.15.7:0/4185688722 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f90102a70 0x7f6f90102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.131+0000 7f6f956e3640 1 -- 172.21.15.7:0/4185688722 >> 172.21.15.7:0/4185688722 conn(0x7f6f90079710 msgr2=0x7f6f90079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:28.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.131+0000 7f6f956e3640 1 -- 172.21.15.7:0/4185688722 shutdown_connections 2024-09-21T06:01:28.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.131+0000 7f6f956e3640 1 -- 172.21.15.7:0/4185688722 wait complete. 2024-09-21T06:01:28.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.131+0000 7f6f956e3640 1 Processor -- start 2024-09-21T06:01:28.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.131+0000 7f6f956e3640 1 -- start start 2024-09-21T06:01:28.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f956e3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f90102a70 0x7f6f90199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f956e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f901083b0 0x7f6f90199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f956e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f90108d00 0x7f6f90199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f956e3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901129c0 con 0x7f6f901083b0 2024-09-21T06:01:28.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f956e3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6f90112840 con 0x7f6f90108d00 2024-09-21T06:01:28.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f956e3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f90112b40 con 0x7f6f90102a70 2024-09-21T06:01:28.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f901083b0 0x7f6f90199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f901083b0 0x7f6f90199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47434/0 (socket says 172.21.15.7:47434) 2024-09-21T06:01:28.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f87fff640 1 -- 172.21.15.7:0/703650942 learned_addr learned my addr 172.21.15.7:0/703650942 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:28.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f8effd640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f90102a70 0x7f6f90199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f8f7fe640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f90108d00 0x7f6f90199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f87fff640 1 -- 172.21.15.7:0/703650942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f90102a70 msgr2=0x7f6f90199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:28.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f87fff640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f90102a70 0x7f6f90199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f87fff640 1 -- 172.21.15.7:0/703650942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f90108d00 msgr2=0x7f6f90199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:28.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f87fff640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f90108d00 0x7f6f90199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f87fff640 1 -- 172.21.15.7:0/703650942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f901a87b0 con 0x7f6f901083b0 2024-09-21T06:01:28.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.132+0000 7f6f87fff640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f901083b0 0x7f6f90199640 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800d740 tx=0x7f6f7800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:28.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.133+0000 7f6f8cff9640 1 -- 172.21.15.7:0/703650942 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78017070 con 0x7f6f901083b0 2024-09-21T06:01:28.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.133+0000 7f6f8cff9640 1 -- 172.21.15.7:0/703650942 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f7800de50 con 0x7f6f901083b0 2024-09-21T06:01:28.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.133+0000 7f6f8cff9640 1 -- 172.21.15.7:0/703650942 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800f620 con 0x7f6f901083b0 2024-09-21T06:01:28.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.133+0000 7f6f956e3640 1 -- 172.21.15.7:0/703650942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f901a8aa0 con 0x7f6f901083b0 2024-09-21T06:01:28.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.133+0000 7f6f956e3640 1 -- 172.21.15.7:0/703650942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f901a8fe0 con 0x7f6f901083b0 2024-09-21T06:01:28.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.135+0000 7f6f9bc57740 1 Processor -- start 2024-09-21T06:01:28.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.136+0000 7f6f9bc57740 1 -- start start 2024-09-21T06:01:28.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.136+0000 7f6f9bc57740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301af070 0x55bb305566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.136+0000 7f6f9bc57740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb301861b0 0x55bb30556be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.136+0000 7f6f9bc57740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb3018e390 0x55bb30557120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.136+0000 7f6f9bc57740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bb304ccea0 con 0x55bb301861b0 2024-09-21T06:01:28.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.136+0000 7f6f9bc57740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55bb304bc2d0 con 0x55bb301af070 2024-09-21T06:01:28.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.136+0000 7f6f9bc57740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55bb304c00e0 con 0x55bb3018e390 2024-09-21T06:01:28.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.136+0000 7f6f8cff9640 1 -- 172.21.15.7:0/703650942 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f6f7801a070 con 0x7f6f901083b0 2024-09-21T06:01:28.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.136+0000 7f6f8effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb301861b0 0x55bb30556be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.136+0000 7f6f8effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb301861b0 0x55bb30556be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47446/0 (socket says 172.21.15.7:47446) 2024-09-21T06:01:28.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.136+0000 7f6f8effd640 1 -- 172.21.15.7:0/173299432 learned_addr learned my addr 172.21.15.7:0/173299432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:28.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.136+0000 7f6f8f7fe640 1 --2- 172.21.15.7:0/173299432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301af070 0x55bb305566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.136+0000 7f6f87fff640 1 --2- 172.21.15.7:0/173299432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb3018e390 0x55bb30557120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.137+0000 7f6f8effd640 1 -- 172.21.15.7:0/173299432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb3018e390 msgr2=0x55bb30557120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:28.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.137+0000 7f6f8effd640 1 --2- 172.21.15.7:0/173299432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb3018e390 0x55bb30557120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.137+0000 7f6f8effd640 1 -- 172.21.15.7:0/173299432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301af070 msgr2=0x55bb305566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:28.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.137+0000 7f6f8effd640 1 --2- 172.21.15.7:0/173299432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301af070 0x55bb305566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.137+0000 7f6f8effd640 1 -- 172.21.15.7:0/173299432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb3021a650 con 0x55bb301861b0 2024-09-21T06:01:28.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.137+0000 7f6f8f7fe640 1 --2- 172.21.15.7:0/173299432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301af070 0x55bb305566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:28.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.137+0000 7f6f8effd640 1 --2- 172.21.15.7:0/173299432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb301861b0 0x55bb30556be0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f6f80004650 tx=0x7f6f8000bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e7989b0e0cd8ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:28.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.137+0000 7f6f8cff9640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6f7c0b6680 0x7f6f7c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.137+0000 7f6f857fa640 1 -- 172.21.15.7:0/173299432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80003bd0 con 0x55bb301861b0 2024-09-21T06:01:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.137+0000 7f6f857fa640 1 -- 172.21.15.7:0/173299432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f80015070 con 0x55bb301861b0 2024-09-21T06:01:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.137+0000 7f6f857fa640 1 -- 172.21.15.7:0/173299432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80004d80 con 0x55bb301861b0 2024-09-21T06:01:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.137+0000 7f6f8f7fe640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6f7c0b6680 0x7f6f7c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.137+0000 7f6f8cff9640 1 -- 172.21.15.7:0/703650942 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f6f780e7060 con 0x7f6f901083b0 2024-09-21T06:01:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.138+0000 7f6f9bc57740 1 -- 172.21.15.7:0/173299432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb301861b0 msgr2=0x55bb30556be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.138+0000 7f6f8f7fe640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6f7c0b6680 0x7f6f7c0b8b90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6f880094e0 tx=0x7f6f880093f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.138+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/173299432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb301861b0 0x55bb30556be0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f6f80004650 tx=0x7f6f8000bba0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.138+0000 7f6f9bc57740 1 -- 172.21.15.7:0/173299432 shutdown_connections 2024-09-21T06:01:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.138+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/173299432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb301861b0 0x55bb30556be0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.138+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/173299432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb3018e390 0x55bb30557120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.138+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/173299432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301af070 0x55bb305566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.138+0000 7f6f9bc57740 1 -- 172.21.15.7:0/173299432 >> 172.21.15.7:0/173299432 conn(0x55bb301a3460 msgr2=0x55bb30554590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:28.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.138+0000 7f6f9bc57740 1 -- 172.21.15.7:0/173299432 shutdown_connections 2024-09-21T06:01:28.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.138+0000 7f6f9bc57740 1 -- 172.21.15.7:0/173299432 wait complete. 2024-09-21T06:01:28.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f9bc57740 1 -- start start 2024-09-21T06:01:28.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f9bc57740 1 Processor -- start 2024-09-21T06:01:28.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f9bc57740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb30561d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f9bc57740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 0x55bb30562280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f9bc57740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb301af070 0x55bb30562800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f9bc57740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bb3031d700 con 0x55bb3018e390 2024-09-21T06:01:28.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f9bc57740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55bb30457160 con 0x55bb301861b0 2024-09-21T06:01:28.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f9bc57740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55bb30564e80 con 0x55bb301af070 2024-09-21T06:01:28.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f9bc57740 10 client.0 _ll_register_callbacks cb 0x55bb304709e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:28.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 0x55bb30562280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 0x55bb30562280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47454/0 (socket says 172.21.15.7:47454) 2024-09-21T06:01:28.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f87fff640 1 -- 172.21.15.7:0/756189890 learned_addr learned my addr 172.21.15.7:0/756189890 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:28.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f8f7fe640 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb301af070 0x55bb30562800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.139+0000 7f6f8effd640 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb30561d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f87fff640 1 -- 172.21.15.7:0/756189890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb301af070 msgr2=0x55bb30562800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:28.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f87fff640 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb301af070 0x55bb30562800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f87fff640 1 -- 172.21.15.7:0/756189890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 msgr2=0x55bb30561d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:28.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f87fff640 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb30561d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f87fff640 1 -- 172.21.15.7:0/756189890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb30484c90 con 0x55bb3018e390 2024-09-21T06:01:28.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f8effd640 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb30561d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:28.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f87fff640 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 0x55bb30562280 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f6f780e4860 tx=0x7f6f780a9610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a1e010f675cc88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:28.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f767fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:28.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f767fc640 1 -- 172.21.15.7:0/756189890 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78021030 con 0x55bb3018e390 2024-09-21T06:01:28.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f767fc640 1 -- 172.21.15.7:0/756189890 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f6f780e92d0 con 0x55bb3018e390 2024-09-21T06:01:28.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f9bc57740 1 -- 172.21.15.7:0/756189890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f80015070 con 0x55bb3018e390 2024-09-21T06:01:28.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f767fc640 1 -- 172.21.15.7:0/756189890 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6f780ac850 con 0x55bb3018e390 2024-09-21T06:01:28.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f9bc57740 10 client.17766 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:28.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f9bc57740 1 -- 172.21.15.7:0/756189890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bb30570b50 con 0x55bb3018e390 2024-09-21T06:01:28.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.140+0000 7f6f767fc640 1 -- 172.21.15.7:0/756189890 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f80015070 con 0x55bb3018e390 2024-09-21T06:01:28.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.141+0000 7f6f767fc640 1 -- 172.21.15.7:0/756189890 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6f780a8850 con 0x55bb3018e390 2024-09-21T06:01:28.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.141+0000 7f6f9bc57740 10 client.17766 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:28.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.141+0000 7f6f9bc57740 10 client.17766 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:01:28.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.141+0000 7f6f9bc57740 20 client.17766 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:28.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.141+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55bb3016d9f0 0x55bb30573fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.141+0000 7f6f9bc57740 4 client.17766 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:28.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.141+0000 7f6f9bc57740 1 -- 172.21.15.7:0/756189890 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb304cedf0 con 0x55bb3016d9f0 2024-09-21T06:01:28.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.141+0000 7f6f8effd640 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55bb3016d9f0 0x55bb30573fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.141+0000 7f6f8effd640 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55bb3016d9f0 0x55bb30573fe0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e1b14b2ef6ceb75 server_cookie=2c71cc7694866ea4 in_seq=0 out_seq=0 2024-09-21T06:01:28.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.141+0000 7f6f767fc640 10 client.17766 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:01:28.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.142+0000 7f6f767fc640 1 -- 172.21.15.7:0/756189890 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bb304cedf0 con 0x55bb3016d9f0 2024-09-21T06:01:28.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.142+0000 7f6f767fc640 10 client.17766 handle_command_reply: tid=0 2024-09-21T06:01:28.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.142+0000 7f6f9bc57740 1 client.17766 shutdown 2024-09-21T06:01:28.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.142+0000 7f6f9bc57740 1 -- 172.21.15.7:0/756189890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 msgr2=0x55bb30562280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:28.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.142+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 0x55bb30562280 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f6f780e4860 tx=0x7f6f780a9610 comp rx=0 tx=0).stop 2024-09-21T06:01:28.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.142+0000 7f6f9bc57740 1 -- 172.21.15.7:0/756189890 shutdown_connections 2024-09-21T06:01:28.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.142+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55bb3016d9f0 0x55bb30573fe0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.142+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 0x55bb30562280 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.142+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb301af070 0x55bb30562800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.142+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/756189890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb30561d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.142+0000 7f6f9bc57740 1 -- 172.21.15.7:0/756189890 >> 172.21.15.7:0/756189890 conn(0x55bb301a3460 msgr2=0x55bb30559830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:28.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.142+0000 7f6f767fc640 0 client.17766 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:01:28.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.143+0000 7f6f9bc57740 1 -- 172.21.15.7:0/756189890 shutdown_connections 2024-09-21T06:01:28.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.143+0000 7f6f9bc57740 1 -- 172.21.15.7:0/756189890 wait complete. 2024-09-21T06:01:28.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.143+0000 7f6f9bc57740 20 client.17766 trim_cache size 0 max 16384 2024-09-21T06:01:28.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.156+0000 7f6f9bc57740 1 Processor -- start 2024-09-21T06:01:28.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.156+0000 7f6f9bc57740 1 -- start start 2024-09-21T06:01:28.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f9bc57740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb3055d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f9bc57740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 0x55bb30563970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f9bc57740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb301af070 0x55bb3055ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f9bc57740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901b4110 con 0x55bb3018e390 2024-09-21T06:01:28.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f9bc57740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901b19e0 con 0x55bb301861b0 2024-09-21T06:01:28.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f9bc57740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901af850 con 0x55bb301af070 2024-09-21T06:01:28.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 0x55bb30563970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 0x55bb30563970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47458/0 (socket says 172.21.15.7:47458) 2024-09-21T06:01:28.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f87fff640 1 -- 172.21.15.7:0/3711577687 learned_addr learned my addr 172.21.15.7:0/3711577687 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:28.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f8effd640 1 --2- 172.21.15.7:0/3711577687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb3055d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f8f7fe640 1 --2- 172.21.15.7:0/3711577687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb301af070 0x55bb3055ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f87fff640 1 -- 172.21.15.7:0/3711577687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb301af070 msgr2=0x55bb3055ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:28.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f87fff640 1 --2- 172.21.15.7:0/3711577687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb301af070 0x55bb3055ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f87fff640 1 -- 172.21.15.7:0/3711577687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 msgr2=0x55bb3055d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:28.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f87fff640 1 --2- 172.21.15.7:0/3711577687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb3055d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f87fff640 1 -- 172.21.15.7:0/3711577687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb30559500 con 0x55bb3018e390 2024-09-21T06:01:28.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f8f7fe640 1 --2- 172.21.15.7:0/3711577687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb301af070 0x55bb3055ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:28.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f87fff640 1 --2- 172.21.15.7:0/3711577687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 0x55bb30563970 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f6f780ace90 tx=0x7f6f780a9680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db061600ed085071 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:28.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.157+0000 7f6f84ff9640 1 -- 172.21.15.7:0/3711577687 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78021070 con 0x55bb3018e390 2024-09-21T06:01:28.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.158+0000 7f6f84ff9640 1 -- 172.21.15.7:0/3711577687 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f780ad600 con 0x55bb3018e390 2024-09-21T06:01:28.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.158+0000 7f6f84ff9640 1 -- 172.21.15.7:0/3711577687 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f780ac670 con 0x55bb3018e390 2024-09-21T06:01:28.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.158+0000 7f6f9bc57740 1 -- 172.21.15.7:0/3711577687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 msgr2=0x55bb30563970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:28.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.158+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/3711577687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 0x55bb30563970 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f6f780ace90 tx=0x7f6f780a9680 comp rx=0 tx=0).stop 2024-09-21T06:01:28.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.158+0000 7f6f9bc57740 1 -- 172.21.15.7:0/3711577687 shutdown_connections 2024-09-21T06:01:28.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/3711577687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb3018e390 0x55bb30563970 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/3711577687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb301af070 0x55bb3055ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/3711577687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb3055d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 -- 172.21.15.7:0/3711577687 >> 172.21.15.7:0/3711577687 conn(0x55bb301a3460 msgr2=0x55bb30563260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:28.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 -- 172.21.15.7:0/3711577687 shutdown_connections 2024-09-21T06:01:28.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 -- 172.21.15.7:0/3711577687 wait complete. 2024-09-21T06:01:28.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 -- start start 2024-09-21T06:01:28.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 Processor -- start 2024-09-21T06:01:28.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb3056aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb3018e390 0x55bb30565f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb301af070 0x55bb30566680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901afea0 con 0x55bb301af070 2024-09-21T06:01:28.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901b1310 con 0x55bb301861b0 2024-09-21T06:01:28.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901b0570 con 0x55bb3018e390 2024-09-21T06:01:28.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.159+0000 7f6f9bc57740 10 client.0 _ll_register_callbacks cb 0x7f6f78009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:28.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f8f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb301af070 0x55bb30566680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f8effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb3056aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f8effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb3056aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:37586/0 (socket says 172.21.15.7:37586) 2024-09-21T06:01:28.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f8effd640 1 -- 172.21.15.7:0/1606948999 learned_addr learned my addr 172.21.15.7:0/1606948999 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:28.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f87fff640 1 --2- 172.21.15.7:0/1606948999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb3018e390 0x55bb30565f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f8f7fe640 1 -- 172.21.15.7:0/1606948999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb3018e390 msgr2=0x55bb30565f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:28.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f8f7fe640 1 --2- 172.21.15.7:0/1606948999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb3018e390 0x55bb30565f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f8f7fe640 1 -- 172.21.15.7:0/1606948999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 msgr2=0x55bb3056aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:28.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f8f7fe640 1 --2- 172.21.15.7:0/1606948999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb3056aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f8f7fe640 1 -- 172.21.15.7:0/1606948999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb305dd9a0 con 0x55bb301af070 2024-09-21T06:01:28.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f8f7fe640 1 --2- 172.21.15.7:0/1606948999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb301af070 0x55bb30566680 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f6f88006010 tx=0x7f6f880095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37984122fb587971 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:28.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f767fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:28.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f767fc640 1 -- 172.21.15.7:0/1606948999 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88056060 con 0x55bb301af070 2024-09-21T06:01:28.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f9bc57740 1 -- 172.21.15.7:0/1606948999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f780ad600 con 0x55bb301af070 2024-09-21T06:01:28.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.160+0000 7f6f767fc640 1 -- 172.21.15.7:0/1606948999 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f6f88004240 con 0x55bb301af070 2024-09-21T06:01:28.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.161+0000 7f6f767fc640 1 -- 172.21.15.7:0/1606948999 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6f88004440 con 0x55bb301af070 2024-09-21T06:01:28.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.161+0000 7f6f9bc57740 10 client.17772 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:28.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.161+0000 7f6f9bc57740 1 -- 172.21.15.7:0/1606948999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bb305dea80 con 0x55bb301af070 2024-09-21T06:01:28.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.161+0000 7f6f767fc640 1 -- 172.21.15.7:0/1606948999 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f780ad600 con 0x55bb301af070 2024-09-21T06:01:28.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.161+0000 7f6f767fc640 1 -- 172.21.15.7:0/1606948999 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6f88050070 con 0x55bb301af070 2024-09-21T06:01:28.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.161+0000 7f6f9bc57740 10 client.17772 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:28.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.161+0000 7f6f9bc57740 10 client.17772 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:01:28.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.161+0000 7f6f9bc57740 20 client.17772 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:28.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.161+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/1606948999 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55bb30142da0 0x55bb305e11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:28.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.161+0000 7f6f9bc57740 4 client.17772 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:01:28.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.161+0000 7f6f9bc57740 1 -- 172.21.15.7:0/1606948999 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bb304ca8a0 con 0x55bb30142da0 2024-09-21T06:01:28.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.161+0000 7f6f8effd640 1 --2- 172.21.15.7:0/1606948999 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55bb30142da0 0x55bb305e11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:28.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f767fc640 10 client.17772 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:01:28.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f8effd640 1 --2- 172.21.15.7:0/1606948999 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55bb30142da0 0x55bb305e11c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bee1eb2448a4770a server_cookie=3cd83b5a3ce1395f in_seq=0 out_seq=0 2024-09-21T06:01:28.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f767fc640 1 -- 172.21.15.7:0/1606948999 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bb304ca8a0 con 0x55bb30142da0 2024-09-21T06:01:28.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f767fc640 10 client.17772 handle_command_reply: tid=0 2024-09-21T06:01:28.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f9bc57740 1 client.17772 shutdown 2024-09-21T06:01:28.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f9bc57740 1 -- 172.21.15.7:0/1606948999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb301af070 msgr2=0x55bb30566680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:28.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/1606948999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb301af070 0x55bb30566680 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f6f88006010 tx=0x7f6f880095c0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f9bc57740 1 -- 172.21.15.7:0/1606948999 shutdown_connections 2024-09-21T06:01:28.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/1606948999 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55bb30142da0 0x55bb305e11c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/1606948999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb301af070 0x55bb30566680 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/1606948999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bb3018e390 0x55bb30565f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f9bc57740 1 --2- 172.21.15.7:0/1606948999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bb301861b0 0x55bb3056aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f9bc57740 1 -- 172.21.15.7:0/1606948999 >> 172.21.15.7:0/1606948999 conn(0x55bb301a3460 msgr2=0x55bb3056da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:28.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f767fc640 0 client.17772 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:01:28.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f9bc57740 1 -- 172.21.15.7:0/1606948999 shutdown_connections 2024-09-21T06:01:28.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.162+0000 7f6f9bc57740 1 -- 172.21.15.7:0/1606948999 wait complete. 2024-09-21T06:01:28.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.163+0000 7f6f9bc57740 20 client.17772 trim_cache size 0 max 16384 2024-09-21T06:01:28.180 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:01:28.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.163+0000 7f6f956e3640 1 -- 172.21.15.7:0/703650942 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6f7c0b6680 msgr2=0x7f6f7c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:28.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.163+0000 7f6f956e3640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6f7c0b6680 0x7f6f7c0b8b90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6f880094e0 tx=0x7f6f880093f0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.163+0000 7f6f956e3640 1 -- 172.21.15.7:0/703650942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f901083b0 msgr2=0x7f6f90199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:28.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.163+0000 7f6f956e3640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f901083b0 0x7f6f90199640 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800d740 tx=0x7f6f7800dc00 comp rx=0 tx=0).stop 2024-09-21T06:01:28.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.163+0000 7f6f956e3640 1 -- 172.21.15.7:0/703650942 shutdown_connections 2024-09-21T06:01:28.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.163+0000 7f6f956e3640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f6f7c0b6680 0x7f6f7c0b8b90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.163+0000 7f6f956e3640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f901083b0 0x7f6f90199640 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.163+0000 7f6f956e3640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f90108d00 0x7f6f90199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.163+0000 7f6f956e3640 1 --2- 172.21.15.7:0/703650942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f90102a70 0x7f6f90199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:28.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.163+0000 7f6f956e3640 1 -- 172.21.15.7:0/703650942 >> 172.21.15.7:0/703650942 conn(0x7f6f90079710 msgr2=0x7f6f90104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:28.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.163+0000 7f6f956e3640 1 -- 172.21.15.7:0/703650942 shutdown_connections 2024-09-21T06:01:28.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:28.163+0000 7f6f956e3640 1 -- 172.21.15.7:0/703650942 wait complete. 2024-09-21T06:01:28.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:27 smithi027 ceph-mon[34364]: pgmap v549: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:01:28.926 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:01:29.189 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:29.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.667+0000 7fac885ab640 1 -- 172.21.15.7:0/4229449619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac80101fc0 msgr2=0x7fac801023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:29.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.667+0000 7fac885ab640 1 --2- 172.21.15.7:0/4229449619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac80101fc0 0x7fac801023d0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009900 tx=0x7fac7c02a410 comp rx=0 tx=0).stop 2024-09-21T06:01:29.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.667+0000 7fac885ab640 1 -- 172.21.15.7:0/4229449619 shutdown_connections 2024-09-21T06:01:29.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.667+0000 7fac885ab640 1 --2- 172.21.15.7:0/4229449619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac80109e50 0x7fac80110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.667+0000 7fac885ab640 1 --2- 172.21.15.7:0/4229449619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac80109500 0x7fac80109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.667+0000 7fac885ab640 1 --2- 172.21.15.7:0/4229449619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac80101fc0 0x7fac801023d0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.667+0000 7fac885ab640 1 -- 172.21.15.7:0/4229449619 >> 172.21.15.7:0/4229449619 conn(0x7fac80079f90 msgr2=0x7fac8007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:29.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.667+0000 7fac885ab640 1 -- 172.21.15.7:0/4229449619 shutdown_connections 2024-09-21T06:01:29.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.667+0000 7fac885ab640 1 -- 172.21.15.7:0/4229449619 wait complete. 2024-09-21T06:01:29.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.668+0000 7fac885ab640 1 Processor -- start 2024-09-21T06:01:29.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.668+0000 7fac885ab640 1 -- start start 2024-09-21T06:01:29.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.668+0000 7fac885ab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac80101fc0 0x7fac8019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.668+0000 7fac885ab640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac80109500 0x7fac8019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.668+0000 7fac885ab640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac80109e50 0x7fac8019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.668+0000 7fac885ab640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fac80113b10 con 0x7fac80101fc0 2024-09-21T06:01:29.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.668+0000 7fac885ab640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fac80113990 con 0x7fac80109e50 2024-09-21T06:01:29.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.668+0000 7fac885ab640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fac80113c90 con 0x7fac80109500 2024-09-21T06:01:29.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.668+0000 7fac86347640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac80101fc0 0x7fac8019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.668+0000 7fac86347640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac80101fc0 0x7fac8019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42356/0 (socket says 172.21.15.7:42356) 2024-09-21T06:01:29.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.668+0000 7fac86347640 1 -- 172.21.15.7:0/3876937194 learned_addr learned my addr 172.21.15.7:0/3876937194 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:29.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.668+0000 7fac85b46640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac80109500 0x7fac8019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.668+0000 7fac86b48640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac80109e50 0x7fac8019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.669+0000 7fac86347640 1 -- 172.21.15.7:0/3876937194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac80109500 msgr2=0x7fac8019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.669+0000 7fac86347640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac80109500 0x7fac8019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.669+0000 7fac86347640 1 -- 172.21.15.7:0/3876937194 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac80109e50 msgr2=0x7fac8019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.669+0000 7fac86347640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac80109e50 0x7fac8019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.669+0000 7fac86347640 1 -- 172.21.15.7:0/3876937194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac801a0450 con 0x7fac80101fc0 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.669+0000 7fac86347640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac80101fc0 0x7fac8019a4e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fac7c005940 tx=0x7fac7c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.669+0000 7fac777fe640 1 -- 172.21.15.7:0/3876937194 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c03f030 con 0x7fac80101fc0 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.669+0000 7fac885ab640 1 -- 172.21.15.7:0/3876937194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac801a06e0 con 0x7fac80101fc0 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.669+0000 7fac777fe640 1 -- 172.21.15.7:0/3876937194 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac7c003aa0 con 0x7fac80101fc0 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.669+0000 7fac777fe640 1 -- 172.21.15.7:0/3876937194 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c035070 con 0x7fac80101fc0 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.669+0000 7fac885ab640 1 -- 172.21.15.7:0/3876937194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac801a6ea0 con 0x7fac80101fc0 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.672+0000 7fac8eb1f740 1 Processor -- start 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.672+0000 7fac8eb1f740 1 -- start start 2024-09-21T06:01:29.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.672+0000 7fac777fe640 1 -- 172.21.15.7:0/3876937194 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fac7c042030 con 0x7fac80101fc0 2024-09-21T06:01:29.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.672+0000 7fac8eb1f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f065070 0x55c16f40c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.672+0000 7fac8eb1f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f03c1b0 0x55c16f40cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.672+0000 7fac8eb1f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 0x55c16f40d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.672+0000 7fac8eb1f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c16f382ea0 con 0x55c16f044390 2024-09-21T06:01:29.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.672+0000 7fac8eb1f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c16f3722d0 con 0x55c16f03c1b0 2024-09-21T06:01:29.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.672+0000 7fac8eb1f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c16f3760e0 con 0x55c16f065070 2024-09-21T06:01:29.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.672+0000 7fac85b46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 0x55c16f40d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.672+0000 7fac86347640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f03c1b0 0x55c16f40cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.672+0000 7fac85b46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 0x55c16f40d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42364/0 (socket says 172.21.15.7:42364) 2024-09-21T06:01:29.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.672+0000 7fac85b46640 1 -- 172.21.15.7:0/1544034352 learned_addr learned my addr 172.21.15.7:0/1544034352 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:29.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac86b48640 1 --2- 172.21.15.7:0/1544034352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f065070 0x55c16f40c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac85b46640 1 -- 172.21.15.7:0/1544034352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f065070 msgr2=0x55c16f40c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:29.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac85b46640 1 --2- 172.21.15.7:0/1544034352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f065070 0x55c16f40c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac85b46640 1 -- 172.21.15.7:0/1544034352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f03c1b0 msgr2=0x55c16f40cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac85b46640 1 --2- 172.21.15.7:0/1544034352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f03c1b0 0x55c16f40cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac85b46640 1 -- 172.21.15.7:0/1544034352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c16f0d0650 con 0x55c16f044390 2024-09-21T06:01:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac86347640 1 --2- 172.21.15.7:0/1544034352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f03c1b0 0x55c16f40cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac777fe640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fac6c0b6680 0x7fac6c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac85b46640 1 --2- 172.21.15.7:0/1544034352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 0x55c16f40d120 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fac70009c20 tx=0x7fac70011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a72a550cfbd9fca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac86b48640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fac6c0b6680 0x7fac6c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac777fe640 1 -- 172.21.15.7:0/3876937194 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fac7c107a10 con 0x7fac80101fc0 2024-09-21T06:01:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac74ff9640 1 -- 172.21.15.7:0/1544034352 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70004050 con 0x55c16f044390 2024-09-21T06:01:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac74ff9640 1 -- 172.21.15.7:0/1544034352 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac700054d0 con 0x55c16f044390 2024-09-21T06:01:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.673+0000 7fac74ff9640 1 -- 172.21.15.7:0/1544034352 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70004c60 con 0x55c16f044390 2024-09-21T06:01:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.674+0000 7fac8eb1f740 1 -- 172.21.15.7:0/1544034352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 msgr2=0x55c16f40d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.674+0000 7fac86b48640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fac6c0b6680 0x7fac6c0b8b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fac78005fd0 tx=0x7fac78009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.674+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/1544034352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 0x55c16f40d120 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fac70009c20 tx=0x7fac70011810 comp rx=0 tx=0).stop 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.674+0000 7fac8eb1f740 1 -- 172.21.15.7:0/1544034352 shutdown_connections 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.674+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/1544034352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 0x55c16f40d120 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.674+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/1544034352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f03c1b0 0x55c16f40cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.674+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/1544034352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f065070 0x55c16f40c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.674+0000 7fac8eb1f740 1 -- 172.21.15.7:0/1544034352 >> 172.21.15.7:0/1544034352 conn(0x55c16f059460 msgr2=0x55c16f40a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.675+0000 7fac8eb1f740 1 -- 172.21.15.7:0/1544034352 shutdown_connections 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.675+0000 7fac8eb1f740 1 -- 172.21.15.7:0/1544034352 wait complete. 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.675+0000 7fac8eb1f740 1 -- start start 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.675+0000 7fac8eb1f740 1 Processor -- start 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac8eb1f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f03c1b0 0x55c16f41c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac8eb1f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f044390 0x55c16f41c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac8eb1f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 0x55c16f428510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac8eb1f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c16f1d3700 con 0x55c16f065070 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac8eb1f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c16f30d160 con 0x55c16f044390 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac8eb1f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c16f41f1e0 con 0x55c16f03c1b0 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac8eb1f740 10 client.0 _ll_register_callbacks cb 0x55c16f3269e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac86b48640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 0x55c16f428510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac86b48640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 0x55c16f428510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42374/0 (socket says 172.21.15.7:42374) 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac86b48640 1 -- 172.21.15.7:0/954953426 learned_addr learned my addr 172.21.15.7:0/954953426 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac85b46640 1 --2- 172.21.15.7:0/954953426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f044390 0x55c16f41c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac86347640 1 --2- 172.21.15.7:0/954953426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f03c1b0 0x55c16f41c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac86b48640 1 -- 172.21.15.7:0/954953426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f03c1b0 msgr2=0x55c16f41c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac86b48640 1 --2- 172.21.15.7:0/954953426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f03c1b0 0x55c16f41c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac86b48640 1 -- 172.21.15.7:0/954953426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f044390 msgr2=0x55c16f41c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac86b48640 1 --2- 172.21.15.7:0/954953426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f044390 0x55c16f41c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac86b48640 1 -- 172.21.15.7:0/954953426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c16f33ac90 con 0x55c16f065070 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac86b48640 1 --2- 172.21.15.7:0/954953426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 0x55c16f428510 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fac78005c40 tx=0x7fac78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ae9e494b7b1ca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:29.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac69ffb640 1 -- 172.21.15.7:0/954953426 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78020620 con 0x55c16f065070 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac8eb1f740 1 -- 172.21.15.7:0/954953426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac700054d0 con 0x55c16f065070 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.676+0000 7fac69ffb640 1 -- 172.21.15.7:0/954953426 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fac780207c0 con 0x55c16f065070 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.677+0000 7fac69ffb640 1 -- 172.21.15.7:0/954953426 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac78020a00 con 0x55c16f065070 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.677+0000 7fac8eb1f740 10 client.17784 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.677+0000 7fac8eb1f740 1 -- 172.21.15.7:0/954953426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c16f42af30 con 0x55c16f065070 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.677+0000 7fac69ffb640 1 -- 172.21.15.7:0/954953426 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac700054d0 con 0x55c16f065070 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.677+0000 7fac69ffb640 1 -- 172.21.15.7:0/954953426 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fac7800f040 con 0x55c16f065070 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.677+0000 7fac8eb1f740 10 client.17784 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.677+0000 7fac8eb1f740 10 client.17784 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.677+0000 7fac8eb1f740 20 client.17784 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.677+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/954953426 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c16f0239f0 0x55c16f42e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.677+0000 7fac8eb1f740 4 client.17784 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.677+0000 7fac8eb1f740 1 -- 172.21.15.7:0/954953426 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c16f384df0 con 0x55c16f0239f0 2024-09-21T06:01:29.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.677+0000 7fac86347640 1 --2- 172.21.15.7:0/954953426 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c16f0239f0 0x55c16f42e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.678+0000 7fac86347640 1 --2- 172.21.15.7:0/954953426 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c16f0239f0 0x55c16f42e510 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8513e54ea619c83d server_cookie=3f76258fcd605005 in_seq=0 out_seq=0 2024-09-21T06:01:29.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.678+0000 7fac69ffb640 10 client.17784 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:29.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac69ffb640 1 -- 172.21.15.7:0/954953426 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c16f384df0 con 0x55c16f0239f0 2024-09-21T06:01:29.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac69ffb640 10 client.17784 handle_command_reply: tid=0 2024-09-21T06:01:29.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac8eb1f740 1 client.17784 shutdown 2024-09-21T06:01:29.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac8eb1f740 1 -- 172.21.15.7:0/954953426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 msgr2=0x55c16f428510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:29.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/954953426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 0x55c16f428510 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fac78005c40 tx=0x7fac78004a40 comp rx=0 tx=0).stop 2024-09-21T06:01:29.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac8eb1f740 1 -- 172.21.15.7:0/954953426 shutdown_connections 2024-09-21T06:01:29.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/954953426 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c16f0239f0 0x55c16f42e510 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/954953426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 0x55c16f428510 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/954953426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f044390 0x55c16f41c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/954953426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f03c1b0 0x55c16f41c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac8eb1f740 1 -- 172.21.15.7:0/954953426 >> 172.21.15.7:0/954953426 conn(0x55c16f059460 msgr2=0x55c16f408bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:29.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac69ffb640 0 client.17784 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:29.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac8eb1f740 1 -- 172.21.15.7:0/954953426 shutdown_connections 2024-09-21T06:01:29.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac8eb1f740 1 -- 172.21.15.7:0/954953426 wait complete. 2024-09-21T06:01:29.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.679+0000 7fac8eb1f740 20 client.17784 trim_cache size 0 max 16384 2024-09-21T06:01:29.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.692+0000 7fac8eb1f740 1 Processor -- start 2024-09-21T06:01:29.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac8eb1f740 1 -- start start 2024-09-21T06:01:29.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac8eb1f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f03c1b0 0x55c16f411f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac8eb1f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 0x55c16f428410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac8eb1f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f065070 0x55c16f419330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac8eb1f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fac801afc30 con 0x55c16f044390 2024-09-21T06:01:29.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac8eb1f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fac801ad500 con 0x55c16f03c1b0 2024-09-21T06:01:29.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac8eb1f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fac801ab390 con 0x55c16f065070 2024-09-21T06:01:29.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac85b46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 0x55c16f428410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac85b46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 0x55c16f428410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42382/0 (socket says 172.21.15.7:42382) 2024-09-21T06:01:29.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac85b46640 1 -- 172.21.15.7:0/2815590803 learned_addr learned my addr 172.21.15.7:0/2815590803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:29.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac86b48640 1 --2- 172.21.15.7:0/2815590803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f065070 0x55c16f419330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac86347640 1 --2- 172.21.15.7:0/2815590803 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f03c1b0 0x55c16f411f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac85b46640 1 -- 172.21.15.7:0/2815590803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f065070 msgr2=0x55c16f419330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:29.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac85b46640 1 --2- 172.21.15.7:0/2815590803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f065070 0x55c16f419330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac85b46640 1 -- 172.21.15.7:0/2815590803 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f03c1b0 msgr2=0x55c16f411f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:29.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac85b46640 1 --2- 172.21.15.7:0/2815590803 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f03c1b0 0x55c16f411f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac85b46640 1 -- 172.21.15.7:0/2815590803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c16f412730 con 0x55c16f044390 2024-09-21T06:01:29.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.693+0000 7fac85b46640 1 --2- 172.21.15.7:0/2815590803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 0x55c16f428410 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fac70009bf0 tx=0x7fac70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5955fd80d3983d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:29.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.694+0000 7fac6bfff640 1 -- 172.21.15.7:0/2815590803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70004050 con 0x55c16f044390 2024-09-21T06:01:29.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.694+0000 7fac6bfff640 1 -- 172.21.15.7:0/2815590803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac700041f0 con 0x55c16f044390 2024-09-21T06:01:29.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.694+0000 7fac6bfff640 1 -- 172.21.15.7:0/2815590803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7002c6e0 con 0x55c16f044390 2024-09-21T06:01:29.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.694+0000 7fac8eb1f740 1 -- 172.21.15.7:0/2815590803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 msgr2=0x55c16f428410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:29.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.694+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/2815590803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 0x55c16f428410 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fac70009bf0 tx=0x7fac70009780 comp rx=0 tx=0).stop 2024-09-21T06:01:29.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.694+0000 7fac8eb1f740 1 -- 172.21.15.7:0/2815590803 shutdown_connections 2024-09-21T06:01:29.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.694+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/2815590803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f044390 0x55c16f428410 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.694+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/2815590803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f065070 0x55c16f419330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.695+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/2815590803 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f03c1b0 0x55c16f411f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.695+0000 7fac8eb1f740 1 -- 172.21.15.7:0/2815590803 >> 172.21.15.7:0/2815590803 conn(0x55c16f059460 msgr2=0x55c16f411840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:29.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.695+0000 7fac8eb1f740 1 -- 172.21.15.7:0/2815590803 shutdown_connections 2024-09-21T06:01:29.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.695+0000 7fac8eb1f740 1 -- 172.21.15.7:0/2815590803 wait complete. 2024-09-21T06:01:29.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.695+0000 7fac8eb1f740 1 -- start start 2024-09-21T06:01:29.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.695+0000 7fac8eb1f740 1 Processor -- start 2024-09-21T06:01:29.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.695+0000 7fac8eb1f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f03c1b0 0x55c16f424b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.695+0000 7fac8eb1f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f044390 0x55c16f41fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.695+0000 7fac8eb1f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 0x55c16f420530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.695+0000 7fac8eb1f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fac801ab9e0 con 0x55c16f065070 2024-09-21T06:01:29.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.695+0000 7fac8eb1f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fac801ace30 con 0x55c16f044390 2024-09-21T06:01:29.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.695+0000 7fac8eb1f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fac801ac090 con 0x55c16f03c1b0 2024-09-21T06:01:29.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.695+0000 7fac8eb1f740 10 client.0 _ll_register_callbacks cb 0x7fac78009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:29.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac86b48640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 0x55c16f420530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac86b48640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 0x55c16f420530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42386/0 (socket says 172.21.15.7:42386) 2024-09-21T06:01:29.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac86b48640 1 -- 172.21.15.7:0/626448512 learned_addr learned my addr 172.21.15.7:0/626448512 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:29.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac85b46640 1 --2- 172.21.15.7:0/626448512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f044390 0x55c16f41fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac86347640 1 --2- 172.21.15.7:0/626448512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f03c1b0 0x55c16f424b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac86b48640 1 -- 172.21.15.7:0/626448512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f03c1b0 msgr2=0x55c16f424b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:29.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac86b48640 1 --2- 172.21.15.7:0/626448512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f03c1b0 0x55c16f424b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac86b48640 1 -- 172.21.15.7:0/626448512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f044390 msgr2=0x55c16f41fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac86b48640 1 --2- 172.21.15.7:0/626448512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f044390 0x55c16f41fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac86b48640 1 -- 172.21.15.7:0/626448512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c16f420ba0 con 0x55c16f065070 2024-09-21T06:01:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac86b48640 1 --2- 172.21.15.7:0/626448512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 0x55c16f420530 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fac7801dcb0 tx=0x7fac7801df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3254c7e8eecebb47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac69ffb640 1 -- 172.21.15.7:0/626448512 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7801fe80 con 0x55c16f065070 2024-09-21T06:01:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac69ffb640 1 -- 172.21.15.7:0/626448512 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fac78020420 con 0x55c16f065070 2024-09-21T06:01:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.696+0000 7fac8eb1f740 1 -- 172.21.15.7:0/626448512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac700041f0 con 0x55c16f065070 2024-09-21T06:01:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.697+0000 7fac69ffb640 1 -- 172.21.15.7:0/626448512 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac78020620 con 0x55c16f065070 2024-09-21T06:01:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.697+0000 7fac8eb1f740 10 client.17790 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.697+0000 7fac8eb1f740 1 -- 172.21.15.7:0/626448512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c16f498d00 con 0x55c16f065070 2024-09-21T06:01:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.697+0000 7fac69ffb640 1 -- 172.21.15.7:0/626448512 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac700041f0 con 0x55c16f065070 2024-09-21T06:01:29.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.697+0000 7fac69ffb640 1 -- 172.21.15.7:0/626448512 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fac78038020 con 0x55c16f065070 2024-09-21T06:01:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.697+0000 7fac8eb1f740 10 client.17790 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.697+0000 7fac8eb1f740 10 client.17790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.697+0000 7fac8eb1f740 20 client.17790 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.697+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/626448512 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c16eff8da0 0x55c16f49b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.697+0000 7fac8eb1f740 4 client.17790 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:01:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.697+0000 7fac8eb1f740 1 -- 172.21.15.7:0/626448512 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c16f3808a0 con 0x55c16eff8da0 2024-09-21T06:01:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.697+0000 7fac86347640 1 --2- 172.21.15.7:0/626448512 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c16eff8da0 0x55c16f49b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac86347640 1 --2- 172.21.15.7:0/626448512 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c16eff8da0 0x55c16f49b470 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1de2769e062983fa server_cookie=16fdf0b19792c10b in_seq=0 out_seq=0 2024-09-21T06:01:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac69ffb640 10 client.17790 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac69ffb640 1 -- 172.21.15.7:0/626448512 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c16f3808a0 con 0x55c16eff8da0 2024-09-21T06:01:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac69ffb640 10 client.17790 handle_command_reply: tid=0 2024-09-21T06:01:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac8eb1f740 1 client.17790 shutdown 2024-09-21T06:01:29.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac8eb1f740 1 -- 172.21.15.7:0/626448512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 msgr2=0x55c16f420530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:29.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/626448512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 0x55c16f420530 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fac7801dcb0 tx=0x7fac7801df20 comp rx=0 tx=0).stop 2024-09-21T06:01:29.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac8eb1f740 1 -- 172.21.15.7:0/626448512 shutdown_connections 2024-09-21T06:01:29.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/626448512 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c16eff8da0 0x55c16f49b470 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/626448512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c16f065070 0x55c16f420530 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/626448512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c16f044390 0x55c16f41fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac8eb1f740 1 --2- 172.21.15.7:0/626448512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c16f03c1b0 0x55c16f424b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac69ffb640 0 client.17790 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:29.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac8eb1f740 1 -- 172.21.15.7:0/626448512 >> 172.21.15.7:0/626448512 conn(0x55c16f059460 msgr2=0x55c16f41d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:29.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac8eb1f740 1 -- 172.21.15.7:0/626448512 shutdown_connections 2024-09-21T06:01:29.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac8eb1f740 1 -- 172.21.15.7:0/626448512 wait complete. 2024-09-21T06:01:29.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.698+0000 7fac8eb1f740 20 client.17790 trim_cache size 0 max 16384 2024-09-21T06:01:29.706 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:01:29.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.699+0000 7fac885ab640 1 -- 172.21.15.7:0/3876937194 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fac6c0b6680 msgr2=0x7fac6c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:29.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.699+0000 7fac885ab640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fac6c0b6680 0x7fac6c0b8b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fac78005fd0 tx=0x7fac78009600 comp rx=0 tx=0).stop 2024-09-21T06:01:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.699+0000 7fac885ab640 1 -- 172.21.15.7:0/3876937194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac80101fc0 msgr2=0x7fac8019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.699+0000 7fac885ab640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac80101fc0 0x7fac8019a4e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fac7c005940 tx=0x7fac7c004270 comp rx=0 tx=0).stop 2024-09-21T06:01:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.699+0000 7fac885ab640 1 -- 172.21.15.7:0/3876937194 shutdown_connections 2024-09-21T06:01:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.699+0000 7fac885ab640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fac6c0b6680 0x7fac6c0b8b90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.699+0000 7fac885ab640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac80109e50 0x7fac8019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.699+0000 7fac885ab640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac80109500 0x7fac8019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.699+0000 7fac885ab640 1 --2- 172.21.15.7:0/3876937194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac80101fc0 0x7fac8019a4e0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.699+0000 7fac885ab640 1 -- 172.21.15.7:0/3876937194 >> 172.21.15.7:0/3876937194 conn(0x7fac80079f90 msgr2=0x7fac80107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.699+0000 7fac885ab640 1 -- 172.21.15.7:0/3876937194 shutdown_connections 2024-09-21T06:01:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:29.699+0000 7fac885ab640 1 -- 172.21.15.7:0/3876937194 wait complete. 2024-09-21T06:01:30.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:29 smithi007 ceph-mon[30983]: pgmap v550: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7 op/s 2024-09-21T06:01:30.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:29 smithi119 ceph-mon[34833]: pgmap v550: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7 op/s 2024-09-21T06:01:30.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:29 smithi027 ceph-mon[34364]: pgmap v550: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7 op/s 2024-09-21T06:01:31.491 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:01:31.492 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:01:31.767 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:32.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:31 smithi007 ceph-mon[30983]: pgmap v551: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T06:01:32.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:31 smithi119 ceph-mon[34833]: pgmap v551: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T06:01:32.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:31 smithi027 ceph-mon[34364]: pgmap v551: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T06:01:32.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.251+0000 7f254c438640 1 -- 172.21.15.7:0/2196952953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2544102a60 msgr2=0x7f2544102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:32.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.251+0000 7f254c438640 1 --2- 172.21.15.7:0/2196952953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2544102a60 0x7f2544102e70 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f2540009900 tx=0x7f254002a410 comp rx=0 tx=0).stop 2024-09-21T06:01:32.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.251+0000 7f254c438640 1 -- 172.21.15.7:0/2196952953 shutdown_connections 2024-09-21T06:01:32.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.251+0000 7f254c438640 1 --2- 172.21.15.7:0/2196952953 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2544108cf0 0x7f254410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.251+0000 7f254c438640 1 --2- 172.21.15.7:0/2196952953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25441083a0 0x7f25441087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.251+0000 7f254c438640 1 --2- 172.21.15.7:0/2196952953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2544102a60 0x7f2544102e70 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.251+0000 7f254c438640 1 -- 172.21.15.7:0/2196952953 >> 172.21.15.7:0/2196952953 conn(0x7f2544079730 msgr2=0x7f2544079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.251+0000 7f254c438640 1 -- 172.21.15.7:0/2196952953 shutdown_connections 2024-09-21T06:01:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.251+0000 7f254c438640 1 -- 172.21.15.7:0/2196952953 wait complete. 2024-09-21T06:01:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.252+0000 7f254c438640 1 Processor -- start 2024-09-21T06:01:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.252+0000 7f254c438640 1 -- start start 2024-09-21T06:01:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.252+0000 7f254c438640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2544102a60 0x7f2544199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.252+0000 7f254c438640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25441083a0 0x7f2544199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.252+0000 7f254c438640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2544108cf0 0x7f254419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.252+0000 7f254c438640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2544112960 con 0x7f25441083a0 2024-09-21T06:01:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.252+0000 7f254c438640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f25441127e0 con 0x7f2544108cf0 2024-09-21T06:01:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.252+0000 7f254c438640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2544112ae0 con 0x7f2544102a60 2024-09-21T06:01:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f25499d3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25441083a0 0x7f2544199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f25499d3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25441083a0 0x7f2544199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42400/0 (socket says 172.21.15.7:42400) 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f25499d3640 1 -- 172.21.15.7:0/3408563675 learned_addr learned my addr 172.21.15.7:0/3408563675 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f254a1d4640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2544102a60 0x7f2544199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f254a9d5640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2544108cf0 0x7f254419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f25499d3640 1 -- 172.21.15.7:0/3408563675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2544102a60 msgr2=0x7f2544199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f25499d3640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2544102a60 0x7f2544199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f25499d3640 1 -- 172.21.15.7:0/3408563675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2544108cf0 msgr2=0x7f254419ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f25499d3640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2544108cf0 0x7f254419ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f25499d3640 1 -- 172.21.15.7:0/3408563675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254419f2e0 con 0x7f25441083a0 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f25499d3640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25441083a0 0x7f2544199910 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f253400e9c0 tx=0x7f253400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f253b7fe640 1 -- 172.21.15.7:0/3408563675 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253400ccc0 con 0x7f25441083a0 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f253b7fe640 1 -- 172.21.15.7:0/3408563675 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25340054d0 con 0x7f25441083a0 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f254c438640 1 -- 172.21.15.7:0/3408563675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254419f5d0 con 0x7f25441083a0 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f253b7fe640 1 -- 172.21.15.7:0/3408563675 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534010430 con 0x7f25441083a0 2024-09-21T06:01:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.253+0000 7f254c438640 1 -- 172.21.15.7:0/3408563675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25441a5d30 con 0x7f25441083a0 2024-09-21T06:01:32.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.256+0000 7f25529ac740 1 Processor -- start 2024-09-21T06:01:32.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.256+0000 7f25529ac740 1 -- start start 2024-09-21T06:01:32.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f253b7fe640 1 -- 172.21.15.7:0/3408563675 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f2534004f20 con 0x7f25441083a0 2024-09-21T06:01:32.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f25529ac740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 0x556754713430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f25529ac740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x556754713970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f25529ac740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 0x556754713eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f25529ac740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556754689e60 con 0x55675436c350 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f25529ac740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556754679290 con 0x55675434b670 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f25529ac740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55675467d0a0 con 0x556754343490 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f254a9d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 0x556754713430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f254a9d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 0x556754713430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42414/0 (socket says 172.21.15.7:42414) 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f254a9d5640 1 -- 172.21.15.7:0/983376871 learned_addr learned my addr 172.21.15.7:0/983376871 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f25499d3640 1 --2- 172.21.15.7:0/983376871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 0x556754713eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f254a1d4640 1 --2- 172.21.15.7:0/983376871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x556754713970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f254a9d5640 1 -- 172.21.15.7:0/983376871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 msgr2=0x556754713970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f254a9d5640 1 --2- 172.21.15.7:0/983376871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x556754713970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f254a9d5640 1 -- 172.21.15.7:0/983376871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 msgr2=0x556754713eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f254a9d5640 1 --2- 172.21.15.7:0/983376871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 0x556754713eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.257+0000 7f254a9d5640 1 -- 172.21.15.7:0/983376871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567543d7930 con 0x55675436c350 2024-09-21T06:01:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.258+0000 7f253b7fe640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f25300b6700 0x7f25300b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.258+0000 7f254a9d5640 1 --2- 172.21.15.7:0/983376871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 0x556754713430 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f253c011440 tx=0x7f253c011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcdbffebabcd53d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.258+0000 7f254a1d4640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f25300b6700 0x7f25300b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.258+0000 7f253b7fe640 1 -- 172.21.15.7:0/3408563675 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f25340e7c30 con 0x7f25441083a0 2024-09-21T06:01:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.258+0000 7f2538d9a640 1 -- 172.21.15.7:0/983376871 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c003c30 con 0x55675436c350 2024-09-21T06:01:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.258+0000 7f2538d9a640 1 -- 172.21.15.7:0/983376871 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f253c003dd0 con 0x55675436c350 2024-09-21T06:01:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.258+0000 7f2538d9a640 1 -- 172.21.15.7:0/983376871 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c00f9e0 con 0x55675436c350 2024-09-21T06:01:32.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.259+0000 7f25529ac740 1 -- 172.21.15.7:0/983376871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 msgr2=0x556754713430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:32.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.259+0000 7f254a1d4640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f25300b6700 0x7f25300b8c10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2540031440 tx=0x7f2540005890 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:32.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.259+0000 7f25529ac740 1 --2- 172.21.15.7:0/983376871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 0x556754713430 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f253c011440 tx=0x7f253c011900 comp rx=0 tx=0).stop 2024-09-21T06:01:32.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.259+0000 7f25529ac740 1 -- 172.21.15.7:0/983376871 shutdown_connections 2024-09-21T06:01:32.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.259+0000 7f25529ac740 1 --2- 172.21.15.7:0/983376871 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 0x556754713eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.259+0000 7f25529ac740 1 --2- 172.21.15.7:0/983376871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x556754713970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.259+0000 7f25529ac740 1 --2- 172.21.15.7:0/983376871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 0x556754713430 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.259+0000 7f25529ac740 1 -- 172.21.15.7:0/983376871 >> 172.21.15.7:0/983376871 conn(0x556754360740 msgr2=0x556754711320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:32.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.259+0000 7f25529ac740 1 -- 172.21.15.7:0/983376871 shutdown_connections 2024-09-21T06:01:32.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.259+0000 7f25529ac740 1 -- 172.21.15.7:0/983376871 wait complete. 2024-09-21T06:01:32.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.259+0000 7f25529ac740 1 -- start start 2024-09-21T06:01:32.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f25529ac740 1 Processor -- start 2024-09-21T06:01:32.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f25529ac740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x556754721220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f25529ac740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 0x556754721760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f25529ac740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 0x55675472d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f25529ac740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5567544da890 con 0x55675436c350 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f25529ac740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556754613d40 con 0x55675434b670 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f25529ac740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556754723d70 con 0x556754343490 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f25529ac740 10 client.0 _ll_register_callbacks cb 0x556754677c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f254a9d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 0x55675472d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f254a9d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 0x55675472d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42426/0 (socket says 172.21.15.7:42426) 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f254a9d5640 1 -- 172.21.15.7:0/3592894806 learned_addr learned my addr 172.21.15.7:0/3592894806 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f254a1d4640 1 --2- 172.21.15.7:0/3592894806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x556754721220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f25499d3640 1 --2- 172.21.15.7:0/3592894806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 0x556754721760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f254a9d5640 1 -- 172.21.15.7:0/3592894806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 msgr2=0x556754721220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f254a9d5640 1 --2- 172.21.15.7:0/3592894806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x556754721220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f254a9d5640 1 -- 172.21.15.7:0/3592894806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 msgr2=0x556754721760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:32.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f254a9d5640 1 --2- 172.21.15.7:0/3592894806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 0x556754721760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.260+0000 7f254a9d5640 1 -- 172.21.15.7:0/3592894806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55675472d660 con 0x55675436c350 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.261+0000 7f254a9d5640 1 --2- 172.21.15.7:0/3592894806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 0x55675472d0a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f253c0049d0 tx=0x7f253c004cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be93240761fb1157 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.261+0000 7f252dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.261+0000 7f252dffb640 1 -- 172.21.15.7:0/3592894806 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c029020 con 0x55675436c350 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.261+0000 7f252dffb640 1 -- 172.21.15.7:0/3592894806 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f253c00fb30 con 0x55675436c350 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.261+0000 7f25529ac740 1 -- 172.21.15.7:0/3592894806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f253c003dd0 con 0x55675436c350 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.261+0000 7f252dffb640 1 -- 172.21.15.7:0/3592894806 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f253c034050 con 0x55675436c350 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.261+0000 7f25529ac740 10 client.17802 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.261+0000 7f25529ac740 1 -- 172.21.15.7:0/3592894806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55675472ff90 con 0x55675436c350 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.261+0000 7f252dffb640 1 -- 172.21.15.7:0/3592894806 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f253c003dd0 con 0x55675436c350 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.261+0000 7f252dffb640 1 -- 172.21.15.7:0/3592894806 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f253c005140 con 0x55675436c350 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.261+0000 7f25529ac740 10 client.17802 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.261+0000 7f25529ac740 10 client.17802 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.261+0000 7f25529ac740 20 client.17802 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.262+0000 7f25529ac740 1 --2- 172.21.15.7:0/3592894806 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55675432acd0 0x556754733400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.262+0000 7f25529ac740 4 client.17802 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.262+0000 7f25529ac740 1 -- 172.21.15.7:0/3592894806 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55675468bdb0 con 0x55675432acd0 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.262+0000 7f254a1d4640 1 --2- 172.21.15.7:0/3592894806 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55675432acd0 0x556754733400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.262+0000 7f254a1d4640 1 --2- 172.21.15.7:0/3592894806 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55675432acd0 0x556754733400 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68b7e1635d7ec4ec server_cookie=3b96118084569110 in_seq=0 out_seq=0 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.262+0000 7f252dffb640 10 client.17802 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f252dffb640 1 -- 172.21.15.7:0/3592894806 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55675468bdb0 con 0x55675432acd0 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f252dffb640 10 client.17802 handle_command_reply: tid=0 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f25529ac740 1 client.17802 shutdown 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f25529ac740 1 -- 172.21.15.7:0/3592894806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 msgr2=0x55675472d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f25529ac740 1 --2- 172.21.15.7:0/3592894806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 0x55675472d0a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f253c0049d0 tx=0x7f253c004cf0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f25529ac740 1 -- 172.21.15.7:0/3592894806 shutdown_connections 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f25529ac740 1 --2- 172.21.15.7:0/3592894806 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55675432acd0 0x556754733400 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f252dffb640 0 client.17802 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f25529ac740 1 --2- 172.21.15.7:0/3592894806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675436c350 0x55675472d0a0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f25529ac740 1 --2- 172.21.15.7:0/3592894806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 0x556754721760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f25529ac740 1 --2- 172.21.15.7:0/3592894806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x556754721220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f25529ac740 1 -- 172.21.15.7:0/3592894806 >> 172.21.15.7:0/3592894806 conn(0x556754360740 msgr2=0x556754714e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:32.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f25529ac740 1 -- 172.21.15.7:0/3592894806 shutdown_connections 2024-09-21T06:01:32.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f25529ac740 1 -- 172.21.15.7:0/3592894806 wait complete. 2024-09-21T06:01:32.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.263+0000 7f25529ac740 20 client.17802 trim_cache size 0 max 16384 2024-09-21T06:01:32.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.281+0000 7f25529ac740 1 Processor -- start 2024-09-21T06:01:32.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.281+0000 7f25529ac740 1 -- start start 2024-09-21T06:01:32.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.281+0000 7f25529ac740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675432acd0 0x556754721870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.281+0000 7f25529ac740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x5567547208b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.281+0000 7f25529ac740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675434b670 0x556754722c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.281+0000 7f25529ac740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25441afcb0 con 0x55675434b670 2024-09-21T06:01:32.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.281+0000 7f25529ac740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f25441ad580 con 0x55675432acd0 2024-09-21T06:01:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.281+0000 7f25529ac740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f25441ab3f0 con 0x556754343490 2024-09-21T06:01:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.281+0000 7f254a9d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675434b670 0x556754722c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.281+0000 7f254a9d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675434b670 0x556754722c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42432/0 (socket says 172.21.15.7:42432) 2024-09-21T06:01:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.282+0000 7f254a9d5640 1 -- 172.21.15.7:0/930349055 learned_addr learned my addr 172.21.15.7:0/930349055 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.282+0000 7f254a9d5640 1 -- 172.21.15.7:0/930349055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 msgr2=0x5567547208b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.282+0000 7f254a9d5640 1 --2- 172.21.15.7:0/930349055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x5567547208b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.282+0000 7f254a1d4640 1 --2- 172.21.15.7:0/930349055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675432acd0 0x556754721870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.282+0000 7f254a9d5640 1 -- 172.21.15.7:0/930349055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675432acd0 msgr2=0x556754721870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.282+0000 7f254a9d5640 1 --2- 172.21.15.7:0/930349055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675432acd0 0x556754721870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.282+0000 7f254a9d5640 1 -- 172.21.15.7:0/930349055 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567547161f0 con 0x55675434b670 2024-09-21T06:01:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.282+0000 7f254a9d5640 1 --2- 172.21.15.7:0/930349055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675434b670 0x556754722c50 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f253c00a010 tx=0x7f253c009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a5587d8a158ba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:32.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.282+0000 7f252ffff640 1 -- 172.21.15.7:0/930349055 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c029040 con 0x55675434b670 2024-09-21T06:01:32.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.282+0000 7f252ffff640 1 -- 172.21.15.7:0/930349055 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f253c00fde0 con 0x55675434b670 2024-09-21T06:01:32.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.282+0000 7f252ffff640 1 -- 172.21.15.7:0/930349055 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c0052e0 con 0x55675434b670 2024-09-21T06:01:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.283+0000 7f25529ac740 1 -- 172.21.15.7:0/930349055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675434b670 msgr2=0x556754722c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.283+0000 7f25529ac740 1 --2- 172.21.15.7:0/930349055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675434b670 0x556754722c50 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f253c00a010 tx=0x7f253c009eb0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.283+0000 7f25529ac740 1 -- 172.21.15.7:0/930349055 shutdown_connections 2024-09-21T06:01:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.283+0000 7f25529ac740 1 --2- 172.21.15.7:0/930349055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675434b670 0x556754722c50 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.283+0000 7f25529ac740 1 --2- 172.21.15.7:0/930349055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x5567547208b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.283+0000 7f25529ac740 1 --2- 172.21.15.7:0/930349055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675432acd0 0x556754721870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.283+0000 7f25529ac740 1 -- 172.21.15.7:0/930349055 >> 172.21.15.7:0/930349055 conn(0x556754360740 msgr2=0x556754722540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.283+0000 7f25529ac740 1 -- 172.21.15.7:0/930349055 shutdown_connections 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.283+0000 7f25529ac740 1 -- 172.21.15.7:0/930349055 wait complete. 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.283+0000 7f25529ac740 1 -- start start 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.283+0000 7f25529ac740 1 Processor -- start 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f25529ac740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675432acd0 0x556754728fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f25529ac740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x556754729560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f25529ac740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 0x556754723f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f25529ac740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25441aba40 con 0x55675432acd0 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f25529ac740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f25441aceb0 con 0x55675434b670 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f25529ac740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f25441ac110 con 0x556754343490 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f25529ac740 10 client.0 _ll_register_callbacks cb 0x7f25340eb650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f254a1d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675432acd0 0x556754728fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f254a1d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675432acd0 0x556754728fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42442/0 (socket says 172.21.15.7:42442) 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f254a1d4640 1 -- 172.21.15.7:0/1410191941 learned_addr learned my addr 172.21.15.7:0/1410191941 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:32.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f254a9d5640 1 --2- 172.21.15.7:0/1410191941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 0x556754723f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f25499d3640 1 --2- 172.21.15.7:0/1410191941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x556754729560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f254a1d4640 1 -- 172.21.15.7:0/1410191941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 msgr2=0x556754729560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f254a1d4640 1 --2- 172.21.15.7:0/1410191941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x556754729560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f254a1d4640 1 -- 172.21.15.7:0/1410191941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 msgr2=0x556754723f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f254a1d4640 1 --2- 172.21.15.7:0/1410191941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 0x556754723f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.284+0000 7f254a1d4640 1 -- 172.21.15.7:0/1410191941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556754714270 con 0x55675432acd0 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f254a1d4640 1 --2- 172.21.15.7:0/1410191941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675432acd0 0x556754728fe0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f254002a930 tx=0x7f2540009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ceac896a084b6f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f252dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f252dffb640 1 -- 172.21.15.7:0/1410191941 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2540056060 con 0x55675432acd0 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f252dffb640 1 -- 172.21.15.7:0/1410191941 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f2540004250 con 0x55675432acd0 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f25529ac740 1 -- 172.21.15.7:0/1410191941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f253c00fde0 con 0x55675432acd0 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f252dffb640 1 -- 172.21.15.7:0/1410191941 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2540035040 con 0x55675432acd0 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f25529ac740 10 client.17808 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f25529ac740 1 -- 172.21.15.7:0/1410191941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55675470c9e0 con 0x55675432acd0 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f252dffb640 1 -- 172.21.15.7:0/1410191941 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f253c00fde0 con 0x55675432acd0 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f252dffb640 1 -- 172.21.15.7:0/1410191941 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f25400049b0 con 0x55675432acd0 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f25529ac740 10 client.17808 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f25529ac740 10 client.17808 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f25529ac740 20 client.17808 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f25529ac740 1 --2- 172.21.15.7:0/1410191941 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55675436c350 0x5567547a2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f25529ac740 4 client.17808 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.285+0000 7f25529ac740 1 -- 172.21.15.7:0/1410191941 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556754687860 con 0x55675436c350 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.286+0000 7f25499d3640 1 --2- 172.21.15.7:0/1410191941 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55675436c350 0x5567547a2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.286+0000 7f252dffb640 10 client.17808 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.286+0000 7f25499d3640 1 --2- 172.21.15.7:0/1410191941 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55675436c350 0x5567547a2c60 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e556736f8815baa server_cookie=969066e5ea67d678 in_seq=0 out_seq=0 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f252dffb640 1 -- 172.21.15.7:0/1410191941 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556754687860 con 0x55675436c350 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f252dffb640 10 client.17808 handle_command_reply: tid=0 2024-09-21T06:01:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f25529ac740 1 client.17808 shutdown 2024-09-21T06:01:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f25529ac740 1 -- 172.21.15.7:0/1410191941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675432acd0 msgr2=0x556754728fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f25529ac740 1 --2- 172.21.15.7:0/1410191941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675432acd0 0x556754728fe0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f254002a930 tx=0x7f2540009260 comp rx=0 tx=0).stop 2024-09-21T06:01:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f25529ac740 1 -- 172.21.15.7:0/1410191941 shutdown_connections 2024-09-21T06:01:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f25529ac740 1 --2- 172.21.15.7:0/1410191941 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55675436c350 0x5567547a2c60 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f25529ac740 1 --2- 172.21.15.7:0/1410191941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55675434b670 0x556754723f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f25529ac740 1 --2- 172.21.15.7:0/1410191941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556754343490 0x556754729560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f25529ac740 1 --2- 172.21.15.7:0/1410191941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55675432acd0 0x556754728fe0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f25529ac740 1 -- 172.21.15.7:0/1410191941 >> 172.21.15.7:0/1410191941 conn(0x556754360740 msgr2=0x556754714440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f252dffb640 0 client.17808 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f25529ac740 1 -- 172.21.15.7:0/1410191941 shutdown_connections 2024-09-21T06:01:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f25529ac740 1 -- 172.21.15.7:0/1410191941 wait complete. 2024-09-21T06:01:32.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.288+0000 7f25529ac740 20 client.17808 trim_cache size 0 max 16384 2024-09-21T06:01:32.296 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:01:32.296 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:01:32.296 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "46ad69b3-ef90-42e0-a57b-ea33e3ef74ab", 2024-09-21T06:01:32.296 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:01:32.296 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:01:32.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.289+0000 7f254c438640 1 -- 172.21.15.7:0/3408563675 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f25300b6700 msgr2=0x7f25300b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:32.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.289+0000 7f254c438640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f25300b6700 0x7f25300b8c10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2540031440 tx=0x7f2540005890 comp rx=0 tx=0).stop 2024-09-21T06:01:32.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.289+0000 7f254c438640 1 -- 172.21.15.7:0/3408563675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25441083a0 msgr2=0x7f2544199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:32.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.289+0000 7f254c438640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25441083a0 0x7f2544199910 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f253400e9c0 tx=0x7f253400edc0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.289+0000 7f254c438640 1 -- 172.21.15.7:0/3408563675 shutdown_connections 2024-09-21T06:01:32.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.289+0000 7f254c438640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f25300b6700 0x7f25300b8c10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.289+0000 7f254c438640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25441083a0 0x7f2544199910 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.289+0000 7f254c438640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2544108cf0 0x7f254419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.289+0000 7f254c438640 1 --2- 172.21.15.7:0/3408563675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2544102a60 0x7f2544199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:32.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.289+0000 7f254c438640 1 -- 172.21.15.7:0/3408563675 >> 172.21.15.7:0/3408563675 conn(0x7f2544079730 msgr2=0x7f25441014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:32.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.289+0000 7f254c438640 1 -- 172.21.15.7:0/3408563675 shutdown_connections 2024-09-21T06:01:32.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:32.289+0000 7f254c438640 1 -- 172.21.15.7:0/3408563675 wait complete. 2024-09-21T06:01:33.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:32 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:01:33.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:32 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:33.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:32 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:01:33.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:32 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:33.059 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:01:33.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:32 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:01:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:32 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:32 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:01:33.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:32 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:33.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:32 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:01:33.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:32 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:33.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:32 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:01:33.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:32 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:01:33.317 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:33.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.774+0000 7fc080d75640 1 -- 172.21.15.7:0/2949061867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc07c1083d0 msgr2=0x7fc07c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.774+0000 7fc080d75640 1 --2- 172.21.15.7:0/2949061867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc07c1083d0 0x7fc07c1087e0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fc070009900 tx=0x7fc07002a410 comp rx=0 tx=0).stop 2024-09-21T06:01:33.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.774+0000 7fc080d75640 1 -- 172.21.15.7:0/2949061867 shutdown_connections 2024-09-21T06:01:33.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.774+0000 7fc080d75640 1 --2- 172.21.15.7:0/2949061867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc07c1083d0 0x7fc07c1087e0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.774+0000 7fc080d75640 1 --2- 172.21.15.7:0/2949061867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc07c108d20 0x7fc07c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.774+0000 7fc080d75640 1 --2- 172.21.15.7:0/2949061867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc07c102ae0 0x7fc07c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.774+0000 7fc080d75640 1 -- 172.21.15.7:0/2949061867 >> 172.21.15.7:0/2949061867 conn(0x7fc07c079760 msgr2=0x7fc07c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:33.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.774+0000 7fc080d75640 1 -- 172.21.15.7:0/2949061867 shutdown_connections 2024-09-21T06:01:33.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.774+0000 7fc080d75640 1 -- 172.21.15.7:0/2949061867 wait complete. 2024-09-21T06:01:33.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.775+0000 7fc080d75640 1 Processor -- start 2024-09-21T06:01:33.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.775+0000 7fc080d75640 1 -- start start 2024-09-21T06:01:33.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.775+0000 7fc080d75640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc07c102ae0 0x7fc07c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.775+0000 7fc080d75640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc07c1083d0 0x7fc07c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.775+0000 7fc080d75640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc07c108d20 0x7fc07c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.775+0000 7fc080d75640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c112990 con 0x7fc07c102ae0 2024-09-21T06:01:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.775+0000 7fc080d75640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c112810 con 0x7fc07c108d20 2024-09-21T06:01:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.775+0000 7fc080d75640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c112b10 con 0x7fc07c1083d0 2024-09-21T06:01:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.775+0000 7fc07a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc07c102ae0 0x7fc07c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.775+0000 7fc07a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc07c102ae0 0x7fc07c0ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42454/0 (socket says 172.21.15.7:42454) 2024-09-21T06:01:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.775+0000 7fc07a59c640 1 -- 172.21.15.7:0/1404431321 learned_addr learned my addr 172.21.15.7:0/1404431321 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.776+0000 7fc079d9b640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc07c1083d0 0x7fc07c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.776+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc07c108d20 0x7fc07c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.776+0000 7fc07a59c640 1 -- 172.21.15.7:0/1404431321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc07c1083d0 msgr2=0x7fc07c0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.776+0000 7fc07a59c640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc07c1083d0 0x7fc07c0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.776+0000 7fc07a59c640 1 -- 172.21.15.7:0/1404431321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc07c108d20 msgr2=0x7fc07c1000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.776+0000 7fc07a59c640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc07c108d20 0x7fc07c1000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.776+0000 7fc07a59c640 1 -- 172.21.15.7:0/1404431321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07c1a8850 con 0x7fc07c102ae0 2024-09-21T06:01:33.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.776+0000 7fc07a59c640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc07c102ae0 0x7fc07c0ff670 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00c890 tx=0x7fc06c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:33.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.776+0000 7fc06b7fe640 1 -- 172.21.15.7:0/1404431321 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c004220 con 0x7fc07c102ae0 2024-09-21T06:01:33.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.776+0000 7fc06b7fe640 1 -- 172.21.15.7:0/1404431321 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc06c0043c0 con 0x7fc07c102ae0 2024-09-21T06:01:33.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.776+0000 7fc080d75640 1 -- 172.21.15.7:0/1404431321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07c1a8b40 con 0x7fc07c102ae0 2024-09-21T06:01:33.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.776+0000 7fc06b7fe640 1 -- 172.21.15.7:0/1404431321 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c004a00 con 0x7fc07c102ae0 2024-09-21T06:01:33.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.776+0000 7fc080d75640 1 -- 172.21.15.7:0/1404431321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc07c1a9050 con 0x7fc07c102ae0 2024-09-21T06:01:33.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.779+0000 7fc0872e9740 1 Processor -- start 2024-09-21T06:01:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.779+0000 7fc0872e9740 1 -- start start 2024-09-21T06:01:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.779+0000 7fc06b7fe640 1 -- 172.21.15.7:0/1404431321 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fc06c004ba0 con 0x7fc07c102ae0 2024-09-21T06:01:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.779+0000 7fc0872e9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338d2070 0x559733c79650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.779+0000 7fc0872e9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338a91b0 0x559733c79b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.779+0000 7fc0872e9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338b1390 0x559733c7a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.779+0000 7fc0872e9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559733befe50 con 0x5597338b1390 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.779+0000 7fc0872e9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559733bdf280 con 0x5597338a91b0 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.779+0000 7fc0872e9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559733be3090 con 0x5597338d2070 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.780+0000 7fc07a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338a91b0 0x559733c79b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.780+0000 7fc07ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338d2070 0x559733c79650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.780+0000 7fc07ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338d2070 0x559733c79650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:51522/0 (socket says 172.21.15.7:51522) 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.780+0000 7fc07ad9d640 1 -- 172.21.15.7:0/241115413 learned_addr learned my addr 172.21.15.7:0/241115413 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.780+0000 7fc07a59c640 1 --2- 172.21.15.7:0/241115413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338a91b0 0x559733c79b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:48436/0 (socket says 172.21.15.7:48436) 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.780+0000 7fc079d9b640 1 --2- 172.21.15.7:0/241115413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338b1390 0x559733c7a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.780+0000 7fc07ad9d640 1 -- 172.21.15.7:0/241115413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338a91b0 msgr2=0x559733c79b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.780+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/241115413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338a91b0 0x559733c79b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.780+0000 7fc07ad9d640 1 -- 172.21.15.7:0/241115413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338b1390 msgr2=0x559733c7a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.780+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/241115413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338b1390 0x559733c7a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.780+0000 7fc07ad9d640 1 -- 172.21.15.7:0/241115413 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55973393d650 con 0x5597338d2070 2024-09-21T06:01:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.780+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/241115413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338d2070 0x559733c79650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc074009f70 tx=0x7fc074010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a69bfa2ffa28d55 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.781+0000 7fc06b7fe640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc0640b6680 0x7fc0640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.781+0000 7fc07a59c640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc0640b6680 0x7fc0640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.781+0000 7fc06b7fe640 1 -- 172.21.15.7:0/1404431321 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fc06c0e73c0 con 0x7fc07c102ae0 2024-09-21T06:01:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.781+0000 7fc07a59c640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc0640b6680 0x7fc0640b8b90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0e4c10 tx=0x7fc06c0eaf10 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.783+0000 7fc068ff9640 1 -- 172.21.15.7:0/241115413 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074016070 con 0x5597338d2070 2024-09-21T06:01:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.783+0000 7fc068ff9640 1 -- 172.21.15.7:0/241115413 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc074004d20 con 0x5597338d2070 2024-09-21T06:01:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.783+0000 7fc068ff9640 1 -- 172.21.15.7:0/241115413 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074012790 con 0x5597338d2070 2024-09-21T06:01:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.784+0000 7fc0872e9740 1 -- 172.21.15.7:0/241115413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338d2070 msgr2=0x559733c79650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.784+0000 7fc0872e9740 1 --2- 172.21.15.7:0/241115413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338d2070 0x559733c79650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc074009f70 tx=0x7fc074010800 comp rx=0 tx=0).stop 2024-09-21T06:01:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.784+0000 7fc0872e9740 1 -- 172.21.15.7:0/241115413 shutdown_connections 2024-09-21T06:01:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.784+0000 7fc0872e9740 1 --2- 172.21.15.7:0/241115413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338b1390 0x559733c7a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.784+0000 7fc0872e9740 1 --2- 172.21.15.7:0/241115413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338a91b0 0x559733c79b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.784+0000 7fc0872e9740 1 --2- 172.21.15.7:0/241115413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338d2070 0x559733c79650 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.784+0000 7fc0872e9740 1 -- 172.21.15.7:0/241115413 >> 172.21.15.7:0/241115413 conn(0x5597338c6460 msgr2=0x559733c77540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.784+0000 7fc0872e9740 1 -- 172.21.15.7:0/241115413 shutdown_connections 2024-09-21T06:01:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.784+0000 7fc0872e9740 1 -- 172.21.15.7:0/241115413 wait complete. 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.785+0000 7fc0872e9740 1 -- start start 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.785+0000 7fc0872e9740 1 Processor -- start 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.785+0000 7fc0872e9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 0x559733c84d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.785+0000 7fc0872e9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 0x559733c85290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.785+0000 7fc0872e9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338d2070 0x559733c91120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.785+0000 7fc0872e9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559733a40700 con 0x5597338a91b0 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.785+0000 7fc0872e9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559733b7a110 con 0x5597338d2070 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.785+0000 7fc0872e9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559733c87e30 con 0x5597338b1390 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc0872e9740 10 client.0 _ll_register_callbacks cb 0x559733b93990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc07ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 0x559733c84d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc07ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 0x559733c84d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42466/0 (socket says 172.21.15.7:42466) 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc07ad9d640 1 -- 172.21.15.7:0/1128729439 learned_addr learned my addr 172.21.15.7:0/1128729439 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc079d9b640 1 --2- 172.21.15.7:0/1128729439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 0x559733c85290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/1128729439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338d2070 0x559733c91120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc07ad9d640 1 -- 172.21.15.7:0/1128729439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 msgr2=0x559733c85290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/1128729439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 0x559733c85290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc07ad9d640 1 -- 172.21.15.7:0/1128729439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338d2070 msgr2=0x559733c91120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/1128729439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338d2070 0x559733c91120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc07ad9d640 1 -- 172.21.15.7:0/1128729439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559733ba7c40 con 0x5597338a91b0 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/1128729439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 0x559733c84d50 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fc0740098b0 tx=0x7fc074009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa71a2d2eb2dc604 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc061ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc061ffb640 1 -- 172.21.15.7:0/1128729439 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074016070 con 0x5597338a91b0 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc061ffb640 1 -- 172.21.15.7:0/1128729439 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fc074005610 con 0x5597338a91b0 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc0872e9740 1 -- 172.21.15.7:0/1128729439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc074004d20 con 0x5597338a91b0 2024-09-21T06:01:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc061ffb640 1 -- 172.21.15.7:0/1128729439 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc07402e030 con 0x5597338a91b0 2024-09-21T06:01:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.786+0000 7fc0872e9740 10 client.17820 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.787+0000 7fc0872e9740 1 -- 172.21.15.7:0/1128729439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559733c93ba0 con 0x5597338a91b0 2024-09-21T06:01:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.787+0000 7fc061ffb640 1 -- 172.21.15.7:0/1128729439 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc074004d20 con 0x5597338a91b0 2024-09-21T06:01:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.787+0000 7fc061ffb640 1 -- 172.21.15.7:0/1128729439 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc07400f040 con 0x5597338a91b0 2024-09-21T06:01:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.787+0000 7fc0872e9740 10 client.17820 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.787+0000 7fc0872e9740 10 client.17820 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.787+0000 7fc0872e9740 20 client.17820 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.787+0000 7fc0872e9740 1 --2- 172.21.15.7:0/1128729439 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5597338909f0 0x559733c96f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.787+0000 7fc0872e9740 4 client.17820 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.787+0000 7fc0872e9740 1 -- 172.21.15.7:0/1128729439 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559733bf1da0 con 0x5597338909f0 2024-09-21T06:01:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.787+0000 7fc079d9b640 1 --2- 172.21.15.7:0/1128729439 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5597338909f0 0x559733c96f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.788+0000 7fc079d9b640 1 --2- 172.21.15.7:0/1128729439 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5597338909f0 0x559733c96f00 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff454c8b40375ace server_cookie=f83af8da6e678f6b in_seq=0 out_seq=0 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.788+0000 7fc061ffb640 10 client.17820 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc061ffb640 1 -- 172.21.15.7:0/1128729439 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559733bf1da0 con 0x5597338909f0 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc061ffb640 10 client.17820 handle_command_reply: tid=0 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc0872e9740 1 client.17820 shutdown 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc0872e9740 1 -- 172.21.15.7:0/1128729439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 msgr2=0x559733c84d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc0872e9740 1 --2- 172.21.15.7:0/1128729439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 0x559733c84d50 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fc0740098b0 tx=0x7fc074009800 comp rx=0 tx=0).stop 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc0872e9740 1 -- 172.21.15.7:0/1128729439 shutdown_connections 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc0872e9740 1 --2- 172.21.15.7:0/1128729439 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5597338909f0 0x559733c96f00 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc0872e9740 1 --2- 172.21.15.7:0/1128729439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338d2070 0x559733c91120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc0872e9740 1 --2- 172.21.15.7:0/1128729439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 0x559733c85290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc0872e9740 1 --2- 172.21.15.7:0/1128729439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 0x559733c84d50 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc0872e9740 1 -- 172.21.15.7:0/1128729439 >> 172.21.15.7:0/1128729439 conn(0x5597338c6460 msgr2=0x559733c7c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc061ffb640 0 client.17820 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc0872e9740 1 -- 172.21.15.7:0/1128729439 shutdown_connections 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc0872e9740 1 -- 172.21.15.7:0/1128729439 wait complete. 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.789+0000 7fc0872e9740 20 client.17820 trim_cache size 0 max 16384 2024-09-21T06:01:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.807+0000 7fc0872e9740 1 Processor -- start 2024-09-21T06:01:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.807+0000 7fc0872e9740 1 -- start start 2024-09-21T06:01:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.807+0000 7fc0872e9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338a91b0 0x559733c86980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.807+0000 7fc0872e9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 0x559733c81f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.807+0000 7fc0872e9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338d2070 0x559733c82480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.807+0000 7fc0872e9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c1b4160 con 0x5597338d2070 2024-09-21T06:01:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.807+0000 7fc0872e9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c1b1a30 con 0x5597338a91b0 2024-09-21T06:01:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.807+0000 7fc0872e9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c1af8a0 con 0x5597338b1390 2024-09-21T06:01:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.807+0000 7fc07ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338d2070 0x559733c82480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.807+0000 7fc07ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338d2070 0x559733c82480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42480/0 (socket says 172.21.15.7:42480) 2024-09-21T06:01:33.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.807+0000 7fc07ad9d640 1 -- 172.21.15.7:0/1440980390 learned_addr learned my addr 172.21.15.7:0/1440980390 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.807+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/1440980390 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338a91b0 0x559733c86980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.808+0000 7fc079d9b640 1 --2- 172.21.15.7:0/1440980390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 0x559733c81f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.808+0000 7fc07ad9d640 1 -- 172.21.15.7:0/1440980390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 msgr2=0x559733c81f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.808+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/1440980390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 0x559733c81f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.808+0000 7fc07ad9d640 1 -- 172.21.15.7:0/1440980390 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338a91b0 msgr2=0x559733c86980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.808+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/1440980390 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338a91b0 0x559733c86980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.808+0000 7fc07ad9d640 1 -- 172.21.15.7:0/1440980390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559733c9d1f0 con 0x5597338d2070 2024-09-21T06:01:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.808+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/1440980390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338d2070 0x559733c82480 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fc074010d80 tx=0x7fc07401d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ce4a37919f9a74 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.808+0000 7fc063fff640 1 -- 172.21.15.7:0/1440980390 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074016070 con 0x5597338d2070 2024-09-21T06:01:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.808+0000 7fc063fff640 1 -- 172.21.15.7:0/1440980390 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc07401f030 con 0x5597338d2070 2024-09-21T06:01:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.808+0000 7fc063fff640 1 -- 172.21.15.7:0/1440980390 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074033e40 con 0x5597338d2070 2024-09-21T06:01:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.809+0000 7fc0872e9740 1 -- 172.21.15.7:0/1440980390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338d2070 msgr2=0x559733c82480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.809+0000 7fc0872e9740 1 --2- 172.21.15.7:0/1440980390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338d2070 0x559733c82480 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fc074010d80 tx=0x7fc07401d040 comp rx=0 tx=0).stop 2024-09-21T06:01:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.809+0000 7fc0872e9740 1 -- 172.21.15.7:0/1440980390 shutdown_connections 2024-09-21T06:01:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.809+0000 7fc0872e9740 1 --2- 172.21.15.7:0/1440980390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338d2070 0x559733c82480 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.809+0000 7fc0872e9740 1 --2- 172.21.15.7:0/1440980390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 0x559733c81f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.809+0000 7fc0872e9740 1 --2- 172.21.15.7:0/1440980390 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338a91b0 0x559733c86980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.809+0000 7fc0872e9740 1 -- 172.21.15.7:0/1440980390 >> 172.21.15.7:0/1440980390 conn(0x5597338c6460 msgr2=0x559733c86270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:33.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.809+0000 7fc0872e9740 1 -- 172.21.15.7:0/1440980390 shutdown_connections 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.809+0000 7fc0872e9740 1 -- 172.21.15.7:0/1440980390 wait complete. 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.809+0000 7fc0872e9740 1 -- start start 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.809+0000 7fc0872e9740 1 Processor -- start 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc0872e9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 0x559733c99b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc0872e9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 0x559733c9a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc0872e9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338d2070 0x559733cf76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc0872e9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c1afef0 con 0x5597338a91b0 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc0872e9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c1b1360 con 0x5597338d2070 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc0872e9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c1b05c0 con 0x5597338b1390 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc0872e9740 10 client.0 _ll_register_callbacks cb 0x7fc070009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc07ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 0x559733c99b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc07ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 0x559733c99b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42488/0 (socket says 172.21.15.7:42488) 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc07ad9d640 1 -- 172.21.15.7:0/2854097485 learned_addr learned my addr 172.21.15.7:0/2854097485 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:01:33.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc079d9b640 1 --2- 172.21.15.7:0/2854097485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 0x559733c9a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/2854097485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338d2070 0x559733cf76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc07ad9d640 1 -- 172.21.15.7:0/2854097485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 msgr2=0x559733c9a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/2854097485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 0x559733c9a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc07ad9d640 1 -- 172.21.15.7:0/2854097485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338d2070 msgr2=0x559733cf76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/2854097485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338d2070 0x559733cf76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc07ad9d640 1 -- 172.21.15.7:0/2854097485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559733cf7d10 con 0x5597338a91b0 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc07ad9d640 1 --2- 172.21.15.7:0/2854097485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 0x559733c99b30 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc074004b30 tx=0x7fc074009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c338308b2f1881ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.810+0000 7fc061ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc061ffb640 1 -- 172.21.15.7:0/2854097485 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074016040 con 0x5597338a91b0 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc061ffb640 1 -- 172.21.15.7:0/2854097485 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fc074033be0 con 0x5597338a91b0 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc0872e9740 1 -- 172.21.15.7:0/2854097485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc07401f030 con 0x5597338a91b0 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc061ffb640 1 -- 172.21.15.7:0/2854097485 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc074033de0 con 0x5597338a91b0 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc0872e9740 10 client.17826 fetch_fsmap learned FSMap version 25 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc0872e9740 1 -- 172.21.15.7:0/2854097485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559733d01300 con 0x5597338a91b0 2024-09-21T06:01:33.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc061ffb640 1 -- 172.21.15.7:0/2854097485 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc07401f030 con 0x5597338a91b0 2024-09-21T06:01:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc061ffb640 1 -- 172.21.15.7:0/2854097485 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc074004090 con 0x5597338a91b0 2024-09-21T06:01:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc0872e9740 10 client.17826 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:01:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc0872e9740 10 client.17826 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:01:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc0872e9740 20 client.17826 populate_metadata read hostname 'smithi007' 2024-09-21T06:01:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc0872e9740 1 --2- 172.21.15.7:0/2854097485 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559733865da0 0x559733d03910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc0872e9740 4 client.17826 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:01:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.811+0000 7fc0872e9740 1 -- 172.21.15.7:0/2854097485 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559733bed850 con 0x559733865da0 2024-09-21T06:01:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.812+0000 7fc079d9b640 1 --2- 172.21.15.7:0/2854097485 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559733865da0 0x559733d03910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.812+0000 7fc079d9b640 1 --2- 172.21.15.7:0/2854097485 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559733865da0 0x559733d03910 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1773663854aacf8a server_cookie=9cfa4066ef4dbf56 in_seq=0 out_seq=0 2024-09-21T06:01:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.812+0000 7fc061ffb640 10 client.17826 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc061ffb640 1 -- 172.21.15.7:0/2854097485 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6534 (crc 0 0 0) 0x559733bed850 con 0x559733865da0 2024-09-21T06:01:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc061ffb640 10 client.17826 handle_command_reply: tid=0 2024-09-21T06:01:33.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc0872e9740 1 client.17826 shutdown 2024-09-21T06:01:33.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc0872e9740 1 -- 172.21.15.7:0/2854097485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 msgr2=0x559733c99b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc0872e9740 1 --2- 172.21.15.7:0/2854097485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 0x559733c99b30 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc074004b30 tx=0x7fc074009f90 comp rx=0 tx=0).stop 2024-09-21T06:01:33.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc0872e9740 1 -- 172.21.15.7:0/2854097485 shutdown_connections 2024-09-21T06:01:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc0872e9740 1 --2- 172.21.15.7:0/2854097485 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x559733865da0 0x559733d03910 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc0872e9740 1 --2- 172.21.15.7:0/2854097485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5597338d2070 0x559733cf76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc0872e9740 1 --2- 172.21.15.7:0/2854097485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5597338b1390 0x559733c9a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc0872e9740 1 --2- 172.21.15.7:0/2854097485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5597338a91b0 0x559733c99b30 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc0872e9740 1 -- 172.21.15.7:0/2854097485 >> 172.21.15.7:0/2854097485 conn(0x5597338c6460 msgr2=0x559733c7af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc061ffb640 0 client.17826 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:01:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc0872e9740 1 -- 172.21.15.7:0/2854097485 shutdown_connections 2024-09-21T06:01:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc0872e9740 1 -- 172.21.15.7:0/2854097485 wait complete. 2024-09-21T06:01:33.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.813+0000 7fc0872e9740 20 client.17826 trim_cache size 0 max 16384 2024-09-21T06:01:33.820 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "46ad69b3-ef90-42e0-a57b-ea33e3ef74ab": { 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "46ad69b3-ef90-42e0-a57b-ea33e3ef74ab", 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "46ad69b3-ef90-42e0-a57b-ea33e3ef74ab": { 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:32.287019+0000", 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "d9b96838-732e-40a1-9fad-f54faef73b59": { 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:21.774276+0000", 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "fd9e7ebd-b70a-487f-937b-80b64378d04b": { 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:11.755521+0000", 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "3bd778db-a0ed-42ad-8a79-14a200f0734e": { 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:51.556015+0000", 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:01:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:01:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:01:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "ecf3518d-a174-4cee-89a1-6aa26e1b3442": { 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:01.909762+0000", 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:01:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:01:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:01:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:01:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:01:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:01:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:01:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:01:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:01:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:01:33.833 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:01:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.814+0000 7fc080d75640 1 -- 172.21.15.7:0/1404431321 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc0640b6680 msgr2=0x7fc0640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.814+0000 7fc080d75640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc0640b6680 0x7fc0640b8b90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0e4c10 tx=0x7fc06c0eaf10 comp rx=0 tx=0).stop 2024-09-21T06:01:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.814+0000 7fc080d75640 1 -- 172.21.15.7:0/1404431321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc07c102ae0 msgr2=0x7fc07c0ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.814+0000 7fc080d75640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc07c102ae0 0x7fc07c0ff670 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00c890 tx=0x7fc06c00cd50 comp rx=0 tx=0).stop 2024-09-21T06:01:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.814+0000 7fc080d75640 1 -- 172.21.15.7:0/1404431321 shutdown_connections 2024-09-21T06:01:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.814+0000 7fc080d75640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fc0640b6680 0x7fc0640b8b90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.814+0000 7fc080d75640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc07c108d20 0x7fc07c1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.814+0000 7fc080d75640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc07c1083d0 0x7fc07c0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.814+0000 7fc080d75640 1 --2- 172.21.15.7:0/1404431321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc07c102ae0 0x7fc07c0ff670 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.814+0000 7fc080d75640 1 -- 172.21.15.7:0/1404431321 >> 172.21.15.7:0/1404431321 conn(0x7fc07c079760 msgr2=0x7fc07c1019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.814+0000 7fc080d75640 1 -- 172.21.15.7:0/1404431321 shutdown_connections 2024-09-21T06:01:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:01:33.814+0000 7fc080d75640 1 -- 172.21.15.7:0/1404431321 wait complete. 2024-09-21T06:01:34.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:33 smithi007 ceph-mon[30983]: pgmap v552: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-21T06:01:34.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:33 smithi119 ceph-mon[34833]: pgmap v552: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-21T06:01:34.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:33 smithi027 ceph-mon[34364]: pgmap v552: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-21T06:01:34.621 INFO:tasks.cephfs.filesystem:scrub status for tag:46ad69b3-ef90-42e0-a57b-ea33e3ef74ab - {'path': '/', 'tag': '46ad69b3-ef90-42e0-a57b-ea33e3ef74ab', 'options': 'recursive,force'} 2024-09-21T06:01:36.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:35 smithi007 ceph-mon[30983]: pgmap v553: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8 op/s 2024-09-21T06:01:36.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:35 smithi119 ceph-mon[34833]: pgmap v553: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8 op/s 2024-09-21T06:01:36.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:35 smithi027 ceph-mon[34364]: pgmap v553: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8 op/s 2024-09-21T06:01:38.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:37 smithi007 ceph-mon[30983]: pgmap v554: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:01:38.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:37 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:01:38.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:37 smithi119 ceph-mon[34833]: pgmap v554: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:01:38.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:37 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:01:38.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:37 smithi027 ceph-mon[34364]: pgmap v554: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:01:38.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:37 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:01:40.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:39 smithi007 ceph-mon[30983]: pgmap v555: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:01:40.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:39 smithi119 ceph-mon[34833]: pgmap v555: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:01:40.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:39 smithi027 ceph-mon[34364]: pgmap v555: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:01:42.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:41 smithi007 ceph-mon[30983]: pgmap v556: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:01:42.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:41 smithi119 ceph-mon[34833]: pgmap v556: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:01:42.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:41 smithi027 ceph-mon[34364]: pgmap v556: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:01:44.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:43 smithi007 ceph-mon[30983]: pgmap v557: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:01:44.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:43 smithi119 ceph-mon[34833]: pgmap v557: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:01:44.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:43 smithi027 ceph-mon[34364]: pgmap v557: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:01:46.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:45 smithi007 ceph-mon[30983]: pgmap v558: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T06:01:46.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:45 smithi119 ceph-mon[34833]: pgmap v558: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T06:01:46.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:45 smithi027 ceph-mon[34364]: pgmap v558: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T06:01:48.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:47 smithi007 ceph-mon[30983]: pgmap v559: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:01:48.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:47 smithi119 ceph-mon[34833]: pgmap v559: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:01:48.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:47 smithi027 ceph-mon[34364]: pgmap v559: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:01:50.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:49 smithi007 ceph-mon[30983]: pgmap v560: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:01:50.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:49 smithi119 ceph-mon[34833]: pgmap v560: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:01:50.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:49 smithi027 ceph-mon[34364]: pgmap v560: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:01:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:51 smithi007 ceph-mon[30983]: pgmap v561: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:01:52.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:51 smithi119 ceph-mon[34833]: pgmap v561: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:01:52.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:51 smithi027 ceph-mon[34364]: pgmap v561: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:01:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:53 smithi007 ceph-mon[30983]: pgmap v562: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:01:54.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:53 smithi119 ceph-mon[34833]: pgmap v562: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:01:54.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:53 smithi027 ceph-mon[34364]: pgmap v562: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:01:56.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:55 smithi007 ceph-mon[30983]: pgmap v563: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:01:56.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:55 smithi119 ceph-mon[34833]: pgmap v563: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:01:56.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:55 smithi027 ceph-mon[34364]: pgmap v563: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:01:58.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:57 smithi119 ceph-mon[34833]: pgmap v564: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:01:58.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:57 smithi027 ceph-mon[34364]: pgmap v564: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:01:58.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:57 smithi007 ceph-mon[30983]: pgmap v564: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:02:00.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:01:59 smithi119 ceph-mon[34833]: pgmap v565: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:02:00.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:01:59 smithi027 ceph-mon[34364]: pgmap v565: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:02:00.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:01:59 smithi007 ceph-mon[30983]: pgmap v565: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:02:01.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:00 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:02:01.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:00 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:02:01.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:00 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:02:02.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:01 smithi119 ceph-mon[34833]: pgmap v566: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:02:02.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:02:02.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:02:02.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:02:02.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:01 smithi027 ceph-mon[34364]: pgmap v566: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:02:02.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:02:02.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:02:02.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:02:02.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:01 smithi007 ceph-mon[30983]: pgmap v566: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:02:02.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:02:02.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:02:02.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:02:04.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:03 smithi119 ceph-mon[34833]: pgmap v567: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:02:04.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:03 smithi027 ceph-mon[34364]: pgmap v567: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:02:04.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:03 smithi007 ceph-mon[30983]: pgmap v567: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:02:04.622 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:02:04.895 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.644+0000 7fb94c104640 1 -- 172.21.15.7:0/2109440745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9441083c0 msgr2=0x7fb9441087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.644+0000 7fb94c104640 1 --2- 172.21.15.7:0/2109440745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9441083c0 0x7fb9441087d0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fb934009900 tx=0x7fb93402a410 comp rx=0 tx=0).stop 2024-09-21T06:02:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.644+0000 7fb94c104640 1 -- 172.21.15.7:0/2109440745 shutdown_connections 2024-09-21T06:02:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.644+0000 7fb94c104640 1 --2- 172.21.15.7:0/2109440745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9441083c0 0x7fb9441087d0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.644+0000 7fb94c104640 1 --2- 172.21.15.7:0/2109440745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb944108d10 0x7fb94410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.644+0000 7fb94c104640 1 --2- 172.21.15.7:0/2109440745 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb944102a80 0x7fb944102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.644+0000 7fb94c104640 1 -- 172.21.15.7:0/2109440745 >> 172.21.15.7:0/2109440745 conn(0x7fb944079740 msgr2=0x7fb944079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.644+0000 7fb94c104640 1 -- 172.21.15.7:0/2109440745 shutdown_connections 2024-09-21T06:02:05.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.644+0000 7fb94c104640 1 -- 172.21.15.7:0/2109440745 wait complete. 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94c104640 1 Processor -- start 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94c104640 1 -- start start 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94c104640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb944102a80 0x7fb94419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94c104640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9441083c0 0x7fb94419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94c104640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb944108d10 0x7fb94419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94c104640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb944113aa0 con 0x7fb944108d10 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94c104640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb944113920 con 0x7fb944102a80 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94c104640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb944113c20 con 0x7fb9441083c0 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94a6a1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb944108d10 0x7fb94419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94a6a1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb944108d10 0x7fb94419fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32912/0 (socket says 172.21.15.7:32912) 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94a6a1640 1 -- 172.21.15.7:0/2670232693 learned_addr learned my addr 172.21.15.7:0/2670232693 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94969f640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9441083c0 0x7fb94419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb949ea0640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb944102a80 0x7fb94419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94a6a1640 1 -- 172.21.15.7:0/2670232693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9441083c0 msgr2=0x7fb94419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:05.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94a6a1640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9441083c0 0x7fb94419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94a6a1640 1 -- 172.21.15.7:0/2670232693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb944102a80 msgr2=0x7fb94419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94a6a1640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb944102a80 0x7fb94419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.645+0000 7fb94a6a1640 1 -- 172.21.15.7:0/2670232693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9441a03e0 con 0x7fb944108d10 2024-09-21T06:02:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.646+0000 7fb94a6a1640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb944108d10 0x7fb94419fcb0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00eb10 tx=0x7fb93c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.646+0000 7fb93affd640 1 -- 172.21.15.7:0/2670232693 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c004b20 con 0x7fb944108d10 2024-09-21T06:02:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.646+0000 7fb93affd640 1 -- 172.21.15.7:0/2670232693 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb93c004cc0 con 0x7fb944108d10 2024-09-21T06:02:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.646+0000 7fb94c104640 1 -- 172.21.15.7:0/2670232693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9441a06d0 con 0x7fb944108d10 2024-09-21T06:02:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.646+0000 7fb93affd640 1 -- 172.21.15.7:0/2670232693 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c010670 con 0x7fb944108d10 2024-09-21T06:02:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.646+0000 7fb94c104640 1 -- 172.21.15.7:0/2670232693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9441a6e30 con 0x7fb944108d10 2024-09-21T06:02:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.649+0000 7fb93affd640 1 -- 172.21.15.7:0/2670232693 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb93c005020 con 0x7fb944108d10 2024-09-21T06:02:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.649+0000 7fb952678740 1 Processor -- start 2024-09-21T06:02:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.650+0000 7fb952678740 1 -- start start 2024-09-21T06:02:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.650+0000 7fb952678740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae909650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.650+0000 7fb952678740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae5391b0 0x55fcae909b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.650+0000 7fb952678740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 0x55fcae90a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.650+0000 7fb952678740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fcae87fe50 con 0x55fcae541390 2024-09-21T06:02:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.650+0000 7fb952678740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55fcae86f280 con 0x55fcae5391b0 2024-09-21T06:02:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.650+0000 7fb952678740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55fcae873090 con 0x55fcae562070 2024-09-21T06:02:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.650+0000 7fb94969f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 0x55fcae90a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.650+0000 7fb949ea0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae5391b0 0x55fcae909b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.650+0000 7fb94969f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 0x55fcae90a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32920/0 (socket says 172.21.15.7:32920) 2024-09-21T06:02:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.650+0000 7fb94969f640 1 -- 172.21.15.7:0/2125497495 learned_addr learned my addr 172.21.15.7:0/2125497495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb94969f640 1 --2- 172.21.15.7:0/2125497495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae909650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb949ea0640 1 -- 172.21.15.7:0/2125497495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 msgr2=0x55fcae909650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb949ea0640 1 --2- 172.21.15.7:0/2125497495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae909650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb949ea0640 1 -- 172.21.15.7:0/2125497495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 msgr2=0x55fcae90a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb949ea0640 1 --2- 172.21.15.7:0/2125497495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 0x55fcae90a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb949ea0640 1 -- 172.21.15.7:0/2125497495 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcae5cd650 con 0x55fcae5391b0 2024-09-21T06:02:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb94969f640 1 --2- 172.21.15.7:0/2125497495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 0x55fcae90a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:02:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb93affd640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9300b6680 0x7fb9300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb949ea0640 1 --2- 172.21.15.7:0/2125497495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae5391b0 0x55fcae909b90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb94000dc60 tx=0x7fb94000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=292009bc483eb1d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb93affd640 1 -- 172.21.15.7:0/2670232693 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb93c0e7ca0 con 0x7fb944108d10 2024-09-21T06:02:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb94969f640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9300b6680 0x7fb9300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb92ffff640 1 -- 172.21.15.7:0/2125497495 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940015070 con 0x55fcae5391b0 2024-09-21T06:02:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb92ffff640 1 -- 172.21.15.7:0/2125497495 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9400054d0 con 0x55fcae5391b0 2024-09-21T06:02:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.651+0000 7fb92ffff640 1 -- 172.21.15.7:0/2125497495 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9400116a0 con 0x55fcae5391b0 2024-09-21T06:02:05.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.652+0000 7fb94969f640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9300b6680 0x7fb9300b8b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb934005f70 tx=0x7fb934005780 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:05.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.652+0000 7fb952678740 1 -- 172.21.15.7:0/2125497495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae5391b0 msgr2=0x55fcae909b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.652+0000 7fb952678740 1 --2- 172.21.15.7:0/2125497495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae5391b0 0x55fcae909b90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb94000dc60 tx=0x7fb94000f730 comp rx=0 tx=0).stop 2024-09-21T06:02:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.653+0000 7fb952678740 1 -- 172.21.15.7:0/2125497495 shutdown_connections 2024-09-21T06:02:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.653+0000 7fb952678740 1 --2- 172.21.15.7:0/2125497495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 0x55fcae90a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.653+0000 7fb952678740 1 --2- 172.21.15.7:0/2125497495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae5391b0 0x55fcae909b90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.653+0000 7fb952678740 1 --2- 172.21.15.7:0/2125497495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae909650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.653+0000 7fb952678740 1 -- 172.21.15.7:0/2125497495 >> 172.21.15.7:0/2125497495 conn(0x55fcae556460 msgr2=0x55fcae907540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.653+0000 7fb952678740 1 -- 172.21.15.7:0/2125497495 shutdown_connections 2024-09-21T06:02:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.653+0000 7fb952678740 1 -- 172.21.15.7:0/2125497495 wait complete. 2024-09-21T06:02:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.653+0000 7fb952678740 1 -- start start 2024-09-21T06:02:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.653+0000 7fb952678740 1 Processor -- start 2024-09-21T06:02:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb952678740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae5391b0 0x55fcae919130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb952678740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 0x55fcae919670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb952678740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae925490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb952678740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fcae6d0700 con 0x55fcae541390 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb952678740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55fcae80a110 con 0x55fcae5391b0 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb952678740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55fcae91c130 con 0x55fcae562070 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb952678740 10 client.0 _ll_register_callbacks cb 0x55fcae823990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb94969f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 0x55fcae919670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb94969f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 0x55fcae919670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32928/0 (socket says 172.21.15.7:32928) 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb94969f640 1 -- 172.21.15.7:0/4199912195 learned_addr learned my addr 172.21.15.7:0/4199912195 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb94a6a1640 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae925490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb949ea0640 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae5391b0 0x55fcae919130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb94969f640 1 -- 172.21.15.7:0/4199912195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 msgr2=0x55fcae925490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb94969f640 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae925490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb94969f640 1 -- 172.21.15.7:0/4199912195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae5391b0 msgr2=0x55fcae919130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb94969f640 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae5391b0 0x55fcae919130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb94969f640 1 -- 172.21.15.7:0/4199912195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcae837c40 con 0x55fcae541390 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.654+0000 7fb94a6a1640 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae925490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.655+0000 7fb94969f640 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 0x55fcae919670 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fb934009230 tx=0x7fb934031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cdfe1a1693091f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.655+0000 7fb92d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.655+0000 7fb92d7fa640 1 -- 172.21.15.7:0/4199912195 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb934050070 con 0x55fcae541390 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.655+0000 7fb92d7fa640 1 -- 172.21.15.7:0/4199912195 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb9340035f0 con 0x55fcae541390 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.655+0000 7fb952678740 1 -- 172.21.15.7:0/4199912195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9400054d0 con 0x55fcae541390 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.655+0000 7fb92d7fa640 1 -- 172.21.15.7:0/4199912195 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb934035040 con 0x55fcae541390 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.655+0000 7fb952678740 10 client.17838 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.655+0000 7fb952678740 1 -- 172.21.15.7:0/4199912195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fcae927e90 con 0x55fcae541390 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.655+0000 7fb92d7fa640 1 -- 172.21.15.7:0/4199912195 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9400054d0 con 0x55fcae541390 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.656+0000 7fb92d7fa640 1 -- 172.21.15.7:0/4199912195 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb93403d910 con 0x55fcae541390 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.656+0000 7fb952678740 10 client.17838 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.656+0000 7fb952678740 10 client.17838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.656+0000 7fb952678740 20 client.17838 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:05.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.656+0000 7fb952678740 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fcae5209f0 0x55fcae92b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.656+0000 7fb952678740 4 client.17838 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:02:05.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.656+0000 7fb952678740 1 -- 172.21.15.7:0/4199912195 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcae881da0 con 0x55fcae5209f0 2024-09-21T06:02:05.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.656+0000 7fb949ea0640 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fcae5209f0 0x55fcae92b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.657+0000 7fb92d7fa640 10 client.17838 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:05.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.657+0000 7fb949ea0640 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fcae5209f0 0x55fcae92b420 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7e147d2aee329ec server_cookie=66269a56c8249187 in_seq=0 out_seq=0 2024-09-21T06:02:05.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.657+0000 7fb92d7fa640 1 -- 172.21.15.7:0/4199912195 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fcae881da0 con 0x55fcae5209f0 2024-09-21T06:02:05.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.657+0000 7fb92d7fa640 10 client.17838 handle_command_reply: tid=0 2024-09-21T06:02:05.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.658+0000 7fb952678740 1 client.17838 shutdown 2024-09-21T06:02:05.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.658+0000 7fb952678740 1 -- 172.21.15.7:0/4199912195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 msgr2=0x55fcae919670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:05.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.658+0000 7fb952678740 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 0x55fcae919670 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fb934009230 tx=0x7fb934031400 comp rx=0 tx=0).stop 2024-09-21T06:02:05.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.658+0000 7fb952678740 1 -- 172.21.15.7:0/4199912195 shutdown_connections 2024-09-21T06:02:05.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.658+0000 7fb952678740 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fcae5209f0 0x55fcae92b420 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.658+0000 7fb952678740 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae541390 0x55fcae919670 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.658+0000 7fb952678740 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae925490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.658+0000 7fb952678740 1 --2- 172.21.15.7:0/4199912195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae5391b0 0x55fcae919130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.658+0000 7fb952678740 1 -- 172.21.15.7:0/4199912195 >> 172.21.15.7:0/4199912195 conn(0x55fcae556460 msgr2=0x55fcae90b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:05.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.658+0000 7fb92d7fa640 0 client.17838 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:05.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.658+0000 7fb952678740 1 -- 172.21.15.7:0/4199912195 shutdown_connections 2024-09-21T06:02:05.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.658+0000 7fb952678740 1 -- 172.21.15.7:0/4199912195 wait complete. 2024-09-21T06:02:05.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.658+0000 7fb952678740 20 client.17838 trim_cache size 0 max 16384 2024-09-21T06:02:05.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.676+0000 7fb952678740 1 Processor -- start 2024-09-21T06:02:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.676+0000 7fb952678740 1 -- start start 2024-09-21T06:02:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.676+0000 7fb952678740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 0x55fcae9148e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.676+0000 7fb952678740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae541390 0x55fcae907570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.676+0000 7fb952678740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae925390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.676+0000 7fb952678740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb9441afc60 con 0x55fcae5391b0 2024-09-21T06:02:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.676+0000 7fb952678740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb9441ad530 con 0x55fcae541390 2024-09-21T06:02:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.676+0000 7fb952678740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb9441ab3a0 con 0x55fcae562070 2024-09-21T06:02:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.676+0000 7fb949ea0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 0x55fcae9148e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.676+0000 7fb949ea0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 0x55fcae9148e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32930/0 (socket says 172.21.15.7:32930) 2024-09-21T06:02:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.676+0000 7fb949ea0640 1 -- 172.21.15.7:0/2109184736 learned_addr learned my addr 172.21.15.7:0/2109184736 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.676+0000 7fb94969f640 1 --2- 172.21.15.7:0/2109184736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae541390 0x55fcae907570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.677+0000 7fb94a6a1640 1 --2- 172.21.15.7:0/2109184736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae925390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.677+0000 7fb949ea0640 1 -- 172.21.15.7:0/2109184736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 msgr2=0x55fcae925390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:05.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.677+0000 7fb949ea0640 1 --2- 172.21.15.7:0/2109184736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae925390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.677+0000 7fb949ea0640 1 -- 172.21.15.7:0/2109184736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae541390 msgr2=0x55fcae907570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:05.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.677+0000 7fb949ea0640 1 --2- 172.21.15.7:0/2109184736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae541390 0x55fcae907570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.677+0000 7fb949ea0640 1 -- 172.21.15.7:0/2109184736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcae90a440 con 0x55fcae5391b0 2024-09-21T06:02:05.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.677+0000 7fb94969f640 1 --2- 172.21.15.7:0/2109184736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae541390 0x55fcae907570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:05.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.677+0000 7fb94a6a1640 1 --2- 172.21.15.7:0/2109184736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae925390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:02:05.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.677+0000 7fb949ea0640 1 --2- 172.21.15.7:0/2109184736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 0x55fcae9148e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x55fcae9082d0 tx=0x7fb940004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d18676d261d482 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:05.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.677+0000 7fb92f7fe640 1 -- 172.21.15.7:0/2109184736 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940015040 con 0x55fcae5391b0 2024-09-21T06:02:05.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.677+0000 7fb92f7fe640 1 -- 172.21.15.7:0/2109184736 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb940030070 con 0x55fcae5391b0 2024-09-21T06:02:05.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.677+0000 7fb92f7fe640 1 -- 172.21.15.7:0/2109184736 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94002b440 con 0x55fcae5391b0 2024-09-21T06:02:05.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.678+0000 7fb952678740 1 -- 172.21.15.7:0/2109184736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 msgr2=0x55fcae9148e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:05.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.678+0000 7fb952678740 1 --2- 172.21.15.7:0/2109184736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 0x55fcae9148e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x55fcae9082d0 tx=0x7fb940004b20 comp rx=0 tx=0).stop 2024-09-21T06:02:05.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.678+0000 7fb952678740 1 -- 172.21.15.7:0/2109184736 shutdown_connections 2024-09-21T06:02:05.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.678+0000 7fb952678740 1 --2- 172.21.15.7:0/2109184736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae925390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.678+0000 7fb952678740 1 --2- 172.21.15.7:0/2109184736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae541390 0x55fcae907570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.678+0000 7fb952678740 1 --2- 172.21.15.7:0/2109184736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 0x55fcae9148e0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.678+0000 7fb952678740 1 -- 172.21.15.7:0/2109184736 >> 172.21.15.7:0/2109184736 conn(0x55fcae556460 msgr2=0x55fcae906e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:05.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.678+0000 7fb952678740 1 -- 172.21.15.7:0/2109184736 shutdown_connections 2024-09-21T06:02:05.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.678+0000 7fb952678740 1 -- 172.21.15.7:0/2109184736 wait complete. 2024-09-21T06:02:05.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.679+0000 7fb952678740 1 -- start start 2024-09-21T06:02:05.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.679+0000 7fb952678740 1 Processor -- start 2024-09-21T06:02:05.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.679+0000 7fb952678740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 0x55fcae91cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.679+0000 7fb952678740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae541390 0x55fcae91d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.679+0000 7fb952678740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae921230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.679+0000 7fb952678740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb9441ab9f0 con 0x55fcae5391b0 2024-09-21T06:02:05.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.679+0000 7fb952678740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb9441ace60 con 0x55fcae541390 2024-09-21T06:02:05.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.679+0000 7fb952678740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb9441ac0c0 con 0x55fcae562070 2024-09-21T06:02:05.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.679+0000 7fb952678740 10 client.0 _ll_register_callbacks cb 0x7fb934005e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:05.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.679+0000 7fb949ea0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 0x55fcae91cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.679+0000 7fb949ea0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 0x55fcae91cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32934/0 (socket says 172.21.15.7:32934) 2024-09-21T06:02:05.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.679+0000 7fb949ea0640 1 -- 172.21.15.7:0/983704023 learned_addr learned my addr 172.21.15.7:0/983704023 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:05.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb94969f640 1 --2- 172.21.15.7:0/983704023 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae541390 0x55fcae91d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb94a6a1640 1 --2- 172.21.15.7:0/983704023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae921230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb949ea0640 1 -- 172.21.15.7:0/983704023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 msgr2=0x55fcae921230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:05.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb949ea0640 1 --2- 172.21.15.7:0/983704023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae921230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb949ea0640 1 -- 172.21.15.7:0/983704023 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae541390 msgr2=0x55fcae91d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:05.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb949ea0640 1 --2- 172.21.15.7:0/983704023 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae541390 0x55fcae91d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb949ea0640 1 -- 172.21.15.7:0/983704023 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcae9218a0 con 0x55fcae5391b0 2024-09-21T06:02:05.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb949ea0640 1 --2- 172.21.15.7:0/983704023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 0x55fcae91cd40 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fb94000d660 tx=0x7fb94000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83edd7d7d835fda9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:05.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb92d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:05.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb92d7fa640 1 -- 172.21.15.7:0/983704023 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940038030 con 0x55fcae5391b0 2024-09-21T06:02:05.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb92d7fa640 1 -- 172.21.15.7:0/983704023 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb940004040 con 0x55fcae5391b0 2024-09-21T06:02:05.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb952678740 1 -- 172.21.15.7:0/983704023 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb940030070 con 0x55fcae5391b0 2024-09-21T06:02:05.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb92d7fa640 1 -- 172.21.15.7:0/983704023 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb940041020 con 0x55fcae5391b0 2024-09-21T06:02:05.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb952678740 10 client.17844 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:05.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.680+0000 7fb952678740 1 -- 172.21.15.7:0/983704023 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fcae9957a0 con 0x55fcae5391b0 2024-09-21T06:02:05.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.681+0000 7fb92d7fa640 1 -- 172.21.15.7:0/983704023 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb940030070 con 0x55fcae5391b0 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.681+0000 7fb92d7fa640 1 -- 172.21.15.7:0/983704023 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb9400037b0 con 0x55fcae5391b0 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.681+0000 7fb952678740 10 client.17844 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.681+0000 7fb952678740 10 client.17844 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.681+0000 7fb952678740 20 client.17844 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.681+0000 7fb952678740 1 --2- 172.21.15.7:0/983704023 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fcae4f5da0 0x55fcae997d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.681+0000 7fb952678740 4 client.17844 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.681+0000 7fb952678740 1 -- 172.21.15.7:0/983704023 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fcae87d850 con 0x55fcae4f5da0 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.681+0000 7fb94969f640 1 --2- 172.21.15.7:0/983704023 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fcae4f5da0 0x55fcae997d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb94969f640 1 --2- 172.21.15.7:0/983704023 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fcae4f5da0 0x55fcae997d60 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1cd6e15e4ba8c77 server_cookie=493b2a5371c4485a in_seq=0 out_seq=0 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb92d7fa640 10 client.17844 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb92d7fa640 1 -- 172.21.15.7:0/983704023 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6338 (crc 0 0 0) 0x55fcae87d850 con 0x55fcae4f5da0 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb92d7fa640 10 client.17844 handle_command_reply: tid=0 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb952678740 1 client.17844 shutdown 2024-09-21T06:02:05.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb952678740 1 -- 172.21.15.7:0/983704023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 msgr2=0x55fcae91cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb952678740 1 --2- 172.21.15.7:0/983704023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 0x55fcae91cd40 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fb94000d660 tx=0x7fb94000d7a0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb952678740 1 -- 172.21.15.7:0/983704023 shutdown_connections 2024-09-21T06:02:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb952678740 1 --2- 172.21.15.7:0/983704023 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55fcae4f5da0 0x55fcae997d60 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb952678740 1 --2- 172.21.15.7:0/983704023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55fcae562070 0x55fcae921230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb952678740 1 --2- 172.21.15.7:0/983704023 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fcae541390 0x55fcae91d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb92d7fa640 0 client.17844 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb952678740 1 --2- 172.21.15.7:0/983704023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcae5391b0 0x55fcae91cd40 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.682+0000 7fb952678740 1 -- 172.21.15.7:0/983704023 >> 172.21.15.7:0/983704023 conn(0x55fcae556460 msgr2=0x55fcae90a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb952678740 1 -- 172.21.15.7:0/983704023 shutdown_connections 2024-09-21T06:02:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb952678740 1 -- 172.21.15.7:0/983704023 wait complete. 2024-09-21T06:02:05.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb952678740 20 client.17844 trim_cache size 0 max 16384 2024-09-21T06:02:05.692 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:02:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:02:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:02:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:02:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: "46ad69b3-ef90-42e0-a57b-ea33e3ef74ab": { 2024-09-21T06:02:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:32.287019+0000", 2024-09-21T06:02:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "d9b96838-732e-40a1-9fad-f54faef73b59": { 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:21.774276+0000", 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "fd9e7ebd-b70a-487f-937b-80b64378d04b": { 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:11.755521+0000", 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "3bd778db-a0ed-42ad-8a79-14a200f0734e": { 2024-09-21T06:02:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:51.556015+0000", 2024-09-21T06:02:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:02:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "ecf3518d-a174-4cee-89a1-6aa26e1b3442": { 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:01.909762+0000", 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:02:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:02:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:02:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:02:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:02:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:02:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:02:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:02:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:05.705 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:05.705 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:02:05.705 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:02:05.705 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:02:05.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb94c104640 1 -- 172.21.15.7:0/2670232693 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9300b6680 msgr2=0x7fb9300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:05.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb94c104640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9300b6680 0x7fb9300b8b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb934005f70 tx=0x7fb934005780 comp rx=0 tx=0).stop 2024-09-21T06:02:05.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb94c104640 1 -- 172.21.15.7:0/2670232693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb944108d10 msgr2=0x7fb94419fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:05.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb94c104640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb944108d10 0x7fb94419fcb0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00eb10 tx=0x7fb93c00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb94c104640 1 -- 172.21.15.7:0/2670232693 shutdown_connections 2024-09-21T06:02:05.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb94c104640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb9300b6680 0x7fb9300b8b90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb94c104640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb944108d10 0x7fb94419fcb0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb94c104640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9441083c0 0x7fb94419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb94c104640 1 --2- 172.21.15.7:0/2670232693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb944102a80 0x7fb94419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:05.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb94c104640 1 -- 172.21.15.7:0/2670232693 >> 172.21.15.7:0/2670232693 conn(0x7fb944079740 msgr2=0x7fb9441052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:05.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb94c104640 1 -- 172.21.15.7:0/2670232693 shutdown_connections 2024-09-21T06:02:05.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:05.683+0000 7fb94c104640 1 -- 172.21.15.7:0/2670232693 wait complete. 2024-09-21T06:02:06.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:05 smithi007 ceph-mon[30983]: pgmap v568: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:02:06.091 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:05 smithi119 ceph-mon[34833]: pgmap v568: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:02:06.227 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:05 smithi027 ceph-mon[34364]: pgmap v568: 97 pgs: 97 active+clean; 2.4 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:02:06.360 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:02:06.361 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:02:06.620 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.218+0000 7fe472bd7640 1 -- 172.21.15.7:0/634862282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe46c1022a0 msgr2=0x7fe46c1026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.218+0000 7fe472bd7640 1 --2- 172.21.15.7:0/634862282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe46c1022a0 0x7fe46c1026b0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fe460009900 tx=0x7fe46002a410 comp rx=0 tx=0).stop 2024-09-21T06:02:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.218+0000 7fe472bd7640 1 -- 172.21.15.7:0/634862282 shutdown_connections 2024-09-21T06:02:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.218+0000 7fe472bd7640 1 --2- 172.21.15.7:0/634862282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46c108530 0x7fe46c10ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.218+0000 7fe472bd7640 1 --2- 172.21.15.7:0/634862282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe46c107be0 0x7fe46c107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.218+0000 7fe472bd7640 1 --2- 172.21.15.7:0/634862282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe46c1022a0 0x7fe46c1026b0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.218+0000 7fe472bd7640 1 -- 172.21.15.7:0/634862282 >> 172.21.15.7:0/634862282 conn(0x7fe46c079ec0 msgr2=0x7fe46c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.218+0000 7fe472bd7640 1 -- 172.21.15.7:0/634862282 shutdown_connections 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.218+0000 7fe472bd7640 1 -- 172.21.15.7:0/634862282 wait complete. 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.219+0000 7fe472bd7640 1 Processor -- start 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.219+0000 7fe472bd7640 1 -- start start 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.219+0000 7fe472bd7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe46c1022a0 0x7fe46c19c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.219+0000 7fe472bd7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe46c107be0 0x7fe46c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.219+0000 7fe472bd7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46c108530 0x7fe46c1a2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.219+0000 7fe472bd7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c113b70 con 0x7fe46c1022a0 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.219+0000 7fe472bd7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c1139f0 con 0x7fe46c108530 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.219+0000 7fe472bd7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c113cf0 con 0x7fe46c107be0 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.219+0000 7fe470973640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe46c1022a0 0x7fe46c19c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.219+0000 7fe470973640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe46c1022a0 0x7fe46c19c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32950/0 (socket says 172.21.15.7:32950) 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.219+0000 7fe470973640 1 -- 172.21.15.7:0/1730880869 learned_addr learned my addr 172.21.15.7:0/1730880869 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.219+0000 7fe46bfff640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe46c107be0 0x7fe46c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.219+0000 7fe471174640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46c108530 0x7fe46c1a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.220+0000 7fe470973640 1 -- 172.21.15.7:0/1730880869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe46c107be0 msgr2=0x7fe46c19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.220+0000 7fe470973640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe46c107be0 0x7fe46c19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.220+0000 7fe470973640 1 -- 172.21.15.7:0/1730880869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46c108530 msgr2=0x7fe46c1a2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.220+0000 7fe470973640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46c108530 0x7fe46c1a2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.220+0000 7fe470973640 1 -- 172.21.15.7:0/1730880869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46c1a2750 con 0x7fe46c1022a0 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.220+0000 7fe471174640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46c108530 0x7fe46c1a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.220+0000 7fe46bfff640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe46c107be0 0x7fe46c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.220+0000 7fe470973640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe46c1022a0 0x7fe46c19c7e0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe460005940 tx=0x7fe4600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.220+0000 7fe469ffb640 1 -- 172.21.15.7:0/1730880869 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46003f030 con 0x7fe46c1022a0 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.220+0000 7fe469ffb640 1 -- 172.21.15.7:0/1730880869 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe460003cb0 con 0x7fe46c1022a0 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.220+0000 7fe469ffb640 1 -- 172.21.15.7:0/1730880869 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe460035070 con 0x7fe46c1022a0 2024-09-21T06:02:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.220+0000 7fe472bd7640 1 -- 172.21.15.7:0/1730880869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe46c1a29e0 con 0x7fe46c1022a0 2024-09-21T06:02:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.220+0000 7fe472bd7640 1 -- 172.21.15.7:0/1730880869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe46c1a91a0 con 0x7fe46c1022a0 2024-09-21T06:02:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.221+0000 7fe472bd7640 1 -- 172.21.15.7:0/1730880869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe46c103520 con 0x7fe46c1022a0 2024-09-21T06:02:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.223+0000 7fe469ffb640 1 -- 172.21.15.7:0/1730880869 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe460042030 con 0x7fe46c1022a0 2024-09-21T06:02:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.224+0000 7fe469ffb640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe45c0b6680 0x7fe45c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.224+0000 7fe46bfff640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe45c0b6680 0x7fe45c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.224+0000 7fe469ffb640 1 -- 172.21.15.7:0/1730880869 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fe4601082f0 con 0x7fe46c1022a0 2024-09-21T06:02:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.224+0000 7fe46bfff640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe45c0b6680 0x7fe45c0b8b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe4580058c0 tx=0x7fe458005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.227+0000 7fe469ffb640 1 -- 172.21.15.7:0/1730880869 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4600ce830 con 0x7fe46c1022a0 2024-09-21T06:02:07.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.454+0000 7fe472bd7640 1 -- 172.21.15.7:0/1730880869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe46c1026b0 con 0x7fe46c1022a0 2024-09-21T06:02:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.454+0000 7fe469ffb640 1 -- 172.21.15.7:0/1730880869 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7fe46c1026b0 con 0x7fe46c1022a0 2024-09-21T06:02:07.456 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:02:07.457 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:02:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:02:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.458+0000 7fe472bd7640 1 -- 172.21.15.7:0/1730880869 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe45c0b6680 msgr2=0x7fe45c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.458+0000 7fe472bd7640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe45c0b6680 0x7fe45c0b8b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe4580058c0 tx=0x7fe458005850 comp rx=0 tx=0).stop 2024-09-21T06:02:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.458+0000 7fe472bd7640 1 -- 172.21.15.7:0/1730880869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe46c1022a0 msgr2=0x7fe46c19c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.458+0000 7fe472bd7640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe46c1022a0 0x7fe46c19c7e0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe460005940 tx=0x7fe4600042f0 comp rx=0 tx=0).stop 2024-09-21T06:02:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.458+0000 7fe472bd7640 1 -- 172.21.15.7:0/1730880869 shutdown_connections 2024-09-21T06:02:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.458+0000 7fe472bd7640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe45c0b6680 0x7fe45c0b8b90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.458+0000 7fe472bd7640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46c108530 0x7fe46c1a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.458+0000 7fe472bd7640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe46c107be0 0x7fe46c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.458+0000 7fe472bd7640 1 --2- 172.21.15.7:0/1730880869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe46c1022a0 0x7fe46c19c7e0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.458+0000 7fe472bd7640 1 -- 172.21.15.7:0/1730880869 >> 172.21.15.7:0/1730880869 conn(0x7fe46c079ec0 msgr2=0x7fe46c105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.458+0000 7fe472bd7640 1 -- 172.21.15.7:0/1730880869 shutdown_connections 2024-09-21T06:02:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:07.458+0000 7fe472bd7640 1 -- 172.21.15.7:0/1730880869 wait complete. 2024-09-21T06:02:08.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:07 smithi007 ceph-mon[30983]: pgmap v569: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:02:08.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:07 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1730880869' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:02:08.143 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:02:08.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:07 smithi027 ceph-mon[34364]: pgmap v569: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:02:08.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:07 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1730880869' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:02:08.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:07 smithi119 ceph-mon[34833]: pgmap v569: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:02:08.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:07 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1730880869' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:02:08.402 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.028+0000 7fcab849b640 1 -- 172.21.15.7:0/915358367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcab01094d0 msgr2=0x7fcab01098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.028+0000 7fcab849b640 1 --2- 172.21.15.7:0/915358367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcab01094d0 0x7fcab01098e0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009900 tx=0x7fcaa002a410 comp rx=0 tx=0).stop 2024-09-21T06:02:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.028+0000 7fcab849b640 1 -- 172.21.15.7:0/915358367 shutdown_connections 2024-09-21T06:02:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.028+0000 7fcab849b640 1 --2- 172.21.15.7:0/915358367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcab01094d0 0x7fcab01098e0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.028+0000 7fcab849b640 1 --2- 172.21.15.7:0/915358367 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcab0109e20 0x7fcab0110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.028+0000 7fcab849b640 1 --2- 172.21.15.7:0/915358367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcab0103b90 0x7fcab0103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.028+0000 7fcab849b640 1 -- 172.21.15.7:0/915358367 >> 172.21.15.7:0/915358367 conn(0x7fcab00ff5e0 msgr2=0x7fcab0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.028+0000 7fcab849b640 1 -- 172.21.15.7:0/915358367 shutdown_connections 2024-09-21T06:02:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.028+0000 7fcab849b640 1 -- 172.21.15.7:0/915358367 wait complete. 2024-09-21T06:02:09.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.029+0000 7fcab849b640 1 Processor -- start 2024-09-21T06:02:09.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.029+0000 7fcab849b640 1 -- start start 2024-09-21T06:02:09.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.029+0000 7fcab849b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcab0103b90 0x7fcab019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.029+0000 7fcab849b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcab01094d0 0x7fcab019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.029+0000 7fcab849b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcab0109e20 0x7fcab019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.029+0000 7fcab849b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcab0113ae0 con 0x7fcab01094d0 2024-09-21T06:02:09.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.029+0000 7fcab849b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcab0113960 con 0x7fcab0103b90 2024-09-21T06:02:09.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.029+0000 7fcab849b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcab0113c60 con 0x7fcab0109e20 2024-09-21T06:02:09.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcab5a36640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcab01094d0 0x7fcab019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcab5a36640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcab01094d0 0x7fcab019aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48274/0 (socket says 172.21.15.7:48274) 2024-09-21T06:02:09.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcab5a36640 1 -- 172.21.15.7:0/779901746 learned_addr learned my addr 172.21.15.7:0/779901746 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:09.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcab6237640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcab0103b90 0x7fcab019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcab6a38640 1 --2- 172.21.15.7:0/779901746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcab0109e20 0x7fcab019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcab5a36640 1 -- 172.21.15.7:0/779901746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcab0109e20 msgr2=0x7fcab019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:09.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcab5a36640 1 --2- 172.21.15.7:0/779901746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcab0109e20 0x7fcab019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcab5a36640 1 -- 172.21.15.7:0/779901746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcab0103b90 msgr2=0x7fcab019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:09.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcab5a36640 1 --2- 172.21.15.7:0/779901746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcab0103b90 0x7fcab019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcab5a36640 1 -- 172.21.15.7:0/779901746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab01a0400 con 0x7fcab01094d0 2024-09-21T06:02:09.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcab5a36640 1 --2- 172.21.15.7:0/779901746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcab01094d0 0x7fcab019aa30 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fcaa002a930 tx=0x7fcaa0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:09.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcaa77fe640 1 -- 172.21.15.7:0/779901746 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa003f030 con 0x7fcab01094d0 2024-09-21T06:02:09.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcab849b640 1 -- 172.21.15.7:0/779901746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab01a0690 con 0x7fcab01094d0 2024-09-21T06:02:09.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcaa77fe640 1 -- 172.21.15.7:0/779901746 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaa0003aa0 con 0x7fcab01094d0 2024-09-21T06:02:09.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcaa77fe640 1 -- 172.21.15.7:0/779901746 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0035070 con 0x7fcab01094d0 2024-09-21T06:02:09.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.030+0000 7fcab849b640 1 -- 172.21.15.7:0/779901746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab01a6e50 con 0x7fcab01094d0 2024-09-21T06:02:09.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.033+0000 7fcabea0f740 1 Processor -- start 2024-09-21T06:02:09.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.033+0000 7fcabea0f740 1 -- start start 2024-09-21T06:02:09.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcaa77fe640 1 -- 172.21.15.7:0/779901746 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fcaa0042030 con 0x7fcab01094d0 2024-09-21T06:02:09.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcabea0f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d3bd070 0x56205d7642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcabea0f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 0x56205d764800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcabea0f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d39c390 0x56205d764d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcabea0f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56205d6daea0 con 0x56205d3941b0 2024-09-21T06:02:09.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcabea0f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56205d6ca2d0 con 0x56205d3bd070 2024-09-21T06:02:09.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcabea0f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56205d6ce0e0 con 0x56205d39c390 2024-09-21T06:02:09.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcab6237640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 0x56205d764800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcab6237640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 0x56205d764800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48282/0 (socket says 172.21.15.7:48282) 2024-09-21T06:02:09.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcab6237640 1 -- 172.21.15.7:0/2042632708 learned_addr learned my addr 172.21.15.7:0/2042632708 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:09.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcab5a36640 1 --2- 172.21.15.7:0/2042632708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d39c390 0x56205d764d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcab6a38640 1 --2- 172.21.15.7:0/2042632708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d3bd070 0x56205d7642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcab6237640 1 -- 172.21.15.7:0/2042632708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d39c390 msgr2=0x56205d764d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:09.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcab6237640 1 --2- 172.21.15.7:0/2042632708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d39c390 0x56205d764d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcab6237640 1 -- 172.21.15.7:0/2042632708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d3bd070 msgr2=0x56205d7642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:09.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcab6237640 1 --2- 172.21.15.7:0/2042632708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d3bd070 0x56205d7642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcab6237640 1 -- 172.21.15.7:0/2042632708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56205d428650 con 0x56205d3941b0 2024-09-21T06:02:09.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.034+0000 7fcab5a36640 1 --2- 172.21.15.7:0/2042632708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d39c390 0x56205d764d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:09.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.035+0000 7fcab6237640 1 --2- 172.21.15.7:0/2042632708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 0x56205d764800 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00b760 tx=0x7fcaac00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba178893d5dafd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:09.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.035+0000 7fcaa4d9a640 1 -- 172.21.15.7:0/2042632708 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaac003dd0 con 0x56205d3941b0 2024-09-21T06:02:09.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.035+0000 7fcaa4d9a640 1 -- 172.21.15.7:0/2042632708 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaac015070 con 0x56205d3941b0 2024-09-21T06:02:09.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.035+0000 7fcaa4d9a640 1 -- 172.21.15.7:0/2042632708 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaac004da0 con 0x56205d3941b0 2024-09-21T06:02:09.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.035+0000 7fcaa77fe640 1 --2- 172.21.15.7:0/779901746 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fca9c0b6680 0x7fca9c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.035+0000 7fcab6a38640 1 --2- 172.21.15.7:0/779901746 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fca9c0b6680 0x7fca9c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.035+0000 7fcaa77fe640 1 -- 172.21.15.7:0/779901746 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7fcaa0107de0 con 0x7fcab01094d0 2024-09-21T06:02:09.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.036+0000 7fcabea0f740 1 -- 172.21.15.7:0/2042632708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 msgr2=0x56205d764800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:09.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.036+0000 7fcab6a38640 1 --2- 172.21.15.7:0/779901746 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fca9c0b6680 0x7fca9c0b8b90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8005fd0 tx=0x7fcaa8009580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:09.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.036+0000 7fcabea0f740 1 --2- 172.21.15.7:0/2042632708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 0x56205d764800 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00b760 tx=0x7fcaac00bc20 comp rx=0 tx=0).stop 2024-09-21T06:02:09.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.036+0000 7fcabea0f740 1 -- 172.21.15.7:0/2042632708 shutdown_connections 2024-09-21T06:02:09.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.036+0000 7fcabea0f740 1 --2- 172.21.15.7:0/2042632708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 0x56205d764800 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.036+0000 7fcabea0f740 1 --2- 172.21.15.7:0/2042632708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d39c390 0x56205d764d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.036+0000 7fcabea0f740 1 --2- 172.21.15.7:0/2042632708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d3bd070 0x56205d7642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.036+0000 7fcabea0f740 1 -- 172.21.15.7:0/2042632708 >> 172.21.15.7:0/2042632708 conn(0x56205d3b1460 msgr2=0x56205d7621b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:09.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.036+0000 7fcabea0f740 1 -- 172.21.15.7:0/2042632708 shutdown_connections 2024-09-21T06:02:09.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.036+0000 7fcabea0f740 1 -- 172.21.15.7:0/2042632708 wait complete. 2024-09-21T06:02:09.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.036+0000 7fcabea0f740 1 -- start start 2024-09-21T06:02:09.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.036+0000 7fcabea0f740 1 Processor -- start 2024-09-21T06:02:09.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcabea0f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 0x56205d76f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcabea0f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d39c390 0x56205d76fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcabea0f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d3bd070 0x56205d770410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcabea0f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56205d52b700 con 0x56205d3941b0 2024-09-21T06:02:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcabea0f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56205d665160 con 0x56205d3bd070 2024-09-21T06:02:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcabea0f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56205d772aa0 con 0x56205d39c390 2024-09-21T06:02:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcabea0f740 10 client.0 _ll_register_callbacks cb 0x56205d67e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcab6237640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 0x56205d76f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcab6237640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 0x56205d76f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48296/0 (socket says 172.21.15.7:48296) 2024-09-21T06:02:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcab6237640 1 -- 172.21.15.7:0/3071238356 learned_addr learned my addr 172.21.15.7:0/3071238356 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcab6a38640 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d3bd070 0x56205d770410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcab5a36640 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d39c390 0x56205d76fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcab6237640 1 -- 172.21.15.7:0/3071238356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d39c390 msgr2=0x56205d76fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcab6237640 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d39c390 0x56205d76fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcab6237640 1 -- 172.21.15.7:0/3071238356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d3bd070 msgr2=0x56205d770410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcab6237640 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d3bd070 0x56205d770410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcab6237640 1 -- 172.21.15.7:0/3071238356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56205d692c90 con 0x56205d3941b0 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.037+0000 7fcab6a38640 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d3bd070 0x56205d770410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fcab6237640 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 0x56205d76f950 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0046f0 tx=0x7fcaac004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60172a2a214758f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fca99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fca99ffb640 1 -- 172.21.15.7:0/3071238356 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaac028060 con 0x56205d3941b0 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fca99ffb640 1 -- 172.21.15.7:0/3071238356 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7fcaac011640 con 0x56205d3941b0 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fcabea0f740 1 -- 172.21.15.7:0/3071238356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcaac015070 con 0x56205d3941b0 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fca99ffb640 1 -- 172.21.15.7:0/3071238356 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcaac011840 con 0x56205d3941b0 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fcabea0f740 10 client.17862 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fcabea0f740 1 -- 172.21.15.7:0/3071238356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56205d77e740 con 0x56205d3941b0 2024-09-21T06:02:09.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fca99ffb640 1 -- 172.21.15.7:0/3071238356 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaac015070 con 0x56205d3941b0 2024-09-21T06:02:09.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fca99ffb640 1 -- 172.21.15.7:0/3071238356 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcaac022070 con 0x56205d3941b0 2024-09-21T06:02:09.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fcabea0f740 10 client.17862 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:09.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fcabea0f740 10 client.17862 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:02:09.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fcabea0f740 20 client.17862 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:09.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.038+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56205d37b9f0 0x56205d781b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.039+0000 7fcabea0f740 4 client.17862 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:02:09.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.039+0000 7fcabea0f740 1 -- 172.21.15.7:0/3071238356 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56205d6dcdf0 con 0x56205d37b9f0 2024-09-21T06:02:09.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.039+0000 7fcab5a36640 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56205d37b9f0 0x56205d781b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.039+0000 7fca99ffb640 10 client.17862 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:02:09.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.039+0000 7fcab5a36640 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56205d37b9f0 0x56205d781b50 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=30b14d3a4dc5f7a8 server_cookie=27c8c5d5bd461c52 in_seq=0 out_seq=0 2024-09-21T06:02:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.040+0000 7fca99ffb640 1 -- 172.21.15.7:0/3071238356 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56205d6dcdf0 con 0x56205d37b9f0 2024-09-21T06:02:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.040+0000 7fca99ffb640 10 client.17862 handle_command_reply: tid=0 2024-09-21T06:02:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.040+0000 7fcabea0f740 1 client.17862 shutdown 2024-09-21T06:02:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.040+0000 7fcabea0f740 1 -- 172.21.15.7:0/3071238356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 msgr2=0x56205d76f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.040+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 0x56205d76f950 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0046f0 tx=0x7fcaac004720 comp rx=0 tx=0).stop 2024-09-21T06:02:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.040+0000 7fcabea0f740 1 -- 172.21.15.7:0/3071238356 shutdown_connections 2024-09-21T06:02:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.040+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56205d37b9f0 0x56205d781b50 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.040+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d3bd070 0x56205d770410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.040+0000 7fca99ffb640 0 client.17862 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:02:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.040+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d39c390 0x56205d76fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.040+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3071238356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d3941b0 0x56205d76f950 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.040+0000 7fcabea0f740 1 -- 172.21.15.7:0/3071238356 >> 172.21.15.7:0/3071238356 conn(0x56205d3b1460 msgr2=0x56205d7674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.041+0000 7fcabea0f740 1 -- 172.21.15.7:0/3071238356 shutdown_connections 2024-09-21T06:02:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.041+0000 7fcabea0f740 1 -- 172.21.15.7:0/3071238356 wait complete. 2024-09-21T06:02:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.041+0000 7fcabea0f740 20 client.17862 trim_cache size 0 max 16384 2024-09-21T06:02:09.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcabea0f740 1 Processor -- start 2024-09-21T06:02:09.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcabea0f740 1 -- start start 2024-09-21T06:02:09.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcabea0f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d37b9f0 0x56205d76f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcabea0f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d3941b0 0x56205d76fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcabea0f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 0x56205d76cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcabea0f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcab01b1f00 con 0x56205d39c390 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcabea0f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcab01af7d0 con 0x56205d37b9f0 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcabea0f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcab01ad640 con 0x56205d3941b0 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcab6a38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 0x56205d76cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcab6a38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 0x56205d76cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48298/0 (socket says 172.21.15.7:48298) 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcab6a38640 1 -- 172.21.15.7:0/3174585534 learned_addr learned my addr 172.21.15.7:0/3174585534 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcab5a36640 1 --2- 172.21.15.7:0/3174585534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d3941b0 0x56205d76fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcab6237640 1 --2- 172.21.15.7:0/3174585534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d37b9f0 0x56205d76f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcab6a38640 1 -- 172.21.15.7:0/3174585534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d3941b0 msgr2=0x56205d76fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcab6a38640 1 --2- 172.21.15.7:0/3174585534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d3941b0 0x56205d76fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.054+0000 7fcab6a38640 1 -- 172.21.15.7:0/3174585534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d37b9f0 msgr2=0x56205d76f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.055+0000 7fcab6a38640 1 --2- 172.21.15.7:0/3174585534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d37b9f0 0x56205d76f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.055+0000 7fcab6a38640 1 -- 172.21.15.7:0/3174585534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56205d767120 con 0x56205d39c390 2024-09-21T06:02:09.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.055+0000 7fcab6a38640 1 --2- 172.21.15.7:0/3174585534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 0x56205d76cb40 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009800 tx=0x7fcaa8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2077880a8d650a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:09.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.055+0000 7fca9bfff640 1 -- 172.21.15.7:0/3174585534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8004d20 con 0x56205d39c390 2024-09-21T06:02:09.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.055+0000 7fca9bfff640 1 -- 172.21.15.7:0/3174585534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaa8012e40 con 0x56205d39c390 2024-09-21T06:02:09.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.055+0000 7fca9bfff640 1 -- 172.21.15.7:0/3174585534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8005920 con 0x56205d39c390 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.056+0000 7fcabea0f740 1 -- 172.21.15.7:0/3174585534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 msgr2=0x56205d76cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.056+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3174585534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 0x56205d76cb40 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009800 tx=0x7fcaa8014000 comp rx=0 tx=0).stop 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.056+0000 7fcabea0f740 1 -- 172.21.15.7:0/3174585534 shutdown_connections 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.056+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3174585534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 0x56205d76cb40 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.056+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3174585534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d3941b0 0x56205d76fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.056+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3174585534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d37b9f0 0x56205d76f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.056+0000 7fcabea0f740 1 -- 172.21.15.7:0/3174585534 >> 172.21.15.7:0/3174585534 conn(0x56205d3b1460 msgr2=0x56205d76e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.056+0000 7fcabea0f740 1 -- 172.21.15.7:0/3174585534 shutdown_connections 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.056+0000 7fcabea0f740 1 -- 172.21.15.7:0/3174585534 wait complete. 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.056+0000 7fcabea0f740 1 -- start start 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.056+0000 7fcabea0f740 1 Processor -- start 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcabea0f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d37b9f0 0x56205d7836b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcabea0f740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d3941b0 0x56205d783c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcabea0f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 0x56205d7e8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcabea0f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcab01adc90 con 0x56205d39c390 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcabea0f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcab01af100 con 0x56205d37b9f0 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcabea0f740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcab01ae360 con 0x56205d3941b0 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcabea0f740 10 client.0 _ll_register_callbacks cb 0x7fcaac004590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcab6a38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 0x56205d7e8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcab6a38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 0x56205d7e8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48300/0 (socket says 172.21.15.7:48300) 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcab6a38640 1 -- 172.21.15.7:0/3328908100 learned_addr learned my addr 172.21.15.7:0/3328908100 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcab5a36640 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d3941b0 0x56205d783c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcab6237640 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d37b9f0 0x56205d7836b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcab6a38640 1 -- 172.21.15.7:0/3328908100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d3941b0 msgr2=0x56205d783c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcab6a38640 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d3941b0 0x56205d783c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcab6a38640 1 -- 172.21.15.7:0/3328908100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d37b9f0 msgr2=0x56205d7836b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcab6a38640 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d37b9f0 0x56205d7836b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcab6a38640 1 -- 172.21.15.7:0/3328908100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56205d7e8d80 con 0x56205d39c390 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcab6237640 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d37b9f0 0x56205d7836b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fcab6a38640 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 0x56205d7e8710 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8005460 tx=0x7fcaa80057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f5c2ec47cc23a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fca99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.057+0000 7fca99ffb640 1 -- 172.21.15.7:0/3328908100 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa801fd50 con 0x56205d39c390 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.058+0000 7fcabea0f740 1 -- 172.21.15.7:0/3328908100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56205d6d88a0 con 0x56205d39c390 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.058+0000 7fca99ffb640 1 -- 172.21.15.7:0/3328908100 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7fcaa8004a40 con 0x56205d39c390 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.058+0000 7fca99ffb640 1 -- 172.21.15.7:0/3328908100 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcaa8041050 con 0x56205d39c390 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.058+0000 7fcabea0f740 10 client.17868 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.058+0000 7fcabea0f740 1 -- 172.21.15.7:0/3328908100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56205d7f1280 con 0x56205d39c390 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.058+0000 7fca99ffb640 1 -- 172.21.15.7:0/3328908100 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56205d6d88a0 con 0x56205d39c390 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.058+0000 7fca99ffb640 1 -- 172.21.15.7:0/3328908100 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcaa800f040 con 0x56205d39c390 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.058+0000 7fcabea0f740 10 client.17868 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.058+0000 7fcabea0f740 10 client.17868 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.058+0000 7fcabea0f740 20 client.17868 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.058+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56205d3bd070 0x56205d7f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.058+0000 7fcabea0f740 4 client.17868 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:02:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.058+0000 7fcabea0f740 1 -- 172.21.15.7:0/3328908100 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56205d6d5cd0 con 0x56205d3bd070 2024-09-21T06:02:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fcab6237640 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56205d3bd070 0x56205d7f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fcab6237640 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56205d3bd070 0x56205d7f38f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=22636839cf1233b1 server_cookie=d5338b790148a728 in_seq=0 out_seq=0 2024-09-21T06:02:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fca99ffb640 10 client.17868 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:02:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fca99ffb640 1 -- 172.21.15.7:0/3328908100 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56205d6d5cd0 con 0x56205d3bd070 2024-09-21T06:02:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fca99ffb640 10 client.17868 handle_command_reply: tid=0 2024-09-21T06:02:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fcabea0f740 1 client.17868 shutdown 2024-09-21T06:02:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fcabea0f740 1 -- 172.21.15.7:0/3328908100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 msgr2=0x56205d7e8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 0x56205d7e8710 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8005460 tx=0x7fcaa80057c0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fcabea0f740 1 -- 172.21.15.7:0/3328908100 shutdown_connections 2024-09-21T06:02:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56205d3bd070 0x56205d7f38f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56205d39c390 0x56205d7e8710 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56205d3941b0 0x56205d783c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fcabea0f740 1 --2- 172.21.15.7:0/3328908100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56205d37b9f0 0x56205d7836b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fcabea0f740 1 -- 172.21.15.7:0/3328908100 >> 172.21.15.7:0/3328908100 conn(0x56205d3b1460 msgr2=0x56205d76e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:09.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fca99ffb640 0 client.17868 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:02:09.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fcabea0f740 1 -- 172.21.15.7:0/3328908100 shutdown_connections 2024-09-21T06:02:09.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.059+0000 7fcabea0f740 1 -- 172.21.15.7:0/3328908100 wait complete. 2024-09-21T06:02:09.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.060+0000 7fcabea0f740 20 client.17868 trim_cache size 0 max 16384 2024-09-21T06:02:09.066 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:02:09.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.060+0000 7fcab849b640 1 -- 172.21.15.7:0/779901746 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fca9c0b6680 msgr2=0x7fca9c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:09.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.060+0000 7fcab849b640 1 --2- 172.21.15.7:0/779901746 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fca9c0b6680 0x7fca9c0b8b90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8005fd0 tx=0x7fcaa8009580 comp rx=0 tx=0).stop 2024-09-21T06:02:09.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.060+0000 7fcab849b640 1 -- 172.21.15.7:0/779901746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcab01094d0 msgr2=0x7fcab019aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:09.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.060+0000 7fcab849b640 1 --2- 172.21.15.7:0/779901746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcab01094d0 0x7fcab019aa30 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fcaa002a930 tx=0x7fcaa0004270 comp rx=0 tx=0).stop 2024-09-21T06:02:09.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.060+0000 7fcab849b640 1 -- 172.21.15.7:0/779901746 shutdown_connections 2024-09-21T06:02:09.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.060+0000 7fcab849b640 1 --2- 172.21.15.7:0/779901746 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fca9c0b6680 0x7fca9c0b8b90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.060+0000 7fcab849b640 1 --2- 172.21.15.7:0/779901746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcab01094d0 0x7fcab019aa30 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.060+0000 7fcab849b640 1 --2- 172.21.15.7:0/779901746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcab0109e20 0x7fcab019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.060+0000 7fcab849b640 1 --2- 172.21.15.7:0/779901746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcab0103b90 0x7fcab019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:09.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.060+0000 7fcab849b640 1 -- 172.21.15.7:0/779901746 >> 172.21.15.7:0/779901746 conn(0x7fcab00ff5e0 msgr2=0x7fcab0101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:09.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.060+0000 7fcab849b640 1 -- 172.21.15.7:0/779901746 shutdown_connections 2024-09-21T06:02:09.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:09.060+0000 7fcab849b640 1 -- 172.21.15.7:0/779901746 wait complete. 2024-09-21T06:02:09.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:08 smithi027 ceph-mon[34364]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:02:09.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:08 smithi007 ceph-mon[30983]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:02:09.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:08 smithi119 ceph-mon[34833]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:02:09.893 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:02:10.154 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:10.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:09 smithi027 ceph-mon[34364]: pgmap v571: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:02:10.276 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:09 smithi007 ceph-mon[30983]: pgmap v571: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:02:10.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:09 smithi119 ceph-mon[34833]: pgmap v571: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:02:10.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.614+0000 7fda99e29640 1 -- 172.21.15.7:0/1732125042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda94109df0 msgr2=0x7fda94110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:10.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.614+0000 7fda99e29640 1 --2- 172.21.15.7:0/1732125042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda94109df0 0x7fda94110620 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fda8c009ca0 tx=0x7fda8c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.614+0000 7fda99e29640 1 -- 172.21.15.7:0/1732125042 shutdown_connections 2024-09-21T06:02:10.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.614+0000 7fda99e29640 1 --2- 172.21.15.7:0/1732125042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda94109df0 0x7fda94110620 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.614+0000 7fda99e29640 1 --2- 172.21.15.7:0/1732125042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda941094a0 0x7fda941098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.614+0000 7fda99e29640 1 --2- 172.21.15.7:0/1732125042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda94103b60 0x7fda94103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.614+0000 7fda99e29640 1 -- 172.21.15.7:0/1732125042 >> 172.21.15.7:0/1732125042 conn(0x7fda9407b850 msgr2=0x7fda9407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:10.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.614+0000 7fda99e29640 1 -- 172.21.15.7:0/1732125042 shutdown_connections 2024-09-21T06:02:10.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.614+0000 7fda99e29640 1 -- 172.21.15.7:0/1732125042 wait complete. 2024-09-21T06:02:10.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.615+0000 7fda99e29640 1 Processor -- start 2024-09-21T06:02:10.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.615+0000 7fda99e29640 1 -- start start 2024-09-21T06:02:10.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda99e29640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda94103b60 0x7fda94075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda99e29640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda941094a0 0x7fda94075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda99e29640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda94109df0 0x7fda94076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda99e29640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fda94113ab0 con 0x7fda94109df0 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda99e29640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fda94113930 con 0x7fda941094a0 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda99e29640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fda94113c30 con 0x7fda94103b60 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda93fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda94109df0 0x7fda94076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda93fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda94109df0 0x7fda94076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48308/0 (socket says 172.21.15.7:48308) 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda93fff640 1 -- 172.21.15.7:0/280970141 learned_addr learned my addr 172.21.15.7:0/280970141 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda937fe640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda94103b60 0x7fda94075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda92ffd640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda941094a0 0x7fda94075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda93fff640 1 -- 172.21.15.7:0/280970141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda94103b60 msgr2=0x7fda94075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda93fff640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda94103b60 0x7fda94075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda93fff640 1 -- 172.21.15.7:0/280970141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda941094a0 msgr2=0x7fda94075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda93fff640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda941094a0 0x7fda94075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda93fff640 1 -- 172.21.15.7:0/280970141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda941a8740 con 0x7fda94109df0 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda93fff640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda94109df0 0x7fda94076190 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fda8c005cc0 tx=0x7fda8c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.616+0000 7fda90ff9640 1 -- 172.21.15.7:0/280970141 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c003bf0 con 0x7fda94109df0 2024-09-21T06:02:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.617+0000 7fda99e29640 1 -- 172.21.15.7:0/280970141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda941a89d0 con 0x7fda94109df0 2024-09-21T06:02:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.617+0000 7fda90ff9640 1 -- 172.21.15.7:0/280970141 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda8c003d90 con 0x7fda94109df0 2024-09-21T06:02:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.617+0000 7fda90ff9640 1 -- 172.21.15.7:0/280970141 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c02fbc0 con 0x7fda94109df0 2024-09-21T06:02:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.617+0000 7fda99e29640 1 -- 172.21.15.7:0/280970141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda941a8f60 con 0x7fda94109df0 2024-09-21T06:02:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.619+0000 7fdaa039d740 1 Processor -- start 2024-09-21T06:02:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.619+0000 7fda90ff9640 1 -- 172.21.15.7:0/280970141 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fda8c02fd60 con 0x7fda94109df0 2024-09-21T06:02:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.619+0000 7fdaa039d740 1 -- start start 2024-09-21T06:02:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fdaa039d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce773d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fdaa039d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce736d1b0 0x562ce773d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fdaa039d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce7375390 0x562ce773dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fdaa039d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562ce76b3ea0 con 0x562ce7396070 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fdaa039d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562ce76a32d0 con 0x562ce7375390 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fdaa039d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562ce76a70e0 con 0x562ce736d1b0 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fda92ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce773d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fda92ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce773d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48312/0 (socket says 172.21.15.7:48312) 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fda92ffd640 1 -- 172.21.15.7:0/2632955863 learned_addr learned my addr 172.21.15.7:0/2632955863 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fda92ffd640 1 --2- 172.21.15.7:0/2632955863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce7375390 0x562ce773dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fda937fe640 1 --2- 172.21.15.7:0/2632955863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce736d1b0 0x562ce773d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fda90ff9640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fda7c0b6680 0x7fda7c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fda92ffd640 1 -- 172.21.15.7:0/2632955863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce736d1b0 msgr2=0x562ce773d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fda92ffd640 1 --2- 172.21.15.7:0/2632955863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce736d1b0 0x562ce773d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fda92ffd640 1 -- 172.21.15.7:0/2632955863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce7375390 msgr2=0x562ce773dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fda92ffd640 1 --2- 172.21.15.7:0/2632955863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce7375390 0x562ce773dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.620+0000 7fda92ffd640 1 -- 172.21.15.7:0/2632955863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce7401650 con 0x562ce7396070 2024-09-21T06:02:10.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.621+0000 7fda90ff9640 1 -- 172.21.15.7:0/280970141 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7fda8c108c40 con 0x7fda94109df0 2024-09-21T06:02:10.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.621+0000 7fda93fff640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fda7c0b6680 0x7fda7c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.621+0000 7fda92ffd640 1 --2- 172.21.15.7:0/2632955863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce773d2c0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fda88013550 tx=0x7fda8800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47c060d02f51cab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:10.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.621+0000 7fda79ffb640 1 -- 172.21.15.7:0/2632955863 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda88019030 con 0x562ce7396070 2024-09-21T06:02:10.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.621+0000 7fda79ffb640 1 -- 172.21.15.7:0/2632955863 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda880118f0 con 0x562ce7396070 2024-09-21T06:02:10.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.621+0000 7fda79ffb640 1 -- 172.21.15.7:0/2632955863 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8801d6b0 con 0x562ce7396070 2024-09-21T06:02:10.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.622+0000 7fdaa039d740 1 -- 172.21.15.7:0/2632955863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 msgr2=0x562ce773d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.622+0000 7fda93fff640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fda7c0b6680 0x7fda7c0b8b90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0ce7b0 tx=0x7fda8c02f660 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.622+0000 7fdaa039d740 1 --2- 172.21.15.7:0/2632955863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce773d2c0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fda88013550 tx=0x7fda8800b630 comp rx=0 tx=0).stop 2024-09-21T06:02:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.622+0000 7fdaa039d740 1 -- 172.21.15.7:0/2632955863 shutdown_connections 2024-09-21T06:02:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.622+0000 7fdaa039d740 1 --2- 172.21.15.7:0/2632955863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce7375390 0x562ce773dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.622+0000 7fdaa039d740 1 --2- 172.21.15.7:0/2632955863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce736d1b0 0x562ce773d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.622+0000 7fdaa039d740 1 --2- 172.21.15.7:0/2632955863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce773d2c0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.622+0000 7fdaa039d740 1 -- 172.21.15.7:0/2632955863 >> 172.21.15.7:0/2632955863 conn(0x562ce738a460 msgr2=0x562ce773b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.622+0000 7fdaa039d740 1 -- 172.21.15.7:0/2632955863 shutdown_connections 2024-09-21T06:02:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.622+0000 7fdaa039d740 1 -- 172.21.15.7:0/2632955863 wait complete. 2024-09-21T06:02:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.622+0000 7fdaa039d740 1 -- start start 2024-09-21T06:02:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fdaa039d740 1 Processor -- start 2024-09-21T06:02:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fdaa039d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce736d1b0 0x562ce77489a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fdaa039d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce7375390 0x562ce7748ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fdaa039d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce7754dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fdaa039d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562ce7504700 con 0x562ce7396070 2024-09-21T06:02:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fdaa039d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x562ce763e160 con 0x562ce736d1b0 2024-09-21T06:02:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fdaa039d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562ce774baa0 con 0x562ce7375390 2024-09-21T06:02:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fdaa039d740 10 client.0 _ll_register_callbacks cb 0x562ce76579e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fda92ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce7754dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fda92ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce7754dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48328/0 (socket says 172.21.15.7:48328) 2024-09-21T06:02:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fda92ffd640 1 -- 172.21.15.7:0/4076309472 learned_addr learned my addr 172.21.15.7:0/4076309472 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fda937fe640 1 --2- 172.21.15.7:0/4076309472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce7375390 0x562ce7748ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fda92ffd640 1 --2- 172.21.15.7:0/4076309472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce736d1b0 0x562ce77489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fda92ffd640 1 -- 172.21.15.7:0/4076309472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce7375390 msgr2=0x562ce7748ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fda92ffd640 1 --2- 172.21.15.7:0/4076309472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce7375390 0x562ce7748ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fda92ffd640 1 -- 172.21.15.7:0/4076309472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce736d1b0 msgr2=0x562ce77489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fda92ffd640 1 --2- 172.21.15.7:0/4076309472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce736d1b0 0x562ce77489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.623+0000 7fda92ffd640 1 -- 172.21.15.7:0/4076309472 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ce766bc90 con 0x562ce7396070 2024-09-21T06:02:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.624+0000 7fda92ffd640 1 --2- 172.21.15.7:0/4076309472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce7754dc0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fda880118c0 tx=0x7fda8800b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22344a76a5600c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.624+0000 7fda72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.624+0000 7fda72ffd640 1 -- 172.21.15.7:0/4076309472 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda88019040 con 0x562ce7396070 2024-09-21T06:02:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.624+0000 7fda72ffd640 1 -- 172.21.15.7:0/4076309472 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7fda88011de0 con 0x562ce7396070 2024-09-21T06:02:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.624+0000 7fdaa039d740 1 -- 172.21.15.7:0/4076309472 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda880118f0 con 0x562ce7396070 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.624+0000 7fda72ffd640 1 -- 172.21.15.7:0/4076309472 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fda88005020 con 0x562ce7396070 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.624+0000 7fdaa039d740 10 client.17880 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.624+0000 7fdaa039d740 1 -- 172.21.15.7:0/4076309472 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ce77577a0 con 0x562ce7396070 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.624+0000 7fda72ffd640 1 -- 172.21.15.7:0/4076309472 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda880118f0 con 0x562ce7396070 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.625+0000 7fda72ffd640 1 -- 172.21.15.7:0/4076309472 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fda88004ce0 con 0x562ce7396070 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.625+0000 7fdaa039d740 10 client.17880 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.625+0000 7fdaa039d740 10 client.17880 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.625+0000 7fdaa039d740 20 client.17880 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.625+0000 7fdaa039d740 1 --2- 172.21.15.7:0/4076309472 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x562ce73549f0 0x562ce775ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.625+0000 7fdaa039d740 4 client.17880 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.625+0000 7fdaa039d740 1 -- 172.21.15.7:0/4076309472 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ce76b5df0 con 0x562ce73549f0 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.625+0000 7fda937fe640 1 --2- 172.21.15.7:0/4076309472 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x562ce73549f0 0x562ce775ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.626+0000 7fda72ffd640 10 client.17880 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.626+0000 7fda937fe640 1 --2- 172.21.15.7:0/4076309472 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x562ce73549f0 0x562ce775ab00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=53b5cf95bbc91fd3 server_cookie=878dc65ebb800967 in_seq=0 out_seq=0 2024-09-21T06:02:10.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.626+0000 7fda72ffd640 1 -- 172.21.15.7:0/4076309472 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ce76b5df0 con 0x562ce73549f0 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.626+0000 7fda72ffd640 10 client.17880 handle_command_reply: tid=0 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.626+0000 7fdaa039d740 1 client.17880 shutdown 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.627+0000 7fdaa039d740 1 -- 172.21.15.7:0/4076309472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 msgr2=0x562ce7754dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.627+0000 7fdaa039d740 1 --2- 172.21.15.7:0/4076309472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce7754dc0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fda880118c0 tx=0x7fda8800b3a0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.627+0000 7fdaa039d740 1 -- 172.21.15.7:0/4076309472 shutdown_connections 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.627+0000 7fdaa039d740 1 --2- 172.21.15.7:0/4076309472 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x562ce73549f0 0x562ce775ab00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.627+0000 7fda72ffd640 0 client.17880 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.627+0000 7fdaa039d740 1 --2- 172.21.15.7:0/4076309472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce7754dc0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.627+0000 7fdaa039d740 1 --2- 172.21.15.7:0/4076309472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce7375390 0x562ce7748ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.627+0000 7fdaa039d740 1 --2- 172.21.15.7:0/4076309472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce736d1b0 0x562ce77489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.627+0000 7fdaa039d740 1 -- 172.21.15.7:0/4076309472 >> 172.21.15.7:0/4076309472 conn(0x562ce738a460 msgr2=0x562ce77404a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.627+0000 7fdaa039d740 1 -- 172.21.15.7:0/4076309472 shutdown_connections 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.627+0000 7fdaa039d740 1 -- 172.21.15.7:0/4076309472 wait complete. 2024-09-21T06:02:10.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.627+0000 7fdaa039d740 20 client.17880 trim_cache size 0 max 16384 2024-09-21T06:02:10.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.640+0000 7fdaa039d740 1 Processor -- start 2024-09-21T06:02:10.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.640+0000 7fdaa039d740 1 -- start start 2024-09-21T06:02:10.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fdaa039d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce736d1b0 0x562ce773ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fdaa039d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7375390 0x562ce7754d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fdaa039d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce7396070 0x562ce774a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fdaa039d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fda941b4100 con 0x562ce7375390 2024-09-21T06:02:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fdaa039d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fda941b19d0 con 0x562ce7396070 2024-09-21T06:02:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fdaa039d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fda941af840 con 0x562ce736d1b0 2024-09-21T06:02:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fda937fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7375390 0x562ce7754d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fda937fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7375390 0x562ce7754d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48340/0 (socket says 172.21.15.7:48340) 2024-09-21T06:02:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fda937fe640 1 -- 172.21.15.7:0/4010512957 learned_addr learned my addr 172.21.15.7:0/4010512957 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fda92ffd640 1 --2- 172.21.15.7:0/4010512957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce736d1b0 0x562ce773ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fda937fe640 1 -- 172.21.15.7:0/4010512957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce736d1b0 msgr2=0x562ce773ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fda937fe640 1 --2- 172.21.15.7:0/4010512957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce736d1b0 0x562ce773ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fda937fe640 1 -- 172.21.15.7:0/4010512957 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce7396070 msgr2=0x562ce774a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:10.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fda92ffd640 1 --2- 172.21.15.7:0/4010512957 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce7396070 0x562ce774a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fda937fe640 1 --2- 172.21.15.7:0/4010512957 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce7396070 0x562ce774a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fda937fe640 1 -- 172.21.15.7:0/4010512957 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce77365d0 con 0x562ce7375390 2024-09-21T06:02:10.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fda937fe640 1 --2- 172.21.15.7:0/4010512957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7375390 0x562ce7754d30 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fda8400bdd0 tx=0x7fda840044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5dfc31613c1f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:10.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.641+0000 7fda797fa640 1 -- 172.21.15.7:0/4010512957 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84003e20 con 0x562ce7375390 2024-09-21T06:02:10.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.642+0000 7fda797fa640 1 -- 172.21.15.7:0/4010512957 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda8401d8d0 con 0x562ce7375390 2024-09-21T06:02:10.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.642+0000 7fda797fa640 1 -- 172.21.15.7:0/4010512957 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84024a20 con 0x562ce7375390 2024-09-21T06:02:10.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.642+0000 7fdaa039d740 1 -- 172.21.15.7:0/4010512957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7375390 msgr2=0x562ce7754d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:10.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.642+0000 7fdaa039d740 1 --2- 172.21.15.7:0/4010512957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7375390 0x562ce7754d30 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fda8400bdd0 tx=0x7fda840044d0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.642+0000 7fdaa039d740 1 -- 172.21.15.7:0/4010512957 shutdown_connections 2024-09-21T06:02:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.642+0000 7fdaa039d740 1 --2- 172.21.15.7:0/4010512957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7375390 0x562ce7754d30 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.642+0000 7fdaa039d740 1 --2- 172.21.15.7:0/4010512957 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce7396070 0x562ce774a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.642+0000 7fdaa039d740 1 --2- 172.21.15.7:0/4010512957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce736d1b0 0x562ce773ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.642+0000 7fdaa039d740 1 -- 172.21.15.7:0/4010512957 >> 172.21.15.7:0/4010512957 conn(0x562ce738a460 msgr2=0x562ce7749ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.642+0000 7fdaa039d740 1 -- 172.21.15.7:0/4010512957 shutdown_connections 2024-09-21T06:02:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.642+0000 7fdaa039d740 1 -- 172.21.15.7:0/4010512957 wait complete. 2024-09-21T06:02:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.643+0000 7fdaa039d740 1 -- start start 2024-09-21T06:02:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.643+0000 7fdaa039d740 1 Processor -- start 2024-09-21T06:02:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.643+0000 7fdaa039d740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce736d1b0 0x562ce775bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.643+0000 7fdaa039d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce7375390 0x562ce775c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.643+0000 7fdaa039d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce775c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.643+0000 7fdaa039d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fda941afe90 con 0x562ce7396070 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.643+0000 7fdaa039d740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fda941b1300 con 0x562ce736d1b0 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.643+0000 7fdaa039d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fda941b0560 con 0x562ce7375390 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.643+0000 7fdaa039d740 10 client.0 _ll_register_callbacks cb 0x7fda88013400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda92ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce775c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda92ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce775c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48342/0 (socket says 172.21.15.7:48342) 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda92ffd640 1 -- 172.21.15.7:0/1518830591 learned_addr learned my addr 172.21.15.7:0/1518830591 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda937fe640 1 --2- 172.21.15.7:0/1518830591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce7375390 0x562ce775c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda92ffd640 1 --2- 172.21.15.7:0/1518830591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce736d1b0 0x562ce775bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda92ffd640 1 -- 172.21.15.7:0/1518830591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce7375390 msgr2=0x562ce775c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda92ffd640 1 --2- 172.21.15.7:0/1518830591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce7375390 0x562ce775c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda92ffd640 1 -- 172.21.15.7:0/1518830591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce736d1b0 msgr2=0x562ce775bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda92ffd640 1 --2- 172.21.15.7:0/1518830591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce736d1b0 0x562ce775bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda92ffd640 1 -- 172.21.15.7:0/1518830591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ce77c4280 con 0x562ce7396070 2024-09-21T06:02:10.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda92ffd640 1 --2- 172.21.15.7:0/1518830591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce775c560 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fda88006010 tx=0x7fda8800b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e789a95f5f7a5218 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda72ffd640 1 -- 172.21.15.7:0/1518830591 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda88019040 con 0x562ce7396070 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fdaa039d740 1 -- 172.21.15.7:0/1518830591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda8401d8d0 con 0x562ce7396070 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda72ffd640 1 -- 172.21.15.7:0/1518830591 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7fda88011de0 con 0x562ce7396070 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fda72ffd640 1 -- 172.21.15.7:0/1518830591 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fda88011440 con 0x562ce7396070 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fdaa039d740 10 client.17886 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.644+0000 7fdaa039d740 1 -- 172.21.15.7:0/1518830591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ce77c5420 con 0x562ce7396070 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.645+0000 7fda72ffd640 1 -- 172.21.15.7:0/1518830591 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda8401d8d0 con 0x562ce7396070 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.645+0000 7fda72ffd640 1 -- 172.21.15.7:0/1518830591 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fda88041030 con 0x562ce7396070 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.645+0000 7fdaa039d740 10 client.17886 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.645+0000 7fdaa039d740 10 client.17886 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.645+0000 7fdaa039d740 20 client.17886 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.645+0000 7fdaa039d740 1 --2- 172.21.15.7:0/1518830591 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x562ce7329da0 0x562ce77c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.645+0000 7fdaa039d740 4 client.17886 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:02:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.645+0000 7fdaa039d740 1 -- 172.21.15.7:0/1518830591 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ce76b18a0 con 0x562ce7329da0 2024-09-21T06:02:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.645+0000 7fda937fe640 1 --2- 172.21.15.7:0/1518830591 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x562ce7329da0 0x562ce77c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fda937fe640 1 --2- 172.21.15.7:0/1518830591 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x562ce7329da0 0x562ce77c7b20 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e61d2bd971e2b78c server_cookie=1ef1d9993442d444 in_seq=0 out_seq=0 2024-09-21T06:02:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fda72ffd640 10 client.17886 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:02:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fda72ffd640 1 -- 172.21.15.7:0/1518830591 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ce76b18a0 con 0x562ce7329da0 2024-09-21T06:02:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fda72ffd640 10 client.17886 handle_command_reply: tid=0 2024-09-21T06:02:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fdaa039d740 1 client.17886 shutdown 2024-09-21T06:02:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fdaa039d740 1 -- 172.21.15.7:0/1518830591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 msgr2=0x562ce775c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fdaa039d740 1 --2- 172.21.15.7:0/1518830591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce775c560 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fda88006010 tx=0x7fda8800b3a0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fdaa039d740 1 -- 172.21.15.7:0/1518830591 shutdown_connections 2024-09-21T06:02:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fdaa039d740 1 --2- 172.21.15.7:0/1518830591 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x562ce7329da0 0x562ce77c7b20 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fdaa039d740 1 --2- 172.21.15.7:0/1518830591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ce7396070 0x562ce775c560 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fdaa039d740 1 --2- 172.21.15.7:0/1518830591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562ce7375390 0x562ce775c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fdaa039d740 1 --2- 172.21.15.7:0/1518830591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x562ce736d1b0 0x562ce775bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fdaa039d740 1 -- 172.21.15.7:0/1518830591 >> 172.21.15.7:0/1518830591 conn(0x562ce738a460 msgr2=0x562ce774a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:10.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fda72ffd640 0 client.17886 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:02:10.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fdaa039d740 1 -- 172.21.15.7:0/1518830591 shutdown_connections 2024-09-21T06:02:10.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fdaa039d740 1 -- 172.21.15.7:0/1518830591 wait complete. 2024-09-21T06:02:10.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.646+0000 7fdaa039d740 20 client.17886 trim_cache size 0 max 16384 2024-09-21T06:02:10.654 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:02:10.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.647+0000 7fda99e29640 1 -- 172.21.15.7:0/280970141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fda7c0b6680 msgr2=0x7fda7c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:10.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.647+0000 7fda99e29640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fda7c0b6680 0x7fda7c0b8b90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0ce7b0 tx=0x7fda8c02f660 comp rx=0 tx=0).stop 2024-09-21T06:02:10.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.647+0000 7fda99e29640 1 -- 172.21.15.7:0/280970141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda94109df0 msgr2=0x7fda94076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.647+0000 7fda99e29640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda94109df0 0x7fda94076190 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fda8c005cc0 tx=0x7fda8c02f380 comp rx=0 tx=0).stop 2024-09-21T06:02:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.647+0000 7fda99e29640 1 -- 172.21.15.7:0/280970141 shutdown_connections 2024-09-21T06:02:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.647+0000 7fda99e29640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fda7c0b6680 0x7fda7c0b8b90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.647+0000 7fda99e29640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda94109df0 0x7fda94076190 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.647+0000 7fda99e29640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda941094a0 0x7fda94075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.647+0000 7fda99e29640 1 --2- 172.21.15.7:0/280970141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda94103b60 0x7fda94075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.647+0000 7fda99e29640 1 -- 172.21.15.7:0/280970141 >> 172.21.15.7:0/280970141 conn(0x7fda9407b850 msgr2=0x7fda94107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.647+0000 7fda99e29640 1 -- 172.21.15.7:0/280970141 shutdown_connections 2024-09-21T06:02:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:10.647+0000 7fda99e29640 1 -- 172.21.15.7:0/280970141 wait complete. 2024-09-21T06:02:11.460 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:02:11.724 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:12.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:11 smithi007 ceph-mon[30983]: pgmap v572: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:02:12.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.180+0000 7fb0c490a640 1 -- 172.21.15.7:0/2131797313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0c0103b60 msgr2=0x7fb0c0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:12.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.180+0000 7fb0c490a640 1 --2- 172.21.15.7:0/2131797313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0c0103b60 0x7fb0c0103f70 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009900 tx=0x7fb0b002a410 comp rx=0 tx=0).stop 2024-09-21T06:02:12.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.180+0000 7fb0c490a640 1 -- 172.21.15.7:0/2131797313 shutdown_connections 2024-09-21T06:02:12.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.180+0000 7fb0c490a640 1 --2- 172.21.15.7:0/2131797313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0c0109df0 0x7fb0c0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.180+0000 7fb0c490a640 1 --2- 172.21.15.7:0/2131797313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c01094a0 0x7fb0c01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.180+0000 7fb0c490a640 1 --2- 172.21.15.7:0/2131797313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0c0103b60 0x7fb0c0103f70 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.180+0000 7fb0c490a640 1 -- 172.21.15.7:0/2131797313 >> 172.21.15.7:0/2131797313 conn(0x7fb0c007b850 msgr2=0x7fb0c007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:12.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.180+0000 7fb0c490a640 1 -- 172.21.15.7:0/2131797313 shutdown_connections 2024-09-21T06:02:12.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.180+0000 7fb0c490a640 1 -- 172.21.15.7:0/2131797313 wait complete. 2024-09-21T06:02:12.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.181+0000 7fb0c490a640 1 Processor -- start 2024-09-21T06:02:12.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.181+0000 7fb0c490a640 1 -- start start 2024-09-21T06:02:12.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0c490a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0c0103b60 0x7fb0c019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0c490a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c01094a0 0x7fb0c019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0c490a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0c0109df0 0x7fb0c019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0c490a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c0113ab0 con 0x7fb0c0109df0 2024-09-21T06:02:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0c490a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c0113930 con 0x7fb0c0103b60 2024-09-21T06:02:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0c490a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c0113c30 con 0x7fb0c01094a0 2024-09-21T06:02:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0bed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0c0109df0 0x7fb0c019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0bed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0c0109df0 0x7fb0c019fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48356/0 (socket says 172.21.15.7:48356) 2024-09-21T06:02:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0bed9d640 1 -- 172.21.15.7:0/3374542302 learned_addr learned my addr 172.21.15.7:0/3374542302 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0be59c640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0c0103b60 0x7fb0c019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0b5d9b640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c01094a0 0x7fb0c019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0bed9d640 1 -- 172.21.15.7:0/3374542302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c01094a0 msgr2=0x7fb0c019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0bed9d640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c01094a0 0x7fb0c019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0bed9d640 1 -- 172.21.15.7:0/3374542302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0c0103b60 msgr2=0x7fb0c019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0bed9d640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0c0103b60 0x7fb0c019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.182+0000 7fb0bed9d640 1 -- 172.21.15.7:0/3374542302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c01a0310 con 0x7fb0c0109df0 2024-09-21T06:02:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.183+0000 7fb0bed9d640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0c0109df0 0x7fb0c019fca0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800cad0 tx=0x7fb0b800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.183+0000 7fb0b7fff640 1 -- 172.21.15.7:0/3374542302 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b800ae20 con 0x7fb0c0109df0 2024-09-21T06:02:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.183+0000 7fb0c490a640 1 -- 172.21.15.7:0/3374542302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c01a0600 con 0x7fb0c0109df0 2024-09-21T06:02:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.183+0000 7fb0b7fff640 1 -- 172.21.15.7:0/3374542302 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0b8005020 con 0x7fb0c0109df0 2024-09-21T06:02:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.183+0000 7fb0b7fff640 1 -- 172.21.15.7:0/3374542302 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b800f6b0 con 0x7fb0c0109df0 2024-09-21T06:02:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.183+0000 7fb0c490a640 1 -- 172.21.15.7:0/3374542302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c01a6e20 con 0x7fb0c0109df0 2024-09-21T06:02:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.186+0000 7fb0cae7e740 1 Processor -- start 2024-09-21T06:02:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.186+0000 7fb0b7fff640 1 -- 172.21.15.7:0/3374542302 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb0b8004b20 con 0x7fb0c0109df0 2024-09-21T06:02:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.186+0000 7fb0cae7e740 1 -- start start 2024-09-21T06:02:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0cae7e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf10d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0cae7e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 0x55bfbf10dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0cae7e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed45390 0x55bfbf10e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0cae7e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bfbf083ea0 con 0x55bfbed3d1b0 2024-09-21T06:02:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0cae7e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55bfbf0732d0 con 0x55bfbed66070 2024-09-21T06:02:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0cae7e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55bfbf0770e0 con 0x55bfbed45390 2024-09-21T06:02:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 0x55bfbf10dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 0x55bfbf10dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48360/0 (socket says 172.21.15.7:48360) 2024-09-21T06:02:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0be59c640 1 -- 172.21.15.7:0/3226465754 learned_addr learned my addr 172.21.15.7:0/3226465754 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0b5d9b640 1 --2- 172.21.15.7:0/3226465754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf10d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0b5d9b640 1 --2- 172.21.15.7:0/3226465754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed45390 0x55bfbf10e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0be59c640 1 -- 172.21.15.7:0/3226465754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed45390 msgr2=0x55bfbf10e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:12.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0be59c640 1 --2- 172.21.15.7:0/3226465754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed45390 0x55bfbf10e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0be59c640 1 -- 172.21.15.7:0/3226465754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 msgr2=0x55bfbf10d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:12.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0be59c640 1 --2- 172.21.15.7:0/3226465754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf10d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0be59c640 1 -- 172.21.15.7:0/3226465754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfbedd1650 con 0x55bfbed3d1b0 2024-09-21T06:02:12.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0b7fff640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb0ac0b66b0 0x7fb0ac0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.187+0000 7fb0be59c640 1 --2- 172.21.15.7:0/3226465754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 0x55bfbf10dbe0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009900 tx=0x7fb0b0031e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f551ed6fd790cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:12.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.188+0000 7fb0b5d9b640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb0ac0b66b0 0x7fb0ac0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.188+0000 7fb0b7fff640 1 -- 172.21.15.7:0/3374542302 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7fb0b80e76f0 con 0x7fb0c0109df0 2024-09-21T06:02:12.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.188+0000 7fb0b4d99640 1 -- 172.21.15.7:0/3226465754 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0040070 con 0x55bfbed3d1b0 2024-09-21T06:02:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.188+0000 7fb0b4d99640 1 -- 172.21.15.7:0/3226465754 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0b00316a0 con 0x55bfbed3d1b0 2024-09-21T06:02:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.188+0000 7fb0b4d99640 1 -- 172.21.15.7:0/3226465754 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0035040 con 0x55bfbed3d1b0 2024-09-21T06:02:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.189+0000 7fb0cae7e740 1 -- 172.21.15.7:0/3226465754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 msgr2=0x55bfbf10dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.189+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/3226465754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 0x55bfbf10dbe0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009900 tx=0x7fb0b0031e50 comp rx=0 tx=0).stop 2024-09-21T06:02:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.189+0000 7fb0b5d9b640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb0ac0b66b0 0x7fb0ac0b8bc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb0c01064c0 tx=0x7fb0a8004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.189+0000 7fb0cae7e740 1 -- 172.21.15.7:0/3226465754 shutdown_connections 2024-09-21T06:02:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.189+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/3226465754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 0x55bfbf10dbe0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.189+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/3226465754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed45390 0x55bfbf10e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.189+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/3226465754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf10d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.189+0000 7fb0cae7e740 1 -- 172.21.15.7:0/3226465754 >> 172.21.15.7:0/3226465754 conn(0x55bfbed5a460 msgr2=0x55bfbf10b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:12.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.189+0000 7fb0cae7e740 1 -- 172.21.15.7:0/3226465754 shutdown_connections 2024-09-21T06:02:12.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.189+0000 7fb0cae7e740 1 -- 172.21.15.7:0/3226465754 wait complete. 2024-09-21T06:02:12.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.189+0000 7fb0cae7e740 1 -- start start 2024-09-21T06:02:12.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0cae7e740 1 Processor -- start 2024-09-21T06:02:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0cae7e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed3d1b0 0x55bfbf118da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0cae7e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 0x55bfbf1192e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0cae7e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf125110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0cae7e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bfbeed4700 con 0x55bfbed45390 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0cae7e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55bfbf00e160 con 0x55bfbed66070 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0cae7e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55bfbf11be20 con 0x55bfbed3d1b0 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0cae7e740 10 client.0 _ll_register_callbacks cb 0x55bfbf0279e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0b5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 0x55bfbf1192e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0b5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 0x55bfbf1192e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48376/0 (socket says 172.21.15.7:48376) 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0b5d9b640 1 -- 172.21.15.7:0/2868168105 learned_addr learned my addr 172.21.15.7:0/2868168105 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0bed9d640 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf125110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0be59c640 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed3d1b0 0x55bfbf118da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0b5d9b640 1 -- 172.21.15.7:0/2868168105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed3d1b0 msgr2=0x55bfbf118da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0b5d9b640 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed3d1b0 0x55bfbf118da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0b5d9b640 1 -- 172.21.15.7:0/2868168105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 msgr2=0x55bfbf125110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0b5d9b640 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf125110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0b5d9b640 1 -- 172.21.15.7:0/2868168105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfbf03bc90 con 0x55bfbed45390 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.190+0000 7fb0bed9d640 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf125110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.191+0000 7fb0b5d9b640 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 0x55bfbf1192e0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800e400 tx=0x7fb0a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5755e184b13b9fa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.191+0000 7fb0a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.191+0000 7fb0a5ffb640 1 -- 172.21.15.7:0/2868168105 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8018070 con 0x55bfbed45390 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.191+0000 7fb0a5ffb640 1 -- 172.21.15.7:0/2868168105 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7fb0a8005220 con 0x55bfbed45390 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.191+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2868168105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0b00316a0 con 0x55bfbed45390 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.191+0000 7fb0a5ffb640 1 -- 172.21.15.7:0/2868168105 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb0a8005420 con 0x55bfbed45390 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.191+0000 7fb0cae7e740 10 client.17898 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.191+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2868168105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bfbf127b70 con 0x55bfbed45390 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.191+0000 7fb0a5ffb640 1 -- 172.21.15.7:0/2868168105 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0b00316a0 con 0x55bfbed45390 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.192+0000 7fb0a5ffb640 1 -- 172.21.15.7:0/2868168105 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb0a802e020 con 0x55bfbed45390 2024-09-21T06:02:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.192+0000 7fb0cae7e740 10 client.17898 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.192+0000 7fb0cae7e740 10 client.17898 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.192+0000 7fb0cae7e740 20 client.17898 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.192+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bfbed249f0 0x55bfbf12b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.192+0000 7fb0cae7e740 4 client.17898 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.192+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2868168105 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfbf085df0 con 0x55bfbed249f0 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.192+0000 7fb0be59c640 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bfbed249f0 0x55bfbf12b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.193+0000 7fb0be59c640 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bfbed249f0 0x55bfbf12b0d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12600784f39b8ff2 server_cookie=9e0c49af794488e4 in_seq=0 out_seq=0 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.193+0000 7fb0a5ffb640 10 client.17898 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.193+0000 7fb0a5ffb640 1 -- 172.21.15.7:0/2868168105 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bfbf085df0 con 0x55bfbed249f0 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.193+0000 7fb0a5ffb640 10 client.17898 handle_command_reply: tid=0 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.194+0000 7fb0cae7e740 1 client.17898 shutdown 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.194+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2868168105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 msgr2=0x55bfbf1192e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.194+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 0x55bfbf1192e0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800e400 tx=0x7fb0a80046c0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.194+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2868168105 shutdown_connections 2024-09-21T06:02:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.194+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bfbed249f0 0x55bfbf12b0d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.194+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 0x55bfbf1192e0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.194+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf125110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.194+0000 7fb0a5ffb640 0 client.17898 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.194+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/2868168105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed3d1b0 0x55bfbf118da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.194+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2868168105 >> 172.21.15.7:0/2868168105 conn(0x55bfbed5a460 msgr2=0x55bfbf110880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.194+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2868168105 shutdown_connections 2024-09-21T06:02:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.194+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2868168105 wait complete. 2024-09-21T06:02:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.194+0000 7fb0cae7e740 20 client.17898 trim_cache size 0 max 16384 2024-09-21T06:02:12.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.207+0000 7fb0cae7e740 1 Processor -- start 2024-09-21T06:02:12.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.207+0000 7fb0cae7e740 1 -- start start 2024-09-21T06:02:12.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.207+0000 7fb0cae7e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 0x55bfbf117c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.207+0000 7fb0cae7e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed45390 0x55bfbf10ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.207+0000 7fb0cae7e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf125010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.207+0000 7fb0cae7e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01b1f10 con 0x55bfbed3d1b0 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.207+0000 7fb0cae7e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01af7e0 con 0x55bfbed66070 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.207+0000 7fb0cae7e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01ad650 con 0x55bfbed45390 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 0x55bfbf117c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 0x55bfbf117c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48386/0 (socket says 172.21.15.7:48386) 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0be59c640 1 -- 172.21.15.7:0/3338072121 learned_addr learned my addr 172.21.15.7:0/3338072121 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0b5d9b640 1 --2- 172.21.15.7:0/3338072121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed45390 0x55bfbf10ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0bed9d640 1 --2- 172.21.15.7:0/3338072121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf125010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0be59c640 1 -- 172.21.15.7:0/3338072121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed45390 msgr2=0x55bfbf10ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0be59c640 1 --2- 172.21.15.7:0/3338072121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed45390 0x55bfbf10ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0be59c640 1 -- 172.21.15.7:0/3338072121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 msgr2=0x55bfbf125010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0be59c640 1 --2- 172.21.15.7:0/3338072121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf125010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0be59c640 1 -- 172.21.15.7:0/3338072121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfbf11b4e0 con 0x55bfbed3d1b0 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0bed9d640 1 --2- 172.21.15.7:0/3338072121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf125010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:02:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0be59c640 1 --2- 172.21.15.7:0/3338072121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 0x55bfbf117c90 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005400 tx=0x7fb0b0005430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec948cd267043128 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:12.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0a7fff640 1 -- 172.21.15.7:0/3338072121 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0040040 con 0x55bfbed3d1b0 2024-09-21T06:02:12.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0a7fff640 1 -- 172.21.15.7:0/3338072121 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0b0031950 con 0x55bfbed3d1b0 2024-09-21T06:02:12.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.208+0000 7fb0a7fff640 1 -- 172.21.15.7:0/3338072121 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0035040 con 0x55bfbed3d1b0 2024-09-21T06:02:12.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.209+0000 7fb0cae7e740 1 -- 172.21.15.7:0/3338072121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 msgr2=0x55bfbf117c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:12.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.209+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/3338072121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 0x55bfbf117c90 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005400 tx=0x7fb0b0005430 comp rx=0 tx=0).stop 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.209+0000 7fb0cae7e740 1 -- 172.21.15.7:0/3338072121 shutdown_connections 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.209+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/3338072121 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed66070 0x55bfbf125010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.209+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/3338072121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed45390 0x55bfbf10ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.209+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/3338072121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed3d1b0 0x55bfbf117c90 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.209+0000 7fb0cae7e740 1 -- 172.21.15.7:0/3338072121 >> 172.21.15.7:0/3338072121 conn(0x55bfbed5a460 msgr2=0x55bfbf10e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.209+0000 7fb0cae7e740 1 -- 172.21.15.7:0/3338072121 shutdown_connections 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.209+0000 7fb0cae7e740 1 -- 172.21.15.7:0/3338072121 wait complete. 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.210+0000 7fb0cae7e740 1 -- start start 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.210+0000 7fb0cae7e740 1 Processor -- start 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.210+0000 7fb0cae7e740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed3d1b0 0x55bfbf11d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.210+0000 7fb0cae7e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 0x55bfbf11dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.210+0000 7fb0cae7e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed66070 0x55bfbf194a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.210+0000 7fb0cae7e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01adca0 con 0x55bfbed45390 2024-09-21T06:02:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.210+0000 7fb0cae7e740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01af110 con 0x55bfbed3d1b0 2024-09-21T06:02:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.210+0000 7fb0cae7e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01ae370 con 0x55bfbed66070 2024-09-21T06:02:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.210+0000 7fb0cae7e740 10 client.0 _ll_register_callbacks cb 0x7fb0a800ee30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.210+0000 7fb0b5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 0x55bfbf11dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.210+0000 7fb0b5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 0x55bfbf11dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48388/0 (socket says 172.21.15.7:48388) 2024-09-21T06:02:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.210+0000 7fb0b5d9b640 1 -- 172.21.15.7:0/2596792399 learned_addr learned my addr 172.21.15.7:0/2596792399 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.210+0000 7fb0be59c640 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed3d1b0 0x55bfbf11d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0bed9d640 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed66070 0x55bfbf194a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0b5d9b640 1 -- 172.21.15.7:0/2596792399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed66070 msgr2=0x55bfbf194a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0b5d9b640 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed66070 0x55bfbf194a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0b5d9b640 1 -- 172.21.15.7:0/2596792399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed3d1b0 msgr2=0x55bfbf11d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0b5d9b640 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed3d1b0 0x55bfbf11d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0b5d9b640 1 -- 172.21.15.7:0/2596792399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfbf195050 con 0x55bfbed45390 2024-09-21T06:02:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0be59c640 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed3d1b0 0x55bfbf11d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0b5d9b640 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 0x55bfbf11dd80 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800e400 tx=0x7fb0a800fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fe5b56e647b789 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0a5ffb640 1 -- 172.21.15.7:0/2596792399 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a803f060 con 0x55bfbed45390 2024-09-21T06:02:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0a5ffb640 1 -- 172.21.15.7:0/2596792399 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7fb0a8030460 con 0x55bfbed45390 2024-09-21T06:02:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2596792399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0b0031950 con 0x55bfbed45390 2024-09-21T06:02:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0a5ffb640 1 -- 172.21.15.7:0/2596792399 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb0a8036070 con 0x55bfbed45390 2024-09-21T06:02:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0cae7e740 10 client.17904 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.211+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2596792399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bfbf196240 con 0x55bfbed45390 2024-09-21T06:02:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.212+0000 7fb0a5ffb640 1 -- 172.21.15.7:0/2596792399 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0b0031950 con 0x55bfbed45390 2024-09-21T06:02:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.212+0000 7fb0a5ffb640 1 -- 172.21.15.7:0/2596792399 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb0a802e050 con 0x55bfbed45390 2024-09-21T06:02:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.212+0000 7fb0cae7e740 10 client.17904 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.212+0000 7fb0cae7e740 10 client.17904 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.212+0000 7fb0cae7e740 20 client.17904 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.212+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bfbecf9da0 0x55bfbf198970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.212+0000 7fb0cae7e740 4 client.17904 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.212+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2596792399 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bfbf0818a0 con 0x55bfbecf9da0 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.212+0000 7fb0be59c640 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bfbecf9da0 0x55bfbf198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0a5ffb640 10 client.17904 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.212+0000 7fb0be59c640 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bfbecf9da0 0x55bfbf198970 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9279cc83aadeca4d server_cookie=c04fbef9e5ca365f in_seq=0 out_seq=0 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0a5ffb640 1 -- 172.21.15.7:0/2596792399 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bfbf0818a0 con 0x55bfbecf9da0 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0a5ffb640 10 client.17904 handle_command_reply: tid=0 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0cae7e740 1 client.17904 shutdown 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2596792399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 msgr2=0x55bfbf11dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 0x55bfbf11dd80 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800e400 tx=0x7fb0a800fc20 comp rx=0 tx=0).stop 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2596792399 shutdown_connections 2024-09-21T06:02:12.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55bfbecf9da0 0x55bfbf198970 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bfbed45390 0x55bfbf11dd80 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bfbed66070 0x55bfbf194a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0cae7e740 1 --2- 172.21.15.7:0/2596792399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55bfbed3d1b0 0x55bfbf11d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2596792399 >> 172.21.15.7:0/2596792399 conn(0x55bfbed5a460 msgr2=0x55bfbf11a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0a5ffb640 0 client.17904 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2596792399 shutdown_connections 2024-09-21T06:02:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0cae7e740 1 -- 172.21.15.7:0/2596792399 wait complete. 2024-09-21T06:02:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.213+0000 7fb0cae7e740 20 client.17904 trim_cache size 0 max 16384 2024-09-21T06:02:12.220 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:02:12.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.214+0000 7fb0c490a640 1 -- 172.21.15.7:0/3374542302 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb0ac0b66b0 msgr2=0x7fb0ac0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:12.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.214+0000 7fb0c490a640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb0ac0b66b0 0x7fb0ac0b8bc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb0c01064c0 tx=0x7fb0a8004730 comp rx=0 tx=0).stop 2024-09-21T06:02:12.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.214+0000 7fb0c490a640 1 -- 172.21.15.7:0/3374542302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0c0109df0 msgr2=0x7fb0c019fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:12.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.214+0000 7fb0c490a640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0c0109df0 0x7fb0c019fca0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800cad0 tx=0x7fb0b800cf90 comp rx=0 tx=0).stop 2024-09-21T06:02:12.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.214+0000 7fb0c490a640 1 -- 172.21.15.7:0/3374542302 shutdown_connections 2024-09-21T06:02:12.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.214+0000 7fb0c490a640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb0ac0b66b0 0x7fb0ac0b8bc0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.214+0000 7fb0c490a640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0c0109df0 0x7fb0c019fca0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.214+0000 7fb0c490a640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c01094a0 0x7fb0c019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.214+0000 7fb0c490a640 1 --2- 172.21.15.7:0/3374542302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb0c0103b60 0x7fb0c019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.214+0000 7fb0c490a640 1 -- 172.21.15.7:0/3374542302 >> 172.21.15.7:0/3374542302 conn(0x7fb0c007b850 msgr2=0x7fb0c0107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.214+0000 7fb0c490a640 1 -- 172.21.15.7:0/3374542302 shutdown_connections 2024-09-21T06:02:12.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:12.214+0000 7fb0c490a640 1 -- 172.21.15.7:0/3374542302 wait complete. 2024-09-21T06:02:12.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:11 smithi027 ceph-mon[34364]: pgmap v572: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:02:12.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:11 smithi119 ceph-mon[34833]: pgmap v572: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:02:13.853 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:02:13.853 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:02:14.124 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:14.144 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:13 smithi119 ceph-mon[34833]: pgmap v573: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:02:14.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:13 smithi027 ceph-mon[34364]: pgmap v573: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:02:14.245 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:13 smithi007 ceph-mon[30983]: pgmap v573: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:02:14.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.660+0000 7f3e82350640 1 -- 172.21.15.7:0/1202101802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e7c109e40 msgr2=0x7f3e7c110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:14.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.660+0000 7f3e82350640 1 --2- 172.21.15.7:0/1202101802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e7c109e40 0x7f3e7c110670 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009ca0 tx=0x7f3e7402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.660+0000 7f3e82350640 1 -- 172.21.15.7:0/1202101802 shutdown_connections 2024-09-21T06:02:14.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.660+0000 7f3e82350640 1 --2- 172.21.15.7:0/1202101802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e7c109e40 0x7f3e7c110670 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.660+0000 7f3e82350640 1 --2- 172.21.15.7:0/1202101802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e7c1094f0 0x7f3e7c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.660+0000 7f3e82350640 1 --2- 172.21.15.7:0/1202101802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e7c103bb0 0x7f3e7c103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.660+0000 7f3e82350640 1 -- 172.21.15.7:0/1202101802 >> 172.21.15.7:0/1202101802 conn(0x7f3e7c0ff600 msgr2=0x7f3e7c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:14.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.660+0000 7f3e82350640 1 -- 172.21.15.7:0/1202101802 shutdown_connections 2024-09-21T06:02:14.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.660+0000 7f3e82350640 1 -- 172.21.15.7:0/1202101802 wait complete. 2024-09-21T06:02:14.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.661+0000 7f3e82350640 1 Processor -- start 2024-09-21T06:02:14.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.661+0000 7f3e82350640 1 -- start start 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.661+0000 7f3e82350640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e7c103bb0 0x7f3e7c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.661+0000 7f3e82350640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e7c1094f0 0x7f3e7c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.661+0000 7f3e82350640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e7c109e40 0x7f3e7c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.661+0000 7f3e82350640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c113b00 con 0x7f3e7c1094f0 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.661+0000 7f3e82350640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c113980 con 0x7f3e7c103bb0 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.661+0000 7f3e82350640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c113c80 con 0x7f3e7c109e40 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.661+0000 7f3e73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e7c1094f0 0x7f3e7c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.661+0000 7f3e73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e7c1094f0 0x7f3e7c19aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48418/0 (socket says 172.21.15.7:48418) 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.661+0000 7f3e73fff640 1 -- 172.21.15.7:0/4032562200 learned_addr learned my addr 172.21.15.7:0/4032562200 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.661+0000 7f3e7bfff640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e7c103bb0 0x7f3e7c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.661+0000 7f3e808ed640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e7c109e40 0x7f3e7c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.662+0000 7f3e73fff640 1 -- 172.21.15.7:0/4032562200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e7c109e40 msgr2=0x7f3e7c19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.662+0000 7f3e73fff640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e7c109e40 0x7f3e7c19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.662+0000 7f3e73fff640 1 -- 172.21.15.7:0/4032562200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e7c103bb0 msgr2=0x7f3e7c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.662+0000 7f3e73fff640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e7c103bb0 0x7f3e7c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.662+0000 7f3e73fff640 1 -- 172.21.15.7:0/4032562200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7c1a03e0 con 0x7f3e7c1094f0 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.662+0000 7f3e73fff640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e7c1094f0 0x7f3e7c19aa10 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400d750 tx=0x7f3e6400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.662+0000 7f3e79ffb640 1 -- 172.21.15.7:0/4032562200 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64017070 con 0x7f3e7c1094f0 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.662+0000 7f3e79ffb640 1 -- 172.21.15.7:0/4032562200 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e640054d0 con 0x7f3e7c1094f0 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.662+0000 7f3e82350640 1 -- 172.21.15.7:0/4032562200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e7c1a06d0 con 0x7f3e7c1094f0 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.662+0000 7f3e79ffb640 1 -- 172.21.15.7:0/4032562200 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64004c30 con 0x7f3e7c1094f0 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.662+0000 7f3e82350640 1 -- 172.21.15.7:0/4032562200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e7c1a6e30 con 0x7f3e7c1094f0 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e888c4740 1 Processor -- start 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e79ffb640 1 -- 172.21.15.7:0/4032562200 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3e64004dd0 con 0x7f3e7c1094f0 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e888c4740 1 -- start start 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e888c4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac23460350 0x55ac23807430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e888c4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23437490 0x55ac23807970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e888c4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 0x55ac23807eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e888c4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ac2377de60 con 0x55ac2343f670 2024-09-21T06:02:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e888c4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55ac2376d290 con 0x55ac23460350 2024-09-21T06:02:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e888c4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ac237710a0 con 0x55ac23437490 2024-09-21T06:02:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 0x55ac23807eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 0x55ac23807eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48424/0 (socket says 172.21.15.7:48424) 2024-09-21T06:02:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e73fff640 1 -- 172.21.15.7:0/3394782933 learned_addr learned my addr 172.21.15.7:0/3394782933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e808ed640 1 --2- 172.21.15.7:0/3394782933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac23460350 0x55ac23807430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.665+0000 7f3e7bfff640 1 --2- 172.21.15.7:0/3394782933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23437490 0x55ac23807970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e73fff640 1 -- 172.21.15.7:0/3394782933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23437490 msgr2=0x55ac23807970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e73fff640 1 --2- 172.21.15.7:0/3394782933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23437490 0x55ac23807970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e73fff640 1 -- 172.21.15.7:0/3394782933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac23460350 msgr2=0x55ac23807430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e73fff640 1 --2- 172.21.15.7:0/3394782933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac23460350 0x55ac23807430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e73fff640 1 -- 172.21.15.7:0/3394782933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac234cb930 con 0x55ac2343f670 2024-09-21T06:02:14.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e808ed640 1 --2- 172.21.15.7:0/3394782933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac23460350 0x55ac23807430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e79ffb640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3e680b6680 0x7f3e680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e7bfff640 1 --2- 172.21.15.7:0/3394782933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23437490 0x55ac23807970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e808ed640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3e680b6680 0x7f3e680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e73fff640 1 --2- 172.21.15.7:0/3394782933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 0x55ac23807eb0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f3e640e4720 tx=0x7f3e640ef780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4e1f8726b7e5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e79ffb640 1 -- 172.21.15.7:0/4032562200 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7f3e640e7070 con 0x7f3e7c1094f0 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e727fc640 1 -- 172.21.15.7:0/3394782933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64020020 con 0x55ac2343f670 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e727fc640 1 -- 172.21.15.7:0/3394782933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e640efe30 con 0x55ac2343f670 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.666+0000 7f3e727fc640 1 -- 172.21.15.7:0/3394782933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e640ac8e0 con 0x55ac2343f670 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.667+0000 7f3e888c4740 1 -- 172.21.15.7:0/3394782933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 msgr2=0x55ac23807eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.667+0000 7f3e888c4740 1 --2- 172.21.15.7:0/3394782933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 0x55ac23807eb0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f3e640e4720 tx=0x7f3e640ef780 comp rx=0 tx=0).stop 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.667+0000 7f3e808ed640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3e680b6680 0x7f3e680b8b90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3e7402f500 tx=0x7f3e7402f490 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.667+0000 7f3e888c4740 1 -- 172.21.15.7:0/3394782933 shutdown_connections 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.667+0000 7f3e888c4740 1 --2- 172.21.15.7:0/3394782933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 0x55ac23807eb0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.667+0000 7f3e888c4740 1 --2- 172.21.15.7:0/3394782933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23437490 0x55ac23807970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.667+0000 7f3e888c4740 1 --2- 172.21.15.7:0/3394782933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac23460350 0x55ac23807430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.667+0000 7f3e888c4740 1 -- 172.21.15.7:0/3394782933 >> 172.21.15.7:0/3394782933 conn(0x55ac23454740 msgr2=0x55ac23805320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:14.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.667+0000 7f3e888c4740 1 -- 172.21.15.7:0/3394782933 shutdown_connections 2024-09-21T06:02:14.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.667+0000 7f3e888c4740 1 -- 172.21.15.7:0/3394782933 wait complete. 2024-09-21T06:02:14.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.668+0000 7f3e888c4740 1 -- start start 2024-09-21T06:02:14.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.668+0000 7f3e888c4740 1 Processor -- start 2024-09-21T06:02:14.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.668+0000 7f3e888c4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23437490 0x55ac23817320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.668+0000 7f3e888c4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac2343f670 0x55ac23817860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.668+0000 7f3e888c4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23460350 0x55ac23823270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.668+0000 7f3e888c4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ac235ce890 con 0x55ac23437490 2024-09-21T06:02:14.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.668+0000 7f3e888c4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55ac23707d40 con 0x55ac2343f670 2024-09-21T06:02:14.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.668+0000 7f3e888c4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ac23819ee0 con 0x55ac23460350 2024-09-21T06:02:14.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.668+0000 7f3e888c4740 10 client.0 _ll_register_callbacks cb 0x55ac2376bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:14.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.668+0000 7f3e7bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23437490 0x55ac23817320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.668+0000 7f3e7bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23437490 0x55ac23817320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48438/0 (socket says 172.21.15.7:48438) 2024-09-21T06:02:14.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.668+0000 7f3e7bfff640 1 -- 172.21.15.7:0/1298903190 learned_addr learned my addr 172.21.15.7:0/1298903190 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:14.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e73fff640 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac2343f670 0x55ac23817860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e808ed640 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23460350 0x55ac23823270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e7bfff640 1 -- 172.21.15.7:0/1298903190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23460350 msgr2=0x55ac23823270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:14.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e7bfff640 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23460350 0x55ac23823270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e7bfff640 1 -- 172.21.15.7:0/1298903190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac2343f670 msgr2=0x55ac23817860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:14.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e7bfff640 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac2343f670 0x55ac23817860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e7bfff640 1 -- 172.21.15.7:0/1298903190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac238237b0 con 0x55ac23437490 2024-09-21T06:02:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e808ed640 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23460350 0x55ac23823270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e7bfff640 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23437490 0x55ac23817320 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c012760 tx=0x7f3e6c012c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9ebf63cdd596fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e5b7fe640 1 -- 172.21.15.7:0/1298903190 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c00f920 con 0x55ac23437490 2024-09-21T06:02:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e5b7fe640 1 -- 172.21.15.7:0/1298903190 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7f3e6c00fac0 con 0x55ac23437490 2024-09-21T06:02:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e888c4740 1 -- 172.21.15.7:0/1298903190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e640efe30 con 0x55ac23437490 2024-09-21T06:02:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e5b7fe640 1 -- 172.21.15.7:0/1298903190 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e6c00fcc0 con 0x55ac23437490 2024-09-21T06:02:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e888c4740 10 client.17916 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e888c4740 1 -- 172.21.15.7:0/1298903190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ac238260f0 con 0x55ac23437490 2024-09-21T06:02:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.669+0000 7f3e5b7fe640 1 -- 172.21.15.7:0/1298903190 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e640efe30 con 0x55ac23437490 2024-09-21T06:02:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.670+0000 7f3e5b7fe640 1 -- 172.21.15.7:0/1298903190 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3e6c023070 con 0x55ac23437490 2024-09-21T06:02:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.670+0000 7f3e888c4740 10 client.17916 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.670+0000 7f3e888c4740 10 client.17916 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.670+0000 7f3e888c4740 20 client.17916 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.670+0000 7f3e888c4740 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55ac2341ecd0 0x55ac23829720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.670+0000 7f3e888c4740 4 client.17916 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.670+0000 7f3e888c4740 1 -- 172.21.15.7:0/1298903190 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac2377fdb0 con 0x55ac2341ecd0 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.670+0000 7f3e73fff640 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55ac2341ecd0 0x55ac23829720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.671+0000 7f3e73fff640 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55ac2341ecd0 0x55ac23829720 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=845e937c28d1692a server_cookie=212928ada5b72ff7 in_seq=0 out_seq=0 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.671+0000 7f3e5b7fe640 10 client.17916 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.671+0000 7f3e5b7fe640 1 -- 172.21.15.7:0/1298903190 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac2377fdb0 con 0x55ac2341ecd0 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.671+0000 7f3e5b7fe640 10 client.17916 handle_command_reply: tid=0 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.671+0000 7f3e888c4740 1 client.17916 shutdown 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.672+0000 7f3e888c4740 1 -- 172.21.15.7:0/1298903190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23437490 msgr2=0x55ac23817320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.672+0000 7f3e888c4740 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23437490 0x55ac23817320 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c012760 tx=0x7f3e6c012c20 comp rx=0 tx=0).stop 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.672+0000 7f3e888c4740 1 -- 172.21.15.7:0/1298903190 shutdown_connections 2024-09-21T06:02:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.672+0000 7f3e888c4740 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55ac2341ecd0 0x55ac23829720 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.672+0000 7f3e888c4740 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23460350 0x55ac23823270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.672+0000 7f3e888c4740 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac2343f670 0x55ac23817860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.672+0000 7f3e888c4740 1 --2- 172.21.15.7:0/1298903190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23437490 0x55ac23817320 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.672+0000 7f3e5b7fe640 0 client.17916 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:14.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.672+0000 7f3e888c4740 1 -- 172.21.15.7:0/1298903190 >> 172.21.15.7:0/1298903190 conn(0x55ac23454740 msgr2=0x55ac2380a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:14.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.672+0000 7f3e888c4740 1 -- 172.21.15.7:0/1298903190 shutdown_connections 2024-09-21T06:02:14.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.672+0000 7f3e888c4740 1 -- 172.21.15.7:0/1298903190 wait complete. 2024-09-21T06:02:14.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.672+0000 7f3e888c4740 20 client.17916 trim_cache size 0 max 16384 2024-09-21T06:02:14.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.690+0000 7f3e888c4740 1 Processor -- start 2024-09-21T06:02:14.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.690+0000 7f3e888c4740 1 -- start start 2024-09-21T06:02:14.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.690+0000 7f3e888c4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23437490 0x55ac23823170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.690+0000 7f3e888c4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac2343f670 0x55ac2380abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.690+0000 7f3e888c4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23460350 0x55ac23804b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.690+0000 7f3e888c4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1afd20 con 0x55ac23460350 2024-09-21T06:02:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.690+0000 7f3e888c4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1ad5f0 con 0x55ac2343f670 2024-09-21T06:02:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.690+0000 7f3e888c4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1ab440 con 0x55ac23437490 2024-09-21T06:02:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e808ed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23460350 0x55ac23804b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e808ed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23460350 0x55ac23804b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48452/0 (socket says 172.21.15.7:48452) 2024-09-21T06:02:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e808ed640 1 -- 172.21.15.7:0/2390773138 learned_addr learned my addr 172.21.15.7:0/2390773138 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e73fff640 1 --2- 172.21.15.7:0/2390773138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac2343f670 0x55ac2380abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e7bfff640 1 --2- 172.21.15.7:0/2390773138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23437490 0x55ac23823170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e808ed640 1 -- 172.21.15.7:0/2390773138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23437490 msgr2=0x55ac23823170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e808ed640 1 --2- 172.21.15.7:0/2390773138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23437490 0x55ac23823170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e808ed640 1 -- 172.21.15.7:0/2390773138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac2343f670 msgr2=0x55ac2380abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:14.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e808ed640 1 --2- 172.21.15.7:0/2390773138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac2343f670 0x55ac2380abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e808ed640 1 -- 172.21.15.7:0/2390773138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac238129b0 con 0x55ac23460350 2024-09-21T06:02:14.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e73fff640 1 --2- 172.21.15.7:0/2390773138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac2343f670 0x55ac2380abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:02:14.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e808ed640 1 --2- 172.21.15.7:0/2390773138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23460350 0x55ac23804b40 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009ca0 tx=0x7f3e74041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e3f1ba90991312 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:14.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e71ffb640 1 -- 172.21.15.7:0/2390773138 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e74003970 con 0x55ac23460350 2024-09-21T06:02:14.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.691+0000 7f3e71ffb640 1 -- 172.21.15.7:0/2390773138 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e74036050 con 0x55ac23460350 2024-09-21T06:02:14.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.692+0000 7f3e71ffb640 1 -- 172.21.15.7:0/2390773138 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7402f660 con 0x55ac23460350 2024-09-21T06:02:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.692+0000 7f3e888c4740 1 -- 172.21.15.7:0/2390773138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23460350 msgr2=0x55ac23804b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.692+0000 7f3e888c4740 1 --2- 172.21.15.7:0/2390773138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23460350 0x55ac23804b40 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009ca0 tx=0x7f3e74041000 comp rx=0 tx=0).stop 2024-09-21T06:02:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.692+0000 7f3e888c4740 1 -- 172.21.15.7:0/2390773138 shutdown_connections 2024-09-21T06:02:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.692+0000 7f3e888c4740 1 --2- 172.21.15.7:0/2390773138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac23460350 0x55ac23804b40 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.692+0000 7f3e888c4740 1 --2- 172.21.15.7:0/2390773138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac2343f670 0x55ac2380abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.692+0000 7f3e888c4740 1 --2- 172.21.15.7:0/2390773138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23437490 0x55ac23823170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.692+0000 7f3e888c4740 1 -- 172.21.15.7:0/2390773138 >> 172.21.15.7:0/2390773138 conn(0x55ac23454740 msgr2=0x55ac2380a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.693+0000 7f3e888c4740 1 -- 172.21.15.7:0/2390773138 shutdown_connections 2024-09-21T06:02:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.693+0000 7f3e888c4740 1 -- 172.21.15.7:0/2390773138 wait complete. 2024-09-21T06:02:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.693+0000 7f3e888c4740 1 -- start start 2024-09-21T06:02:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.693+0000 7f3e888c4740 1 Processor -- start 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e888c4740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac23437490 0x55ac2381bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e888c4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 0x55ac2381c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e888c4740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23460350 0x55ac2388d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e888c4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1abab0 con 0x55ac2343f670 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e888c4740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1acf20 con 0x55ac23437490 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e888c4740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1ac180 con 0x55ac23460350 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e888c4740 10 client.0 _ll_register_callbacks cb 0x7f3e6c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 0x55ac2381c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 0x55ac2381c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48460/0 (socket says 172.21.15.7:48460) 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e73fff640 1 -- 172.21.15.7:0/2028262627 learned_addr learned my addr 172.21.15.7:0/2028262627 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e7bfff640 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac23437490 0x55ac2381bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e808ed640 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23460350 0x55ac2388d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e73fff640 1 -- 172.21.15.7:0/2028262627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23460350 msgr2=0x55ac2388d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:14.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e73fff640 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23460350 0x55ac2388d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e73fff640 1 -- 172.21.15.7:0/2028262627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac23437490 msgr2=0x55ac2381bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e73fff640 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac23437490 0x55ac2381bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e73fff640 1 -- 172.21.15.7:0/2028262627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac2388d890 con 0x55ac2343f670 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e808ed640 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23460350 0x55ac2388d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e73fff640 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 0x55ac2381c280 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f3e640e4890 tx=0x7f3e640eabc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3da39cb28c9e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.694+0000 7f3e5b7fe640 1 -- 172.21.15.7:0/2028262627 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64020040 con 0x55ac2343f670 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e5b7fe640 1 -- 172.21.15.7:0/2028262627 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7f3e64005680 con 0x55ac2343f670 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e888c4740 1 -- 172.21.15.7:0/2028262627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e74036050 con 0x55ac2343f670 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e5b7fe640 1 -- 172.21.15.7:0/2028262627 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e640ac700 con 0x55ac2343f670 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e888c4740 10 client.17922 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e888c4740 1 -- 172.21.15.7:0/2028262627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ac23894cc0 con 0x55ac2343f670 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e5b7fe640 1 -- 172.21.15.7:0/2028262627 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e74036050 con 0x55ac2343f670 2024-09-21T06:02:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e5b7fe640 1 -- 172.21.15.7:0/2028262627 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3e640e4a60 con 0x55ac2343f670 2024-09-21T06:02:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e888c4740 10 client.17922 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e888c4740 10 client.17922 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e888c4740 20 client.17922 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e888c4740 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55ac233f4080 0x55ac23896ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e888c4740 4 client.17922 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:02:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e888c4740 1 -- 172.21.15.7:0/2028262627 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ac2377b860 con 0x55ac233f4080 2024-09-21T06:02:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.695+0000 7f3e7bfff640 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55ac233f4080 0x55ac23896ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.696+0000 7f3e5b7fe640 10 client.17922 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.696+0000 7f3e7bfff640 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55ac233f4080 0x55ac23896ea0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeea0af053440239 server_cookie=3342fcc018b40761 in_seq=0 out_seq=0 2024-09-21T06:02:14.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.697+0000 7f3e5b7fe640 1 -- 172.21.15.7:0/2028262627 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ac2377b860 con 0x55ac233f4080 2024-09-21T06:02:14.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.697+0000 7f3e5b7fe640 10 client.17922 handle_command_reply: tid=0 2024-09-21T06:02:14.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.697+0000 7f3e888c4740 1 client.17922 shutdown 2024-09-21T06:02:14.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.698+0000 7f3e888c4740 1 -- 172.21.15.7:0/2028262627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 msgr2=0x55ac2381c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:14.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.698+0000 7f3e888c4740 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 0x55ac2381c280 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f3e640e4890 tx=0x7f3e640eabc0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.698+0000 7f3e888c4740 1 -- 172.21.15.7:0/2028262627 shutdown_connections 2024-09-21T06:02:14.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.698+0000 7f3e888c4740 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55ac233f4080 0x55ac23896ea0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.698+0000 7f3e888c4740 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2343f670 0x55ac2381c280 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.698+0000 7f3e888c4740 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ac23460350 0x55ac2388d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.698+0000 7f3e888c4740 1 --2- 172.21.15.7:0/2028262627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55ac23437490 0x55ac2381bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.698+0000 7f3e5b7fe640 0 client.17922 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:14.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.698+0000 7f3e888c4740 1 -- 172.21.15.7:0/2028262627 >> 172.21.15.7:0/2028262627 conn(0x55ac23454740 msgr2=0x55ac23804a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:14.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.698+0000 7f3e888c4740 1 -- 172.21.15.7:0/2028262627 shutdown_connections 2024-09-21T06:02:14.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.698+0000 7f3e888c4740 1 -- 172.21.15.7:0/2028262627 wait complete. 2024-09-21T06:02:14.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.698+0000 7f3e888c4740 20 client.17922 trim_cache size 0 max 16384 2024-09-21T06:02:14.703 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:02:14.703 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:02:14.703 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "a9901d9b-aa10-4587-83ff-d32730ff12ea", 2024-09-21T06:02:14.704 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:02:14.704 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:02:14.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.699+0000 7f3e82350640 1 -- 172.21.15.7:0/4032562200 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3e680b6680 msgr2=0x7f3e680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:14.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.699+0000 7f3e82350640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3e680b6680 0x7f3e680b8b90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3e7402f500 tx=0x7f3e7402f490 comp rx=0 tx=0).stop 2024-09-21T06:02:14.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.699+0000 7f3e82350640 1 -- 172.21.15.7:0/4032562200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e7c1094f0 msgr2=0x7f3e7c19aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:14.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.699+0000 7f3e82350640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e7c1094f0 0x7f3e7c19aa10 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400d750 tx=0x7f3e6400dc10 comp rx=0 tx=0).stop 2024-09-21T06:02:14.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.699+0000 7f3e82350640 1 -- 172.21.15.7:0/4032562200 shutdown_connections 2024-09-21T06:02:14.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.699+0000 7f3e82350640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3e680b6680 0x7f3e680b8b90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.699+0000 7f3e82350640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e7c1094f0 0x7f3e7c19aa10 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.699+0000 7f3e82350640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e7c109e40 0x7f3e7c19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.699+0000 7f3e82350640 1 --2- 172.21.15.7:0/4032562200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e7c103bb0 0x7f3e7c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:14.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.699+0000 7f3e82350640 1 -- 172.21.15.7:0/4032562200 >> 172.21.15.7:0/4032562200 conn(0x7f3e7c0ff600 msgr2=0x7f3e7c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:14.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.699+0000 7f3e82350640 1 -- 172.21.15.7:0/4032562200 shutdown_connections 2024-09-21T06:02:14.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:14.699+0000 7f3e82350640 1 -- 172.21.15.7:0/4032562200 wait complete. 2024-09-21T06:02:15.427 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:02:15.686 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:16.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:15 smithi007 ceph-mon[30983]: pgmap v574: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-21T06:02:16.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:15 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:02:16.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:15 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:02:16.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:15 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:02:16.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:15 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:02:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.142+0000 7f2eb5656640 1 -- 172.21.15.7:0/3834718726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb01083d0 msgr2=0x7f2eb01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.142+0000 7f2eb5656640 1 --2- 172.21.15.7:0/3834718726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb01083d0 0x7f2eb01087e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009900 tx=0x7f2ea402a410 comp rx=0 tx=0).stop 2024-09-21T06:02:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.142+0000 7f2eb5656640 1 -- 172.21.15.7:0/3834718726 shutdown_connections 2024-09-21T06:02:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.142+0000 7f2eb5656640 1 --2- 172.21.15.7:0/3834718726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb01083d0 0x7f2eb01087e0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.142+0000 7f2eb5656640 1 --2- 172.21.15.7:0/3834718726 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eb0108d20 0x7f2eb010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.142+0000 7f2eb5656640 1 --2- 172.21.15.7:0/3834718726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2eb0102a90 0x7f2eb0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.142+0000 7f2eb5656640 1 -- 172.21.15.7:0/3834718726 >> 172.21.15.7:0/3834718726 conn(0x7f2eb0079750 msgr2=0x7f2eb0079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.143+0000 7f2eb5656640 1 -- 172.21.15.7:0/3834718726 shutdown_connections 2024-09-21T06:02:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.143+0000 7f2eb5656640 1 -- 172.21.15.7:0/3834718726 wait complete. 2024-09-21T06:02:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.143+0000 7f2eb5656640 1 Processor -- start 2024-09-21T06:02:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.144+0000 7f2eb5656640 1 -- start start 2024-09-21T06:02:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.144+0000 7f2eb5656640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eb0102a90 0x7f2eb019b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.144+0000 7f2eb5656640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb01083d0 0x7f2eb019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.144+0000 7f2eb5656640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2eb0108d20 0x7f2eb019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.144+0000 7f2eb5656640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb0112990 con 0x7f2eb01083d0 2024-09-21T06:02:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.144+0000 7f2eb5656640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb0112810 con 0x7f2eb0108d20 2024-09-21T06:02:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.144+0000 7f2eb5656640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb0112b10 con 0x7f2eb0102a90 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.144+0000 7f2eae7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb01083d0 0x7f2eb019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.144+0000 7f2eae7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb01083d0 0x7f2eb019b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48484/0 (socket says 172.21.15.7:48484) 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.144+0000 7f2eae7fc640 1 -- 172.21.15.7:0/2619374656 learned_addr learned my addr 172.21.15.7:0/2619374656 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.144+0000 7f2eaeffd640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eb0102a90 0x7f2eb019b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.144+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2eb0108d20 0x7f2eb019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.145+0000 7f2eae7fc640 1 -- 172.21.15.7:0/2619374656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eb0102a90 msgr2=0x7f2eb019b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.145+0000 7f2eae7fc640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eb0102a90 0x7f2eb019b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.145+0000 7f2eae7fc640 1 -- 172.21.15.7:0/2619374656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2eb0108d20 msgr2=0x7f2eb019bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.145+0000 7f2eae7fc640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2eb0108d20 0x7f2eb019bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.145+0000 7f2eae7fc640 1 -- 172.21.15.7:0/2619374656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb01a6570 con 0x7f2eb01083d0 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.145+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2eb0108d20 0x7f2eb019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.145+0000 7f2eae7fc640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb01083d0 0x7f2eb019b820 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4032fd0 tx=0x7f2ea4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.145+0000 7f2e97fff640 1 -- 172.21.15.7:0/2619374656 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea403f030 con 0x7f2eb01083d0 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.145+0000 7f2e97fff640 1 -- 172.21.15.7:0/2619374656 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ea4004490 con 0x7f2eb01083d0 2024-09-21T06:02:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.145+0000 7f2e97fff640 1 -- 172.21.15.7:0/2619374656 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4035070 con 0x7f2eb01083d0 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.145+0000 7f2eb5656640 1 -- 172.21.15.7:0/2619374656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb01a6800 con 0x7f2eb01083d0 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.145+0000 7f2eb5656640 1 -- 172.21.15.7:0/2619374656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb01a6ce0 con 0x7f2eb01083d0 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2e97fff640 1 -- 172.21.15.7:0/2619374656 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f2ea4042030 con 0x7f2eb01083d0 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2ebbbca740 1 Processor -- start 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2ebbbca740 1 -- start start 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2ebbbca740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f89e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2ebbbca740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f89eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2ebbbca740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f89f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2ebbbca740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56121f814e50 con 0x56121f4f7070 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2ebbbca740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56121f804280 con 0x56121f4d6390 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2ebbbca740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56121f808090 con 0x56121f4ce1b0 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2eaf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f89e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2eaf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f89e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48492/0 (socket says 172.21.15.7:48492) 2024-09-21T06:02:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2eaf7fe640 1 -- 172.21.15.7:0/2069942235 learned_addr learned my addr 172.21.15.7:0/2069942235 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2eae7fc640 1 --2- 172.21.15.7:0/2069942235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f89f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.148+0000 7f2eaeffd640 1 --2- 172.21.15.7:0/2069942235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f89eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.149+0000 7f2e97fff640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2e980b66b0 0x7f2e980b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.149+0000 7f2eaf7fe640 1 -- 172.21.15.7:0/2069942235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 msgr2=0x56121f89eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.149+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/2069942235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f89eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.149+0000 7f2eaf7fe640 1 -- 172.21.15.7:0/2069942235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 msgr2=0x56121f89f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.149+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/2069942235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f89f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.149+0000 7f2eaf7fe640 1 -- 172.21.15.7:0/2069942235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56121f562650 con 0x56121f4f7070 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.149+0000 7f2eaeffd640 1 --2- 172.21.15.7:0/2069942235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f89eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.149+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2e980b66b0 0x7f2e980b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.149+0000 7f2e97fff640 1 -- 172.21.15.7:0/2619374656 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7f2ea4107bd0 con 0x7f2eb01083d0 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.149+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/2069942235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f89e650 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8010570 tx=0x7f2ea8010a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62829e3150f02d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.149+0000 7f2e957fa640 1 -- 172.21.15.7:0/2069942235 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea801d400 con 0x56121f4f7070 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.149+0000 7f2e957fa640 1 -- 172.21.15.7:0/2069942235 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ea80134c0 con 0x56121f4f7070 2024-09-21T06:02:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.149+0000 7f2e957fa640 1 -- 172.21.15.7:0/2069942235 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8011760 con 0x56121f4f7070 2024-09-21T06:02:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.150+0000 7f2ebbbca740 1 -- 172.21.15.7:0/2069942235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 msgr2=0x56121f89e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.150+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/2069942235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f89e650 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8010570 tx=0x7f2ea8010a30 comp rx=0 tx=0).stop 2024-09-21T06:02:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.150+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2e980b66b0 0x7f2e980b8bc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8021000 tx=0x7f2ea801e000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.150+0000 7f2ebbbca740 1 -- 172.21.15.7:0/2069942235 shutdown_connections 2024-09-21T06:02:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.150+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/2069942235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f89f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.150+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/2069942235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f89eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.150+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/2069942235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f89e650 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.150+0000 7f2ebbbca740 1 -- 172.21.15.7:0/2069942235 >> 172.21.15.7:0/2069942235 conn(0x56121f4eb460 msgr2=0x56121f89c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.150+0000 7f2ebbbca740 1 -- 172.21.15.7:0/2069942235 shutdown_connections 2024-09-21T06:02:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.150+0000 7f2ebbbca740 1 -- 172.21.15.7:0/2069942235 wait complete. 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.151+0000 7f2ebbbca740 1 -- start start 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.151+0000 7f2ebbbca740 1 Processor -- start 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.151+0000 7f2ebbbca740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f8ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.151+0000 7f2ebbbca740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f8ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.151+0000 7f2ebbbca740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f8aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.151+0000 7f2ebbbca740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56121f665700 con 0x56121f4f7070 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.151+0000 7f2ebbbca740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56121f79f110 con 0x56121f4d6390 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.151+0000 7f2ebbbca740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56121f8b1160 con 0x56121f4ce1b0 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.151+0000 7f2ebbbca740 10 client.0 _ll_register_callbacks cb 0x56121f7b8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.151+0000 7f2eaf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f8aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.151+0000 7f2eaf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f8aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48504/0 (socket says 172.21.15.7:48504) 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.151+0000 7f2eaf7fe640 1 -- 172.21.15.7:0/242762138 learned_addr learned my addr 172.21.15.7:0/242762138 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.152+0000 7f2eae7fc640 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f8ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.152+0000 7f2eaeffd640 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f8ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.152+0000 7f2eaf7fe640 1 -- 172.21.15.7:0/242762138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 msgr2=0x56121f8ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.152+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f8ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.152+0000 7f2eaf7fe640 1 -- 172.21.15.7:0/242762138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 msgr2=0x56121f8ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.152+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f8ae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.152+0000 7f2eaf7fe640 1 -- 172.21.15.7:0/242762138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56121f7ccc40 con 0x56121f4f7070 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.152+0000 7f2eae7fc640 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f8ae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.152+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f8aeb10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8005fb0 tx=0x7f2ea8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398c1329504c84d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.152+0000 7f2e92ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.152+0000 7f2e92ff5640 1 -- 172.21.15.7:0/242762138 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8034060 con 0x56121f4f7070 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.152+0000 7f2e92ff5640 1 -- 172.21.15.7:0/242762138 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7f2ea8004c10 con 0x56121f4f7070 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.152+0000 7f2ebbbca740 1 -- 172.21.15.7:0/242762138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ea80134c0 con 0x56121f4f7070 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.153+0000 7f2e92ff5640 1 -- 172.21.15.7:0/242762138 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2ea8011740 con 0x56121f4f7070 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.153+0000 7f2ebbbca740 10 client.17934 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.153+0000 7f2ebbbca740 1 -- 172.21.15.7:0/242762138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56121f8bce20 con 0x56121f4f7070 2024-09-21T06:02:16.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.153+0000 7f2e92ff5640 1 -- 172.21.15.7:0/242762138 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ea80134c0 con 0x56121f4f7070 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.153+0000 7f2e92ff5640 1 -- 172.21.15.7:0/242762138 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2ea800f040 con 0x56121f4f7070 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.153+0000 7f2ebbbca740 10 client.17934 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.153+0000 7f2ebbbca740 10 client.17934 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.153+0000 7f2ebbbca740 20 client.17934 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.153+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56121f4b59f0 0x56121f8c0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.153+0000 7f2ebbbca740 4 client.17934 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.153+0000 7f2ebbbca740 1 -- 172.21.15.7:0/242762138 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56121f816da0 con 0x56121f4b59f0 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.153+0000 7f2eaeffd640 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56121f4b59f0 0x56121f8c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.154+0000 7f2e92ff5640 10 client.17934 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.154+0000 7f2eaeffd640 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56121f4b59f0 0x56121f8c0290 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba6e3d59cd459670 server_cookie=6a4cb824fc69defa in_seq=0 out_seq=0 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2e92ff5640 1 -- 172.21.15.7:0/242762138 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56121f816da0 con 0x56121f4b59f0 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2e92ff5640 10 client.17934 handle_command_reply: tid=0 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2ebbbca740 1 client.17934 shutdown 2024-09-21T06:02:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2ebbbca740 1 -- 172.21.15.7:0/242762138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 msgr2=0x56121f8aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f8aeb10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8005fb0 tx=0x7f2ea8005bd0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2ebbbca740 1 -- 172.21.15.7:0/242762138 shutdown_connections 2024-09-21T06:02:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56121f4b59f0 0x56121f8c0290 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f8aeb10 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f8ae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/242762138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f8ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2ebbbca740 1 -- 172.21.15.7:0/242762138 >> 172.21.15.7:0/242762138 conn(0x56121f4eb460 msgr2=0x56121f8a17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2e92ff5640 0 client.17934 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2ebbbca740 1 -- 172.21.15.7:0/242762138 shutdown_connections 2024-09-21T06:02:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2ebbbca740 1 -- 172.21.15.7:0/242762138 wait complete. 2024-09-21T06:02:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.155+0000 7f2ebbbca740 20 client.17934 trim_cache size 0 max 16384 2024-09-21T06:02:16.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2ebbbca740 1 Processor -- start 2024-09-21T06:02:16.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2ebbbca740 1 -- start start 2024-09-21T06:02:16.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2ebbbca740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f8aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2ebbbca740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f8ba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2ebbbca740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f89fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2ebbbca740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb01afdc0 con 0x56121f4f7070 2024-09-21T06:02:16.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2ebbbca740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb01ad690 con 0x56121f4d6390 2024-09-21T06:02:16.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2ebbbca740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb01ab500 con 0x56121f4ce1b0 2024-09-21T06:02:16.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2eaf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f89fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2eaf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f89fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48518/0 (socket says 172.21.15.7:48518) 2024-09-21T06:02:16.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2eaf7fe640 1 -- 172.21.15.7:0/4271419019 learned_addr learned my addr 172.21.15.7:0/4271419019 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:16.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2eae7fc640 1 --2- 172.21.15.7:0/4271419019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f8ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2eaeffd640 1 --2- 172.21.15.7:0/4271419019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f8aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2eaf7fe640 1 -- 172.21.15.7:0/4271419019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 msgr2=0x56121f8aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:16.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/4271419019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f8aff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2eaf7fe640 1 -- 172.21.15.7:0/4271419019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 msgr2=0x56121f8ba390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:16.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/4271419019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f8ba390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.173+0000 7f2eaf7fe640 1 -- 172.21.15.7:0/4271419019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56121f896880 con 0x56121f4f7070 2024-09-21T06:02:16.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.174+0000 7f2eae7fc640 1 --2- 172.21.15.7:0/4271419019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f8ba390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:16.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.174+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/4271419019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f89fd90 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80116f0 tx=0x7f2ea8009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e359e34bb74f11aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:16.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.174+0000 7f2e94ff9640 1 -- 172.21.15.7:0/4271419019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8034070 con 0x56121f4f7070 2024-09-21T06:02:16.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.174+0000 7f2e94ff9640 1 -- 172.21.15.7:0/4271419019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ea802b040 con 0x56121f4f7070 2024-09-21T06:02:16.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.174+0000 7f2e94ff9640 1 -- 172.21.15.7:0/4271419019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8004c10 con 0x56121f4f7070 2024-09-21T06:02:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.174+0000 7f2ebbbca740 1 -- 172.21.15.7:0/4271419019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 msgr2=0x56121f89fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.174+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/4271419019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f89fd90 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80116f0 tx=0x7f2ea8009cf0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 -- 172.21.15.7:0/4271419019 shutdown_connections 2024-09-21T06:02:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/4271419019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4f7070 0x56121f89fd90 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/4271419019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4d6390 0x56121f8ba390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/4271419019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f8aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 -- 172.21.15.7:0/4271419019 >> 172.21.15.7:0/4271419019 conn(0x56121f4eb460 msgr2=0x56121f89f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 -- 172.21.15.7:0/4271419019 shutdown_connections 2024-09-21T06:02:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 -- 172.21.15.7:0/4271419019 wait complete. 2024-09-21T06:02:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 -- start start 2024-09-21T06:02:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 Processor -- start 2024-09-21T06:02:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f8b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4d6390 0x56121f8b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4f7070 0x56121f8b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb01abb50 con 0x56121f4d6390 2024-09-21T06:02:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb01acfc0 con 0x56121f4f7070 2024-09-21T06:02:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb01ac220 con 0x56121f4ce1b0 2024-09-21T06:02:16.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.175+0000 7f2ebbbca740 10 client.0 _ll_register_callbacks cb 0x7f2ea8020020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2eae7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4d6390 0x56121f8b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2eae7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4d6390 0x56121f8b21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48522/0 (socket says 172.21.15.7:48522) 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2eaeffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f8b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2eae7fc640 1 -- 172.21.15.7:0/3697941815 learned_addr learned my addr 172.21.15.7:0/3697941815 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/3697941815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4f7070 0x56121f8b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2eae7fc640 1 -- 172.21.15.7:0/3697941815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 msgr2=0x56121f8b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2eae7fc640 1 --2- 172.21.15.7:0/3697941815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f8b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2eae7fc640 1 -- 172.21.15.7:0/3697941815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4f7070 msgr2=0x56121f8b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2eae7fc640 1 --2- 172.21.15.7:0/3697941815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4f7070 0x56121f8b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2eae7fc640 1 -- 172.21.15.7:0/3697941815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56121f8b2f80 con 0x56121f4d6390 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2eaf7fe640 1 --2- 172.21.15.7:0/3697941815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4f7070 0x56121f8b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2eae7fc640 1 --2- 172.21.15.7:0/3697941815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4d6390 0x56121f8b21c0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40cd740 tx=0x7f2ea403b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06ccce64c50425a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2e92ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2e92ff5640 1 -- 172.21.15.7:0/3697941815 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4049040 con 0x56121f4d6390 2024-09-21T06:02:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2e92ff5640 1 -- 172.21.15.7:0/3697941815 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8485+0+0 (secure 0 0 0) 0x7f2ea40d71d0 con 0x56121f4d6390 2024-09-21T06:02:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2ebbbca740 1 -- 172.21.15.7:0/3697941815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ea802b040 con 0x56121f4d6390 2024-09-21T06:02:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2e92ff5640 1 -- 172.21.15.7:0/3697941815 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2ea40cd390 con 0x56121f4d6390 2024-09-21T06:02:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2ebbbca740 10 client.17940 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.176+0000 7f2ebbbca740 1 -- 172.21.15.7:0/3697941815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56121f92ac20 con 0x56121f4d6390 2024-09-21T06:02:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.177+0000 7f2e92ff5640 1 -- 172.21.15.7:0/3697941815 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ea802b040 con 0x56121f4d6390 2024-09-21T06:02:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.177+0000 7f2e92ff5640 1 -- 172.21.15.7:0/3697941815 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2ea40d2160 con 0x56121f4d6390 2024-09-21T06:02:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.177+0000 7f2ebbbca740 10 client.17940 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.177+0000 7f2ebbbca740 10 client.17940 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.177+0000 7f2ebbbca740 20 client.17940 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.177+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/3697941815 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56121f48ada0 0x56121f92d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.177+0000 7f2ebbbca740 4 client.17940 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:02:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.177+0000 7f2ebbbca740 1 -- 172.21.15.7:0/3697941815 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56121f812850 con 0x56121f48ada0 2024-09-21T06:02:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.177+0000 7f2eaeffd640 1 --2- 172.21.15.7:0/3697941815 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56121f48ada0 0x56121f92d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2eaeffd640 1 --2- 172.21.15.7:0/3697941815 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56121f48ada0 0x56121f92d3c0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=676816aba7b20263 server_cookie=eb5136cd148881c5 in_seq=0 out_seq=0 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2e92ff5640 10 client.17940 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2e92ff5640 1 -- 172.21.15.7:0/3697941815 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6818 (crc 0 0 0) 0x56121f812850 con 0x56121f48ada0 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2e92ff5640 10 client.17940 handle_command_reply: tid=0 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2ebbbca740 1 client.17940 shutdown 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2ebbbca740 1 -- 172.21.15.7:0/3697941815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4d6390 msgr2=0x56121f8b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/3697941815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4d6390 0x56121f8b21c0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40cd740 tx=0x7f2ea403b690 comp rx=0 tx=0).stop 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2ebbbca740 1 -- 172.21.15.7:0/3697941815 shutdown_connections 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/3697941815 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x56121f48ada0 0x56121f92d3c0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/3697941815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56121f4d6390 0x56121f8b21c0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/3697941815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56121f4f7070 0x56121f8b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2e92ff5640 0 client.17940 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2ebbbca740 1 --2- 172.21.15.7:0/3697941815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56121f4ce1b0 0x56121f8b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2ebbbca740 1 -- 172.21.15.7:0/3697941815 >> 172.21.15.7:0/3697941815 conn(0x56121f4eb460 msgr2=0x56121f8a20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2ebbbca740 1 -- 172.21.15.7:0/3697941815 shutdown_connections 2024-09-21T06:02:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2ebbbca740 1 -- 172.21.15.7:0/3697941815 wait complete. 2024-09-21T06:02:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.178+0000 7f2ebbbca740 20 client.17940 trim_cache size 0 max 16384 2024-09-21T06:02:16.186 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:02:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:02:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:02:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "a9901d9b-aa10-4587-83ff-d32730ff12ea": { 2024-09-21T06:02:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "a9901d9b-aa10-4587-83ff-d32730ff12ea", 2024-09-21T06:02:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:02:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "46ad69b3-ef90-42e0-a57b-ea33e3ef74ab": { 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:32.287019+0000", 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "d9b96838-732e-40a1-9fad-f54faef73b59": { 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:21.774276+0000", 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "fd9e7ebd-b70a-487f-937b-80b64378d04b": { 2024-09-21T06:02:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:11.755521+0000", 2024-09-21T06:02:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "3bd778db-a0ed-42ad-8a79-14a200f0734e": { 2024-09-21T06:02:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:51.556015+0000", 2024-09-21T06:02:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:02:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:02:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "ecf3518d-a174-4cee-89a1-6aa26e1b3442": { 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:01.909762+0000", 2024-09-21T06:02:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:02:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:02:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:02:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:02:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:02:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "a9901d9b-aa10-4587-83ff-d32730ff12ea": { 2024-09-21T06:02:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:02:14.695980+0000", 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:02:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:02:16.200 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:02:16.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.179+0000 7f2eb5656640 1 -- 172.21.15.7:0/2619374656 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2e980b66b0 msgr2=0x7f2e980b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:16.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.179+0000 7f2eb5656640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2e980b66b0 0x7f2e980b8bc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8021000 tx=0x7f2ea801e000 comp rx=0 tx=0).stop 2024-09-21T06:02:16.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.179+0000 7f2eb5656640 1 -- 172.21.15.7:0/2619374656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb01083d0 msgr2=0x7f2eb019b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:16.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.179+0000 7f2eb5656640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb01083d0 0x7f2eb019b820 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4032fd0 tx=0x7f2ea4004270 comp rx=0 tx=0).stop 2024-09-21T06:02:16.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.179+0000 7f2eb5656640 1 -- 172.21.15.7:0/2619374656 shutdown_connections 2024-09-21T06:02:16.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.179+0000 7f2eb5656640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f2e980b66b0 0x7f2e980b8bc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.179+0000 7f2eb5656640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb01083d0 0x7f2eb019b820 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.179+0000 7f2eb5656640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2eb0108d20 0x7f2eb019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.179+0000 7f2eb5656640 1 --2- 172.21.15.7:0/2619374656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eb0102a90 0x7f2eb019b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:16.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.179+0000 7f2eb5656640 1 -- 172.21.15.7:0/2619374656 >> 172.21.15.7:0/2619374656 conn(0x7f2eb0079750 msgr2=0x7f2eb0104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:16.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.179+0000 7f2eb5656640 1 -- 172.21.15.7:0/2619374656 shutdown_connections 2024-09-21T06:02:16.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:16.179+0000 7f2eb5656640 1 -- 172.21.15.7:0/2619374656 wait complete. 2024-09-21T06:02:16.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:15 smithi027 ceph-mon[34364]: pgmap v574: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-21T06:02:16.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:15 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:02:16.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:15 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:02:16.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:15 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:02:16.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:15 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:02:16.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:15 smithi119 ceph-mon[34833]: pgmap v574: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-21T06:02:16.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:15 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:02:16.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:15 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:02:16.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:15 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:02:16.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:15 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:02:16.934 INFO:tasks.cephfs.filesystem:scrub status for tag:a9901d9b-aa10-4587-83ff-d32730ff12ea - {'path': '/', 'tag': 'a9901d9b-aa10-4587-83ff-d32730ff12ea', 'options': 'recursive,force'} 2024-09-21T06:02:18.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:17 smithi027 ceph-mon[34364]: pgmap v575: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:02:18.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:17 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:02:18.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:17 smithi027 ceph-mon[34364]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:02:18.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:17 smithi007 ceph-mon[30983]: pgmap v575: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:02:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:17 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:02:18.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:17 smithi007 ceph-mon[30983]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:02:18.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:17 smithi119 ceph-mon[34833]: pgmap v575: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:02:18.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:17 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:02:18.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:17 smithi119 ceph-mon[34833]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:02:20.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:19 smithi027 ceph-mon[34364]: pgmap v577: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:02:20.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:19 smithi007 ceph-mon[30983]: pgmap v577: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:02:20.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:19 smithi119 ceph-mon[34833]: pgmap v577: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:02:22.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:21 smithi027 ceph-mon[34364]: pgmap v578: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:02:22.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:21 smithi007 ceph-mon[30983]: pgmap v578: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:02:22.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:21 smithi119 ceph-mon[34833]: pgmap v578: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:02:24.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:23 smithi027 ceph-mon[34364]: pgmap v579: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:02:24.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:23 smithi007 ceph-mon[30983]: pgmap v579: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:02:24.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:23 smithi119 ceph-mon[34833]: pgmap v579: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:02:26.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:25 smithi027 ceph-mon[34364]: pgmap v580: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:02:26.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:25 smithi007 ceph-mon[30983]: pgmap v580: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:02:26.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:25 smithi119 ceph-mon[34833]: pgmap v580: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:02:28.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:27 smithi027 ceph-mon[34364]: pgmap v581: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T06:02:28.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:27 smithi007 ceph-mon[30983]: pgmap v581: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T06:02:28.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:27 smithi119 ceph-mon[34833]: pgmap v581: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T06:02:30.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:29 smithi027 ceph-mon[34364]: pgmap v582: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:02:30.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:29 smithi007 ceph-mon[30983]: pgmap v582: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:02:30.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:29 smithi119 ceph-mon[34833]: pgmap v582: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:02:32.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:31 smithi027 ceph-mon[34364]: pgmap v583: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T06:02:32.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:31 smithi007 ceph-mon[30983]: pgmap v583: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T06:02:32.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:31 smithi119 ceph-mon[34833]: pgmap v583: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T06:02:34.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:33 smithi027 ceph-mon[34364]: pgmap v584: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:02:34.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:33 smithi007 ceph-mon[30983]: pgmap v584: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:02:34.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:33 smithi119 ceph-mon[34833]: pgmap v584: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:02:36.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:35 smithi027 ceph-mon[34364]: pgmap v585: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:02:36.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:35 smithi007 ceph-mon[30983]: pgmap v585: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:02:36.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:35 smithi119 ceph-mon[34833]: pgmap v585: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:02:38.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:37 smithi027 ceph-mon[34364]: pgmap v586: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:02:38.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:37 smithi007 ceph-mon[30983]: pgmap v586: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:02:38.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:37 smithi119 ceph-mon[34833]: pgmap v586: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:02:40.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:39 smithi027 ceph-mon[34364]: pgmap v587: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:02:40.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:39 smithi007 ceph-mon[30983]: pgmap v587: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:02:40.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:39 smithi119 ceph-mon[34833]: pgmap v587: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:02:42.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:41 smithi027 ceph-mon[34364]: pgmap v588: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:02:42.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:41 smithi007 ceph-mon[30983]: pgmap v588: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:02:42.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:41 smithi119 ceph-mon[34833]: pgmap v588: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:02:44.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:43 smithi027 ceph-mon[34364]: pgmap v589: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:02:44.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:43 smithi007 ceph-mon[30983]: pgmap v589: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:02:44.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:43 smithi119 ceph-mon[34833]: pgmap v589: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:02:46.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:45 smithi027 ceph-mon[34364]: pgmap v590: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:02:46.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:45 smithi007 ceph-mon[30983]: pgmap v590: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:02:46.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:45 smithi119 ceph-mon[34833]: pgmap v590: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:02:46.935 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:02:47.209 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.684+0000 7fe8cc9ff640 1 -- 172.21.15.7:0/3766577648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c810dc50 msgr2=0x7fe8c8110160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.684+0000 7fe8cc9ff640 1 --2- 172.21.15.7:0/3766577648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c810dc50 0x7fe8c8110160 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009ca0 tx=0x7fe8c002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.684+0000 7fe8cc9ff640 1 -- 172.21.15.7:0/3766577648 shutdown_connections 2024-09-21T06:02:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.684+0000 7fe8cc9ff640 1 --2- 172.21.15.7:0/3766577648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c810dc50 0x7fe8c8110160 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.684+0000 7fe8cc9ff640 1 --2- 172.21.15.7:0/3766577648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c81050d0 0x7fe8c810d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.684+0000 7fe8cc9ff640 1 --2- 172.21.15.7:0/3766577648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c81046a0 0x7fe8c8104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.684+0000 7fe8cc9ff640 1 -- 172.21.15.7:0/3766577648 >> 172.21.15.7:0/3766577648 conn(0x7fe8c80fe330 msgr2=0x7fe8c8100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.684+0000 7fe8cc9ff640 1 -- 172.21.15.7:0/3766577648 shutdown_connections 2024-09-21T06:02:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.684+0000 7fe8cc9ff640 1 -- 172.21.15.7:0/3766577648 wait complete. 2024-09-21T06:02:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.685+0000 7fe8cc9ff640 1 Processor -- start 2024-09-21T06:02:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.685+0000 7fe8cc9ff640 1 -- start start 2024-09-21T06:02:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.685+0000 7fe8cc9ff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c81046a0 0x7fe8c819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.685+0000 7fe8cc9ff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c81050d0 0x7fe8c819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.685+0000 7fe8cc9ff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c810dc50 0x7fe8c819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.685+0000 7fe8cc9ff640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81138f0 con 0x7fe8c810dc50 2024-09-21T06:02:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.685+0000 7fe8cc9ff640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c8113770 con 0x7fe8c81050d0 2024-09-21T06:02:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.685+0000 7fe8cc9ff640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c8113a70 con 0x7fe8c81046a0 2024-09-21T06:02:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.685+0000 7fe8c759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c810dc50 0x7fe8c819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.685+0000 7fe8c759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c810dc50 0x7fe8c819fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46944/0 (socket says 172.21.15.7:46944) 2024-09-21T06:02:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.685+0000 7fe8c6d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c81046a0 0x7fe8c819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.685+0000 7fe8c759e640 1 -- 172.21.15.7:0/2148370987 learned_addr learned my addr 172.21.15.7:0/2148370987 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8c659c640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c81050d0 0x7fe8c819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8c759e640 1 -- 172.21.15.7:0/2148370987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c81046a0 msgr2=0x7fe8c819a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8c759e640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c81046a0 0x7fe8c819a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8c759e640 1 -- 172.21.15.7:0/2148370987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c81050d0 msgr2=0x7fe8c819a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8c759e640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c81050d0 0x7fe8c819a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8c759e640 1 -- 172.21.15.7:0/2148370987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c81a01f0 con 0x7fe8c810dc50 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8c6d9d640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c81046a0 0x7fe8c819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8c659c640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c81050d0 0x7fe8c819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8c759e640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c810dc50 0x7fe8c819fb80 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00098d0 tx=0x7fe8c00317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8affff640 1 -- 172.21.15.7:0/2148370987 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0003b70 con 0x7fe8c810dc50 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8cc9ff640 1 -- 172.21.15.7:0/2148370987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c81a0480 con 0x7fe8c810dc50 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8affff640 1 -- 172.21.15.7:0/2148370987 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8c0003d10 con 0x7fe8c810dc50 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8affff640 1 -- 172.21.15.7:0/2148370987 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c002fa20 con 0x7fe8c810dc50 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.686+0000 7fe8cc9ff640 1 -- 172.21.15.7:0/2148370987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c81a6d00 con 0x7fe8c810dc50 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.689+0000 7fe8d3774740 1 Processor -- start 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.689+0000 7fe8affff640 1 -- 172.21.15.7:0/2148370987 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fe8c002fbe0 con 0x7fe8c810dc50 2024-09-21T06:02:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.689+0000 7fe8d3774740 1 -- start start 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.689+0000 7fe8d3774740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55730420e070 0x5573045b5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.689+0000 7fe8d3774740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.689+0000 7fe8d3774740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x5573045b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.689+0000 7fe8d3774740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55730452be50 con 0x5573041e51b0 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.689+0000 7fe8d3774740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55730451b280 con 0x5573041ed390 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.689+0000 7fe8d3774740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55730451f090 con 0x55730420e070 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8c6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8c6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46948/0 (socket says 172.21.15.7:46948) 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8c6d9d640 1 -- 172.21.15.7:0/2581679575 learned_addr learned my addr 172.21.15.7:0/2581679575 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8c659c640 1 --2- 172.21.15.7:0/2581679575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55730420e070 0x5573045b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8c659c640 1 --2- 172.21.15.7:0/2581679575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x5573045b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8affff640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8b00b66b0 0x7fe8b00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8c6d9d640 1 -- 172.21.15.7:0/2581679575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55730420e070 msgr2=0x5573045b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8c6d9d640 1 --2- 172.21.15.7:0/2581679575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55730420e070 0x5573045b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8c6d9d640 1 -- 172.21.15.7:0/2581679575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 msgr2=0x5573045b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:47.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8c6d9d640 1 --2- 172.21.15.7:0/2581679575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x5573045b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8c6d9d640 1 -- 172.21.15.7:0/2581679575 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557304279650 con 0x5573041e51b0 2024-09-21T06:02:47.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8c759e640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8b00b66b0 0x7fe8b00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8affff640 1 -- 172.21.15.7:0/2148370987 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fe8c0108b70 con 0x7fe8c810dc50 2024-09-21T06:02:47.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.690+0000 7fe8c6d9d640 1 --2- 172.21.15.7:0/2581679575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045b5d50 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80115c0 tx=0x7fe8b8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ae459d6000bf53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:47.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.691+0000 7fe8ad7fa640 1 -- 172.21.15.7:0/2581679575 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b800f640 con 0x5573041e51b0 2024-09-21T06:02:47.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.691+0000 7fe8ad7fa640 1 -- 172.21.15.7:0/2581679575 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8b800fc90 con 0x5573041e51b0 2024-09-21T06:02:47.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.691+0000 7fe8ad7fa640 1 -- 172.21.15.7:0/2581679575 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8019c10 con 0x5573041e51b0 2024-09-21T06:02:47.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.691+0000 7fe8c759e640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8b00b66b0 0x7fe8b00b8bc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe8c01063c0 tx=0x7fe8c009be00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.692+0000 7fe8d3774740 1 -- 172.21.15.7:0/2581679575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 msgr2=0x5573045b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.692+0000 7fe8d3774740 1 --2- 172.21.15.7:0/2581679575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045b5d50 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80115c0 tx=0x7fe8b8011a80 comp rx=0 tx=0).stop 2024-09-21T06:02:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.692+0000 7fe8d3774740 1 -- 172.21.15.7:0/2581679575 shutdown_connections 2024-09-21T06:02:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.692+0000 7fe8d3774740 1 --2- 172.21.15.7:0/2581679575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045b5d50 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.692+0000 7fe8d3774740 1 --2- 172.21.15.7:0/2581679575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x5573045b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.692+0000 7fe8d3774740 1 --2- 172.21.15.7:0/2581679575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55730420e070 0x5573045b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.692+0000 7fe8d3774740 1 -- 172.21.15.7:0/2581679575 >> 172.21.15.7:0/2581679575 conn(0x557304202460 msgr2=0x5573045b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.692+0000 7fe8d3774740 1 -- 172.21.15.7:0/2581679575 shutdown_connections 2024-09-21T06:02:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.692+0000 7fe8d3774740 1 -- 172.21.15.7:0/2581679575 wait complete. 2024-09-21T06:02:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.692+0000 7fe8d3774740 1 -- start start 2024-09-21T06:02:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.692+0000 7fe8d3774740 1 Processor -- start 2024-09-21T06:02:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.693+0000 7fe8d3774740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.693+0000 7fe8d3774740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x5573045c1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.693+0000 7fe8d3774740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55730420e070 0x5573045cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.693+0000 7fe8d3774740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55730437c700 con 0x5573041e51b0 2024-09-21T06:02:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.693+0000 7fe8c659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.693+0000 7fe8d3774740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5573044b6110 con 0x5573041ed390 2024-09-21T06:02:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.693+0000 7fe8d3774740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5573045c3ff0 con 0x55730420e070 2024-09-21T06:02:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.693+0000 7fe8c659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46962/0 (socket says 172.21.15.7:46962) 2024-09-21T06:02:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.693+0000 7fe8c659c640 1 -- 172.21.15.7:0/1633274929 learned_addr learned my addr 172.21.15.7:0/1633274929 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.693+0000 7fe8d3774740 10 client.0 _ll_register_callbacks cb 0x5573044cf990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:47.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.693+0000 7fe8c6d9d640 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x5573045c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.693+0000 7fe8c659c640 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55730420e070 0x5573045cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.693+0000 7fe8c659c640 1 -- 172.21.15.7:0/1633274929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55730420e070 msgr2=0x5573045cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8c659c640 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55730420e070 0x5573045cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8c659c640 1 -- 172.21.15.7:0/1633274929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 msgr2=0x5573045c1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8c659c640 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x5573045c1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8c659c640 1 -- 172.21.15.7:0/1633274929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573044e3c40 con 0x5573041e51b0 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8c6d9d640 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x5573045c1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8c659c640 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045c0ef0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00bb90 tx=0x7fe8bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91497c4219d611a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8aaff5640 1 -- 172.21.15.7:0/1633274929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc0130d0 con 0x5573041e51b0 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8d3774740 1 -- 172.21.15.7:0/1633274929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8b800fc90 con 0x5573041e51b0 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8aaff5640 1 -- 172.21.15.7:0/1633274929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fe8bc0040f0 con 0x5573041e51b0 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8aaff5640 1 -- 172.21.15.7:0/1633274929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe8bc013270 con 0x5573041e51b0 2024-09-21T06:02:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8d3774740 10 client.17952 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8d3774740 1 -- 172.21.15.7:0/1633274929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5573045cfd60 con 0x5573041e51b0 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.694+0000 7fe8aaff5640 1 -- 172.21.15.7:0/1633274929 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8b800fc90 con 0x5573041e51b0 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.695+0000 7fe8aaff5640 1 -- 172.21.15.7:0/1633274929 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe8bc004960 con 0x5573041e51b0 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.695+0000 7fe8d3774740 10 client.17952 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.695+0000 7fe8d3774740 10 client.17952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.695+0000 7fe8d3774740 20 client.17952 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.695+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5573041cc9f0 0x5573045d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.695+0000 7fe8d3774740 4 client.17952 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.695+0000 7fe8d3774740 1 -- 172.21.15.7:0/1633274929 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55730452dda0 con 0x5573041cc9f0 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.695+0000 7fe8c6d9d640 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5573041cc9f0 0x5573045d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.696+0000 7fe8c6d9d640 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5573041cc9f0 0x5573045d3230 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85c7dc9bf3676 server_cookie=1af4fb6d277a1375 in_seq=0 out_seq=0 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.696+0000 7fe8aaff5640 10 client.17952 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.696+0000 7fe8aaff5640 1 -- 172.21.15.7:0/1633274929 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55730452dda0 con 0x5573041cc9f0 2024-09-21T06:02:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.696+0000 7fe8aaff5640 10 client.17952 handle_command_reply: tid=0 2024-09-21T06:02:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.696+0000 7fe8d3774740 1 client.17952 shutdown 2024-09-21T06:02:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.696+0000 7fe8d3774740 1 -- 172.21.15.7:0/1633274929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 msgr2=0x5573045c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.696+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045c0ef0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00bb90 tx=0x7fe8bc0046c0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.696+0000 7fe8d3774740 1 -- 172.21.15.7:0/1633274929 shutdown_connections 2024-09-21T06:02:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.696+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5573041cc9f0 0x5573045d3230 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.697+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55730420e070 0x5573045cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.697+0000 7fe8aaff5640 0 client.17952 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.697+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x5573045c1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.697+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1633274929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045c0ef0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.697+0000 7fe8d3774740 1 -- 172.21.15.7:0/1633274929 >> 172.21.15.7:0/1633274929 conn(0x557304202460 msgr2=0x5573045b89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.697+0000 7fe8d3774740 1 -- 172.21.15.7:0/1633274929 shutdown_connections 2024-09-21T06:02:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.697+0000 7fe8d3774740 1 -- 172.21.15.7:0/1633274929 wait complete. 2024-09-21T06:02:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.697+0000 7fe8d3774740 20 client.17952 trim_cache size 0 max 16384 2024-09-21T06:02:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.714+0000 7fe8d3774740 1 Processor -- start 2024-09-21T06:02:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.714+0000 7fe8d3774740 1 -- start start 2024-09-21T06:02:47.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8d3774740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041cc9f0 0x5573045c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8d3774740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5573041e51b0 0x5573045be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8d3774740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x5573045be620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8d3774740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81b1c90 con 0x5573041cc9f0 2024-09-21T06:02:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8d3774740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81af560 con 0x5573041ed390 2024-09-21T06:02:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8d3774740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81ad3d0 con 0x5573041e51b0 2024-09-21T06:02:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8c659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041cc9f0 0x5573045c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8c659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041cc9f0 0x5573045c2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46974/0 (socket says 172.21.15.7:46974) 2024-09-21T06:02:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8c659c640 1 -- 172.21.15.7:0/1488848390 learned_addr learned my addr 172.21.15.7:0/1488848390 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8c659c640 1 -- 172.21.15.7:0/1488848390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5573041e51b0 msgr2=0x5573045be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8c6d9d640 1 --2- 172.21.15.7:0/1488848390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5573041e51b0 0x5573045be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8c659c640 1 --2- 172.21.15.7:0/1488848390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5573041e51b0 0x5573045be0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8c659c640 1 -- 172.21.15.7:0/1488848390 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 msgr2=0x5573045be620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8c659c640 1 --2- 172.21.15.7:0/1488848390 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x5573045be620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8c659c640 1 -- 172.21.15.7:0/1488848390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573045c3aa0 con 0x5573041cc9f0 2024-09-21T06:02:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8c659c640 1 --2- 172.21.15.7:0/1488848390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041cc9f0 0x5573045c2b20 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc001eb0 tx=0x7fe8bc010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21496bd631a03ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:47.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.715+0000 7fe8acff9640 1 -- 172.21.15.7:0/1488848390 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc02f070 con 0x5573041cc9f0 2024-09-21T06:02:47.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.716+0000 7fe8acff9640 1 -- 172.21.15.7:0/1488848390 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8bc017070 con 0x5573041cc9f0 2024-09-21T06:02:47.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.716+0000 7fe8acff9640 1 -- 172.21.15.7:0/1488848390 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc005000 con 0x5573041cc9f0 2024-09-21T06:02:47.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.716+0000 7fe8d3774740 1 -- 172.21.15.7:0/1488848390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041cc9f0 msgr2=0x5573045c2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:47.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.716+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1488848390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041cc9f0 0x5573045c2b20 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc001eb0 tx=0x7fe8bc010f10 comp rx=0 tx=0).stop 2024-09-21T06:02:47.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.716+0000 7fe8d3774740 1 -- 172.21.15.7:0/1488848390 shutdown_connections 2024-09-21T06:02:47.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.716+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1488848390 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x5573045be620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.716+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1488848390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5573041e51b0 0x5573045be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.716+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1488848390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041cc9f0 0x5573045c2b20 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.716+0000 7fe8d3774740 1 -- 172.21.15.7:0/1488848390 >> 172.21.15.7:0/1488848390 conn(0x557304202460 msgr2=0x5573045c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.716+0000 7fe8d3774740 1 -- 172.21.15.7:0/1488848390 shutdown_connections 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.716+0000 7fe8d3774740 1 -- 172.21.15.7:0/1488848390 wait complete. 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.717+0000 7fe8d3774740 1 -- start start 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.717+0000 7fe8d3774740 1 Processor -- start 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.717+0000 7fe8d3774740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5573041cc9f0 0x5573045c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.717+0000 7fe8d3774740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045c6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.717+0000 7fe8d3774740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x557304636c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.717+0000 7fe8d3774740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81ada20 con 0x5573041e51b0 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.717+0000 7fe8d3774740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81aee90 con 0x5573041ed390 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.717+0000 7fe8d3774740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81ae0f0 con 0x5573041cc9f0 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.717+0000 7fe8d3774740 10 client.0 _ll_register_callbacks cb 0x7fe8bc0134c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.717+0000 7fe8c6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.717+0000 7fe8c6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045c6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46988/0 (socket says 172.21.15.7:46988) 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.717+0000 7fe8c6d9d640 1 -- 172.21.15.7:0/1818987318 learned_addr learned my addr 172.21.15.7:0/1818987318 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8c659c640 1 --2- 172.21.15.7:0/1818987318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x557304636c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8c659c640 1 --2- 172.21.15.7:0/1818987318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5573041cc9f0 0x5573045c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8c6d9d640 1 -- 172.21.15.7:0/1818987318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5573041cc9f0 msgr2=0x5573045c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8c6d9d640 1 --2- 172.21.15.7:0/1818987318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5573041cc9f0 0x5573045c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8c6d9d640 1 -- 172.21.15.7:0/1818987318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 msgr2=0x557304636c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8c6d9d640 1 --2- 172.21.15.7:0/1818987318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x557304636c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8c6d9d640 1 -- 172.21.15.7:0/1818987318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557304637300 con 0x5573041e51b0 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8c6d9d640 1 --2- 172.21.15.7:0/1818987318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045c6230 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8011f80 tx=0x7fe8b8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8416317789f199b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8aaff5640 1 -- 172.21.15.7:0/1818987318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8030060 con 0x5573041e51b0 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8aaff5640 1 -- 172.21.15.7:0/1818987318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fe8b80052c0 con 0x5573041e51b0 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8d3774740 1 -- 172.21.15.7:0/1818987318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8bc017070 con 0x5573041e51b0 2024-09-21T06:02:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8aaff5640 1 -- 172.21.15.7:0/1818987318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe8b8009d10 con 0x5573041e51b0 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8d3774740 10 client.17958 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.718+0000 7fe8d3774740 1 -- 172.21.15.7:0/1818987318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55730463e790 con 0x5573041e51b0 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.719+0000 7fe8aaff5640 1 -- 172.21.15.7:0/1818987318 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8bc017070 con 0x5573041e51b0 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.719+0000 7fe8aaff5640 1 -- 172.21.15.7:0/1818987318 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe8b800f640 con 0x5573041e51b0 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.719+0000 7fe8d3774740 10 client.17958 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.719+0000 7fe8d3774740 10 client.17958 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.719+0000 7fe8d3774740 20 client.17958 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.719+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1818987318 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55730420e070 0x557304640e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.719+0000 7fe8d3774740 4 client.17958 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.719+0000 7fe8d3774740 1 -- 172.21.15.7:0/1818987318 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557304529850 con 0x55730420e070 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.719+0000 7fe8c659c640 1 --2- 172.21.15.7:0/1818987318 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55730420e070 0x557304640e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8c659c640 1 --2- 172.21.15.7:0/1818987318 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55730420e070 0x557304640e10 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e44063fcede5843 server_cookie=c2977370bfdd481c in_seq=0 out_seq=0 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8aaff5640 10 client.17958 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8aaff5640 1 -- 172.21.15.7:0/1818987318 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6622 (crc 0 0 0) 0x557304529850 con 0x55730420e070 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8aaff5640 10 client.17958 handle_command_reply: tid=0 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8d3774740 1 client.17958 shutdown 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8d3774740 1 -- 172.21.15.7:0/1818987318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 msgr2=0x5573045c6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1818987318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045c6230 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8011f80 tx=0x7fe8b8009b30 comp rx=0 tx=0).stop 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8d3774740 1 -- 172.21.15.7:0/1818987318 shutdown_connections 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1818987318 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55730420e070 0x557304640e10 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1818987318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573041e51b0 0x5573045c6230 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1818987318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5573041ed390 0x557304636c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8aaff5640 0 client.17958 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8d3774740 1 --2- 172.21.15.7:0/1818987318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5573041cc9f0 0x5573045c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8d3774740 1 -- 172.21.15.7:0/1818987318 >> 172.21.15.7:0/1818987318 conn(0x557304202460 msgr2=0x5573045c23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8d3774740 1 -- 172.21.15.7:0/1818987318 shutdown_connections 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8d3774740 1 -- 172.21.15.7:0/1818987318 wait complete. 2024-09-21T06:02:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.720+0000 7fe8d3774740 20 client.17958 trim_cache size 0 max 16384 2024-09-21T06:02:47.728 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:02:47.728 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:02:47.728 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:02:47.728 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:02:47.728 INFO:teuthology.orchestra.run.smithi007.stdout: "46ad69b3-ef90-42e0-a57b-ea33e3ef74ab": { 2024-09-21T06:02:47.728 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:32.287019+0000", 2024-09-21T06:02:47.728 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.728 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.728 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: "d9b96838-732e-40a1-9fad-f54faef73b59": { 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:21.774276+0000", 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: "fd9e7ebd-b70a-487f-937b-80b64378d04b": { 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:11.755521+0000", 2024-09-21T06:02:47.729 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: "3bd778db-a0ed-42ad-8a79-14a200f0734e": { 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:51.556015+0000", 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.730 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.732 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.733 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: "ecf3518d-a174-4cee-89a1-6aa26e1b3442": { 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:01.909762+0000", 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.734 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:02:47.735 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.736 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.737 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.738 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: "a9901d9b-aa10-4587-83ff-d32730ff12ea": { 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:02:14.695980+0000", 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.739 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:47.740 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:47.741 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:47.741 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:47.741 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:47.741 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:02:47.741 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:02:47.741 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:02:47.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.721+0000 7fe8cc9ff640 1 -- 172.21.15.7:0/2148370987 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8b00b66b0 msgr2=0x7fe8b00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:47.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.721+0000 7fe8cc9ff640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8b00b66b0 0x7fe8b00b8bc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe8c01063c0 tx=0x7fe8c009be00 comp rx=0 tx=0).stop 2024-09-21T06:02:47.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.721+0000 7fe8cc9ff640 1 -- 172.21.15.7:0/2148370987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c810dc50 msgr2=0x7fe8c819fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:47.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.721+0000 7fe8cc9ff640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c810dc50 0x7fe8c819fb80 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00098d0 tx=0x7fe8c00317b0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.721+0000 7fe8cc9ff640 1 -- 172.21.15.7:0/2148370987 shutdown_connections 2024-09-21T06:02:47.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.721+0000 7fe8cc9ff640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fe8b00b66b0 0x7fe8b00b8bc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.721+0000 7fe8cc9ff640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c810dc50 0x7fe8c819fb80 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.721+0000 7fe8cc9ff640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe8c81050d0 0x7fe8c819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.721+0000 7fe8cc9ff640 1 --2- 172.21.15.7:0/2148370987 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8c81046a0 0x7fe8c819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:47.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.721+0000 7fe8cc9ff640 1 -- 172.21.15.7:0/2148370987 >> 172.21.15.7:0/2148370987 conn(0x7fe8c80fe330 msgr2=0x7fe8c8107780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:47.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.721+0000 7fe8cc9ff640 1 -- 172.21.15.7:0/2148370987 shutdown_connections 2024-09-21T06:02:47.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:47.721+0000 7fe8cc9ff640 1 -- 172.21.15.7:0/2148370987 wait complete. 2024-09-21T06:02:48.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:47 smithi027 ceph-mon[34364]: pgmap v591: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:02:48.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:47 smithi007 ceph-mon[30983]: pgmap v591: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:02:48.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:47 smithi119 ceph-mon[34833]: pgmap v591: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:02:48.469 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:02:48.469 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:02:48.728 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:49.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.198+0000 7f0ed8700640 1 -- 172.21.15.7:0/1868713707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ed0109e10 msgr2=0x7f0ed0110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:49.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.198+0000 7f0ed8700640 1 --2- 172.21.15.7:0/1868713707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ed0109e10 0x7f0ed0110640 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009ca0 tx=0x7f0ec802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:02:49.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.198+0000 7f0ed8700640 1 -- 172.21.15.7:0/1868713707 shutdown_connections 2024-09-21T06:02:49.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.198+0000 7f0ed8700640 1 --2- 172.21.15.7:0/1868713707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ed0109e10 0x7f0ed0110640 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:49.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.198+0000 7f0ed8700640 1 --2- 172.21.15.7:0/1868713707 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ed01094c0 0x7f0ed01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:49.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.198+0000 7f0ed8700640 1 --2- 172.21.15.7:0/1868713707 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ed0103b80 0x7f0ed0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:49.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.198+0000 7f0ed8700640 1 -- 172.21.15.7:0/1868713707 >> 172.21.15.7:0/1868713707 conn(0x7f0ed00ff610 msgr2=0x7f0ed0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:49.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.198+0000 7f0ed8700640 1 -- 172.21.15.7:0/1868713707 shutdown_connections 2024-09-21T06:02:49.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.198+0000 7f0ed8700640 1 -- 172.21.15.7:0/1868713707 wait complete. 2024-09-21T06:02:49.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.199+0000 7f0ed8700640 1 Processor -- start 2024-09-21T06:02:49.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.199+0000 7f0ed8700640 1 -- start start 2024-09-21T06:02:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed8700640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ed0103b80 0x7f0ed019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed8700640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ed01094c0 0x7f0ed019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed8700640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ed0109e10 0x7f0ed019fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed8700640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed0113ad0 con 0x7f0ed0109e10 2024-09-21T06:02:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed8700640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed0113950 con 0x7f0ed0103b80 2024-09-21T06:02:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed8700640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed0113c50 con 0x7f0ed01094c0 2024-09-21T06:02:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed6c9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ed0109e10 0x7f0ed019fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed6c9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ed0109e10 0x7f0ed019fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60056/0 (socket says 172.21.15.7:60056) 2024-09-21T06:02:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed6c9d640 1 -- 172.21.15.7:0/288574533 learned_addr learned my addr 172.21.15.7:0/288574533 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed649c640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ed0103b80 0x7f0ed019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed5c9b640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ed01094c0 0x7f0ed019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed6c9d640 1 -- 172.21.15.7:0/288574533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ed01094c0 msgr2=0x7f0ed019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:49.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed6c9d640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ed01094c0 0x7f0ed019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:49.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed6c9d640 1 -- 172.21.15.7:0/288574533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ed0103b80 msgr2=0x7f0ed019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:49.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed6c9d640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ed0103b80 0x7f0ed019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:49.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.200+0000 7f0ed6c9d640 1 -- 172.21.15.7:0/288574533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed01a0390 con 0x7f0ed0109e10 2024-09-21T06:02:49.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.201+0000 7f0ed6c9d640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ed0109e10 0x7f0ed019fc60 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8005cc0 tx=0x7f0ec802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:49.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.201+0000 7f0ec37fe640 1 -- 172.21.15.7:0/288574533 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8003bf0 con 0x7f0ed0109e10 2024-09-21T06:02:49.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.201+0000 7f0ec37fe640 1 -- 172.21.15.7:0/288574533 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ec8003d90 con 0x7f0ed0109e10 2024-09-21T06:02:49.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.201+0000 7f0ed8700640 1 -- 172.21.15.7:0/288574533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed01a0620 con 0x7f0ed0109e10 2024-09-21T06:02:49.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.201+0000 7f0ec37fe640 1 -- 172.21.15.7:0/288574533 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec802fbc0 con 0x7f0ed0109e10 2024-09-21T06:02:49.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.201+0000 7f0ed8700640 1 -- 172.21.15.7:0/288574533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed01a6de0 con 0x7f0ed0109e10 2024-09-21T06:02:49.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.202+0000 7f0ed8700640 1 -- 172.21.15.7:0/288574533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed0103f90 con 0x7f0ed0109e10 2024-09-21T06:02:49.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.203+0000 7f0ec37fe640 1 -- 172.21.15.7:0/288574533 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0ec802fd60 con 0x7f0ed0109e10 2024-09-21T06:02:49.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.206+0000 7f0ec37fe640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0ebc0b6700 0x7f0ebc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:49.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.206+0000 7f0ed649c640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0ebc0b6700 0x7f0ebc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:49.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.206+0000 7f0ec37fe640 1 -- 172.21.15.7:0/288574533 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f0ec8108cf0 con 0x7f0ed0109e10 2024-09-21T06:02:49.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.206+0000 7f0ed649c640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0ebc0b6700 0x7f0ebc0b8c10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0058c0 tx=0x7f0ecc00a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:49.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.208+0000 7f0ec37fe640 1 -- 172.21.15.7:0/288574533 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0ec8083710 con 0x7f0ed0109e10 2024-09-21T06:02:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.435+0000 7f0ed8700640 1 -- 172.21.15.7:0/288574533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ed019b550 con 0x7f0ed0109e10 2024-09-21T06:02:49.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.435+0000 7f0ec37fe640 1 -- 172.21.15.7:0/288574533 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f0ed019b550 con 0x7f0ed0109e10 2024-09-21T06:02:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:02:49.439 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:02:49.439 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:02:49.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.438+0000 7f0ed8700640 1 -- 172.21.15.7:0/288574533 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0ebc0b6700 msgr2=0x7f0ebc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.438+0000 7f0ed8700640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0ebc0b6700 0x7f0ebc0b8c10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0058c0 tx=0x7f0ecc00a250 comp rx=0 tx=0).stop 2024-09-21T06:02:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.438+0000 7f0ed8700640 1 -- 172.21.15.7:0/288574533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ed0109e10 msgr2=0x7f0ed019fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.438+0000 7f0ed8700640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ed0109e10 0x7f0ed019fc60 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8005cc0 tx=0x7f0ec802f380 comp rx=0 tx=0).stop 2024-09-21T06:02:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.438+0000 7f0ed8700640 1 -- 172.21.15.7:0/288574533 shutdown_connections 2024-09-21T06:02:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.438+0000 7f0ed8700640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0ebc0b6700 0x7f0ebc0b8c10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.438+0000 7f0ed8700640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ed0109e10 0x7f0ed019fc60 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.438+0000 7f0ed8700640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ed01094c0 0x7f0ed019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.438+0000 7f0ed8700640 1 --2- 172.21.15.7:0/288574533 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ed0103b80 0x7f0ed019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.438+0000 7f0ed8700640 1 -- 172.21.15.7:0/288574533 >> 172.21.15.7:0/288574533 conn(0x7f0ed00ff610 msgr2=0x7f0ed0106a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.438+0000 7f0ed8700640 1 -- 172.21.15.7:0/288574533 shutdown_connections 2024-09-21T06:02:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:49.438+0000 7f0ed8700640 1 -- 172.21.15.7:0/288574533 wait complete. 2024-09-21T06:02:50.086 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:02:50.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:49 smithi027 ceph-mon[34364]: pgmap v592: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:02:50.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:49 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/288574533' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:02:50.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:49 smithi007 ceph-mon[30983]: pgmap v592: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:02:50.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:49 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/288574533' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:02:50.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:49 smithi119 ceph-mon[34833]: pgmap v592: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:02:50.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:49 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/288574533' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:02:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:50.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.843+0000 7feef2036640 1 -- 172.21.15.7:0/1417536665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeec110200 msgr2=0x7feeec112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:50.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.843+0000 7feef2036640 1 --2- 172.21.15.7:0/1417536665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeec110200 0x7feeec112620 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7feee4009900 tx=0x7feee402a480 comp rx=0 tx=0).stop 2024-09-21T06:02:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.843+0000 7feef2036640 1 -- 172.21.15.7:0/1417536665 shutdown_connections 2024-09-21T06:02:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.843+0000 7feef2036640 1 --2- 172.21.15.7:0/1417536665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeec110200 0x7feeec112620 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.843+0000 7feef2036640 1 --2- 172.21.15.7:0/1417536665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feeec102fa0 0x7feeec10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.843+0000 7feef2036640 1 --2- 172.21.15.7:0/1417536665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feeec102650 0x7feeec102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.843+0000 7feef2036640 1 -- 172.21.15.7:0/1417536665 >> 172.21.15.7:0/1417536665 conn(0x7feeec079730 msgr2=0x7feeec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.843+0000 7feef2036640 1 -- 172.21.15.7:0/1417536665 shutdown_connections 2024-09-21T06:02:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.843+0000 7feef2036640 1 -- 172.21.15.7:0/1417536665 wait complete. 2024-09-21T06:02:50.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.844+0000 7feef2036640 1 Processor -- start 2024-09-21T06:02:50.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.844+0000 7feef2036640 1 -- start start 2024-09-21T06:02:50.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feef2036640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feeec102650 0x7feeec19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feef2036640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feeec102fa0 0x7feeec19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feef2036640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeec110200 0x7feeec1a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feef2036640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feeec115c70 con 0x7feeec110200 2024-09-21T06:02:50.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feef2036640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7feeec115af0 con 0x7feeec102650 2024-09-21T06:02:50.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feef2036640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7feeec115df0 con 0x7feeec102fa0 2024-09-21T06:02:50.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feeebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeec110200 0x7feeec1a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feeebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeec110200 0x7feeec1a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60074/0 (socket says 172.21.15.7:60074) 2024-09-21T06:02:50.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feeebfff640 1 -- 172.21.15.7:0/3608094619 learned_addr learned my addr 172.21.15.7:0/3608094619 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:50.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feeeaffd640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feeec102fa0 0x7feeec19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feeeb7fe640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feeec102650 0x7feeec19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feeebfff640 1 -- 172.21.15.7:0/3608094619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feeec102fa0 msgr2=0x7feeec19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feeebfff640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feeec102fa0 0x7feeec19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feeebfff640 1 -- 172.21.15.7:0/3608094619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feeec102650 msgr2=0x7feeec19c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feeebfff640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feeec102650 0x7feeec19c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feeebfff640 1 -- 172.21.15.7:0/3608094619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeec1a2550 con 0x7feeec110200 2024-09-21T06:02:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feeeb7fe640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feeec102650 0x7feeec19c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.845+0000 7feeebfff640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeec110200 0x7feeec1a1e20 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7feee4004770 tx=0x7feee4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.846+0000 7feee8ff9640 1 -- 172.21.15.7:0/3608094619 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee403f030 con 0x7feeec110200 2024-09-21T06:02:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.846+0000 7feee8ff9640 1 -- 172.21.15.7:0/3608094619 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feee4003aa0 con 0x7feeec110200 2024-09-21T06:02:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.846+0000 7feef2036640 1 -- 172.21.15.7:0/3608094619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeec1a27e0 con 0x7feeec110200 2024-09-21T06:02:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.846+0000 7feee8ff9640 1 -- 172.21.15.7:0/3608094619 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee4035070 con 0x7feeec110200 2024-09-21T06:02:50.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.846+0000 7feef2036640 1 -- 172.21.15.7:0/3608094619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeec1a8fa0 con 0x7feeec110200 2024-09-21T06:02:50.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.848+0000 7feef85aa740 1 Processor -- start 2024-09-21T06:02:50.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.849+0000 7feee8ff9640 1 -- 172.21.15.7:0/3608094619 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7feee4042030 con 0x7feeec110200 2024-09-21T06:02:50.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.849+0000 7feef85aa740 1 -- start start 2024-09-21T06:02:50.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.849+0000 7feef85aa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55786665b070 0x557866a026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.849+0000 7feef85aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5578666321b0 0x557866a02be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.849+0000 7feef85aa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55786663a390 0x557866a03120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.849+0000 7feef85aa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557866978ea0 con 0x55786665b070 2024-09-21T06:02:50.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.849+0000 7feef85aa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5578669682d0 con 0x55786663a390 2024-09-21T06:02:50.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.849+0000 7feef85aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55786696c0e0 con 0x5578666321b0 2024-09-21T06:02:50.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.849+0000 7feeeaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55786665b070 0x557866a026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.849+0000 7feeeaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55786665b070 0x557866a026a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60090/0 (socket says 172.21.15.7:60090) 2024-09-21T06:02:50.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.849+0000 7feeeaffd640 1 -- 172.21.15.7:0/387270866 learned_addr learned my addr 172.21.15.7:0/387270866 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:50.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feeeb7fe640 1 --2- 172.21.15.7:0/387270866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5578666321b0 0x557866a02be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feeeaffd640 1 --2- 172.21.15.7:0/387270866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55786663a390 0x557866a03120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feee8ff9640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7feed40b6680 0x7feed40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feeeaffd640 1 -- 172.21.15.7:0/387270866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5578666321b0 msgr2=0x557866a02be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:50.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feeeaffd640 1 --2- 172.21.15.7:0/387270866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5578666321b0 0x557866a02be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feeeaffd640 1 -- 172.21.15.7:0/387270866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55786663a390 msgr2=0x557866a03120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:50.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feeeaffd640 1 --2- 172.21.15.7:0/387270866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55786663a390 0x557866a03120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feeeaffd640 1 -- 172.21.15.7:0/387270866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578666c6650 con 0x55786665b070 2024-09-21T06:02:50.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feeebfff640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7feed40b6680 0x7feed40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feeeb7fe640 1 --2- 172.21.15.7:0/387270866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5578666321b0 0x557866a02be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:02:50.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feee8ff9640 1 -- 172.21.15.7:0/3608094619 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7feee4107e60 con 0x7feeec110200 2024-09-21T06:02:50.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feeeaffd640 1 --2- 172.21.15.7:0/387270866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55786665b070 0x557866a026a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7feee000bbf0 tx=0x7feee0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3462fdcfccb5616 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feed1ffb640 1 -- 172.21.15.7:0/387270866 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0012480 con 0x55786665b070 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feed1ffb640 1 -- 172.21.15.7:0/387270866 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feee0012ad0 con 0x55786665b070 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.850+0000 7feed1ffb640 1 -- 172.21.15.7:0/387270866 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0010a20 con 0x55786665b070 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.851+0000 7feef85aa740 1 -- 172.21.15.7:0/387270866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55786665b070 msgr2=0x557866a026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.851+0000 7feeebfff640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7feed40b6680 0x7feed40b8b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7feee41056b0 tx=0x7feee4096820 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.851+0000 7feef85aa740 1 --2- 172.21.15.7:0/387270866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55786665b070 0x557866a026a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7feee000bbf0 tx=0x7feee0004610 comp rx=0 tx=0).stop 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.851+0000 7feef85aa740 1 -- 172.21.15.7:0/387270866 shutdown_connections 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.851+0000 7feef85aa740 1 --2- 172.21.15.7:0/387270866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55786663a390 0x557866a03120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.851+0000 7feef85aa740 1 --2- 172.21.15.7:0/387270866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5578666321b0 0x557866a02be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.851+0000 7feef85aa740 1 --2- 172.21.15.7:0/387270866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55786665b070 0x557866a026a0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.851+0000 7feef85aa740 1 -- 172.21.15.7:0/387270866 >> 172.21.15.7:0/387270866 conn(0x55786664f460 msgr2=0x557866a00590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.851+0000 7feef85aa740 1 -- 172.21.15.7:0/387270866 shutdown_connections 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.851+0000 7feef85aa740 1 -- 172.21.15.7:0/387270866 wait complete. 2024-09-21T06:02:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.852+0000 7feef85aa740 1 -- start start 2024-09-21T06:02:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.852+0000 7feef85aa740 1 Processor -- start 2024-09-21T06:02:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.852+0000 7feef85aa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666321b0 0x557866a0dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.852+0000 7feef85aa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55786663a390 0x557866a0e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.852+0000 7feef85aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786665b070 0x557866a0e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.852+0000 7feef85aa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5578667c9700 con 0x5578666321b0 2024-09-21T06:02:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.852+0000 7feef85aa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x557866903160 con 0x55786663a390 2024-09-21T06:02:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.852+0000 7feef85aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557866a10e20 con 0x55786665b070 2024-09-21T06:02:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feef85aa740 10 client.0 _ll_register_callbacks cb 0x55786691c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feeeaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666321b0 0x557866a0dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feeeaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666321b0 0x557866a0dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60092/0 (socket says 172.21.15.7:60092) 2024-09-21T06:02:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feeeaffd640 1 -- 172.21.15.7:0/2606752174 learned_addr learned my addr 172.21.15.7:0/2606752174 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feeeb7fe640 1 --2- 172.21.15.7:0/2606752174 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55786663a390 0x557866a0e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feeeaffd640 1 --2- 172.21.15.7:0/2606752174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786665b070 0x557866a0e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feeeaffd640 1 -- 172.21.15.7:0/2606752174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786665b070 msgr2=0x557866a0e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feeeaffd640 1 --2- 172.21.15.7:0/2606752174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786665b070 0x557866a0e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feeeaffd640 1 -- 172.21.15.7:0/2606752174 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55786663a390 msgr2=0x557866a0e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feeeaffd640 1 --2- 172.21.15.7:0/2606752174 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55786663a390 0x557866a0e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feeeaffd640 1 -- 172.21.15.7:0/2606752174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557866930c90 con 0x5578666321b0 2024-09-21T06:02:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feeeaffd640 1 --2- 172.21.15.7:0/2606752174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666321b0 0x557866a0dd30 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7feee0005fe0 tx=0x7feee00106a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592a876f099a5525 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feecaffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feecaffd640 1 -- 172.21.15.7:0/2606752174 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0012890 con 0x5578666321b0 2024-09-21T06:02:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feecaffd640 1 -- 172.21.15.7:0/2606752174 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7feee00107a0 con 0x5578666321b0 2024-09-21T06:02:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.853+0000 7feef85aa740 1 -- 172.21.15.7:0/2606752174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feee0012ad0 con 0x5578666321b0 2024-09-21T06:02:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.854+0000 7feecaffd640 1 -- 172.21.15.7:0/2606752174 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feee0032030 con 0x5578666321b0 2024-09-21T06:02:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.854+0000 7feef85aa740 10 client.17976 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.854+0000 7feef85aa740 1 -- 172.21.15.7:0/2606752174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557866a1cb20 con 0x5578666321b0 2024-09-21T06:02:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.854+0000 7feecaffd640 1 -- 172.21.15.7:0/2606752174 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feee0012ad0 con 0x5578666321b0 2024-09-21T06:02:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.854+0000 7feecaffd640 1 -- 172.21.15.7:0/2606752174 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feee001d070 con 0x5578666321b0 2024-09-21T06:02:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.854+0000 7feef85aa740 10 client.17976 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.854+0000 7feef85aa740 10 client.17976 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:02:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.854+0000 7feef85aa740 20 client.17976 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.854+0000 7feef85aa740 1 --2- 172.21.15.7:0/2606752174 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5578666199f0 0x557866a1fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.854+0000 7feef85aa740 4 client.17976 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:02:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.854+0000 7feef85aa740 1 -- 172.21.15.7:0/2606752174 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55786697adf0 con 0x5578666199f0 2024-09-21T06:02:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.854+0000 7feeeb7fe640 1 --2- 172.21.15.7:0/2606752174 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5578666199f0 0x557866a1fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.855+0000 7feeeb7fe640 1 --2- 172.21.15.7:0/2606752174 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5578666199f0 0x557866a1fe80 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d4261fa7553b4705 server_cookie=f9981973fb0189b0 in_seq=0 out_seq=0 2024-09-21T06:02:50.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.855+0000 7feecaffd640 10 client.17976 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:02:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feecaffd640 1 -- 172.21.15.7:0/2606752174 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55786697adf0 con 0x5578666199f0 2024-09-21T06:02:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feecaffd640 10 client.17976 handle_command_reply: tid=0 2024-09-21T06:02:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feef85aa740 1 client.17976 shutdown 2024-09-21T06:02:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feef85aa740 1 -- 172.21.15.7:0/2606752174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666321b0 msgr2=0x557866a0dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feef85aa740 1 --2- 172.21.15.7:0/2606752174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666321b0 0x557866a0dd30 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7feee0005fe0 tx=0x7feee00106a0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feef85aa740 1 -- 172.21.15.7:0/2606752174 shutdown_connections 2024-09-21T06:02:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feef85aa740 1 --2- 172.21.15.7:0/2606752174 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5578666199f0 0x557866a1fe80 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feecaffd640 0 client.17976 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:02:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feef85aa740 1 --2- 172.21.15.7:0/2606752174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786665b070 0x557866a0e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feef85aa740 1 --2- 172.21.15.7:0/2606752174 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55786663a390 0x557866a0e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feef85aa740 1 --2- 172.21.15.7:0/2606752174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666321b0 0x557866a0dd30 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feef85aa740 1 -- 172.21.15.7:0/2606752174 >> 172.21.15.7:0/2606752174 conn(0x55786664f460 msgr2=0x557866a05880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feef85aa740 1 -- 172.21.15.7:0/2606752174 shutdown_connections 2024-09-21T06:02:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feef85aa740 1 -- 172.21.15.7:0/2606752174 wait complete. 2024-09-21T06:02:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.856+0000 7feef85aa740 20 client.17976 trim_cache size 0 max 16384 2024-09-21T06:02:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.869+0000 7feef85aa740 1 Processor -- start 2024-09-21T06:02:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.869+0000 7feef85aa740 1 -- start start 2024-09-21T06:02:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feef85aa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 0x557866a0cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feef85aa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5578666321b0 0x557866a1a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feef85aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786663a390 0x557866a03de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feef85aa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feeec1b3fd0 con 0x5578666199f0 2024-09-21T06:02:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feef85aa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7feeec1b18a0 con 0x5578666321b0 2024-09-21T06:02:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feef85aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7feeec1af710 con 0x55786663a390 2024-09-21T06:02:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feeeaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 0x557866a0cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feeeaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 0x557866a0cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60108/0 (socket says 172.21.15.7:60108) 2024-09-21T06:02:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feeeaffd640 1 -- 172.21.15.7:0/3783532336 learned_addr learned my addr 172.21.15.7:0/3783532336 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feeeaffd640 1 -- 172.21.15.7:0/3783532336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786663a390 msgr2=0x557866a03de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feeeaffd640 1 --2- 172.21.15.7:0/3783532336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786663a390 0x557866a03de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feeeaffd640 1 -- 172.21.15.7:0/3783532336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5578666321b0 msgr2=0x557866a1a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feeeaffd640 1 --2- 172.21.15.7:0/3783532336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5578666321b0 0x557866a1a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feeeaffd640 1 -- 172.21.15.7:0/3783532336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557866a04990 con 0x5578666199f0 2024-09-21T06:02:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feeeaffd640 1 --2- 172.21.15.7:0/3783532336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 0x557866a0cc20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7feee00042f0 tx=0x7feee0004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbc1e4b51e32c84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.870+0000 7feed17fa640 1 -- 172.21.15.7:0/3783532336 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0023070 con 0x5578666199f0 2024-09-21T06:02:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.871+0000 7feed17fa640 1 -- 172.21.15.7:0/3783532336 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feee000b990 con 0x5578666199f0 2024-09-21T06:02:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.871+0000 7feed17fa640 1 -- 172.21.15.7:0/3783532336 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0037690 con 0x5578666199f0 2024-09-21T06:02:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.871+0000 7feef85aa740 1 -- 172.21.15.7:0/3783532336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 msgr2=0x557866a0cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.871+0000 7feef85aa740 1 --2- 172.21.15.7:0/3783532336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 0x557866a0cc20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7feee00042f0 tx=0x7feee0004120 comp rx=0 tx=0).stop 2024-09-21T06:02:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.871+0000 7feef85aa740 1 -- 172.21.15.7:0/3783532336 shutdown_connections 2024-09-21T06:02:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.871+0000 7feef85aa740 1 --2- 172.21.15.7:0/3783532336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786663a390 0x557866a03de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.871+0000 7feef85aa740 1 --2- 172.21.15.7:0/3783532336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5578666321b0 0x557866a1a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.871+0000 7feef85aa740 1 --2- 172.21.15.7:0/3783532336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 0x557866a0cc20 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.871+0000 7feef85aa740 1 -- 172.21.15.7:0/3783532336 >> 172.21.15.7:0/3783532336 conn(0x55786664f460 msgr2=0x557866a036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.871+0000 7feef85aa740 1 -- 172.21.15.7:0/3783532336 shutdown_connections 2024-09-21T06:02:50.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.871+0000 7feef85aa740 1 -- 172.21.15.7:0/3783532336 wait complete. 2024-09-21T06:02:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.872+0000 7feef85aa740 1 -- start start 2024-09-21T06:02:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.872+0000 7feef85aa740 1 Processor -- start 2024-09-21T06:02:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.872+0000 7feef85aa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 0x557866a12110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.872+0000 7feef85aa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5578666321b0 0x557866a12650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.872+0000 7feef85aa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786663a390 0x557866a12b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.872+0000 7feef85aa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feeec1afd60 con 0x5578666199f0 2024-09-21T06:02:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.872+0000 7feef85aa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7feeec1b11d0 con 0x5578666321b0 2024-09-21T06:02:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.872+0000 7feef85aa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7feeec1b0430 con 0x55786663a390 2024-09-21T06:02:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.872+0000 7feef85aa740 10 client.0 _ll_register_callbacks cb 0x7feedc009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.872+0000 7feeeaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 0x557866a12110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.872+0000 7feeeaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 0x557866a12110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60124/0 (socket says 172.21.15.7:60124) 2024-09-21T06:02:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.872+0000 7feeeaffd640 1 -- 172.21.15.7:0/1099062270 learned_addr learned my addr 172.21.15.7:0/1099062270 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feeeb7fe640 1 --2- 172.21.15.7:0/1099062270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5578666321b0 0x557866a12650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feeeaffd640 1 --2- 172.21.15.7:0/1099062270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786663a390 0x557866a12b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feeeaffd640 1 -- 172.21.15.7:0/1099062270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786663a390 msgr2=0x557866a12b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feeeaffd640 1 --2- 172.21.15.7:0/1099062270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786663a390 0x557866a12b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feeeaffd640 1 -- 172.21.15.7:0/1099062270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5578666321b0 msgr2=0x557866a12650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feeeaffd640 1 --2- 172.21.15.7:0/1099062270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5578666321b0 0x557866a12650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feeeaffd640 1 -- 172.21.15.7:0/1099062270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557866a897e0 con 0x5578666199f0 2024-09-21T06:02:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feeeaffd640 1 --2- 172.21.15.7:0/1099062270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 0x557866a12110 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7feee0000c00 tx=0x7feee00058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de9ed921a326d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feecaffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feecaffd640 1 -- 172.21.15.7:0/1099062270 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0023040 con 0x5578666199f0 2024-09-21T06:02:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feecaffd640 1 -- 172.21.15.7:0/1099062270 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7feee0010450 con 0x5578666199f0 2024-09-21T06:02:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feef85aa740 1 -- 172.21.15.7:0/1099062270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feee000b990 con 0x5578666199f0 2024-09-21T06:02:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feecaffd640 1 -- 172.21.15.7:0/1099062270 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feee0047050 con 0x5578666199f0 2024-09-21T06:02:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feef85aa740 10 client.17982 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.873+0000 7feef85aa740 1 -- 172.21.15.7:0/1099062270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557866a8aa40 con 0x5578666199f0 2024-09-21T06:02:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.874+0000 7feecaffd640 1 -- 172.21.15.7:0/1099062270 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feee000b990 con 0x5578666199f0 2024-09-21T06:02:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.874+0000 7feecaffd640 1 -- 172.21.15.7:0/1099062270 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feee001d040 con 0x5578666199f0 2024-09-21T06:02:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.874+0000 7feef85aa740 10 client.17982 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:50.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.874+0000 7feef85aa740 10 client.17982 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:02:50.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.874+0000 7feef85aa740 20 client.17982 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:50.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.874+0000 7feef85aa740 1 --2- 172.21.15.7:0/1099062270 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55786665b070 0x557866a8d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:50.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.874+0000 7feef85aa740 4 client.17982 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:02:50.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.874+0000 7feef85aa740 1 -- 172.21.15.7:0/1099062270 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557866a098e0 con 0x55786665b070 2024-09-21T06:02:50.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.874+0000 7feeeb7fe640 1 --2- 172.21.15.7:0/1099062270 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55786665b070 0x557866a8d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:50.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feecaffd640 10 client.17982 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:02:50.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feeeb7fe640 1 --2- 172.21.15.7:0/1099062270 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55786665b070 0x557866a8d100 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6d4437b0fe39647d server_cookie=c57df5938b16d234 in_seq=0 out_seq=0 2024-09-21T06:02:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feecaffd640 1 -- 172.21.15.7:0/1099062270 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557866a098e0 con 0x55786665b070 2024-09-21T06:02:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feecaffd640 10 client.17982 handle_command_reply: tid=0 2024-09-21T06:02:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feef85aa740 1 client.17982 shutdown 2024-09-21T06:02:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feef85aa740 1 -- 172.21.15.7:0/1099062270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 msgr2=0x557866a12110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feef85aa740 1 --2- 172.21.15.7:0/1099062270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 0x557866a12110 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7feee0000c00 tx=0x7feee00058f0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feef85aa740 1 -- 172.21.15.7:0/1099062270 shutdown_connections 2024-09-21T06:02:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feef85aa740 1 --2- 172.21.15.7:0/1099062270 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x55786665b070 0x557866a8d100 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feef85aa740 1 --2- 172.21.15.7:0/1099062270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55786663a390 0x557866a12b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feef85aa740 1 --2- 172.21.15.7:0/1099062270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5578666321b0 0x557866a12650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feef85aa740 1 --2- 172.21.15.7:0/1099062270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578666199f0 0x557866a12110 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feef85aa740 1 -- 172.21.15.7:0/1099062270 >> 172.21.15.7:0/1099062270 conn(0x55786664f460 msgr2=0x557866a04030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feecaffd640 0 client.17982 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:02:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feef85aa740 1 -- 172.21.15.7:0/1099062270 shutdown_connections 2024-09-21T06:02:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feef85aa740 1 -- 172.21.15.7:0/1099062270 wait complete. 2024-09-21T06:02:50.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.875+0000 7feef85aa740 20 client.17982 trim_cache size 0 max 16384 2024-09-21T06:02:50.884 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:02:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.876+0000 7feef2036640 1 -- 172.21.15.7:0/3608094619 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7feed40b6680 msgr2=0x7feed40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.876+0000 7feef2036640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7feed40b6680 0x7feed40b8b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7feee41056b0 tx=0x7feee4096820 comp rx=0 tx=0).stop 2024-09-21T06:02:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.876+0000 7feef2036640 1 -- 172.21.15.7:0/3608094619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeec110200 msgr2=0x7feeec1a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.876+0000 7feef2036640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeec110200 0x7feeec1a1e20 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7feee4004770 tx=0x7feee4004270 comp rx=0 tx=0).stop 2024-09-21T06:02:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.876+0000 7feef2036640 1 -- 172.21.15.7:0/3608094619 shutdown_connections 2024-09-21T06:02:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.876+0000 7feef2036640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7feed40b6680 0x7feed40b8b90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.876+0000 7feef2036640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeec110200 0x7feeec1a1e20 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.876+0000 7feef2036640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feeec102fa0 0x7feeec19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.876+0000 7feef2036640 1 --2- 172.21.15.7:0/3608094619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feeec102650 0x7feeec19c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:50.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.876+0000 7feef2036640 1 -- 172.21.15.7:0/3608094619 >> 172.21.15.7:0/3608094619 conn(0x7feeec079730 msgr2=0x7feeec109d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:50.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.876+0000 7feef2036640 1 -- 172.21.15.7:0/3608094619 shutdown_connections 2024-09-21T06:02:50.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:50.876+0000 7feef2036640 1 -- 172.21.15.7:0/3608094619 wait complete. 2024-09-21T06:02:51.553 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:02:51.813 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:52.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:51 smithi007 ceph-mon[30983]: pgmap v593: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:02:52.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:51 smithi027 ceph-mon[34364]: pgmap v593: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:02:52.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.301+0000 7f8ee82ce640 1 -- 172.21.15.7:0/346498735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee0108d10 msgr2=0x7f8ee010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:52.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.301+0000 7f8ee82ce640 1 --2- 172.21.15.7:0/346498735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee0108d10 0x7f8ee010f540 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009ca0 tx=0x7f8ed802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.301+0000 7f8ee82ce640 1 -- 172.21.15.7:0/346498735 shutdown_connections 2024-09-21T06:02:52.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.301+0000 7f8ee82ce640 1 --2- 172.21.15.7:0/346498735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee0108d10 0x7f8ee010f540 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.301+0000 7f8ee82ce640 1 --2- 172.21.15.7:0/346498735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ee01083c0 0x7f8ee01087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.301+0000 7f8ee82ce640 1 --2- 172.21.15.7:0/346498735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ee0102a80 0x7f8ee0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.301+0000 7f8ee82ce640 1 -- 172.21.15.7:0/346498735 >> 172.21.15.7:0/346498735 conn(0x7f8ee0079740 msgr2=0x7f8ee0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:52.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.301+0000 7f8ee82ce640 1 -- 172.21.15.7:0/346498735 shutdown_connections 2024-09-21T06:02:52.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.301+0000 7f8ee82ce640 1 -- 172.21.15.7:0/346498735 wait complete. 2024-09-21T06:02:52.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.302+0000 7f8ee82ce640 1 Processor -- start 2024-09-21T06:02:52.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.302+0000 7f8ee82ce640 1 -- start start 2024-09-21T06:02:52.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.302+0000 7f8ee82ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee0102a80 0x7f8ee019b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.302+0000 7f8ee82ce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ee01083c0 0x7f8ee019b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.302+0000 7f8ee82ce640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ee0108d10 0x7f8ee019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.302+0000 7f8ee82ce640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0112980 con 0x7f8ee0102a80 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.302+0000 7f8ee82ce640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0112800 con 0x7f8ee0108d10 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.302+0000 7f8ee82ce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0112b00 con 0x7f8ee01083c0 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.302+0000 7f8ee606a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee0102a80 0x7f8ee019b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.302+0000 7f8ee606a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee0102a80 0x7f8ee019b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60138/0 (socket says 172.21.15.7:60138) 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.302+0000 7f8ee606a640 1 -- 172.21.15.7:0/1168748907 learned_addr learned my addr 172.21.15.7:0/1168748907 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.302+0000 7f8ee5869640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ee01083c0 0x7f8ee019b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.302+0000 7f8ee686b640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ee0108d10 0x7f8ee019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.303+0000 7f8ee606a640 1 -- 172.21.15.7:0/1168748907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ee01083c0 msgr2=0x7f8ee019b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.303+0000 7f8ee606a640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ee01083c0 0x7f8ee019b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.303+0000 7f8ee606a640 1 -- 172.21.15.7:0/1168748907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ee0108d10 msgr2=0x7f8ee019bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:52.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.303+0000 7f8ee606a640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ee0108d10 0x7f8ee019bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.303+0000 7f8ee606a640 1 -- 172.21.15.7:0/1168748907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee01a6470 con 0x7f8ee0102a80 2024-09-21T06:02:52.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.303+0000 7f8ee686b640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ee0108d10 0x7f8ee019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:02:52.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.303+0000 7f8ee606a640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee0102a80 0x7f8ee019b1f0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00c920 tx=0x7f8edc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:52.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.303+0000 7f8ed77fe640 1 -- 172.21.15.7:0/1168748907 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc007c70 con 0x7f8ee0102a80 2024-09-21T06:02:52.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.303+0000 7f8ee82ce640 1 -- 172.21.15.7:0/1168748907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee01a6760 con 0x7f8ee0102a80 2024-09-21T06:02:52.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.303+0000 7f8ed77fe640 1 -- 172.21.15.7:0/1168748907 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8edc007e10 con 0x7f8ee0102a80 2024-09-21T06:02:52.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.303+0000 7f8ed77fe640 1 -- 172.21.15.7:0/1168748907 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc018820 con 0x7f8ee0102a80 2024-09-21T06:02:52.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.303+0000 7f8ee82ce640 1 -- 172.21.15.7:0/1168748907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee01a6ca0 con 0x7f8ee0102a80 2024-09-21T06:02:52.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.306+0000 7f8ed77fe640 1 -- 172.21.15.7:0/1168748907 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8edc00f450 con 0x7f8ee0102a80 2024-09-21T06:02:52.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.306+0000 7f8eee842740 1 Processor -- start 2024-09-21T06:02:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.306+0000 7f8eee842740 1 -- start start 2024-09-21T06:02:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.306+0000 7f8eee842740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64493f070 0x55f644ce62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.306+0000 7f8eee842740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644ce6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.306+0000 7f8eee842740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64491e390 0x55f644ce6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.306+0000 7f8eee842740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f644c5cea0 con 0x55f64493f070 2024-09-21T06:02:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.306+0000 7f8eee842740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f644c4c2d0 con 0x55f6449161b0 2024-09-21T06:02:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.306+0000 7f8eee842740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f644c500e0 con 0x55f64491e390 2024-09-21T06:02:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ee606a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644ce6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ee686b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64493f070 0x55f644ce62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ee5869640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64491e390 0x55f644ce6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ee606a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644ce6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:39782/0 (socket says 172.21.15.7:39782) 2024-09-21T06:02:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ee686b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64493f070 0x55f644ce62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60154/0 (socket says 172.21.15.7:60154) 2024-09-21T06:02:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ee606a640 1 -- 172.21.15.7:0/1259275058 learned_addr learned my addr 172.21.15.7:0/1259275058 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:52.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ee5869640 1 -- 172.21.15.7:0/1259275058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 msgr2=0x55f644ce6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:52.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ee5869640 1 --2- 172.21.15.7:0/1259275058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644ce6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ee5869640 1 -- 172.21.15.7:0/1259275058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64493f070 msgr2=0x55f644ce62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:52.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ee5869640 1 --2- 172.21.15.7:0/1259275058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64493f070 0x55f644ce62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ee5869640 1 -- 172.21.15.7:0/1259275058 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6449aa650 con 0x55f64491e390 2024-09-21T06:02:52.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ed77fe640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8ecc0b6680 0x7f8ecc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ee686b640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8ecc0b6680 0x7f8ecc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ed77fe640 1 -- 172.21.15.7:0/1168748907 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f8edc0e7950 con 0x7f8ee0102a80 2024-09-21T06:02:52.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.307+0000 7f8ee5869640 1 --2- 172.21.15.7:0/1259275058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64491e390 0x55f644ce6d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8ee006b6c0 tx=0x7f8ed000cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2adf71953bb6c358 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:52.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.308+0000 7f8ed4d9a640 1 -- 172.21.15.7:0/1259275058 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0014070 con 0x55f64491e390 2024-09-21T06:02:52.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.308+0000 7f8ed4d9a640 1 -- 172.21.15.7:0/1259275058 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed0005020 con 0x55f64491e390 2024-09-21T06:02:52.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.308+0000 7f8ed4d9a640 1 -- 172.21.15.7:0/1259275058 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0004a90 con 0x55f64491e390 2024-09-21T06:02:52.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.308+0000 7f8eee842740 1 -- 172.21.15.7:0/1259275058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64491e390 msgr2=0x55f644ce6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:52.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.308+0000 7f8ee686b640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8ecc0b6680 0x7f8ecc0b8b90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80094e0 tx=0x7f8ed8009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:52.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.308+0000 7f8eee842740 1 --2- 172.21.15.7:0/1259275058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64491e390 0x55f644ce6d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8ee006b6c0 tx=0x7f8ed000cf80 comp rx=0 tx=0).stop 2024-09-21T06:02:52.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.309+0000 7f8eee842740 1 -- 172.21.15.7:0/1259275058 shutdown_connections 2024-09-21T06:02:52.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.309+0000 7f8eee842740 1 --2- 172.21.15.7:0/1259275058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64491e390 0x55f644ce6d40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.309+0000 7f8eee842740 1 --2- 172.21.15.7:0/1259275058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644ce6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.309+0000 7f8eee842740 1 --2- 172.21.15.7:0/1259275058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64493f070 0x55f644ce62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.309+0000 7f8eee842740 1 -- 172.21.15.7:0/1259275058 >> 172.21.15.7:0/1259275058 conn(0x55f644933460 msgr2=0x55f644ce41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.309+0000 7f8eee842740 1 -- 172.21.15.7:0/1259275058 shutdown_connections 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.309+0000 7f8eee842740 1 -- 172.21.15.7:0/1259275058 wait complete. 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.309+0000 7f8eee842740 1 -- start start 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.309+0000 7f8eee842740 1 Processor -- start 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8eee842740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8eee842740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64491e390 0x55f644cf1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8eee842740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64493f070 0x55f644cf23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8eee842740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f644aad700 con 0x55f64493f070 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8eee842740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f644be7160 con 0x55f6449161b0 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8eee842740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f644cf4aa0 con 0x55f64491e390 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8eee842740 10 client.0 _ll_register_callbacks cb 0x55f644c009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8ee686b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64493f070 0x55f644cf23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8ee686b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64493f070 0x55f644cf23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60162/0 (socket says 172.21.15.7:60162) 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8ee686b640 1 -- 172.21.15.7:0/2430546164 learned_addr learned my addr 172.21.15.7:0/2430546164 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8ee5869640 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64491e390 0x55f644cf1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8ee606a640 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8ee686b640 1 -- 172.21.15.7:0/2430546164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64491e390 msgr2=0x55f644cf1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8ee686b640 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64491e390 0x55f644cf1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8ee686b640 1 -- 172.21.15.7:0/2430546164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 msgr2=0x55f644cf1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8ee686b640 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8ee686b640 1 -- 172.21.15.7:0/2430546164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f644c14c90 con 0x55f64493f070 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8ee606a640 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8ee686b640 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64493f070 0x55f644cf23d0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8031660 tx=0x7f8ed802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8034cdac1484c6c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.310+0000 7f8ec9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8ec9ffb640 1 -- 172.21.15.7:0/2430546164 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8004250 con 0x55f64493f070 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8ec9ffb640 1 -- 172.21.15.7:0/2430546164 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f8ed80043f0 con 0x55f64493f070 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8eee842740 1 -- 172.21.15.7:0/2430546164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ed0005020 con 0x55f64493f070 2024-09-21T06:02:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8ec9ffb640 1 -- 172.21.15.7:0/2430546164 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8ed80045f0 con 0x55f64493f070 2024-09-21T06:02:52.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8eee842740 10 client.17994 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:52.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8eee842740 1 -- 172.21.15.7:0/2430546164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f644d00720 con 0x55f64493f070 2024-09-21T06:02:52.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8ec9ffb640 1 -- 172.21.15.7:0/2430546164 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed0005020 con 0x55f64493f070 2024-09-21T06:02:52.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8ec9ffb640 1 -- 172.21.15.7:0/2430546164 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8ed8050070 con 0x55f64493f070 2024-09-21T06:02:52.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8eee842740 10 client.17994 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:52.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8eee842740 10 client.17994 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:02:52.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8eee842740 20 client.17994 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:52.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8eee842740 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55f6448fd9f0 0x55f644d03c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8eee842740 4 client.17994 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:02:52.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.311+0000 7f8eee842740 1 -- 172.21.15.7:0/2430546164 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f644c5edf0 con 0x55f6448fd9f0 2024-09-21T06:02:52.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.312+0000 7f8ee606a640 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55f6448fd9f0 0x55f644d03c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.312+0000 7f8ee606a640 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55f6448fd9f0 0x55f644d03c60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae9fb34832ea6b1f server_cookie=6039b41b57d98bc0 in_seq=0 out_seq=0 2024-09-21T06:02:52.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.312+0000 7f8ec9ffb640 10 client.17994 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:02:52.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8ec9ffb640 1 -- 172.21.15.7:0/2430546164 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f644c5edf0 con 0x55f6448fd9f0 2024-09-21T06:02:52.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8ec9ffb640 10 client.17994 handle_command_reply: tid=0 2024-09-21T06:02:52.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8eee842740 1 client.17994 shutdown 2024-09-21T06:02:52.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8eee842740 1 -- 172.21.15.7:0/2430546164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64493f070 msgr2=0x55f644cf23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:52.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8eee842740 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64493f070 0x55f644cf23d0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8031660 tx=0x7f8ed802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8eee842740 1 -- 172.21.15.7:0/2430546164 shutdown_connections 2024-09-21T06:02:52.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8eee842740 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55f6448fd9f0 0x55f644d03c60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8eee842740 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64493f070 0x55f644cf23d0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8eee842740 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64491e390 0x55f644cf1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8eee842740 1 --2- 172.21.15.7:0/2430546164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8eee842740 1 -- 172.21.15.7:0/2430546164 >> 172.21.15.7:0/2430546164 conn(0x55f644933460 msgr2=0x55f644ce94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8ec9ffb640 0 client.17994 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:02:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8eee842740 1 -- 172.21.15.7:0/2430546164 shutdown_connections 2024-09-21T06:02:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8eee842740 1 -- 172.21.15.7:0/2430546164 wait complete. 2024-09-21T06:02:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.313+0000 7f8eee842740 20 client.17994 trim_cache size 0 max 16384 2024-09-21T06:02:52.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8eee842740 1 Processor -- start 2024-09-21T06:02:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8eee842740 1 -- start start 2024-09-21T06:02:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8eee842740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8eee842740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 0x55f644ce7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8eee842740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64493f070 0x55f644ce3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8eee842740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01b1e40 con 0x55f64491e390 2024-09-21T06:02:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8eee842740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01af710 con 0x55f6449161b0 2024-09-21T06:02:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8eee842740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01ad580 con 0x55f64493f070 2024-09-21T06:02:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8ee5869640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 0x55f644ce7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8ee5869640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 0x55f644ce7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60170/0 (socket says 172.21.15.7:60170) 2024-09-21T06:02:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8ee5869640 1 -- 172.21.15.7:0/2345709509 learned_addr learned my addr 172.21.15.7:0/2345709509 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8ee606a640 1 --2- 172.21.15.7:0/2345709509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8ee5869640 1 -- 172.21.15.7:0/2345709509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64493f070 msgr2=0x55f644ce3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:52.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8ee686b640 1 --2- 172.21.15.7:0/2345709509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64493f070 0x55f644ce3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8ee5869640 1 --2- 172.21.15.7:0/2345709509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64493f070 0x55f644ce3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8ee5869640 1 -- 172.21.15.7:0/2345709509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 msgr2=0x55f644cf3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:52.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8ee5869640 1 --2- 172.21.15.7:0/2345709509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8ee5869640 1 -- 172.21.15.7:0/2345709509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f644cf2bf0 con 0x55f64491e390 2024-09-21T06:02:52.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.327+0000 7f8ee606a640 1 --2- 172.21.15.7:0/2345709509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:52.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.328+0000 7f8ee5869640 1 --2- 172.21.15.7:0/2345709509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 0x55f644ce7a00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000c8b0 tx=0x7f8ed0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d6d8984ef0f882 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:52.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.328+0000 7f8ecbfff640 1 -- 172.21.15.7:0/2345709509 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0014070 con 0x55f64491e390 2024-09-21T06:02:52.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.328+0000 7f8ecbfff640 1 -- 172.21.15.7:0/2345709509 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed0005040 con 0x55f64491e390 2024-09-21T06:02:52.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.328+0000 7f8ecbfff640 1 -- 172.21.15.7:0/2345709509 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0004af0 con 0x55f64491e390 2024-09-21T06:02:52.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.328+0000 7f8eee842740 1 -- 172.21.15.7:0/2345709509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 msgr2=0x55f644ce7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:52.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.328+0000 7f8eee842740 1 --2- 172.21.15.7:0/2345709509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 0x55f644ce7a00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000c8b0 tx=0x7f8ed0005850 comp rx=0 tx=0).stop 2024-09-21T06:02:52.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.329+0000 7f8eee842740 1 -- 172.21.15.7:0/2345709509 shutdown_connections 2024-09-21T06:02:52.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.329+0000 7f8eee842740 1 --2- 172.21.15.7:0/2345709509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 0x55f644ce7a00 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.329+0000 7f8eee842740 1 --2- 172.21.15.7:0/2345709509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64493f070 0x55f644ce3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.329+0000 7f8eee842740 1 --2- 172.21.15.7:0/2345709509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.329+0000 7f8eee842740 1 -- 172.21.15.7:0/2345709509 >> 172.21.15.7:0/2345709509 conn(0x55f644933460 msgr2=0x55f644ce72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:52.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.329+0000 7f8eee842740 1 -- 172.21.15.7:0/2345709509 shutdown_connections 2024-09-21T06:02:52.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.329+0000 7f8eee842740 1 -- 172.21.15.7:0/2345709509 wait complete. 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.329+0000 7f8eee842740 1 -- start start 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.329+0000 7f8eee842740 1 Processor -- start 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.329+0000 7f8eee842740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.329+0000 7f8eee842740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 0x55f644cf6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.329+0000 7f8eee842740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64493f070 0x55f644cf6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8eee842740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01adbd0 con 0x55f64491e390 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8eee842740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01af040 con 0x55f6449161b0 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8eee842740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01ae2a0 con 0x55f64493f070 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8eee842740 10 client.0 _ll_register_callbacks cb 0x7f8ed80099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ee5869640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 0x55f644cf6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ee5869640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 0x55f644cf6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60180/0 (socket says 172.21.15.7:60180) 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ee5869640 1 -- 172.21.15.7:0/1600785172 learned_addr learned my addr 172.21.15.7:0/1600785172 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ee606a640 1 --2- 172.21.15.7:0/1600785172 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ee686b640 1 --2- 172.21.15.7:0/1600785172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64493f070 0x55f644cf6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ee5869640 1 -- 172.21.15.7:0/1600785172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64493f070 msgr2=0x55f644cf6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ee5869640 1 --2- 172.21.15.7:0/1600785172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64493f070 0x55f644cf6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ee5869640 1 -- 172.21.15.7:0/1600785172 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 msgr2=0x55f644cf5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ee5869640 1 --2- 172.21.15.7:0/1600785172 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ee5869640 1 -- 172.21.15.7:0/1600785172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f644d6d750 con 0x55f64491e390 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ee5869640 1 --2- 172.21.15.7:0/1600785172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 0x55f644cf6340 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000c600 tx=0x7f8ed000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9167c2a82139d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ec9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ec9ffb640 1 -- 172.21.15.7:0/1600785172 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0031070 con 0x55f64491e390 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.330+0000 7f8ec9ffb640 1 -- 172.21.15.7:0/1600785172 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f8ed0004880 con 0x55f64491e390 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.331+0000 7f8eee842740 1 -- 172.21.15.7:0/1600785172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ed0005040 con 0x55f64491e390 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.331+0000 7f8ec9ffb640 1 -- 172.21.15.7:0/1600785172 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8ed003d050 con 0x55f64491e390 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.331+0000 7f8eee842740 10 client.18000 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.331+0000 7f8eee842740 1 -- 172.21.15.7:0/1600785172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f644d6e9d0 con 0x55f64491e390 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.331+0000 7f8ec9ffb640 1 -- 172.21.15.7:0/1600785172 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed0005040 con 0x55f64491e390 2024-09-21T06:02:52.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.331+0000 7f8ec9ffb640 1 -- 172.21.15.7:0/1600785172 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8ed0023440 con 0x55f64491e390 2024-09-21T06:02:52.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.331+0000 7f8eee842740 10 client.18000 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:52.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.331+0000 7f8eee842740 10 client.18000 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:02:52.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.331+0000 7f8eee842740 20 client.18000 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:52.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.331+0000 7f8eee842740 1 --2- 172.21.15.7:0/1600785172 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55f6448d2da0 0x55f644d70e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:52.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.331+0000 7f8eee842740 4 client.18000 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:02:52.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.331+0000 7f8eee842740 1 -- 172.21.15.7:0/1600785172 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f644c5a8a0 con 0x55f6448d2da0 2024-09-21T06:02:52.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.331+0000 7f8ee606a640 1 --2- 172.21.15.7:0/1600785172 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55f6448d2da0 0x55f644d70e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:52.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8ee606a640 1 --2- 172.21.15.7:0/1600785172 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55f6448d2da0 0x55f644d70e60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a177cd65fabf444d server_cookie=afb95a8324e7f44e in_seq=0 out_seq=0 2024-09-21T06:02:52.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8ec9ffb640 10 client.18000 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:02:52.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8ec9ffb640 1 -- 172.21.15.7:0/1600785172 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f644c5a8a0 con 0x55f6448d2da0 2024-09-21T06:02:52.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8ec9ffb640 10 client.18000 handle_command_reply: tid=0 2024-09-21T06:02:52.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8eee842740 1 client.18000 shutdown 2024-09-21T06:02:52.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8eee842740 1 -- 172.21.15.7:0/1600785172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 msgr2=0x55f644cf6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:52.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8eee842740 1 --2- 172.21.15.7:0/1600785172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 0x55f644cf6340 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000c600 tx=0x7f8ed000c830 comp rx=0 tx=0).stop 2024-09-21T06:02:52.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8eee842740 1 -- 172.21.15.7:0/1600785172 shutdown_connections 2024-09-21T06:02:52.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8eee842740 1 --2- 172.21.15.7:0/1600785172 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55f6448d2da0 0x55f644d70e60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8eee842740 1 --2- 172.21.15.7:0/1600785172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f64491e390 0x55f644cf6340 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8eee842740 1 --2- 172.21.15.7:0/1600785172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f64493f070 0x55f644cf6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8eee842740 1 --2- 172.21.15.7:0/1600785172 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f6449161b0 0x55f644cf5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8ec9ffb640 0 client.18000 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:02:52.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8eee842740 1 -- 172.21.15.7:0/1600785172 >> 172.21.15.7:0/1600785172 conn(0x55f644933460 msgr2=0x55f644cf3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:52.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8eee842740 1 -- 172.21.15.7:0/1600785172 shutdown_connections 2024-09-21T06:02:52.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8eee842740 1 -- 172.21.15.7:0/1600785172 wait complete. 2024-09-21T06:02:52.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.332+0000 7f8eee842740 20 client.18000 trim_cache size 0 max 16384 2024-09-21T06:02:52.340 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:02:52.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.333+0000 7f8ee82ce640 1 -- 172.21.15.7:0/1168748907 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8ecc0b6680 msgr2=0x7f8ecc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:52.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.333+0000 7f8ee82ce640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8ecc0b6680 0x7f8ecc0b8b90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80094e0 tx=0x7f8ed8009360 comp rx=0 tx=0).stop 2024-09-21T06:02:52.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.333+0000 7f8ee82ce640 1 -- 172.21.15.7:0/1168748907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee0102a80 msgr2=0x7f8ee019b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:52.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.333+0000 7f8ee82ce640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee0102a80 0x7f8ee019b1f0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00c920 tx=0x7f8edc00cde0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.333+0000 7f8ee82ce640 1 -- 172.21.15.7:0/1168748907 shutdown_connections 2024-09-21T06:02:52.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.333+0000 7f8ee82ce640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8ecc0b6680 0x7f8ecc0b8b90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.333+0000 7f8ee82ce640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8ee0108d10 0x7f8ee019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.333+0000 7f8ee82ce640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ee01083c0 0x7f8ee019b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.333+0000 7f8ee82ce640 1 --2- 172.21.15.7:0/1168748907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ee0102a80 0x7f8ee019b1f0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:52.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.333+0000 7f8ee82ce640 1 -- 172.21.15.7:0/1168748907 >> 172.21.15.7:0/1168748907 conn(0x7f8ee0079740 msgr2=0x7f8ee01043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:52.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.333+0000 7f8ee82ce640 1 -- 172.21.15.7:0/1168748907 shutdown_connections 2024-09-21T06:02:52.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:52.333+0000 7f8ee82ce640 1 -- 172.21.15.7:0/1168748907 wait complete. 2024-09-21T06:02:52.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:51 smithi119 ceph-mon[34833]: pgmap v593: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:02:53.071 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:02:53.332 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.737+0000 7fad66015640 1 -- 172.21.15.7:0/1104515008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad60108cf0 msgr2=0x7fad6010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.737+0000 7fad66015640 1 --2- 172.21.15.7:0/1104515008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad60108cf0 0x7fad6010f520 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fad58009ca0 tx=0x7fad5802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.737+0000 7fad66015640 1 -- 172.21.15.7:0/1104515008 shutdown_connections 2024-09-21T06:02:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.737+0000 7fad66015640 1 --2- 172.21.15.7:0/1104515008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad60108cf0 0x7fad6010f520 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.737+0000 7fad66015640 1 --2- 172.21.15.7:0/1104515008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad601083a0 0x7fad601087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.737+0000 7fad66015640 1 --2- 172.21.15.7:0/1104515008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad60102a60 0x7fad60102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.737+0000 7fad66015640 1 -- 172.21.15.7:0/1104515008 >> 172.21.15.7:0/1104515008 conn(0x7fad60079730 msgr2=0x7fad60079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.737+0000 7fad66015640 1 -- 172.21.15.7:0/1104515008 shutdown_connections 2024-09-21T06:02:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.737+0000 7fad66015640 1 -- 172.21.15.7:0/1104515008 wait complete. 2024-09-21T06:02:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.738+0000 7fad66015640 1 Processor -- start 2024-09-21T06:02:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.738+0000 7fad66015640 1 -- start start 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.738+0000 7fad66015640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad60102a60 0x7fad6019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.738+0000 7fad66015640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad601083a0 0x7fad6019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.738+0000 7fad66015640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad60108cf0 0x7fad6019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.738+0000 7fad66015640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad601129c0 con 0x7fad60102a60 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.738+0000 7fad66015640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fad60112840 con 0x7fad60108cf0 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.738+0000 7fad66015640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fad60112b40 con 0x7fad601083a0 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.738+0000 7fad5f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad60102a60 0x7fad6019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.738+0000 7fad5f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad60102a60 0x7fad6019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60198/0 (socket says 172.21.15.7:60198) 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.738+0000 7fad5f7fe640 1 -- 172.21.15.7:0/2099979297 learned_addr learned my addr 172.21.15.7:0/2099979297 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.738+0000 7fad5ffff640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad60108cf0 0x7fad6019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.739+0000 7fad5effd640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad601083a0 0x7fad6019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.739+0000 7fad5f7fe640 1 -- 172.21.15.7:0/2099979297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad601083a0 msgr2=0x7fad6019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.739+0000 7fad5f7fe640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad601083a0 0x7fad6019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.739+0000 7fad5f7fe640 1 -- 172.21.15.7:0/2099979297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad60108cf0 msgr2=0x7fad6019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.739+0000 7fad5f7fe640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad60108cf0 0x7fad6019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.739+0000 7fad5f7fe640 1 -- 172.21.15.7:0/2099979297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad601a0410 con 0x7fad60102a60 2024-09-21T06:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.739+0000 7fad5f7fe640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad60102a60 0x7fad6019a4a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fad5000b4a0 tx=0x7fad5000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.739+0000 7fad5cff9640 1 -- 172.21.15.7:0/2099979297 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50014070 con 0x7fad60102a60 2024-09-21T06:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.739+0000 7fad5cff9640 1 -- 172.21.15.7:0/2099979297 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad50010ac0 con 0x7fad60102a60 2024-09-21T06:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.739+0000 7fad5cff9640 1 -- 172.21.15.7:0/2099979297 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50017c30 con 0x7fad60102a60 2024-09-21T06:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.739+0000 7fad66015640 1 -- 172.21.15.7:0/2099979297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad601a0700 con 0x7fad60102a60 2024-09-21T06:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.739+0000 7fad66015640 1 -- 172.21.15.7:0/2099979297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad601a6e60 con 0x7fad60102a60 2024-09-21T06:02:53.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.742+0000 7fad6c589740 1 Processor -- start 2024-09-21T06:02:53.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.742+0000 7fad6c589740 1 -- start start 2024-09-21T06:02:53.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.743+0000 7fad6c589740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e626a070 0x55c6e66112c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.743+0000 7fad6c589740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e6611800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.743+0000 7fad6c589740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e6611d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.743+0000 7fad6c589740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c6e6587ea0 con 0x55c6e62411b0 2024-09-21T06:02:53.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.743+0000 7fad6c589740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c6e65772d0 con 0x55c6e626a070 2024-09-21T06:02:53.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.743+0000 7fad6c589740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c6e657b0e0 con 0x55c6e6249390 2024-09-21T06:02:53.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.743+0000 7fad5cff9640 1 -- 172.21.15.7:0/2099979297 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fad50017070 con 0x7fad60102a60 2024-09-21T06:02:53.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.743+0000 7fad5ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e626a070 0x55c6e66112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.743+0000 7fad5effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e6611d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.743+0000 7fad5f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e6611800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.743+0000 7fad5ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e626a070 0x55c6e66112c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:39842/0 (socket says 172.21.15.7:39842) 2024-09-21T06:02:53.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.743+0000 7fad5ffff640 1 -- 172.21.15.7:0/1981693382 learned_addr learned my addr 172.21.15.7:0/1981693382 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.744+0000 7fad5ffff640 1 -- 172.21.15.7:0/1981693382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 msgr2=0x55c6e6611d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.744+0000 7fad5ffff640 1 --2- 172.21.15.7:0/1981693382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e6611d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.744+0000 7fad5ffff640 1 -- 172.21.15.7:0/1981693382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 msgr2=0x55c6e6611800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.744+0000 7fad5ffff640 1 --2- 172.21.15.7:0/1981693382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e6611800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.744+0000 7fad5ffff640 1 -- 172.21.15.7:0/1981693382 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6e62d5650 con 0x55c6e626a070 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.744+0000 7fad5effd640 1 --2- 172.21.15.7:0/1981693382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e6611d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.744+0000 7fad5ffff640 1 --2- 172.21.15.7:0/1981693382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e626a070 0x55c6e66112c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fad58009920 tx=0x7fad58009950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a84d206c1dfbee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.744+0000 7fad45ffb640 1 -- 172.21.15.7:0/1981693382 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad58031e30 con 0x55c6e626a070 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.744+0000 7fad5cff9640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fad480b6700 0x7fad480b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.744+0000 7fad45ffb640 1 -- 172.21.15.7:0/1981693382 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad58036030 con 0x55c6e626a070 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.744+0000 7fad45ffb640 1 -- 172.21.15.7:0/1981693382 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad580042a0 con 0x55c6e626a070 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.744+0000 7fad5f7fe640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fad480b6700 0x7fad480b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.744+0000 7fad5cff9640 1 -- 172.21.15.7:0/2099979297 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fad500e6b10 con 0x7fad60102a60 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.745+0000 7fad6c589740 1 -- 172.21.15.7:0/1981693382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e626a070 msgr2=0x55c6e66112c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.745+0000 7fad6c589740 1 --2- 172.21.15.7:0/1981693382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e626a070 0x55c6e66112c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fad58009920 tx=0x7fad58009950 comp rx=0 tx=0).stop 2024-09-21T06:02:53.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.745+0000 7fad5f7fe640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fad480b6700 0x7fad480b8c10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fad500e4360 tx=0x7fad50010f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:53.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.745+0000 7fad6c589740 1 -- 172.21.15.7:0/1981693382 shutdown_connections 2024-09-21T06:02:53.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.745+0000 7fad6c589740 1 --2- 172.21.15.7:0/1981693382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e6611800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.745+0000 7fad6c589740 1 --2- 172.21.15.7:0/1981693382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e6611d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.745+0000 7fad6c589740 1 --2- 172.21.15.7:0/1981693382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e626a070 0x55c6e66112c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.745+0000 7fad6c589740 1 -- 172.21.15.7:0/1981693382 >> 172.21.15.7:0/1981693382 conn(0x55c6e625e460 msgr2=0x55c6e660f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:53.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.745+0000 7fad6c589740 1 -- 172.21.15.7:0/1981693382 shutdown_connections 2024-09-21T06:02:53.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.745+0000 7fad6c589740 1 -- 172.21.15.7:0/1981693382 wait complete. 2024-09-21T06:02:53.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.746+0000 7fad6c589740 1 -- start start 2024-09-21T06:02:53.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.746+0000 7fad6c589740 1 Processor -- start 2024-09-21T06:02:53.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.746+0000 7fad6c589740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e661ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.746+0000 7fad6c589740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e661cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.746+0000 7fad6c589740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e626a070 0x55c6e6628bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.746+0000 7fad6c589740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c6e63d8700 con 0x55c6e62411b0 2024-09-21T06:02:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.746+0000 7fad6c589740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55c6e6512160 con 0x55c6e626a070 2024-09-21T06:02:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.746+0000 7fad6c589740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c6e661f8c0 con 0x55c6e6249390 2024-09-21T06:02:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.746+0000 7fad6c589740 10 client.0 _ll_register_callbacks cb 0x55c6e652b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e661ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e661ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60224/0 (socket says 172.21.15.7:60224) 2024-09-21T06:02:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad5ffff640 1 -- 172.21.15.7:0/2284482863 learned_addr learned my addr 172.21.15.7:0/2284482863 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad5effd640 1 --2- 172.21.15.7:0/2284482863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e661cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad5ffff640 1 --2- 172.21.15.7:0/2284482863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e626a070 0x55c6e6628bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad5ffff640 1 -- 172.21.15.7:0/2284482863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 msgr2=0x55c6e661cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad5ffff640 1 --2- 172.21.15.7:0/2284482863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e661cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad5ffff640 1 -- 172.21.15.7:0/2284482863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e626a070 msgr2=0x55c6e6628bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad5ffff640 1 --2- 172.21.15.7:0/2284482863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e626a070 0x55c6e6628bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad5ffff640 1 -- 172.21.15.7:0/2284482863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6e653fc90 con 0x55c6e62411b0 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad5ffff640 1 --2- 172.21.15.7:0/2284482863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e661ca30 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fad58009bf0 tx=0x7fad58003e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9228833ffae211f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad3effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad3effd640 1 -- 172.21.15.7:0/2284482863 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad58058060 con 0x55c6e62411b0 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad3effd640 1 -- 172.21.15.7:0/2284482863 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fad58031860 con 0x55c6e62411b0 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.747+0000 7fad6c589740 1 -- 172.21.15.7:0/2284482863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad58036030 con 0x55c6e62411b0 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.748+0000 7fad3effd640 1 -- 172.21.15.7:0/2284482863 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad5804b070 con 0x55c6e62411b0 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.748+0000 7fad6c589740 10 client.18012 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.748+0000 7fad6c589740 1 -- 172.21.15.7:0/2284482863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c6e662b5a0 con 0x55c6e62411b0 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.748+0000 7fad3effd640 1 -- 172.21.15.7:0/2284482863 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad58036030 con 0x55c6e62411b0 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.748+0000 7fad3effd640 1 -- 172.21.15.7:0/2284482863 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fad58050070 con 0x55c6e62411b0 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.748+0000 7fad6c589740 10 client.18012 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:53.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.748+0000 7fad6c589740 10 client.18012 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.748+0000 7fad6c589740 20 client.18012 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.748+0000 7fad6c589740 1 --2- 172.21.15.7:0/2284482863 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c6e62289f0 0x55c6e662e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.748+0000 7fad6c589740 4 client.18012 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:02:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.748+0000 7fad6c589740 1 -- 172.21.15.7:0/2284482863 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6e6589df0 con 0x55c6e62289f0 2024-09-21T06:02:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.748+0000 7fad5effd640 1 --2- 172.21.15.7:0/2284482863 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c6e62289f0 0x55c6e662e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.749+0000 7fad3effd640 10 client.18012 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.749+0000 7fad5effd640 1 --2- 172.21.15.7:0/2284482863 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c6e62289f0 0x55c6e662e900 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5d1ba5900fec421 server_cookie=8b9b2a724194f5b2 in_seq=0 out_seq=0 2024-09-21T06:02:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad3effd640 1 -- 172.21.15.7:0/2284482863 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c6e6589df0 con 0x55c6e62289f0 2024-09-21T06:02:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad3effd640 10 client.18012 handle_command_reply: tid=0 2024-09-21T06:02:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad6c589740 1 client.18012 shutdown 2024-09-21T06:02:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad6c589740 1 -- 172.21.15.7:0/2284482863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 msgr2=0x55c6e661ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad6c589740 1 --2- 172.21.15.7:0/2284482863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e661ca30 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fad58009bf0 tx=0x7fad58003e50 comp rx=0 tx=0).stop 2024-09-21T06:02:53.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad6c589740 1 -- 172.21.15.7:0/2284482863 shutdown_connections 2024-09-21T06:02:53.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad6c589740 1 --2- 172.21.15.7:0/2284482863 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c6e62289f0 0x55c6e662e900 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad6c589740 1 --2- 172.21.15.7:0/2284482863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e626a070 0x55c6e6628bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad6c589740 1 --2- 172.21.15.7:0/2284482863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e661cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad6c589740 1 --2- 172.21.15.7:0/2284482863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e661ca30 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad6c589740 1 -- 172.21.15.7:0/2284482863 >> 172.21.15.7:0/2284482863 conn(0x55c6e625e460 msgr2=0x55c6e66144a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:53.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad3effd640 0 client.18012 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:53.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad6c589740 1 -- 172.21.15.7:0/2284482863 shutdown_connections 2024-09-21T06:02:53.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad6c589740 1 -- 172.21.15.7:0/2284482863 wait complete. 2024-09-21T06:02:53.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.750+0000 7fad6c589740 20 client.18012 trim_cache size 0 max 16384 2024-09-21T06:02:53.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.763+0000 7fad6c589740 1 Processor -- start 2024-09-21T06:02:53.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.763+0000 7fad6c589740 1 -- start start 2024-09-21T06:02:53.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad6c589740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e62411b0 0x55c6e6628b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad6c589740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e661e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad6c589740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e626a070 0x55c6e6619c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad6c589740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad601b1e90 con 0x55c6e626a070 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad6c589740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fad601af760 con 0x55c6e62411b0 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad6c589740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fad601ad5d0 con 0x55c6e6249390 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e626a070 0x55c6e6619c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e626a070 0x55c6e6619c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60240/0 (socket says 172.21.15.7:60240) 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad5ffff640 1 -- 172.21.15.7:0/408223177 learned_addr learned my addr 172.21.15.7:0/408223177 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad5effd640 1 --2- 172.21.15.7:0/408223177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e661e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad5ffff640 1 --2- 172.21.15.7:0/408223177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e62411b0 0x55c6e6628b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad5ffff640 1 -- 172.21.15.7:0/408223177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 msgr2=0x55c6e661e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad5ffff640 1 --2- 172.21.15.7:0/408223177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e661e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad5ffff640 1 -- 172.21.15.7:0/408223177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e62411b0 msgr2=0x55c6e6628b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad5ffff640 1 --2- 172.21.15.7:0/408223177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e62411b0 0x55c6e6628b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad5ffff640 1 -- 172.21.15.7:0/408223177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6e660faa0 con 0x55c6e626a070 2024-09-21T06:02:53.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad5effd640 1 --2- 172.21.15.7:0/408223177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e661e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:53.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad5ffff640 1 --2- 172.21.15.7:0/408223177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e626a070 0x55c6e6619c20 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fad5802fa00 tx=0x7fad5802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503b82a5a5100ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:53.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.764+0000 7fad457fa640 1 -- 172.21.15.7:0/408223177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad58058030 con 0x55c6e626a070 2024-09-21T06:02:53.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.765+0000 7fad457fa640 1 -- 172.21.15.7:0/408223177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad58036040 con 0x55c6e626a070 2024-09-21T06:02:53.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.765+0000 7fad457fa640 1 -- 172.21.15.7:0/408223177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5802f770 con 0x55c6e626a070 2024-09-21T06:02:53.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.765+0000 7fad6c589740 1 -- 172.21.15.7:0/408223177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e626a070 msgr2=0x55c6e6619c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:53.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.765+0000 7fad6c589740 1 --2- 172.21.15.7:0/408223177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e626a070 0x55c6e6619c20 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fad5802fa00 tx=0x7fad5802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.765+0000 7fad6c589740 1 -- 172.21.15.7:0/408223177 shutdown_connections 2024-09-21T06:02:53.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.765+0000 7fad6c589740 1 --2- 172.21.15.7:0/408223177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e626a070 0x55c6e6619c20 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.765+0000 7fad6c589740 1 --2- 172.21.15.7:0/408223177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e6249390 0x55c6e661e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.765+0000 7fad6c589740 1 --2- 172.21.15.7:0/408223177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e62411b0 0x55c6e6628b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.765+0000 7fad6c589740 1 -- 172.21.15.7:0/408223177 >> 172.21.15.7:0/408223177 conn(0x55c6e625e460 msgr2=0x55c6e661df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:53.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.765+0000 7fad6c589740 1 -- 172.21.15.7:0/408223177 shutdown_connections 2024-09-21T06:02:53.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.765+0000 7fad6c589740 1 -- 172.21.15.7:0/408223177 wait complete. 2024-09-21T06:02:53.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.766+0000 7fad6c589740 1 -- start start 2024-09-21T06:02:53.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.766+0000 7fad6c589740 1 Processor -- start 2024-09-21T06:02:53.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.766+0000 7fad6c589740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e6630360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.766+0000 7fad6c589740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e6249390 0x55c6e6630900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.766+0000 7fad6c589740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e626a070 0x55c6e66920c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.766+0000 7fad6c589740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad601adc20 con 0x55c6e62411b0 2024-09-21T06:02:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.766+0000 7fad6c589740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fad601af090 con 0x55c6e6249390 2024-09-21T06:02:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.766+0000 7fad6c589740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fad601ae2f0 con 0x55c6e626a070 2024-09-21T06:02:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.766+0000 7fad6c589740 10 client.0 _ll_register_callbacks cb 0x7fad500ea530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.766+0000 7fad5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e6630360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.766+0000 7fad5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e6630360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60252/0 (socket says 172.21.15.7:60252) 2024-09-21T06:02:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.766+0000 7fad5ffff640 1 -- 172.21.15.7:0/2560604753 learned_addr learned my addr 172.21.15.7:0/2560604753 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad5effd640 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e6249390 0x55c6e6630900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad5ffff640 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e626a070 0x55c6e66920c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad5ffff640 1 -- 172.21.15.7:0/2560604753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e626a070 msgr2=0x55c6e66920c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad5ffff640 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e626a070 0x55c6e66920c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad5ffff640 1 -- 172.21.15.7:0/2560604753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e6249390 msgr2=0x55c6e6630900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad5ffff640 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e6249390 0x55c6e6630900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad5ffff640 1 -- 172.21.15.7:0/2560604753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6e6692730 con 0x55c6e62411b0 2024-09-21T06:02:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad5effd640 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e6249390 0x55c6e6630900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:02:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad5ffff640 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e6630360 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fad5803f040 tx=0x7fad5802ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4273b8f671989 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad3effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad3effd640 1 -- 172.21.15.7:0/2560604753 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad58003b80 con 0x55c6e62411b0 2024-09-21T06:02:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad3effd640 1 -- 172.21.15.7:0/2560604753 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fad58004d40 con 0x55c6e62411b0 2024-09-21T06:02:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad6c589740 1 -- 172.21.15.7:0/2560604753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad58036040 con 0x55c6e62411b0 2024-09-21T06:02:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad3effd640 1 -- 172.21.15.7:0/2560604753 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad58004000 con 0x55c6e62411b0 2024-09-21T06:02:53.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad6c589740 10 client.18018 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:53.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.767+0000 7fad6c589740 1 -- 172.21.15.7:0/2560604753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c6e6699b20 con 0x55c6e62411b0 2024-09-21T06:02:53.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.768+0000 7fad3effd640 1 -- 172.21.15.7:0/2560604753 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad58036040 con 0x55c6e62411b0 2024-09-21T06:02:53.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.768+0000 7fad3effd640 1 -- 172.21.15.7:0/2560604753 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fad58050070 con 0x55c6e62411b0 2024-09-21T06:02:53.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.768+0000 7fad6c589740 10 client.18018 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:53.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.768+0000 7fad6c589740 10 client.18018 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:53.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.768+0000 7fad6c589740 20 client.18018 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:53.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.768+0000 7fad6c589740 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c6e61fdda0 0x55c6e669c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:53.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.768+0000 7fad6c589740 4 client.18018 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:02:53.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.768+0000 7fad6c589740 1 -- 172.21.15.7:0/2560604753 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c6e65858a0 con 0x55c6e61fdda0 2024-09-21T06:02:53.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.768+0000 7fad5effd640 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c6e61fdda0 0x55c6e669c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:53.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad5effd640 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c6e61fdda0 0x55c6e669c170 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6121e2066ab2570 server_cookie=7103b642915872e4 in_seq=0 out_seq=0 2024-09-21T06:02:53.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad3effd640 10 client.18018 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad3effd640 1 -- 172.21.15.7:0/2560604753 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c6e65858a0 con 0x55c6e61fdda0 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad3effd640 10 client.18018 handle_command_reply: tid=0 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad6c589740 1 client.18018 shutdown 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad6c589740 1 -- 172.21.15.7:0/2560604753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 msgr2=0x55c6e6630360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad6c589740 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e6630360 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fad5803f040 tx=0x7fad5802ff00 comp rx=0 tx=0).stop 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad6c589740 1 -- 172.21.15.7:0/2560604753 shutdown_connections 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad6c589740 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55c6e61fdda0 0x55c6e669c170 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad6c589740 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6e626a070 0x55c6e66920c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad6c589740 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c6e6249390 0x55c6e6630900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad6c589740 1 --2- 172.21.15.7:0/2560604753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6e62411b0 0x55c6e6630360 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad3effd640 0 client.18018 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.769+0000 7fad6c589740 1 -- 172.21.15.7:0/2560604753 >> 172.21.15.7:0/2560604753 conn(0x55c6e625e460 msgr2=0x55c6e6614b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.770+0000 7fad6c589740 1 -- 172.21.15.7:0/2560604753 shutdown_connections 2024-09-21T06:02:53.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.770+0000 7fad6c589740 1 -- 172.21.15.7:0/2560604753 wait complete. 2024-09-21T06:02:53.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.770+0000 7fad6c589740 20 client.18018 trim_cache size 0 max 16384 2024-09-21T06:02:53.777 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:02:53.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.770+0000 7fad66015640 1 -- 172.21.15.7:0/2099979297 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fad480b6700 msgr2=0x7fad480b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:53.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.770+0000 7fad66015640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fad480b6700 0x7fad480b8c10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fad500e4360 tx=0x7fad50010f90 comp rx=0 tx=0).stop 2024-09-21T06:02:53.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.770+0000 7fad66015640 1 -- 172.21.15.7:0/2099979297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad60102a60 msgr2=0x7fad6019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:53.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.770+0000 7fad66015640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad60102a60 0x7fad6019a4a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fad5000b4a0 tx=0x7fad5000b960 comp rx=0 tx=0).stop 2024-09-21T06:02:53.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.770+0000 7fad66015640 1 -- 172.21.15.7:0/2099979297 shutdown_connections 2024-09-21T06:02:53.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.770+0000 7fad66015640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fad480b6700 0x7fad480b8c10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.770+0000 7fad66015640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad60108cf0 0x7fad6019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.770+0000 7fad66015640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad601083a0 0x7fad6019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.770+0000 7fad66015640 1 --2- 172.21.15.7:0/2099979297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad60102a60 0x7fad6019a4a0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:53.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.770+0000 7fad66015640 1 -- 172.21.15.7:0/2099979297 >> 172.21.15.7:0/2099979297 conn(0x7fad60079730 msgr2=0x7fad6006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:53.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.771+0000 7fad66015640 1 -- 172.21.15.7:0/2099979297 shutdown_connections 2024-09-21T06:02:53.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:53.771+0000 7fad66015640 1 -- 172.21.15.7:0/2099979297 wait complete. 2024-09-21T06:02:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:53 smithi007 ceph-mon[30983]: pgmap v594: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:02:54.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:53 smithi027 ceph-mon[34364]: pgmap v594: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:02:54.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:53 smithi119 ceph-mon[34833]: pgmap v594: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:02:55.604 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:02:55.605 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:02:55.879 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:56.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:55 smithi027 ceph-mon[34364]: pgmap v595: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:02:56.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:55 smithi007 ceph-mon[30983]: pgmap v595: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:02:56.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:55 smithi119 ceph-mon[34833]: pgmap v595: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:02:56.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.340+0000 7f8c0b255640 1 -- 172.21.15.7:0/3382916386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c041094c0 msgr2=0x7f8c041098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:56.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.340+0000 7f8c0b255640 1 --2- 172.21.15.7:0/3382916386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c041094c0 0x7f8c041098d0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009ca0 tx=0x7f8bf402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.341+0000 7f8c0b255640 1 -- 172.21.15.7:0/3382916386 shutdown_connections 2024-09-21T06:02:56.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.341+0000 7f8c0b255640 1 --2- 172.21.15.7:0/3382916386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c041094c0 0x7f8c041098d0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.341+0000 7f8c0b255640 1 --2- 172.21.15.7:0/3382916386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c04109e10 0x7f8c04110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.341+0000 7f8c0b255640 1 --2- 172.21.15.7:0/3382916386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c04103b80 0x7f8c04103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.341+0000 7f8c0b255640 1 -- 172.21.15.7:0/3382916386 >> 172.21.15.7:0/3382916386 conn(0x7f8c040ff610 msgr2=0x7f8c04101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:56.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.341+0000 7f8c0b255640 1 -- 172.21.15.7:0/3382916386 shutdown_connections 2024-09-21T06:02:56.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.341+0000 7f8c0b255640 1 -- 172.21.15.7:0/3382916386 wait complete. 2024-09-21T06:02:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.341+0000 7f8c0b255640 1 Processor -- start 2024-09-21T06:02:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c0b255640 1 -- start start 2024-09-21T06:02:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c0b255640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c04103b80 0x7f8c0419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c0b255640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c041094c0 0x7f8c0419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c0b255640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04109e10 0x7f8c0419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c0b255640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8c04113ad0 con 0x7f8c04109e10 2024-09-21T06:02:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c0b255640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8c04113950 con 0x7f8c04103b80 2024-09-21T06:02:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c0b255640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8c04113c50 con 0x7f8c041094c0 2024-09-21T06:02:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c097f2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04109e10 0x7f8c0419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c097f2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04109e10 0x7f8c0419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60266/0 (socket says 172.21.15.7:60266) 2024-09-21T06:02:56.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c097f2640 1 -- 172.21.15.7:0/1578665757 learned_addr learned my addr 172.21.15.7:0/1578665757 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c08ff1640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c04103b80 0x7f8c0419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c03fff640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c041094c0 0x7f8c0419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c097f2640 1 -- 172.21.15.7:0/1578665757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c041094c0 msgr2=0x7f8c0419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c097f2640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c041094c0 0x7f8c0419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c097f2640 1 -- 172.21.15.7:0/1578665757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c04103b80 msgr2=0x7f8c0419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c097f2640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c04103b80 0x7f8c0419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c097f2640 1 -- 172.21.15.7:0/1578665757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c041a0430 con 0x7f8c04109e10 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.342+0000 7f8c03fff640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c041094c0 0x7f8c0419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.343+0000 7f8c097f2640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04109e10 0x7f8c0419fd00 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00e970 tx=0x7f8bfc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.343+0000 7f8c01ffb640 1 -- 172.21.15.7:0/1578665757 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc00ccc0 con 0x7f8c04109e10 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.343+0000 7f8c01ffb640 1 -- 172.21.15.7:0/1578665757 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bfc00ce60 con 0x7f8c04109e10 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.343+0000 7f8c0b255640 1 -- 172.21.15.7:0/1578665757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c041a0720 con 0x7f8c04109e10 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.343+0000 7f8c01ffb640 1 -- 172.21.15.7:0/1578665757 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc010430 con 0x7f8c04109e10 2024-09-21T06:02:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.343+0000 7f8c0b255640 1 -- 172.21.15.7:0/1578665757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c041a6e80 con 0x7f8c04109e10 2024-09-21T06:02:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.346+0000 7f8c117c9740 1 Processor -- start 2024-09-21T06:02:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.346+0000 7f8c01ffb640 1 -- 172.21.15.7:0/1578665757 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8bfc004ff0 con 0x7f8c04109e10 2024-09-21T06:02:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.346+0000 7f8c117c9740 1 -- start start 2024-09-21T06:02:56.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.346+0000 7f8c117c9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x557857ff8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.346+0000 7f8c117c9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 0x557857ff8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.346+0000 7f8c117c9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c30670 0x557857ff8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.346+0000 7f8c117c9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557857f6ee60 con 0x557857c28490 2024-09-21T06:02:56.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.346+0000 7f8c117c9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x557857f5e290 con 0x557857c51350 2024-09-21T06:02:56.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.346+0000 7f8c117c9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557857f620a0 con 0x557857c30670 2024-09-21T06:02:56.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.346+0000 7f8c08ff1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 0x557857ff8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.346+0000 7f8c08ff1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 0x557857ff8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60272/0 (socket says 172.21.15.7:60272) 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.346+0000 7f8c08ff1640 1 -- 172.21.15.7:0/3514069555 learned_addr learned my addr 172.21.15.7:0/3514069555 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8c03fff640 1 --2- 172.21.15.7:0/3514069555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x557857ff8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8c03fff640 1 --2- 172.21.15.7:0/3514069555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c30670 0x557857ff8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8c08ff1640 1 -- 172.21.15.7:0/3514069555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c30670 msgr2=0x557857ff8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8c08ff1640 1 --2- 172.21.15.7:0/3514069555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c30670 0x557857ff8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8c08ff1640 1 -- 172.21.15.7:0/3514069555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 msgr2=0x557857ff8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8c08ff1640 1 --2- 172.21.15.7:0/3514069555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x557857ff8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8c01ffb640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8bf00b6700 0x7f8bf00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8c08ff1640 1 -- 172.21.15.7:0/3514069555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557857cbc930 con 0x557857c28490 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8c03fff640 1 --2- 172.21.15.7:0/3514069555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x557857ff8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8c03fff640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8bf00b6700 0x7f8bf00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8c01ffb640 1 -- 172.21.15.7:0/1578665757 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f8bfc0e7bb0 con 0x7f8c04109e10 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8c08ff1640 1 --2- 172.21.15.7:0/3514069555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 0x557857ff8970 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00bcf0 tx=0x7f8bec00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdded9efec167f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:56.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8bfaffd640 1 -- 172.21.15.7:0/3514069555 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec015070 con 0x557857c28490 2024-09-21T06:02:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8bfaffd640 1 -- 172.21.15.7:0/3514069555 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bec01a910 con 0x557857c28490 2024-09-21T06:02:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.347+0000 7f8bfaffd640 1 -- 172.21.15.7:0/3514069555 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec011900 con 0x557857c28490 2024-09-21T06:02:56.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.348+0000 7f8c117c9740 1 -- 172.21.15.7:0/3514069555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 msgr2=0x557857ff8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:56.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.348+0000 7f8c03fff640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8bf00b6700 0x7f8bf00b8c10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4004af0 tx=0x7f8bf4000f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.348+0000 7f8c117c9740 1 --2- 172.21.15.7:0/3514069555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 0x557857ff8970 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00bcf0 tx=0x7f8bec00f730 comp rx=0 tx=0).stop 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.348+0000 7f8c117c9740 1 -- 172.21.15.7:0/3514069555 shutdown_connections 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.348+0000 7f8c117c9740 1 --2- 172.21.15.7:0/3514069555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 0x557857ff8970 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.348+0000 7f8c117c9740 1 --2- 172.21.15.7:0/3514069555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c30670 0x557857ff8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.348+0000 7f8c117c9740 1 --2- 172.21.15.7:0/3514069555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x557857ff8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.348+0000 7f8c117c9740 1 -- 172.21.15.7:0/3514069555 >> 172.21.15.7:0/3514069555 conn(0x557857c45740 msgr2=0x557857ff6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.348+0000 7f8c117c9740 1 -- 172.21.15.7:0/3514069555 shutdown_connections 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.348+0000 7f8c117c9740 1 -- 172.21.15.7:0/3514069555 wait complete. 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.349+0000 7f8c117c9740 1 -- start start 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.349+0000 7f8c117c9740 1 Processor -- start 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.349+0000 7f8c117c9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 0x557858003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.349+0000 7f8c117c9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c30670 0x557858004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.349+0000 7f8c117c9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x55785800ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.349+0000 7f8c117c9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557857dbf890 con 0x557857c28490 2024-09-21T06:02:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.349+0000 7f8c117c9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x557857ef8d40 con 0x557857c51350 2024-09-21T06:02:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.349+0000 7f8c117c9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557858006c10 con 0x557857c30670 2024-09-21T06:02:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8c08ff1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 0x557858003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.349+0000 7f8c117c9740 10 client.0 _ll_register_callbacks cb 0x557857f5cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8c08ff1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 0x557858003ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60276/0 (socket says 172.21.15.7:60276) 2024-09-21T06:02:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8c08ff1640 1 -- 172.21.15.7:0/2120537472 learned_addr learned my addr 172.21.15.7:0/2120537472 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8c03fff640 1 --2- 172.21.15.7:0/2120537472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c30670 0x557858004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8c097f2640 1 --2- 172.21.15.7:0/2120537472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x55785800ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8c08ff1640 1 -- 172.21.15.7:0/2120537472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c30670 msgr2=0x557858004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8c08ff1640 1 --2- 172.21.15.7:0/2120537472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c30670 0x557858004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8c08ff1640 1 -- 172.21.15.7:0/2120537472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 msgr2=0x55785800ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8c08ff1640 1 --2- 172.21.15.7:0/2120537472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x55785800ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8c08ff1640 1 -- 172.21.15.7:0/2120537472 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578580104c0 con 0x557857c28490 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8c08ff1640 1 --2- 172.21.15.7:0/2120537472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 0x557858003ff0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0115e0 tx=0x7f8bec01a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82d1161cceef670 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8be3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8be3fff640 1 -- 172.21.15.7:0/2120537472 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec028060 con 0x557857c28490 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8be3fff640 1 -- 172.21.15.7:0/2120537472 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f8bec005040 con 0x557857c28490 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.350+0000 7f8c117c9740 1 -- 172.21.15.7:0/2120537472 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bec01a910 con 0x557857c28490 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.351+0000 7f8be3fff640 1 -- 172.21.15.7:0/2120537472 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8bec015040 con 0x557857c28490 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.351+0000 7f8c117c9740 10 client.18030 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.351+0000 7f8c117c9740 1 -- 172.21.15.7:0/2120537472 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557858012d60 con 0x557857c28490 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.351+0000 7f8be3fff640 1 -- 172.21.15.7:0/2120537472 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bec01a910 con 0x557857c28490 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.351+0000 7f8be3fff640 1 -- 172.21.15.7:0/2120537472 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8bec022030 con 0x557857c28490 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.351+0000 7f8c117c9740 10 client.18030 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.351+0000 7f8c117c9740 10 client.18030 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.351+0000 7f8c117c9740 20 client.18030 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:56.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.351+0000 7f8c117c9740 1 --2- 172.21.15.7:0/2120537472 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557857c0fcd0 0x557858016170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.351+0000 7f8c117c9740 4 client.18030 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:02:56.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.351+0000 7f8c117c9740 1 -- 172.21.15.7:0/2120537472 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557857f70db0 con 0x557857c0fcd0 2024-09-21T06:02:56.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.351+0000 7f8c03fff640 1 --2- 172.21.15.7:0/2120537472 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557857c0fcd0 0x557858016170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.352+0000 7f8c03fff640 1 --2- 172.21.15.7:0/2120537472 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557857c0fcd0 0x557858016170 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0a9a4542023e2ce server_cookie=fe98c04942910909 in_seq=0 out_seq=0 2024-09-21T06:02:56.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.352+0000 7f8be3fff640 10 client.18030 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8be3fff640 1 -- 172.21.15.7:0/2120537472 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557857f70db0 con 0x557857c0fcd0 2024-09-21T06:02:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8be3fff640 10 client.18030 handle_command_reply: tid=0 2024-09-21T06:02:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8c117c9740 1 client.18030 shutdown 2024-09-21T06:02:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8c117c9740 1 -- 172.21.15.7:0/2120537472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 msgr2=0x557858003ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8c117c9740 1 --2- 172.21.15.7:0/2120537472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 0x557858003ff0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0115e0 tx=0x7f8bec01a690 comp rx=0 tx=0).stop 2024-09-21T06:02:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8c117c9740 1 -- 172.21.15.7:0/2120537472 shutdown_connections 2024-09-21T06:02:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8c117c9740 1 --2- 172.21.15.7:0/2120537472 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557857c0fcd0 0x557858016170 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8c117c9740 1 --2- 172.21.15.7:0/2120537472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x55785800ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8c117c9740 1 --2- 172.21.15.7:0/2120537472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c30670 0x557858004530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8c117c9740 1 --2- 172.21.15.7:0/2120537472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c28490 0x557858003ff0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8c117c9740 1 -- 172.21.15.7:0/2120537472 >> 172.21.15.7:0/2120537472 conn(0x557857c45740 msgr2=0x557857ffb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:56.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8be3fff640 0 client.18030 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:56.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8c117c9740 1 -- 172.21.15.7:0/2120537472 shutdown_connections 2024-09-21T06:02:56.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8c117c9740 1 -- 172.21.15.7:0/2120537472 wait complete. 2024-09-21T06:02:56.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.353+0000 7f8c117c9740 20 client.18030 trim_cache size 0 max 16384 2024-09-21T06:02:56.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.371+0000 7f8c117c9740 1 Processor -- start 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.371+0000 7f8c117c9740 1 -- start start 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.371+0000 7f8c117c9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c28490 0x557857ffe550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.371+0000 7f8c117c9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 0x557857ff9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.371+0000 7f8c117c9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x557858000fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.371+0000 7f8c117c9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8c041b1f50 con 0x557857c30670 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.371+0000 7f8c117c9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8c041af820 con 0x557857c51350 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.371+0000 7f8c117c9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8c041ad690 con 0x557857c28490 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.371+0000 7f8c03fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 0x557857ff9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.371+0000 7f8c03fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 0x557857ff9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60282/0 (socket says 172.21.15.7:60282) 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.371+0000 7f8c03fff640 1 -- 172.21.15.7:0/2531296405 learned_addr learned my addr 172.21.15.7:0/2531296405 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.371+0000 7f8c08ff1640 1 --2- 172.21.15.7:0/2531296405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c28490 0x557857ffe550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.371+0000 7f8c097f2640 1 --2- 172.21.15.7:0/2531296405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x557858000fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.372+0000 7f8c03fff640 1 -- 172.21.15.7:0/2531296405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c28490 msgr2=0x557857ffe550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:56.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.372+0000 7f8c03fff640 1 --2- 172.21.15.7:0/2531296405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c28490 0x557857ffe550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.372+0000 7f8c03fff640 1 -- 172.21.15.7:0/2531296405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 msgr2=0x557858000fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.372+0000 7f8c03fff640 1 --2- 172.21.15.7:0/2531296405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x557858000fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.372+0000 7f8c03fff640 1 -- 172.21.15.7:0/2531296405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557858002d50 con 0x557857c30670 2024-09-21T06:02:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.372+0000 7f8c08ff1640 1 --2- 172.21.15.7:0/2531296405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c28490 0x557857ffe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.372+0000 7f8c097f2640 1 --2- 172.21.15.7:0/2531296405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x557858000fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:02:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.372+0000 7f8c03fff640 1 --2- 172.21.15.7:0/2531296405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 0x557857ff9b70 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f8c0406aa90 tx=0x7f8bf403f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e42781502aa383b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.372+0000 7f8bfa7fc640 1 -- 172.21.15.7:0/2531296405 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4031e50 con 0x557857c30670 2024-09-21T06:02:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.372+0000 7f8bfa7fc640 1 -- 172.21.15.7:0/2531296405 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bf4036040 con 0x557857c30670 2024-09-21T06:02:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.372+0000 7f8bfa7fc640 1 -- 172.21.15.7:0/2531296405 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf402f9d0 con 0x557857c30670 2024-09-21T06:02:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.373+0000 7f8c117c9740 1 -- 172.21.15.7:0/2531296405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 msgr2=0x557857ff9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.373+0000 7f8c117c9740 1 --2- 172.21.15.7:0/2531296405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 0x557857ff9b70 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f8c0406aa90 tx=0x7f8bf403f040 comp rx=0 tx=0).stop 2024-09-21T06:02:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.373+0000 7f8c117c9740 1 -- 172.21.15.7:0/2531296405 shutdown_connections 2024-09-21T06:02:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.373+0000 7f8c117c9740 1 --2- 172.21.15.7:0/2531296405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 0x557857ff9b70 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.373+0000 7f8c117c9740 1 --2- 172.21.15.7:0/2531296405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c51350 0x557858000fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.373+0000 7f8c117c9740 1 --2- 172.21.15.7:0/2531296405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c28490 0x557857ffe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.373+0000 7f8c117c9740 1 -- 172.21.15.7:0/2531296405 >> 172.21.15.7:0/2531296405 conn(0x557857c45740 msgr2=0x557857ff9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.373+0000 7f8c117c9740 1 -- 172.21.15.7:0/2531296405 shutdown_connections 2024-09-21T06:02:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.373+0000 7f8c117c9740 1 -- 172.21.15.7:0/2531296405 wait complete. 2024-09-21T06:02:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.373+0000 7f8c117c9740 1 -- start start 2024-09-21T06:02:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.373+0000 7f8c117c9740 1 Processor -- start 2024-09-21T06:02:56.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c117c9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c28490 0x557858017a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c117c9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 0x557858018050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c117c9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c51350 0x5578580798c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c117c9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8c041adce0 con 0x557857c30670 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c117c9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8c041af150 con 0x557857c28490 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c117c9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8c041ae3b0 con 0x557857c51350 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c117c9740 10 client.0 _ll_register_callbacks cb 0x7f8bec00bb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c03fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 0x557858018050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c03fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 0x557858018050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60294/0 (socket says 172.21.15.7:60294) 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c03fff640 1 -- 172.21.15.7:0/820160654 learned_addr learned my addr 172.21.15.7:0/820160654 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c097f2640 1 --2- 172.21.15.7:0/820160654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c51350 0x5578580798c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c08ff1640 1 --2- 172.21.15.7:0/820160654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c28490 0x557858017a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c03fff640 1 -- 172.21.15.7:0/820160654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c51350 msgr2=0x5578580798c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c03fff640 1 --2- 172.21.15.7:0/820160654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c51350 0x5578580798c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c03fff640 1 -- 172.21.15.7:0/820160654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c28490 msgr2=0x557858017a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c03fff640 1 --2- 172.21.15.7:0/820160654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c28490 0x557858017a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c03fff640 1 -- 172.21.15.7:0/820160654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557858079f30 con 0x557857c30670 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8c03fff640 1 --2- 172.21.15.7:0/820160654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 0x557858018050 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f8bf402f500 tx=0x7f8bf4004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161dfc493cc4e216 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.374+0000 7f8be3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8be3fff640 1 -- 172.21.15.7:0/820160654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4004b40 con 0x557857c30670 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8be3fff640 1 -- 172.21.15.7:0/820160654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f8bf4004ce0 con 0x557857c30670 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8c117c9740 1 -- 172.21.15.7:0/820160654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bf4036040 con 0x557857c30670 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8be3fff640 1 -- 172.21.15.7:0/820160654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8bf4067030 con 0x557857c30670 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8c117c9740 10 client.18036 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8c117c9740 1 -- 172.21.15.7:0/820160654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557858081200 con 0x557857c30670 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8be3fff640 1 -- 172.21.15.7:0/820160654 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bf4036040 con 0x557857c30670 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8be3fff640 1 -- 172.21.15.7:0/820160654 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8bf4044070 con 0x557857c30670 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8c117c9740 10 client.18036 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:56.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8c117c9740 10 client.18036 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:56.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8c117c9740 20 client.18036 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:56.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8c117c9740 1 --2- 172.21.15.7:0/820160654 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557857be5080 0x557858083970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:56.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8c117c9740 4 client.18036 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:02:56.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.375+0000 7f8c117c9740 1 -- 172.21.15.7:0/820160654 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557857f6c860 con 0x557857be5080 2024-09-21T06:02:56.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.376+0000 7f8c08ff1640 1 --2- 172.21.15.7:0/820160654 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557857be5080 0x557858083970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:56.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.376+0000 7f8be3fff640 10 client.18036 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:56.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.376+0000 7f8c08ff1640 1 --2- 172.21.15.7:0/820160654 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557857be5080 0x557858083970 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cbe2c645fb20ac0 server_cookie=8988fd5edb433315 in_seq=0 out_seq=0 2024-09-21T06:02:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.378+0000 7f8be3fff640 1 -- 172.21.15.7:0/820160654 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557857f6c860 con 0x557857be5080 2024-09-21T06:02:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.378+0000 7f8be3fff640 10 client.18036 handle_command_reply: tid=0 2024-09-21T06:02:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.378+0000 7f8c117c9740 1 client.18036 shutdown 2024-09-21T06:02:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.378+0000 7f8c117c9740 1 -- 172.21.15.7:0/820160654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 msgr2=0x557858018050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.378+0000 7f8c117c9740 1 --2- 172.21.15.7:0/820160654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 0x557858018050 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f8bf402f500 tx=0x7f8bf4004850 comp rx=0 tx=0).stop 2024-09-21T06:02:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.378+0000 7f8c117c9740 1 -- 172.21.15.7:0/820160654 shutdown_connections 2024-09-21T06:02:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.378+0000 7f8c117c9740 1 --2- 172.21.15.7:0/820160654 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557857be5080 0x557858083970 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.378+0000 7f8c117c9740 1 --2- 172.21.15.7:0/820160654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557857c30670 0x557858018050 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.378+0000 7f8c117c9740 1 --2- 172.21.15.7:0/820160654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557857c51350 0x5578580798c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.378+0000 7f8be3fff640 0 client.18036 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.378+0000 7f8c117c9740 1 --2- 172.21.15.7:0/820160654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557857c28490 0x557858017a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.379+0000 7f8c117c9740 1 -- 172.21.15.7:0/820160654 >> 172.21.15.7:0/820160654 conn(0x557857c45740 msgr2=0x557857ff4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.379+0000 7f8c117c9740 1 -- 172.21.15.7:0/820160654 shutdown_connections 2024-09-21T06:02:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.379+0000 7f8c117c9740 1 -- 172.21.15.7:0/820160654 wait complete. 2024-09-21T06:02:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.379+0000 7f8c117c9740 20 client.18036 trim_cache size 0 max 16384 2024-09-21T06:02:56.383 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:02:56.383 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:02:56.383 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "1d89aa12-56bd-49e8-bbd4-0309b4e70f2a", 2024-09-21T06:02:56.383 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:02:56.383 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:02:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.380+0000 7f8c0b255640 1 -- 172.21.15.7:0/1578665757 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8bf00b6700 msgr2=0x7f8bf00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.380+0000 7f8c0b255640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8bf00b6700 0x7f8bf00b8c10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4004af0 tx=0x7f8bf4000f40 comp rx=0 tx=0).stop 2024-09-21T06:02:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.380+0000 7f8c0b255640 1 -- 172.21.15.7:0/1578665757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04109e10 msgr2=0x7f8c0419fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.380+0000 7f8c0b255640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04109e10 0x7f8c0419fd00 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00e970 tx=0x7f8bfc00ed70 comp rx=0 tx=0).stop 2024-09-21T06:02:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.380+0000 7f8c0b255640 1 -- 172.21.15.7:0/1578665757 shutdown_connections 2024-09-21T06:02:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.380+0000 7f8c0b255640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8bf00b6700 0x7f8bf00b8c10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.380+0000 7f8c0b255640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04109e10 0x7f8c0419fd00 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.380+0000 7f8c0b255640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c041094c0 0x7f8c0419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.380+0000 7f8c0b255640 1 --2- 172.21.15.7:0/1578665757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c04103b80 0x7f8c0419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.380+0000 7f8c0b255640 1 -- 172.21.15.7:0/1578665757 >> 172.21.15.7:0/1578665757 conn(0x7f8c040ff610 msgr2=0x7f8c04101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.380+0000 7f8c0b255640 1 -- 172.21.15.7:0/1578665757 shutdown_connections 2024-09-21T06:02:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:56.380+0000 7f8c0b255640 1 -- 172.21.15.7:0/1578665757 wait complete. 2024-09-21T06:02:57.097 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:02:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.829+0000 7f0e0c949640 1 -- 172.21.15.7:0/1566635445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e08102a60 msgr2=0x7f0e08102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.829+0000 7f0e0c949640 1 --2- 172.21.15.7:0/1566635445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e08102a60 0x7f0e08102e70 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009900 tx=0x7f0df802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.829+0000 7f0e0c949640 1 -- 172.21.15.7:0/1566635445 shutdown_connections 2024-09-21T06:02:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.829+0000 7f0e0c949640 1 --2- 172.21.15.7:0/1566635445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e08108cf0 0x7f0e0810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.829+0000 7f0e0c949640 1 --2- 172.21.15.7:0/1566635445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e081083a0 0x7f0e081087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.829+0000 7f0e0c949640 1 --2- 172.21.15.7:0/1566635445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e08102a60 0x7f0e08102e70 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.829+0000 7f0e0c949640 1 -- 172.21.15.7:0/1566635445 >> 172.21.15.7:0/1566635445 conn(0x7f0e08079720 msgr2=0x7f0e08079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.829+0000 7f0e0c949640 1 -- 172.21.15.7:0/1566635445 shutdown_connections 2024-09-21T06:02:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.829+0000 7f0e0c949640 1 -- 172.21.15.7:0/1566635445 wait complete. 2024-09-21T06:02:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.830+0000 7f0e0c949640 1 Processor -- start 2024-09-21T06:02:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.830+0000 7f0e0c949640 1 -- start start 2024-09-21T06:02:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.830+0000 7f0e0c949640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e08102a60 0x7f0e0819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.830+0000 7f0e0c949640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e081083a0 0x7f0e0819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.830+0000 7f0e0c949640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e08108cf0 0x7f0e0819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.830+0000 7f0e0c949640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0e08112960 con 0x7f0e081083a0 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.830+0000 7f0e0c949640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0e081127e0 con 0x7f0e08108cf0 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.830+0000 7f0e0c949640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0e08112ae0 con 0x7f0e08102a60 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.830+0000 7f0e05d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e081083a0 0x7f0e0819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.830+0000 7f0e05d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e081083a0 0x7f0e0819a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60314/0 (socket says 172.21.15.7:60314) 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.830+0000 7f0e05d9b640 1 -- 172.21.15.7:0/4063354754 learned_addr learned my addr 172.21.15.7:0/4063354754 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0e06d9d640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e08108cf0 0x7f0e0819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0e0659c640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e08102a60 0x7f0e0819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0e05d9b640 1 -- 172.21.15.7:0/4063354754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e08102a60 msgr2=0x7f0e0819a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e08102a60 0x7f0e0819a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0e05d9b640 1 -- 172.21.15.7:0/4063354754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e08108cf0 msgr2=0x7f0e0819fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e08108cf0 0x7f0e0819fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0e05d9b640 1 -- 172.21.15.7:0/4063354754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e081a0290 con 0x7f0e081083a0 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0e0659c640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e08102a60 0x7f0e0819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0e06d9d640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e08108cf0 0x7f0e0819fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e081083a0 0x7f0e0819a980 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00ccb0 tx=0x7f0dfc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0df77fe640 1 -- 172.21.15.7:0/4063354754 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc00ce60 con 0x7f0e081083a0 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0df77fe640 1 -- 172.21.15.7:0/4063354754 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dfc00fb00 con 0x7f0e081083a0 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0e0c949640 1 -- 172.21.15.7:0/4063354754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e081a0580 con 0x7f0e081083a0 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0df77fe640 1 -- 172.21.15.7:0/4063354754 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc018bb0 con 0x7f0e081083a0 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.831+0000 7f0e0c949640 1 -- 172.21.15.7:0/4063354754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e081a6da0 con 0x7f0e081083a0 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.835+0000 7f0e12ebd740 1 Processor -- start 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.835+0000 7f0e12ebd740 1 -- start start 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.835+0000 7f0df77fe640 1 -- 172.21.15.7:0/4063354754 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0dfc004b20 con 0x7f0e081083a0 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.835+0000 7f0e12ebd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 0x5654bcb20650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.835+0000 7f0e12ebd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc7501b0 0x5654bcb20b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.835+0000 7f0e12ebd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 0x5654bcb210d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.835+0000 7f0e12ebd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5654bca96e50 con 0x5654bc758390 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.835+0000 7f0e12ebd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5654bca86280 con 0x5654bc779070 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.835+0000 7f0e12ebd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5654bca8a090 con 0x5654bc7501b0 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0e05d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 0x5654bcb210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0e0659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc7501b0 0x5654bcb20b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0e05d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 0x5654bcb210d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60322/0 (socket says 172.21.15.7:60322) 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0e0659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc7501b0 0x5654bcb20b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:38744/0 (socket says 172.21.15.7:38744) 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0e05d9b640 1 -- 172.21.15.7:0/3356444374 learned_addr learned my addr 172.21.15.7:0/3356444374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0e06d9d640 1 --2- 172.21.15.7:0/3356444374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 0x5654bcb20650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0e05d9b640 1 -- 172.21.15.7:0/3356444374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc7501b0 msgr2=0x5654bcb20b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/3356444374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc7501b0 0x5654bcb20b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0e05d9b640 1 -- 172.21.15.7:0/3356444374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 msgr2=0x5654bcb20650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/3356444374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 0x5654bcb20650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0e05d9b640 1 -- 172.21.15.7:0/3356444374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654bc7e4650 con 0x5654bc758390 2024-09-21T06:02:57.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0df77fe640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0df00b66b0 0x7f0df00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/3356444374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 0x5654bcb210d0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0e5340 tx=0x7f0dfc0ebf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b030ef2af88ae559 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:57.875 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:02:57.875 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:02:57.875 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:02:57.875 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:02:57.875 INFO:teuthology.orchestra.run.smithi007.stdout: "1d89aa12-56bd-49e8-bbd4-0309b4e70f2a": { 2024-09-21T06:02:57.875 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:02:56.375957+0000", 2024-09-21T06:02:57.875 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: "46ad69b3-ef90-42e0-a57b-ea33e3ef74ab": { 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:32.287019+0000", 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.876 INFO:teuthology.orchestra.run.smithi007.stdout: "d9b96838-732e-40a1-9fad-f54faef73b59": { 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:21.774276+0000", 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: "fd9e7ebd-b70a-487f-937b-80b64378d04b": { 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:11.755521+0000", 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi007.stdout: "3bd778db-a0ed-42ad-8a79-14a200f0734e": { 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:51.556015+0000", 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:02:57.880 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: "ecf3518d-a174-4cee-89a1-6aa26e1b3442": { 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:01.909762+0000", 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.882 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.883 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.884 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:02:57.885 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.887 INFO:teuthology.orchestra.run.smithi007.stdout: "a9901d9b-aa10-4587-83ff-d32730ff12ea": { 2024-09-21T06:02:57.887 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:02:14.695980+0000", 2024-09-21T06:02:57.887 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.887 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.887 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.887 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.887 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.887 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:02:57.887 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:02:57.887 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.887 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.887 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:02:57.888 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:02:57.889 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:02:57.889 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:02:57.889 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:02:57.889 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:02:57.889 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:02:57.889 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:02:57.889 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:02:57.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0e06d9d640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0df00b66b0 0x7f0df00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.836+0000 7f0df77fe640 1 -- 172.21.15.7:0/4063354754 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f0dfc0e7c30 con 0x7f0e081083a0 2024-09-21T06:02:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.837+0000 7f0df4ff9640 1 -- 172.21.15.7:0/3356444374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0aa120 con 0x5654bc758390 2024-09-21T06:02:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.837+0000 7f0df4ff9640 1 -- 172.21.15.7:0/3356444374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dfc0f5070 con 0x5654bc758390 2024-09-21T06:02:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.837+0000 7f0df4ff9640 1 -- 172.21.15.7:0/3356444374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0ad240 con 0x5654bc758390 2024-09-21T06:02:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.837+0000 7f0e12ebd740 1 -- 172.21.15.7:0/3356444374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 msgr2=0x5654bcb210d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.837+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/3356444374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 0x5654bcb210d0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0e5340 tx=0x7f0dfc0ebf00 comp rx=0 tx=0).stop 2024-09-21T06:02:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.837+0000 7f0e06d9d640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0df00b66b0 0x7f0df00b8bc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000cd20 tx=0x7f0e0000c4b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 -- 172.21.15.7:0/3356444374 shutdown_connections 2024-09-21T06:02:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/3356444374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 0x5654bcb210d0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/3356444374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc7501b0 0x5654bcb20b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/3356444374 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 0x5654bcb20650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 -- 172.21.15.7:0/3356444374 >> 172.21.15.7:0/3356444374 conn(0x5654bc76d460 msgr2=0x5654bcb1e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 -- 172.21.15.7:0/3356444374 shutdown_connections 2024-09-21T06:02:57.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 -- 172.21.15.7:0/3356444374 wait complete. 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 -- start start 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 Processor -- start 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 0x5654bcb2bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc758390 0x5654bcb2c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 0x5654bcb38120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5654bc8e7700 con 0x5654bc7501b0 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5654bca21110 con 0x5654bc779070 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.838+0000 7f0e12ebd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5654bcb2ee30 con 0x5654bc758390 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0e12ebd740 10 client.0 _ll_register_callbacks cb 0x5654bca3a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0e0659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 0x5654bcb2bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0e0659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 0x5654bcb2bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60338/0 (socket says 172.21.15.7:60338) 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0e0659c640 1 -- 172.21.15.7:0/669793229 learned_addr learned my addr 172.21.15.7:0/669793229 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0e06d9d640 1 --2- 172.21.15.7:0/669793229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 0x5654bcb38120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/669793229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc758390 0x5654bcb2c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0e0659c640 1 -- 172.21.15.7:0/669793229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc758390 msgr2=0x5654bcb2c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0e0659c640 1 --2- 172.21.15.7:0/669793229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc758390 0x5654bcb2c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0e0659c640 1 -- 172.21.15.7:0/669793229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 msgr2=0x5654bcb38120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0e0659c640 1 --2- 172.21.15.7:0/669793229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 0x5654bcb38120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0e0659c640 1 -- 172.21.15.7:0/669793229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654bca4ec40 con 0x5654bc7501b0 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0e0659c640 1 --2- 172.21.15.7:0/669793229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 0x5654bcb2bd90 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f0df802a910 tx=0x7f0df8031830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c493c92c72ad467e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0dedffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0dedffb640 1 -- 172.21.15.7:0/669793229 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8035040 con 0x5654bc7501b0 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0dedffb640 1 -- 172.21.15.7:0/669793229 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f0df8004240 con 0x5654bc7501b0 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.839+0000 7f0e12ebd740 1 -- 172.21.15.7:0/669793229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dfc0f5070 con 0x5654bc7501b0 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.840+0000 7f0dedffb640 1 -- 172.21.15.7:0/669793229 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0df8004440 con 0x5654bc7501b0 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.840+0000 7f0e12ebd740 10 client.18048 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.840+0000 7f0e12ebd740 1 -- 172.21.15.7:0/669793229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5654bcb3abc0 con 0x5654bc7501b0 2024-09-21T06:02:57.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.840+0000 7f0dedffb640 1 -- 172.21.15.7:0/669793229 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dfc0f5070 con 0x5654bc7501b0 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.840+0000 7f0dedffb640 1 -- 172.21.15.7:0/669793229 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0df8004c10 con 0x5654bc7501b0 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.840+0000 7f0e12ebd740 10 client.18048 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.840+0000 7f0e12ebd740 10 client.18048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.840+0000 7f0e12ebd740 20 client.18048 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.840+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/669793229 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5654bc7379f0 0x5654bcb3e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.840+0000 7f0e12ebd740 4 client.18048 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.840+0000 7f0e12ebd740 1 -- 172.21.15.7:0/669793229 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654bca98da0 con 0x5654bc7379f0 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.840+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/669793229 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5654bc7379f0 0x5654bcb3e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.841+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/669793229 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5654bc7379f0 0x5654bcb3e060 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77970678d9f98ce4 server_cookie=58b2901a035c5718 in_seq=0 out_seq=0 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.841+0000 7f0dedffb640 10 client.18048 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0dedffb640 1 -- 172.21.15.7:0/669793229 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5654bca98da0 con 0x5654bc7379f0 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0dedffb640 10 client.18048 handle_command_reply: tid=0 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0e12ebd740 1 client.18048 shutdown 2024-09-21T06:02:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0e12ebd740 1 -- 172.21.15.7:0/669793229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 msgr2=0x5654bcb2bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/669793229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 0x5654bcb2bd90 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f0df802a910 tx=0x7f0df8031830 comp rx=0 tx=0).stop 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0e12ebd740 1 -- 172.21.15.7:0/669793229 shutdown_connections 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/669793229 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5654bc7379f0 0x5654bcb3e060 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/669793229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 0x5654bcb38120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/669793229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc758390 0x5654bcb2c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0dedffb640 0 client.18048 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/669793229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 0x5654bcb2bd90 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0e12ebd740 1 -- 172.21.15.7:0/669793229 >> 172.21.15.7:0/669793229 conn(0x5654bc76d460 msgr2=0x5654bcb23830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0e12ebd740 1 -- 172.21.15.7:0/669793229 shutdown_connections 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0e12ebd740 1 -- 172.21.15.7:0/669793229 wait complete. 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.842+0000 7f0e12ebd740 20 client.18048 trim_cache size 0 max 16384 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.859+0000 7f0e12ebd740 1 Processor -- start 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.859+0000 7f0e12ebd740 1 -- start start 2024-09-21T06:02:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e12ebd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc7501b0 0x5654bcb2dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e12ebd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 0x5654bcb21d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e12ebd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 0x5654bcb38020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e12ebd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0e081b3fa0 con 0x5654bc758390 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e12ebd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0e081b1870 con 0x5654bc779070 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e12ebd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0e081af6e0 con 0x5654bc7501b0 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e05d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 0x5654bcb21d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e05d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 0x5654bcb21d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60346/0 (socket says 172.21.15.7:60346) 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e05d9b640 1 -- 172.21.15.7:0/4247647230 learned_addr learned my addr 172.21.15.7:0/4247647230 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e06d9d640 1 --2- 172.21.15.7:0/4247647230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 0x5654bcb38020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e0659c640 1 --2- 172.21.15.7:0/4247647230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc7501b0 0x5654bcb2dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e05d9b640 1 -- 172.21.15.7:0/4247647230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc7501b0 msgr2=0x5654bcb2dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/4247647230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc7501b0 0x5654bcb2dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e05d9b640 1 -- 172.21.15.7:0/4247647230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 msgr2=0x5654bcb38020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/4247647230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 0x5654bcb38020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e05d9b640 1 -- 172.21.15.7:0/4247647230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654bcb22940 con 0x5654bc758390 2024-09-21T06:02:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e0659c640 1 --2- 172.21.15.7:0/4247647230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc7501b0 0x5654bcb2dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:02:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/4247647230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 0x5654bcb21d90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0ebfd0 tx=0x7f0dfc007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539a0b037e2b55dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0deffff640 1 -- 172.21.15.7:0/4247647230 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0ad420 con 0x5654bc758390 2024-09-21T06:02:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.860+0000 7f0deffff640 1 -- 172.21.15.7:0/4247647230 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dfc092030 con 0x5654bc758390 2024-09-21T06:02:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.861+0000 7f0deffff640 1 -- 172.21.15.7:0/4247647230 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0ad8a0 con 0x5654bc758390 2024-09-21T06:02:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.861+0000 7f0e12ebd740 1 -- 172.21.15.7:0/4247647230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 msgr2=0x5654bcb21d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.861+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/4247647230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 0x5654bcb21d90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0ebfd0 tx=0x7f0dfc007f30 comp rx=0 tx=0).stop 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.861+0000 7f0e12ebd740 1 -- 172.21.15.7:0/4247647230 shutdown_connections 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.861+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/4247647230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc758390 0x5654bcb21d90 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.861+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/4247647230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc779070 0x5654bcb38020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.861+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/4247647230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc7501b0 0x5654bcb2dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.861+0000 7f0e12ebd740 1 -- 172.21.15.7:0/4247647230 >> 172.21.15.7:0/4247647230 conn(0x5654bc76d460 msgr2=0x5654bcb21680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.861+0000 7f0e12ebd740 1 -- 172.21.15.7:0/4247647230 shutdown_connections 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.861+0000 7f0e12ebd740 1 -- 172.21.15.7:0/4247647230 wait complete. 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e12ebd740 1 -- start start 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e12ebd740 1 Processor -- start 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e12ebd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 0x5654bcb320b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e12ebd740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc758390 0x5654bcb325f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e12ebd740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc779070 0x5654bcb32b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e12ebd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0e081afd30 con 0x5654bc7501b0 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e12ebd740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0e081b11a0 con 0x5654bc758390 2024-09-21T06:02:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e12ebd740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0e081b0400 con 0x5654bc779070 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e12ebd740 10 client.0 _ll_register_callbacks cb 0x7f0df8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e0659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 0x5654bcb320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e0659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 0x5654bcb320b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60362/0 (socket says 172.21.15.7:60362) 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e0659c640 1 -- 172.21.15.7:0/3185430933 learned_addr learned my addr 172.21.15.7:0/3185430933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc758390 0x5654bcb325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.862+0000 7f0e06d9d640 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc779070 0x5654bcb32b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0e0659c640 1 -- 172.21.15.7:0/3185430933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc779070 msgr2=0x5654bcb32b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0e0659c640 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc779070 0x5654bcb32b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0e0659c640 1 -- 172.21.15.7:0/3185430933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc758390 msgr2=0x5654bcb325f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0e0659c640 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc758390 0x5654bcb325f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0e0659c640 1 -- 172.21.15.7:0/3185430933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654bcba7a30 con 0x5654bc7501b0 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0e06d9d640 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc779070 0x5654bcb32b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0e0659c640 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 0x5654bcb320b0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f0df8006010 tx=0x7f0df80314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fd309a090f9845 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0dedffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0dedffb640 1 -- 172.21.15.7:0/3185430933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8035050 con 0x5654bc7501b0 2024-09-21T06:02:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0dedffb640 1 -- 172.21.15.7:0/3185430933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f0df8003e60 con 0x5654bc7501b0 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0e12ebd740 1 -- 172.21.15.7:0/3185430933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dfc092030 con 0x5654bc7501b0 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0dedffb640 1 -- 172.21.15.7:0/3185430933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0df805f050 con 0x5654bc7501b0 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0e12ebd740 10 client.18054 fetch_fsmap learned FSMap version 25 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0e12ebd740 1 -- 172.21.15.7:0/3185430933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5654bcba8ca0 con 0x5654bc7501b0 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.863+0000 7f0dedffb640 1 -- 172.21.15.7:0/3185430933 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dfc092030 con 0x5654bc7501b0 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.864+0000 7f0dedffb640 1 -- 172.21.15.7:0/3185430933 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0df8005160 con 0x5654bc7501b0 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.864+0000 7f0e12ebd740 10 client.18054 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.864+0000 7f0e12ebd740 10 client.18054 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.864+0000 7f0e12ebd740 20 client.18054 populate_metadata read hostname 'smithi007' 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.864+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5654bc70cda0 0x5654bcbab490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.864+0000 7f0e12ebd740 4 client.18054 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.864+0000 7f0e12ebd740 1 -- 172.21.15.7:0/3185430933 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5654bca94850 con 0x5654bc70cda0 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.864+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5654bc70cda0 0x5654bcbab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.864+0000 7f0e05d9b640 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5654bc70cda0 0x5654bcbab490 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ae6b87937189167 server_cookie=644e8248ab5e7197 in_seq=0 out_seq=0 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.864+0000 7f0dedffb640 10 client.18054 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0dedffb640 1 -- 172.21.15.7:0/3185430933 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6906 (crc 0 0 0) 0x5654bca94850 con 0x5654bc70cda0 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0dedffb640 10 client.18054 handle_command_reply: tid=0 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0e12ebd740 1 client.18054 shutdown 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0e12ebd740 1 -- 172.21.15.7:0/3185430933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 msgr2=0x5654bcb320b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 0x5654bcb320b0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f0df8006010 tx=0x7f0df80314a0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0e12ebd740 1 -- 172.21.15.7:0/3185430933 shutdown_connections 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5654bc70cda0 0x5654bcbab490 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5654bc779070 0x5654bcb32b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5654bc758390 0x5654bcb325f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0dedffb640 0 client.18054 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0e12ebd740 1 --2- 172.21.15.7:0/3185430933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654bc7501b0 0x5654bcb320b0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0e12ebd740 1 -- 172.21.15.7:0/3185430933 >> 172.21.15.7:0/3185430933 conn(0x5654bc76d460 msgr2=0x5654bcb21e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0e12ebd740 1 -- 172.21.15.7:0/3185430933 shutdown_connections 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0e12ebd740 1 -- 172.21.15.7:0/3185430933 wait complete. 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.865+0000 7f0e12ebd740 20 client.18054 trim_cache size 0 max 16384 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.866+0000 7f0e0c949640 1 -- 172.21.15.7:0/4063354754 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0df00b66b0 msgr2=0x7f0df00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.866+0000 7f0e0c949640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0df00b66b0 0x7f0df00b8bc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000cd20 tx=0x7f0e0000c4b0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.866+0000 7f0e0c949640 1 -- 172.21.15.7:0/4063354754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e081083a0 msgr2=0x7f0e0819a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.866+0000 7f0e0c949640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e081083a0 0x7f0e0819a980 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00ccb0 tx=0x7f0dfc00a620 comp rx=0 tx=0).stop 2024-09-21T06:02:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.866+0000 7f0e0c949640 1 -- 172.21.15.7:0/4063354754 shutdown_connections 2024-09-21T06:02:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.866+0000 7f0e0c949640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0df00b66b0 0x7f0df00b8bc0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.866+0000 7f0e0c949640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e081083a0 0x7f0e0819a980 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.866+0000 7f0e0c949640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e08108cf0 0x7f0e0819fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.866+0000 7f0e0c949640 1 --2- 172.21.15.7:0/4063354754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e08102a60 0x7f0e0819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.866+0000 7f0e0c949640 1 -- 172.21.15.7:0/4063354754 >> 172.21.15.7:0/4063354754 conn(0x7f0e08079720 msgr2=0x7f0e08106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.866+0000 7f0e0c949640 1 -- 172.21.15.7:0/4063354754 shutdown_connections 2024-09-21T06:02:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:57.866+0000 7f0e0c949640 1 -- 172.21.15.7:0/4063354754 wait complete. 2024-09-21T06:02:58.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:57 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:02:58.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:57 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:02:58.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:57 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:02:58.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:57 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:02:58.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:57 smithi007 ceph-mon[30983]: pgmap v596: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:02:58.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:57 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:02:58.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:57 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:02:58.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:57 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:02:58.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:57 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:02:58.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:57 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:02:58.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:57 smithi027 ceph-mon[34364]: pgmap v596: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:02:58.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:57 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:02:58.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:57 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:02:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:57 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:02:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:57 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:02:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:57 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:02:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:57 smithi119 ceph-mon[34833]: pgmap v596: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:02:58.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:57 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:02:58.630 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:02:58.630 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:02:58.890 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:59.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.370+0000 7f5b60c14640 1 -- 172.21.15.7:0/2908274316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b5c102a80 msgr2=0x7f5b5c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:59.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.370+0000 7f5b60c14640 1 --2- 172.21.15.7:0/2908274316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b5c102a80 0x7f5b5c102e90 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009900 tx=0x7f5b4c02a410 comp rx=0 tx=0).stop 2024-09-21T06:02:59.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.371+0000 7f5b60c14640 1 -- 172.21.15.7:0/2908274316 shutdown_connections 2024-09-21T06:02:59.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.371+0000 7f5b60c14640 1 --2- 172.21.15.7:0/2908274316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b5c108d10 0x7f5b5c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:59.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.371+0000 7f5b60c14640 1 --2- 172.21.15.7:0/2908274316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b5c1083c0 0x7f5b5c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:59.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.371+0000 7f5b60c14640 1 --2- 172.21.15.7:0/2908274316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b5c102a80 0x7f5b5c102e90 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:59.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.371+0000 7f5b60c14640 1 -- 172.21.15.7:0/2908274316 >> 172.21.15.7:0/2908274316 conn(0x7f5b5c079730 msgr2=0x7f5b5c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:59.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.371+0000 7f5b60c14640 1 -- 172.21.15.7:0/2908274316 shutdown_connections 2024-09-21T06:02:59.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.371+0000 7f5b60c14640 1 -- 172.21.15.7:0/2908274316 wait complete. 2024-09-21T06:02:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.372+0000 7f5b60c14640 1 Processor -- start 2024-09-21T06:02:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.372+0000 7f5b60c14640 1 -- start start 2024-09-21T06:02:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.372+0000 7f5b60c14640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b5c102a80 0x7f5b5c19b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.372+0000 7f5b60c14640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b5c1083c0 0x7f5b5c19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.372+0000 7f5b60c14640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b5c108d10 0x7f5b5c19bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.372+0000 7f5b60c14640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5c112a10 con 0x7f5b5c1083c0 2024-09-21T06:02:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.372+0000 7f5b60c14640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5c112890 con 0x7f5b5c108d10 2024-09-21T06:02:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.372+0000 7f5b60c14640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5c112b90 con 0x7f5b5c102a80 2024-09-21T06:02:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.372+0000 7f5b59d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b5c1083c0 0x7f5b5c19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.372+0000 7f5b59d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b5c1083c0 0x7f5b5c19b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43868/0 (socket says 172.21.15.7:43868) 2024-09-21T06:02:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.372+0000 7f5b59d9b640 1 -- 172.21.15.7:0/1037309181 learned_addr learned my addr 172.21.15.7:0/1037309181 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:02:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.372+0000 7f5b5a59c640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b5c102a80 0x7f5b5c19b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:59.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.372+0000 7f5b5ad9d640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b5c108d10 0x7f5b5c19bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.373+0000 7f5b59d9b640 1 -- 172.21.15.7:0/1037309181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b5c102a80 msgr2=0x7f5b5c19b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.373+0000 7f5b59d9b640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b5c102a80 0x7f5b5c19b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.373+0000 7f5b59d9b640 1 -- 172.21.15.7:0/1037309181 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b5c108d10 msgr2=0x7f5b5c19bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.373+0000 7f5b59d9b640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b5c108d10 0x7f5b5c19bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.373+0000 7f5b59d9b640 1 -- 172.21.15.7:0/1037309181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5c1a6790 con 0x7f5b5c1083c0 2024-09-21T06:02:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.373+0000 7f5b5ad9d640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b5c108d10 0x7f5b5c19bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:02:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.373+0000 7f5b59d9b640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b5c1083c0 0x7f5b5c19b9c0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5b50006fd0 tx=0x7f5b5000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.373+0000 7f5b4b7fe640 1 -- 172.21.15.7:0/1037309181 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50011830 con 0x7f5b5c1083c0 2024-09-21T06:02:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.373+0000 7f5b60c14640 1 -- 172.21.15.7:0/1037309181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b5c1a6a80 con 0x7f5b5c1083c0 2024-09-21T06:02:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.373+0000 7f5b4b7fe640 1 -- 172.21.15.7:0/1037309181 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b50016070 con 0x7f5b5c1083c0 2024-09-21T06:02:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.373+0000 7f5b4b7fe640 1 -- 172.21.15.7:0/1037309181 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50010e00 con 0x7f5b5c1083c0 2024-09-21T06:02:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.373+0000 7f5b60c14640 1 -- 172.21.15.7:0/1037309181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b5c1a7010 con 0x7f5b5c1083c0 2024-09-21T06:02:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.374+0000 7f5b60c14640 1 -- 172.21.15.7:0/1037309181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b5c103d00 con 0x7f5b5c1083c0 2024-09-21T06:02:59.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.376+0000 7f5b4b7fe640 1 -- 172.21.15.7:0/1037309181 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f5b5001b460 con 0x7f5b5c1083c0 2024-09-21T06:02:59.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.377+0000 7f5b4b7fe640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5b440b6680 0x7f5b440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:02:59.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.377+0000 7f5b5a59c640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5b440b6680 0x7f5b440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:02:59.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.377+0000 7f5b4b7fe640 1 -- 172.21.15.7:0/1037309181 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f5b500e7320 con 0x7f5b5c1083c0 2024-09-21T06:02:59.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.377+0000 7f5b5a59c640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5b440b6680 0x7f5b440b8b90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c000c00 tx=0x7f5b4c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:02:59.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.380+0000 7f5b4b7fe640 1 -- 172.21.15.7:0/1037309181 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5b500ad860 con 0x7f5b5c1083c0 2024-09-21T06:02:59.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.604+0000 7f5b60c14640 1 -- 172.21.15.7:0/1037309181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b5c102e90 con 0x7f5b5c1083c0 2024-09-21T06:02:59.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.604+0000 7f5b4b7fe640 1 -- 172.21.15.7:0/1037309181 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f5b500b1c40 con 0x7f5b5c1083c0 2024-09-21T06:02:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:02:59.606 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:02:59.607 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:02:59.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.606+0000 7f5b60c14640 1 -- 172.21.15.7:0/1037309181 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5b440b6680 msgr2=0x7f5b440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:59.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.606+0000 7f5b60c14640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5b440b6680 0x7f5b440b8b90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c000c00 tx=0x7f5b4c031400 comp rx=0 tx=0).stop 2024-09-21T06:02:59.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.606+0000 7f5b60c14640 1 -- 172.21.15.7:0/1037309181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b5c1083c0 msgr2=0x7f5b5c19b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:02:59.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.606+0000 7f5b60c14640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b5c1083c0 0x7f5b5c19b9c0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5b50006fd0 tx=0x7f5b5000b8e0 comp rx=0 tx=0).stop 2024-09-21T06:02:59.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.606+0000 7f5b60c14640 1 -- 172.21.15.7:0/1037309181 shutdown_connections 2024-09-21T06:02:59.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.607+0000 7f5b60c14640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f5b440b6680 0x7f5b440b8b90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:59.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.607+0000 7f5b60c14640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b5c1083c0 0x7f5b5c19b9c0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:59.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.607+0000 7f5b60c14640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b5c108d10 0x7f5b5c19bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:59.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.607+0000 7f5b60c14640 1 --2- 172.21.15.7:0/1037309181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b5c102a80 0x7f5b5c19b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:02:59.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.607+0000 7f5b60c14640 1 -- 172.21.15.7:0/1037309181 >> 172.21.15.7:0/1037309181 conn(0x7f5b5c079730 msgr2=0x7f5b5c106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:02:59.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.607+0000 7f5b60c14640 1 -- 172.21.15.7:0/1037309181 shutdown_connections 2024-09-21T06:02:59.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:02:59.607+0000 7f5b60c14640 1 -- 172.21.15.7:0/1037309181 wait complete. 2024-09-21T06:03:00.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:59 smithi027 ceph-mon[34364]: pgmap v597: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T06:03:00.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:02:59 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1037309181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:00.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:59 smithi007 ceph-mon[30983]: pgmap v597: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T06:03:00.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:02:59 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1037309181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:00.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:03:00.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:59 smithi119 ceph-mon[34833]: pgmap v597: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T06:03:00.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:02:59 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1037309181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:00.563 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:01.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.049+0000 7f0da2d61640 1 -- 172.21.15.7:0/347095162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d9c102ae0 msgr2=0x7f0d9c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:01.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.049+0000 7f0da2d61640 1 --2- 172.21.15.7:0/347095162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d9c102ae0 0x7f0d9c102ef0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c009900 tx=0x7f0d8c02a410 comp rx=0 tx=0).stop 2024-09-21T06:03:01.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.049+0000 7f0da2d61640 1 -- 172.21.15.7:0/347095162 shutdown_connections 2024-09-21T06:03:01.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.049+0000 7f0da2d61640 1 --2- 172.21.15.7:0/347095162 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d9c108d20 0x7f0d9c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.049+0000 7f0da2d61640 1 --2- 172.21.15.7:0/347095162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d9c1083d0 0x7f0d9c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.049+0000 7f0da2d61640 1 --2- 172.21.15.7:0/347095162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d9c102ae0 0x7f0d9c102ef0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.049+0000 7f0da2d61640 1 -- 172.21.15.7:0/347095162 >> 172.21.15.7:0/347095162 conn(0x7f0d9c0797b0 msgr2=0x7f0d9c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:01.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.049+0000 7f0da2d61640 1 -- 172.21.15.7:0/347095162 shutdown_connections 2024-09-21T06:03:01.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.049+0000 7f0da2d61640 1 -- 172.21.15.7:0/347095162 wait complete. 2024-09-21T06:03:01.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.050+0000 7f0da2d61640 1 Processor -- start 2024-09-21T06:03:01.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.050+0000 7f0da2d61640 1 -- start start 2024-09-21T06:03:01.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.050+0000 7f0da2d61640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d9c102ae0 0x7f0d9c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.050+0000 7f0da2d61640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d9c1083d0 0x7f0d9c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.050+0000 7f0da2d61640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d9c108d20 0x7f0d9c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.050+0000 7f0da2d61640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c1129e0 con 0x7f0d9c1083d0 2024-09-21T06:03:01.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.050+0000 7f0da2d61640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c112860 con 0x7f0d9c102ae0 2024-09-21T06:03:01.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.050+0000 7f0da2d61640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c112b60 con 0x7f0d9c108d20 2024-09-21T06:03:01.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.050+0000 7f0d9bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d9c1083d0 0x7f0d9c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.050+0000 7f0d9bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d9c1083d0 0x7f0d9c0ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43892/0 (socket says 172.21.15.7:43892) 2024-09-21T06:03:01.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.050+0000 7f0d9bfff640 1 -- 172.21.15.7:0/2489564986 learned_addr learned my addr 172.21.15.7:0/2489564986 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:01.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.050+0000 7f0da0afd640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d9c102ae0 0x7f0d9c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.050+0000 7f0da12fe640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d9c108d20 0x7f0d9c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.051+0000 7f0d9bfff640 1 -- 172.21.15.7:0/2489564986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d9c108d20 msgr2=0x7f0d9c1000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:01.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.051+0000 7f0d9bfff640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d9c108d20 0x7f0d9c1000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.051+0000 7f0d9bfff640 1 -- 172.21.15.7:0/2489564986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d9c102ae0 msgr2=0x7f0d9c0ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.051+0000 7f0d9bfff640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d9c102ae0 0x7f0d9c0ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.051+0000 7f0d9bfff640 1 -- 172.21.15.7:0/2489564986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c1a87c0 con 0x7f0d9c1083d0 2024-09-21T06:03:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.051+0000 7f0da12fe640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d9c108d20 0x7f0d9c1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.051+0000 7f0d9bfff640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d9c1083d0 0x7f0d9c0ffbb0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000d750 tx=0x7f0d9000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.051+0000 7f0d99ffb640 1 -- 172.21.15.7:0/2489564986 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90017070 con 0x7f0d9c1083d0 2024-09-21T06:03:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.051+0000 7f0d99ffb640 1 -- 172.21.15.7:0/2489564986 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d900054d0 con 0x7f0d9c1083d0 2024-09-21T06:03:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.051+0000 7f0da2d61640 1 -- 172.21.15.7:0/2489564986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c1a8ab0 con 0x7f0d9c1083d0 2024-09-21T06:03:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.051+0000 7f0d99ffb640 1 -- 172.21.15.7:0/2489564986 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90004c30 con 0x7f0d9c1083d0 2024-09-21T06:03:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.051+0000 7f0da2d61640 1 -- 172.21.15.7:0/2489564986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c1a8fa0 con 0x7f0d9c1083d0 2024-09-21T06:03:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.054+0000 7f0d99ffb640 1 -- 172.21.15.7:0/2489564986 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0d90004dd0 con 0x7f0d9c1083d0 2024-09-21T06:03:01.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.054+0000 7f0da92d5740 1 Processor -- start 2024-09-21T06:03:01.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.054+0000 7f0da92d5740 1 -- start start 2024-09-21T06:03:01.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.054+0000 7f0da92d5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3ee070 0x56495e7956a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.054+0000 7f0da92d5740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3c51b0 0x56495e795be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.054+0000 7f0da92d5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3cd390 0x56495e796120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.054+0000 7f0da92d5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56495e70bea0 con 0x56495e3cd390 2024-09-21T06:03:01.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.054+0000 7f0da92d5740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56495e6fb2d0 con 0x56495e3c51b0 2024-09-21T06:03:01.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.054+0000 7f0da92d5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56495e6ff0e0 con 0x56495e3ee070 2024-09-21T06:03:01.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0da12fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3ee070 0x56495e7956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0d9bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3cd390 0x56495e796120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0da12fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3ee070 0x56495e7956a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:58964/0 (socket says 172.21.15.7:58964) 2024-09-21T06:03:01.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0da12fe640 1 -- 172.21.15.7:0/478807183 learned_addr learned my addr 172.21.15.7:0/478807183 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:01.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0da0afd640 1 --2- 172.21.15.7:0/478807183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3c51b0 0x56495e795be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0d99ffb640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d840b6680 0x7f0d840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0da12fe640 1 -- 172.21.15.7:0/478807183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3c51b0 msgr2=0x56495e795be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:01.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0da12fe640 1 --2- 172.21.15.7:0/478807183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3c51b0 0x56495e795be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0da12fe640 1 -- 172.21.15.7:0/478807183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3cd390 msgr2=0x56495e796120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:01.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0da12fe640 1 --2- 172.21.15.7:0/478807183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3cd390 0x56495e796120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0da12fe640 1 -- 172.21.15.7:0/478807183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56495e459650 con 0x56495e3ee070 2024-09-21T06:03:01.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0da0afd640 1 --2- 172.21.15.7:0/478807183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3c51b0 0x56495e795be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:01.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0d99ffb640 1 -- 172.21.15.7:0/2489564986 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f0d900e70e0 con 0x7f0d9c1083d0 2024-09-21T06:03:01.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0da12fe640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d840b6680 0x7f0d840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.055+0000 7f0da12fe640 1 --2- 172.21.15.7:0/478807183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3ee070 0x56495e7956a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009fd0 tx=0x7f0d940108e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58ce4f6f3e4a666c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:01.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.056+0000 7f0d82ffd640 1 -- 172.21.15.7:0/478807183 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94011ac0 con 0x56495e3ee070 2024-09-21T06:03:01.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.056+0000 7f0d82ffd640 1 -- 172.21.15.7:0/478807183 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d94011ce0 con 0x56495e3ee070 2024-09-21T06:03:01.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.056+0000 7f0d82ffd640 1 -- 172.21.15.7:0/478807183 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9401a790 con 0x56495e3ee070 2024-09-21T06:03:01.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.057+0000 7f0da92d5740 1 -- 172.21.15.7:0/478807183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3ee070 msgr2=0x56495e7956a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:01.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.057+0000 7f0da12fe640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d840b6680 0x7f0d840b8b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0d9401d040 tx=0x7f0d9401aa10 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:01.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.057+0000 7f0da92d5740 1 --2- 172.21.15.7:0/478807183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3ee070 0x56495e7956a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009fd0 tx=0x7f0d940108e0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.057+0000 7f0da92d5740 1 -- 172.21.15.7:0/478807183 shutdown_connections 2024-09-21T06:03:01.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.057+0000 7f0da92d5740 1 --2- 172.21.15.7:0/478807183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3cd390 0x56495e796120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.057+0000 7f0da92d5740 1 --2- 172.21.15.7:0/478807183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3c51b0 0x56495e795be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.057+0000 7f0da92d5740 1 --2- 172.21.15.7:0/478807183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3ee070 0x56495e7956a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.057+0000 7f0da92d5740 1 -- 172.21.15.7:0/478807183 >> 172.21.15.7:0/478807183 conn(0x56495e3e2460 msgr2=0x56495e793590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:01.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.057+0000 7f0da92d5740 1 -- 172.21.15.7:0/478807183 shutdown_connections 2024-09-21T06:03:01.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.057+0000 7f0da92d5740 1 -- 172.21.15.7:0/478807183 wait complete. 2024-09-21T06:03:01.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.057+0000 7f0da92d5740 1 -- start start 2024-09-21T06:03:01.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.057+0000 7f0da92d5740 1 Processor -- start 2024-09-21T06:03:01.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da92d5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da92d5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3cd390 0x56495e7a1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da92d5740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3ee070 0x56495e7ad170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da92d5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56495e55c700 con 0x56495e3c51b0 2024-09-21T06:03:01.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da92d5740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56495e696160 con 0x56495e3ee070 2024-09-21T06:03:01.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da92d5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56495e7a3e80 con 0x56495e3cd390 2024-09-21T06:03:01.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da92d5740 10 client.0 _ll_register_callbacks cb 0x56495e6af9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:01.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da0afd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da0afd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7a0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43918/0 (socket says 172.21.15.7:43918) 2024-09-21T06:03:01.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da0afd640 1 -- 172.21.15.7:0/480946183 learned_addr learned my addr 172.21.15.7:0/480946183 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:01.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0d9bfff640 1 --2- 172.21.15.7:0/480946183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3cd390 0x56495e7a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da12fe640 1 --2- 172.21.15.7:0/480946183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3ee070 0x56495e7ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da0afd640 1 -- 172.21.15.7:0/480946183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3cd390 msgr2=0x56495e7a1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:01.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da0afd640 1 --2- 172.21.15.7:0/480946183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3cd390 0x56495e7a1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da0afd640 1 -- 172.21.15.7:0/480946183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3ee070 msgr2=0x56495e7ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:01.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da0afd640 1 --2- 172.21.15.7:0/480946183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3ee070 0x56495e7ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.058+0000 7f0da0afd640 1 -- 172.21.15.7:0/480946183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56495e6c3c90 con 0x56495e3c51b0 2024-09-21T06:03:01.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.059+0000 7f0da0afd640 1 --2- 172.21.15.7:0/480946183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7a0d30 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c009900 tx=0x7f0d8c0314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e7eeabc2301ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:01.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.059+0000 7f0d7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:01.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.059+0000 7f0d7bfff640 1 -- 172.21.15.7:0/480946183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c035040 con 0x56495e3c51b0 2024-09-21T06:03:01.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.059+0000 7f0d7bfff640 1 -- 172.21.15.7:0/480946183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f0d8c031810 con 0x56495e3c51b0 2024-09-21T06:03:01.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.059+0000 7f0da92d5740 1 -- 172.21.15.7:0/480946183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d94011ce0 con 0x56495e3c51b0 2024-09-21T06:03:01.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.059+0000 7f0d7bfff640 1 -- 172.21.15.7:0/480946183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0d8c004040 con 0x56495e3c51b0 2024-09-21T06:03:01.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.059+0000 7f0da92d5740 10 client.18072 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:01.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.059+0000 7f0da92d5740 1 -- 172.21.15.7:0/480946183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56495e7afb60 con 0x56495e3c51b0 2024-09-21T06:03:01.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.059+0000 7f0d7bfff640 1 -- 172.21.15.7:0/480946183 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d94011ce0 con 0x56495e3c51b0 2024-09-21T06:03:01.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.059+0000 7f0d7bfff640 1 -- 172.21.15.7:0/480946183 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0d8c004770 con 0x56495e3c51b0 2024-09-21T06:03:01.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.060+0000 7f0da92d5740 10 client.18072 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:01.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.060+0000 7f0da92d5740 10 client.18072 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:03:01.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.060+0000 7f0da92d5740 20 client.18072 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.060+0000 7f0da92d5740 1 --2- 172.21.15.7:0/480946183 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56495e3ac9f0 0x56495e7b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.060+0000 7f0da92d5740 4 client.18072 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.060+0000 7f0da92d5740 1 -- 172.21.15.7:0/480946183 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56495e70ddf0 con 0x56495e3ac9f0 2024-09-21T06:03:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.060+0000 7f0d9bfff640 1 --2- 172.21.15.7:0/480946183 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56495e3ac9f0 0x56495e7b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.060+0000 7f0d9bfff640 1 --2- 172.21.15.7:0/480946183 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56495e3ac9f0 0x56495e7b2fc0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85631a604529630 server_cookie=9e0501383d14b177 in_seq=0 out_seq=0 2024-09-21T06:03:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.060+0000 7f0d7bfff640 10 client.18072 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:03:01.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0d7bfff640 1 -- 172.21.15.7:0/480946183 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56495e70ddf0 con 0x56495e3ac9f0 2024-09-21T06:03:01.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0d7bfff640 10 client.18072 handle_command_reply: tid=0 2024-09-21T06:03:01.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0da92d5740 1 client.18072 shutdown 2024-09-21T06:03:01.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0da92d5740 1 -- 172.21.15.7:0/480946183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 msgr2=0x56495e7a0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:01.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0da92d5740 1 --2- 172.21.15.7:0/480946183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7a0d30 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c009900 tx=0x7f0d8c0314a0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0da92d5740 1 -- 172.21.15.7:0/480946183 shutdown_connections 2024-09-21T06:03:01.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0da92d5740 1 --2- 172.21.15.7:0/480946183 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56495e3ac9f0 0x56495e7b2fc0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0d7bfff640 0 client.18072 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:03:01.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0da92d5740 1 --2- 172.21.15.7:0/480946183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3ee070 0x56495e7ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0da92d5740 1 --2- 172.21.15.7:0/480946183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3cd390 0x56495e7a1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0da92d5740 1 --2- 172.21.15.7:0/480946183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7a0d30 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0da92d5740 1 -- 172.21.15.7:0/480946183 >> 172.21.15.7:0/480946183 conn(0x56495e3e2460 msgr2=0x56495e798830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:01.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0da92d5740 1 -- 172.21.15.7:0/480946183 shutdown_connections 2024-09-21T06:03:01.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.061+0000 7f0da92d5740 1 -- 172.21.15.7:0/480946183 wait complete. 2024-09-21T06:03:01.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.062+0000 7f0da92d5740 20 client.18072 trim_cache size 0 max 16384 2024-09-21T06:03:01.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0da92d5740 1 Processor -- start 2024-09-21T06:03:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0da92d5740 1 -- start start 2024-09-21T06:03:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0da92d5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3ac9f0 0x56495e7a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0da92d5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7ad070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0da92d5740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3cd390 0x56495e79df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0da92d5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c1b4090 con 0x56495e3c51b0 2024-09-21T06:03:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0da92d5740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c1b1960 con 0x56495e3cd390 2024-09-21T06:03:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0da92d5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c1af7d0 con 0x56495e3ac9f0 2024-09-21T06:03:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0d9bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0d9bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7ad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43930/0 (socket says 172.21.15.7:43930) 2024-09-21T06:03:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0d9bfff640 1 -- 172.21.15.7:0/17465894 learned_addr learned my addr 172.21.15.7:0/17465894 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0da12fe640 1 --2- 172.21.15.7:0/17465894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3cd390 0x56495e79df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0da0afd640 1 --2- 172.21.15.7:0/17465894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3ac9f0 0x56495e7a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0d9bfff640 1 -- 172.21.15.7:0/17465894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3ac9f0 msgr2=0x56495e7a11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0d9bfff640 1 --2- 172.21.15.7:0/17465894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3ac9f0 0x56495e7a11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0d9bfff640 1 -- 172.21.15.7:0/17465894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3cd390 msgr2=0x56495e79df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0d9bfff640 1 --2- 172.21.15.7:0/17465894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3cd390 0x56495e79df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.075+0000 7f0d9bfff640 1 -- 172.21.15.7:0/17465894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56495e794270 con 0x56495e3c51b0 2024-09-21T06:03:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.076+0000 7f0da0afd640 1 --2- 172.21.15.7:0/17465894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3ac9f0 0x56495e7a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.076+0000 7f0da12fe640 1 --2- 172.21.15.7:0/17465894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3cd390 0x56495e79df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.076+0000 7f0d9bfff640 1 --2- 172.21.15.7:0/17465894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7ad070 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f0d900e48e0 tx=0x7f0d90094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b58e038426ecc12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.076+0000 7f0d827fc640 1 -- 172.21.15.7:0/17465894 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90020040 con 0x56495e3c51b0 2024-09-21T06:03:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.076+0000 7f0d827fc640 1 -- 172.21.15.7:0/17465894 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d900aca90 con 0x56495e3c51b0 2024-09-21T06:03:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.076+0000 7f0d827fc640 1 -- 172.21.15.7:0/17465894 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90005680 con 0x56495e3c51b0 2024-09-21T06:03:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.077+0000 7f0da92d5740 1 -- 172.21.15.7:0/17465894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 msgr2=0x56495e7ad070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.077+0000 7f0da92d5740 1 --2- 172.21.15.7:0/17465894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7ad070 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f0d900e48e0 tx=0x7f0d90094040 comp rx=0 tx=0).stop 2024-09-21T06:03:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.077+0000 7f0da92d5740 1 -- 172.21.15.7:0/17465894 shutdown_connections 2024-09-21T06:03:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.077+0000 7f0da92d5740 1 --2- 172.21.15.7:0/17465894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7ad070 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.077+0000 7f0da92d5740 1 --2- 172.21.15.7:0/17465894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3cd390 0x56495e79df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.077+0000 7f0da92d5740 1 --2- 172.21.15.7:0/17465894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3ac9f0 0x56495e7a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.077+0000 7f0da92d5740 1 -- 172.21.15.7:0/17465894 >> 172.21.15.7:0/17465894 conn(0x56495e3e2460 msgr2=0x56495e7a0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.077+0000 7f0da92d5740 1 -- 172.21.15.7:0/17465894 shutdown_connections 2024-09-21T06:03:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.077+0000 7f0da92d5740 1 -- 172.21.15.7:0/17465894 wait complete. 2024-09-21T06:03:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.077+0000 7f0da92d5740 1 -- start start 2024-09-21T06:03:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.077+0000 7f0da92d5740 1 Processor -- start 2024-09-21T06:03:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0da92d5740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3ac9f0 0x56495e7a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0da92d5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0da92d5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3cd390 0x56495e81ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0da92d5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c1afe20 con 0x56495e3c51b0 2024-09-21T06:03:01.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0da92d5740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c1b1290 con 0x56495e3ac9f0 2024-09-21T06:03:01.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0da92d5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c1b04f0 con 0x56495e3cd390 2024-09-21T06:03:01.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0da92d5740 10 client.0 _ll_register_callbacks cb 0x7f0d8c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:01.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0d9bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0d9bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43944/0 (socket says 172.21.15.7:43944) 2024-09-21T06:03:01.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0d9bfff640 1 -- 172.21.15.7:0/3667234161 learned_addr learned my addr 172.21.15.7:0/3667234161 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:01.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0da0afd640 1 --2- 172.21.15.7:0/3667234161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3ac9f0 0x56495e7a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0da12fe640 1 --2- 172.21.15.7:0/3667234161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3cd390 0x56495e81ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0d9bfff640 1 -- 172.21.15.7:0/3667234161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3cd390 msgr2=0x56495e81ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:01.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0d9bfff640 1 --2- 172.21.15.7:0/3667234161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3cd390 0x56495e81ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0d9bfff640 1 -- 172.21.15.7:0/3667234161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3ac9f0 msgr2=0x56495e7a57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:01.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0d9bfff640 1 --2- 172.21.15.7:0/3667234161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3ac9f0 0x56495e7a57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.078+0000 7f0d9bfff640 1 -- 172.21.15.7:0/3667234161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56495e81cf50 con 0x56495e3c51b0 2024-09-21T06:03:01.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0d9bfff640 1 --2- 172.21.15.7:0/3667234161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7a5cf0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f0d900acf10 tx=0x7f0d900ac9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363c0b4ee7256cc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0d7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0d7bfff640 1 -- 172.21.15.7:0/3667234161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90020070 con 0x56495e3c51b0 2024-09-21T06:03:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0d7bfff640 1 -- 172.21.15.7:0/3667234161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f0d900a91f0 con 0x56495e3c51b0 2024-09-21T06:03:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0da92d5740 1 -- 172.21.15.7:0/3667234161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d900aca90 con 0x56495e3c51b0 2024-09-21T06:03:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0d7bfff640 1 -- 172.21.15.7:0/3667234161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0d9005c020 con 0x56495e3c51b0 2024-09-21T06:03:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0da92d5740 10 client.18078 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0da92d5740 1 -- 172.21.15.7:0/3667234161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56495e81e080 con 0x56495e3c51b0 2024-09-21T06:03:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0d7bfff640 1 -- 172.21.15.7:0/3667234161 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d900aca90 con 0x56495e3c51b0 2024-09-21T06:03:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0d7bfff640 1 -- 172.21.15.7:0/3667234161 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0d9005c230 con 0x56495e3c51b0 2024-09-21T06:03:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0da92d5740 10 client.18078 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0da92d5740 10 client.18078 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:03:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0da92d5740 20 client.18078 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.079+0000 7f0da92d5740 1 --2- 172.21.15.7:0/3667234161 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56495e3ee070 0x56495e820710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.080+0000 7f0da92d5740 4 client.18078 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:03:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.080+0000 7f0da92d5740 1 -- 172.21.15.7:0/3667234161 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56495e7098a0 con 0x56495e3ee070 2024-09-21T06:03:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.080+0000 7f0da0afd640 1 --2- 172.21.15.7:0/3667234161 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56495e3ee070 0x56495e820710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.080+0000 7f0da0afd640 1 --2- 172.21.15.7:0/3667234161 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56495e3ee070 0x56495e820710 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=48f1a7833e93c649 server_cookie=285cdd53301a1fb1 in_seq=0 out_seq=0 2024-09-21T06:03:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.080+0000 7f0d7bfff640 10 client.18078 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:03:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.080+0000 7f0d7bfff640 1 -- 172.21.15.7:0/3667234161 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56495e7098a0 con 0x56495e3ee070 2024-09-21T06:03:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.080+0000 7f0d7bfff640 10 client.18078 handle_command_reply: tid=0 2024-09-21T06:03:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.080+0000 7f0da92d5740 1 client.18078 shutdown 2024-09-21T06:03:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.081+0000 7f0da92d5740 1 -- 172.21.15.7:0/3667234161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 msgr2=0x56495e7a5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.081+0000 7f0da92d5740 1 --2- 172.21.15.7:0/3667234161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7a5cf0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f0d900acf10 tx=0x7f0d900ac9a0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.081+0000 7f0da92d5740 1 -- 172.21.15.7:0/3667234161 shutdown_connections 2024-09-21T06:03:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.081+0000 7f0da92d5740 1 --2- 172.21.15.7:0/3667234161 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x56495e3ee070 0x56495e820710 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.081+0000 7f0da92d5740 1 --2- 172.21.15.7:0/3667234161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56495e3c51b0 0x56495e7a5cf0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.081+0000 7f0da92d5740 1 --2- 172.21.15.7:0/3667234161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56495e3cd390 0x56495e81ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.081+0000 7f0d7bfff640 0 client.18078 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:03:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.081+0000 7f0da92d5740 1 --2- 172.21.15.7:0/3667234161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56495e3ac9f0 0x56495e7a57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.081+0000 7f0da92d5740 1 -- 172.21.15.7:0/3667234161 >> 172.21.15.7:0/3667234161 conn(0x56495e3e2460 msgr2=0x56495e7966d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:01.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.081+0000 7f0da92d5740 1 -- 172.21.15.7:0/3667234161 shutdown_connections 2024-09-21T06:03:01.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.081+0000 7f0da92d5740 1 -- 172.21.15.7:0/3667234161 wait complete. 2024-09-21T06:03:01.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.081+0000 7f0da92d5740 20 client.18078 trim_cache size 0 max 16384 2024-09-21T06:03:01.095 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:03:01.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.082+0000 7f0da2d61640 1 -- 172.21.15.7:0/2489564986 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d840b6680 msgr2=0x7f0d840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:01.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.082+0000 7f0da2d61640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d840b6680 0x7f0d840b8b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0d9401d040 tx=0x7f0d9401aa10 comp rx=0 tx=0).stop 2024-09-21T06:03:01.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.082+0000 7f0da2d61640 1 -- 172.21.15.7:0/2489564986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d9c1083d0 msgr2=0x7f0d9c0ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:01.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.082+0000 7f0da2d61640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d9c1083d0 0x7f0d9c0ffbb0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000d750 tx=0x7f0d9000dc10 comp rx=0 tx=0).stop 2024-09-21T06:03:01.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.082+0000 7f0da2d61640 1 -- 172.21.15.7:0/2489564986 shutdown_connections 2024-09-21T06:03:01.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.082+0000 7f0da2d61640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0d840b6680 0x7f0d840b8b90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.082+0000 7f0da2d61640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d9c1083d0 0x7f0d9c0ffbb0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.082+0000 7f0da2d61640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d9c108d20 0x7f0d9c1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.082+0000 7f0da2d61640 1 --2- 172.21.15.7:0/2489564986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0d9c102ae0 0x7f0d9c0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:01.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.082+0000 7f0da2d61640 1 -- 172.21.15.7:0/2489564986 >> 172.21.15.7:0/2489564986 conn(0x7f0d9c0797b0 msgr2=0x7f0d9c101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:01.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.082+0000 7f0da2d61640 1 -- 172.21.15.7:0/2489564986 shutdown_connections 2024-09-21T06:03:01.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:01.082+0000 7f0da2d61640 1 -- 172.21.15.7:0/2489564986 wait complete. 2024-09-21T06:03:01.866 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:03:02.135 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:02.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:01 smithi027 ceph-mon[34364]: pgmap v598: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T06:03:02.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:01 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:02.256 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:01 smithi007 ceph-mon[30983]: pgmap v598: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T06:03:02.256 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:02.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:01 smithi119 ceph-mon[34833]: pgmap v598: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T06:03:02.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:01 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:02.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.649+0000 7fd47ca35640 1 -- 172.21.15.7:0/3963659975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd478105360 msgr2=0x7fd47810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:02.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.649+0000 7fd47ca35640 1 --2- 172.21.15.7:0/3963659975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd478105360 0x7fd47810d8b0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009900 tx=0x7fd46c02a410 comp rx=0 tx=0).stop 2024-09-21T06:03:02.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.649+0000 7fd47ca35640 1 -- 172.21.15.7:0/3963659975 shutdown_connections 2024-09-21T06:03:02.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.649+0000 7fd47ca35640 1 --2- 172.21.15.7:0/3963659975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd478105360 0x7fd47810d8b0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.649+0000 7fd47ca35640 1 --2- 172.21.15.7:0/3963659975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd47810de40 0x7fd478110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.649+0000 7fd47ca35640 1 --2- 172.21.15.7:0/3963659975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd478104a10 0x7fd478104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.649+0000 7fd47ca35640 1 -- 172.21.15.7:0/3963659975 >> 172.21.15.7:0/3963659975 conn(0x7fd478079720 msgr2=0x7fd478079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:02.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.649+0000 7fd47ca35640 1 -- 172.21.15.7:0/3963659975 shutdown_connections 2024-09-21T06:03:02.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.649+0000 7fd47ca35640 1 -- 172.21.15.7:0/3963659975 wait complete. 2024-09-21T06:03:02.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.650+0000 7fd47ca35640 1 Processor -- start 2024-09-21T06:03:02.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.650+0000 7fd47ca35640 1 -- start start 2024-09-21T06:03:02.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd47ca35640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd478104a10 0x7fd47819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd47ca35640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd478105360 0x7fd47819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd47ca35640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd47810de40 0x7fd47819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd47ca35640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd478113ad0 con 0x7fd478105360 2024-09-21T06:03:02.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd47ca35640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd478113950 con 0x7fd478104a10 2024-09-21T06:03:02.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd47ca35640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd478113c50 con 0x7fd47810de40 2024-09-21T06:03:02.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd475d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd478105360 0x7fd47819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd475d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd478105360 0x7fd47819ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43976/0 (socket says 172.21.15.7:43976) 2024-09-21T06:03:02.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd475d9b640 1 -- 172.21.15.7:0/364586466 learned_addr learned my addr 172.21.15.7:0/364586466 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd47659c640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd478104a10 0x7fd47819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd476d9d640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd47810de40 0x7fd47819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd475d9b640 1 -- 172.21.15.7:0/364586466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd47810de40 msgr2=0x7fd47819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd475d9b640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd47810de40 0x7fd47819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd475d9b640 1 -- 172.21.15.7:0/364586466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd478104a10 msgr2=0x7fd47819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd475d9b640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd478104a10 0x7fd47819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd475d9b640 1 -- 172.21.15.7:0/364586466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4781a04d0 con 0x7fd478105360 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.651+0000 7fd475d9b640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd478105360 0x7fd47819ab00 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fd46c005ab0 tx=0x7fd46c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.652+0000 7fd4677fe640 1 -- 172.21.15.7:0/364586466 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c03f070 con 0x7fd478105360 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.652+0000 7fd4677fe640 1 -- 172.21.15.7:0/364586466 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd46c031b50 con 0x7fd478105360 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.652+0000 7fd47ca35640 1 -- 172.21.15.7:0/364586466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4781a0760 con 0x7fd478105360 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.652+0000 7fd4677fe640 1 -- 172.21.15.7:0/364586466 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c035030 con 0x7fd478105360 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.652+0000 7fd47ca35640 1 -- 172.21.15.7:0/364586466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4781a6f20 con 0x7fd478105360 2024-09-21T06:03:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.654+0000 7fd482fa9740 1 Processor -- start 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.654+0000 7fd482fa9740 1 -- start start 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd4677fe640 1 -- 172.21.15.7:0/364586466 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd46c042070 con 0x7fd478105360 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd482fa9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af7153f070 0x55af718e62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd482fa9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 0x55af718e6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd482fa9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 0x55af718e6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd482fa9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55af7185cea0 con 0x55af7151e390 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd482fa9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55af7184c2d0 con 0x55af715161b0 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd482fa9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55af718500e0 con 0x55af7153f070 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd475d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 0x55af718e6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd475d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 0x55af718e6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43992/0 (socket says 172.21.15.7:43992) 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd475d9b640 1 -- 172.21.15.7:0/2485089644 learned_addr learned my addr 172.21.15.7:0/2485089644 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd476d9d640 1 --2- 172.21.15.7:0/2485089644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af7153f070 0x55af718e62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd47659c640 1 --2- 172.21.15.7:0/2485089644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 0x55af718e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd475d9b640 1 -- 172.21.15.7:0/2485089644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af7153f070 msgr2=0x55af718e62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd475d9b640 1 --2- 172.21.15.7:0/2485089644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af7153f070 0x55af718e62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd475d9b640 1 -- 172.21.15.7:0/2485089644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 msgr2=0x55af718e6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd475d9b640 1 --2- 172.21.15.7:0/2485089644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 0x55af718e6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd475d9b640 1 -- 172.21.15.7:0/2485089644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af715aa650 con 0x55af7151e390 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.655+0000 7fd476d9d640 1 --2- 172.21.15.7:0/2485089644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af7153f070 0x55af718e62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.656+0000 7fd4677fe640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4600b6680 0x7fd4600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.656+0000 7fd475d9b640 1 --2- 172.21.15.7:0/2485089644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 0x55af718e6d40 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fd46c105410 tx=0x7fd46c10bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9899e5b0dea373 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.656+0000 7fd476d9d640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4600b6680 0x7fd4600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.656+0000 7fd4677fe640 1 -- 172.21.15.7:0/364586466 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fd46c107d00 con 0x7fd478105360 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.656+0000 7fd464ff9640 1 -- 172.21.15.7:0/2485089644 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0ca2a0 con 0x55af7151e390 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.656+0000 7fd464ff9640 1 -- 172.21.15.7:0/2485089644 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd46c0c93b0 con 0x55af7151e390 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.656+0000 7fd464ff9640 1 -- 172.21.15.7:0/2485089644 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0cd3c0 con 0x55af7151e390 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.657+0000 7fd482fa9740 1 -- 172.21.15.7:0/2485089644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 msgr2=0x55af718e6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.657+0000 7fd476d9d640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4600b6680 0x7fd4600b8b90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd470009cb0 tx=0x7fd470005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.657+0000 7fd482fa9740 1 --2- 172.21.15.7:0/2485089644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 0x55af718e6d40 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fd46c105410 tx=0x7fd46c10bf50 comp rx=0 tx=0).stop 2024-09-21T06:03:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.657+0000 7fd482fa9740 1 -- 172.21.15.7:0/2485089644 shutdown_connections 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.657+0000 7fd482fa9740 1 --2- 172.21.15.7:0/2485089644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 0x55af718e6d40 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.657+0000 7fd482fa9740 1 --2- 172.21.15.7:0/2485089644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 0x55af718e6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.657+0000 7fd482fa9740 1 --2- 172.21.15.7:0/2485089644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af7153f070 0x55af718e62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.657+0000 7fd482fa9740 1 -- 172.21.15.7:0/2485089644 >> 172.21.15.7:0/2485089644 conn(0x55af71533460 msgr2=0x55af718e41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.657+0000 7fd482fa9740 1 -- 172.21.15.7:0/2485089644 shutdown_connections 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.657+0000 7fd482fa9740 1 -- 172.21.15.7:0/2485089644 wait complete. 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd482fa9740 1 -- start start 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd482fa9740 1 Processor -- start 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd482fa9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 0x55af718f1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd482fa9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 0x55af718f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd482fa9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af7153f070 0x55af718f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd482fa9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55af716ad700 con 0x55af7151e390 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd482fa9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55af717e7160 con 0x55af715161b0 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd482fa9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55af718f4860 con 0x55af7153f070 2024-09-21T06:03:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd482fa9740 10 client.0 _ll_register_callbacks cb 0x55af718009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd475d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 0x55af718f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd475d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 0x55af718f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44008/0 (socket says 172.21.15.7:44008) 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd475d9b640 1 -- 172.21.15.7:0/1201916350 learned_addr learned my addr 172.21.15.7:0/1201916350 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd47659c640 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 0x55af718f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.658+0000 7fd476d9d640 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af7153f070 0x55af718f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd475d9b640 1 -- 172.21.15.7:0/1201916350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af7153f070 msgr2=0x55af718f23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd475d9b640 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af7153f070 0x55af718f23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd475d9b640 1 -- 172.21.15.7:0/1201916350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 msgr2=0x55af718f1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd475d9b640 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 0x55af718f1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd475d9b640 1 -- 172.21.15.7:0/1201916350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af71814c90 con 0x55af7151e390 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd476d9d640 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af7153f070 0x55af718f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd475d9b640 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 0x55af718f1e40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd46c105550 tx=0x7fd46c03b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1546f1f97454f619 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd45dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd45dffb640 1 -- 172.21.15.7:0/1201916350 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c049070 con 0x55af7151e390 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd45dffb640 1 -- 172.21.15.7:0/1201916350 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fd46c0f10e0 con 0x55af7151e390 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd482fa9740 1 -- 172.21.15.7:0/1201916350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd46c0c93b0 con 0x55af7151e390 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd45dffb640 1 -- 172.21.15.7:0/1201916350 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd46c0cd5a0 con 0x55af7151e390 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd482fa9740 10 client.18090 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd482fa9740 1 -- 172.21.15.7:0/1201916350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55af71900550 con 0x55af7151e390 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd45dffb640 1 -- 172.21.15.7:0/1201916350 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd46c0c93b0 con 0x55af7151e390 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.659+0000 7fd45dffb640 1 -- 172.21.15.7:0/1201916350 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd46c105720 con 0x55af7151e390 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.660+0000 7fd482fa9740 10 client.18090 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.660+0000 7fd482fa9740 10 client.18090 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.660+0000 7fd482fa9740 20 client.18090 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.660+0000 7fd482fa9740 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55af714fd9f0 0x55af719038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.660+0000 7fd482fa9740 4 client.18090 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.660+0000 7fd482fa9740 1 -- 172.21.15.7:0/1201916350 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af7185edf0 con 0x55af714fd9f0 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.660+0000 7fd47659c640 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55af714fd9f0 0x55af719038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.660+0000 7fd47659c640 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55af714fd9f0 0x55af719038b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c4dd1bbd8d1f57b3 server_cookie=98389c9af882fd7d in_seq=0 out_seq=0 2024-09-21T06:03:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.660+0000 7fd45dffb640 10 client.18090 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd45dffb640 1 -- 172.21.15.7:0/1201916350 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af7185edf0 con 0x55af714fd9f0 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd45dffb640 10 client.18090 handle_command_reply: tid=0 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd482fa9740 1 client.18090 shutdown 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd482fa9740 1 -- 172.21.15.7:0/1201916350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 msgr2=0x55af718f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd482fa9740 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 0x55af718f1e40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd46c105550 tx=0x7fd46c03b790 comp rx=0 tx=0).stop 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd482fa9740 1 -- 172.21.15.7:0/1201916350 shutdown_connections 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd482fa9740 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55af714fd9f0 0x55af719038b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd482fa9740 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af7151e390 0x55af718f1e40 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd482fa9740 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af7153f070 0x55af718f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd45dffb640 0 client.18090 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd482fa9740 1 --2- 172.21.15.7:0/1201916350 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 0x55af718f1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd482fa9740 1 -- 172.21.15.7:0/1201916350 >> 172.21.15.7:0/1201916350 conn(0x55af71533460 msgr2=0x55af718e9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd482fa9740 1 -- 172.21.15.7:0/1201916350 shutdown_connections 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.661+0000 7fd482fa9740 1 -- 172.21.15.7:0/1201916350 wait complete. 2024-09-21T06:03:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.662+0000 7fd482fa9740 20 client.18090 trim_cache size 0 max 16384 2024-09-21T06:03:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd482fa9740 1 Processor -- start 2024-09-21T06:03:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd482fa9740 1 -- start start 2024-09-21T06:03:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd482fa9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af71533460 0x55af718f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd482fa9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af714fd9f0 0x55af718eeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd482fa9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af715161b0 0x55af718ef030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd482fa9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd4781b1f50 con 0x55af715161b0 2024-09-21T06:03:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd482fa9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd4781af820 con 0x55af714fd9f0 2024-09-21T06:03:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd482fa9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd4781ad690 con 0x55af71533460 2024-09-21T06:03:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd476d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af715161b0 0x55af718ef030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd476d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af715161b0 0x55af718ef030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44018/0 (socket says 172.21.15.7:44018) 2024-09-21T06:03:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd476d9d640 1 -- 172.21.15.7:0/2871561670 learned_addr learned my addr 172.21.15.7:0/2871561670 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd47659c640 1 --2- 172.21.15.7:0/2871561670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af71533460 0x55af718f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd475d9b640 1 --2- 172.21.15.7:0/2871561670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af714fd9f0 0x55af718eeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd476d9d640 1 -- 172.21.15.7:0/2871561670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af71533460 msgr2=0x55af718f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd476d9d640 1 --2- 172.21.15.7:0/2871561670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af71533460 0x55af718f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd476d9d640 1 -- 172.21.15.7:0/2871561670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af714fd9f0 msgr2=0x55af718eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd476d9d640 1 --2- 172.21.15.7:0/2871561670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af714fd9f0 0x55af718eeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd476d9d640 1 -- 172.21.15.7:0/2871561670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af718de460 con 0x55af715161b0 2024-09-21T06:03:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.675+0000 7fd47659c640 1 --2- 172.21.15.7:0/2871561670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af71533460 0x55af718f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.676+0000 7fd476d9d640 1 --2- 172.21.15.7:0/2871561670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af715161b0 0x55af718ef030 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd470004200 tx=0x7fd470017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb480789dee30d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.676+0000 7fd45ffff640 1 -- 172.21.15.7:0/2871561670 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4700043b0 con 0x55af715161b0 2024-09-21T06:03:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.676+0000 7fd45ffff640 1 -- 172.21.15.7:0/2871561670 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd470003b70 con 0x55af715161b0 2024-09-21T06:03:02.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.676+0000 7fd45ffff640 1 -- 172.21.15.7:0/2871561670 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47001fe20 con 0x55af715161b0 2024-09-21T06:03:02.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.677+0000 7fd482fa9740 1 -- 172.21.15.7:0/2871561670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af715161b0 msgr2=0x55af718ef030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:02.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.677+0000 7fd482fa9740 1 --2- 172.21.15.7:0/2871561670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af715161b0 0x55af718ef030 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd470004200 tx=0x7fd470017000 comp rx=0 tx=0).stop 2024-09-21T06:03:02.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.677+0000 7fd482fa9740 1 -- 172.21.15.7:0/2871561670 shutdown_connections 2024-09-21T06:03:02.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.677+0000 7fd482fa9740 1 --2- 172.21.15.7:0/2871561670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af715161b0 0x55af718ef030 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.677+0000 7fd482fa9740 1 --2- 172.21.15.7:0/2871561670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af714fd9f0 0x55af718eeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.677+0000 7fd482fa9740 1 --2- 172.21.15.7:0/2871561670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af71533460 0x55af718f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.677+0000 7fd482fa9740 1 -- 172.21.15.7:0/2871561670 >> 172.21.15.7:0/2871561670 conn(0x55af718e4090 msgr2=0x55af718f16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.677+0000 7fd482fa9740 1 -- 172.21.15.7:0/2871561670 shutdown_connections 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.677+0000 7fd482fa9740 1 -- 172.21.15.7:0/2871561670 wait complete. 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.677+0000 7fd482fa9740 1 -- start start 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.677+0000 7fd482fa9740 1 Processor -- start 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd482fa9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af714fd9f0 0x55af719679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd482fa9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 0x55af71967f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd482fa9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af71533460 0x55af718f9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd482fa9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd4781adce0 con 0x55af714fd9f0 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd482fa9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd4781af150 con 0x55af715161b0 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd482fa9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd4781ae3b0 con 0x55af71533460 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd482fa9740 10 client.0 _ll_register_callbacks cb 0x7fd468009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd47659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af714fd9f0 0x55af719679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd47659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af714fd9f0 0x55af719679d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44034/0 (socket says 172.21.15.7:44034) 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd47659c640 1 -- 172.21.15.7:0/3953166057 learned_addr learned my addr 172.21.15.7:0/3953166057 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd475d9b640 1 --2- 172.21.15.7:0/3953166057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 0x55af71967f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd476d9d640 1 --2- 172.21.15.7:0/3953166057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af71533460 0x55af718f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd47659c640 1 -- 172.21.15.7:0/3953166057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af71533460 msgr2=0x55af718f9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd47659c640 1 --2- 172.21.15.7:0/3953166057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af71533460 0x55af718f9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd47659c640 1 -- 172.21.15.7:0/3953166057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 msgr2=0x55af71967f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd47659c640 1 --2- 172.21.15.7:0/3953166057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 0x55af71967f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd47659c640 1 -- 172.21.15.7:0/3953166057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af718fa0a0 con 0x55af714fd9f0 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd47659c640 1 --2- 172.21.15.7:0/3953166057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af714fd9f0 0x55af719679d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x55af718e4f40 tx=0x7fd468013b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0b39d90ddc8a09 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd45dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd45dffb640 1 -- 172.21.15.7:0/3953166057 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468003b70 con 0x55af714fd9f0 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd45dffb640 1 -- 172.21.15.7:0/3953166057 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fd468003d10 con 0x55af714fd9f0 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.678+0000 7fd482fa9740 1 -- 172.21.15.7:0/3953166057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd470003b70 con 0x55af714fd9f0 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.679+0000 7fd45dffb640 1 -- 172.21.15.7:0/3953166057 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd468029020 con 0x55af714fd9f0 2024-09-21T06:03:02.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.679+0000 7fd482fa9740 10 client.18096 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.679+0000 7fd482fa9740 1 -- 172.21.15.7:0/3953166057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55af71972e20 con 0x55af714fd9f0 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.679+0000 7fd45dffb640 1 -- 172.21.15.7:0/3953166057 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd470003b70 con 0x55af714fd9f0 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.679+0000 7fd45dffb640 1 -- 172.21.15.7:0/3953166057 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd46800f040 con 0x55af714fd9f0 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.679+0000 7fd482fa9740 10 client.18096 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.679+0000 7fd482fa9740 10 client.18096 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.679+0000 7fd482fa9740 20 client.18096 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.679+0000 7fd482fa9740 1 --2- 172.21.15.7:0/3953166057 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55af7151e390 0x55af719755f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.679+0000 7fd482fa9740 4 client.18096 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.679+0000 7fd482fa9740 1 -- 172.21.15.7:0/3953166057 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55af7185a8a0 con 0x55af7151e390 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.679+0000 7fd475d9b640 1 --2- 172.21.15.7:0/3953166057 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55af7151e390 0x55af719755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd475d9b640 1 --2- 172.21.15.7:0/3953166057 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55af7151e390 0x55af719755f0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=120097ef81ebcdd9 server_cookie=2989a44ef0de99be in_seq=0 out_seq=0 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd45dffb640 10 client.18096 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd45dffb640 1 -- 172.21.15.7:0/3953166057 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55af7185a8a0 con 0x55af7151e390 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd45dffb640 10 client.18096 handle_command_reply: tid=0 2024-09-21T06:03:02.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd482fa9740 1 client.18096 shutdown 2024-09-21T06:03:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd482fa9740 1 -- 172.21.15.7:0/3953166057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af714fd9f0 msgr2=0x55af719679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd482fa9740 1 --2- 172.21.15.7:0/3953166057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af714fd9f0 0x55af719679d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x55af718e4f40 tx=0x7fd468013b50 comp rx=0 tx=0).stop 2024-09-21T06:03:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd482fa9740 1 -- 172.21.15.7:0/3953166057 shutdown_connections 2024-09-21T06:03:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd482fa9740 1 --2- 172.21.15.7:0/3953166057 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55af7151e390 0x55af719755f0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd482fa9740 1 --2- 172.21.15.7:0/3953166057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55af71533460 0x55af718f9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd482fa9740 1 --2- 172.21.15.7:0/3953166057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55af715161b0 0x55af71967f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd482fa9740 1 --2- 172.21.15.7:0/3953166057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af714fd9f0 0x55af719679d0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd482fa9740 1 -- 172.21.15.7:0/3953166057 >> 172.21.15.7:0/3953166057 conn(0x55af718e4090 msgr2=0x55af718e72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd45dffb640 0 client.18096 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:03:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd482fa9740 1 -- 172.21.15.7:0/3953166057 shutdown_connections 2024-09-21T06:03:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd482fa9740 1 -- 172.21.15.7:0/3953166057 wait complete. 2024-09-21T06:03:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.680+0000 7fd482fa9740 20 client.18096 trim_cache size 0 max 16384 2024-09-21T06:03:02.688 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:03:02.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.681+0000 7fd47ca35640 1 -- 172.21.15.7:0/364586466 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4600b6680 msgr2=0x7fd4600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:02.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.681+0000 7fd47ca35640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4600b6680 0x7fd4600b8b90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd470009cb0 tx=0x7fd470005f90 comp rx=0 tx=0).stop 2024-09-21T06:03:02.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.681+0000 7fd47ca35640 1 -- 172.21.15.7:0/364586466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd478105360 msgr2=0x7fd47819ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:02.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.681+0000 7fd47ca35640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd478105360 0x7fd47819ab00 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fd46c005ab0 tx=0x7fd46c003b90 comp rx=0 tx=0).stop 2024-09-21T06:03:02.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.681+0000 7fd47ca35640 1 -- 172.21.15.7:0/364586466 shutdown_connections 2024-09-21T06:03:02.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.681+0000 7fd47ca35640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd4600b6680 0x7fd4600b8b90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.681+0000 7fd47ca35640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd478105360 0x7fd47819ab00 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.681+0000 7fd47ca35640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd47810de40 0x7fd47819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.681+0000 7fd47ca35640 1 --2- 172.21.15.7:0/364586466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd478104a10 0x7fd47819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.681+0000 7fd47ca35640 1 -- 172.21.15.7:0/364586466 >> 172.21.15.7:0/364586466 conn(0x7fd478079720 msgr2=0x7fd4780ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.681+0000 7fd47ca35640 1 -- 172.21.15.7:0/364586466 shutdown_connections 2024-09-21T06:03:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:02.681+0000 7fd47ca35640 1 -- 172.21.15.7:0/364586466 wait complete. 2024-09-21T06:03:03.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:02 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:03.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:02 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:03.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:02 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:03:03.281 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:03.281 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:03.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:03:03.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:02 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:03.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:02 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:03.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:02 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:03:03.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:03:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:04.266 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:04 smithi007 ceph-mon[30983]: pgmap v599: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:03:04.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.276+0000 7fb7abe91640 1 -- 172.21.15.7:0/274720909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7a4108d20 msgr2=0x7fb7a410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:04.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.276+0000 7fb7abe91640 1 --2- 172.21.15.7:0/274720909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7a4108d20 0x7fb7a410f550 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fb79c009ca0 tx=0x7fb79c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.276+0000 7fb7abe91640 1 -- 172.21.15.7:0/274720909 shutdown_connections 2024-09-21T06:03:04.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.276+0000 7fb7abe91640 1 --2- 172.21.15.7:0/274720909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7a4108d20 0x7fb7a410f550 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.276+0000 7fb7abe91640 1 --2- 172.21.15.7:0/274720909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a41083d0 0x7fb7a41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.276+0000 7fb7abe91640 1 --2- 172.21.15.7:0/274720909 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7a4102ae0 0x7fb7a4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.276+0000 7fb7abe91640 1 -- 172.21.15.7:0/274720909 >> 172.21.15.7:0/274720909 conn(0x7fb7a4079760 msgr2=0x7fb7a4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:04.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.276+0000 7fb7abe91640 1 -- 172.21.15.7:0/274720909 shutdown_connections 2024-09-21T06:03:04.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.276+0000 7fb7abe91640 1 -- 172.21.15.7:0/274720909 wait complete. 2024-09-21T06:03:04.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7abe91640 1 Processor -- start 2024-09-21T06:03:04.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7abe91640 1 -- start start 2024-09-21T06:03:04.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7abe91640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7a4102ae0 0x7fb7a419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7abe91640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a41083d0 0x7fb7a419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7abe91640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7a4108d20 0x7fb7a41a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7abe91640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a4112990 con 0x7fb7a4108d20 2024-09-21T06:03:04.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7abe91640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a4112810 con 0x7fb7a4102ae0 2024-09-21T06:03:04.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7abe91640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a4112b10 con 0x7fb7a41083d0 2024-09-21T06:03:04.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7aa42e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7a4108d20 0x7fb7a41a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7aa42e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7a4108d20 0x7fb7a41a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44048/0 (socket says 172.21.15.7:44048) 2024-09-21T06:03:04.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7aa42e640 1 -- 172.21.15.7:0/960884608 learned_addr learned my addr 172.21.15.7:0/960884608 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:04.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7a9c2d640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7a4102ae0 0x7fb7a419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7a942c640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a41083d0 0x7fb7a419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7aa42e640 1 -- 172.21.15.7:0/960884608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a41083d0 msgr2=0x7fb7a419cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:04.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7aa42e640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a41083d0 0x7fb7a419cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7aa42e640 1 -- 172.21.15.7:0/960884608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7a4102ae0 msgr2=0x7fb7a419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:04.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7aa42e640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7a4102ae0 0x7fb7a419c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.277+0000 7fb7aa42e640 1 -- 172.21.15.7:0/960884608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a41a2580 con 0x7fb7a4108d20 2024-09-21T06:03:04.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.278+0000 7fb7aa42e640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7a4108d20 0x7fb7a41a1e50 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fb79c005cc0 tx=0x7fb79c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:04.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.278+0000 7fb79affd640 1 -- 172.21.15.7:0/960884608 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c003bf0 con 0x7fb7a4108d20 2024-09-21T06:03:04.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.278+0000 7fb7abe91640 1 -- 172.21.15.7:0/960884608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a41a2810 con 0x7fb7a4108d20 2024-09-21T06:03:04.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.278+0000 7fb79affd640 1 -- 172.21.15.7:0/960884608 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb79c003d90 con 0x7fb7a4108d20 2024-09-21T06:03:04.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.278+0000 7fb79affd640 1 -- 172.21.15.7:0/960884608 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c02fbc0 con 0x7fb7a4108d20 2024-09-21T06:03:04.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.278+0000 7fb7abe91640 1 -- 172.21.15.7:0/960884608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a41a8fd0 con 0x7fb7a4108d20 2024-09-21T06:03:04.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.281+0000 7fb79affd640 1 -- 172.21.15.7:0/960884608 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb79c02fd60 con 0x7fb7a4108d20 2024-09-21T06:03:04.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.281+0000 7fb7b2405740 1 Processor -- start 2024-09-21T06:03:04.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.281+0000 7fb7b2405740 1 -- start start 2024-09-21T06:03:04.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.281+0000 7fb7b2405740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 0x5570969386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7b2405740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570965681b0 0x557096938be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7b2405740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557096570390 0x557096939120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7b2405740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5570968aeea0 con 0x557096591070 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7b2405740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55709689e2d0 con 0x557096570390 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7b2405740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5570968a20e0 con 0x5570965681b0 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7a942c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 0x5570969386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7a942c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 0x5570969386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44056/0 (socket says 172.21.15.7:44056) 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7a942c640 1 -- 172.21.15.7:0/4291888553 learned_addr learned my addr 172.21.15.7:0/4291888553 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7a9c2d640 1 --2- 172.21.15.7:0/4291888553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570965681b0 0x557096938be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7a942c640 1 --2- 172.21.15.7:0/4291888553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557096570390 0x557096939120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7a942c640 1 -- 172.21.15.7:0/4291888553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570965681b0 msgr2=0x557096938be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7a942c640 1 --2- 172.21.15.7:0/4291888553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570965681b0 0x557096938be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7a942c640 1 -- 172.21.15.7:0/4291888553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557096570390 msgr2=0x557096939120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7a942c640 1 --2- 172.21.15.7:0/4291888553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557096570390 0x557096939120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7a942c640 1 -- 172.21.15.7:0/4291888553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570965fc650 con 0x557096591070 2024-09-21T06:03:04.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb79affd640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb7900b6680 0x7fb7900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7a9c2d640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb7900b6680 0x7fb7900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb7a942c640 1 --2- 172.21.15.7:0/4291888553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 0x5570969386a0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fb79400b8b0 tx=0x7fb794004210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ddeecee35d5a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:04.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.282+0000 7fb79affd640 1 -- 172.21.15.7:0/960884608 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fb79c108bb0 con 0x7fb7a4108d20 2024-09-21T06:03:04.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.283+0000 7fb78ffff640 1 -- 172.21.15.7:0/4291888553 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794003d70 con 0x557096591070 2024-09-21T06:03:04.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.283+0000 7fb78ffff640 1 -- 172.21.15.7:0/4291888553 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7940054d0 con 0x557096591070 2024-09-21T06:03:04.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.283+0000 7fb78ffff640 1 -- 172.21.15.7:0/4291888553 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794010460 con 0x557096591070 2024-09-21T06:03:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.284+0000 7fb7b2405740 1 -- 172.21.15.7:0/4291888553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 msgr2=0x5570969386a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.284+0000 7fb7a9c2d640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb7900b6680 0x7fb7900b8b90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x557096937320 tx=0x7fb7a000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.284+0000 7fb7b2405740 1 --2- 172.21.15.7:0/4291888553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 0x5570969386a0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fb79400b8b0 tx=0x7fb794004210 comp rx=0 tx=0).stop 2024-09-21T06:03:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.284+0000 7fb7b2405740 1 -- 172.21.15.7:0/4291888553 shutdown_connections 2024-09-21T06:03:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.284+0000 7fb7b2405740 1 --2- 172.21.15.7:0/4291888553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557096570390 0x557096939120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.284+0000 7fb7b2405740 1 --2- 172.21.15.7:0/4291888553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570965681b0 0x557096938be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.284+0000 7fb7b2405740 1 --2- 172.21.15.7:0/4291888553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 0x5570969386a0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.284+0000 7fb7b2405740 1 -- 172.21.15.7:0/4291888553 >> 172.21.15.7:0/4291888553 conn(0x557096585460 msgr2=0x557096936590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.284+0000 7fb7b2405740 1 -- 172.21.15.7:0/4291888553 shutdown_connections 2024-09-21T06:03:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.284+0000 7fb7b2405740 1 -- 172.21.15.7:0/4291888553 wait complete. 2024-09-21T06:03:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.284+0000 7fb7b2405740 1 -- start start 2024-09-21T06:03:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.284+0000 7fb7b2405740 1 Processor -- start 2024-09-21T06:03:04.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7b2405740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5570965681b0 0x557096943d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7b2405740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096570390 0x5570969442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7b2405740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 0x5570969501a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7b2405740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5570966ff700 con 0x557096591070 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7b2405740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x557096839160 con 0x5570965681b0 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7b2405740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557096946e80 con 0x557096570390 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7b2405740 10 client.0 _ll_register_callbacks cb 0x5570968529e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7aa42e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 0x5570969501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7aa42e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 0x5570969501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44070/0 (socket says 172.21.15.7:44070) 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7aa42e640 1 -- 172.21.15.7:0/4063723373 learned_addr learned my addr 172.21.15.7:0/4063723373 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7a942c640 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096570390 0x5570969442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7a9c2d640 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5570965681b0 0x557096943d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7aa42e640 1 -- 172.21.15.7:0/4063723373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096570390 msgr2=0x5570969442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7aa42e640 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096570390 0x5570969442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7aa42e640 1 -- 172.21.15.7:0/4063723373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5570965681b0 msgr2=0x557096943d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:04.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7aa42e640 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5570965681b0 0x557096943d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7aa42e640 1 -- 172.21.15.7:0/4063723373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557096866c90 con 0x557096591070 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.285+0000 7fb7a9c2d640 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5570965681b0 0x557096943d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.286+0000 7fb7aa42e640 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 0x5570969501a0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0ce750 tx=0x7fb79c0ce280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf234e9bf171f20e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.286+0000 7fb78d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.286+0000 7fb78d7fa640 1 -- 172.21.15.7:0/4063723373 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c0d3530 con 0x557096591070 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.286+0000 7fb78d7fa640 1 -- 172.21.15.7:0/4063723373 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fb79c004610 con 0x557096591070 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.286+0000 7fb7b2405740 1 -- 172.21.15.7:0/4063723373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7940054d0 con 0x557096591070 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.286+0000 7fb78d7fa640 1 -- 172.21.15.7:0/4063723373 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb79c0d8470 con 0x557096591070 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.286+0000 7fb7b2405740 10 client.18108 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.286+0000 7fb7b2405740 1 -- 172.21.15.7:0/4063723373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557096952b80 con 0x557096591070 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.286+0000 7fb78d7fa640 1 -- 172.21.15.7:0/4063723373 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7940054d0 con 0x557096591070 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.286+0000 7fb78d7fa640 1 -- 172.21.15.7:0/4063723373 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb79c0d7fe0 con 0x557096591070 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.287+0000 7fb7b2405740 10 client.18108 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.287+0000 7fb7b2405740 10 client.18108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:04.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.287+0000 7fb7b2405740 20 client.18108 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:04.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.287+0000 7fb7b2405740 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55709654f9f0 0x557096956070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.287+0000 7fb7b2405740 4 client.18108 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:04.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.287+0000 7fb7b2405740 1 -- 172.21.15.7:0/4063723373 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570968b0df0 con 0x55709654f9f0 2024-09-21T06:03:04.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.287+0000 7fb7a9c2d640 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55709654f9f0 0x557096956070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.287+0000 7fb7a9c2d640 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55709654f9f0 0x557096956070 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d32270e2a7bbf208 server_cookie=957ea6f9061013dd in_seq=0 out_seq=0 2024-09-21T06:03:04.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.287+0000 7fb78d7fa640 10 client.18108 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:04.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.288+0000 7fb78d7fa640 1 -- 172.21.15.7:0/4063723373 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5570968b0df0 con 0x55709654f9f0 2024-09-21T06:03:04.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.288+0000 7fb78d7fa640 10 client.18108 handle_command_reply: tid=0 2024-09-21T06:03:04.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.288+0000 7fb7b2405740 1 client.18108 shutdown 2024-09-21T06:03:04.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.288+0000 7fb7b2405740 1 -- 172.21.15.7:0/4063723373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 msgr2=0x5570969501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:04.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.288+0000 7fb7b2405740 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 0x5570969501a0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0ce750 tx=0x7fb79c0ce280 comp rx=0 tx=0).stop 2024-09-21T06:03:04.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.288+0000 7fb7b2405740 1 -- 172.21.15.7:0/4063723373 shutdown_connections 2024-09-21T06:03:04.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.288+0000 7fb7b2405740 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55709654f9f0 0x557096956070 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.288+0000 7fb7b2405740 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096591070 0x5570969501a0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.288+0000 7fb7b2405740 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096570390 0x5570969442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.288+0000 7fb78d7fa640 0 client.18108 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:04.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.288+0000 7fb7b2405740 1 --2- 172.21.15.7:0/4063723373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5570965681b0 0x557096943d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.288+0000 7fb7b2405740 1 -- 172.21.15.7:0/4063723373 >> 172.21.15.7:0/4063723373 conn(0x557096585460 msgr2=0x55709693b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:04.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.288+0000 7fb7b2405740 1 -- 172.21.15.7:0/4063723373 shutdown_connections 2024-09-21T06:03:04.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.289+0000 7fb7b2405740 1 -- 172.21.15.7:0/4063723373 wait complete. 2024-09-21T06:03:04.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.289+0000 7fb7b2405740 20 client.18108 trim_cache size 0 max 16384 2024-09-21T06:03:04.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.302+0000 7fb7b2405740 1 Processor -- start 2024-09-21T06:03:04.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.302+0000 7fb7b2405740 1 -- start start 2024-09-21T06:03:04.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.302+0000 7fb7b2405740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5570965681b0 0x557096939de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.302+0000 7fb7b2405740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096570390 0x5570969500a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.302+0000 7fb7b2405740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096591070 0x557096940f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.302+0000 7fb7b2405740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a41b3f50 con 0x557096570390 2024-09-21T06:03:04.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.302+0000 7fb7b2405740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a41b1820 con 0x5570965681b0 2024-09-21T06:03:04.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.302+0000 7fb7b2405740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a41af690 con 0x557096591070 2024-09-21T06:03:04.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.302+0000 7fb7a942c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096570390 0x5570969500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.302+0000 7fb7a942c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096570390 0x5570969500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44076/0 (socket says 172.21.15.7:44076) 2024-09-21T06:03:04.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.302+0000 7fb7a942c640 1 -- 172.21.15.7:0/1073502010 learned_addr learned my addr 172.21.15.7:0/1073502010 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:04.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.302+0000 7fb7a9c2d640 1 --2- 172.21.15.7:0/1073502010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5570965681b0 0x557096939de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.302+0000 7fb7aa42e640 1 --2- 172.21.15.7:0/1073502010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096591070 0x557096940f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.303+0000 7fb7a942c640 1 -- 172.21.15.7:0/1073502010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096591070 msgr2=0x557096940f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:04.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.303+0000 7fb7a942c640 1 --2- 172.21.15.7:0/1073502010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096591070 0x557096940f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.303+0000 7fb7a942c640 1 -- 172.21.15.7:0/1073502010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5570965681b0 msgr2=0x557096939de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:04.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.303+0000 7fb7a942c640 1 --2- 172.21.15.7:0/1073502010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5570965681b0 0x557096939de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.303+0000 7fb7a942c640 1 -- 172.21.15.7:0/1073502010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709693b500 con 0x557096570390 2024-09-21T06:03:04.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.303+0000 7fb7aa42e640 1 --2- 172.21.15.7:0/1073502010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096591070 0x557096940f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:04.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.303+0000 7fb7a942c640 1 --2- 172.21.15.7:0/1073502010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096570390 0x5570969500a0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fb794006010 tx=0x7fb794004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba33330e0624089 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:04.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.303+0000 7fb78f7fe640 1 -- 172.21.15.7:0/1073502010 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7940047f0 con 0x557096570390 2024-09-21T06:03:04.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.303+0000 7fb78f7fe640 1 -- 172.21.15.7:0/1073502010 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb794014030 con 0x557096570390 2024-09-21T06:03:04.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.303+0000 7fb78f7fe640 1 -- 172.21.15.7:0/1073502010 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794010d60 con 0x557096570390 2024-09-21T06:03:04.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.304+0000 7fb7b2405740 1 -- 172.21.15.7:0/1073502010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096570390 msgr2=0x5570969500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:04.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.304+0000 7fb7b2405740 1 --2- 172.21.15.7:0/1073502010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096570390 0x5570969500a0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fb794006010 tx=0x7fb794004680 comp rx=0 tx=0).stop 2024-09-21T06:03:04.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.304+0000 7fb7b2405740 1 -- 172.21.15.7:0/1073502010 shutdown_connections 2024-09-21T06:03:04.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.304+0000 7fb7b2405740 1 --2- 172.21.15.7:0/1073502010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557096570390 0x5570969500a0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.304+0000 7fb7b2405740 1 --2- 172.21.15.7:0/1073502010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096591070 0x557096940f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.304+0000 7fb7b2405740 1 --2- 172.21.15.7:0/1073502010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5570965681b0 0x557096939de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.304+0000 7fb7b2405740 1 -- 172.21.15.7:0/1073502010 >> 172.21.15.7:0/1073502010 conn(0x557096585460 msgr2=0x5570969396d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.304+0000 7fb7b2405740 1 -- 172.21.15.7:0/1073502010 shutdown_connections 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.304+0000 7fb7b2405740 1 -- 172.21.15.7:0/1073502010 wait complete. 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.304+0000 7fb7b2405740 1 -- start start 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.304+0000 7fb7b2405740 1 Processor -- start 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7b2405740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570965681b0 0x557096948770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7b2405740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557096570390 0x557096948cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7b2405740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096591070 0x5570969bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7b2405740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a41afce0 con 0x5570965681b0 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7b2405740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a41b1150 con 0x557096570390 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7b2405740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a41b03b0 con 0x557096591070 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7b2405740 10 client.0 _ll_register_callbacks cb 0x7fb79c009430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7a9c2d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570965681b0 0x557096948770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7a942c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557096570390 0x557096948cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7a9c2d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570965681b0 0x557096948770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44080/0 (socket says 172.21.15.7:44080) 2024-09-21T06:03:04.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7a9c2d640 1 -- 172.21.15.7:0/1260599877 learned_addr learned my addr 172.21.15.7:0/1260599877 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:04.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7aa42e640 1 --2- 172.21.15.7:0/1260599877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096591070 0x5570969bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7a942c640 1 -- 172.21.15.7:0/1260599877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096591070 msgr2=0x5570969bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:04.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7a942c640 1 --2- 172.21.15.7:0/1260599877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096591070 0x5570969bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7a942c640 1 -- 172.21.15.7:0/1260599877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570965681b0 msgr2=0x557096948770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:04.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7a942c640 1 --2- 172.21.15.7:0/1260599877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570965681b0 0x557096948770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7a942c640 1 -- 172.21.15.7:0/1260599877 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570969bff40 con 0x557096570390 2024-09-21T06:03:04.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.305+0000 7fb7aa42e640 1 --2- 172.21.15.7:0/1260599877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096591070 0x5570969bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:04.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.306+0000 7fb7a942c640 1 --2- 172.21.15.7:0/1260599877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557096570390 0x557096948cb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb794000c00 tx=0x7fb794010d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8645bdd80050bdb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:04.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.306+0000 7fb78d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T06:03:04.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.306+0000 7fb78d7fa640 1 -- 172.21.15.7:0/1260599877 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794003d00 con 0x557096570390 2024-09-21T06:03:04.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.306+0000 7fb7b2405740 1 -- 172.21.15.7:0/1260599877 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb794014030 con 0x557096570390 2024-09-21T06:03:04.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.306+0000 7fb78d7fa640 1 -- 172.21.15.7:0/1260599877 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fb794023040 con 0x557096570390 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.306+0000 7fb78d7fa640 1 -- 172.21.15.7:0/1260599877 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb79403d050 con 0x557096570390 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.306+0000 7fb7b2405740 10 client.27398 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.306+0000 7fb7b2405740 1 -- 172.21.15.7:0/1260599877 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5570969c1120 con 0x557096570390 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.306+0000 7fb78d7fa640 1 -- 172.21.15.7:0/1260599877 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb794014030 con 0x557096570390 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.307+0000 7fb78d7fa640 1 -- 172.21.15.7:0/1260599877 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb794027800 con 0x557096570390 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.307+0000 7fb7b2405740 10 client.27398 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.307+0000 7fb7b2405740 10 client.27398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.307+0000 7fb7b2405740 20 client.27398 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.307+0000 7fb7b2405740 1 --2- 172.21.15.7:0/1260599877 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557096524da0 0x5570969c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.307+0000 7fb7b2405740 4 client.27398 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.307+0000 7fb7b2405740 1 -- 172.21.15.7:0/1260599877 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5570968ac8a0 con 0x557096524da0 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.307+0000 7fb7a9c2d640 1 --2- 172.21.15.7:0/1260599877 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557096524da0 0x5570969c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.307+0000 7fb7a9c2d640 1 --2- 172.21.15.7:0/1260599877 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557096524da0 0x5570969c35e0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14e8d249aee8fe7e server_cookie=90023434415c53f0 in_seq=0 out_seq=0 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.307+0000 7fb78d7fa640 10 client.27398 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb78d7fa640 1 -- 172.21.15.7:0/1260599877 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5570968ac8a0 con 0x557096524da0 2024-09-21T06:03:04.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb78d7fa640 10 client.27398 handle_command_reply: tid=0 2024-09-21T06:03:04.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb7b2405740 1 client.27398 shutdown 2024-09-21T06:03:04.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb7b2405740 1 -- 172.21.15.7:0/1260599877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557096570390 msgr2=0x557096948cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:04.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb7b2405740 1 --2- 172.21.15.7:0/1260599877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557096570390 0x557096948cb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb794000c00 tx=0x7fb794010d10 comp rx=0 tx=0).stop 2024-09-21T06:03:04.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb7b2405740 1 -- 172.21.15.7:0/1260599877 shutdown_connections 2024-09-21T06:03:04.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb7b2405740 1 --2- 172.21.15.7:0/1260599877 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x557096524da0 0x5570969c35e0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb7b2405740 1 --2- 172.21.15.7:0/1260599877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557096591070 0x5570969bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb7b2405740 1 --2- 172.21.15.7:0/1260599877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x557096570390 0x557096948cb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb7b2405740 1 --2- 172.21.15.7:0/1260599877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570965681b0 0x557096948770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb78d7fa640 0 client.27398 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:04.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb7b2405740 1 -- 172.21.15.7:0/1260599877 >> 172.21.15.7:0/1260599877 conn(0x557096585460 msgr2=0x5570969421f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:04.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb7b2405740 1 -- 172.21.15.7:0/1260599877 shutdown_connections 2024-09-21T06:03:04.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb7b2405740 1 -- 172.21.15.7:0/1260599877 wait complete. 2024-09-21T06:03:04.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.308+0000 7fb7b2405740 20 client.27398 trim_cache size 0 max 16384 2024-09-21T06:03:04.314 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:03:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.309+0000 7fb7abe91640 1 -- 172.21.15.7:0/960884608 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb7900b6680 msgr2=0x7fb7900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.309+0000 7fb7abe91640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb7900b6680 0x7fb7900b8b90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x557096937320 tx=0x7fb7a000b390 comp rx=0 tx=0).stop 2024-09-21T06:03:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.309+0000 7fb7abe91640 1 -- 172.21.15.7:0/960884608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7a4108d20 msgr2=0x7fb7a41a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.309+0000 7fb7abe91640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7a4108d20 0x7fb7a41a1e50 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fb79c005cc0 tx=0x7fb79c02f380 comp rx=0 tx=0).stop 2024-09-21T06:03:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.309+0000 7fb7abe91640 1 -- 172.21.15.7:0/960884608 shutdown_connections 2024-09-21T06:03:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.309+0000 7fb7abe91640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb7900b6680 0x7fb7900b8b90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.309+0000 7fb7abe91640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7a4108d20 0x7fb7a41a1e50 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.309+0000 7fb7abe91640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a41083d0 0x7fb7a419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.309+0000 7fb7abe91640 1 --2- 172.21.15.7:0/960884608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7a4102ae0 0x7fb7a419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.309+0000 7fb7abe91640 1 -- 172.21.15.7:0/960884608 >> 172.21.15.7:0/960884608 conn(0x7fb7a4079760 msgr2=0x7fb7a406bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.309+0000 7fb7abe91640 1 -- 172.21.15.7:0/960884608 shutdown_connections 2024-09-21T06:03:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:04.309+0000 7fb7abe91640 1 -- 172.21.15.7:0/960884608 wait complete. 2024-09-21T06:03:04.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:04 smithi119 ceph-mon[34833]: pgmap v599: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:03:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:04 smithi027 ceph-mon[34364]: pgmap v599: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:03:06.088 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:03:06.088 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:03:06.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:06 smithi007 ceph-mon[30983]: pgmap v600: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T06:03:06.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:06 smithi119 ceph-mon[34833]: pgmap v600: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T06:03:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:06.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:06 smithi027 ceph-mon[34364]: pgmap v600: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T06:03:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.903+0000 7f4b732d7640 1 -- 172.21.15.7:0/2974186887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b6c103b60 msgr2=0x7f4b6c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.903+0000 7f4b732d7640 1 --2- 172.21.15.7:0/2974186887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b6c103b60 0x7f4b6c103f70 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f4b68009900 tx=0x7f4b6802a410 comp rx=0 tx=0).stop 2024-09-21T06:03:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.903+0000 7f4b732d7640 1 -- 172.21.15.7:0/2974186887 shutdown_connections 2024-09-21T06:03:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.903+0000 7f4b732d7640 1 --2- 172.21.15.7:0/2974186887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c109df0 0x7f4b6c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.903+0000 7f4b732d7640 1 --2- 172.21.15.7:0/2974186887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b6c1094a0 0x7f4b6c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.903+0000 7f4b732d7640 1 --2- 172.21.15.7:0/2974186887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b6c103b60 0x7f4b6c103f70 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.903+0000 7f4b732d7640 1 -- 172.21.15.7:0/2974186887 >> 172.21.15.7:0/2974186887 conn(0x7f4b6c07b850 msgr2=0x7f4b6c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.903+0000 7f4b732d7640 1 -- 172.21.15.7:0/2974186887 shutdown_connections 2024-09-21T06:03:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.903+0000 7f4b732d7640 1 -- 172.21.15.7:0/2974186887 wait complete. 2024-09-21T06:03:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.903+0000 7f4b732d7640 1 Processor -- start 2024-09-21T06:03:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b732d7640 1 -- start start 2024-09-21T06:03:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b732d7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b6c103b60 0x7f4b6c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b732d7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b6c1094a0 0x7f4b6c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b732d7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c109df0 0x7f4b6c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b732d7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c113ab0 con 0x7f4b6c103b60 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b732d7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c113930 con 0x7f4b6c1094a0 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b732d7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c113c30 con 0x7f4b6c109df0 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b71073640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b6c103b60 0x7f4b6c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b71073640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b6c103b60 0x7f4b6c19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44100/0 (socket says 172.21.15.7:44100) 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b71073640 1 -- 172.21.15.7:0/3764671804 learned_addr learned my addr 172.21.15.7:0/3764671804 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b70872640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b6c1094a0 0x7f4b6c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b71874640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c109df0 0x7f4b6c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b71073640 1 -- 172.21.15.7:0/3764671804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c109df0 msgr2=0x7f4b6c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b71073640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c109df0 0x7f4b6c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b71073640 1 -- 172.21.15.7:0/3764671804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b6c1094a0 msgr2=0x7f4b6c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b71073640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b6c1094a0 0x7f4b6c19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.904+0000 7f4b71073640 1 -- 172.21.15.7:0/3764671804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c1a03f0 con 0x7f4b6c103b60 2024-09-21T06:03:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.905+0000 7f4b71073640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b6c103b60 0x7f4b6c19a480 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f4b68005940 tx=0x7f4b680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.905+0000 7f4b627fc640 1 -- 172.21.15.7:0/3764671804 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6803f030 con 0x7f4b6c103b60 2024-09-21T06:03:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.905+0000 7f4b732d7640 1 -- 172.21.15.7:0/3764671804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6c1a0680 con 0x7f4b6c103b60 2024-09-21T06:03:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.905+0000 7f4b627fc640 1 -- 172.21.15.7:0/3764671804 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b68003cb0 con 0x7f4b6c103b60 2024-09-21T06:03:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.905+0000 7f4b627fc640 1 -- 172.21.15.7:0/3764671804 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b68035070 con 0x7f4b6c103b60 2024-09-21T06:03:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.905+0000 7f4b732d7640 1 -- 172.21.15.7:0/3764671804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6c1a6e40 con 0x7f4b6c103b60 2024-09-21T06:03:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.908+0000 7f4b7984b740 1 Processor -- start 2024-09-21T06:03:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.908+0000 7f4b7984b740 1 -- start start 2024-09-21T06:03:06.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.908+0000 7f4b7984b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6c01350 0x55f3e6fa8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.908+0000 7f4b7984b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 0x55f3e6fa8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.908+0000 7f4b627fc640 1 -- 172.21.15.7:0/3764671804 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f4b68042030 con 0x7f4b6c103b60 2024-09-21T06:03:06.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.908+0000 7f4b7984b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6be0670 0x55f3e6fa8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.908+0000 7f4b7984b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f3e6f1ee60 con 0x55f3e6c01350 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.908+0000 7f4b7984b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f3e6f0e290 con 0x55f3e6be0670 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.908+0000 7f4b7984b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f3e6f120a0 con 0x55f3e6bd8490 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.908+0000 7f4b71874640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6c01350 0x55f3e6fa8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.908+0000 7f4b71874640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6c01350 0x55f3e6fa8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44116/0 (socket says 172.21.15.7:44116) 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.908+0000 7f4b71874640 1 -- 172.21.15.7:0/1302517975 learned_addr learned my addr 172.21.15.7:0/1302517975 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.908+0000 7f4b71073640 1 --2- 172.21.15.7:0/1302517975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 0x55f3e6fa8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.909+0000 7f4b70872640 1 --2- 172.21.15.7:0/1302517975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6be0670 0x55f3e6fa8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.909+0000 7f4b71874640 1 -- 172.21.15.7:0/1302517975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 msgr2=0x55f3e6fa8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.909+0000 7f4b71874640 1 --2- 172.21.15.7:0/1302517975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 0x55f3e6fa8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.909+0000 7f4b71874640 1 -- 172.21.15.7:0/1302517975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6be0670 msgr2=0x55f3e6fa8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.909+0000 7f4b71874640 1 --2- 172.21.15.7:0/1302517975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6be0670 0x55f3e6fa8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.909+0000 7f4b71874640 1 -- 172.21.15.7:0/1302517975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3e6c6c930 con 0x55f3e6c01350 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.909+0000 7f4b71874640 1 --2- 172.21.15.7:0/1302517975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6c01350 0x55f3e6fa8430 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009ee0 tx=0x7f4b64010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429b220d2345c9ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.909+0000 7f4b577fe640 1 -- 172.21.15.7:0/1302517975 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64016070 con 0x55f3e6c01350 2024-09-21T06:03:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.909+0000 7f4b627fc640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b580b6680 0x7f4b580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.909+0000 7f4b577fe640 1 -- 172.21.15.7:0/1302517975 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b64004d20 con 0x55f3e6c01350 2024-09-21T06:03:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.909+0000 7f4b577fe640 1 -- 172.21.15.7:0/1302517975 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64012740 con 0x55f3e6c01350 2024-09-21T06:03:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.910+0000 7f4b71073640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b580b6680 0x7f4b580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.910+0000 7f4b627fc640 1 -- 172.21.15.7:0/3764671804 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f4b68108030 con 0x7f4b6c103b60 2024-09-21T06:03:06.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.910+0000 7f4b7984b740 1 -- 172.21.15.7:0/1302517975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6c01350 msgr2=0x55f3e6fa8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:06.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.910+0000 7f4b7984b740 1 --2- 172.21.15.7:0/1302517975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6c01350 0x55f3e6fa8430 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009ee0 tx=0x7f4b64010740 comp rx=0 tx=0).stop 2024-09-21T06:03:06.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.910+0000 7f4b71073640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b580b6680 0x7f4b580b8b90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b68105880 tx=0x7f4b6810bb80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:06.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.910+0000 7f4b7984b740 1 -- 172.21.15.7:0/1302517975 shutdown_connections 2024-09-21T06:03:06.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.910+0000 7f4b7984b740 1 --2- 172.21.15.7:0/1302517975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6be0670 0x55f3e6fa8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.910+0000 7f4b7984b740 1 --2- 172.21.15.7:0/1302517975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 0x55f3e6fa8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.910+0000 7f4b7984b740 1 --2- 172.21.15.7:0/1302517975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6c01350 0x55f3e6fa8430 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.910+0000 7f4b7984b740 1 -- 172.21.15.7:0/1302517975 >> 172.21.15.7:0/1302517975 conn(0x55f3e6bf5740 msgr2=0x55f3e6fa6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:06.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.910+0000 7f4b7984b740 1 -- 172.21.15.7:0/1302517975 shutdown_connections 2024-09-21T06:03:06.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.910+0000 7f4b7984b740 1 -- 172.21.15.7:0/1302517975 wait complete. 2024-09-21T06:03:06.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.911+0000 7f4b7984b740 1 -- start start 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.911+0000 7f4b7984b740 1 Processor -- start 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.911+0000 7f4b7984b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bd8490 0x55f3e6fb8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.911+0000 7f4b7984b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6be0670 0x55f3e6fb88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.911+0000 7f4b7984b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6c01350 0x55f3e6fc42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.911+0000 7f4b7984b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f3e6d6f890 con 0x55f3e6bd8490 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.911+0000 7f4b7984b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f3e6ea8d40 con 0x55f3e6c01350 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.911+0000 7f4b7984b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f3e6fbaf70 con 0x55f3e6be0670 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.911+0000 7f4b71874640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bd8490 0x55f3e6fb8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.911+0000 7f4b7984b740 10 client.0 _ll_register_callbacks cb 0x55f3e6f0cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b71874640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bd8490 0x55f3e6fb8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44120/0 (socket says 172.21.15.7:44120) 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b71874640 1 -- 172.21.15.7:0/2198678525 learned_addr learned my addr 172.21.15.7:0/2198678525 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b70872640 1 --2- 172.21.15.7:0/2198678525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6be0670 0x55f3e6fb88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b71874640 1 --2- 172.21.15.7:0/2198678525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6c01350 0x55f3e6fc42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b71874640 1 -- 172.21.15.7:0/2198678525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6be0670 msgr2=0x55f3e6fb88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b71874640 1 --2- 172.21.15.7:0/2198678525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6be0670 0x55f3e6fb88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b71874640 1 -- 172.21.15.7:0/2198678525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6c01350 msgr2=0x55f3e6fc42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b71874640 1 --2- 172.21.15.7:0/2198678525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6c01350 0x55f3e6fc42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b71874640 1 -- 172.21.15.7:0/2198678525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3e6fc47e0 con 0x55f3e6bd8490 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b71874640 1 --2- 172.21.15.7:0/2198678525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bd8490 0x55f3e6fb8370 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f4b64005a20 tx=0x7f4b64005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a322e24401e0e82f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b54ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b54ff9640 1 -- 172.21.15.7:0/2198678525 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64016070 con 0x55f3e6bd8490 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b54ff9640 1 -- 172.21.15.7:0/2198678525 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f4b64005460 con 0x55f3e6bd8490 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.912+0000 7f4b7984b740 1 -- 172.21.15.7:0/2198678525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b64004d20 con 0x55f3e6bd8490 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.913+0000 7f4b54ff9640 1 -- 172.21.15.7:0/2198678525 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b6402d030 con 0x55f3e6bd8490 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.913+0000 7f4b7984b740 10 client.18126 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.913+0000 7f4b7984b740 1 -- 172.21.15.7:0/2198678525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f3e6fc70e0 con 0x55f3e6bd8490 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.913+0000 7f4b54ff9640 1 -- 172.21.15.7:0/2198678525 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b64004d20 con 0x55f3e6bd8490 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.913+0000 7f4b54ff9640 1 -- 172.21.15.7:0/2198678525 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4b6400f040 con 0x55f3e6bd8490 2024-09-21T06:03:06.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.913+0000 7f4b7984b740 10 client.18126 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:06.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.913+0000 7f4b7984b740 10 client.18126 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:06.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.913+0000 7f4b7984b740 20 client.18126 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:06.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.913+0000 7f4b7984b740 1 --2- 172.21.15.7:0/2198678525 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3e6bbfcd0 0x55f3e6fca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.913+0000 7f4b7984b740 4 client.18126 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:06.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.913+0000 7f4b7984b740 1 -- 172.21.15.7:0/2198678525 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3e6f20db0 con 0x55f3e6bbfcd0 2024-09-21T06:03:06.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.914+0000 7f4b70872640 1 --2- 172.21.15.7:0/2198678525 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3e6bbfcd0 0x55f3e6fca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.914+0000 7f4b54ff9640 10 client.18126 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:06.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.914+0000 7f4b70872640 1 --2- 172.21.15.7:0/2198678525 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3e6bbfcd0 0x55f3e6fca440 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b0f8db0c800e593 server_cookie=dcc303ff9b7024e in_seq=0 out_seq=0 2024-09-21T06:03:06.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b54ff9640 1 -- 172.21.15.7:0/2198678525 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f3e6f20db0 con 0x55f3e6bbfcd0 2024-09-21T06:03:06.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b54ff9640 10 client.18126 handle_command_reply: tid=0 2024-09-21T06:03:06.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b7984b740 1 client.18126 shutdown 2024-09-21T06:03:06.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b7984b740 1 -- 172.21.15.7:0/2198678525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bd8490 msgr2=0x55f3e6fb8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:06.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b7984b740 1 --2- 172.21.15.7:0/2198678525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bd8490 0x55f3e6fb8370 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f4b64005a20 tx=0x7f4b64005ae0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b7984b740 1 -- 172.21.15.7:0/2198678525 shutdown_connections 2024-09-21T06:03:06.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b7984b740 1 --2- 172.21.15.7:0/2198678525 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3e6bbfcd0 0x55f3e6fca440 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b7984b740 1 --2- 172.21.15.7:0/2198678525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6c01350 0x55f3e6fc42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b7984b740 1 --2- 172.21.15.7:0/2198678525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6be0670 0x55f3e6fb88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b54ff9640 0 client.18126 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:06.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b7984b740 1 --2- 172.21.15.7:0/2198678525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bd8490 0x55f3e6fb8370 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b7984b740 1 -- 172.21.15.7:0/2198678525 >> 172.21.15.7:0/2198678525 conn(0x55f3e6bf5740 msgr2=0x55f3e6fa4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:06.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b7984b740 1 -- 172.21.15.7:0/2198678525 shutdown_connections 2024-09-21T06:03:06.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b7984b740 1 -- 172.21.15.7:0/2198678525 wait complete. 2024-09-21T06:03:06.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.915+0000 7f4b7984b740 20 client.18126 trim_cache size 0 max 16384 2024-09-21T06:03:06.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.933+0000 7f4b7984b740 1 Processor -- start 2024-09-21T06:03:06.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.933+0000 7f4b7984b740 1 -- start start 2024-09-21T06:03:06.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.933+0000 7f4b7984b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 0x55f3e6fa9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.933+0000 7f4b7984b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6bbfcd0 0x55f3e6fb78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.933+0000 7f4b7984b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 0x55f3e6fb9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.933+0000 7f4b7984b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c1afcd0 con 0x55f3e6bf5740 2024-09-21T06:03:06.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.933+0000 7f4b7984b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c1ad5a0 con 0x55f3e6bbfcd0 2024-09-21T06:03:06.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.933+0000 7f4b7984b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c1ab410 con 0x55f3e6bd8490 2024-09-21T06:03:06.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.933+0000 7f4b71874640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 0x55f3e6fa9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.933+0000 7f4b71874640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 0x55f3e6fa9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44122/0 (socket says 172.21.15.7:44122) 2024-09-21T06:03:06.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.933+0000 7f4b71874640 1 -- 172.21.15.7:0/517721471 learned_addr learned my addr 172.21.15.7:0/517721471 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:06.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.934+0000 7f4b71874640 1 -- 172.21.15.7:0/517721471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 msgr2=0x55f3e6fb9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:06.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.934+0000 7f4b71874640 1 --2- 172.21.15.7:0/517721471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 0x55f3e6fb9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.934+0000 7f4b71874640 1 -- 172.21.15.7:0/517721471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6bbfcd0 msgr2=0x55f3e6fb78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:06.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.934+0000 7f4b70872640 1 --2- 172.21.15.7:0/517721471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6bbfcd0 0x55f3e6fb78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.934+0000 7f4b71874640 1 --2- 172.21.15.7:0/517721471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6bbfcd0 0x55f3e6fb78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.934+0000 7f4b71874640 1 -- 172.21.15.7:0/517721471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3e6fab260 con 0x55f3e6bf5740 2024-09-21T06:03:06.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.934+0000 7f4b71874640 1 --2- 172.21.15.7:0/517721471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 0x55f3e6fa9e20 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009e30 tx=0x7f4b64010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173a5545107f4e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:06.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.934+0000 7f4b56ffd640 1 -- 172.21.15.7:0/517721471 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64016040 con 0x55f3e6bf5740 2024-09-21T06:03:06.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.934+0000 7f4b56ffd640 1 -- 172.21.15.7:0/517721471 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b6401e030 con 0x55f3e6bf5740 2024-09-21T06:03:06.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.934+0000 7f4b56ffd640 1 -- 172.21.15.7:0/517721471 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64032bc0 con 0x55f3e6bf5740 2024-09-21T06:03:06.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.935+0000 7f4b7984b740 1 -- 172.21.15.7:0/517721471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 msgr2=0x55f3e6fa9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.935+0000 7f4b7984b740 1 --2- 172.21.15.7:0/517721471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 0x55f3e6fa9e20 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009e30 tx=0x7f4b64010f60 comp rx=0 tx=0).stop 2024-09-21T06:03:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.935+0000 7f4b7984b740 1 -- 172.21.15.7:0/517721471 shutdown_connections 2024-09-21T06:03:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.935+0000 7f4b7984b740 1 --2- 172.21.15.7:0/517721471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 0x55f3e6fb9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.935+0000 7f4b7984b740 1 --2- 172.21.15.7:0/517721471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6bbfcd0 0x55f3e6fb78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.935+0000 7f4b7984b740 1 --2- 172.21.15.7:0/517721471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 0x55f3e6fa9e20 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.935+0000 7f4b7984b740 1 -- 172.21.15.7:0/517721471 >> 172.21.15.7:0/517721471 conn(0x55f3e6fb3ac0 msgr2=0x55f3e6fb9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.935+0000 7f4b7984b740 1 -- 172.21.15.7:0/517721471 shutdown_connections 2024-09-21T06:03:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.935+0000 7f4b7984b740 1 -- 172.21.15.7:0/517721471 wait complete. 2024-09-21T06:03:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.935+0000 7f4b7984b740 1 -- start start 2024-09-21T06:03:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.936+0000 7f4b7984b740 1 Processor -- start 2024-09-21T06:03:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.936+0000 7f4b7984b740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6bbfcd0 0x55f3e6fcbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.936+0000 7f4b7984b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 0x55f3e6fcc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.936+0000 7f4b7984b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 0x55f3e7033bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.936+0000 7f4b7984b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c1aba60 con 0x55f3e6bf5740 2024-09-21T06:03:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.936+0000 7f4b7984b740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c1aced0 con 0x55f3e6bbfcd0 2024-09-21T06:03:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.936+0000 7f4b7984b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c1ac130 con 0x55f3e6bd8490 2024-09-21T06:03:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.936+0000 7f4b7984b740 10 client.0 _ll_register_callbacks cb 0x7f4b5c00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.936+0000 7f4b71874640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 0x55f3e7033bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.936+0000 7f4b71874640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 0x55f3e7033bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44126/0 (socket says 172.21.15.7:44126) 2024-09-21T06:03:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.936+0000 7f4b71874640 1 -- 172.21.15.7:0/2317934514 learned_addr learned my addr 172.21.15.7:0/2317934514 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.936+0000 7f4b71874640 1 --2- 172.21.15.7:0/2317934514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6bbfcd0 0x55f3e6fcbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.936+0000 7f4b70872640 1 --2- 172.21.15.7:0/2317934514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 0x55f3e6fcc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b71874640 1 -- 172.21.15.7:0/2317934514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 msgr2=0x55f3e6fcc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b71874640 1 --2- 172.21.15.7:0/2317934514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 0x55f3e6fcc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b71874640 1 -- 172.21.15.7:0/2317934514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6bbfcd0 msgr2=0x55f3e6fcbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b71874640 1 --2- 172.21.15.7:0/2317934514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6bbfcd0 0x55f3e6fcbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b71874640 1 -- 172.21.15.7:0/2317934514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3e70341b0 con 0x55f3e6bf5740 2024-09-21T06:03:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b71874640 1 --2- 172.21.15.7:0/2317934514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 0x55f3e7033bc0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009700 tx=0x7f4b6402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a553996f95248f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b54ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b54ff9640 1 -- 172.21.15.7:0/2317934514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64032bc0 con 0x55f3e6bf5740 2024-09-21T06:03:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b54ff9640 1 -- 172.21.15.7:0/2317934514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f4b64032d60 con 0x55f3e6bf5740 2024-09-21T06:03:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b7984b740 1 -- 172.21.15.7:0/2317934514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b6401e030 con 0x55f3e6bf5740 2024-09-21T06:03:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b54ff9640 1 -- 172.21.15.7:0/2317934514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b64005260 con 0x55f3e6bf5740 2024-09-21T06:03:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b7984b740 10 client.18132 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b7984b740 1 -- 172.21.15.7:0/2317934514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f3e7035450 con 0x55f3e6bf5740 2024-09-21T06:03:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.937+0000 7f4b54ff9640 1 -- 172.21.15.7:0/2317934514 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b6401e030 con 0x55f3e6bf5740 2024-09-21T06:03:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.938+0000 7f4b54ff9640 1 -- 172.21.15.7:0/2317934514 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4b64048020 con 0x55f3e6bf5740 2024-09-21T06:03:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.938+0000 7f4b7984b740 10 client.18132 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:06.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.938+0000 7f4b7984b740 10 client.18132 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:06.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.938+0000 7f4b7984b740 20 client.18132 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:06.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.938+0000 7f4b7984b740 1 --2- 172.21.15.7:0/2317934514 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3e6be0670 0x55f3e7037a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:06.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.938+0000 7f4b7984b740 4 client.18132 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:03:06.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.938+0000 7f4b7984b740 1 -- 172.21.15.7:0/2317934514 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f3e6f1c860 con 0x55f3e6be0670 2024-09-21T06:03:06.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.938+0000 7f4b70872640 1 --2- 172.21.15.7:0/2317934514 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3e6be0670 0x55f3e7037a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:06.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.938+0000 7f4b54ff9640 10 client.18132 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:06.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.938+0000 7f4b70872640 1 --2- 172.21.15.7:0/2317934514 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3e6be0670 0x55f3e7037a70 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4e5b39f355405e3 server_cookie=9b08ad66c1403f58 in_seq=0 out_seq=0 2024-09-21T06:03:06.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b54ff9640 1 -- 172.21.15.7:0/2317934514 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f3e6f1c860 con 0x55f3e6be0670 2024-09-21T06:03:06.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b54ff9640 10 client.18132 handle_command_reply: tid=0 2024-09-21T06:03:06.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b7984b740 1 client.18132 shutdown 2024-09-21T06:03:06.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b7984b740 1 -- 172.21.15.7:0/2317934514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 msgr2=0x55f3e7033bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:06.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b7984b740 1 --2- 172.21.15.7:0/2317934514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 0x55f3e7033bc0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009700 tx=0x7f4b6402c040 comp rx=0 tx=0).stop 2024-09-21T06:03:06.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b7984b740 1 -- 172.21.15.7:0/2317934514 shutdown_connections 2024-09-21T06:03:06.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b7984b740 1 --2- 172.21.15.7:0/2317934514 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f3e6be0670 0x55f3e7037a70 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b7984b740 1 --2- 172.21.15.7:0/2317934514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3e6bf5740 0x55f3e7033bc0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b7984b740 1 --2- 172.21.15.7:0/2317934514 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f3e6bd8490 0x55f3e6fcc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b7984b740 1 --2- 172.21.15.7:0/2317934514 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f3e6bbfcd0 0x55f3e6fcbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b7984b740 1 -- 172.21.15.7:0/2317934514 >> 172.21.15.7:0/2317934514 conn(0x55f3e6fb3ac0 msgr2=0x55f3e6fb9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:06.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b54ff9640 0 client.18132 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:06.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b7984b740 1 -- 172.21.15.7:0/2317934514 shutdown_connections 2024-09-21T06:03:06.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b7984b740 1 -- 172.21.15.7:0/2317934514 wait complete. 2024-09-21T06:03:06.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.941+0000 7f4b7984b740 20 client.18132 trim_cache size 0 max 16384 2024-09-21T06:03:06.946 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:03:06.946 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:03:06.946 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "f5c9a9cd-a1fc-4e1a-8442-f7c676fc4489", 2024-09-21T06:03:06.946 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:03:06.947 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:03:06.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.942+0000 7f4b732d7640 1 -- 172.21.15.7:0/3764671804 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b580b6680 msgr2=0x7f4b580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:06.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.942+0000 7f4b732d7640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b580b6680 0x7f4b580b8b90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b68105880 tx=0x7f4b6810bb80 comp rx=0 tx=0).stop 2024-09-21T06:03:06.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.942+0000 7f4b732d7640 1 -- 172.21.15.7:0/3764671804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b6c103b60 msgr2=0x7f4b6c19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:06.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.942+0000 7f4b732d7640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b6c103b60 0x7f4b6c19a480 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f4b68005940 tx=0x7f4b680042f0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.942+0000 7f4b732d7640 1 -- 172.21.15.7:0/3764671804 shutdown_connections 2024-09-21T06:03:06.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.942+0000 7f4b732d7640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f4b580b6680 0x7f4b580b8b90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.942+0000 7f4b732d7640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b6c109df0 0x7f4b6c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.942+0000 7f4b732d7640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b6c1094a0 0x7f4b6c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.942+0000 7f4b732d7640 1 --2- 172.21.15.7:0/3764671804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b6c103b60 0x7f4b6c19a480 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:06.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.942+0000 7f4b732d7640 1 -- 172.21.15.7:0/3764671804 >> 172.21.15.7:0/3764671804 conn(0x7f4b6c07b850 msgr2=0x7f4b6c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:06.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.942+0000 7f4b732d7640 1 -- 172.21.15.7:0/3764671804 shutdown_connections 2024-09-21T06:03:06.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:06.942+0000 7f4b732d7640 1 -- 172.21.15.7:0/3764671804 wait complete. 2024-09-21T06:03:07.824 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:08.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:08 smithi007 ceph-mon[30983]: pgmap v601: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:03:08.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:08 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:03:08.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:08 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:08.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:08 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:03:08.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:08 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:08.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:08 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:03:08.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:08 smithi119 ceph-mon[34833]: pgmap v601: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:03:08.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:08 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:03:08.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:08 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:08.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:08 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:03:08.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:08 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:08.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:08 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:03:08.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:08 smithi027 ceph-mon[34364]: pgmap v601: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:03:08.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:08 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:03:08.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:08 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:08.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:08 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:03:08.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:08 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:08.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:08 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:03:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.569+0000 7f971597e640 1 -- 172.21.15.7:0/1954594822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97101052a0 msgr2=0x7f971010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.569+0000 7f971597e640 1 --2- 172.21.15.7:0/1954594822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97101052a0 0x7f971010d930 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f9704009900 tx=0x7f970402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.570+0000 7f971597e640 1 -- 172.21.15.7:0/1954594822 shutdown_connections 2024-09-21T06:03:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.570+0000 7f971597e640 1 --2- 172.21.15.7:0/1954594822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97101052a0 0x7f971010d930 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.570+0000 7f971597e640 1 --2- 172.21.15.7:0/1954594822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971010de70 0x7f9710110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.570+0000 7f971597e640 1 --2- 172.21.15.7:0/1954594822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97101048c0 0x7f9710104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.570+0000 7f971597e640 1 -- 172.21.15.7:0/1954594822 >> 172.21.15.7:0/1954594822 conn(0x7f9710079760 msgr2=0x7f9710079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.570+0000 7f971597e640 1 -- 172.21.15.7:0/1954594822 shutdown_connections 2024-09-21T06:03:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.570+0000 7f971597e640 1 -- 172.21.15.7:0/1954594822 wait complete. 2024-09-21T06:03:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.570+0000 7f971597e640 1 Processor -- start 2024-09-21T06:03:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.571+0000 7f971597e640 1 -- start start 2024-09-21T06:03:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.571+0000 7f971597e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97101048c0 0x7f971019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.571+0000 7f971597e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97101052a0 0x7f971019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.571+0000 7f971597e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971010de70 0x7f971019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.571+0000 7f971597e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9710113ab0 con 0x7f97101048c0 2024-09-21T06:03:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.571+0000 7f971597e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9710113930 con 0x7f971010de70 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.571+0000 7f971597e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9710113c30 con 0x7f97101052a0 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.571+0000 7f970e7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97101052a0 0x7f971019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.571+0000 7f970effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97101048c0 0x7f971019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.571+0000 7f970e7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97101052a0 0x7f971019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:56790/0 (socket says 172.21.15.7:56790) 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.571+0000 7f970effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97101048c0 0x7f971019a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56894/0 (socket says 172.21.15.7:56894) 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.571+0000 7f970e7fc640 1 -- 172.21.15.7:0/1560883411 learned_addr learned my addr 172.21.15.7:0/1560883411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.571+0000 7f970f7fe640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971010de70 0x7f971019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.572+0000 7f970e7fc640 1 -- 172.21.15.7:0/1560883411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971010de70 msgr2=0x7f971019fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.572+0000 7f970e7fc640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971010de70 0x7f971019fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.572+0000 7f970e7fc640 1 -- 172.21.15.7:0/1560883411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97101048c0 msgr2=0x7f971019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.572+0000 7f970e7fc640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97101048c0 0x7f971019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.572+0000 7f970e7fc640 1 -- 172.21.15.7:0/1560883411 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97101a03d0 con 0x7f97101052a0 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.572+0000 7f970effd640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97101048c0 0x7f971019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:08.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.572+0000 7f970e7fc640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97101052a0 0x7f971019aac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f970402a910 tx=0x7f9704004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:08.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.572+0000 7f971497c640 1 -- 172.21.15.7:0/1560883411 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970403f030 con 0x7f97101052a0 2024-09-21T06:03:08.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.572+0000 7f971597e640 1 -- 172.21.15.7:0/1560883411 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97101a0660 con 0x7f97101052a0 2024-09-21T06:03:08.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.572+0000 7f971497c640 1 -- 172.21.15.7:0/1560883411 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9704003cb0 con 0x7f97101052a0 2024-09-21T06:03:08.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.572+0000 7f971497c640 1 -- 172.21.15.7:0/1560883411 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704035070 con 0x7f97101052a0 2024-09-21T06:03:08.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.572+0000 7f971597e640 1 -- 172.21.15.7:0/1560883411 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97101a0b40 con 0x7f97101052a0 2024-09-21T06:03:08.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.575+0000 7f971bef2740 1 Processor -- start 2024-09-21T06:03:08.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.575+0000 7f971bef2740 1 -- start start 2024-09-21T06:03:08.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.575+0000 7f971bef2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c57070 0x5631c0ffe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.575+0000 7f971bef2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c2e1b0 0x5631c0ffeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.575+0000 7f971bef2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c0fff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.575+0000 7f971bef2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5631c0f74e50 con 0x5631c0c36390 2024-09-21T06:03:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.575+0000 7f971bef2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5631c0f64280 con 0x5631c0c2e1b0 2024-09-21T06:03:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.575+0000 7f971bef2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5631c0f68090 con 0x5631c0c57070 2024-09-21T06:03:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.575+0000 7f970effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c2e1b0 0x5631c0ffeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.575+0000 7f970effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c2e1b0 0x5631c0ffeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:36366/0 (socket says 172.21.15.7:36366) 2024-09-21T06:03:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.575+0000 7f970f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c57070 0x5631c0ffe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.575+0000 7f970effd640 1 -- 172.21.15.7:0/1859651700 learned_addr learned my addr 172.21.15.7:0/1859651700 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.576+0000 7f970effd640 1 -- 172.21.15.7:0/1859651700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c57070 msgr2=0x5631c0ffe650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.576+0000 7f970effd640 1 --2- 172.21.15.7:0/1859651700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c57070 0x5631c0ffe650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.576+0000 7f970effd640 1 -- 172.21.15.7:0/1859651700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 msgr2=0x5631c0fff0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:03:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.576+0000 7f970effd640 1 --2- 172.21.15.7:0/1859651700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c0fff0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.576+0000 7f970effd640 1 -- 172.21.15.7:0/1859651700 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c0cc2650 con 0x5631c0c2e1b0 2024-09-21T06:03:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.576+0000 7f971497c640 1 -- 172.21.15.7:0/1560883411 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9704042030 con 0x7f97101052a0 2024-09-21T06:03:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.576+0000 7f970effd640 1 --2- 172.21.15.7:0/1859651700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c2e1b0 0x5631c0ffeb90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f970000afd0 tx=0x7f970000f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42dd959b379cdafd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.576+0000 7f96f5ffb640 1 -- 172.21.15.7:0/1859651700 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970001d070 con 0x5631c0c2e1b0 2024-09-21T06:03:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.576+0000 7f96f5ffb640 1 -- 172.21.15.7:0/1859651700 <== mon.2 v2:172.21.15.27:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9700010db0 con 0x5631c0c2e1b0 2024-09-21T06:03:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.576+0000 7f96f5ffb640 1 -- 172.21.15.7:0/1859651700 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700018dd0 con 0x5631c0c2e1b0 2024-09-21T06:03:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.577+0000 7f971497c640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96f80b66b0 0x7f96f80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.577+0000 7f970f7fe640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96f80b66b0 0x7f96f80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.577+0000 7f971497c640 1 -- 172.21.15.7:0/1560883411 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7f9704107c60 con 0x7f97101052a0 2024-09-21T06:03:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.577+0000 7f971bef2740 1 -- 172.21.15.7:0/1859651700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c2e1b0 msgr2=0x5631c0ffeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.577+0000 7f971bef2740 1 --2- 172.21.15.7:0/1859651700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c2e1b0 0x5631c0ffeb90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f970000afd0 tx=0x7f970000f850 comp rx=0 tx=0).stop 2024-09-21T06:03:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.577+0000 7f970f7fe640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96f80b66b0 0x7f96f80b8bc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9708007f00 tx=0x7f9708007520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.577+0000 7f971bef2740 1 -- 172.21.15.7:0/1859651700 shutdown_connections 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.577+0000 7f971bef2740 1 --2- 172.21.15.7:0/1859651700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c0fff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.577+0000 7f971bef2740 1 --2- 172.21.15.7:0/1859651700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c2e1b0 0x5631c0ffeb90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.577+0000 7f971bef2740 1 --2- 172.21.15.7:0/1859651700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c57070 0x5631c0ffe650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.577+0000 7f971bef2740 1 -- 172.21.15.7:0/1859651700 >> 172.21.15.7:0/1859651700 conn(0x5631c0c4b460 msgr2=0x5631c0ffc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.577+0000 7f971bef2740 1 -- 172.21.15.7:0/1859651700 shutdown_connections 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.577+0000 7f971bef2740 1 -- 172.21.15.7:0/1859651700 wait complete. 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.578+0000 7f971bef2740 1 -- start start 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.578+0000 7f971bef2740 1 Processor -- start 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.578+0000 7f971bef2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c2e1b0 0x5631c1009d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.578+0000 7f971bef2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c36390 0x5631c100a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.578+0000 7f971bef2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c57070 0x5631c1016120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.578+0000 7f971bef2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5631c0dc5700 con 0x5631c0c57070 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.578+0000 7f971bef2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5631c0eff110 con 0x5631c0c36390 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.578+0000 7f971bef2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5631c100ce30 con 0x5631c0c2e1b0 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.578+0000 7f971bef2740 10 client.0 _ll_register_callbacks cb 0x5631c0f18990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.578+0000 7f970f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c57070 0x5631c1016120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f970e7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c36390 0x5631c100a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f970f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c57070 0x5631c1016120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56908/0 (socket says 172.21.15.7:56908) 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f970f7fe640 1 -- 172.21.15.7:0/2991419074 learned_addr learned my addr 172.21.15.7:0/2991419074 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f970e7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c36390 0x5631c100a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:36372/0 (socket says 172.21.15.7:36372) 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f970effd640 1 --2- 172.21.15.7:0/2991419074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c2e1b0 0x5631c1009d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f970f7fe640 1 -- 172.21.15.7:0/2991419074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c2e1b0 msgr2=0x5631c1009d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f970f7fe640 1 --2- 172.21.15.7:0/2991419074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c2e1b0 0x5631c1009d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f970f7fe640 1 -- 172.21.15.7:0/2991419074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c36390 msgr2=0x5631c100a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f970f7fe640 1 --2- 172.21.15.7:0/2991419074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c36390 0x5631c100a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f970f7fe640 1 -- 172.21.15.7:0/2991419074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c0f2cc40 con 0x5631c0c57070 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f970e7fc640 1 --2- 172.21.15.7:0/2991419074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c36390 0x5631c100a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f970f7fe640 1 --2- 172.21.15.7:0/2991419074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c57070 0x5631c1016120 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f970801ebf0 tx=0x7f9708004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d791608b3470b86f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f96eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f96eeffd640 1 -- 172.21.15.7:0/2991419074 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970800fcb0 con 0x5631c0c57070 2024-09-21T06:03:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f96eeffd640 1 -- 172.21.15.7:0/2991419074 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7f9708016030 con 0x5631c0c57070 2024-09-21T06:03:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.579+0000 7f971bef2740 1 -- 172.21.15.7:0/2991419074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9700010db0 con 0x5631c0c57070 2024-09-21T06:03:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.580+0000 7f96eeffd640 1 -- 172.21.15.7:0/2991419074 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f970800fe50 con 0x5631c0c57070 2024-09-21T06:03:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.580+0000 7f971bef2740 10 client.18141 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.580+0000 7f971bef2740 1 -- 172.21.15.7:0/2991419074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5631c1018c20 con 0x5631c0c57070 2024-09-21T06:03:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.580+0000 7f96eeffd640 1 -- 172.21.15.7:0/2991419074 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9700010db0 con 0x5631c0c57070 2024-09-21T06:03:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.580+0000 7f96eeffd640 1 -- 172.21.15.7:0/2991419074 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f970802d020 con 0x5631c0c57070 2024-09-21T06:03:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.580+0000 7f971bef2740 10 client.18141 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.580+0000 7f971bef2740 10 client.18141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.580+0000 7f971bef2740 20 client.18141 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.580+0000 7f971bef2740 1 --2- 172.21.15.7:0/2991419074 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5631c0c159f0 0x5631c101c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.580+0000 7f971bef2740 4 client.18141 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.580+0000 7f971bef2740 1 -- 172.21.15.7:0/2991419074 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631c0f76da0 con 0x5631c0c159f0 2024-09-21T06:03:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.580+0000 7f970effd640 1 --2- 172.21.15.7:0/2991419074 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5631c0c159f0 0x5631c101c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.581+0000 7f96eeffd640 10 client.18141 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.581+0000 7f970effd640 1 --2- 172.21.15.7:0/2991419074 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5631c0c159f0 0x5631c101c210 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ad6a20c36f8b14d server_cookie=9b250714cb5635c1 in_seq=0 out_seq=0 2024-09-21T06:03:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f96eeffd640 1 -- 172.21.15.7:0/2991419074 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5631c0f76da0 con 0x5631c0c159f0 2024-09-21T06:03:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f96eeffd640 10 client.18141 handle_command_reply: tid=0 2024-09-21T06:03:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f971bef2740 1 client.18141 shutdown 2024-09-21T06:03:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f971bef2740 1 -- 172.21.15.7:0/2991419074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c57070 msgr2=0x5631c1016120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f971bef2740 1 --2- 172.21.15.7:0/2991419074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c57070 0x5631c1016120 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f970801ebf0 tx=0x7f9708004ab0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f971bef2740 1 -- 172.21.15.7:0/2991419074 shutdown_connections 2024-09-21T06:03:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f971bef2740 1 --2- 172.21.15.7:0/2991419074 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5631c0c159f0 0x5631c101c210 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f971bef2740 1 --2- 172.21.15.7:0/2991419074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c57070 0x5631c1016120 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f971bef2740 1 --2- 172.21.15.7:0/2991419074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c36390 0x5631c100a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f971bef2740 1 --2- 172.21.15.7:0/2991419074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c2e1b0 0x5631c1009d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f971bef2740 1 -- 172.21.15.7:0/2991419074 >> 172.21.15.7:0/2991419074 conn(0x5631c0c4b460 msgr2=0x5631c10017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f96eeffd640 0 client.18141 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f971bef2740 1 -- 172.21.15.7:0/2991419074 shutdown_connections 2024-09-21T06:03:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f971bef2740 1 -- 172.21.15.7:0/2991419074 wait complete. 2024-09-21T06:03:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.582+0000 7f971bef2740 20 client.18141 trim_cache size 0 max 16384 2024-09-21T06:03:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.600+0000 7f971bef2740 1 Processor -- start 2024-09-21T06:03:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.600+0000 7f971bef2740 1 -- start start 2024-09-21T06:03:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.600+0000 7f971bef2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c2e1b0 0x5631c100a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.600+0000 7f971bef2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c1016020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.600+0000 7f971bef2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c57070 0x5631c1001750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.600+0000 7f971bef2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97101b1ef0 con 0x5631c0c36390 2024-09-21T06:03:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.600+0000 7f971bef2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f97101af7c0 con 0x5631c0c57070 2024-09-21T06:03:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.600+0000 7f971bef2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f97101ad630 con 0x5631c0c2e1b0 2024-09-21T06:03:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.600+0000 7f970e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c1016020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.600+0000 7f970e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c1016020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56920/0 (socket says 172.21.15.7:56920) 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.600+0000 7f970e7fc640 1 -- 172.21.15.7:0/1924270150 learned_addr learned my addr 172.21.15.7:0/1924270150 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.600+0000 7f970e7fc640 1 -- 172.21.15.7:0/1924270150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c2e1b0 msgr2=0x5631c100a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.601+0000 7f970effd640 1 --2- 172.21.15.7:0/1924270150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c2e1b0 0x5631c100a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.601+0000 7f970f7fe640 1 --2- 172.21.15.7:0/1924270150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c57070 0x5631c1001750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.601+0000 7f970e7fc640 1 --2- 172.21.15.7:0/1924270150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c2e1b0 0x5631c100a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.601+0000 7f970e7fc640 1 -- 172.21.15.7:0/1924270150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c57070 msgr2=0x5631c1001750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.601+0000 7f970e7fc640 1 --2- 172.21.15.7:0/1924270150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c57070 0x5631c1001750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.601+0000 7f970e7fc640 1 -- 172.21.15.7:0/1924270150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c0ff7970 con 0x5631c0c36390 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.601+0000 7f970effd640 1 --2- 172.21.15.7:0/1924270150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c2e1b0 0x5631c100a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.601+0000 7f970f7fe640 1 --2- 172.21.15.7:0/1924270150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c57070 0x5631c1001750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.601+0000 7f970e7fc640 1 --2- 172.21.15.7:0/1924270150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c1016020 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9704031440 tx=0x7f9704005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77a25c7aaa75f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.601+0000 7f96f57fa640 1 -- 172.21.15.7:0/1924270150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704049040 con 0x5631c0c36390 2024-09-21T06:03:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.601+0000 7f96f57fa640 1 -- 172.21.15.7:0/1924270150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97040cd690 con 0x5631c0c36390 2024-09-21T06:03:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.601+0000 7f96f57fa640 1 -- 172.21.15.7:0/1924270150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97040c9df0 con 0x5631c0c36390 2024-09-21T06:03:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.602+0000 7f971bef2740 1 -- 172.21.15.7:0/1924270150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 msgr2=0x5631c1016020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.602+0000 7f971bef2740 1 --2- 172.21.15.7:0/1924270150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c1016020 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9704031440 tx=0x7f9704005c90 comp rx=0 tx=0).stop 2024-09-21T06:03:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.602+0000 7f971bef2740 1 -- 172.21.15.7:0/1924270150 shutdown_connections 2024-09-21T06:03:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.602+0000 7f971bef2740 1 --2- 172.21.15.7:0/1924270150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c1016020 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.602+0000 7f971bef2740 1 --2- 172.21.15.7:0/1924270150 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c57070 0x5631c1001750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.602+0000 7f971bef2740 1 --2- 172.21.15.7:0/1924270150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c2e1b0 0x5631c100a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.602+0000 7f971bef2740 1 -- 172.21.15.7:0/1924270150 >> 172.21.15.7:0/1924270150 conn(0x5631c0c4b460 msgr2=0x5631c1009b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.602+0000 7f971bef2740 1 -- 172.21.15.7:0/1924270150 shutdown_connections 2024-09-21T06:03:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.602+0000 7f971bef2740 1 -- 172.21.15.7:0/1924270150 wait complete. 2024-09-21T06:03:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.602+0000 7f971bef2740 1 -- start start 2024-09-21T06:03:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.602+0000 7f971bef2740 1 Processor -- start 2024-09-21T06:03:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f971bef2740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c2e1b0 0x5631c100e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f971bef2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c100e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f971bef2740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c57070 0x5631c1085bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f971bef2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97101adc80 con 0x5631c0c36390 2024-09-21T06:03:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f971bef2740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f97101af0f0 con 0x5631c0c2e1b0 2024-09-21T06:03:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f971bef2740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f97101ae350 con 0x5631c0c57070 2024-09-21T06:03:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f971bef2740 10 client.0 _ll_register_callbacks cb 0x7f9708007950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f970e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c100e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f970effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c2e1b0 0x5631c100e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f970e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c100e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56922/0 (socket says 172.21.15.7:56922) 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f970e7fc640 1 -- 172.21.15.7:0/492408316 learned_addr learned my addr 172.21.15.7:0/492408316 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f970f7fe640 1 --2- 172.21.15.7:0/492408316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c57070 0x5631c1085bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f970e7fc640 1 -- 172.21.15.7:0/492408316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c57070 msgr2=0x5631c1085bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f970e7fc640 1 --2- 172.21.15.7:0/492408316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c57070 0x5631c1085bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f970e7fc640 1 -- 172.21.15.7:0/492408316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c2e1b0 msgr2=0x5631c100e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f970e7fc640 1 --2- 172.21.15.7:0/492408316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c2e1b0 0x5631c100e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f970e7fc640 1 -- 172.21.15.7:0/492408316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c1086110 con 0x5631c0c36390 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.603+0000 7f970effd640 1 --2- 172.21.15.7:0/492408316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c2e1b0 0x5631c100e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f970e7fc640 1 --2- 172.21.15.7:0/492408316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c100e9e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f9704032af0 tx=0x7f970402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481613b422781e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f96eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f96eeffd640 1 -- 172.21.15.7:0/492408316 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704049070 con 0x5631c0c36390 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f96eeffd640 1 -- 172.21.15.7:0/492408316 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7f97040d21c0 con 0x5631c0c36390 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f971bef2740 1 -- 172.21.15.7:0/492408316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97040cd690 con 0x5631c0c36390 2024-09-21T06:03:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f96eeffd640 1 -- 172.21.15.7:0/492408316 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f97040d25b0 con 0x5631c0c36390 2024-09-21T06:03:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f971bef2740 10 client.18147 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f971bef2740 1 -- 172.21.15.7:0/492408316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5631c1087150 con 0x5631c0c36390 2024-09-21T06:03:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f96eeffd640 1 -- 172.21.15.7:0/492408316 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97040cd690 con 0x5631c0c36390 2024-09-21T06:03:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f96eeffd640 1 -- 172.21.15.7:0/492408316 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f97040ccde0 con 0x5631c0c36390 2024-09-21T06:03:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f971bef2740 10 client.18147 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f971bef2740 10 client.18147 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f971bef2740 20 client.18147 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f971bef2740 1 --2- 172.21.15.7:0/492408316 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5631c0beada0 0x5631c1089880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f971bef2740 4 client.18147 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:03:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.604+0000 7f971bef2740 1 -- 172.21.15.7:0/492408316 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5631c0f72850 con 0x5631c0beada0 2024-09-21T06:03:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.605+0000 7f970effd640 1 --2- 172.21.15.7:0/492408316 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5631c0beada0 0x5631c1089880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.605+0000 7f96eeffd640 10 client.18147 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.605+0000 7f970effd640 1 --2- 172.21.15.7:0/492408316 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5631c0beada0 0x5631c1089880 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=376aa07214ed7318 server_cookie=31388c4eaa256ffa in_seq=0 out_seq=0 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.605+0000 7f96eeffd640 1 -- 172.21.15.7:0/492408316 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7190 (crc 0 0 0) 0x5631c0f72850 con 0x5631c0beada0 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.605+0000 7f96eeffd640 10 client.18147 handle_command_reply: tid=0 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.605+0000 7f971bef2740 1 client.18147 shutdown 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971bef2740 1 -- 172.21.15.7:0/492408316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 msgr2=0x5631c100e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971bef2740 1 --2- 172.21.15.7:0/492408316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c100e9e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f9704032af0 tx=0x7f970402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971bef2740 1 -- 172.21.15.7:0/492408316 shutdown_connections 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971bef2740 1 --2- 172.21.15.7:0/492408316 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5631c0beada0 0x5631c1089880 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f96eeffd640 0 client.18147 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971bef2740 1 --2- 172.21.15.7:0/492408316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631c0c36390 0x5631c100e9e0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971bef2740 1 --2- 172.21.15.7:0/492408316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5631c0c57070 0x5631c1085bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971bef2740 1 --2- 172.21.15.7:0/492408316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5631c0c2e1b0 0x5631c100e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971bef2740 1 -- 172.21.15.7:0/492408316 >> 172.21.15.7:0/492408316 conn(0x5631c0c4b460 msgr2=0x5631c1001750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971bef2740 1 -- 172.21.15.7:0/492408316 shutdown_connections 2024-09-21T06:03:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971bef2740 1 -- 172.21.15.7:0/492408316 wait complete. 2024-09-21T06:03:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971bef2740 20 client.18147 trim_cache size 0 max 16384 2024-09-21T06:03:08.613 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:03:08.613 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:03:08.613 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:03:08.613 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:03:08.613 INFO:teuthology.orchestra.run.smithi007.stdout: "1d89aa12-56bd-49e8-bbd4-0309b4e70f2a": { 2024-09-21T06:03:08.613 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:02:56.375957+0000", 2024-09-21T06:03:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "46ad69b3-ef90-42e0-a57b-ea33e3ef74ab": { 2024-09-21T06:03:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:32.287019+0000", 2024-09-21T06:03:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "d9b96838-732e-40a1-9fad-f54faef73b59": { 2024-09-21T06:03:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:21.774276+0000", 2024-09-21T06:03:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "fd9e7ebd-b70a-487f-937b-80b64378d04b": { 2024-09-21T06:03:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:11.755521+0000", 2024-09-21T06:03:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "3bd778db-a0ed-42ad-8a79-14a200f0734e": { 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:51.556015+0000", 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:03:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "f5c9a9cd-a1fc-4e1a-8442-f7c676fc4489": { 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:03:06.938698+0000", 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "ecf3518d-a174-4cee-89a1-6aa26e1b3442": { 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:01.909762+0000", 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:03:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:03:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "a9901d9b-aa10-4587-83ff-d32730ff12ea": { 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:02:14.695980+0000", 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:03:08.627 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:03:08.627 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:08.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:08.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:08.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:08.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:08.627 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:03:08.627 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:03:08.627 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:03:08.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971597e640 1 -- 172.21.15.7:0/1560883411 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96f80b66b0 msgr2=0x7f96f80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:08.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971597e640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96f80b66b0 0x7f96f80b8bc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9708007f00 tx=0x7f9708007520 comp rx=0 tx=0).stop 2024-09-21T06:03:08.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971597e640 1 -- 172.21.15.7:0/1560883411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97101052a0 msgr2=0x7f971019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:08.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.606+0000 7f971597e640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97101052a0 0x7f971019aac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f970402a910 tx=0x7f9704004270 comp rx=0 tx=0).stop 2024-09-21T06:03:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.607+0000 7f971597e640 1 -- 172.21.15.7:0/1560883411 shutdown_connections 2024-09-21T06:03:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.607+0000 7f971597e640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f96f80b66b0 0x7f96f80b8bc0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.607+0000 7f971597e640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f971010de70 0x7f971019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.607+0000 7f971597e640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97101052a0 0x7f971019aac0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.607+0000 7f971597e640 1 --2- 172.21.15.7:0/1560883411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97101048c0 0x7f971019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.607+0000 7f971597e640 1 -- 172.21.15.7:0/1560883411 >> 172.21.15.7:0/1560883411 conn(0x7f9710079760 msgr2=0x7f97100ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.607+0000 7f971597e640 1 -- 172.21.15.7:0/1560883411 shutdown_connections 2024-09-21T06:03:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:08.607+0000 7f971597e640 1 -- 172.21.15.7:0/1560883411 wait complete. 2024-09-21T06:03:09.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:09 smithi007 ceph-mon[30983]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:03:09.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:09 smithi119 ceph-mon[34833]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:03:09.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:09 smithi027 ceph-mon[34364]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:03:09.489 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:03:09.489 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:03:09.748 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:10.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:10 smithi007 ceph-mon[30983]: pgmap v603: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:03:10.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.203+0000 7f335c36f640 1 -- 172.21.15.7:0/2311553181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3354102a80 msgr2=0x7f3354102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.203+0000 7f335c36f640 1 --2- 172.21.15.7:0/2311553181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3354102a80 0x7f3354102e90 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f3350009900 tx=0x7f335002a410 comp rx=0 tx=0).stop 2024-09-21T06:03:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.203+0000 7f335c36f640 1 -- 172.21.15.7:0/2311553181 shutdown_connections 2024-09-21T06:03:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.203+0000 7f335c36f640 1 --2- 172.21.15.7:0/2311553181 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3354108d10 0x7f335410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.203+0000 7f335c36f640 1 --2- 172.21.15.7:0/2311553181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33541083c0 0x7f33541087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.203+0000 7f335c36f640 1 --2- 172.21.15.7:0/2311553181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3354102a80 0x7f3354102e90 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.203+0000 7f335c36f640 1 -- 172.21.15.7:0/2311553181 >> 172.21.15.7:0/2311553181 conn(0x7f3354079740 msgr2=0x7f3354079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.203+0000 7f335c36f640 1 -- 172.21.15.7:0/2311553181 shutdown_connections 2024-09-21T06:03:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.203+0000 7f335c36f640 1 -- 172.21.15.7:0/2311553181 wait complete. 2024-09-21T06:03:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.203+0000 7f335c36f640 1 Processor -- start 2024-09-21T06:03:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.203+0000 7f335c36f640 1 -- start start 2024-09-21T06:03:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335c36f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3354102a80 0x7f335419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335c36f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33541083c0 0x7f335419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335c36f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3354108d10 0x7f335419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335c36f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3354113a80 con 0x7f33541083c0 2024-09-21T06:03:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335c36f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3354113900 con 0x7f3354108d10 2024-09-21T06:03:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335c36f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3354113c00 con 0x7f3354102a80 2024-09-21T06:03:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335990a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33541083c0 0x7f335419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335990a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33541083c0 0x7f335419aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56948/0 (socket says 172.21.15.7:56948) 2024-09-21T06:03:10.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335990a640 1 -- 172.21.15.7:0/3841419641 learned_addr learned my addr 172.21.15.7:0/3841419641 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335a10b640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3354102a80 0x7f335419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335a90c640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3354108d10 0x7f335419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335990a640 1 -- 172.21.15.7:0/3841419641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3354102a80 msgr2=0x7f335419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335990a640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3354102a80 0x7f335419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335990a640 1 -- 172.21.15.7:0/3841419641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3354108d10 msgr2=0x7f335419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335990a640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3354108d10 0x7f335419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335990a640 1 -- 172.21.15.7:0/3841419641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33541a0440 con 0x7f33541083c0 2024-09-21T06:03:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.204+0000 7f335990a640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33541083c0 0x7f335419aa70 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f334400e9f0 tx=0x7f334400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.205+0000 7f334b7fe640 1 -- 172.21.15.7:0/3841419641 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334400ccc0 con 0x7f33541083c0 2024-09-21T06:03:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.205+0000 7f335c36f640 1 -- 172.21.15.7:0/3841419641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33541a0730 con 0x7f33541083c0 2024-09-21T06:03:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.205+0000 7f334b7fe640 1 -- 172.21.15.7:0/3841419641 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33440054d0 con 0x7f33541083c0 2024-09-21T06:03:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.205+0000 7f335c36f640 1 -- 172.21.15.7:0/3841419641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33541a6e90 con 0x7f33541083c0 2024-09-21T06:03:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.205+0000 7f334b7fe640 1 -- 172.21.15.7:0/3841419641 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3344010430 con 0x7f33541083c0 2024-09-21T06:03:10.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.206+0000 7f335c36f640 1 -- 172.21.15.7:0/3841419641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3354103d00 con 0x7f33541083c0 2024-09-21T06:03:10.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.209+0000 7f334b7fe640 1 -- 172.21.15.7:0/3841419641 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f33440046c0 con 0x7f33541083c0 2024-09-21T06:03:10.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.209+0000 7f334b7fe640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f33400b6680 0x7f33400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:10.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.209+0000 7f335a10b640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f33400b6680 0x7f33400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:10.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.209+0000 7f334b7fe640 1 -- 172.21.15.7:0/3841419641 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7f33440e7ce0 con 0x7f33541083c0 2024-09-21T06:03:10.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.210+0000 7f335a10b640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f33400b6680 0x7f33400b8b90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3350031440 tx=0x7f3350009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:10.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.213+0000 7f334b7fe640 1 -- 172.21.15.7:0/3841419641 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3344056710 con 0x7f33541083c0 2024-09-21T06:03:10.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:10 smithi119 ceph-mon[34833]: pgmap v603: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:03:10.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.443+0000 7f335c36f640 1 -- 172.21.15.7:0/3841419641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3354102e90 con 0x7f33541083c0 2024-09-21T06:03:10.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.444+0000 7f334b7fe640 1 -- 172.21.15.7:0/3841419641 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f33440ae250 con 0x7f33541083c0 2024-09-21T06:03:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:03:10.446 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:03:10.446 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:03:10.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.446+0000 7f335c36f640 1 -- 172.21.15.7:0/3841419641 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f33400b6680 msgr2=0x7f33400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:10.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.446+0000 7f335c36f640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f33400b6680 0x7f33400b8b90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3350031440 tx=0x7f3350009560 comp rx=0 tx=0).stop 2024-09-21T06:03:10.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.446+0000 7f335c36f640 1 -- 172.21.15.7:0/3841419641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33541083c0 msgr2=0x7f335419aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:10.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.446+0000 7f335c36f640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33541083c0 0x7f335419aa70 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f334400e9f0 tx=0x7f334400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:03:10.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.447+0000 7f335c36f640 1 -- 172.21.15.7:0/3841419641 shutdown_connections 2024-09-21T06:03:10.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.447+0000 7f335c36f640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f33400b6680 0x7f33400b8b90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:10.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.447+0000 7f335c36f640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33541083c0 0x7f335419aa70 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:10.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.447+0000 7f335c36f640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3354108d10 0x7f335419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:10.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.447+0000 7f335c36f640 1 --2- 172.21.15.7:0/3841419641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3354102a80 0x7f335419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:10.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.447+0000 7f335c36f640 1 -- 172.21.15.7:0/3841419641 >> 172.21.15.7:0/3841419641 conn(0x7f3354079740 msgr2=0x7f33541014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:10.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.447+0000 7f335c36f640 1 -- 172.21.15.7:0/3841419641 shutdown_connections 2024-09-21T06:03:10.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:10.447+0000 7f335c36f640 1 -- 172.21.15.7:0/3841419641 wait complete. 2024-09-21T06:03:10.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:10 smithi027 ceph-mon[34364]: pgmap v603: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:03:11.094 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:03:11.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:11 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3841419641' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:11.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:11 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3841419641' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:11.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:11 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3841419641' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.845+0000 7fb8a245b640 1 -- 172.21.15.7:0/212937651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb89c103b60 msgr2=0x7fb89c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.845+0000 7fb8a245b640 1 --2- 172.21.15.7:0/212937651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb89c103b60 0x7fb89c103f70 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fb88c009900 tx=0x7fb88c02a410 comp rx=0 tx=0).stop 2024-09-21T06:03:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.845+0000 7fb8a245b640 1 -- 172.21.15.7:0/212937651 shutdown_connections 2024-09-21T06:03:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.845+0000 7fb8a245b640 1 --2- 172.21.15.7:0/212937651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb89c109df0 0x7fb89c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.845+0000 7fb8a245b640 1 --2- 172.21.15.7:0/212937651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb89c1094a0 0x7fb89c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.845+0000 7fb8a245b640 1 --2- 172.21.15.7:0/212937651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb89c103b60 0x7fb89c103f70 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.845+0000 7fb8a245b640 1 -- 172.21.15.7:0/212937651 >> 172.21.15.7:0/212937651 conn(0x7fb89c07b850 msgr2=0x7fb89c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.845+0000 7fb8a245b640 1 -- 172.21.15.7:0/212937651 shutdown_connections 2024-09-21T06:03:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.845+0000 7fb8a245b640 1 -- 172.21.15.7:0/212937651 wait complete. 2024-09-21T06:03:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.846+0000 7fb8a245b640 1 Processor -- start 2024-09-21T06:03:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.846+0000 7fb8a245b640 1 -- start start 2024-09-21T06:03:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.846+0000 7fb8a245b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb89c103b60 0x7fb89c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.846+0000 7fb8a245b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb89c1094a0 0x7fb89c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.846+0000 7fb8a245b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb89c109df0 0x7fb89c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.846+0000 7fb8a245b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c113ab0 con 0x7fb89c109df0 2024-09-21T06:03:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.846+0000 7fb8a245b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c113930 con 0x7fb89c1094a0 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.846+0000 7fb8a245b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c113c30 con 0x7fb89c103b60 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8a09f8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb89c109df0 0x7fb89c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8a09f8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb89c109df0 0x7fb89c19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56958/0 (socket says 172.21.15.7:56958) 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8a09f8640 1 -- 172.21.15.7:0/3464496566 learned_addr learned my addr 172.21.15.7:0/3464496566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb89b7fe640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb89c1094a0 0x7fb89c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb89bfff640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb89c103b60 0x7fb89c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8a09f8640 1 -- 172.21.15.7:0/3464496566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb89c103b60 msgr2=0x7fb89c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8a09f8640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb89c103b60 0x7fb89c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8a09f8640 1 -- 172.21.15.7:0/3464496566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb89c1094a0 msgr2=0x7fb89c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8a09f8640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb89c1094a0 0x7fb89c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8a09f8640 1 -- 172.21.15.7:0/3464496566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89c1a0410 con 0x7fb89c109df0 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8a09f8640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb89c109df0 0x7fb89c19fce0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fb89400cad0 tx=0x7fb89400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8997fa640 1 -- 172.21.15.7:0/3464496566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89400ae20 con 0x7fb89c109df0 2024-09-21T06:03:11.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8a245b640 1 -- 172.21.15.7:0/3464496566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb89c1a0700 con 0x7fb89c109df0 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8997fa640 1 -- 172.21.15.7:0/3464496566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb894005020 con 0x7fb89c109df0 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8997fa640 1 -- 172.21.15.7:0/3464496566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89400f6b0 con 0x7fb89c109df0 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.847+0000 7fb8a245b640 1 -- 172.21.15.7:0/3464496566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb89c1a6e60 con 0x7fb89c109df0 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.850+0000 7fb8a89cf740 1 Processor -- start 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.850+0000 7fb8997fa640 1 -- 172.21.15.7:0/3464496566 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb89400f850 con 0x7fb89c109df0 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.850+0000 7fb8a89cf740 1 -- start start 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb8a89cf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd900a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb8a89cf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 0x555dd900abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb8a89cf740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c42390 0x555dd900b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb8a89cf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555dd8f80ea0 con 0x555dd8c63070 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb8a89cf740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555dd8f702d0 con 0x555dd8c42390 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb8a89cf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555dd8f740e0 con 0x555dd8c3a1b0 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb89b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd900a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb89b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd900a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56966/0 (socket says 172.21.15.7:56966) 2024-09-21T06:03:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb89b7fe640 1 -- 172.21.15.7:0/3000761417 learned_addr learned my addr 172.21.15.7:0/3000761417 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb89b7fe640 1 --2- 172.21.15.7:0/3000761417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c42390 0x555dd900b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb89bfff640 1 --2- 172.21.15.7:0/3000761417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 0x555dd900abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb89b7fe640 1 -- 172.21.15.7:0/3000761417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 msgr2=0x555dd900abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb89b7fe640 1 --2- 172.21.15.7:0/3000761417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 0x555dd900abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb89b7fe640 1 -- 172.21.15.7:0/3000761417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c42390 msgr2=0x555dd900b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb89b7fe640 1 --2- 172.21.15.7:0/3000761417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c42390 0x555dd900b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb89b7fe640 1 -- 172.21.15.7:0/3000761417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dd8cce650 con 0x555dd8c63070 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb8997fa640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8840b6680 0x7fb8840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb89bfff640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8840b6680 0x7fb8840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb89b7fe640 1 --2- 172.21.15.7:0/3000761417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd900a6a0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fb890012540 tx=0x7fb89000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd1b7592573322e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.851+0000 7fb8997fa640 1 -- 172.21.15.7:0/3464496566 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7fb8940e7620 con 0x7fb89c109df0 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.852+0000 7fb8827fc640 1 -- 172.21.15.7:0/3000761417 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890004030 con 0x555dd8c63070 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.852+0000 7fb8827fc640 1 -- 172.21.15.7:0/3000761417 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8900054d0 con 0x555dd8c63070 2024-09-21T06:03:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.852+0000 7fb8827fc640 1 -- 172.21.15.7:0/3000761417 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890004b20 con 0x555dd8c63070 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.852+0000 7fb8a89cf740 1 -- 172.21.15.7:0/3000761417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 msgr2=0x555dd900a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.852+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/3000761417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd900a6a0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fb890012540 tx=0x7fb89000b820 comp rx=0 tx=0).stop 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.852+0000 7fb89bfff640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8840b6680 0x7fb8840b8b90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb88c031440 tx=0x7fb88c009640 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.853+0000 7fb8a89cf740 1 -- 172.21.15.7:0/3000761417 shutdown_connections 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.853+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/3000761417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c42390 0x555dd900b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.853+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/3000761417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 0x555dd900abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.853+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/3000761417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd900a6a0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.853+0000 7fb8a89cf740 1 -- 172.21.15.7:0/3000761417 >> 172.21.15.7:0/3000761417 conn(0x555dd8c57460 msgr2=0x555dd9008590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.853+0000 7fb8a89cf740 1 -- 172.21.15.7:0/3000761417 shutdown_connections 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.853+0000 7fb8a89cf740 1 -- 172.21.15.7:0/3000761417 wait complete. 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.853+0000 7fb8a89cf740 1 -- start start 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.853+0000 7fb8a89cf740 1 Processor -- start 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb8a89cf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 0x555dd9015d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb8a89cf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c42390 0x555dd90162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb8a89cf740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c63070 0x555dd9022170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb8a89cf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555dd8dd1700 con 0x555dd8c42390 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb8a89cf740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555dd8f0b160 con 0x555dd8c63070 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb8a89cf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555dd9018e80 con 0x555dd8c3a1b0 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb8a89cf740 10 client.0 _ll_register_callbacks cb 0x555dd8f249e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb89b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c42390 0x555dd90162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb89b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c42390 0x555dd90162a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56970/0 (socket says 172.21.15.7:56970) 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb89b7fe640 1 -- 172.21.15.7:0/500415893 learned_addr learned my addr 172.21.15.7:0/500415893 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb89bfff640 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 0x555dd9015d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb8a09f8640 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c63070 0x555dd9022170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb89b7fe640 1 -- 172.21.15.7:0/500415893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 msgr2=0x555dd9015d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb89b7fe640 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 0x555dd9015d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb89b7fe640 1 -- 172.21.15.7:0/500415893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c63070 msgr2=0x555dd9022170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb89b7fe640 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c63070 0x555dd9022170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb89b7fe640 1 -- 172.21.15.7:0/500415893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dd8f38c90 con 0x555dd8c42390 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.854+0000 7fb8a09f8640 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c63070 0x555dd9022170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb89b7fe640 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c42390 0x555dd90162a0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fb8900045b0 tx=0x7fb8900056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc73030d53d198e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb87b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb87b7fe640 1 -- 172.21.15.7:0/500415893 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89002d060 con 0x555dd8c42390 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb87b7fe640 1 -- 172.21.15.7:0/500415893 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7fb890010460 con 0x555dd8c42390 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb8a89cf740 1 -- 172.21.15.7:0/500415893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8900054d0 con 0x555dd8c42390 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb87b7fe640 1 -- 172.21.15.7:0/500415893 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb890010660 con 0x555dd8c42390 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb8a89cf740 10 client.18165 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb8a89cf740 1 -- 172.21.15.7:0/500415893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555dd9024b90 con 0x555dd8c42390 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb87b7fe640 1 -- 172.21.15.7:0/500415893 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8900054d0 con 0x555dd8c42390 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb87b7fe640 1 -- 172.21.15.7:0/500415893 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb89001c020 con 0x555dd8c42390 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb8a89cf740 10 client.18165 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb8a89cf740 10 client.18165 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb8a89cf740 20 client.18165 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x555dd8c219f0 0x555dd9027fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb8a89cf740 4 client.18165 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.855+0000 7fb8a89cf740 1 -- 172.21.15.7:0/500415893 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555dd8f82df0 con 0x555dd8c219f0 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.856+0000 7fb89bfff640 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x555dd8c219f0 0x555dd9027fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.856+0000 7fb87b7fe640 10 client.18165 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.856+0000 7fb89bfff640 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x555dd8c219f0 0x555dd9027fa0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5b3b1d821f31b367 server_cookie=70f79d755d286096 in_seq=0 out_seq=0 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb87b7fe640 1 -- 172.21.15.7:0/500415893 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555dd8f82df0 con 0x555dd8c219f0 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb87b7fe640 10 client.18165 handle_command_reply: tid=0 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb8a89cf740 1 client.18165 shutdown 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb8a89cf740 1 -- 172.21.15.7:0/500415893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c42390 msgr2=0x555dd90162a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c42390 0x555dd90162a0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fb8900045b0 tx=0x7fb8900056f0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb8a89cf740 1 -- 172.21.15.7:0/500415893 shutdown_connections 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x555dd8c219f0 0x555dd9027fa0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c42390 0x555dd90162a0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c63070 0x555dd9022170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb87b7fe640 0 client.18165 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:03:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/500415893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 0x555dd9015d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb8a89cf740 1 -- 172.21.15.7:0/500415893 >> 172.21.15.7:0/500415893 conn(0x555dd8c57460 msgr2=0x555dd900d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb8a89cf740 1 -- 172.21.15.7:0/500415893 shutdown_connections 2024-09-21T06:03:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb8a89cf740 1 -- 172.21.15.7:0/500415893 wait complete. 2024-09-21T06:03:11.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.857+0000 7fb8a89cf740 20 client.18165 trim_cache size 0 max 16384 2024-09-21T06:03:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.870+0000 7fb8a89cf740 1 Processor -- start 2024-09-21T06:03:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.870+0000 7fb8a89cf740 1 -- start start 2024-09-21T06:03:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a89cf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 0x555dd9014c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a89cf740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c42390 0x555dd900bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a89cf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd9022070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a89cf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1b1fc0 con 0x555dd8c63070 2024-09-21T06:03:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a89cf740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1af890 con 0x555dd8c42390 2024-09-21T06:03:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a89cf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1ad700 con 0x555dd8c3a1b0 2024-09-21T06:03:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a09f8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd9022070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a09f8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd9022070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56978/0 (socket says 172.21.15.7:56978) 2024-09-21T06:03:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a09f8640 1 -- 172.21.15.7:0/1888164507 learned_addr learned my addr 172.21.15.7:0/1888164507 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb89b7fe640 1 --2- 172.21.15.7:0/1888164507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c42390 0x555dd900bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb89bfff640 1 --2- 172.21.15.7:0/1888164507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 0x555dd9014c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a09f8640 1 -- 172.21.15.7:0/1888164507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 msgr2=0x555dd9014c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a09f8640 1 --2- 172.21.15.7:0/1888164507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 0x555dd9014c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a09f8640 1 -- 172.21.15.7:0/1888164507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c42390 msgr2=0x555dd900bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a09f8640 1 --2- 172.21.15.7:0/1888164507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c42390 0x555dd900bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.871+0000 7fb8a09f8640 1 -- 172.21.15.7:0/1888164507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dd9008f00 con 0x555dd8c63070 2024-09-21T06:03:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.872+0000 7fb8a09f8640 1 --2- 172.21.15.7:0/1888164507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd9022070 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fb894000f80 tx=0x7fb8940acdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6f10dbe1be441f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.872+0000 7fb881ffb640 1 -- 172.21.15.7:0/1888164507 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89401d070 con 0x555dd8c63070 2024-09-21T06:03:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.872+0000 7fb881ffb640 1 -- 172.21.15.7:0/1888164507 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8940a97b0 con 0x555dd8c63070 2024-09-21T06:03:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.872+0000 7fb881ffb640 1 -- 172.21.15.7:0/1888164507 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8940e7330 con 0x555dd8c63070 2024-09-21T06:03:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.873+0000 7fb8a89cf740 1 -- 172.21.15.7:0/1888164507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 msgr2=0x555dd9022070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.873+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/1888164507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd9022070 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fb894000f80 tx=0x7fb8940acdd0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.873+0000 7fb8a89cf740 1 -- 172.21.15.7:0/1888164507 shutdown_connections 2024-09-21T06:03:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.873+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/1888164507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd9022070 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.873+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/1888164507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c42390 0x555dd900bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.873+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/1888164507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c3a1b0 0x555dd9014c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.873+0000 7fb8a89cf740 1 -- 172.21.15.7:0/1888164507 >> 172.21.15.7:0/1888164507 conn(0x555dd8c57460 msgr2=0x555dd900b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.873+0000 7fb8a89cf740 1 -- 172.21.15.7:0/1888164507 shutdown_connections 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.873+0000 7fb8a89cf740 1 -- 172.21.15.7:0/1888164507 wait complete. 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.873+0000 7fb8a89cf740 1 -- start start 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.873+0000 7fb8a89cf740 1 Processor -- start 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a89cf740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c3a1b0 0x555dd901a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a89cf740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c42390 0x555dd901ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a89cf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd90917a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a89cf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1add50 con 0x555dd8c63070 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a89cf740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1af1c0 con 0x555dd8c3a1b0 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a89cf740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1ae420 con 0x555dd8c42390 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a89cf740 10 client.0 _ll_register_callbacks cb 0x7fb8900123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:11.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a09f8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd90917a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a09f8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd90917a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56980/0 (socket says 172.21.15.7:56980) 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb89bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c3a1b0 0x555dd901a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a09f8640 1 -- 172.21.15.7:0/2866635644 learned_addr learned my addr 172.21.15.7:0/2866635644 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb89b7fe640 1 --2- 172.21.15.7:0/2866635644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c42390 0x555dd901ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a09f8640 1 -- 172.21.15.7:0/2866635644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c42390 msgr2=0x555dd901ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a09f8640 1 --2- 172.21.15.7:0/2866635644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c42390 0x555dd901ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a09f8640 1 -- 172.21.15.7:0/2866635644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c3a1b0 msgr2=0x555dd901a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a09f8640 1 --2- 172.21.15.7:0/2866635644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c3a1b0 0x555dd901a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a09f8640 1 -- 172.21.15.7:0/2866635644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dd9091ce0 con 0x555dd8c63070 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb89bfff640 1 --2- 172.21.15.7:0/2866635644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c3a1b0 0x555dd901a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb8a09f8640 1 --2- 172.21.15.7:0/2866635644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd90917a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fb8940ad4d0 tx=0x7fb8940e5240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f371ff21b485f1ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.874+0000 7fb87b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb87b7fe640 1 -- 172.21.15.7:0/2866635644 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89401d040 con 0x555dd8c63070 2024-09-21T06:03:11.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb87b7fe640 1 -- 172.21.15.7:0/2866635644 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7fb8940ac7a0 con 0x555dd8c63070 2024-09-21T06:03:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb8a89cf740 1 -- 172.21.15.7:0/2866635644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8940a97b0 con 0x555dd8c63070 2024-09-21T06:03:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb87b7fe640 1 -- 172.21.15.7:0/2866635644 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8940ac9a0 con 0x555dd8c63070 2024-09-21T06:03:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb8a89cf740 10 client.18171 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb8a89cf740 1 -- 172.21.15.7:0/2866635644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555dd9092f60 con 0x555dd8c63070 2024-09-21T06:03:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb87b7fe640 1 -- 172.21.15.7:0/2866635644 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8940a97b0 con 0x555dd8c63070 2024-09-21T06:03:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb87b7fe640 1 -- 172.21.15.7:0/2866635644 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb8940b6040 con 0x555dd8c63070 2024-09-21T06:03:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb8a89cf740 10 client.18171 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb8a89cf740 10 client.18171 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:03:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb8a89cf740 20 client.18171 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/2866635644 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x555dd8bf6da0 0x555dd90956f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb8a89cf740 4 client.18171 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:03:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.875+0000 7fb8a89cf740 1 -- 172.21.15.7:0/2866635644 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555dd8f7e8a0 con 0x555dd8bf6da0 2024-09-21T06:03:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb89bfff640 1 --2- 172.21.15.7:0/2866635644 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x555dd8bf6da0 0x555dd90956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb87b7fe640 10 client.18171 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:03:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb89bfff640 1 --2- 172.21.15.7:0/2866635644 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x555dd8bf6da0 0x555dd90956f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a298ec63413a85 server_cookie=85d4eb5da3ff3659 in_seq=0 out_seq=0 2024-09-21T06:03:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb87b7fe640 1 -- 172.21.15.7:0/2866635644 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555dd8f7e8a0 con 0x555dd8bf6da0 2024-09-21T06:03:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb87b7fe640 10 client.18171 handle_command_reply: tid=0 2024-09-21T06:03:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb8a89cf740 1 client.18171 shutdown 2024-09-21T06:03:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb8a89cf740 1 -- 172.21.15.7:0/2866635644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 msgr2=0x555dd90917a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/2866635644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd90917a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fb8940ad4d0 tx=0x7fb8940e5240 comp rx=0 tx=0).stop 2024-09-21T06:03:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb8a89cf740 1 -- 172.21.15.7:0/2866635644 shutdown_connections 2024-09-21T06:03:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/2866635644 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x555dd8bf6da0 0x555dd90956f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/2866635644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd8c63070 0x555dd90917a0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/2866635644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555dd8c42390 0x555dd901ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb87b7fe640 0 client.18171 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:03:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb8a89cf740 1 --2- 172.21.15.7:0/2866635644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555dd8c3a1b0 0x555dd901a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.876+0000 7fb8a89cf740 1 -- 172.21.15.7:0/2866635644 >> 172.21.15.7:0/2866635644 conn(0x555dd8c57460 msgr2=0x555dd900b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:11.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a89cf740 1 -- 172.21.15.7:0/2866635644 shutdown_connections 2024-09-21T06:03:11.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a89cf740 1 -- 172.21.15.7:0/2866635644 wait complete. 2024-09-21T06:03:11.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a89cf740 20 client.18171 trim_cache size 0 max 16384 2024-09-21T06:03:11.883 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:03:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a245b640 1 -- 172.21.15.7:0/3464496566 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8840b6680 msgr2=0x7fb8840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a245b640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8840b6680 0x7fb8840b8b90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb88c031440 tx=0x7fb88c009640 comp rx=0 tx=0).stop 2024-09-21T06:03:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a245b640 1 -- 172.21.15.7:0/3464496566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb89c109df0 msgr2=0x7fb89c19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a245b640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb89c109df0 0x7fb89c19fce0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fb89400cad0 tx=0x7fb89400cf90 comp rx=0 tx=0).stop 2024-09-21T06:03:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a245b640 1 -- 172.21.15.7:0/3464496566 shutdown_connections 2024-09-21T06:03:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a245b640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb8840b6680 0x7fb8840b8b90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a245b640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb89c109df0 0x7fb89c19fce0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a245b640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb89c1094a0 0x7fb89c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a245b640 1 --2- 172.21.15.7:0/3464496566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb89c103b60 0x7fb89c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a245b640 1 -- 172.21.15.7:0/3464496566 >> 172.21.15.7:0/3464496566 conn(0x7fb89c07b850 msgr2=0x7fb89c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a245b640 1 -- 172.21.15.7:0/3464496566 shutdown_connections 2024-09-21T06:03:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:11.877+0000 7fb8a245b640 1 -- 172.21.15.7:0/3464496566 wait complete. 2024-09-21T06:03:12.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:12 smithi119 ceph-mon[34833]: pgmap v604: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:03:12.377 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:12 smithi027 ceph-mon[34364]: pgmap v604: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:03:12.558 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:12 smithi007 ceph-mon[30983]: pgmap v604: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:03:12.594 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:03:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:13.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.354+0000 7f9843b65640 1 -- 172.21.15.7:0/4133523534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c0757b0 msgr2=0x7f983c075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:13.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.354+0000 7f9843b65640 1 --2- 172.21.15.7:0/4133523534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c0757b0 0x7f983c075bc0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f9838009900 tx=0x7f983802a410 comp rx=0 tx=0).stop 2024-09-21T06:03:13.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.354+0000 7f9843b65640 1 -- 172.21.15.7:0/4133523534 shutdown_connections 2024-09-21T06:03:13.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.354+0000 7f9843b65640 1 --2- 172.21.15.7:0/4133523534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f983c1100c0 0x7f983c112500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.354+0000 7f9843b65640 1 --2- 172.21.15.7:0/4133523534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f983c076100 0x7f983c10fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.354+0000 7f9843b65640 1 --2- 172.21.15.7:0/4133523534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c0757b0 0x7f983c075bc0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.354+0000 7f9843b65640 1 -- 172.21.15.7:0/4133523534 >> 172.21.15.7:0/4133523534 conn(0x7f983c07b850 msgr2=0x7f983c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:13.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.354+0000 7f9843b65640 1 -- 172.21.15.7:0/4133523534 shutdown_connections 2024-09-21T06:03:13.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.354+0000 7f9843b65640 1 -- 172.21.15.7:0/4133523534 wait complete. 2024-09-21T06:03:13.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9843b65640 1 Processor -- start 2024-09-21T06:03:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9843b65640 1 -- start start 2024-09-21T06:03:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9843b65640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f983c0757b0 0x7f983c19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9843b65640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c076100 0x7f983c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9843b65640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f983c1100c0 0x7f983c1a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9843b65640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f983c115c70 con 0x7f983c076100 2024-09-21T06:03:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9843b65640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f983c115af0 con 0x7f983c1100c0 2024-09-21T06:03:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9843b65640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f983c115df0 con 0x7f983c0757b0 2024-09-21T06:03:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9841100640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c076100 0x7f983c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9841100640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c076100 0x7f983c19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56986/0 (socket says 172.21.15.7:56986) 2024-09-21T06:03:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9841100640 1 -- 172.21.15.7:0/3621518782 learned_addr learned my addr 172.21.15.7:0/3621518782 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9841901640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f983c0757b0 0x7f983c19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9842102640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f983c1100c0 0x7f983c1a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9841100640 1 -- 172.21.15.7:0/3621518782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f983c0757b0 msgr2=0x7f983c19c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9841100640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f983c0757b0 0x7f983c19c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9841100640 1 -- 172.21.15.7:0/3621518782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f983c1100c0 msgr2=0x7f983c1a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.355+0000 7f9841100640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f983c1100c0 0x7f983c1a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.356+0000 7f9841100640 1 -- 172.21.15.7:0/3621518782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983c1a2710 con 0x7f983c076100 2024-09-21T06:03:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.356+0000 7f9841901640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f983c0757b0 0x7f983c19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.356+0000 7f9841100640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c076100 0x7f983c19cd40 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f982c00d950 tx=0x7f982c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.356+0000 7f9832ffd640 1 -- 172.21.15.7:0/3621518782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c017070 con 0x7f983c076100 2024-09-21T06:03:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.356+0000 7f9832ffd640 1 -- 172.21.15.7:0/3621518782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f982c009c30 con 0x7f983c076100 2024-09-21T06:03:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.356+0000 7f9843b65640 1 -- 172.21.15.7:0/3621518782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983c1a2a00 con 0x7f983c076100 2024-09-21T06:03:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.356+0000 7f9832ffd640 1 -- 172.21.15.7:0/3621518782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c00f620 con 0x7f983c076100 2024-09-21T06:03:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.356+0000 7f9843b65640 1 -- 172.21.15.7:0/3621518782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f983c1a9160 con 0x7f983c076100 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.359+0000 7f984a0d9740 1 Processor -- start 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.359+0000 7f984a0d9740 1 -- start start 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.359+0000 7f9832ffd640 1 -- 172.21.15.7:0/3621518782 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f982c01a070 con 0x7f983c076100 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.359+0000 7f984a0d9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1e2070 0x56208e5896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.359+0000 7f984a0d9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1b91b0 0x56208e589be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.359+0000 7f984a0d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 0x56208e58a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.359+0000 7f984a0d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56208e4ffea0 con 0x56208e1c1390 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.359+0000 7f984a0d9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56208e4ef2d0 con 0x56208e1e2070 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.359+0000 7f984a0d9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56208e4f30e0 con 0x56208e1b91b0 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.359+0000 7f9841100640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 0x56208e58a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.359+0000 7f9841100640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 0x56208e58a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56998/0 (socket says 172.21.15.7:56998) 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.359+0000 7f9842102640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1e2070 0x56208e5896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.359+0000 7f9841100640 1 -- 172.21.15.7:0/1490520058 learned_addr learned my addr 172.21.15.7:0/1490520058 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.360+0000 7f9841901640 1 --2- 172.21.15.7:0/1490520058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1b91b0 0x56208e589be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.360+0000 7f9841100640 1 -- 172.21.15.7:0/1490520058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1b91b0 msgr2=0x56208e589be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.360+0000 7f9841100640 1 --2- 172.21.15.7:0/1490520058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1b91b0 0x56208e589be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.360+0000 7f9841100640 1 -- 172.21.15.7:0/1490520058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1e2070 msgr2=0x56208e5896a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.360+0000 7f9841100640 1 --2- 172.21.15.7:0/1490520058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1e2070 0x56208e5896a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.360+0000 7f9841100640 1 -- 172.21.15.7:0/1490520058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56208e24d650 con 0x56208e1c1390 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.360+0000 7f9832ffd640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f98280b6680 0x7f98280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.360+0000 7f9841100640 1 --2- 172.21.15.7:0/1490520058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 0x56208e58a120 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f982c0e4930 tx=0x7f982c0ef930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6d46daeedbec6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.360+0000 7f9842102640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f98280b6680 0x7f98280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.360+0000 7f9827fff640 1 -- 172.21.15.7:0/1490520058 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c0a9710 con 0x56208e1c1390 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.360+0000 7f9832ffd640 1 -- 172.21.15.7:0/3621518782 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7f982c0e7250 con 0x7f983c076100 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.360+0000 7f9827fff640 1 -- 172.21.15.7:0/1490520058 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f982c0acbd0 con 0x56208e1c1390 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.360+0000 7f9827fff640 1 -- 172.21.15.7:0/1490520058 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c0ca9c0 con 0x56208e1c1390 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.361+0000 7f984a0d9740 1 -- 172.21.15.7:0/1490520058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 msgr2=0x56208e58a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.361+0000 7f9842102640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f98280b6680 0x7f98280b8b90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9834005fd0 tx=0x7f9834009760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:13.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.361+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1490520058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 0x56208e58a120 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f982c0e4930 tx=0x7f982c0ef930 comp rx=0 tx=0).stop 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.361+0000 7f984a0d9740 1 -- 172.21.15.7:0/1490520058 shutdown_connections 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.361+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1490520058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 0x56208e58a120 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.361+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1490520058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1b91b0 0x56208e589be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.361+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1490520058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1e2070 0x56208e5896a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.361+0000 7f984a0d9740 1 -- 172.21.15.7:0/1490520058 >> 172.21.15.7:0/1490520058 conn(0x56208e1d6460 msgr2=0x56208e587590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.362+0000 7f984a0d9740 1 -- 172.21.15.7:0/1490520058 shutdown_connections 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.362+0000 7f984a0d9740 1 -- 172.21.15.7:0/1490520058 wait complete. 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.362+0000 7f984a0d9740 1 -- start start 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.362+0000 7f984a0d9740 1 Processor -- start 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f984a0d9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1b91b0 0x56208e594c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f984a0d9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1c1390 0x56208e595170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f984a0d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 0x56208e5956b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f984a0d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56208e350700 con 0x56208e1e2070 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f984a0d9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x56208e48a160 con 0x56208e1b91b0 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f984a0d9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56208e597e80 con 0x56208e1c1390 2024-09-21T06:03:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f984a0d9740 10 client.0 _ll_register_callbacks cb 0x56208e4a39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f9842102640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 0x56208e5956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f9842102640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 0x56208e5956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57012/0 (socket says 172.21.15.7:57012) 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f9842102640 1 -- 172.21.15.7:0/2902519725 learned_addr learned my addr 172.21.15.7:0/2902519725 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f9841100640 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1c1390 0x56208e595170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f9841901640 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1b91b0 0x56208e594c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f9842102640 1 -- 172.21.15.7:0/2902519725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1c1390 msgr2=0x56208e595170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f9842102640 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1c1390 0x56208e595170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f9842102640 1 -- 172.21.15.7:0/2902519725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1b91b0 msgr2=0x56208e594c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f9842102640 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1b91b0 0x56208e594c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f9842102640 1 -- 172.21.15.7:0/2902519725 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56208e4b7c90 con 0x56208e1e2070 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.363+0000 7f9841901640 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1b91b0 0x56208e594c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f9842102640 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 0x56208e5956b0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f9834009730 tx=0x7f9834004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d9321fcd713e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f98257fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f98257fa640 1 -- 172.21.15.7:0/2902519725 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983402a060 con 0x56208e1e2070 2024-09-21T06:03:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f98257fa640 1 -- 172.21.15.7:0/2902519725 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7f9834010e40 con 0x56208e1e2070 2024-09-21T06:03:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f984a0d9740 1 -- 172.21.15.7:0/2902519725 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f982c0acbd0 con 0x56208e1e2070 2024-09-21T06:03:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f98257fa640 1 -- 172.21.15.7:0/2902519725 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f983401db90 con 0x56208e1e2070 2024-09-21T06:03:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f984a0d9740 10 client.18183 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f984a0d9740 1 -- 172.21.15.7:0/2902519725 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56208e5a3ac0 con 0x56208e1e2070 2024-09-21T06:03:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f98257fa640 1 -- 172.21.15.7:0/2902519725 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f982c0acbd0 con 0x56208e1e2070 2024-09-21T06:03:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f98257fa640 1 -- 172.21.15.7:0/2902519725 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9834019040 con 0x56208e1e2070 2024-09-21T06:03:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f984a0d9740 10 client.18183 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f984a0d9740 10 client.18183 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:03:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f984a0d9740 20 client.18183 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f984a0d9740 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x56208e1a09f0 0x56208e5a6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f984a0d9740 4 client.18183 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.364+0000 7f984a0d9740 1 -- 172.21.15.7:0/2902519725 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56208e501df0 con 0x56208e1a09f0 2024-09-21T06:03:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.365+0000 7f9841901640 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x56208e1a09f0 0x56208e5a6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.365+0000 7f98257fa640 10 client.18183 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:03:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.365+0000 7f9841901640 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x56208e1a09f0 0x56208e5a6ff0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac1864083a3fc007 server_cookie=c4a4dde6353830ae in_seq=0 out_seq=0 2024-09-21T06:03:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.366+0000 7f98257fa640 1 -- 172.21.15.7:0/2902519725 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56208e501df0 con 0x56208e1a09f0 2024-09-21T06:03:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.366+0000 7f98257fa640 10 client.18183 handle_command_reply: tid=0 2024-09-21T06:03:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.366+0000 7f984a0d9740 1 client.18183 shutdown 2024-09-21T06:03:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.366+0000 7f984a0d9740 1 -- 172.21.15.7:0/2902519725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 msgr2=0x56208e5956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.366+0000 7f984a0d9740 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 0x56208e5956b0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f9834009730 tx=0x7f9834004a40 comp rx=0 tx=0).stop 2024-09-21T06:03:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.367+0000 7f984a0d9740 1 -- 172.21.15.7:0/2902519725 shutdown_connections 2024-09-21T06:03:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.367+0000 7f984a0d9740 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x56208e1a09f0 0x56208e5a6ff0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.367+0000 7f984a0d9740 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 0x56208e5956b0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.367+0000 7f984a0d9740 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1c1390 0x56208e595170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.367+0000 7f984a0d9740 1 --2- 172.21.15.7:0/2902519725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1b91b0 0x56208e594c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.367+0000 7f98257fa640 0 client.18183 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:03:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.367+0000 7f984a0d9740 1 -- 172.21.15.7:0/2902519725 >> 172.21.15.7:0/2902519725 conn(0x56208e1d6460 msgr2=0x56208e58c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.367+0000 7f984a0d9740 1 -- 172.21.15.7:0/2902519725 shutdown_connections 2024-09-21T06:03:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.367+0000 7f984a0d9740 1 -- 172.21.15.7:0/2902519725 wait complete. 2024-09-21T06:03:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.367+0000 7f984a0d9740 20 client.18183 trim_cache size 0 max 16384 2024-09-21T06:03:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.380+0000 7f984a0d9740 1 Processor -- start 2024-09-21T06:03:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.380+0000 7f984a0d9740 1 -- start start 2024-09-21T06:03:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.380+0000 7f984a0d9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1b91b0 0x56208e58b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.380+0000 7f984a0d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 0x56208e596b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.380+0000 7f984a0d9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1e2070 0x56208e5a1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.380+0000 7f984a0d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1b4260 con 0x56208e1c1390 2024-09-21T06:03:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.380+0000 7f984a0d9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1b1b30 con 0x56208e1e2070 2024-09-21T06:03:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.380+0000 7f984a0d9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1af9a0 con 0x56208e1b91b0 2024-09-21T06:03:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.380+0000 7f9841100640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 0x56208e596b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.380+0000 7f9841100640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 0x56208e596b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57026/0 (socket says 172.21.15.7:57026) 2024-09-21T06:03:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.380+0000 7f9841100640 1 -- 172.21.15.7:0/1496424562 learned_addr learned my addr 172.21.15.7:0/1496424562 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.380+0000 7f9841901640 1 --2- 172.21.15.7:0/1496424562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1b91b0 0x56208e58b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.380+0000 7f9842102640 1 --2- 172.21.15.7:0/1496424562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1e2070 0x56208e5a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.381+0000 7f9841100640 1 -- 172.21.15.7:0/1496424562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1b91b0 msgr2=0x56208e58b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.381+0000 7f9841100640 1 --2- 172.21.15.7:0/1496424562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1b91b0 0x56208e58b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.381+0000 7f9841100640 1 -- 172.21.15.7:0/1496424562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1e2070 msgr2=0x56208e5a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.381+0000 7f9841100640 1 --2- 172.21.15.7:0/1496424562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1e2070 0x56208e5a1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.381+0000 7f9841100640 1 -- 172.21.15.7:0/1496424562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56208e597910 con 0x56208e1c1390 2024-09-21T06:03:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.381+0000 7f9841100640 1 --2- 172.21.15.7:0/1496424562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 0x56208e596b10 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f982c0aa330 tx=0x7f982c010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abeae6d4e62de6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.381+0000 7f98277fe640 1 -- 172.21.15.7:0/1496424562 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c021030 con 0x56208e1c1390 2024-09-21T06:03:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.381+0000 7f98277fe640 1 -- 172.21.15.7:0/1496424562 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f982c0e4e40 con 0x56208e1c1390 2024-09-21T06:03:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.381+0000 7f98277fe640 1 -- 172.21.15.7:0/1496424562 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c0c9d40 con 0x56208e1c1390 2024-09-21T06:03:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.382+0000 7f984a0d9740 1 -- 172.21.15.7:0/1496424562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 msgr2=0x56208e596b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.382+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1496424562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 0x56208e596b10 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f982c0aa330 tx=0x7f982c010f10 comp rx=0 tx=0).stop 2024-09-21T06:03:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.382+0000 7f984a0d9740 1 -- 172.21.15.7:0/1496424562 shutdown_connections 2024-09-21T06:03:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.382+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1496424562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1c1390 0x56208e596b10 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.382+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1496424562 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1e2070 0x56208e5a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.382+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1496424562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1b91b0 0x56208e58b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.382+0000 7f984a0d9740 1 -- 172.21.15.7:0/1496424562 >> 172.21.15.7:0/1496424562 conn(0x56208e1d6460 msgr2=0x56208e5949e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.382+0000 7f984a0d9740 1 -- 172.21.15.7:0/1496424562 shutdown_connections 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.382+0000 7f984a0d9740 1 -- 172.21.15.7:0/1496424562 wait complete. 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.382+0000 7f984a0d9740 1 -- start start 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.382+0000 7f984a0d9740 1 Processor -- start 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f984a0d9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1b91b0 0x56208e599280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f984a0d9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1c1390 0x56208e5997c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f984a0d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 0x56208e599d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f984a0d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1afff0 con 0x56208e1e2070 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f984a0d9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1b1460 con 0x56208e1b91b0 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f984a0d9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f983c1b06c0 con 0x56208e1c1390 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f984a0d9740 10 client.0 _ll_register_callbacks cb 0x7f9834009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f9842102640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 0x56208e599d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f9842102640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 0x56208e599d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57040/0 (socket says 172.21.15.7:57040) 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f9842102640 1 -- 172.21.15.7:0/1620315617 learned_addr learned my addr 172.21.15.7:0/1620315617 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f9841100640 1 --2- 172.21.15.7:0/1620315617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1c1390 0x56208e5997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f9841901640 1 --2- 172.21.15.7:0/1620315617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1b91b0 0x56208e599280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f9842102640 1 -- 172.21.15.7:0/1620315617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1c1390 msgr2=0x56208e5997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f9842102640 1 --2- 172.21.15.7:0/1620315617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1c1390 0x56208e5997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f9842102640 1 -- 172.21.15.7:0/1620315617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1b91b0 msgr2=0x56208e599280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f9842102640 1 --2- 172.21.15.7:0/1620315617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1b91b0 0x56208e599280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.383+0000 7f9842102640 1 -- 172.21.15.7:0/1620315617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56208e610c00 con 0x56208e1e2070 2024-09-21T06:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f9842102640 1 --2- 172.21.15.7:0/1620315617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 0x56208e599d00 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f98340254e0 tx=0x7f983401d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e136bd729cc813bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f98257fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f98257fa640 1 -- 172.21.15.7:0/1620315617 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834004cc0 con 0x56208e1e2070 2024-09-21T06:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f98257fa640 1 -- 172.21.15.7:0/1620315617 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7f9834005040 con 0x56208e1e2070 2024-09-21T06:03:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f984a0d9740 1 -- 172.21.15.7:0/1620315617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f982c0e4e40 con 0x56208e1e2070 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f98257fa640 1 -- 172.21.15.7:0/1620315617 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9834004e60 con 0x56208e1e2070 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f984a0d9740 10 client.18189 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f984a0d9740 1 -- 172.21.15.7:0/1620315617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56208e611e60 con 0x56208e1e2070 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f98257fa640 1 -- 172.21.15.7:0/1620315617 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f982c0e4e40 con 0x56208e1e2070 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f98257fa640 1 -- 172.21.15.7:0/1620315617 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f983403e030 con 0x56208e1e2070 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f984a0d9740 10 client.18189 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f984a0d9740 10 client.18189 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f984a0d9740 20 client.18189 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.384+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1620315617 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x56208e175da0 0x56208e614640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.385+0000 7f984a0d9740 4 client.18189 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.385+0000 7f984a0d9740 1 -- 172.21.15.7:0/1620315617 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56208e4fd8a0 con 0x56208e175da0 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.385+0000 7f9841901640 1 --2- 172.21.15.7:0/1620315617 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x56208e175da0 0x56208e614640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.385+0000 7f9841901640 1 --2- 172.21.15.7:0/1620315617 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x56208e175da0 0x56208e614640 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=636ee8d67f3a56e server_cookie=c6cd3e447e33a4d in_seq=0 out_seq=0 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.385+0000 7f98257fa640 10 client.18189 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:03:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.385+0000 7f98257fa640 1 -- 172.21.15.7:0/1620315617 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56208e4fd8a0 con 0x56208e175da0 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.385+0000 7f98257fa640 10 client.18189 handle_command_reply: tid=0 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.386+0000 7f984a0d9740 1 client.18189 shutdown 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.386+0000 7f984a0d9740 1 -- 172.21.15.7:0/1620315617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 msgr2=0x56208e599d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.386+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1620315617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 0x56208e599d00 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f98340254e0 tx=0x7f983401d910 comp rx=0 tx=0).stop 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.386+0000 7f984a0d9740 1 -- 172.21.15.7:0/1620315617 shutdown_connections 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.386+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1620315617 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x56208e175da0 0x56208e614640 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.386+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1620315617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56208e1e2070 0x56208e599d00 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.386+0000 7f98257fa640 0 client.18189 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.386+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1620315617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56208e1c1390 0x56208e5997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.386+0000 7f984a0d9740 1 --2- 172.21.15.7:0/1620315617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x56208e1b91b0 0x56208e599280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.386+0000 7f984a0d9740 1 -- 172.21.15.7:0/1620315617 >> 172.21.15.7:0/1620315617 conn(0x56208e1d6460 msgr2=0x56208e5967b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.386+0000 7f984a0d9740 1 -- 172.21.15.7:0/1620315617 shutdown_connections 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.386+0000 7f984a0d9740 1 -- 172.21.15.7:0/1620315617 wait complete. 2024-09-21T06:03:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.386+0000 7f984a0d9740 20 client.18189 trim_cache size 0 max 16384 2024-09-21T06:03:13.393 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:03:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.387+0000 7f9843b65640 1 -- 172.21.15.7:0/3621518782 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f98280b6680 msgr2=0x7f98280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.387+0000 7f9843b65640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f98280b6680 0x7f98280b8b90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9834005fd0 tx=0x7f9834009760 comp rx=0 tx=0).stop 2024-09-21T06:03:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.387+0000 7f9843b65640 1 -- 172.21.15.7:0/3621518782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c076100 msgr2=0x7f983c19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.387+0000 7f9843b65640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c076100 0x7f983c19cd40 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f982c00d950 tx=0x7f982c00de10 comp rx=0 tx=0).stop 2024-09-21T06:03:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.387+0000 7f9843b65640 1 -- 172.21.15.7:0/3621518782 shutdown_connections 2024-09-21T06:03:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.387+0000 7f9843b65640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f98280b6680 0x7f98280b8b90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.387+0000 7f9843b65640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f983c076100 0x7f983c19cd40 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.387+0000 7f9843b65640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f983c1100c0 0x7f983c1a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.387+0000 7f9843b65640 1 --2- 172.21.15.7:0/3621518782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f983c0757b0 0x7f983c19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.387+0000 7f9843b65640 1 -- 172.21.15.7:0/3621518782 >> 172.21.15.7:0/3621518782 conn(0x7f983c07b850 msgr2=0x7f983c109d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.387+0000 7f9843b65640 1 -- 172.21.15.7:0/3621518782 shutdown_connections 2024-09-21T06:03:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:13.387+0000 7f9843b65640 1 -- 172.21.15.7:0/3621518782 wait complete. 2024-09-21T06:03:14.010 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:03:14.269 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:14.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:14 smithi007 ceph-mon[30983]: pgmap v605: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:03:14.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:14 smithi119 ceph-mon[34833]: pgmap v605: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:03:14.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:14 smithi027 ceph-mon[34364]: pgmap v605: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T06:03:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.770+0000 7fd8931e5640 1 -- 172.21.15.7:0/1610195042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd88c0760c0 msgr2=0x7fd88c10fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.770+0000 7fd8931e5640 1 --2- 172.21.15.7:0/1610195042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd88c0760c0 0x7fd88c10fbc0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009900 tx=0x7fd87c02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.770+0000 7fd8931e5640 1 -- 172.21.15.7:0/1610195042 shutdown_connections 2024-09-21T06:03:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.770+0000 7fd8931e5640 1 --2- 172.21.15.7:0/1610195042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd88c0760c0 0x7fd88c10fbc0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.770+0000 7fd8931e5640 1 --2- 172.21.15.7:0/1610195042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd88c110100 0x7fd88c112520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.770+0000 7fd8931e5640 1 --2- 172.21.15.7:0/1610195042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd88c075770 0x7fd88c075b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.770+0000 7fd8931e5640 1 -- 172.21.15.7:0/1610195042 >> 172.21.15.7:0/1610195042 conn(0x7fd88c07b850 msgr2=0x7fd88c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.770+0000 7fd8931e5640 1 -- 172.21.15.7:0/1610195042 shutdown_connections 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.770+0000 7fd8931e5640 1 -- 172.21.15.7:0/1610195042 wait complete. 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.771+0000 7fd8931e5640 1 Processor -- start 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.771+0000 7fd8931e5640 1 -- start start 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.771+0000 7fd8931e5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd88c075770 0x7fd88c19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.771+0000 7fd8931e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd88c0760c0 0x7fd88c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.771+0000 7fd8931e5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd88c110100 0x7fd88c1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.771+0000 7fd8931e5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c115c90 con 0x7fd88c0760c0 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.771+0000 7fd8931e5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c115b10 con 0x7fd88c075770 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.771+0000 7fd8931e5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c115e10 con 0x7fd88c110100 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.771+0000 7fd88bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd88c0760c0 0x7fd88c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.771+0000 7fd88bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd88c0760c0 0x7fd88c19cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57062/0 (socket says 172.21.15.7:57062) 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.771+0000 7fd88bfff640 1 -- 172.21.15.7:0/4238323401 learned_addr learned my addr 172.21.15.7:0/4238323401 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.771+0000 7fd890f81640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd88c075770 0x7fd88c19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.771+0000 7fd891782640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd88c110100 0x7fd88c1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.772+0000 7fd88bfff640 1 -- 172.21.15.7:0/4238323401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd88c110100 msgr2=0x7fd88c1a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.772+0000 7fd88bfff640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd88c110100 0x7fd88c1a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.772+0000 7fd88bfff640 1 -- 172.21.15.7:0/4238323401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd88c075770 msgr2=0x7fd88c19c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.772+0000 7fd88bfff640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd88c075770 0x7fd88c19c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.772+0000 7fd88bfff640 1 -- 172.21.15.7:0/4238323401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88c1a24f0 con 0x7fd88c0760c0 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.772+0000 7fd88bfff640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd88c0760c0 0x7fd88c19cbe0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fd87c02a910 tx=0x7fd87c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.772+0000 7fd889ffb640 1 -- 172.21.15.7:0/4238323401 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c03f030 con 0x7fd88c0760c0 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.772+0000 7fd8931e5640 1 -- 172.21.15.7:0/4238323401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd88c1a2780 con 0x7fd88c0760c0 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.772+0000 7fd889ffb640 1 -- 172.21.15.7:0/4238323401 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd87c003aa0 con 0x7fd88c0760c0 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.772+0000 7fd889ffb640 1 -- 172.21.15.7:0/4238323401 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c035070 con 0x7fd88c0760c0 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.772+0000 7fd8931e5640 1 -- 172.21.15.7:0/4238323401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd88c1a2cb0 con 0x7fd88c0760c0 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd899759740 1 Processor -- start 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd899759740 1 -- start start 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd889ffb640 1 -- 172.21.15.7:0/4238323401 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fd87c042030 con 0x7fd88c0760c0 2024-09-21T06:03:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd899759740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67e2070 0x555fe6b896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd899759740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6b89be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd899759740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67c1390 0x555fe6b8a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd899759740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555fe6affea0 con 0x555fe67b91b0 2024-09-21T06:03:14.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd899759740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555fe6aef2d0 con 0x555fe67c1390 2024-09-21T06:03:14.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd899759740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555fe6af30e0 con 0x555fe67e2070 2024-09-21T06:03:14.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd890f81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6b89be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd890f81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6b89be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57078/0 (socket says 172.21.15.7:57078) 2024-09-21T06:03:14.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd890f81640 1 -- 172.21.15.7:0/2832093558 learned_addr learned my addr 172.21.15.7:0/2832093558 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:14.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd88bfff640 1 --2- 172.21.15.7:0/2832093558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67c1390 0x555fe6b8a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd891782640 1 --2- 172.21.15.7:0/2832093558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67e2070 0x555fe6b896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd890f81640 1 -- 172.21.15.7:0/2832093558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67e2070 msgr2=0x555fe6b896a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:14.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.775+0000 7fd890f81640 1 --2- 172.21.15.7:0/2832093558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67e2070 0x555fe6b896a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.776+0000 7fd890f81640 1 -- 172.21.15.7:0/2832093558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67c1390 msgr2=0x555fe6b8a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.776+0000 7fd890f81640 1 --2- 172.21.15.7:0/2832093558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67c1390 0x555fe6b8a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.776+0000 7fd890f81640 1 -- 172.21.15.7:0/2832093558 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fe684d650 con 0x555fe67b91b0 2024-09-21T06:03:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.776+0000 7fd891782640 1 --2- 172.21.15.7:0/2832093558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67e2070 0x555fe6b896a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.776+0000 7fd890f81640 1 --2- 172.21.15.7:0/2832093558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6b89be0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fd87400ad00 tx=0x7fd87400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0b7de4f2c1603f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.776+0000 7fd889ffb640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd8780b66b0 0x7fd8780b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.776+0000 7fd882ffd640 1 -- 172.21.15.7:0/2832093558 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87401d070 con 0x555fe67b91b0 2024-09-21T06:03:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.776+0000 7fd882ffd640 1 -- 172.21.15.7:0/2832093558 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd874018af0 con 0x555fe67b91b0 2024-09-21T06:03:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.776+0000 7fd882ffd640 1 -- 172.21.15.7:0/2832093558 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874010ae0 con 0x555fe67b91b0 2024-09-21T06:03:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.776+0000 7fd891782640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd8780b66b0 0x7fd8780b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.776+0000 7fd889ffb640 1 -- 172.21.15.7:0/4238323401 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7fd87c107c40 con 0x7fd88c0760c0 2024-09-21T06:03:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.777+0000 7fd891782640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd8780b66b0 0x7fd8780b8bc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd88c076750 tx=0x7fd88400a440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:14.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.778+0000 7fd899759740 1 -- 172.21.15.7:0/2832093558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 msgr2=0x555fe6b89be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:14.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.778+0000 7fd899759740 1 --2- 172.21.15.7:0/2832093558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6b89be0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fd87400ad00 tx=0x7fd87400f790 comp rx=0 tx=0).stop 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.778+0000 7fd899759740 1 -- 172.21.15.7:0/2832093558 shutdown_connections 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.778+0000 7fd899759740 1 --2- 172.21.15.7:0/2832093558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6b89be0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.778+0000 7fd899759740 1 --2- 172.21.15.7:0/2832093558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67c1390 0x555fe6b8a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.778+0000 7fd899759740 1 --2- 172.21.15.7:0/2832093558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67e2070 0x555fe6b896a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.778+0000 7fd899759740 1 -- 172.21.15.7:0/2832093558 >> 172.21.15.7:0/2832093558 conn(0x555fe67d6460 msgr2=0x555fe6b87590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.778+0000 7fd899759740 1 -- 172.21.15.7:0/2832093558 shutdown_connections 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.778+0000 7fd899759740 1 -- 172.21.15.7:0/2832093558 wait complete. 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.779+0000 7fd899759740 1 -- start start 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.779+0000 7fd899759740 1 Processor -- start 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.779+0000 7fd899759740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6b94da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.779+0000 7fd899759740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67c1390 0x555fe6b952e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.779+0000 7fd899759740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 0x555fe6ba11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.779+0000 7fd899759740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555fe6950700 con 0x555fe67b91b0 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.779+0000 7fd899759740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x555fe6a8a160 con 0x555fe67e2070 2024-09-21T06:03:14.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.779+0000 7fd899759740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x555fe6b97e80 con 0x555fe67c1390 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.779+0000 7fd899759740 10 client.0 _ll_register_callbacks cb 0x555fe6aa39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.779+0000 7fd890f81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6b94da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.779+0000 7fd890f81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6b94da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57086/0 (socket says 172.21.15.7:57086) 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.779+0000 7fd890f81640 1 -- 172.21.15.7:0/4011193182 learned_addr learned my addr 172.21.15.7:0/4011193182 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd891782640 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 0x555fe6ba11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd88bfff640 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67c1390 0x555fe6b952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd890f81640 1 -- 172.21.15.7:0/4011193182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67c1390 msgr2=0x555fe6b952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd890f81640 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67c1390 0x555fe6b952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd890f81640 1 -- 172.21.15.7:0/4011193182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 msgr2=0x555fe6ba11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd890f81640 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 0x555fe6ba11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd890f81640 1 -- 172.21.15.7:0/4011193182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fe6ab7c90 con 0x555fe67b91b0 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd891782640 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 0x555fe6ba11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd890f81640 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6b94da0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fd874010660 tx=0x7fd874018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429d4fcec151081e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:14.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd86bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd86bfff640 1 -- 172.21.15.7:0/4011193182 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874026020 con 0x555fe67b91b0 2024-09-21T06:03:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd899759740 1 -- 172.21.15.7:0/4011193182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd874018af0 con 0x555fe67b91b0 2024-09-21T06:03:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd86bfff640 1 -- 172.21.15.7:0/4011193182 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7fd874005240 con 0x555fe67b91b0 2024-09-21T06:03:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd86bfff640 1 -- 172.21.15.7:0/4011193182 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd874031050 con 0x555fe67b91b0 2024-09-21T06:03:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd899759740 10 client.18201 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.780+0000 7fd899759740 1 -- 172.21.15.7:0/4011193182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555fe6ba3b40 con 0x555fe67b91b0 2024-09-21T06:03:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.781+0000 7fd86bfff640 1 -- 172.21.15.7:0/4011193182 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd874018af0 con 0x555fe67b91b0 2024-09-21T06:03:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.781+0000 7fd86bfff640 1 -- 172.21.15.7:0/4011193182 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd874004750 con 0x555fe67b91b0 2024-09-21T06:03:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.781+0000 7fd899759740 10 client.18201 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.781+0000 7fd899759740 10 client.18201 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.781+0000 7fd899759740 20 client.18201 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:14.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.781+0000 7fd899759740 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555fe67a09f0 0x555fe6ba6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.781+0000 7fd899759740 4 client.18201 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.781+0000 7fd899759740 1 -- 172.21.15.7:0/4011193182 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fe6b01df0 con 0x555fe67a09f0 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.781+0000 7fd88bfff640 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555fe67a09f0 0x555fe6ba6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.782+0000 7fd86bfff640 10 client.18201 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.782+0000 7fd88bfff640 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555fe67a09f0 0x555fe6ba6f50 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98db53bdeb42d742 server_cookie=f939e3e7aa5f6ad8 in_seq=0 out_seq=0 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.782+0000 7fd86bfff640 1 -- 172.21.15.7:0/4011193182 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555fe6b01df0 con 0x555fe67a09f0 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.782+0000 7fd86bfff640 10 client.18201 handle_command_reply: tid=0 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.782+0000 7fd899759740 1 client.18201 shutdown 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.783+0000 7fd899759740 1 -- 172.21.15.7:0/4011193182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 msgr2=0x555fe6b94da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.783+0000 7fd899759740 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6b94da0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fd874010660 tx=0x7fd874018670 comp rx=0 tx=0).stop 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.783+0000 7fd899759740 1 -- 172.21.15.7:0/4011193182 shutdown_connections 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.783+0000 7fd899759740 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555fe67a09f0 0x555fe6ba6f50 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.783+0000 7fd899759740 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 0x555fe6ba11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.783+0000 7fd899759740 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67c1390 0x555fe6b952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.783+0000 7fd899759740 1 --2- 172.21.15.7:0/4011193182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6b94da0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.783+0000 7fd899759740 1 -- 172.21.15.7:0/4011193182 >> 172.21.15.7:0/4011193182 conn(0x555fe67d6460 msgr2=0x555fe6b8c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.783+0000 7fd86bfff640 0 client.18201 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.783+0000 7fd899759740 1 -- 172.21.15.7:0/4011193182 shutdown_connections 2024-09-21T06:03:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.783+0000 7fd899759740 1 -- 172.21.15.7:0/4011193182 wait complete. 2024-09-21T06:03:14.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.783+0000 7fd899759740 20 client.18201 trim_cache size 0 max 16384 2024-09-21T06:03:14.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.796+0000 7fd899759740 1 Processor -- start 2024-09-21T06:03:14.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.796+0000 7fd899759740 1 -- start start 2024-09-21T06:03:14.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.796+0000 7fd899759740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67b91b0 0x555fe6b95260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.796+0000 7fd899759740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67c1390 0x555fe6ba1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.796+0000 7fd899759740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 0x555fe6b91f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.796+0000 7fd899759740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c1b4100 con 0x555fe67c1390 2024-09-21T06:03:14.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.796+0000 7fd899759740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c1b19d0 con 0x555fe67e2070 2024-09-21T06:03:14.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.796+0000 7fd899759740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c1af840 con 0x555fe67b91b0 2024-09-21T06:03:14.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd88bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67c1390 0x555fe6ba1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd88bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67c1390 0x555fe6ba1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57102/0 (socket says 172.21.15.7:57102) 2024-09-21T06:03:14.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd88bfff640 1 -- 172.21.15.7:0/1346016938 learned_addr learned my addr 172.21.15.7:0/1346016938 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:14.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd890f81640 1 --2- 172.21.15.7:0/1346016938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67b91b0 0x555fe6b95260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd891782640 1 --2- 172.21.15.7:0/1346016938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 0x555fe6b91f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd88bfff640 1 -- 172.21.15.7:0/1346016938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67b91b0 msgr2=0x555fe6b95260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:14.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd88bfff640 1 --2- 172.21.15.7:0/1346016938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67b91b0 0x555fe6b95260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd88bfff640 1 -- 172.21.15.7:0/1346016938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 msgr2=0x555fe6b91f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:14.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd88bfff640 1 --2- 172.21.15.7:0/1346016938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 0x555fe6b91f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd88bfff640 1 -- 172.21.15.7:0/1346016938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fe6b95e40 con 0x555fe67c1390 2024-09-21T06:03:14.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd88bfff640 1 --2- 172.21.15.7:0/1346016938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67c1390 0x555fe6ba1140 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0cda40 tx=0x7fd87c005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ad60035e435693 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:14.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd8827fc640 1 -- 172.21.15.7:0/1346016938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c049040 con 0x555fe67c1390 2024-09-21T06:03:14.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd8827fc640 1 -- 172.21.15.7:0/1346016938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd87c0cd5c0 con 0x555fe67c1390 2024-09-21T06:03:14.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.797+0000 7fd8827fc640 1 -- 172.21.15.7:0/1346016938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c003c50 con 0x555fe67c1390 2024-09-21T06:03:14.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.798+0000 7fd899759740 1 -- 172.21.15.7:0/1346016938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67c1390 msgr2=0x555fe6ba1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:14.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.798+0000 7fd899759740 1 --2- 172.21.15.7:0/1346016938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67c1390 0x555fe6ba1140 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0cda40 tx=0x7fd87c005de0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.798+0000 7fd899759740 1 -- 172.21.15.7:0/1346016938 shutdown_connections 2024-09-21T06:03:14.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.798+0000 7fd899759740 1 --2- 172.21.15.7:0/1346016938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67c1390 0x555fe6ba1140 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.798+0000 7fd899759740 1 --2- 172.21.15.7:0/1346016938 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 0x555fe6b91f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.798+0000 7fd899759740 1 --2- 172.21.15.7:0/1346016938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67b91b0 0x555fe6b95260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.798+0000 7fd899759740 1 -- 172.21.15.7:0/1346016938 >> 172.21.15.7:0/1346016938 conn(0x555fe67d6460 msgr2=0x555fe6b94b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:14.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.798+0000 7fd899759740 1 -- 172.21.15.7:0/1346016938 shutdown_connections 2024-09-21T06:03:14.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.798+0000 7fd899759740 1 -- 172.21.15.7:0/1346016938 wait complete. 2024-09-21T06:03:14.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd899759740 1 -- start start 2024-09-21T06:03:14.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd899759740 1 Processor -- start 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd899759740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6ba7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd899759740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67c1390 0x555fe6ba80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd899759740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 0x555fe6c086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd899759740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c1afe90 con 0x555fe67b91b0 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd899759740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c1b1300 con 0x555fe67e2070 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd899759740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c1b0560 con 0x555fe67c1390 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd899759740 10 client.0 _ll_register_callbacks cb 0x7fd87401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd890f81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6ba7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd890f81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6ba7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57106/0 (socket says 172.21.15.7:57106) 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd890f81640 1 -- 172.21.15.7:0/1253765663 learned_addr learned my addr 172.21.15.7:0/1253765663 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd88bfff640 1 --2- 172.21.15.7:0/1253765663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67c1390 0x555fe6ba80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.799+0000 7fd891782640 1 --2- 172.21.15.7:0/1253765663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 0x555fe6c086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd890f81640 1 -- 172.21.15.7:0/1253765663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67c1390 msgr2=0x555fe6ba80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd890f81640 1 --2- 172.21.15.7:0/1253765663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67c1390 0x555fe6ba80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd890f81640 1 -- 172.21.15.7:0/1253765663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 msgr2=0x555fe6c086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd890f81640 1 --2- 172.21.15.7:0/1253765663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 0x555fe6c086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd890f81640 1 -- 172.21.15.7:0/1253765663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fe6c08d60 con 0x555fe67b91b0 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd890f81640 1 --2- 172.21.15.7:0/1253765663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6ba7ae0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fd874005e80 tx=0x7fd87400a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c22accc8079b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd86bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd86bfff640 1 -- 172.21.15.7:0/1253765663 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874026040 con 0x555fe67b91b0 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd86bfff640 1 -- 172.21.15.7:0/1253765663 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7fd874004660 con 0x555fe67b91b0 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd899759740 1 -- 172.21.15.7:0/1253765663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd87c0cd5c0 con 0x555fe67b91b0 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd86bfff640 1 -- 172.21.15.7:0/1253765663 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd874043050 con 0x555fe67b91b0 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd899759740 10 client.18207 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd899759740 1 -- 172.21.15.7:0/1253765663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555fe6c11260 con 0x555fe67b91b0 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.800+0000 7fd86bfff640 1 -- 172.21.15.7:0/1253765663 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd87c0cd5c0 con 0x555fe67b91b0 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.801+0000 7fd86bfff640 1 -- 172.21.15.7:0/1253765663 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd874004e60 con 0x555fe67b91b0 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.801+0000 7fd899759740 10 client.18207 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.801+0000 7fd899759740 10 client.18207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.801+0000 7fd899759740 20 client.18207 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.801+0000 7fd899759740 1 --2- 172.21.15.7:0/1253765663 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555fe6775da0 0x555fe6c139b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.801+0000 7fd899759740 4 client.18207 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:03:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.801+0000 7fd899759740 1 -- 172.21.15.7:0/1253765663 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555fe6b87800 con 0x555fe6775da0 2024-09-21T06:03:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.801+0000 7fd88bfff640 1 --2- 172.21.15.7:0/1253765663 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555fe6775da0 0x555fe6c139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.801+0000 7fd88bfff640 1 --2- 172.21.15.7:0/1253765663 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555fe6775da0 0x555fe6c139b0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=733153918a075af6 server_cookie=2c9193a7e0a45794 in_seq=0 out_seq=0 2024-09-21T06:03:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.801+0000 7fd86bfff640 10 client.18207 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd86bfff640 1 -- 172.21.15.7:0/1253765663 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555fe6b87800 con 0x555fe6775da0 2024-09-21T06:03:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd86bfff640 10 client.18207 handle_command_reply: tid=0 2024-09-21T06:03:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd899759740 1 client.18207 shutdown 2024-09-21T06:03:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd899759740 1 -- 172.21.15.7:0/1253765663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 msgr2=0x555fe6ba7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd899759740 1 --2- 172.21.15.7:0/1253765663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6ba7ae0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fd874005e80 tx=0x7fd87400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd899759740 1 -- 172.21.15.7:0/1253765663 shutdown_connections 2024-09-21T06:03:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd899759740 1 --2- 172.21.15.7:0/1253765663 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x555fe6775da0 0x555fe6c139b0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd86bfff640 0 client.18207 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd899759740 1 --2- 172.21.15.7:0/1253765663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555fe67e2070 0x555fe6c086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd899759740 1 --2- 172.21.15.7:0/1253765663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x555fe67c1390 0x555fe6ba80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd899759740 1 --2- 172.21.15.7:0/1253765663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fe67b91b0 0x555fe6ba7ae0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd899759740 1 -- 172.21.15.7:0/1253765663 >> 172.21.15.7:0/1253765663 conn(0x555fe67d6460 msgr2=0x555fe6b8a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd899759740 1 -- 172.21.15.7:0/1253765663 shutdown_connections 2024-09-21T06:03:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd899759740 1 -- 172.21.15.7:0/1253765663 wait complete. 2024-09-21T06:03:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.802+0000 7fd899759740 20 client.18207 trim_cache size 0 max 16384 2024-09-21T06:03:14.808 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:03:14.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.803+0000 7fd8931e5640 1 -- 172.21.15.7:0/4238323401 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd8780b66b0 msgr2=0x7fd8780b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:14.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.803+0000 7fd8931e5640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd8780b66b0 0x7fd8780b8bc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd88c076750 tx=0x7fd88400a440 comp rx=0 tx=0).stop 2024-09-21T06:03:14.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.803+0000 7fd8931e5640 1 -- 172.21.15.7:0/4238323401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd88c0760c0 msgr2=0x7fd88c19cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:14.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.803+0000 7fd8931e5640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd88c0760c0 0x7fd88c19cbe0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fd87c02a910 tx=0x7fd87c004270 comp rx=0 tx=0).stop 2024-09-21T06:03:14.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.803+0000 7fd8931e5640 1 -- 172.21.15.7:0/4238323401 shutdown_connections 2024-09-21T06:03:14.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.803+0000 7fd8931e5640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fd8780b66b0 0x7fd8780b8bc0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.803+0000 7fd8931e5640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd88c0760c0 0x7fd88c19cbe0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.803+0000 7fd8931e5640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd88c110100 0x7fd88c1a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.803+0000 7fd8931e5640 1 --2- 172.21.15.7:0/4238323401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd88c075770 0x7fd88c19c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:14.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.803+0000 7fd8931e5640 1 -- 172.21.15.7:0/4238323401 >> 172.21.15.7:0/4238323401 conn(0x7fd88c07b850 msgr2=0x7fd88c109ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:14.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.803+0000 7fd8931e5640 1 -- 172.21.15.7:0/4238323401 shutdown_connections 2024-09-21T06:03:14.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:14.803+0000 7fd8931e5640 1 -- 172.21.15.7:0/4238323401 wait complete. 2024-09-21T06:03:16.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:16 smithi119 ceph-mon[34833]: pgmap v606: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:03:16.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:16 smithi027 ceph-mon[34364]: pgmap v606: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:03:16.521 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:03:16.522 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:03:16.549 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:16 smithi007 ceph-mon[30983]: pgmap v606: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:03:16.795 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:17.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.198+0000 7f9ff8585640 1 -- 172.21.15.7:0/3729303862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff0103b60 msgr2=0x7f9ff0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:17.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.198+0000 7f9ff8585640 1 --2- 172.21.15.7:0/3729303862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff0103b60 0x7f9ff0103f70 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009900 tx=0x7f9fec02a410 comp rx=0 tx=0).stop 2024-09-21T06:03:17.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.198+0000 7f9ff8585640 1 -- 172.21.15.7:0/3729303862 shutdown_connections 2024-09-21T06:03:17.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.198+0000 7f9ff8585640 1 --2- 172.21.15.7:0/3729303862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ff0109df0 0x7f9ff0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.198+0000 7f9ff8585640 1 --2- 172.21.15.7:0/3729303862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff01094a0 0x7f9ff01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.198+0000 7f9ff8585640 1 --2- 172.21.15.7:0/3729303862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff0103b60 0x7f9ff0103f70 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.198+0000 7f9ff8585640 1 -- 172.21.15.7:0/3729303862 >> 172.21.15.7:0/3729303862 conn(0x7f9ff007b850 msgr2=0x7f9ff007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:17.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.198+0000 7f9ff8585640 1 -- 172.21.15.7:0/3729303862 shutdown_connections 2024-09-21T06:03:17.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.199+0000 7f9ff8585640 1 -- 172.21.15.7:0/3729303862 wait complete. 2024-09-21T06:03:17.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.199+0000 7f9ff8585640 1 Processor -- start 2024-09-21T06:03:17.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.199+0000 7f9ff8585640 1 -- start start 2024-09-21T06:03:17.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.199+0000 7f9ff8585640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff0103b60 0x7f9ff019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.199+0000 7f9ff8585640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ff01094a0 0x7f9ff019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff8585640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff0109df0 0x7f9ff019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff8585640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0113af0 con 0x7f9ff0103b60 2024-09-21T06:03:17.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff8585640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0113970 con 0x7f9ff01094a0 2024-09-21T06:03:17.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff8585640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0113c70 con 0x7f9ff0109df0 2024-09-21T06:03:17.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff6321640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff0103b60 0x7f9ff019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff6321640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff0103b60 0x7f9ff019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57124/0 (socket says 172.21.15.7:57124) 2024-09-21T06:03:17.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff6321640 1 -- 172.21.15.7:0/402160218 learned_addr learned my addr 172.21.15.7:0/402160218 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:17.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff5b20640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ff01094a0 0x7f9ff019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff6b22640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff0109df0 0x7f9ff019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff6321640 1 -- 172.21.15.7:0/402160218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff0109df0 msgr2=0x7f9ff019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:17.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff6321640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff0109df0 0x7f9ff019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff6321640 1 -- 172.21.15.7:0/402160218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ff01094a0 msgr2=0x7f9ff019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:17.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff6321640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ff01094a0 0x7f9ff019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff6321640 1 -- 172.21.15.7:0/402160218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff01a0450 con 0x7f9ff0103b60 2024-09-21T06:03:17.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff5b20640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ff01094a0 0x7f9ff019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:17.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff6321640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff0103b60 0x7f9ff019a4e0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f9fec005940 tx=0x7f9fec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:17.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9fe77fe640 1 -- 172.21.15.7:0/402160218 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec03f030 con 0x7f9ff0103b60 2024-09-21T06:03:17.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9fe77fe640 1 -- 172.21.15.7:0/402160218 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fec003cb0 con 0x7f9ff0103b60 2024-09-21T06:03:17.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.200+0000 7f9ff8585640 1 -- 172.21.15.7:0/402160218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff01a06e0 con 0x7f9ff0103b60 2024-09-21T06:03:17.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.201+0000 7f9fe77fe640 1 -- 172.21.15.7:0/402160218 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec035070 con 0x7f9ff0103b60 2024-09-21T06:03:17.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.201+0000 7f9ff8585640 1 -- 172.21.15.7:0/402160218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff01a6ea0 con 0x7f9ff0103b60 2024-09-21T06:03:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.203+0000 7f9ffeaf9740 1 Processor -- start 2024-09-21T06:03:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.203+0000 7f9fe77fe640 1 -- 172.21.15.7:0/402160218 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f9fec042030 con 0x7f9ff0103b60 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ffeaf9740 1 -- start start 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ffeaf9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd3d350 0x556c7d0e4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ffeaf9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0e4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ffeaf9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd1c670 0x556c7d0e4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ffeaf9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556c7d05ae60 con 0x556c7cd1c670 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ffeaf9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556c7d04a290 con 0x556c7cd14490 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ffeaf9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556c7d04e0a0 con 0x556c7cd3d350 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ff5b20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd1c670 0x556c7d0e4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ff5b20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd1c670 0x556c7d0e4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57126/0 (socket says 172.21.15.7:57126) 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ff5b20640 1 -- 172.21.15.7:0/588702720 learned_addr learned my addr 172.21.15.7:0/588702720 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ff6321640 1 --2- 172.21.15.7:0/588702720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0e4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ff6b22640 1 --2- 172.21.15.7:0/588702720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd3d350 0x556c7d0e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ff5b20640 1 -- 172.21.15.7:0/588702720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd3d350 msgr2=0x556c7d0e4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:17.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ff5b20640 1 --2- 172.21.15.7:0/588702720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd3d350 0x556c7d0e4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ff5b20640 1 -- 172.21.15.7:0/588702720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 msgr2=0x556c7d0e4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.204+0000 7f9ff5b20640 1 --2- 172.21.15.7:0/588702720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0e4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.205+0000 7f9ff5b20640 1 -- 172.21.15.7:0/588702720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c7cda8930 con 0x556c7cd1c670 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.205+0000 7f9ff6321640 1 --2- 172.21.15.7:0/588702720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0e4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.205+0000 7f9fe77fe640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9fdc0b6700 0x7f9fdc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.205+0000 7f9ff5b20640 1 --2- 172.21.15.7:0/588702720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd1c670 0x556c7d0e4eb0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00077a0 tx=0x7f9fe0007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9bc1a9ad237e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.205+0000 7f9ff6b22640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9fdc0b6700 0x7f9fdc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.205+0000 7f9fe77fe640 1 -- 172.21.15.7:0/402160218 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7f9fec107fd0 con 0x7f9ff0103b60 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.205+0000 7f9fe4ff9640 1 -- 172.21.15.7:0/588702720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000d950 con 0x556c7cd1c670 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.205+0000 7f9fe4ff9640 1 -- 172.21.15.7:0/588702720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fe0018070 con 0x556c7cd1c670 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.205+0000 7f9fe4ff9640 1 -- 172.21.15.7:0/588702720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0013e40 con 0x556c7cd1c670 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.206+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/588702720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd1c670 msgr2=0x556c7d0e4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.206+0000 7f9ff6b22640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9fdc0b6700 0x7f9fdc0b8c10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8005fd0 tx=0x7f9fe8009580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:17.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.206+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/588702720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd1c670 0x556c7d0e4eb0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00077a0 tx=0x7f9fe0007c60 comp rx=0 tx=0).stop 2024-09-21T06:03:17.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.206+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/588702720 shutdown_connections 2024-09-21T06:03:17.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.206+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/588702720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd1c670 0x556c7d0e4eb0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.206+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/588702720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0e4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.206+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/588702720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd3d350 0x556c7d0e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.206+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/588702720 >> 172.21.15.7:0/588702720 conn(0x556c7cd31740 msgr2=0x556c7d0e2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:17.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.206+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/588702720 shutdown_connections 2024-09-21T06:03:17.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.206+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/588702720 wait complete. 2024-09-21T06:03:17.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.207+0000 7f9ffeaf9740 1 -- start start 2024-09-21T06:03:17.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.207+0000 7f9ffeaf9740 1 Processor -- start 2024-09-21T06:03:17.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.207+0000 7f9ffeaf9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0effa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.207+0000 7f9ffeaf9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 0x556c7d0f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.207+0000 7f9ffeaf9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd3d350 0x556c7d0fbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.207+0000 7f9ffeaf9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556c7ceab890 con 0x556c7cd3d350 2024-09-21T06:03:17.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.207+0000 7f9ffeaf9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x556c7cfe4d40 con 0x556c7cd14490 2024-09-21T06:03:17.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.207+0000 7f9ffeaf9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x556c7d0f2c10 con 0x556c7cd1c670 2024-09-21T06:03:17.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.207+0000 7f9ffeaf9740 10 client.0 _ll_register_callbacks cb 0x556c7d048c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:17.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.207+0000 7f9ff6b22640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd3d350 0x556c7d0fbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9ff6b22640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd3d350 0x556c7d0fbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57134/0 (socket says 172.21.15.7:57134) 2024-09-21T06:03:17.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9ff5b20640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 0x556c7d0f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9ff6b22640 1 -- 172.21.15.7:0/3580042312 learned_addr learned my addr 172.21.15.7:0/3580042312 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:17.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9ff6321640 1 --2- 172.21.15.7:0/3580042312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0effa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9ff6b22640 1 -- 172.21.15.7:0/3580042312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 msgr2=0x556c7d0f04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:17.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9ff6b22640 1 --2- 172.21.15.7:0/3580042312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 0x556c7d0f04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9ff6b22640 1 -- 172.21.15.7:0/3580042312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 msgr2=0x556c7d0effa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:17.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9ff6b22640 1 --2- 172.21.15.7:0/3580042312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0effa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9ff6b22640 1 -- 172.21.15.7:0/3580042312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c7d0fc490 con 0x556c7cd3d350 2024-09-21T06:03:17.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9ff6b22640 1 --2- 172.21.15.7:0/3580042312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd3d350 0x556c7d0fbf00 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8012890 tx=0x7f9fe8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3448e985ec93cbaa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:17.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9fd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:17.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9fd9ffb640 1 -- 172.21.15.7:0/3580042312 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8004d20 con 0x556c7cd3d350 2024-09-21T06:03:17.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9fd9ffb640 1 -- 172.21.15.7:0/3580042312 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7f9fe800eae0 con 0x556c7cd3d350 2024-09-21T06:03:17.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/3580042312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fe0018070 con 0x556c7cd3d350 2024-09-21T06:03:17.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9fd9ffb640 1 -- 172.21.15.7:0/3580042312 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9fe8012e10 con 0x556c7cd3d350 2024-09-21T06:03:17.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9ffeaf9740 10 client.18219 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:17.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.208+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/3580042312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556c7d0fee00 con 0x556c7cd3d350 2024-09-21T06:03:17.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.209+0000 7f9fd9ffb640 1 -- 172.21.15.7:0/3580042312 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fe0018070 con 0x556c7cd3d350 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.209+0000 7f9fd9ffb640 1 -- 172.21.15.7:0/3580042312 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9fe802e020 con 0x556c7cd3d350 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.209+0000 7f9ffeaf9740 10 client.18219 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.209+0000 7f9ffeaf9740 10 client.18219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.209+0000 7f9ffeaf9740 20 client.18219 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.209+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/3580042312 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556c7ccfbcd0 0x556c7d1022e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.209+0000 7f9ffeaf9740 4 client.18219 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.209+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/3580042312 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c7d05cdb0 con 0x556c7ccfbcd0 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.209+0000 7f9ff6321640 1 --2- 172.21.15.7:0/3580042312 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556c7ccfbcd0 0x556c7d1022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.210+0000 7f9ff6321640 1 --2- 172.21.15.7:0/3580042312 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556c7ccfbcd0 0x556c7d1022e0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eb02251a07b59d7 server_cookie=f19270dc44193f2b in_seq=0 out_seq=0 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.210+0000 7f9fd9ffb640 10 client.18219 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9fd9ffb640 1 -- 172.21.15.7:0/3580042312 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c7d05cdb0 con 0x556c7ccfbcd0 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9fd9ffb640 10 client.18219 handle_command_reply: tid=0 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9ffeaf9740 1 client.18219 shutdown 2024-09-21T06:03:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/3580042312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd3d350 msgr2=0x556c7d0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:17.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/3580042312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd3d350 0x556c7d0fbf00 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8012890 tx=0x7f9fe8004a40 comp rx=0 tx=0).stop 2024-09-21T06:03:17.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/3580042312 shutdown_connections 2024-09-21T06:03:17.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/3580042312 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556c7ccfbcd0 0x556c7d1022e0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/3580042312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd3d350 0x556c7d0fbf00 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/3580042312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 0x556c7d0f04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/3580042312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0effa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/3580042312 >> 172.21.15.7:0/3580042312 conn(0x556c7cd31740 msgr2=0x556c7d0e75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:17.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9fd9ffb640 0 client.18219 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:17.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/3580042312 shutdown_connections 2024-09-21T06:03:17.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/3580042312 wait complete. 2024-09-21T06:03:17.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.211+0000 7f9ffeaf9740 20 client.18219 trim_cache size 0 max 16384 2024-09-21T06:03:17.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ffeaf9740 1 Processor -- start 2024-09-21T06:03:17.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ffeaf9740 1 -- start start 2024-09-21T06:03:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ffeaf9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd14490 0x556c7d0fbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ffeaf9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 0x556c7d0ef630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ffeaf9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd3d350 0x556c7d0f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ffeaf9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01b1ef0 con 0x556c7cd14490 2024-09-21T06:03:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ffeaf9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01af7c0 con 0x556c7cd3d350 2024-09-21T06:03:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ffeaf9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01ad630 con 0x556c7cd1c670 2024-09-21T06:03:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ff6321640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd14490 0x556c7d0fbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ff6321640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd14490 0x556c7d0fbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57138/0 (socket says 172.21.15.7:57138) 2024-09-21T06:03:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ff6321640 1 -- 172.21.15.7:0/733095979 learned_addr learned my addr 172.21.15.7:0/733095979 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ff6b22640 1 --2- 172.21.15.7:0/733095979 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd3d350 0x556c7d0f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ff6321640 1 -- 172.21.15.7:0/733095979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 msgr2=0x556c7d0ef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ff6321640 1 --2- 172.21.15.7:0/733095979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 0x556c7d0ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ff6321640 1 -- 172.21.15.7:0/733095979 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd3d350 msgr2=0x556c7d0f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:17.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ff6321640 1 --2- 172.21.15.7:0/733095979 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd3d350 0x556c7d0f1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ff6321640 1 -- 172.21.15.7:0/733095979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c7d0e2c10 con 0x556c7cd14490 2024-09-21T06:03:17.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ff6b22640 1 --2- 172.21.15.7:0/733095979 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd3d350 0x556c7d0f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:17.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.229+0000 7f9ff6321640 1 --2- 172.21.15.7:0/733095979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd14490 0x556c7d0fbe00 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f9fec031440 tx=0x7f9fec0045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3f6a28dda86bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:17.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.230+0000 7f9fdbfff640 1 -- 172.21.15.7:0/733095979 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec049040 con 0x556c7cd14490 2024-09-21T06:03:17.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.230+0000 7f9fdbfff640 1 -- 172.21.15.7:0/733095979 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fec0efe50 con 0x556c7cd14490 2024-09-21T06:03:17.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.230+0000 7f9fdbfff640 1 -- 172.21.15.7:0/733095979 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec1059c0 con 0x556c7cd14490 2024-09-21T06:03:17.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.230+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/733095979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd14490 msgr2=0x556c7d0fbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:17.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.230+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/733095979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd14490 0x556c7d0fbe00 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f9fec031440 tx=0x7f9fec0045a0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.230+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/733095979 shutdown_connections 2024-09-21T06:03:17.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.230+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/733095979 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd3d350 0x556c7d0f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.230+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/733095979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 0x556c7d0ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.230+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/733095979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd14490 0x556c7d0fbe00 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.230+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/733095979 >> 172.21.15.7:0/733095979 conn(0x556c7cd31740 msgr2=0x556c7d0e5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:17.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.231+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/733095979 shutdown_connections 2024-09-21T06:03:17.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.231+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/733095979 wait complete. 2024-09-21T06:03:17.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.231+0000 7f9ffeaf9740 1 -- start start 2024-09-21T06:03:17.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.231+0000 7f9ffeaf9740 1 Processor -- start 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.231+0000 7f9ffeaf9740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.231+0000 7f9ffeaf9740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 0x556c7d0f4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.231+0000 7f9ffeaf9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd3d350 0x556c7d0f4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.231+0000 7f9ffeaf9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01adc80 con 0x556c7cd3d350 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.231+0000 7f9ffeaf9740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01af0f0 con 0x556c7cd14490 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.231+0000 7f9ffeaf9740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01ae350 con 0x556c7cd1c670 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.231+0000 7f9ffeaf9740 10 client.0 _ll_register_callbacks cb 0x7f9fe8009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9ff6321640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9ff5b20640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 0x556c7d0f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9ff6321640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0f3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:36598/0 (socket says 172.21.15.7:36598) 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9ff6321640 1 -- 172.21.15.7:0/264013912 learned_addr learned my addr 172.21.15.7:0/264013912 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9ff6b22640 1 --2- 172.21.15.7:0/264013912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd3d350 0x556c7d0f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9ff6321640 1 -- 172.21.15.7:0/264013912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 msgr2=0x556c7d0f4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:17.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9ff6321640 1 --2- 172.21.15.7:0/264013912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 0x556c7d0f4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9ff6321640 1 -- 172.21.15.7:0/264013912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd3d350 msgr2=0x556c7d0f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9ff6321640 1 --2- 172.21.15.7:0/264013912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd3d350 0x556c7d0f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9ff6321640 1 -- 172.21.15.7:0/264013912 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c7d16bd20 con 0x556c7cd14490 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9ff5b20640 1 --2- 172.21.15.7:0/264013912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 0x556c7d0f4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9ff6321640 1 --2- 172.21.15.7:0/264013912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0f3ec0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9fec006010 tx=0x7f9fec03b6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e1f3924ef463d4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9fd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9fd9ffb640 1 -- 172.21.15.7:0/264013912 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0d0070 con 0x556c7cd14490 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/264013912 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fec0efe50 con 0x556c7cd14490 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.232+0000 7f9fd9ffb640 1 -- 172.21.15.7:0/264013912 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7f9fec0ca0b0 con 0x556c7cd14490 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.233+0000 7f9fd9ffb640 1 -- 172.21.15.7:0/264013912 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9fec049070 con 0x556c7cd14490 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.233+0000 7f9ffeaf9740 10 client.27497 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.233+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/264013912 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556c7d16cfa0 con 0x556c7cd14490 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.233+0000 7f9fd9ffb640 1 -- 172.21.15.7:0/264013912 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fec0efe50 con 0x556c7cd14490 2024-09-21T06:03:17.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.233+0000 7f9fd9ffb640 1 -- 172.21.15.7:0/264013912 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9fec0f51a0 con 0x556c7cd14490 2024-09-21T06:03:17.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.233+0000 7f9ffeaf9740 10 client.27497 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:17.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.233+0000 7f9ffeaf9740 10 client.27497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:17.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.233+0000 7f9ffeaf9740 20 client.27497 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:17.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.233+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/264013912 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556c7ccd1080 0x556c7d16f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:17.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.233+0000 7f9ffeaf9740 4 client.27497 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:03:17.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.233+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/264013912 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556c7d058860 con 0x556c7ccd1080 2024-09-21T06:03:17.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.234+0000 7f9ff5b20640 1 --2- 172.21.15.7:0/264013912 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556c7ccd1080 0x556c7d16f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:17.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.234+0000 7f9fd9ffb640 10 client.27497 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:17.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.234+0000 7f9ff5b20640 1 --2- 172.21.15.7:0/264013912 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556c7ccd1080 0x556c7d16f730 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd085cb4abdede89 server_cookie=ff04811905613598 in_seq=0 out_seq=0 2024-09-21T06:03:17.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9fd9ffb640 1 -- 172.21.15.7:0/264013912 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556c7d058860 con 0x556c7ccd1080 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9fd9ffb640 10 client.27497 handle_command_reply: tid=0 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9ffeaf9740 1 client.27497 shutdown 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/264013912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 msgr2=0x556c7d0f3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/264013912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0f3ec0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9fec006010 tx=0x7f9fec03b6b0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/264013912 shutdown_connections 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/264013912 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x556c7ccd1080 0x556c7d16f730 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/264013912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c7cd3d350 0x556c7d0f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/264013912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556c7cd1c670 0x556c7d0f4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9ffeaf9740 1 --2- 172.21.15.7:0/264013912 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x556c7cd14490 0x556c7d0f3ec0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9fd9ffb640 0 client.27497 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/264013912 >> 172.21.15.7:0/264013912 conn(0x556c7cd31740 msgr2=0x556c7d0e5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/264013912 shutdown_connections 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9ffeaf9740 1 -- 172.21.15.7:0/264013912 wait complete. 2024-09-21T06:03:17.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.236+0000 7f9ffeaf9740 20 client.27497 trim_cache size 0 max 16384 2024-09-21T06:03:17.242 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:03:17.242 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:03:17.242 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "40df47a2-fbba-49bc-a842-15ce641cb6ee", 2024-09-21T06:03:17.242 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:03:17.242 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:03:17.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.237+0000 7f9ff8585640 1 -- 172.21.15.7:0/402160218 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9fdc0b6700 msgr2=0x7f9fdc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:17.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.237+0000 7f9ff8585640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9fdc0b6700 0x7f9fdc0b8c10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8005fd0 tx=0x7f9fe8009580 comp rx=0 tx=0).stop 2024-09-21T06:03:17.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.237+0000 7f9ff8585640 1 -- 172.21.15.7:0/402160218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff0103b60 msgr2=0x7f9ff019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:17.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.237+0000 7f9ff8585640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff0103b60 0x7f9ff019a4e0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f9fec005940 tx=0x7f9fec0042f0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.237+0000 7f9ff8585640 1 -- 172.21.15.7:0/402160218 shutdown_connections 2024-09-21T06:03:17.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.237+0000 7f9ff8585640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f9fdc0b6700 0x7f9fdc0b8c10 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.237+0000 7f9ff8585640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ff0109df0 0x7f9ff019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.237+0000 7f9ff8585640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ff01094a0 0x7f9ff019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.237+0000 7f9ff8585640 1 --2- 172.21.15.7:0/402160218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ff0103b60 0x7f9ff019a4e0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:17.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.237+0000 7f9ff8585640 1 -- 172.21.15.7:0/402160218 >> 172.21.15.7:0/402160218 conn(0x7f9ff007b850 msgr2=0x7f9ff0107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:17.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.237+0000 7f9ff8585640 1 -- 172.21.15.7:0/402160218 shutdown_connections 2024-09-21T06:03:17.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:17.237+0000 7f9ff8585640 1 -- 172.21.15.7:0/402160218 wait complete. 2024-09-21T06:03:18.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:03:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:18 smithi119 ceph-mon[34833]: pgmap v607: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:03:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:18 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:03:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:18 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:18 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:03:18.342 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:18 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:18.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:18 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:03:18.343 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:18 smithi119 ceph-mon[34833]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:03:18.421 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:18.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:18 smithi027 ceph-mon[34364]: pgmap v607: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:03:18.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:18 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:03:18.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:18 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:18.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:18 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:03:18.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:18 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:18.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:18 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:03:18.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:18 smithi027 ceph-mon[34364]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:03:18.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:18 smithi007 ceph-mon[30983]: pgmap v607: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:03:18.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:18 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:03:18.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:18 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:18.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:18 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:03:18.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:18 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:18.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:18 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:03:18.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:18 smithi007 ceph-mon[30983]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:03:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.879+0000 7f3a7e813640 1 -- 172.21.15.7:0/1761275754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a78108d00 msgr2=0x7f3a7810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.879+0000 7f3a7e813640 1 --2- 172.21.15.7:0/1761275754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a78108d00 0x7f3a7810f530 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f3a70009ca0 tx=0x7f3a7002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.879+0000 7f3a7e813640 1 -- 172.21.15.7:0/1761275754 shutdown_connections 2024-09-21T06:03:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.879+0000 7f3a7e813640 1 --2- 172.21.15.7:0/1761275754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a78108d00 0x7f3a7810f530 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.879+0000 7f3a7e813640 1 --2- 172.21.15.7:0/1761275754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a781083b0 0x7f3a781087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.879+0000 7f3a7e813640 1 --2- 172.21.15.7:0/1761275754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a78102a70 0x7f3a78102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.879+0000 7f3a7e813640 1 -- 172.21.15.7:0/1761275754 >> 172.21.15.7:0/1761275754 conn(0x7f3a78079710 msgr2=0x7f3a78079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.880+0000 7f3a7e813640 1 -- 172.21.15.7:0/1761275754 shutdown_connections 2024-09-21T06:03:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.880+0000 7f3a7e813640 1 -- 172.21.15.7:0/1761275754 wait complete. 2024-09-21T06:03:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.880+0000 7f3a7e813640 1 Processor -- start 2024-09-21T06:03:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.880+0000 7f3a7e813640 1 -- start start 2024-09-21T06:03:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7e813640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a78102a70 0x7f3a7819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7e813640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a781083b0 0x7f3a7819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7e813640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a78108d00 0x7f3a7819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7e813640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a781129c0 con 0x7f3a78108d00 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7e813640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3a78112840 con 0x7f3a78102a70 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7e813640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3a78112b40 con 0x7f3a781083b0 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7cdb0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a78108d00 0x7f3a7819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7cdb0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a78108d00 0x7f3a7819fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59436/0 (socket says 172.21.15.7:59436) 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7cdb0640 1 -- 172.21.15.7:0/566530969 learned_addr learned my addr 172.21.15.7:0/566530969 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a77fff640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a78102a70 0x7f3a7819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a777fe640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a781083b0 0x7f3a7819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7cdb0640 1 -- 172.21.15.7:0/566530969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a781083b0 msgr2=0x7f3a7819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7cdb0640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a781083b0 0x7f3a7819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7cdb0640 1 -- 172.21.15.7:0/566530969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a78102a70 msgr2=0x7f3a7819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7cdb0640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a78102a70 0x7f3a7819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.881+0000 7f3a7cdb0640 1 -- 172.21.15.7:0/566530969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a781a0430 con 0x7f3a78108d00 2024-09-21T06:03:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.882+0000 7f3a7cdb0640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a78108d00 0x7f3a7819fd00 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f3a70005cc0 tx=0x7f3a7002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:18.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.882+0000 7f3a757fa640 1 -- 172.21.15.7:0/566530969 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70003bf0 con 0x7f3a78108d00 2024-09-21T06:03:18.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.882+0000 7f3a7e813640 1 -- 172.21.15.7:0/566530969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a781a06c0 con 0x7f3a78108d00 2024-09-21T06:03:18.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.882+0000 7f3a757fa640 1 -- 172.21.15.7:0/566530969 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a70003d90 con 0x7f3a78108d00 2024-09-21T06:03:18.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.882+0000 7f3a757fa640 1 -- 172.21.15.7:0/566530969 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7002fbc0 con 0x7f3a78108d00 2024-09-21T06:03:18.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.882+0000 7f3a7e813640 1 -- 172.21.15.7:0/566530969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a781a6e80 con 0x7f3a78108d00 2024-09-21T06:03:18.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.885+0000 7f3a84d87740 1 Processor -- start 2024-09-21T06:03:18.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.885+0000 7f3a757fa640 1 -- 172.21.15.7:0/566530969 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3a7002fd60 con 0x7f3a78108d00 2024-09-21T06:03:18.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.885+0000 7f3a84d87740 1 -- start start 2024-09-21T06:03:18.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.885+0000 7f3a84d87740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c44070 0x560d83feb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.885+0000 7f3a84d87740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c1b1b0 0x560d83feb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.885+0000 7f3a84d87740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c23390 0x560d83febcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.885+0000 7f3a84d87740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d83f61e50 con 0x560d83c44070 2024-09-21T06:03:18.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.885+0000 7f3a84d87740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560d83f51280 con 0x560d83c1b1b0 2024-09-21T06:03:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.885+0000 7f3a84d87740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560d83f55090 con 0x560d83c23390 2024-09-21T06:03:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.885+0000 7f3a777fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c44070 0x560d83feb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.885+0000 7f3a777fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c44070 0x560d83feb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59450/0 (socket says 172.21.15.7:59450) 2024-09-21T06:03:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.885+0000 7f3a777fe640 1 -- 172.21.15.7:0/3847995564 learned_addr learned my addr 172.21.15.7:0/3847995564 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.885+0000 7f3a77fff640 1 --2- 172.21.15.7:0/3847995564 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c1b1b0 0x560d83feb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.886+0000 7f3a777fe640 1 --2- 172.21.15.7:0/3847995564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c23390 0x560d83febcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.886+0000 7f3a777fe640 1 -- 172.21.15.7:0/3847995564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c23390 msgr2=0x560d83febcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.886+0000 7f3a777fe640 1 --2- 172.21.15.7:0/3847995564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c23390 0x560d83febcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.886+0000 7f3a777fe640 1 -- 172.21.15.7:0/3847995564 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c1b1b0 msgr2=0x560d83feb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.886+0000 7f3a777fe640 1 --2- 172.21.15.7:0/3847995564 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c1b1b0 0x560d83feb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.886+0000 7f3a777fe640 1 -- 172.21.15.7:0/3847995564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d83caf650 con 0x560d83c44070 2024-09-21T06:03:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.886+0000 7f3a757fa640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3a600b6680 0x7f3a600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.886+0000 7f3a77fff640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3a600b6680 0x7f3a600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.886+0000 7f3a777fe640 1 --2- 172.21.15.7:0/3847995564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c44070 0x560d83feb270 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00bf60 tx=0x7f3a6c00b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1901cbdaa5d6599c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.886+0000 7f3a757fa640 1 -- 172.21.15.7:0/566530969 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f3a70108bf0 con 0x7f3a78108d00 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.886+0000 7f3a5e7fc640 1 -- 172.21.15.7:0/3847995564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c004020 con 0x560d83c44070 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.886+0000 7f3a5e7fc640 1 -- 172.21.15.7:0/3847995564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a6c004c50 con 0x560d83c44070 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.886+0000 7f3a5e7fc640 1 -- 172.21.15.7:0/3847995564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c0052a0 con 0x560d83c44070 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.887+0000 7f3a84d87740 1 -- 172.21.15.7:0/3847995564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c44070 msgr2=0x560d83feb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.887+0000 7f3a77fff640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3a600b6680 0x7f3a600b8b90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3a680058c0 tx=0x7f3a6800a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.887+0000 7f3a84d87740 1 --2- 172.21.15.7:0/3847995564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c44070 0x560d83feb270 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00bf60 tx=0x7f3a6c00b650 comp rx=0 tx=0).stop 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.887+0000 7f3a84d87740 1 -- 172.21.15.7:0/3847995564 shutdown_connections 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.887+0000 7f3a84d87740 1 --2- 172.21.15.7:0/3847995564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c23390 0x560d83febcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.887+0000 7f3a84d87740 1 --2- 172.21.15.7:0/3847995564 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c1b1b0 0x560d83feb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.887+0000 7f3a84d87740 1 --2- 172.21.15.7:0/3847995564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c44070 0x560d83feb270 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.887+0000 7f3a84d87740 1 -- 172.21.15.7:0/3847995564 >> 172.21.15.7:0/3847995564 conn(0x560d83c38460 msgr2=0x560d83fe9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.887+0000 7f3a84d87740 1 -- 172.21.15.7:0/3847995564 shutdown_connections 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.887+0000 7f3a84d87740 1 -- 172.21.15.7:0/3847995564 wait complete. 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.888+0000 7f3a84d87740 1 -- start start 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.888+0000 7f3a84d87740 1 Processor -- start 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.888+0000 7f3a84d87740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 0x560d83ffad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.888+0000 7f3a84d87740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c23390 0x560d83ffb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.888+0000 7f3a84d87740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c44070 0x560d840070e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.888+0000 7f3a84d87740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d83db2700 con 0x560d83c1b1b0 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.888+0000 7f3a84d87740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560d83eec110 con 0x560d83c23390 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.888+0000 7f3a84d87740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560d83ffdd80 con 0x560d83c44070 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.889+0000 7f3a84d87740 10 client.0 _ll_register_callbacks cb 0x560d83f05990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.889+0000 7f3a77fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 0x560d83ffad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.889+0000 7f3a77fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 0x560d83ffad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59454/0 (socket says 172.21.15.7:59454) 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.889+0000 7f3a77fff640 1 -- 172.21.15.7:0/4120714706 learned_addr learned my addr 172.21.15.7:0/4120714706 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.889+0000 7f3a777fe640 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c23390 0x560d83ffb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.889+0000 7f3a7cdb0640 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c44070 0x560d840070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.889+0000 7f3a7cdb0640 1 -- 172.21.15.7:0/4120714706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c23390 msgr2=0x560d83ffb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.889+0000 7f3a7cdb0640 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c23390 0x560d83ffb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.889+0000 7f3a7cdb0640 1 -- 172.21.15.7:0/4120714706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 msgr2=0x560d83ffad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.889+0000 7f3a7cdb0640 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 0x560d83ffad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.889+0000 7f3a7cdb0640 1 -- 172.21.15.7:0/4120714706 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d83f19c40 con 0x560d83c44070 2024-09-21T06:03:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.889+0000 7f3a77fff640 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 0x560d83ffad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.890+0000 7f3a7cdb0640 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c44070 0x560d840070e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3a70106390 tx=0x7f3a700ce200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=450235ac941c16bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.890+0000 7f3a577fe640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T06:03:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.890+0000 7f3a577fe640 1 -- 172.21.15.7:0/4120714706 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a700ce5a0 con 0x560d83c44070 2024-09-21T06:03:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.890+0000 7f3a84d87740 1 -- 172.21.15.7:0/4120714706 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a6c004c50 con 0x560d83c44070 2024-09-21T06:03:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.890+0000 7f3a577fe640 1 -- 172.21.15.7:0/4120714706 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f3a70004610 con 0x560d83c44070 2024-09-21T06:03:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.890+0000 7f3a577fe640 1 -- 172.21.15.7:0/4120714706 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3a700f6020 con 0x560d83c44070 2024-09-21T06:03:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.890+0000 7f3a84d87740 10 client.27442 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.890+0000 7f3a84d87740 1 -- 172.21.15.7:0/4120714706 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560d84009ad0 con 0x560d83c44070 2024-09-21T06:03:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.890+0000 7f3a577fe640 1 -- 172.21.15.7:0/4120714706 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a6c004c50 con 0x560d83c44070 2024-09-21T06:03:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.890+0000 7f3a577fe640 1 -- 172.21.15.7:0/4120714706 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3a70106ae0 con 0x560d83c44070 2024-09-21T06:03:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.891+0000 7f3a84d87740 10 client.27442 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.891+0000 7f3a84d87740 10 client.27442 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.891+0000 7f3a84d87740 20 client.27442 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.891+0000 7f3a84d87740 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560d83c029f0 0x560d8400cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.891+0000 7f3a84d87740 4 client.27442 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.891+0000 7f3a84d87740 1 -- 172.21.15.7:0/4120714706 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d83f63da0 con 0x560d83c029f0 2024-09-21T06:03:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.891+0000 7f3a77fff640 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560d83c029f0 0x560d8400cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.891+0000 7f3a577fe640 10 client.27442 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.891+0000 7f3a77fff640 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560d83c029f0 0x560d8400cff0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8855ed0be12600dc server_cookie=9f6c98e9a7a660b7 in_seq=0 out_seq=0 2024-09-21T06:03:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.892+0000 7f3a577fe640 1 -- 172.21.15.7:0/4120714706 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d83f63da0 con 0x560d83c029f0 2024-09-21T06:03:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.892+0000 7f3a577fe640 10 client.27442 handle_command_reply: tid=0 2024-09-21T06:03:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.892+0000 7f3a84d87740 1 client.27442 shutdown 2024-09-21T06:03:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.892+0000 7f3a84d87740 1 -- 172.21.15.7:0/4120714706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c44070 msgr2=0x560d840070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.892+0000 7f3a84d87740 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c44070 0x560d840070e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3a70106390 tx=0x7f3a700ce200 comp rx=0 tx=0).stop 2024-09-21T06:03:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.892+0000 7f3a84d87740 1 -- 172.21.15.7:0/4120714706 shutdown_connections 2024-09-21T06:03:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.892+0000 7f3a84d87740 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560d83c029f0 0x560d8400cff0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.892+0000 7f3a84d87740 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c44070 0x560d840070e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.892+0000 7f3a84d87740 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c23390 0x560d83ffb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.892+0000 7f3a577fe640 0 client.27442 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.892+0000 7f3a84d87740 1 --2- 172.21.15.7:0/4120714706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 0x560d83ffad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.892+0000 7f3a84d87740 1 -- 172.21.15.7:0/4120714706 >> 172.21.15.7:0/4120714706 conn(0x560d83c38460 msgr2=0x560d83fee400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.892+0000 7f3a84d87740 1 -- 172.21.15.7:0/4120714706 shutdown_connections 2024-09-21T06:03:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.893+0000 7f3a84d87740 1 -- 172.21.15.7:0/4120714706 wait complete. 2024-09-21T06:03:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.893+0000 7f3a84d87740 20 client.27442 trim_cache size 0 max 16384 2024-09-21T06:03:18.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.910+0000 7f3a84d87740 1 Processor -- start 2024-09-21T06:03:18.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.910+0000 7f3a84d87740 1 -- start start 2024-09-21T06:03:18.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.910+0000 7f3a84d87740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c38460 0x560d83ffb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.910+0000 7f3a84d87740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c029f0 0x560d83fe8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.910+0000 7f3a84d87740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c1b1b0 0x560d83fe8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.910+0000 7f3a84d87740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a781afb60 con 0x560d83c029f0 2024-09-21T06:03:18.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.910+0000 7f3a84d87740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3a781ad430 con 0x560d83c38460 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.910+0000 7f3a84d87740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3a781ab2a0 con 0x560d83c1b1b0 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.910+0000 7f3a777fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c029f0 0x560d83fe8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.910+0000 7f3a777fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c029f0 0x560d83fe8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59462/0 (socket says 172.21.15.7:59462) 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.910+0000 7f3a777fe640 1 -- 172.21.15.7:0/1743121850 learned_addr learned my addr 172.21.15.7:0/1743121850 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.910+0000 7f3a77fff640 1 --2- 172.21.15.7:0/1743121850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c38460 0x560d83ffb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.910+0000 7f3a7cdb0640 1 --2- 172.21.15.7:0/1743121850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c1b1b0 0x560d83fe8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.911+0000 7f3a777fe640 1 -- 172.21.15.7:0/1743121850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c1b1b0 msgr2=0x560d83fe8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.911+0000 7f3a777fe640 1 --2- 172.21.15.7:0/1743121850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c1b1b0 0x560d83fe8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.911+0000 7f3a777fe640 1 -- 172.21.15.7:0/1743121850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c38460 msgr2=0x560d83ffb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.911+0000 7f3a777fe640 1 --2- 172.21.15.7:0/1743121850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c38460 0x560d83ffb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.911+0000 7f3a777fe640 1 -- 172.21.15.7:0/1743121850 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d83ff9210 con 0x560d83c029f0 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.911+0000 7f3a7cdb0640 1 --2- 172.21.15.7:0/1743121850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c1b1b0 0x560d83fe8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.911+0000 7f3a77fff640 1 --2- 172.21.15.7:0/1743121850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c38460 0x560d83ffb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.911+0000 7f3a777fe640 1 --2- 172.21.15.7:0/1743121850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c029f0 0x560d83fe8710 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00bf60 tx=0x7f3a6c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3cde8d4d7b7128 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.911+0000 7f3a5dffb640 1 -- 172.21.15.7:0/1743121850 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c004470 con 0x560d83c029f0 2024-09-21T06:03:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.911+0000 7f3a5dffb640 1 -- 172.21.15.7:0/1743121850 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a6c005520 con 0x560d83c029f0 2024-09-21T06:03:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.911+0000 7f3a5dffb640 1 -- 172.21.15.7:0/1743121850 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c004cb0 con 0x560d83c029f0 2024-09-21T06:03:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.912+0000 7f3a84d87740 1 -- 172.21.15.7:0/1743121850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c029f0 msgr2=0x560d83fe8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.912+0000 7f3a84d87740 1 --2- 172.21.15.7:0/1743121850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c029f0 0x560d83fe8710 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00bf60 tx=0x7f3a6c00bf90 comp rx=0 tx=0).stop 2024-09-21T06:03:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.912+0000 7f3a84d87740 1 -- 172.21.15.7:0/1743121850 shutdown_connections 2024-09-21T06:03:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.912+0000 7f3a84d87740 1 --2- 172.21.15.7:0/1743121850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c029f0 0x560d83fe8710 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.912+0000 7f3a84d87740 1 --2- 172.21.15.7:0/1743121850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c1b1b0 0x560d83fe8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.912+0000 7f3a84d87740 1 --2- 172.21.15.7:0/1743121850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c38460 0x560d83ffb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.912+0000 7f3a84d87740 1 -- 172.21.15.7:0/1743121850 >> 172.21.15.7:0/1743121850 conn(0x560d8400d2e0 msgr2=0x560d83ffaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.912+0000 7f3a84d87740 1 -- 172.21.15.7:0/1743121850 shutdown_connections 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.912+0000 7f3a84d87740 1 -- 172.21.15.7:0/1743121850 wait complete. 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.912+0000 7f3a84d87740 1 -- start start 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.913+0000 7f3a84d87740 1 Processor -- start 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.913+0000 7f3a84d87740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c029f0 0x560d83fff390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.913+0000 7f3a84d87740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 0x560d83fff8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.913+0000 7f3a84d87740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c38460 0x560d840769b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.913+0000 7f3a84d87740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a781ab8f0 con 0x560d83c1b1b0 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.913+0000 7f3a84d87740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3a781acd60 con 0x560d83c38460 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.913+0000 7f3a84d87740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3a781abfc0 con 0x560d83c029f0 2024-09-21T06:03:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.913+0000 7f3a84d87740 10 client.0 _ll_register_callbacks cb 0x7f3a70009430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.913+0000 7f3a777fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 0x560d83fff8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.913+0000 7f3a777fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 0x560d83fff8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59474/0 (socket says 172.21.15.7:59474) 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.913+0000 7f3a777fe640 1 -- 172.21.15.7:0/1252502091 learned_addr learned my addr 172.21.15.7:0/1252502091 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.913+0000 7f3a77fff640 1 --2- 172.21.15.7:0/1252502091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c029f0 0x560d83fff390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.913+0000 7f3a7cdb0640 1 --2- 172.21.15.7:0/1252502091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c38460 0x560d840769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a777fe640 1 -- 172.21.15.7:0/1252502091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c029f0 msgr2=0x560d83fff390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a777fe640 1 --2- 172.21.15.7:0/1252502091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c029f0 0x560d83fff390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a777fe640 1 -- 172.21.15.7:0/1252502091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c38460 msgr2=0x560d840769b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a777fe640 1 --2- 172.21.15.7:0/1252502091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c38460 0x560d840769b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a777fe640 1 -- 172.21.15.7:0/1252502091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d84076ef0 con 0x560d83c1b1b0 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a777fe640 1 --2- 172.21.15.7:0/1252502091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 0x560d83fff8d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c005900 tx=0x7f3a6c004890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c1bffe39421aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a577fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a577fe640 1 -- 172.21.15.7:0/1252502091 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c037060 con 0x560d83c1b1b0 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a577fe640 1 -- 172.21.15.7:0/1252502091 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f3a6c004e40 con 0x560d83c1b1b0 2024-09-21T06:03:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a84d87740 1 -- 172.21.15.7:0/1252502091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a6c005520 con 0x560d83c1b1b0 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a577fe640 1 -- 172.21.15.7:0/1252502091 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3a6c012200 con 0x560d83c1b1b0 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a84d87740 10 client.18243 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a84d87740 1 -- 172.21.15.7:0/1252502091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560d84077ea0 con 0x560d83c1b1b0 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.914+0000 7f3a577fe640 1 -- 172.21.15.7:0/1252502091 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a6c005520 con 0x560d83c1b1b0 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.915+0000 7f3a577fe640 1 -- 172.21.15.7:0/1252502091 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3a6c02a410 con 0x560d83c1b1b0 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.915+0000 7f3a84d87740 10 client.18243 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.915+0000 7f3a84d87740 10 client.18243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.915+0000 7f3a84d87740 20 client.18243 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.915+0000 7f3a84d87740 1 --2- 172.21.15.7:0/1252502091 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560d83c23390 0x560d8407a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.915+0000 7f3a84d87740 4 client.18243 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.915+0000 7f3a84d87740 1 -- 172.21.15.7:0/1252502091 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560d83f5f850 con 0x560d83c23390 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.915+0000 7f3a77fff640 1 --2- 172.21.15.7:0/1252502091 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560d83c23390 0x560d8407a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.915+0000 7f3a77fff640 1 --2- 172.21.15.7:0/1252502091 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560d83c23390 0x560d8407a320 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd377fffb88e2158 server_cookie=83bfa70127dfe79 in_seq=0 out_seq=0 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.915+0000 7f3a577fe640 10 client.18243 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a577fe640 1 -- 172.21.15.7:0/1252502091 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7474 (crc 0 0 0) 0x560d83f5f850 con 0x560d83c23390 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a577fe640 10 client.18243 handle_command_reply: tid=0 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a84d87740 1 client.18243 shutdown 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a84d87740 1 -- 172.21.15.7:0/1252502091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 msgr2=0x560d83fff8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a84d87740 1 --2- 172.21.15.7:0/1252502091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 0x560d83fff8d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c005900 tx=0x7f3a6c004890 comp rx=0 tx=0).stop 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a84d87740 1 -- 172.21.15.7:0/1252502091 shutdown_connections 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a84d87740 1 --2- 172.21.15.7:0/1252502091 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x560d83c23390 0x560d8407a320 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a84d87740 1 --2- 172.21.15.7:0/1252502091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d83c1b1b0 0x560d83fff8d0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a84d87740 1 --2- 172.21.15.7:0/1252502091 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560d83c38460 0x560d840769b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a577fe640 0 client.18243 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a84d87740 1 --2- 172.21.15.7:0/1252502091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560d83c029f0 0x560d83fff390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a84d87740 1 -- 172.21.15.7:0/1252502091 >> 172.21.15.7:0/1252502091 conn(0x560d8400d2e0 msgr2=0x560d83ffc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a84d87740 1 -- 172.21.15.7:0/1252502091 shutdown_connections 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a84d87740 1 -- 172.21.15.7:0/1252502091 wait complete. 2024-09-21T06:03:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.916+0000 7f3a84d87740 20 client.18243 trim_cache size 0 max 16384 2024-09-21T06:03:18.923 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:03:18.923 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:03:18.923 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:03:18.923 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:03:18.923 INFO:teuthology.orchestra.run.smithi007.stdout: "40df47a2-fbba-49bc-a842-15ce641cb6ee": { 2024-09-21T06:03:18.923 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:03:17.234445+0000", 2024-09-21T06:03:18.923 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.923 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.924 INFO:teuthology.orchestra.run.smithi007.stdout: "1d89aa12-56bd-49e8-bbd4-0309b4e70f2a": { 2024-09-21T06:03:18.924 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:02:56.375957+0000", 2024-09-21T06:03:18.924 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.925 INFO:teuthology.orchestra.run.smithi007.stdout: "46ad69b3-ef90-42e0-a57b-ea33e3ef74ab": { 2024-09-21T06:03:18.925 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:32.287019+0000", 2024-09-21T06:03:18.925 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.925 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.925 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.925 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.925 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.925 INFO:teuthology.orchestra.run.smithi007.stdout: "d9b96838-732e-40a1-9fad-f54faef73b59": { 2024-09-21T06:03:18.925 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:21.774276+0000", 2024-09-21T06:03:18.925 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: "fd9e7ebd-b70a-487f-937b-80b64378d04b": { 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:11.755521+0000", 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.926 INFO:teuthology.orchestra.run.smithi007.stdout: "3bd778db-a0ed-42ad-8a79-14a200f0734e": { 2024-09-21T06:03:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:51.556015+0000", 2024-09-21T06:03:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:03:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:03:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.927 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: "f5c9a9cd-a1fc-4e1a-8442-f7c676fc4489": { 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:03:06.938698+0000", 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:03:18.929 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:03:18.930 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.930 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.930 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.930 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.930 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.930 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:03:18.930 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:03:18.930 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.930 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.930 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.930 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.930 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: "ecf3518d-a174-4cee-89a1-6aa26e1b3442": { 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:01.909762+0000", 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.931 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:03:18.934 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:03:18.935 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:03:18.936 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.936 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.936 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.936 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.937 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.937 INFO:teuthology.orchestra.run.smithi007.stdout: "a9901d9b-aa10-4587-83ff-d32730ff12ea": { 2024-09-21T06:03:18.937 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:02:14.695980+0000", 2024-09-21T06:03:18.937 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.937 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:03:18.938 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:03:18.939 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:03:18.940 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:03:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.917+0000 7f3a7e813640 1 -- 172.21.15.7:0/566530969 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3a600b6680 msgr2=0x7f3a600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.917+0000 7f3a7e813640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3a600b6680 0x7f3a600b8b90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3a680058c0 tx=0x7f3a6800a250 comp rx=0 tx=0).stop 2024-09-21T06:03:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.917+0000 7f3a7e813640 1 -- 172.21.15.7:0/566530969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a78108d00 msgr2=0x7f3a7819fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.917+0000 7f3a7e813640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a78108d00 0x7f3a7819fd00 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f3a70005cc0 tx=0x7f3a7002f380 comp rx=0 tx=0).stop 2024-09-21T06:03:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.917+0000 7f3a7e813640 1 -- 172.21.15.7:0/566530969 shutdown_connections 2024-09-21T06:03:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.917+0000 7f3a7e813640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3a600b6680 0x7f3a600b8b90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.917+0000 7f3a7e813640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a78108d00 0x7f3a7819fd00 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.917+0000 7f3a7e813640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a781083b0 0x7f3a7819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.917+0000 7f3a7e813640 1 --2- 172.21.15.7:0/566530969 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a78102a70 0x7f3a7819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.917+0000 7f3a7e813640 1 -- 172.21.15.7:0/566530969 >> 172.21.15.7:0/566530969 conn(0x7f3a78079710 msgr2=0x7f3a78101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.917+0000 7f3a7e813640 1 -- 172.21.15.7:0/566530969 shutdown_connections 2024-09-21T06:03:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:18.917+0000 7f3a7e813640 1 -- 172.21.15.7:0/566530969 wait complete. 2024-09-21T06:03:19.666 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:03:19.667 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:03:19.927 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:20.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:20 smithi007 ceph-mon[30983]: pgmap v609: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:03:20.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:20 smithi119 ceph-mon[34833]: pgmap v609: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:03:20.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.387+0000 7f76b8c80640 1 -- 172.21.15.7:0/313188765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41083b0 msgr2=0x7f76b41087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.387+0000 7f76b8c80640 1 --2- 172.21.15.7:0/313188765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41083b0 0x7f76b41087c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f769c009900 tx=0x7f769c02a410 comp rx=0 tx=0).stop 2024-09-21T06:03:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.387+0000 7f76b8c80640 1 -- 172.21.15.7:0/313188765 shutdown_connections 2024-09-21T06:03:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.387+0000 7f76b8c80640 1 --2- 172.21.15.7:0/313188765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41083b0 0x7f76b41087c0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.387+0000 7f76b8c80640 1 --2- 172.21.15.7:0/313188765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b4108d00 0x7f76b410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.387+0000 7f76b8c80640 1 --2- 172.21.15.7:0/313188765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76b4102a70 0x7f76b4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.387+0000 7f76b8c80640 1 -- 172.21.15.7:0/313188765 >> 172.21.15.7:0/313188765 conn(0x7f76b4079710 msgr2=0x7f76b4079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.387+0000 7f76b8c80640 1 -- 172.21.15.7:0/313188765 shutdown_connections 2024-09-21T06:03:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.387+0000 7f76b8c80640 1 -- 172.21.15.7:0/313188765 wait complete. 2024-09-21T06:03:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.388+0000 7f76b8c80640 1 Processor -- start 2024-09-21T06:03:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.388+0000 7f76b8c80640 1 -- start start 2024-09-21T06:03:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.388+0000 7f76b8c80640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4102a70 0x7f76b419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.388+0000 7f76b8c80640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b41083b0 0x7f76b419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.388+0000 7f76b8c80640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76b4108d00 0x7f76b419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.388+0000 7f76b8c80640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f76b41129c0 con 0x7f76b4102a70 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.388+0000 7f76b8c80640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f76b4112840 con 0x7f76b4108d00 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.388+0000 7f76b8c80640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f76b4112b40 con 0x7f76b41083b0 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.388+0000 7f76b259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4102a70 0x7f76b419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.388+0000 7f76b259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4102a70 0x7f76b419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59484/0 (socket says 172.21.15.7:59484) 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.388+0000 7f76b259c640 1 -- 172.21.15.7:0/4096674959 learned_addr learned my addr 172.21.15.7:0/4096674959 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76b2d9d640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76b4108d00 0x7f76b419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76abfff640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b41083b0 0x7f76b419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76b259c640 1 -- 172.21.15.7:0/4096674959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b41083b0 msgr2=0x7f76b419b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76b259c640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b41083b0 0x7f76b419b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76b259c640 1 -- 172.21.15.7:0/4096674959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76b4108d00 msgr2=0x7f76b419bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76b259c640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76b4108d00 0x7f76b419bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76b259c640 1 -- 172.21.15.7:0/4096674959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b41a6610 con 0x7f76b4102a70 2024-09-21T06:03:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76abfff640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b41083b0 0x7f76b419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76b259c640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4102a70 0x7f76b419b350 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f76a400d950 tx=0x7f76a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76ab7fe640 1 -- 172.21.15.7:0/4096674959 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a4017030 con 0x7f76b4102a70 2024-09-21T06:03:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76ab7fe640 1 -- 172.21.15.7:0/4096674959 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76a4004020 con 0x7f76b4102a70 2024-09-21T06:03:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76ab7fe640 1 -- 172.21.15.7:0/4096674959 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a40047a0 con 0x7f76b4102a70 2024-09-21T06:03:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76b8c80640 1 -- 172.21.15.7:0/4096674959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b41a6900 con 0x7f76b4102a70 2024-09-21T06:03:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.389+0000 7f76b8c80640 1 -- 172.21.15.7:0/4096674959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b41a6e10 con 0x7f76b4102a70 2024-09-21T06:03:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.390+0000 7f76b8c80640 1 -- 172.21.15.7:0/4096674959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b4103cf0 con 0x7f76b4102a70 2024-09-21T06:03:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.392+0000 7f76ab7fe640 1 -- 172.21.15.7:0/4096674959 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f76a4009a30 con 0x7f76b4102a70 2024-09-21T06:03:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.393+0000 7f76ab7fe640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f76a00b6680 0x7f76a00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.393+0000 7f76abfff640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f76a00b6680 0x7f76a00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.394+0000 7f76ab7fe640 1 -- 172.21.15.7:0/4096674959 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f76a40e7770 con 0x7f76b4102a70 2024-09-21T06:03:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.394+0000 7f76abfff640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f76a00b6680 0x7f76a00b8b90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f769c009230 tx=0x7f769c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:20.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.397+0000 7f76ab7fe640 1 -- 172.21.15.7:0/4096674959 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76a40add10 con 0x7f76b4102a70 2024-09-21T06:03:20.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:20 smithi027 ceph-mon[34364]: pgmap v609: 97 pgs: 97 active+clean; 2.4 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:03:20.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.624+0000 7f76b8c80640 1 -- 172.21.15.7:0/4096674959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76b4102e80 con 0x7f76b4102a70 2024-09-21T06:03:20.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.625+0000 7f76ab7fe640 1 -- 172.21.15.7:0/4096674959 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f76b4102e80 con 0x7f76b4102a70 2024-09-21T06:03:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:03:20.627 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:03:20.628 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:03:20.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.627+0000 7f76b8c80640 1 -- 172.21.15.7:0/4096674959 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f76a00b6680 msgr2=0x7f76a00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:20.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.627+0000 7f76b8c80640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f76a00b6680 0x7f76a00b8b90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f769c009230 tx=0x7f769c000bc0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.627+0000 7f76b8c80640 1 -- 172.21.15.7:0/4096674959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4102a70 msgr2=0x7f76b419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:20.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.627+0000 7f76b8c80640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4102a70 0x7f76b419b350 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f76a400d950 tx=0x7f76a400de10 comp rx=0 tx=0).stop 2024-09-21T06:03:20.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.627+0000 7f76b8c80640 1 -- 172.21.15.7:0/4096674959 shutdown_connections 2024-09-21T06:03:20.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.627+0000 7f76b8c80640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f76a00b6680 0x7f76a00b8b90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.627+0000 7f76b8c80640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76b4108d00 0x7f76b419bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.627+0000 7f76b8c80640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76b41083b0 0x7f76b419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.627+0000 7f76b8c80640 1 --2- 172.21.15.7:0/4096674959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4102a70 0x7f76b419b350 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.627+0000 7f76b8c80640 1 -- 172.21.15.7:0/4096674959 >> 172.21.15.7:0/4096674959 conn(0x7f76b4079710 msgr2=0x7f76b4106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:20.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.627+0000 7f76b8c80640 1 -- 172.21.15.7:0/4096674959 shutdown_connections 2024-09-21T06:03:20.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:20.627+0000 7f76b8c80640 1 -- 172.21.15.7:0/4096674959 wait complete. 2024-09-21T06:03:21.311 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:03:21.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:21 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/4096674959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:21.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:21 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/4096674959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:21.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:21 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4096674959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:21.574 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.007+0000 7f56488e8640 1 -- 172.21.15.7:0/3145606540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56441020e0 msgr2=0x7f56441024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.007+0000 7f56488e8640 1 --2- 172.21.15.7:0/3145606540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56441020e0 0x7f56441024f0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f5634009900 tx=0x7f563402a410 comp rx=0 tx=0).stop 2024-09-21T06:03:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.007+0000 7f56488e8640 1 -- 172.21.15.7:0/3145606540 shutdown_connections 2024-09-21T06:03:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.007+0000 7f56488e8640 1 --2- 172.21.15.7:0/3145606540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5644106c20 0x7f5644110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.007+0000 7f56488e8640 1 --2- 172.21.15.7:0/3145606540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56441062d0 0x7f56441066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.007+0000 7f56488e8640 1 --2- 172.21.15.7:0/3145606540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56441020e0 0x7f56441024f0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.007+0000 7f56488e8640 1 -- 172.21.15.7:0/3145606540 >> 172.21.15.7:0/3145606540 conn(0x7f5644079e40 msgr2=0x7f564407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:22.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.007+0000 7f56488e8640 1 -- 172.21.15.7:0/3145606540 shutdown_connections 2024-09-21T06:03:22.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.007+0000 7f56488e8640 1 -- 172.21.15.7:0/3145606540 wait complete. 2024-09-21T06:03:22.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.008+0000 7f56488e8640 1 Processor -- start 2024-09-21T06:03:22.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.008+0000 7f56488e8640 1 -- start start 2024-09-21T06:03:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f56488e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56441020e0 0x7f564419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f56488e8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56441062d0 0x7f564419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f56488e8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5644106c20 0x7f564419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f56488e8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5644113ac0 con 0x7f56441020e0 2024-09-21T06:03:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f56488e8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5644113940 con 0x7f56441062d0 2024-09-21T06:03:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f56488e8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5644113c40 con 0x7f5644106c20 2024-09-21T06:03:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f564259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56441020e0 0x7f564419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f564259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56441020e0 0x7f564419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59508/0 (socket says 172.21.15.7:59508) 2024-09-21T06:03:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f564259c640 1 -- 172.21.15.7:0/1908442328 learned_addr learned my addr 172.21.15.7:0/1908442328 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f5642d9d640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5644106c20 0x7f564419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f5639d9b640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56441062d0 0x7f564419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f564259c640 1 -- 172.21.15.7:0/1908442328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5644106c20 msgr2=0x7f564419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f564259c640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5644106c20 0x7f564419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f564259c640 1 -- 172.21.15.7:0/1908442328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56441062d0 msgr2=0x7f564419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f564259c640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56441062d0 0x7f564419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f564259c640 1 -- 172.21.15.7:0/1908442328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56441a0460 con 0x7f56441020e0 2024-09-21T06:03:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f5639d9b640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56441062d0 0x7f564419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.009+0000 7f564259c640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56441020e0 0x7f564419a4f0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5634005940 tx=0x7f56340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.010+0000 7f563bfff640 1 -- 172.21.15.7:0/1908442328 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563403f030 con 0x7f56441020e0 2024-09-21T06:03:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.010+0000 7f563bfff640 1 -- 172.21.15.7:0/1908442328 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5634003cb0 con 0x7f56441020e0 2024-09-21T06:03:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.010+0000 7f56488e8640 1 -- 172.21.15.7:0/1908442328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56441a06f0 con 0x7f56441020e0 2024-09-21T06:03:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.010+0000 7f563bfff640 1 -- 172.21.15.7:0/1908442328 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634035070 con 0x7f56441020e0 2024-09-21T06:03:22.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.010+0000 7f56488e8640 1 -- 172.21.15.7:0/1908442328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56441a6eb0 con 0x7f56441020e0 2024-09-21T06:03:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.012+0000 7f564ee5c740 1 Processor -- start 2024-09-21T06:03:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.013+0000 7f564ee5c740 1 -- start start 2024-09-21T06:03:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.013+0000 7f563bfff640 1 -- 172.21.15.7:0/1908442328 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f5634042030 con 0x7f56441020e0 2024-09-21T06:03:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.013+0000 7f564ee5c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599ee070 0x559c59d952c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.013+0000 7f564ee5c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599c51b0 0x559c59d95800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.013+0000 7f564ee5c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59d95d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.013+0000 7f564ee5c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559c59d0bea0 con 0x559c599cd390 2024-09-21T06:03:22.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.013+0000 7f564ee5c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559c59cfb2d0 con 0x559c599ee070 2024-09-21T06:03:22.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.013+0000 7f564ee5c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559c59cff0e0 con 0x559c599c51b0 2024-09-21T06:03:22.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.013+0000 7f5639d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59d95d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.013+0000 7f5639d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59d95d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59518/0 (socket says 172.21.15.7:59518) 2024-09-21T06:03:22.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.013+0000 7f5639d9b640 1 -- 172.21.15.7:0/2417633820 learned_addr learned my addr 172.21.15.7:0/2417633820 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:22.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.013+0000 7f564259c640 1 --2- 172.21.15.7:0/2417633820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599c51b0 0x559c59d95800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.013+0000 7f5642d9d640 1 --2- 172.21.15.7:0/2417633820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599ee070 0x559c59d952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.014+0000 7f5639d9b640 1 -- 172.21.15.7:0/2417633820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599c51b0 msgr2=0x559c59d95800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.014+0000 7f5639d9b640 1 --2- 172.21.15.7:0/2417633820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599c51b0 0x559c59d95800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.014+0000 7f5639d9b640 1 -- 172.21.15.7:0/2417633820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599ee070 msgr2=0x559c59d952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.014+0000 7f5639d9b640 1 --2- 172.21.15.7:0/2417633820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599ee070 0x559c59d952c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.014+0000 7f5639d9b640 1 -- 172.21.15.7:0/2417633820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c59a59650 con 0x559c599cd390 2024-09-21T06:03:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.014+0000 7f564259c640 1 --2- 172.21.15.7:0/2417633820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599c51b0 0x559c59d95800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.014+0000 7f563bfff640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f56300b6680 0x7f56300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.014+0000 7f5639d9b640 1 --2- 172.21.15.7:0/2417633820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59d95d40 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f562c00bce0 tx=0x7f562c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ffd95d1c312f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.014+0000 7f5642d9d640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f56300b6680 0x7f56300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.014+0000 7f5638d99640 1 -- 172.21.15.7:0/2417633820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c015070 con 0x559c599cd390 2024-09-21T06:03:22.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.014+0000 7f563bfff640 1 -- 172.21.15.7:0/1908442328 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f5634107f80 con 0x7f56441020e0 2024-09-21T06:03:22.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.014+0000 7f5638d99640 1 -- 172.21.15.7:0/2417633820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f562c0118f0 con 0x559c599cd390 2024-09-21T06:03:22.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.014+0000 7f5638d99640 1 -- 172.21.15.7:0/2417633820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c010890 con 0x559c599cd390 2024-09-21T06:03:22.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.015+0000 7f564ee5c740 1 -- 172.21.15.7:0/2417633820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 msgr2=0x559c59d95d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.015+0000 7f5642d9d640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f56300b6680 0x7f56300b8b90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f563c005fd0 tx=0x7f563c009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:22.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.015+0000 7f564ee5c740 1 --2- 172.21.15.7:0/2417633820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59d95d40 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f562c00bce0 tx=0x7f562c00f730 comp rx=0 tx=0).stop 2024-09-21T06:03:22.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.015+0000 7f564ee5c740 1 -- 172.21.15.7:0/2417633820 shutdown_connections 2024-09-21T06:03:22.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.015+0000 7f564ee5c740 1 --2- 172.21.15.7:0/2417633820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59d95d40 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.015+0000 7f564ee5c740 1 --2- 172.21.15.7:0/2417633820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599c51b0 0x559c59d95800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.015+0000 7f564ee5c740 1 --2- 172.21.15.7:0/2417633820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599ee070 0x559c59d952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.015+0000 7f564ee5c740 1 -- 172.21.15.7:0/2417633820 >> 172.21.15.7:0/2417633820 conn(0x559c599e2460 msgr2=0x559c59d931b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.015+0000 7f564ee5c740 1 -- 172.21.15.7:0/2417633820 shutdown_connections 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.015+0000 7f564ee5c740 1 -- 172.21.15.7:0/2417633820 wait complete. 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.016+0000 7f564ee5c740 1 -- start start 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.016+0000 7f564ee5c740 1 Processor -- start 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.016+0000 7f564ee5c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599c51b0 0x559c59da4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.016+0000 7f564ee5c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599cd390 0x559c59da5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.016+0000 7f564ee5c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 0x559c59da5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.016+0000 7f564ee5c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559c59b5c700 con 0x559c599c51b0 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.016+0000 7f564ee5c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x559c59c96160 con 0x559c599cd390 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.016+0000 7f564ee5c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559c59da7e00 con 0x559c599ee070 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.016+0000 7f564ee5c740 10 client.0 _ll_register_callbacks cb 0x559c59caf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.016+0000 7f564259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599c51b0 0x559c59da4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.016+0000 7f564259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599c51b0 0x559c59da4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59530/0 (socket says 172.21.15.7:59530) 2024-09-21T06:03:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.016+0000 7f564259c640 1 -- 172.21.15.7:0/2671239877 learned_addr learned my addr 172.21.15.7:0/2671239877 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.016+0000 7f5639d9b640 1 --2- 172.21.15.7:0/2671239877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599cd390 0x559c59da5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f5642d9d640 1 --2- 172.21.15.7:0/2671239877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 0x559c59da5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f564259c640 1 -- 172.21.15.7:0/2671239877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 msgr2=0x559c59da5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f564259c640 1 --2- 172.21.15.7:0/2671239877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 0x559c59da5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f564259c640 1 -- 172.21.15.7:0/2671239877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599cd390 msgr2=0x559c59da5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f564259c640 1 --2- 172.21.15.7:0/2671239877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599cd390 0x559c59da5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f564259c640 1 -- 172.21.15.7:0/2671239877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c59cc3c90 con 0x559c599c51b0 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f564259c640 1 --2- 172.21.15.7:0/2671239877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599c51b0 0x559c59da4cc0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f5634006010 tx=0x7f563403b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff9b2fe04c96f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f5629ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f5629ffb640 1 -- 172.21.15.7:0/2671239877 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634049070 con 0x559c599c51b0 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f5629ffb640 1 -- 172.21.15.7:0/2671239877 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f563410a110 con 0x559c599c51b0 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f564ee5c740 1 -- 172.21.15.7:0/2671239877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f562c0118f0 con 0x559c599c51b0 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f5629ffb640 1 -- 172.21.15.7:0/2671239877 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f56340cd770 con 0x559c599c51b0 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f564ee5c740 10 client.18261 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f564ee5c740 1 -- 172.21.15.7:0/2671239877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559c59db3a80 con 0x559c599c51b0 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.017+0000 7f5629ffb640 1 -- 172.21.15.7:0/2671239877 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f562c0118f0 con 0x559c599c51b0 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.018+0000 7f5629ffb640 1 -- 172.21.15.7:0/2671239877 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f56340b50b0 con 0x559c599c51b0 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.018+0000 7f564ee5c740 10 client.18261 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.018+0000 7f564ee5c740 10 client.18261 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:03:22.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.018+0000 7f564ee5c740 20 client.18261 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.018+0000 7f564ee5c740 1 --2- 172.21.15.7:0/2671239877 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x559c599ac9f0 0x559c59db6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.018+0000 7f564ee5c740 4 client.18261 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.018+0000 7f564ee5c740 1 -- 172.21.15.7:0/2671239877 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c59d0ddf0 con 0x559c599ac9f0 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.018+0000 7f5639d9b640 1 --2- 172.21.15.7:0/2671239877 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x559c599ac9f0 0x559c59db6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.018+0000 7f5629ffb640 10 client.18261 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.018+0000 7f5639d9b640 1 --2- 172.21.15.7:0/2671239877 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x559c599ac9f0 0x559c59db6ef0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=43808a4049e80256 server_cookie=87176cdf897e2d38 in_seq=0 out_seq=0 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.019+0000 7f5629ffb640 1 -- 172.21.15.7:0/2671239877 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559c59d0ddf0 con 0x559c599ac9f0 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.019+0000 7f5629ffb640 10 client.18261 handle_command_reply: tid=0 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.019+0000 7f564ee5c740 1 client.18261 shutdown 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.019+0000 7f564ee5c740 1 -- 172.21.15.7:0/2671239877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599c51b0 msgr2=0x559c59da4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.019+0000 7f564ee5c740 1 --2- 172.21.15.7:0/2671239877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599c51b0 0x559c59da4cc0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f5634006010 tx=0x7f563403b6b0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.019+0000 7f564ee5c740 1 -- 172.21.15.7:0/2671239877 shutdown_connections 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.019+0000 7f564ee5c740 1 --2- 172.21.15.7:0/2671239877 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x559c599ac9f0 0x559c59db6ef0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.019+0000 7f564ee5c740 1 --2- 172.21.15.7:0/2671239877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 0x559c59da5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.019+0000 7f564ee5c740 1 --2- 172.21.15.7:0/2671239877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599cd390 0x559c59da5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.019+0000 7f564ee5c740 1 --2- 172.21.15.7:0/2671239877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599c51b0 0x559c59da4cc0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.020+0000 7f564ee5c740 1 -- 172.21.15.7:0/2671239877 >> 172.21.15.7:0/2671239877 conn(0x559c599e2460 msgr2=0x559c59d91750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.020+0000 7f5629ffb640 0 client.18261 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:03:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.020+0000 7f564ee5c740 1 -- 172.21.15.7:0/2671239877 shutdown_connections 2024-09-21T06:03:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.020+0000 7f564ee5c740 1 -- 172.21.15.7:0/2671239877 wait complete. 2024-09-21T06:03:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.020+0000 7f564ee5c740 20 client.18261 trim_cache size 0 max 16384 2024-09-21T06:03:22.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.033+0000 7f564ee5c740 1 Processor -- start 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.033+0000 7f564ee5c740 1 -- start start 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.033+0000 7f564ee5c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599c51b0 0x559c59d93200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.033+0000 7f564ee5c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59d9a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.033+0000 7f564ee5c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 0x559c59d9a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.033+0000 7f564ee5c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56441afca0 con 0x559c599cd390 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.033+0000 7f564ee5c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f56441ad570 con 0x559c599c51b0 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.033+0000 7f564ee5c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f56441ab400 con 0x559c599ee070 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.033+0000 7f5639d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59d9a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.033+0000 7f5639d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59d9a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59538/0 (socket says 172.21.15.7:59538) 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.033+0000 7f5639d9b640 1 -- 172.21.15.7:0/3584103468 learned_addr learned my addr 172.21.15.7:0/3584103468 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.034+0000 7f564259c640 1 --2- 172.21.15.7:0/3584103468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599c51b0 0x559c59d93200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.034+0000 7f5639d9b640 1 -- 172.21.15.7:0/3584103468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 msgr2=0x559c59d9a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.034+0000 7f5639d9b640 1 --2- 172.21.15.7:0/3584103468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 0x559c59d9a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.034+0000 7f5639d9b640 1 -- 172.21.15.7:0/3584103468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599c51b0 msgr2=0x559c59d93200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.034+0000 7f5639d9b640 1 --2- 172.21.15.7:0/3584103468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599c51b0 0x559c59d93200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.034+0000 7f5639d9b640 1 -- 172.21.15.7:0/3584103468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c59da7ce0 con 0x559c599cd390 2024-09-21T06:03:22.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.034+0000 7f5639d9b640 1 --2- 172.21.15.7:0/3584103468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59d9a460 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f562c00bc30 tx=0x7f562c00b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367bf333ad48a438 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:22.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.034+0000 7f562bfff640 1 -- 172.21.15.7:0/3584103468 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c015040 con 0x559c599cd390 2024-09-21T06:03:22.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.034+0000 7f562bfff640 1 -- 172.21.15.7:0/3584103468 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f562c005550 con 0x559c599cd390 2024-09-21T06:03:22.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.034+0000 7f562bfff640 1 -- 172.21.15.7:0/3584103468 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c010740 con 0x559c599cd390 2024-09-21T06:03:22.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.035+0000 7f564ee5c740 1 -- 172.21.15.7:0/3584103468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 msgr2=0x559c59d9a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.035+0000 7f564ee5c740 1 --2- 172.21.15.7:0/3584103468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59d9a460 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f562c00bc30 tx=0x7f562c00b980 comp rx=0 tx=0).stop 2024-09-21T06:03:22.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.035+0000 7f564ee5c740 1 -- 172.21.15.7:0/3584103468 shutdown_connections 2024-09-21T06:03:22.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.035+0000 7f564ee5c740 1 --2- 172.21.15.7:0/3584103468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59d9a460 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.035+0000 7f564ee5c740 1 --2- 172.21.15.7:0/3584103468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 0x559c59d9a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.035+0000 7f564ee5c740 1 --2- 172.21.15.7:0/3584103468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599c51b0 0x559c59d93200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.035+0000 7f564ee5c740 1 -- 172.21.15.7:0/3584103468 >> 172.21.15.7:0/3584103468 conn(0x559c599e2460 msgr2=0x559c59d92af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:22.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.035+0000 7f564ee5c740 1 -- 172.21.15.7:0/3584103468 shutdown_connections 2024-09-21T06:03:22.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.035+0000 7f564ee5c740 1 -- 172.21.15.7:0/3584103468 wait complete. 2024-09-21T06:03:22.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.035+0000 7f564ee5c740 1 -- start start 2024-09-21T06:03:22.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.035+0000 7f564ee5c740 1 Processor -- start 2024-09-21T06:03:22.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f564ee5c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599c51b0 0x559c59dad880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f564ee5c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59da8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f564ee5c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 0x559c59da93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f564ee5c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56441aba50 con 0x559c599cd390 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f564ee5c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f56441acea0 con 0x559c599c51b0 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f564ee5c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f56441ac100 con 0x559c599ee070 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f564ee5c740 10 client.0 _ll_register_callbacks cb 0x7f5634005760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f5639d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59da8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f5639d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59da8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59540/0 (socket says 172.21.15.7:59540) 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f5639d9b640 1 -- 172.21.15.7:0/3069266757 learned_addr learned my addr 172.21.15.7:0/3069266757 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f564259c640 1 --2- 172.21.15.7:0/3069266757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599c51b0 0x559c59dad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f5642d9d640 1 --2- 172.21.15.7:0/3069266757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 0x559c59da93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f5639d9b640 1 -- 172.21.15.7:0/3069266757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 msgr2=0x559c59da93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f5639d9b640 1 --2- 172.21.15.7:0/3069266757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 0x559c59da93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f5639d9b640 1 -- 172.21.15.7:0/3069266757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599c51b0 msgr2=0x559c59dad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f5639d9b640 1 --2- 172.21.15.7:0/3069266757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599c51b0 0x559c59dad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f5639d9b640 1 -- 172.21.15.7:0/3069266757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c59da9b20 con 0x559c599cd390 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f5639d9b640 1 --2- 172.21.15.7:0/3069266757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59da8e70 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f562c006010 tx=0x7f562c0050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291d2b8a4fb6e15c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.036+0000 7f5629ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f5629ffb640 1 -- 172.21.15.7:0/3069266757 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c035020 con 0x559c599cd390 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f564ee5c740 1 -- 172.21.15.7:0/3069266757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f562c005550 con 0x559c599cd390 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f5629ffb640 1 -- 172.21.15.7:0/3069266757 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f562c004880 con 0x559c599cd390 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f5629ffb640 1 -- 172.21.15.7:0/3069266757 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f562c040050 con 0x559c599cd390 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f564ee5c740 10 client.18267 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f564ee5c740 1 -- 172.21.15.7:0/3069266757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559c59e217c0 con 0x559c599cd390 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f5629ffb640 1 -- 172.21.15.7:0/3069266757 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f562c005550 con 0x559c599cd390 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f5629ffb640 1 -- 172.21.15.7:0/3069266757 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f562c01ace0 con 0x559c599cd390 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f564ee5c740 10 client.18267 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f564ee5c740 10 client.18267 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:03:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f564ee5c740 20 client.18267 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f564ee5c740 1 --2- 172.21.15.7:0/3069266757 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x559c59981da0 0x559c59e23de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f564ee5c740 4 client.18267 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:03:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.037+0000 7f564ee5c740 1 -- 172.21.15.7:0/3069266757 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559c59d098a0 con 0x559c59981da0 2024-09-21T06:03:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.038+0000 7f564259c640 1 --2- 172.21.15.7:0/3069266757 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x559c59981da0 0x559c59e23de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.038+0000 7f564259c640 1 --2- 172.21.15.7:0/3069266757 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x559c59981da0 0x559c59e23de0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a2a47367aa9a0670 server_cookie=1c5c3bff655d7519 in_seq=0 out_seq=0 2024-09-21T06:03:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.038+0000 7f5629ffb640 10 client.18267 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:03:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.038+0000 7f5629ffb640 1 -- 172.21.15.7:0/3069266757 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559c59d098a0 con 0x559c59981da0 2024-09-21T06:03:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.038+0000 7f5629ffb640 10 client.18267 handle_command_reply: tid=0 2024-09-21T06:03:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.038+0000 7f564ee5c740 1 client.18267 shutdown 2024-09-21T06:03:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.038+0000 7f564ee5c740 1 -- 172.21.15.7:0/3069266757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 msgr2=0x559c59da8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.038+0000 7f564ee5c740 1 --2- 172.21.15.7:0/3069266757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59da8e70 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f562c006010 tx=0x7f562c0050b0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f564ee5c740 1 -- 172.21.15.7:0/3069266757 shutdown_connections 2024-09-21T06:03:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f564ee5c740 1 --2- 172.21.15.7:0/3069266757 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x559c59981da0 0x559c59e23de0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f564ee5c740 1 --2- 172.21.15.7:0/3069266757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c599cd390 0x559c59da8e70 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f564ee5c740 1 --2- 172.21.15.7:0/3069266757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559c599ee070 0x559c59da93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f564ee5c740 1 --2- 172.21.15.7:0/3069266757 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x559c599c51b0 0x559c59dad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f564ee5c740 1 -- 172.21.15.7:0/3069266757 >> 172.21.15.7:0/3069266757 conn(0x559c599e2460 msgr2=0x559c59d9a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:22.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f5629ffb640 0 client.18267 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:03:22.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f564ee5c740 1 -- 172.21.15.7:0/3069266757 shutdown_connections 2024-09-21T06:03:22.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f564ee5c740 1 -- 172.21.15.7:0/3069266757 wait complete. 2024-09-21T06:03:22.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f564ee5c740 20 client.18267 trim_cache size 0 max 16384 2024-09-21T06:03:22.045 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:03:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f56488e8640 1 -- 172.21.15.7:0/1908442328 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f56300b6680 msgr2=0x7f56300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f56488e8640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f56300b6680 0x7f56300b8b90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f563c005fd0 tx=0x7f563c009600 comp rx=0 tx=0).stop 2024-09-21T06:03:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f56488e8640 1 -- 172.21.15.7:0/1908442328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56441020e0 msgr2=0x7f564419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f56488e8640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56441020e0 0x7f564419a4f0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5634005940 tx=0x7f56340042f0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.039+0000 7f56488e8640 1 -- 172.21.15.7:0/1908442328 shutdown_connections 2024-09-21T06:03:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.040+0000 7f56488e8640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f56300b6680 0x7f56300b8b90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.040+0000 7f56488e8640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5644106c20 0x7f564419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.040+0000 7f56488e8640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56441062d0 0x7f564419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.040+0000 7f56488e8640 1 --2- 172.21.15.7:0/1908442328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56441020e0 0x7f564419a4f0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.040+0000 7f56488e8640 1 -- 172.21.15.7:0/1908442328 >> 172.21.15.7:0/1908442328 conn(0x7f5644079e40 msgr2=0x7f5644108130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.040+0000 7f56488e8640 1 -- 172.21.15.7:0/1908442328 shutdown_connections 2024-09-21T06:03:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:22.040+0000 7f56488e8640 1 -- 172.21.15.7:0/1908442328 wait complete. 2024-09-21T06:03:22.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:22 smithi007 ceph-mon[30983]: pgmap v610: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:03:22.341 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:22 smithi119 ceph-mon[34833]: pgmap v610: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:03:22.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:22 smithi027 ceph-mon[34364]: pgmap v610: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:03:22.691 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:03:22.950 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.398+0000 7ff30b686640 1 -- 172.21.15.7:0/405545972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff304104840 msgr2=0x7ff304104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.398+0000 7ff30b686640 1 --2- 172.21.15.7:0/405545972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff304104840 0x7ff304104c50 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ff300009ca0 tx=0x7ff30002a8e0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.398+0000 7ff30b686640 1 -- 172.21.15.7:0/405545972 shutdown_connections 2024-09-21T06:03:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.398+0000 7ff30b686640 1 --2- 172.21.15.7:0/405545972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30410ddf0 0x7ff304110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.398+0000 7ff30b686640 1 --2- 172.21.15.7:0/405545972 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304105270 0x7ff30410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.398+0000 7ff30b686640 1 --2- 172.21.15.7:0/405545972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff304104840 0x7ff304104c50 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.398+0000 7ff30b686640 1 -- 172.21.15.7:0/405545972 >> 172.21.15.7:0/405545972 conn(0x7ff304079730 msgr2=0x7ff304079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.398+0000 7ff30b686640 1 -- 172.21.15.7:0/405545972 shutdown_connections 2024-09-21T06:03:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.398+0000 7ff30b686640 1 -- 172.21.15.7:0/405545972 wait complete. 2024-09-21T06:03:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.399+0000 7ff30b686640 1 Processor -- start 2024-09-21T06:03:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.399+0000 7ff30b686640 1 -- start start 2024-09-21T06:03:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.399+0000 7ff30b686640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304104840 0x7ff30419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.399+0000 7ff30b686640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff304105270 0x7ff30419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.399+0000 7ff30b686640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30410ddf0 0x7ff30419fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.399+0000 7ff30b686640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff304113af0 con 0x7ff304105270 2024-09-21T06:03:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.399+0000 7ff30b686640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff304113970 con 0x7ff304104840 2024-09-21T06:03:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.399+0000 7ff30b686640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff304113c70 con 0x7ff30410ddf0 2024-09-21T06:03:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.399+0000 7ff308c21640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff304105270 0x7ff30419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff308c21640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff304105270 0x7ff30419ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59552/0 (socket says 172.21.15.7:59552) 2024-09-21T06:03:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff308c21640 1 -- 172.21.15.7:0/80552176 learned_addr learned my addr 172.21.15.7:0/80552176 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff309422640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304104840 0x7ff30419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff309c23640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30410ddf0 0x7ff30419fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff308c21640 1 -- 172.21.15.7:0/80552176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30410ddf0 msgr2=0x7ff30419fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff308c21640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30410ddf0 0x7ff30419fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff308c21640 1 -- 172.21.15.7:0/80552176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304104840 msgr2=0x7ff30419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff308c21640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304104840 0x7ff30419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff308c21640 1 -- 172.21.15.7:0/80552176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3041a0550 con 0x7ff304105270 2024-09-21T06:03:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff308c21640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff304105270 0x7ff30419ab80 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4006fd0 tx=0x7ff2f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff2fa7fc640 1 -- 172.21.15.7:0/80552176 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4011830 con 0x7ff304105270 2024-09-21T06:03:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff2fa7fc640 1 -- 172.21.15.7:0/80552176 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2f4016070 con 0x7ff304105270 2024-09-21T06:03:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff30b686640 1 -- 172.21.15.7:0/80552176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3041a0840 con 0x7ff304105270 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff2fa7fc640 1 -- 172.21.15.7:0/80552176 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4010e00 con 0x7ff304105270 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.400+0000 7ff30b686640 1 -- 172.21.15.7:0/80552176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3041a6fa0 con 0x7ff304105270 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.403+0000 7ff2fa7fc640 1 -- 172.21.15.7:0/80552176 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff2f401b460 con 0x7ff304105270 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.403+0000 7ff311bfa740 1 Processor -- start 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff311bfa740 1 -- start start 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff311bfa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff311bfa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd51800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff311bfa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 0x55e43cd51d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff311bfa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e43ccc7ea0 con 0x55e43c9aa070 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff311bfa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e43ccb72d0 con 0x55e43c9811b0 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff311bfa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e43ccbb0e0 con 0x55e43c989390 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff309c23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff309c23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59558/0 (socket says 172.21.15.7:59558) 2024-09-21T06:03:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff309c23640 1 -- 172.21.15.7:0/2936971725 learned_addr learned my addr 172.21.15.7:0/2936971725 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff308c21640 1 --2- 172.21.15.7:0/2936971725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 0x55e43cd51d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff309422640 1 --2- 172.21.15.7:0/2936971725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd51800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff309c23640 1 -- 172.21.15.7:0/2936971725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 msgr2=0x55e43cd51d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.404+0000 7ff309c23640 1 --2- 172.21.15.7:0/2936971725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 0x55e43cd51d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.405+0000 7ff309c23640 1 -- 172.21.15.7:0/2936971725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 msgr2=0x55e43cd51800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.405+0000 7ff309c23640 1 --2- 172.21.15.7:0/2936971725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd51800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.405+0000 7ff2fa7fc640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff2f00b6680 0x7ff2f00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.405+0000 7ff309c23640 1 -- 172.21.15.7:0/2936971725 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e43ca15650 con 0x55e43c9aa070 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.405+0000 7ff309422640 1 --2- 172.21.15.7:0/2936971725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd51800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.405+0000 7ff309c23640 1 --2- 172.21.15.7:0/2936971725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd512c0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00b700 tx=0x7ff2fc00bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5ac9a91d70c7ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.405+0000 7ff2fa7fc640 1 -- 172.21.15.7:0/80552176 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7ff2f40e6ba0 con 0x7ff304105270 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.405+0000 7ff309c23640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff2f00b6680 0x7ff2f00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.405+0000 7ff2ef7fe640 1 -- 172.21.15.7:0/2936971725 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc003dd0 con 0x55e43c9aa070 2024-09-21T06:03:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.405+0000 7ff2ef7fe640 1 -- 172.21.15.7:0/2936971725 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2fc015070 con 0x55e43c9aa070 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.405+0000 7ff2ef7fe640 1 -- 172.21.15.7:0/2936971725 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc011cb0 con 0x55e43c9aa070 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.406+0000 7ff311bfa740 1 -- 172.21.15.7:0/2936971725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 msgr2=0x55e43cd512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.406+0000 7ff309c23640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff2f00b6680 0x7ff2f00b8b90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc01a000 tx=0x7ff2fc010810 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.406+0000 7ff311bfa740 1 --2- 172.21.15.7:0/2936971725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd512c0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00b700 tx=0x7ff2fc00bbc0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.406+0000 7ff311bfa740 1 -- 172.21.15.7:0/2936971725 shutdown_connections 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.406+0000 7ff311bfa740 1 --2- 172.21.15.7:0/2936971725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 0x55e43cd51d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.406+0000 7ff311bfa740 1 --2- 172.21.15.7:0/2936971725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd51800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.406+0000 7ff311bfa740 1 --2- 172.21.15.7:0/2936971725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd512c0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.406+0000 7ff311bfa740 1 -- 172.21.15.7:0/2936971725 >> 172.21.15.7:0/2936971725 conn(0x55e43c99e460 msgr2=0x55e43cd4f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.406+0000 7ff311bfa740 1 -- 172.21.15.7:0/2936971725 shutdown_connections 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.406+0000 7ff311bfa740 1 -- 172.21.15.7:0/2936971725 wait complete. 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.406+0000 7ff311bfa740 1 -- start start 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff311bfa740 1 Processor -- start 2024-09-21T06:03:23.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff311bfa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd5ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff311bfa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 0x55e43cd5cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff311bfa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd68d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff311bfa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e43cb18700 con 0x55e43c9aa070 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff311bfa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55e43cc52160 con 0x55e43c9811b0 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff311bfa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55e43cd5faa0 con 0x55e43c989390 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff311bfa740 10 client.0 _ll_register_callbacks cb 0x55e43cc6b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff309c23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd68d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff309c23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd68d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59574/0 (socket says 172.21.15.7:59574) 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff309c23640 1 -- 172.21.15.7:0/2321816563 learned_addr learned my addr 172.21.15.7:0/2321816563 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff308c21640 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 0x55e43cd5cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff309422640 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd5ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.407+0000 7ff309c23640 1 -- 172.21.15.7:0/2321816563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 msgr2=0x55e43cd5cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff309c23640 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 0x55e43cd5cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff309c23640 1 -- 172.21.15.7:0/2321816563 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 msgr2=0x55e43cd5ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff309c23640 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd5ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff309c23640 1 -- 172.21.15.7:0/2321816563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e43cc7fc90 con 0x55e43c9aa070 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff309422640 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd5ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff309c23640 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd68d90 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0117f0 tx=0x7ff2fc023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9faca3377f988ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff2ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff2ecff9640 1 -- 172.21.15.7:0/2321816563 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc010e90 con 0x55e43c9aa070 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff2ecff9640 1 -- 172.21.15.7:0/2321816563 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7ff2fc011b40 con 0x55e43c9aa070 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff311bfa740 1 -- 172.21.15.7:0/2321816563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2fc015070 con 0x55e43c9aa070 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff2ecff9640 1 -- 172.21.15.7:0/2321816563 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff2fc00be10 con 0x55e43c9aa070 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff311bfa740 10 client.18279 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff311bfa740 1 -- 172.21.15.7:0/2321816563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e43cd6b700 con 0x55e43c9aa070 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.408+0000 7ff2ecff9640 1 -- 172.21.15.7:0/2321816563 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2fc015070 con 0x55e43c9aa070 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.409+0000 7ff2ecff9640 1 -- 172.21.15.7:0/2321816563 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff2fc0048f0 con 0x55e43c9aa070 2024-09-21T06:03:23.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.409+0000 7ff311bfa740 10 client.18279 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.409+0000 7ff311bfa740 10 client.18279 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.409+0000 7ff311bfa740 20 client.18279 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.409+0000 7ff311bfa740 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e43c9689f0 0x55e43cd6eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.409+0000 7ff311bfa740 4 client.18279 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.409+0000 7ff311bfa740 1 -- 172.21.15.7:0/2321816563 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e43ccc9df0 con 0x55e43c9689f0 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.409+0000 7ff309422640 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e43c9689f0 0x55e43cd6eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.409+0000 7ff2ecff9640 10 client.18279 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.409+0000 7ff309422640 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e43c9689f0 0x55e43cd6eac0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32616dc2eb553a58 server_cookie=185815f99cb5613e in_seq=0 out_seq=0 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff2ecff9640 1 -- 172.21.15.7:0/2321816563 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e43ccc9df0 con 0x55e43c9689f0 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff2ecff9640 10 client.18279 handle_command_reply: tid=0 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff311bfa740 1 client.18279 shutdown 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff311bfa740 1 -- 172.21.15.7:0/2321816563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 msgr2=0x55e43cd68d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff311bfa740 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd68d90 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0117f0 tx=0x7ff2fc023000 comp rx=0 tx=0).stop 2024-09-21T06:03:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff311bfa740 1 -- 172.21.15.7:0/2321816563 shutdown_connections 2024-09-21T06:03:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff311bfa740 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e43c9689f0 0x55e43cd6eac0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff311bfa740 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd68d90 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff311bfa740 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 0x55e43cd5cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff311bfa740 1 --2- 172.21.15.7:0/2321816563 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd5ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff311bfa740 1 -- 172.21.15.7:0/2321816563 >> 172.21.15.7:0/2321816563 conn(0x55e43c99e460 msgr2=0x55e43cd544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff2ecff9640 0 client.18279 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:03:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff311bfa740 1 -- 172.21.15.7:0/2321816563 shutdown_connections 2024-09-21T06:03:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.410+0000 7ff311bfa740 1 -- 172.21.15.7:0/2321816563 wait complete. 2024-09-21T06:03:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.411+0000 7ff311bfa740 20 client.18279 trim_cache size 0 max 16384 2024-09-21T06:03:23.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff311bfa740 1 Processor -- start 2024-09-21T06:03:23.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff311bfa740 1 -- start start 2024-09-21T06:03:23.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff311bfa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c9811b0 0x55e43cd5e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff311bfa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c989390 0x55e43cd52a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff311bfa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd68c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff311bfa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff3041b20b0 con 0x55e43c9aa070 2024-09-21T06:03:23.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff311bfa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff3041af980 con 0x55e43c989390 2024-09-21T06:03:23.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff311bfa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff3041ad7f0 con 0x55e43c9811b0 2024-09-21T06:03:23.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff309c23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd68c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff309c23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd68c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59576/0 (socket says 172.21.15.7:59576) 2024-09-21T06:03:23.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff309c23640 1 -- 172.21.15.7:0/1826916601 learned_addr learned my addr 172.21.15.7:0/1826916601 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:23.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff308c21640 1 --2- 172.21.15.7:0/1826916601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c989390 0x55e43cd52a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff309422640 1 --2- 172.21.15.7:0/1826916601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c9811b0 0x55e43cd5e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff309c23640 1 -- 172.21.15.7:0/1826916601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c9811b0 msgr2=0x55e43cd5e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:23.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff309c23640 1 --2- 172.21.15.7:0/1826916601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c9811b0 0x55e43cd5e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff309c23640 1 -- 172.21.15.7:0/1826916601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c989390 msgr2=0x55e43cd52a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:23.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff309c23640 1 --2- 172.21.15.7:0/1826916601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c989390 0x55e43cd52a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.424+0000 7ff309c23640 1 -- 172.21.15.7:0/1826916601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e43cd4a5d0 con 0x55e43c9aa070 2024-09-21T06:03:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.425+0000 7ff309c23640 1 --2- 172.21.15.7:0/1826916601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd68c90 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0041e0 tx=0x7ff2fc004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a634dddd1b4217 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.425+0000 7ff2eeffd640 1 -- 172.21.15.7:0/1826916601 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc010e90 con 0x55e43c9aa070 2024-09-21T06:03:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.425+0000 7ff2eeffd640 1 -- 172.21.15.7:0/1826916601 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2fc015040 con 0x55e43c9aa070 2024-09-21T06:03:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.425+0000 7ff2eeffd640 1 -- 172.21.15.7:0/1826916601 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc011c30 con 0x55e43c9aa070 2024-09-21T06:03:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.426+0000 7ff311bfa740 1 -- 172.21.15.7:0/1826916601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 msgr2=0x55e43cd68c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.426+0000 7ff311bfa740 1 --2- 172.21.15.7:0/1826916601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd68c90 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0041e0 tx=0x7ff2fc004490 comp rx=0 tx=0).stop 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.426+0000 7ff311bfa740 1 -- 172.21.15.7:0/1826916601 shutdown_connections 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.426+0000 7ff311bfa740 1 --2- 172.21.15.7:0/1826916601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd68c90 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.426+0000 7ff311bfa740 1 --2- 172.21.15.7:0/1826916601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c989390 0x55e43cd52a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.426+0000 7ff311bfa740 1 --2- 172.21.15.7:0/1826916601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c9811b0 0x55e43cd5e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.426+0000 7ff311bfa740 1 -- 172.21.15.7:0/1826916601 >> 172.21.15.7:0/1826916601 conn(0x55e43c99e460 msgr2=0x55e43cd522f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.426+0000 7ff311bfa740 1 -- 172.21.15.7:0/1826916601 shutdown_connections 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.426+0000 7ff311bfa740 1 -- 172.21.15.7:0/1826916601 wait complete. 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.426+0000 7ff311bfa740 1 -- start start 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.426+0000 7ff311bfa740 1 Processor -- start 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff311bfa740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd65640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff311bfa740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 0x55e43cd62b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff311bfa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd63200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff311bfa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff3041ade40 con 0x55e43c9aa070 2024-09-21T06:03:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff311bfa740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff3041af2b0 con 0x55e43c9811b0 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff311bfa740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff3041ae510 con 0x55e43c989390 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff311bfa740 10 client.0 _ll_register_callbacks cb 0x7ff2f40ea520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff309c23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd63200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff309c23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd63200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59592/0 (socket says 172.21.15.7:59592) 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff309c23640 1 -- 172.21.15.7:0/1262677714 learned_addr learned my addr 172.21.15.7:0/1262677714 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff309422640 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd65640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff308c21640 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 0x55e43cd62b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff309c23640 1 -- 172.21.15.7:0/1262677714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 msgr2=0x55e43cd62b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff309c23640 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 0x55e43cd62b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff309c23640 1 -- 172.21.15.7:0/1262677714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 msgr2=0x55e43cd65640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff309c23640 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd65640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff309c23640 1 -- 172.21.15.7:0/1262677714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e43cd63990 con 0x55e43c9aa070 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff308c21640 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 0x55e43cd62b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff309c23640 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd63200 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc004cc0 tx=0x7ff2fc00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dae6568324ede57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.427+0000 7ff2ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff2ecff9640 1 -- 172.21.15.7:0/1262677714 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc04c060 con 0x55e43c9aa070 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff2ecff9640 1 -- 172.21.15.7:0/1262677714 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7ff2fc043070 con 0x55e43c9aa070 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff311bfa740 1 -- 172.21.15.7:0/1262677714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2fc015040 con 0x55e43c9aa070 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff2ecff9640 1 -- 172.21.15.7:0/1262677714 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff2fc010e90 con 0x55e43c9aa070 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff311bfa740 10 client.18285 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff311bfa740 1 -- 172.21.15.7:0/1262677714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e43cdd9470 con 0x55e43c9aa070 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff2ecff9640 1 -- 172.21.15.7:0/1262677714 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2fc015040 con 0x55e43c9aa070 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff2ecff9640 1 -- 172.21.15.7:0/1262677714 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff2fc004eb0 con 0x55e43c9aa070 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff311bfa740 10 client.18285 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff311bfa740 10 client.18285 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff311bfa740 20 client.18285 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff311bfa740 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e43c93dda0 0x55e43cddbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff311bfa740 4 client.18285 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:03:23.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.428+0000 7ff311bfa740 1 -- 172.21.15.7:0/1262677714 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e43ccc58a0 con 0x55e43c93dda0 2024-09-21T06:03:23.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.429+0000 7ff309422640 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e43c93dda0 0x55e43cddbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.429+0000 7ff309422640 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e43c93dda0 0x55e43cddbaf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e136abc993b97de5 server_cookie=9989982fcaa8f6e9 in_seq=0 out_seq=0 2024-09-21T06:03:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.429+0000 7ff2ecff9640 10 client.18285 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:03:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff2ecff9640 1 -- 172.21.15.7:0/1262677714 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e43ccc58a0 con 0x55e43c93dda0 2024-09-21T06:03:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff2ecff9640 10 client.18285 handle_command_reply: tid=0 2024-09-21T06:03:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff311bfa740 1 client.18285 shutdown 2024-09-21T06:03:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff311bfa740 1 -- 172.21.15.7:0/1262677714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 msgr2=0x55e43cd63200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff311bfa740 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd63200 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc004cc0 tx=0x7ff2fc00b600 comp rx=0 tx=0).stop 2024-09-21T06:03:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff311bfa740 1 -- 172.21.15.7:0/1262677714 shutdown_connections 2024-09-21T06:03:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff311bfa740 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x55e43c93dda0 0x55e43cddbaf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff311bfa740 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e43c9aa070 0x55e43cd63200 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff311bfa740 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55e43c989390 0x55e43cd62b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff311bfa740 1 --2- 172.21.15.7:0/1262677714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55e43c9811b0 0x55e43cd65640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff311bfa740 1 -- 172.21.15.7:0/1262677714 >> 172.21.15.7:0/1262677714 conn(0x55e43c99e460 msgr2=0x55e43cd5e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff2ecff9640 0 client.18285 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:03:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff311bfa740 1 -- 172.21.15.7:0/1262677714 shutdown_connections 2024-09-21T06:03:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff311bfa740 1 -- 172.21.15.7:0/1262677714 wait complete. 2024-09-21T06:03:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.430+0000 7ff311bfa740 20 client.18285 trim_cache size 0 max 16384 2024-09-21T06:03:23.436 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:03:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.431+0000 7ff30b686640 1 -- 172.21.15.7:0/80552176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff2f00b6680 msgr2=0x7ff2f00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.431+0000 7ff30b686640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff2f00b6680 0x7ff2f00b8b90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc01a000 tx=0x7ff2fc010810 comp rx=0 tx=0).stop 2024-09-21T06:03:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.431+0000 7ff30b686640 1 -- 172.21.15.7:0/80552176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff304105270 msgr2=0x7ff30419ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.431+0000 7ff30b686640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff304105270 0x7ff30419ab80 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4006fd0 tx=0x7ff2f400b8e0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.431+0000 7ff30b686640 1 -- 172.21.15.7:0/80552176 shutdown_connections 2024-09-21T06:03:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.431+0000 7ff30b686640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff2f00b6680 0x7ff2f00b8b90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.431+0000 7ff30b686640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff304105270 0x7ff30419ab80 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.431+0000 7ff30b686640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30410ddf0 0x7ff30419fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.431+0000 7ff30b686640 1 --2- 172.21.15.7:0/80552176 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff304104840 0x7ff30419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.431+0000 7ff30b686640 1 -- 172.21.15.7:0/80552176 >> 172.21.15.7:0/80552176 conn(0x7ff304079730 msgr2=0x7ff3041068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.431+0000 7ff30b686640 1 -- 172.21.15.7:0/80552176 shutdown_connections 2024-09-21T06:03:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:23.431+0000 7ff30b686640 1 -- 172.21.15.7:0/80552176 wait complete. 2024-09-21T06:03:24.161 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:03:24.424 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:24.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:24 smithi027 ceph-mon[34364]: pgmap v611: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:03:24.545 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:24 smithi007 ceph-mon[30983]: pgmap v611: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:03:24.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:24 smithi119 ceph-mon[34833]: pgmap v611: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:03:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.883+0000 7f95ca271640 1 -- 172.21.15.7:0/1950026184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c41094c0 msgr2=0x7f95c41098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.883+0000 7f95ca271640 1 --2- 172.21.15.7:0/1950026184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c41094c0 0x7f95c41098d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009900 tx=0x7f95b802a410 comp rx=0 tx=0).stop 2024-09-21T06:03:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.883+0000 7f95ca271640 1 -- 172.21.15.7:0/1950026184 shutdown_connections 2024-09-21T06:03:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.883+0000 7f95ca271640 1 --2- 172.21.15.7:0/1950026184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c41094c0 0x7f95c41098d0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.883+0000 7f95ca271640 1 --2- 172.21.15.7:0/1950026184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c4109e10 0x7f95c4110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.883+0000 7f95ca271640 1 --2- 172.21.15.7:0/1950026184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c4103b80 0x7f95c4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.883+0000 7f95ca271640 1 -- 172.21.15.7:0/1950026184 >> 172.21.15.7:0/1950026184 conn(0x7f95c40ff610 msgr2=0x7f95c4101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.883+0000 7f95ca271640 1 -- 172.21.15.7:0/1950026184 shutdown_connections 2024-09-21T06:03:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.883+0000 7f95ca271640 1 -- 172.21.15.7:0/1950026184 wait complete. 2024-09-21T06:03:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.884+0000 7f95ca271640 1 Processor -- start 2024-09-21T06:03:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.884+0000 7f95ca271640 1 -- start start 2024-09-21T06:03:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95ca271640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c4103b80 0x7f95c419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95ca271640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c41094c0 0x7f95c419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95ca271640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c4109e10 0x7f95c419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95ca271640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f95c4113ad0 con 0x7f95c41094c0 2024-09-21T06:03:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95ca271640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f95c4113950 con 0x7f95c4109e10 2024-09-21T06:03:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95ca271640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f95c4113c50 con 0x7f95c4103b80 2024-09-21T06:03:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95c37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c41094c0 0x7f95c419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95c37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c41094c0 0x7f95c419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59610/0 (socket says 172.21.15.7:59610) 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95c37fe640 1 -- 172.21.15.7:0/3443279596 learned_addr learned my addr 172.21.15.7:0/3443279596 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95c3fff640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c4103b80 0x7f95c419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95c880e640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c4109e10 0x7f95c419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95c37fe640 1 -- 172.21.15.7:0/3443279596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c4103b80 msgr2=0x7f95c419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95c37fe640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c4103b80 0x7f95c419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95c37fe640 1 -- 172.21.15.7:0/3443279596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c4109e10 msgr2=0x7f95c419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95c37fe640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c4109e10 0x7f95c419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95c37fe640 1 -- 172.21.15.7:0/3443279596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c41a0410 con 0x7f95c41094c0 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95c880e640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c4109e10 0x7f95c419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.885+0000 7f95c37fe640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c41094c0 0x7f95c419aa40 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f95b802a930 tx=0x7f95b8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.886+0000 7f95c17fa640 1 -- 172.21.15.7:0/3443279596 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b803f030 con 0x7f95c41094c0 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.886+0000 7f95ca271640 1 -- 172.21.15.7:0/3443279596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c41a06a0 con 0x7f95c41094c0 2024-09-21T06:03:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.886+0000 7f95c17fa640 1 -- 172.21.15.7:0/3443279596 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95b8003aa0 con 0x7f95c41094c0 2024-09-21T06:03:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.886+0000 7f95c17fa640 1 -- 172.21.15.7:0/3443279596 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b8035070 con 0x7f95c41094c0 2024-09-21T06:03:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.886+0000 7f95ca271640 1 -- 172.21.15.7:0/3443279596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c41a6e60 con 0x7f95c41094c0 2024-09-21T06:03:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.889+0000 7f95d07e5740 1 Processor -- start 2024-09-21T06:03:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.889+0000 7f95d07e5740 1 -- start start 2024-09-21T06:03:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.889+0000 7f95d07e5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da62d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.889+0000 7f95d07e5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6951b0 0x55745da632a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.889+0000 7f95d07e5740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d69d390 0x55745da75670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.889+0000 7f95d07e5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55745d9dbea0 con 0x55745d6be070 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.889+0000 7f95d07e5740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55745d9cb2d0 con 0x55745d69d390 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.889+0000 7f95d07e5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55745d9cf0e0 con 0x55745d6951b0 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.889+0000 7f95c880e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da62d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.890+0000 7f95c880e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da62d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59624/0 (socket says 172.21.15.7:59624) 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.890+0000 7f95c880e640 1 -- 172.21.15.7:0/3996946289 learned_addr learned my addr 172.21.15.7:0/3996946289 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.890+0000 7f95c3fff640 1 --2- 172.21.15.7:0/3996946289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6951b0 0x55745da632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.890+0000 7f95c880e640 1 -- 172.21.15.7:0/3996946289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6951b0 msgr2=0x55745da632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.890+0000 7f95c880e640 1 --2- 172.21.15.7:0/3996946289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6951b0 0x55745da632a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.890+0000 7f95c880e640 1 -- 172.21.15.7:0/3996946289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d69d390 msgr2=0x55745da75670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.890+0000 7f95c880e640 1 --2- 172.21.15.7:0/3996946289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d69d390 0x55745da75670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.890+0000 7f95c880e640 1 -- 172.21.15.7:0/3996946289 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55745d729650 con 0x55745d6be070 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.890+0000 7f95c17fa640 1 -- 172.21.15.7:0/3443279596 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f95b8042030 con 0x7f95c41094c0 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.890+0000 7f95c880e640 1 --2- 172.21.15.7:0/3996946289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da62d20 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009ea0 tx=0x7f95bc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c7e22848838a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.890+0000 7f95aa7fc640 1 -- 172.21.15.7:0/3996946289 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc004d20 con 0x55745d6be070 2024-09-21T06:03:24.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.890+0000 7f95aa7fc640 1 -- 172.21.15.7:0/3996946289 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95bc0054d0 con 0x55745d6be070 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.890+0000 7f95aa7fc640 1 -- 172.21.15.7:0/3996946289 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0117a0 con 0x55745d6be070 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.891+0000 7f95c17fa640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f95ac0b6680 0x7f95ac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.891+0000 7f95c3fff640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f95ac0b6680 0x7f95ac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.891+0000 7f95c17fa640 1 -- 172.21.15.7:0/3443279596 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f95b8107df0 con 0x7f95c41094c0 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.891+0000 7f95d07e5740 1 -- 172.21.15.7:0/3996946289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 msgr2=0x55745da62d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.891+0000 7f95d07e5740 1 --2- 172.21.15.7:0/3996946289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da62d20 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009ea0 tx=0x7f95bc009f90 comp rx=0 tx=0).stop 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.891+0000 7f95d07e5740 1 -- 172.21.15.7:0/3996946289 shutdown_connections 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.891+0000 7f95d07e5740 1 --2- 172.21.15.7:0/3996946289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d69d390 0x55745da75670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.891+0000 7f95d07e5740 1 --2- 172.21.15.7:0/3996946289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6951b0 0x55745da632a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.891+0000 7f95d07e5740 1 --2- 172.21.15.7:0/3996946289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da62d20 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.891+0000 7f95d07e5740 1 -- 172.21.15.7:0/3996946289 >> 172.21.15.7:0/3996946289 conn(0x55745d6b2460 msgr2=0x55745da65240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.891+0000 7f95c3fff640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f95ac0b6680 0x7f95ac0b8b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x55745da63ec0 tx=0x7f95b400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.892+0000 7f95d07e5740 1 -- 172.21.15.7:0/3996946289 shutdown_connections 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.892+0000 7f95d07e5740 1 -- 172.21.15.7:0/3996946289 wait complete. 2024-09-21T06:03:24.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.892+0000 7f95d07e5740 1 -- start start 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.892+0000 7f95d07e5740 1 Processor -- start 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.892+0000 7f95d07e5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6951b0 0x55745da79a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95d07e5740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d69d390 0x55745da7a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95d07e5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da7f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95d07e5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55745d82c700 con 0x55745d6be070 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95d07e5740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55745d966160 con 0x55745d69d390 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95d07e5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55745da76170 con 0x55745d6951b0 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95d07e5740 10 client.0 _ll_register_callbacks cb 0x55745d97f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95c880e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da7f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95c880e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da7f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59626/0 (socket says 172.21.15.7:59626) 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95c880e640 1 -- 172.21.15.7:0/4008508529 learned_addr learned my addr 172.21.15.7:0/4008508529 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95c3fff640 1 --2- 172.21.15.7:0/4008508529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6951b0 0x55745da79a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95c37fe640 1 --2- 172.21.15.7:0/4008508529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d69d390 0x55745da7a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95c880e640 1 -- 172.21.15.7:0/4008508529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6951b0 msgr2=0x55745da79a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95c880e640 1 --2- 172.21.15.7:0/4008508529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6951b0 0x55745da79a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95c880e640 1 -- 172.21.15.7:0/4008508529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d69d390 msgr2=0x55745da7a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95c880e640 1 --2- 172.21.15.7:0/4008508529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d69d390 0x55745da7a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95c880e640 1 -- 172.21.15.7:0/4008508529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55745d993c90 con 0x55745d6be070 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95c880e640 1 --2- 172.21.15.7:0/4008508529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da7f080 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0099f0 tx=0x7f95bc005370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94792a69ebbce47b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.893+0000 7f95a37fe640 1 -- 172.21.15.7:0/4008508529 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc029060 con 0x55745d6be070 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.894+0000 7f95a37fe640 1 -- 172.21.15.7:0/4008508529 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f95bc004a40 con 0x55745d6be070 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.894+0000 7f95d07e5740 1 -- 172.21.15.7:0/4008508529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95bc0054d0 con 0x55745d6be070 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.894+0000 7f95a37fe640 1 -- 172.21.15.7:0/4008508529 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95bc0059d0 con 0x55745d6be070 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.894+0000 7f95d07e5740 10 client.18297 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.894+0000 7f95d07e5740 1 -- 172.21.15.7:0/4008508529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55745da87fd0 con 0x55745d6be070 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.894+0000 7f95a37fe640 1 -- 172.21.15.7:0/4008508529 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95bc0054d0 con 0x55745d6be070 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.894+0000 7f95a37fe640 1 -- 172.21.15.7:0/4008508529 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95bc019430 con 0x55745d6be070 2024-09-21T06:03:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.894+0000 7f95d07e5740 10 client.18297 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.894+0000 7f95d07e5740 10 client.18297 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.894+0000 7f95d07e5740 20 client.18297 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.894+0000 7f95d07e5740 1 --2- 172.21.15.7:0/4008508529 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55745d67c9f0 0x55745da8b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.894+0000 7f95d07e5740 4 client.18297 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.894+0000 7f95d07e5740 1 -- 172.21.15.7:0/4008508529 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55745d9dddf0 con 0x55745d67c9f0 2024-09-21T06:03:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.895+0000 7f95c3fff640 1 --2- 172.21.15.7:0/4008508529 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55745d67c9f0 0x55745da8b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.895+0000 7f95a37fe640 10 client.18297 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:24.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.895+0000 7f95c3fff640 1 --2- 172.21.15.7:0/4008508529 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55745d67c9f0 0x55745da8b440 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de022e33ca496b3f server_cookie=ff1b6129c0a66bf4 in_seq=0 out_seq=0 2024-09-21T06:03:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95a37fe640 1 -- 172.21.15.7:0/4008508529 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55745d9dddf0 con 0x55745d67c9f0 2024-09-21T06:03:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95a37fe640 10 client.18297 handle_command_reply: tid=0 2024-09-21T06:03:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95d07e5740 1 client.18297 shutdown 2024-09-21T06:03:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95d07e5740 1 -- 172.21.15.7:0/4008508529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 msgr2=0x55745da7f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95d07e5740 1 --2- 172.21.15.7:0/4008508529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da7f080 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0099f0 tx=0x7f95bc005370 comp rx=0 tx=0).stop 2024-09-21T06:03:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95d07e5740 1 -- 172.21.15.7:0/4008508529 shutdown_connections 2024-09-21T06:03:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95d07e5740 1 --2- 172.21.15.7:0/4008508529 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55745d67c9f0 0x55745da8b440 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95d07e5740 1 --2- 172.21.15.7:0/4008508529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da7f080 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95d07e5740 1 --2- 172.21.15.7:0/4008508529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d69d390 0x55745da7a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95a37fe640 0 client.18297 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95d07e5740 1 --2- 172.21.15.7:0/4008508529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6951b0 0x55745da79a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95d07e5740 1 -- 172.21.15.7:0/4008508529 >> 172.21.15.7:0/4008508529 conn(0x55745d6b2460 msgr2=0x55745da641f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95d07e5740 1 -- 172.21.15.7:0/4008508529 shutdown_connections 2024-09-21T06:03:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95d07e5740 1 -- 172.21.15.7:0/4008508529 wait complete. 2024-09-21T06:03:24.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.896+0000 7f95d07e5740 20 client.18297 trim_cache size 0 max 16384 2024-09-21T06:03:24.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.909+0000 7f95d07e5740 1 Processor -- start 2024-09-21T06:03:24.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.909+0000 7f95d07e5740 1 -- start start 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95d07e5740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d6951b0 0x55745da773c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95d07e5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d69d390 0x55745da65120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95d07e5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da74210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95d07e5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41afc60 con 0x55745d6be070 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95d07e5740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41ad530 con 0x55745d6951b0 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95d07e5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41ab3a0 con 0x55745d69d390 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95c880e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da74210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95c880e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da74210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59636/0 (socket says 172.21.15.7:59636) 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95c880e640 1 -- 172.21.15.7:0/315550496 learned_addr learned my addr 172.21.15.7:0/315550496 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95c3fff640 1 --2- 172.21.15.7:0/315550496 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d6951b0 0x55745da773c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95c37fe640 1 --2- 172.21.15.7:0/315550496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d69d390 0x55745da65120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95c880e640 1 -- 172.21.15.7:0/315550496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d69d390 msgr2=0x55745da65120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95c880e640 1 --2- 172.21.15.7:0/315550496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d69d390 0x55745da65120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95c880e640 1 -- 172.21.15.7:0/315550496 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d6951b0 msgr2=0x55745da773c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95c880e640 1 --2- 172.21.15.7:0/315550496 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d6951b0 0x55745da773c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95c880e640 1 -- 172.21.15.7:0/315550496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55745da77d80 con 0x55745d6be070 2024-09-21T06:03:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95c37fe640 1 --2- 172.21.15.7:0/315550496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d69d390 0x55745da65120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95c3fff640 1 --2- 172.21.15.7:0/315550496 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d6951b0 0x55745da773c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.910+0000 7f95c880e640 1 --2- 172.21.15.7:0/315550496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da74210 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0093e0 tx=0x7f95bc00fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddd9483850ee7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.911+0000 7f95a9ffb640 1 -- 172.21.15.7:0/315550496 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc01d070 con 0x55745d6be070 2024-09-21T06:03:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.911+0000 7f95a9ffb640 1 -- 172.21.15.7:0/315550496 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95bc005540 con 0x55745d6be070 2024-09-21T06:03:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.911+0000 7f95a9ffb640 1 -- 172.21.15.7:0/315550496 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc029070 con 0x55745d6be070 2024-09-21T06:03:24.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.911+0000 7f95d07e5740 1 -- 172.21.15.7:0/315550496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 msgr2=0x55745da74210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.911+0000 7f95d07e5740 1 --2- 172.21.15.7:0/315550496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da74210 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0093e0 tx=0x7f95bc00fcf0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.911+0000 7f95d07e5740 1 -- 172.21.15.7:0/315550496 shutdown_connections 2024-09-21T06:03:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.911+0000 7f95d07e5740 1 --2- 172.21.15.7:0/315550496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d6be070 0x55745da74210 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.911+0000 7f95d07e5740 1 --2- 172.21.15.7:0/315550496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d69d390 0x55745da65120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.911+0000 7f95d07e5740 1 --2- 172.21.15.7:0/315550496 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d6951b0 0x55745da773c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.911+0000 7f95d07e5740 1 -- 172.21.15.7:0/315550496 >> 172.21.15.7:0/315550496 conn(0x55745d6b2460 msgr2=0x55745da62cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.912+0000 7f95d07e5740 1 -- 172.21.15.7:0/315550496 shutdown_connections 2024-09-21T06:03:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.912+0000 7f95d07e5740 1 -- 172.21.15.7:0/315550496 wait complete. 2024-09-21T06:03:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.912+0000 7f95d07e5740 1 -- start start 2024-09-21T06:03:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.912+0000 7f95d07e5740 1 Processor -- start 2024-09-21T06:03:24.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.912+0000 7f95d07e5740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d6951b0 0x55745da85dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.912+0000 7f95d07e5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d69d390 0x55745da81270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.912+0000 7f95d07e5740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6be070 0x55745da81810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.912+0000 7f95d07e5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41ab9f0 con 0x55745d69d390 2024-09-21T06:03:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.912+0000 7f95d07e5740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41ace60 con 0x55745d6951b0 2024-09-21T06:03:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.912+0000 7f95d07e5740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41ac0c0 con 0x55745d6be070 2024-09-21T06:03:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95d07e5740 10 client.0 _ll_register_callbacks cb 0x7f95b400b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95c37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d69d390 0x55745da81270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95c37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d69d390 0x55745da81270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59650/0 (socket says 172.21.15.7:59650) 2024-09-21T06:03:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95c37fe640 1 -- 172.21.15.7:0/760474578 learned_addr learned my addr 172.21.15.7:0/760474578 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95c3fff640 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d6951b0 0x55745da85dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95c880e640 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6be070 0x55745da81810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95c37fe640 1 -- 172.21.15.7:0/760474578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6be070 msgr2=0x55745da81810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95c37fe640 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6be070 0x55745da81810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95c37fe640 1 -- 172.21.15.7:0/760474578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d6951b0 msgr2=0x55745da85dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95c37fe640 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d6951b0 0x55745da85dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95c37fe640 1 -- 172.21.15.7:0/760474578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55745da81fa0 con 0x55745d69d390 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95c3fff640 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d6951b0 0x55745da85dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95c37fe640 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d69d390 0x55745da81270 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f95b81055f0 tx=0x7f95b8031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d493987efa7233 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95a37fe640 1 -- 172.21.15.7:0/760474578 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b80d2070 con 0x55745d69d390 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95a37fe640 1 -- 172.21.15.7:0/760474578 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f95b8105810 con 0x55745d69d390 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.913+0000 7f95d07e5740 1 -- 172.21.15.7:0/760474578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55745d9d98a0 con 0x55745d69d390 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.914+0000 7f95a37fe640 1 -- 172.21.15.7:0/760474578 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95b8049050 con 0x55745d69d390 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.914+0000 7f95d07e5740 10 client.18303 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.914+0000 7f95d07e5740 1 -- 172.21.15.7:0/760474578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55745daf5aa0 con 0x55745d69d390 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.914+0000 7f95a37fe640 1 -- 172.21.15.7:0/760474578 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55745d9d98a0 con 0x55745d69d390 2024-09-21T06:03:24.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.914+0000 7f95a37fe640 1 -- 172.21.15.7:0/760474578 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95b8105ce0 con 0x55745d69d390 2024-09-21T06:03:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.914+0000 7f95d07e5740 10 client.18303 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.914+0000 7f95d07e5740 10 client.18303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.914+0000 7f95d07e5740 20 client.18303 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.914+0000 7f95d07e5740 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55745d651da0 0x55745daf8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.914+0000 7f95d07e5740 4 client.18303 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:03:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.914+0000 7f95d07e5740 1 -- 172.21.15.7:0/760474578 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55745d9d6cd0 con 0x55745d651da0 2024-09-21T06:03:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.914+0000 7f95c3fff640 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55745d651da0 0x55745daf8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95c3fff640 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55745d651da0 0x55745daf8280 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f7d95d57dfb4ad2 server_cookie=5e617075a4b84b85 in_seq=0 out_seq=0 2024-09-21T06:03:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95a37fe640 10 client.18303 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95a37fe640 1 -- 172.21.15.7:0/760474578 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55745d9d6cd0 con 0x55745d651da0 2024-09-21T06:03:24.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95a37fe640 10 client.18303 handle_command_reply: tid=0 2024-09-21T06:03:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95d07e5740 1 client.18303 shutdown 2024-09-21T06:03:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95d07e5740 1 -- 172.21.15.7:0/760474578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d69d390 msgr2=0x55745da81270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95d07e5740 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d69d390 0x55745da81270 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f95b81055f0 tx=0x7f95b8031a10 comp rx=0 tx=0).stop 2024-09-21T06:03:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95d07e5740 1 -- 172.21.15.7:0/760474578 shutdown_connections 2024-09-21T06:03:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95d07e5740 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55745d651da0 0x55745daf8280 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95d07e5740 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55745d69d390 0x55745da81270 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95d07e5740 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55745d6be070 0x55745da81810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95d07e5740 1 --2- 172.21.15.7:0/760474578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55745d6951b0 0x55745da85dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95a37fe640 0 client.18303 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95d07e5740 1 -- 172.21.15.7:0/760474578 >> 172.21.15.7:0/760474578 conn(0x55745d6b2460 msgr2=0x55745da74210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95d07e5740 1 -- 172.21.15.7:0/760474578 shutdown_connections 2024-09-21T06:03:24.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.915+0000 7f95d07e5740 1 -- 172.21.15.7:0/760474578 wait complete. 2024-09-21T06:03:24.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.916+0000 7f95d07e5740 20 client.18303 trim_cache size 0 max 16384 2024-09-21T06:03:24.923 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:03:24.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.916+0000 7f95ca271640 1 -- 172.21.15.7:0/3443279596 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f95ac0b6680 msgr2=0x7f95ac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.916+0000 7f95ca271640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f95ac0b6680 0x7f95ac0b8b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x55745da63ec0 tx=0x7f95b400b390 comp rx=0 tx=0).stop 2024-09-21T06:03:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.916+0000 7f95ca271640 1 -- 172.21.15.7:0/3443279596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c41094c0 msgr2=0x7f95c419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.916+0000 7f95ca271640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c41094c0 0x7f95c419aa40 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f95b802a930 tx=0x7f95b8004270 comp rx=0 tx=0).stop 2024-09-21T06:03:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.916+0000 7f95ca271640 1 -- 172.21.15.7:0/3443279596 shutdown_connections 2024-09-21T06:03:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.916+0000 7f95ca271640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f95ac0b6680 0x7f95ac0b8b90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.916+0000 7f95ca271640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c41094c0 0x7f95c419aa40 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.916+0000 7f95ca271640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95c4109e10 0x7f95c419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.916+0000 7f95ca271640 1 --2- 172.21.15.7:0/3443279596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c4103b80 0x7f95c419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.916+0000 7f95ca271640 1 -- 172.21.15.7:0/3443279596 >> 172.21.15.7:0/3443279596 conn(0x7f95c40ff610 msgr2=0x7f95c4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.916+0000 7f95ca271640 1 -- 172.21.15.7:0/3443279596 shutdown_connections 2024-09-21T06:03:24.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:24.916+0000 7f95ca271640 1 -- 172.21.15.7:0/3443279596 wait complete. 2024-09-21T06:03:26.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:26 smithi027 ceph-mon[34364]: pgmap v612: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:03:26.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:26 smithi007 ceph-mon[30983]: pgmap v612: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:03:26.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:26 smithi119 ceph-mon[34833]: pgmap v612: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:03:26.620 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:03:26.620 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:03:26.891 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.335+0000 7ff51ab67640 1 -- 172.21.15.7:0/964943667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff514102a80 msgr2=0x7ff514102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.335+0000 7ff51ab67640 1 --2- 172.21.15.7:0/964943667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff514102a80 0x7ff514102e90 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7ff508009900 tx=0x7ff50802a410 comp rx=0 tx=0).stop 2024-09-21T06:03:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.335+0000 7ff51ab67640 1 -- 172.21.15.7:0/964943667 shutdown_connections 2024-09-21T06:03:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.335+0000 7ff51ab67640 1 --2- 172.21.15.7:0/964943667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff514108d10 0x7ff51410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.335+0000 7ff51ab67640 1 --2- 172.21.15.7:0/964943667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5141083c0 0x7ff5141087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.335+0000 7ff51ab67640 1 --2- 172.21.15.7:0/964943667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff514102a80 0x7ff514102e90 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.335+0000 7ff51ab67640 1 -- 172.21.15.7:0/964943667 >> 172.21.15.7:0/964943667 conn(0x7ff514079740 msgr2=0x7ff514079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.335+0000 7ff51ab67640 1 -- 172.21.15.7:0/964943667 shutdown_connections 2024-09-21T06:03:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.335+0000 7ff51ab67640 1 -- 172.21.15.7:0/964943667 wait complete. 2024-09-21T06:03:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff51ab67640 1 Processor -- start 2024-09-21T06:03:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff51ab67640 1 -- start start 2024-09-21T06:03:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff51ab67640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff514102a80 0x7ff51419b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff51ab67640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5141083c0 0x7ff51419b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff51ab67640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff514108d10 0x7ff51419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff51ab67640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5141129e0 con 0x7ff514108d10 2024-09-21T06:03:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff51ab67640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff514112860 con 0x7ff514102a80 2024-09-21T06:03:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff51ab67640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff514112b60 con 0x7ff5141083c0 2024-09-21T06:03:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff519104640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff514108d10 0x7ff51419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff519104640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff514108d10 0x7ff51419bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59668/0 (socket says 172.21.15.7:59668) 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff519104640 1 -- 172.21.15.7:0/4146904797 learned_addr learned my addr 172.21.15.7:0/4146904797 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff518903640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff514102a80 0x7ff51419b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff513fff640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5141083c0 0x7ff51419b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff519104640 1 -- 172.21.15.7:0/4146904797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5141083c0 msgr2=0x7ff51419b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.336+0000 7ff519104640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5141083c0 0x7ff51419b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.337+0000 7ff519104640 1 -- 172.21.15.7:0/4146904797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff514102a80 msgr2=0x7ff51419b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.337+0000 7ff519104640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff514102a80 0x7ff51419b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.337+0000 7ff519104640 1 -- 172.21.15.7:0/4146904797 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5141a65a0 con 0x7ff514108d10 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.337+0000 7ff513fff640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5141083c0 0x7ff51419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.337+0000 7ff519104640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff514108d10 0x7ff51419bd90 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00b970 tx=0x7ff50c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.337+0000 7ff511ffb640 1 -- 172.21.15.7:0/4146904797 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c019070 con 0x7ff514108d10 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.337+0000 7ff511ffb640 1 -- 172.21.15.7:0/4146904797 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff50c014440 con 0x7ff514108d10 2024-09-21T06:03:27.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.337+0000 7ff51ab67640 1 -- 172.21.15.7:0/4146904797 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5141a6890 con 0x7ff514108d10 2024-09-21T06:03:27.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.337+0000 7ff511ffb640 1 -- 172.21.15.7:0/4146904797 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c0075d0 con 0x7ff514108d10 2024-09-21T06:03:27.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.337+0000 7ff51ab67640 1 -- 172.21.15.7:0/4146904797 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5141a6e00 con 0x7ff514108d10 2024-09-21T06:03:27.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.340+0000 7ff511ffb640 1 -- 172.21.15.7:0/4146904797 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ff50c01c070 con 0x7ff514108d10 2024-09-21T06:03:27.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.340+0000 7ff5210db740 1 Processor -- start 2024-09-21T06:03:27.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.340+0000 7ff5210db740 1 -- start start 2024-09-21T06:03:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.340+0000 7ff5210db740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1d5350 0x55f58a57c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.340+0000 7ff5210db740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1ac490 0x55f58a57c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.340+0000 7ff5210db740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a1b4670 0x55f58a57ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.340+0000 7ff5210db740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f58a4f2e60 con 0x55f58a1ac490 2024-09-21T06:03:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.340+0000 7ff5210db740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f58a4e2290 con 0x55f58a1b4670 2024-09-21T06:03:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.340+0000 7ff5210db740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f58a4e60a0 con 0x55f58a1d5350 2024-09-21T06:03:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.340+0000 7ff518903640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1ac490 0x55f58a57c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.340+0000 7ff518903640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1ac490 0x55f58a57c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59682/0 (socket says 172.21.15.7:59682) 2024-09-21T06:03:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.340+0000 7ff513fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1d5350 0x55f58a57c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.341+0000 7ff518903640 1 -- 172.21.15.7:0/4281741104 learned_addr learned my addr 172.21.15.7:0/4281741104 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.341+0000 7ff511ffb640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5040b66b0 0x7ff5040b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.341+0000 7ff513fff640 1 --2- 172.21.15.7:0/4281741104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a1b4670 0x55f58a57ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.341+0000 7ff519104640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5040b66b0 0x7ff5040b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.341+0000 7ff518903640 1 -- 172.21.15.7:0/4281741104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1d5350 msgr2=0x55f58a57c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:27.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.341+0000 7ff518903640 1 --2- 172.21.15.7:0/4281741104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1d5350 0x55f58a57c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.341+0000 7ff518903640 1 -- 172.21.15.7:0/4281741104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a1b4670 msgr2=0x55f58a57ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:27.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.341+0000 7ff518903640 1 --2- 172.21.15.7:0/4281741104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a1b4670 0x55f58a57ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.341+0000 7ff518903640 1 -- 172.21.15.7:0/4281741104 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58a240930 con 0x55f58a1ac490 2024-09-21T06:03:27.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.341+0000 7ff511ffb640 1 -- 172.21.15.7:0/4146904797 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7ff50c0e6b80 con 0x7ff514108d10 2024-09-21T06:03:27.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.341+0000 7ff518903640 1 --2- 172.21.15.7:0/4281741104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1ac490 0x55f58a57c970 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7ff508033000 tx=0x7ff508032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60e149e94a27d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:27.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.341+0000 7ff519104640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5040b66b0 0x7ff5040b8bc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0e43d0 tx=0x7ff50c079db0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:27.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.341+0000 7ff4feffd640 1 -- 172.21.15.7:0/4281741104 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff508035040 con 0x55f58a1ac490 2024-09-21T06:03:27.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.342+0000 7ff4feffd640 1 -- 172.21.15.7:0/4281741104 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff508005db0 con 0x55f58a1ac490 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.342+0000 7ff4feffd640 1 -- 172.21.15.7:0/4281741104 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5080055a0 con 0x55f58a1ac490 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.342+0000 7ff5210db740 1 -- 172.21.15.7:0/4281741104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1ac490 msgr2=0x55f58a57c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.342+0000 7ff5210db740 1 --2- 172.21.15.7:0/4281741104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1ac490 0x55f58a57c970 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7ff508033000 tx=0x7ff508032df0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.342+0000 7ff5210db740 1 -- 172.21.15.7:0/4281741104 shutdown_connections 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.342+0000 7ff5210db740 1 --2- 172.21.15.7:0/4281741104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1ac490 0x55f58a57c970 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.342+0000 7ff5210db740 1 --2- 172.21.15.7:0/4281741104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a1b4670 0x55f58a57ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.342+0000 7ff5210db740 1 --2- 172.21.15.7:0/4281741104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1d5350 0x55f58a57c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.343+0000 7ff5210db740 1 -- 172.21.15.7:0/4281741104 >> 172.21.15.7:0/4281741104 conn(0x55f58a1c9740 msgr2=0x55f58a57a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.343+0000 7ff5210db740 1 -- 172.21.15.7:0/4281741104 shutdown_connections 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.343+0000 7ff5210db740 1 -- 172.21.15.7:0/4281741104 wait complete. 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.343+0000 7ff5210db740 1 -- start start 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.343+0000 7ff5210db740 1 Processor -- start 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff5210db740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 0x55f58a58c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff5210db740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a58c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff5210db740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a1d5350 0x55f58a598270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff5210db740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f58a343890 con 0x55f58a1b4670 2024-09-21T06:03:27.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff5210db740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f58a47cd40 con 0x55f58a1d5350 2024-09-21T06:03:27.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff5210db740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f58a58eee0 con 0x55f58a1ac490 2024-09-21T06:03:27.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff5210db740 10 client.0 _ll_register_callbacks cb 0x55f58a4e0c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:27.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff518903640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a58c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff518903640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a58c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59686/0 (socket says 172.21.15.7:59686) 2024-09-21T06:03:27.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff518903640 1 -- 172.21.15.7:0/235272813 learned_addr learned my addr 172.21.15.7:0/235272813 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:27.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff513fff640 1 --2- 172.21.15.7:0/235272813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 0x55f58a58c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff513fff640 1 --2- 172.21.15.7:0/235272813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a1d5350 0x55f58a598270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff518903640 1 -- 172.21.15.7:0/235272813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 msgr2=0x55f58a58c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:27.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff518903640 1 --2- 172.21.15.7:0/235272813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 0x55f58a58c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff518903640 1 -- 172.21.15.7:0/235272813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a1d5350 msgr2=0x55f58a598270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:27.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff518903640 1 --2- 172.21.15.7:0/235272813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a1d5350 0x55f58a598270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.344+0000 7ff518903640 1 -- 172.21.15.7:0/235272813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58a598830 con 0x55f58a1b4670 2024-09-21T06:03:27.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.345+0000 7ff518903640 1 --2- 172.21.15.7:0/235272813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a58c930 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7ff508005630 tx=0x7ff508032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4546e5c54e13879a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:27.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.345+0000 7ff4f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:27.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.345+0000 7ff4f3fff640 1 -- 172.21.15.7:0/235272813 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50804c030 con 0x55f58a1b4670 2024-09-21T06:03:27.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.345+0000 7ff4f3fff640 1 -- 172.21.15.7:0/235272813 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7ff508031d20 con 0x55f58a1b4670 2024-09-21T06:03:27.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.345+0000 7ff5210db740 1 -- 172.21.15.7:0/235272813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff508005db0 con 0x55f58a1b4670 2024-09-21T06:03:27.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.345+0000 7ff4f3fff640 1 -- 172.21.15.7:0/235272813 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff508056050 con 0x55f58a1b4670 2024-09-21T06:03:27.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.345+0000 7ff5210db740 10 client.18315 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:27.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.345+0000 7ff5210db740 1 -- 172.21.15.7:0/235272813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f58a59b160 con 0x55f58a1b4670 2024-09-21T06:03:27.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.345+0000 7ff4f3fff640 1 -- 172.21.15.7:0/235272813 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff508005db0 con 0x55f58a1b4670 2024-09-21T06:03:27.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.345+0000 7ff4f3fff640 1 -- 172.21.15.7:0/235272813 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff50803c440 con 0x55f58a1b4670 2024-09-21T06:03:27.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.346+0000 7ff5210db740 10 client.18315 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:27.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.346+0000 7ff5210db740 10 client.18315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:27.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.346+0000 7ff5210db740 20 client.18315 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:27.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.346+0000 7ff5210db740 1 --2- 172.21.15.7:0/235272813 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f58a193cd0 0x55f58a59e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.346+0000 7ff5210db740 4 client.18315 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:27.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.346+0000 7ff5210db740 1 -- 172.21.15.7:0/235272813 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f58a4f4db0 con 0x55f58a193cd0 2024-09-21T06:03:27.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.346+0000 7ff513fff640 1 --2- 172.21.15.7:0/235272813 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f58a193cd0 0x55f58a59e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.346+0000 7ff4f3fff640 10 client.18315 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:27.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.346+0000 7ff513fff640 1 --2- 172.21.15.7:0/235272813 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f58a193cd0 0x55f58a59e4c0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d5d90ea9e444b server_cookie=ee215144e23b9358 in_seq=0 out_seq=0 2024-09-21T06:03:27.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.347+0000 7ff4f3fff640 1 -- 172.21.15.7:0/235272813 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f58a4f4db0 con 0x55f58a193cd0 2024-09-21T06:03:27.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.347+0000 7ff4f3fff640 10 client.18315 handle_command_reply: tid=0 2024-09-21T06:03:27.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.347+0000 7ff5210db740 1 client.18315 shutdown 2024-09-21T06:03:27.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.347+0000 7ff5210db740 1 -- 172.21.15.7:0/235272813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 msgr2=0x55f58a58c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:27.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.347+0000 7ff5210db740 1 --2- 172.21.15.7:0/235272813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a58c930 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7ff508005630 tx=0x7ff508032f90 comp rx=0 tx=0).stop 2024-09-21T06:03:27.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.347+0000 7ff5210db740 1 -- 172.21.15.7:0/235272813 shutdown_connections 2024-09-21T06:03:27.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.347+0000 7ff5210db740 1 --2- 172.21.15.7:0/235272813 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f58a193cd0 0x55f58a59e4c0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.347+0000 7ff4f3fff640 0 client.18315 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:27.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.347+0000 7ff5210db740 1 --2- 172.21.15.7:0/235272813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a58c930 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.347+0000 7ff5210db740 1 --2- 172.21.15.7:0/235272813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a1d5350 0x55f58a598270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.347+0000 7ff5210db740 1 --2- 172.21.15.7:0/235272813 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 0x55f58a58c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.347+0000 7ff5210db740 1 -- 172.21.15.7:0/235272813 >> 172.21.15.7:0/235272813 conn(0x55f58a1c9740 msgr2=0x55f58a57f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:27.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.348+0000 7ff5210db740 1 -- 172.21.15.7:0/235272813 shutdown_connections 2024-09-21T06:03:27.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.348+0000 7ff5210db740 1 -- 172.21.15.7:0/235272813 wait complete. 2024-09-21T06:03:27.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.348+0000 7ff5210db740 20 client.18315 trim_cache size 0 max 16384 2024-09-21T06:03:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.365+0000 7ff5210db740 1 Processor -- start 2024-09-21T06:03:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.365+0000 7ff5210db740 1 -- start start 2024-09-21T06:03:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff5210db740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a193cd0 0x55f58a5879a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff5210db740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 0x55f58a58e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff5210db740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a58ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff5210db740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5141afd70 con 0x55f58a1b4670 2024-09-21T06:03:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff5210db740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff5141ad640 con 0x55f58a193cd0 2024-09-21T06:03:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff5210db740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff5141ab490 con 0x55f58a1ac490 2024-09-21T06:03:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff513fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a58ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff513fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a58ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59690/0 (socket says 172.21.15.7:59690) 2024-09-21T06:03:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff513fff640 1 -- 172.21.15.7:0/1964929247 learned_addr learned my addr 172.21.15.7:0/1964929247 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff513fff640 1 --2- 172.21.15.7:0/1964929247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a193cd0 0x55f58a5879a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff513fff640 1 -- 172.21.15.7:0/1964929247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 msgr2=0x55f58a58e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff513fff640 1 --2- 172.21.15.7:0/1964929247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 0x55f58a58e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff513fff640 1 -- 172.21.15.7:0/1964929247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a193cd0 msgr2=0x55f58a5879a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff513fff640 1 --2- 172.21.15.7:0/1964929247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a193cd0 0x55f58a5879a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff513fff640 1 -- 172.21.15.7:0/1964929247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58a58d4b0 con 0x55f58a1b4670 2024-09-21T06:03:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.366+0000 7ff513fff640 1 --2- 172.21.15.7:0/1964929247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a58ba80 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ff500012880 tx=0x7ff500005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77089e73d1c6ed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.367+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/1964929247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500004220 con 0x55f58a1b4670 2024-09-21T06:03:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.367+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/1964929247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff500012e20 con 0x55f58a1b4670 2024-09-21T06:03:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.367+0000 7ff4fe7fc640 1 -- 172.21.15.7:0/1964929247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500021730 con 0x55f58a1b4670 2024-09-21T06:03:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.367+0000 7ff5210db740 1 -- 172.21.15.7:0/1964929247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 msgr2=0x55f58a58ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.367+0000 7ff5210db740 1 --2- 172.21.15.7:0/1964929247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a58ba80 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ff500012880 tx=0x7ff500005850 comp rx=0 tx=0).stop 2024-09-21T06:03:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.367+0000 7ff5210db740 1 -- 172.21.15.7:0/1964929247 shutdown_connections 2024-09-21T06:03:27.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.367+0000 7ff5210db740 1 --2- 172.21.15.7:0/1964929247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a58ba80 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.367+0000 7ff5210db740 1 --2- 172.21.15.7:0/1964929247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 0x55f58a58e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.367+0000 7ff5210db740 1 --2- 172.21.15.7:0/1964929247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a193cd0 0x55f58a5879a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.367+0000 7ff5210db740 1 -- 172.21.15.7:0/1964929247 >> 172.21.15.7:0/1964929247 conn(0x55f58a1c9740 msgr2=0x55f58a57f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.367+0000 7ff5210db740 1 -- 172.21.15.7:0/1964929247 shutdown_connections 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.367+0000 7ff5210db740 1 -- 172.21.15.7:0/1964929247 wait complete. 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.368+0000 7ff5210db740 1 -- start start 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.368+0000 7ff5210db740 1 Processor -- start 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.368+0000 7ff5210db740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a193cd0 0x55f58a59ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.368+0000 7ff5210db740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 0x55f58a5a0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.368+0000 7ff5210db740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a600c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.368+0000 7ff5210db740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5141abb00 con 0x55f58a1b4670 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.368+0000 7ff5210db740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff5141acf70 con 0x55f58a193cd0 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.368+0000 7ff5210db740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff5141ac1d0 con 0x55f58a1ac490 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.368+0000 7ff5210db740 10 client.0 _ll_register_callbacks cb 0x7ff50000bde0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:27.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff513fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a600c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff513fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a600c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59698/0 (socket says 172.21.15.7:59698) 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff513fff640 1 -- 172.21.15.7:0/1032170352 learned_addr learned my addr 172.21.15.7:0/1032170352 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff513fff640 1 --2- 172.21.15.7:0/1032170352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a193cd0 0x55f58a59ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff518903640 1 --2- 172.21.15.7:0/1032170352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 0x55f58a5a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff513fff640 1 -- 172.21.15.7:0/1032170352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 msgr2=0x55f58a5a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff513fff640 1 --2- 172.21.15.7:0/1032170352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 0x55f58a5a0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff513fff640 1 -- 172.21.15.7:0/1032170352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a193cd0 msgr2=0x55f58a59ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff513fff640 1 --2- 172.21.15.7:0/1032170352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a193cd0 0x55f58a59ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff513fff640 1 -- 172.21.15.7:0/1032170352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58a601270 con 0x55f58a1b4670 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff513fff640 1 --2- 172.21.15.7:0/1032170352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a600c00 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ff50000b8b0 tx=0x7ff500001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b43bebacc6a0b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff4f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff4f3fff640 1 -- 172.21.15.7:0/1032170352 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50002c070 con 0x55f58a1b4670 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff4f3fff640 1 -- 172.21.15.7:0/1032170352 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7ff5000037f0 con 0x55f58a1b4670 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.369+0000 7ff5210db740 1 -- 172.21.15.7:0/1032170352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff500012e20 con 0x55f58a1b4670 2024-09-21T06:03:27.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.370+0000 7ff4f3fff640 1 -- 172.21.15.7:0/1032170352 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff5000039f0 con 0x55f58a1b4670 2024-09-21T06:03:27.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.370+0000 7ff5210db740 10 client.18321 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:27.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.370+0000 7ff5210db740 1 -- 172.21.15.7:0/1032170352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f58a609740 con 0x55f58a1b4670 2024-09-21T06:03:27.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.370+0000 7ff4f3fff640 1 -- 172.21.15.7:0/1032170352 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff500012e20 con 0x55f58a1b4670 2024-09-21T06:03:27.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.370+0000 7ff4f3fff640 1 -- 172.21.15.7:0/1032170352 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff500027070 con 0x55f58a1b4670 2024-09-21T06:03:27.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.370+0000 7ff5210db740 10 client.18321 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:27.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.370+0000 7ff5210db740 10 client.18321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:27.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.370+0000 7ff5210db740 20 client.18321 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:27.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.370+0000 7ff5210db740 1 --2- 172.21.15.7:0/1032170352 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f58a1d5350 0x55f58a60bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.370+0000 7ff5210db740 4 client.18321 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.370+0000 7ff5210db740 1 -- 172.21.15.7:0/1032170352 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f58a4f0860 con 0x55f58a1d5350 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.370+0000 7ff518903640 1 --2- 172.21.15.7:0/1032170352 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f58a1d5350 0x55f58a60bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.371+0000 7ff518903640 1 --2- 172.21.15.7:0/1032170352 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f58a1d5350 0x55f58a60bf00 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74e431740f4667ad server_cookie=d6283aa57da71080 in_seq=0 out_seq=0 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.371+0000 7ff4f3fff640 10 client.18321 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.373+0000 7ff4f3fff640 1 -- 172.21.15.7:0/1032170352 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f58a4f0860 con 0x55f58a1d5350 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.373+0000 7ff4f3fff640 10 client.18321 handle_command_reply: tid=0 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.373+0000 7ff5210db740 1 client.18321 shutdown 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.373+0000 7ff5210db740 1 -- 172.21.15.7:0/1032170352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 msgr2=0x55f58a600c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.373+0000 7ff5210db740 1 --2- 172.21.15.7:0/1032170352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a600c00 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ff50000b8b0 tx=0x7ff500001e50 comp rx=0 tx=0).stop 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.373+0000 7ff5210db740 1 -- 172.21.15.7:0/1032170352 shutdown_connections 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.373+0000 7ff5210db740 1 --2- 172.21.15.7:0/1032170352 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f58a1d5350 0x55f58a60bf00 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.373+0000 7ff5210db740 1 --2- 172.21.15.7:0/1032170352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f58a1b4670 0x55f58a600c00 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.373+0000 7ff5210db740 1 --2- 172.21.15.7:0/1032170352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f58a1ac490 0x55f58a5a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.373+0000 7ff4f3fff640 0 client.18321 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:27.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.373+0000 7ff5210db740 1 --2- 172.21.15.7:0/1032170352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f58a193cd0 0x55f58a59ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.373+0000 7ff5210db740 1 -- 172.21.15.7:0/1032170352 >> 172.21.15.7:0/1032170352 conn(0x55f58a1c9740 msgr2=0x55f58a58de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:27.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.373+0000 7ff5210db740 1 -- 172.21.15.7:0/1032170352 shutdown_connections 2024-09-21T06:03:27.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff5210db740 1 -- 172.21.15.7:0/1032170352 wait complete. 2024-09-21T06:03:27.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff5210db740 20 client.18321 trim_cache size 0 max 16384 2024-09-21T06:03:27.377 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:03:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:03:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "45555fc5-f980-4215-8c2e-8c90fd64f21e", 2024-09-21T06:03:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:03:27.377 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:03:27.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff51ab67640 1 -- 172.21.15.7:0/4146904797 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5040b66b0 msgr2=0x7ff5040b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:27.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff51ab67640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5040b66b0 0x7ff5040b8bc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0e43d0 tx=0x7ff50c079db0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff51ab67640 1 -- 172.21.15.7:0/4146904797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff514108d10 msgr2=0x7ff51419bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:27.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff51ab67640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff514108d10 0x7ff51419bd90 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00b970 tx=0x7ff50c00be30 comp rx=0 tx=0).stop 2024-09-21T06:03:27.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff51ab67640 1 -- 172.21.15.7:0/4146904797 shutdown_connections 2024-09-21T06:03:27.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff51ab67640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ff5040b66b0 0x7ff5040b8bc0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff51ab67640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff514108d10 0x7ff51419bd90 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff51ab67640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5141083c0 0x7ff51419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff51ab67640 1 --2- 172.21.15.7:0/4146904797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff514102a80 0x7ff51419b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:27.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff51ab67640 1 -- 172.21.15.7:0/4146904797 >> 172.21.15.7:0/4146904797 conn(0x7ff514079740 msgr2=0x7ff514101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:27.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff51ab67640 1 -- 172.21.15.7:0/4146904797 shutdown_connections 2024-09-21T06:03:27.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:27.374+0000 7ff51ab67640 1 -- 172.21.15.7:0/4146904797 wait complete. 2024-09-21T06:03:28.037 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:03:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:28.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:28 smithi007 ceph-mon[30983]: pgmap v613: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:03:28.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:28 smithi027 ceph-mon[34364]: pgmap v613: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:03:28.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:28 smithi119 ceph-mon[34833]: pgmap v613: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:03:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.742+0000 7f3d022b2640 1 -- 172.21.15.7:0/4281198715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cfc1062b0 msgr2=0x7f3cfc1066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.742+0000 7f3d022b2640 1 --2- 172.21.15.7:0/4281198715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cfc1062b0 0x7f3cfc1066c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009900 tx=0x7f3ce402a410 comp rx=0 tx=0).stop 2024-09-21T06:03:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.742+0000 7f3d022b2640 1 -- 172.21.15.7:0/4281198715 shutdown_connections 2024-09-21T06:03:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.742+0000 7f3d022b2640 1 --2- 172.21.15.7:0/4281198715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cfc1062b0 0x7f3cfc1066c0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.742+0000 7f3d022b2640 1 --2- 172.21.15.7:0/4281198715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cfc106c00 0x7f3cfc110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.742+0000 7f3d022b2640 1 --2- 172.21.15.7:0/4281198715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cfc1020c0 0x7f3cfc1024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.742+0000 7f3d022b2640 1 -- 172.21.15.7:0/4281198715 >> 172.21.15.7:0/4281198715 conn(0x7f3cfc079e40 msgr2=0x7f3cfc07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.742+0000 7f3d022b2640 1 -- 172.21.15.7:0/4281198715 shutdown_connections 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.742+0000 7f3d022b2640 1 -- 172.21.15.7:0/4281198715 wait complete. 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.743+0000 7f3d022b2640 1 Processor -- start 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.743+0000 7f3d022b2640 1 -- start start 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.743+0000 7f3d022b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cfc1020c0 0x7f3cfc19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.743+0000 7f3d022b2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cfc1062b0 0x7f3cfc19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.743+0000 7f3d022b2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cfc106c00 0x7f3cfc19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.743+0000 7f3d022b2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc113b70 con 0x7f3cfc1020c0 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.743+0000 7f3d022b2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc1139f0 con 0x7f3cfc106c00 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.743+0000 7f3d022b2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc113cf0 con 0x7f3cfc1062b0 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.743+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cfc1020c0 0x7f3cfc19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.743+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cfc1020c0 0x7f3cfc19a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47700/0 (socket says 172.21.15.7:47700) 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.743+0000 7f3cfbfff640 1 -- 172.21.15.7:0/3019611008 learned_addr learned my addr 172.21.15.7:0/3019611008 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.743+0000 7f3d0084f640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cfc106c00 0x7f3cfc19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.743+0000 7f3cf3fff640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cfc1062b0 0x7f3cfc19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.744+0000 7f3cfbfff640 1 -- 172.21.15.7:0/3019611008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cfc1062b0 msgr2=0x7f3cfc19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.744+0000 7f3cfbfff640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cfc1062b0 0x7f3cfc19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.744+0000 7f3cfbfff640 1 -- 172.21.15.7:0/3019611008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cfc106c00 msgr2=0x7f3cfc19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.744+0000 7f3cfbfff640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cfc106c00 0x7f3cfc19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.744+0000 7f3cfbfff640 1 -- 172.21.15.7:0/3019611008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc1a0410 con 0x7f3cfc1020c0 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.744+0000 7f3cf3fff640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cfc1062b0 0x7f3cfc19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.744+0000 7f3cfbfff640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cfc1020c0 0x7f3cfc19a560 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00c920 tx=0x7f3cec00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.744+0000 7f3cf9ffb640 1 -- 172.21.15.7:0/3019611008 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec007c70 con 0x7f3cfc1020c0 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.744+0000 7f3d022b2640 1 -- 172.21.15.7:0/3019611008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cfc1a0700 con 0x7f3cfc1020c0 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.744+0000 7f3cf9ffb640 1 -- 172.21.15.7:0/3019611008 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cec007e10 con 0x7f3cfc1020c0 2024-09-21T06:03:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.744+0000 7f3cf9ffb640 1 -- 172.21.15.7:0/3019611008 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec018820 con 0x7f3cfc1020c0 2024-09-21T06:03:28.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.744+0000 7f3d022b2640 1 -- 172.21.15.7:0/3019611008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cfc1a6f20 con 0x7f3cfc1020c0 2024-09-21T06:03:28.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.747+0000 7f3d08826740 1 Processor -- start 2024-09-21T06:03:28.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.747+0000 7f3d08826740 1 -- start start 2024-09-21T06:03:28.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.747+0000 7f3cf9ffb640 1 -- 172.21.15.7:0/3019611008 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f3cec00f450 con 0x7f3cfc1020c0 2024-09-21T06:03:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.747+0000 7f3d08826740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3ae070 0x55f75a755270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.747+0000 7f3d08826740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3851b0 0x55f75a7557b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.747+0000 7f3d08826740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a38d390 0x55f75a755cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.747+0000 7f3d08826740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f75a6cbe50 con 0x55f75a3ae070 2024-09-21T06:03:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.747+0000 7f3d08826740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f75a6bb280 con 0x55f75a3851b0 2024-09-21T06:03:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.747+0000 7f3d08826740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f75a6bf090 con 0x55f75a38d390 2024-09-21T06:03:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.747+0000 7f3d0084f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3ae070 0x55f75a755270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.747+0000 7f3d0084f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3ae070 0x55f75a755270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47708/0 (socket says 172.21.15.7:47708) 2024-09-21T06:03:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.747+0000 7f3d0084f640 1 -- 172.21.15.7:0/2987821933 learned_addr learned my addr 172.21.15.7:0/2987821933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3cf3fff640 1 --2- 172.21.15.7:0/2987821933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a38d390 0x55f75a755cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3cfbfff640 1 --2- 172.21.15.7:0/2987821933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3851b0 0x55f75a7557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3d0084f640 1 -- 172.21.15.7:0/2987821933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a38d390 msgr2=0x55f75a755cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3d0084f640 1 --2- 172.21.15.7:0/2987821933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a38d390 0x55f75a755cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3d0084f640 1 -- 172.21.15.7:0/2987821933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3851b0 msgr2=0x55f75a7557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3d0084f640 1 --2- 172.21.15.7:0/2987821933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3851b0 0x55f75a7557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3d0084f640 1 -- 172.21.15.7:0/2987821933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f75a419650 con 0x55f75a3ae070 2024-09-21T06:03:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3cfbfff640 1 --2- 172.21.15.7:0/2987821933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3851b0 0x55f75a7557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3d0084f640 1 --2- 172.21.15.7:0/2987821933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3ae070 0x55f75a755270 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400a430 tx=0x7f3cf4009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d84192c212a0a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3cf9ffb640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3ce80b66b0 0x7f3ce80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3cf27fc640 1 -- 172.21.15.7:0/2987821933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4013790 con 0x55f75a3ae070 2024-09-21T06:03:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3cf27fc640 1 -- 172.21.15.7:0/2987821933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cf4019070 con 0x55f75a3ae070 2024-09-21T06:03:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3cf27fc640 1 -- 172.21.15.7:0/2987821933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4014d00 con 0x55f75a3ae070 2024-09-21T06:03:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3cf9ffb640 1 -- 172.21.15.7:0/3019611008 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f3cec0e7820 con 0x7f3cfc1020c0 2024-09-21T06:03:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.748+0000 7f3cfbfff640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3ce80b66b0 0x7f3ce80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.749+0000 7f3d08826740 1 -- 172.21.15.7:0/2987821933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3ae070 msgr2=0x55f75a755270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.749+0000 7f3cfbfff640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3ce80b66b0 0x7f3ce80b8bc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0e5070 tx=0x7f3cec000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.749+0000 7f3d08826740 1 --2- 172.21.15.7:0/2987821933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3ae070 0x55f75a755270 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400a430 tx=0x7f3cf4009650 comp rx=0 tx=0).stop 2024-09-21T06:03:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.749+0000 7f3d08826740 1 -- 172.21.15.7:0/2987821933 shutdown_connections 2024-09-21T06:03:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.749+0000 7f3d08826740 1 --2- 172.21.15.7:0/2987821933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a38d390 0x55f75a755cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.749+0000 7f3d08826740 1 --2- 172.21.15.7:0/2987821933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3851b0 0x55f75a7557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.749+0000 7f3d08826740 1 --2- 172.21.15.7:0/2987821933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3ae070 0x55f75a755270 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.749+0000 7f3d08826740 1 -- 172.21.15.7:0/2987821933 >> 172.21.15.7:0/2987821933 conn(0x55f75a3a2460 msgr2=0x55f75a753160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.749+0000 7f3d08826740 1 -- 172.21.15.7:0/2987821933 shutdown_connections 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.749+0000 7f3d08826740 1 -- 172.21.15.7:0/2987821933 wait complete. 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.750+0000 7f3d08826740 1 -- start start 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.750+0000 7f3d08826740 1 Processor -- start 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.750+0000 7f3d08826740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3851b0 0x55f75a760910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.750+0000 7f3d08826740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a38d390 0x55f75a760e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.750+0000 7f3d08826740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 0x55f75a7613d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.750+0000 7f3d08826740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f75a51c700 con 0x55f75a3851b0 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.750+0000 7f3d08826740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55f75a656110 con 0x55f75a3ae070 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.750+0000 7f3d08826740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f75a763a50 con 0x55f75a38d390 2024-09-21T06:03:28.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.750+0000 7f3d08826740 10 client.0 _ll_register_callbacks cb 0x55f75a66f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.750+0000 7f3d0084f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3851b0 0x55f75a760910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3d0084f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3851b0 0x55f75a760910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47716/0 (socket says 172.21.15.7:47716) 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3d0084f640 1 -- 172.21.15.7:0/2177709986 learned_addr learned my addr 172.21.15.7:0/2177709986 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3cf3fff640 1 --2- 172.21.15.7:0/2177709986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a38d390 0x55f75a760e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3d0084f640 1 --2- 172.21.15.7:0/2177709986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 0x55f75a7613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3d0084f640 1 -- 172.21.15.7:0/2177709986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a38d390 msgr2=0x55f75a760e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3d0084f640 1 --2- 172.21.15.7:0/2177709986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a38d390 0x55f75a760e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3d0084f640 1 -- 172.21.15.7:0/2177709986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 msgr2=0x55f75a7613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3d0084f640 1 --2- 172.21.15.7:0/2177709986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 0x55f75a7613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3d0084f640 1 -- 172.21.15.7:0/2177709986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f75a683c40 con 0x55f75a3851b0 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3d0084f640 1 --2- 172.21.15.7:0/2177709986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3851b0 0x55f75a760910 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40149a0 tx=0x7f3cf4009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57717c7059b0f90 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3cdb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3cdb7fe640 1 -- 172.21.15.7:0/2177709986 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4013790 con 0x55f75a3851b0 2024-09-21T06:03:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3cdb7fe640 1 -- 172.21.15.7:0/2177709986 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f3cf4013930 con 0x55f75a3851b0 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.751+0000 7f3d08826740 1 -- 172.21.15.7:0/2177709986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cf4019070 con 0x55f75a3851b0 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.752+0000 7f3cdb7fe640 1 -- 172.21.15.7:0/2177709986 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3cf4033050 con 0x55f75a3851b0 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.752+0000 7f3d08826740 10 client.18333 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.752+0000 7f3d08826740 1 -- 172.21.15.7:0/2177709986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f75a76f750 con 0x55f75a3851b0 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.752+0000 7f3cdb7fe640 1 -- 172.21.15.7:0/2177709986 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cf4019070 con 0x55f75a3851b0 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.752+0000 7f3cdb7fe640 1 -- 172.21.15.7:0/2177709986 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3cf4021a70 con 0x55f75a3851b0 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.752+0000 7f3d08826740 10 client.18333 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.752+0000 7f3d08826740 10 client.18333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.752+0000 7f3d08826740 20 client.18333 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.752+0000 7f3d08826740 1 --2- 172.21.15.7:0/2177709986 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f75a36c9f0 0x55f75a772ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.752+0000 7f3d08826740 4 client.18333 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.752+0000 7f3d08826740 1 -- 172.21.15.7:0/2177709986 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f75a6cdda0 con 0x55f75a36c9f0 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.752+0000 7f3cf3fff640 1 --2- 172.21.15.7:0/2177709986 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f75a36c9f0 0x55f75a772ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.753+0000 7f3cf3fff640 1 --2- 172.21.15.7:0/2177709986 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f75a36c9f0 0x55f75a772ab0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76d914087001e61c server_cookie=1137433bc16176a8 in_seq=0 out_seq=0 2024-09-21T06:03:28.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.753+0000 7f3cdb7fe640 10 client.18333 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:28.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3cdb7fe640 1 -- 172.21.15.7:0/2177709986 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f75a6cdda0 con 0x55f75a36c9f0 2024-09-21T06:03:28.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3cdb7fe640 10 client.18333 handle_command_reply: tid=0 2024-09-21T06:03:28.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3d08826740 1 client.18333 shutdown 2024-09-21T06:03:28.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3d08826740 1 -- 172.21.15.7:0/2177709986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3851b0 msgr2=0x55f75a760910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:28.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3d08826740 1 --2- 172.21.15.7:0/2177709986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3851b0 0x55f75a760910 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40149a0 tx=0x7f3cf4009b00 comp rx=0 tx=0).stop 2024-09-21T06:03:28.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3d08826740 1 -- 172.21.15.7:0/2177709986 shutdown_connections 2024-09-21T06:03:28.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3d08826740 1 --2- 172.21.15.7:0/2177709986 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f75a36c9f0 0x55f75a772ab0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3d08826740 1 --2- 172.21.15.7:0/2177709986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 0x55f75a7613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3d08826740 1 --2- 172.21.15.7:0/2177709986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a38d390 0x55f75a760e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3d08826740 1 --2- 172.21.15.7:0/2177709986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a3851b0 0x55f75a760910 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3d08826740 1 -- 172.21.15.7:0/2177709986 >> 172.21.15.7:0/2177709986 conn(0x55f75a3a2460 msgr2=0x55f75a758400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:28.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3cdb7fe640 0 client.18333 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:28.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3d08826740 1 -- 172.21.15.7:0/2177709986 shutdown_connections 2024-09-21T06:03:28.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3d08826740 1 -- 172.21.15.7:0/2177709986 wait complete. 2024-09-21T06:03:28.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.754+0000 7f3d08826740 20 client.18333 trim_cache size 0 max 16384 2024-09-21T06:03:28.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.772+0000 7f3d08826740 1 Processor -- start 2024-09-21T06:03:28.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.772+0000 7f3d08826740 1 -- start start 2024-09-21T06:03:28.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.772+0000 7f3d08826740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a3851b0 0x55f75a7627f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.772+0000 7f3d08826740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 0x55f75a76c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.772+0000 7f3d08826740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 0x55f75a752710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.772+0000 7f3d08826740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc1b1fe0 con 0x55f75a38d390 2024-09-21T06:03:28.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.772+0000 7f3d08826740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc1af8b0 con 0x55f75a3ae070 2024-09-21T06:03:28.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.772+0000 7f3d08826740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc1ad720 con 0x55f75a3851b0 2024-09-21T06:03:28.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.772+0000 7f3cf3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 0x55f75a76c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.772+0000 7f3cf3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 0x55f75a76c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47718/0 (socket says 172.21.15.7:47718) 2024-09-21T06:03:28.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.772+0000 7f3d0084f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a3851b0 0x55f75a7627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.772+0000 7f3cf3fff640 1 -- 172.21.15.7:0/2718014438 learned_addr learned my addr 172.21.15.7:0/2718014438 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:28.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.773+0000 7f3d0084f640 1 --2- 172.21.15.7:0/2718014438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 0x55f75a752710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.773+0000 7f3d0084f640 1 -- 172.21.15.7:0/2718014438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 msgr2=0x55f75a752710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:28.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.773+0000 7f3d0084f640 1 --2- 172.21.15.7:0/2718014438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 0x55f75a752710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.773+0000 7f3d0084f640 1 -- 172.21.15.7:0/2718014438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 msgr2=0x55f75a76c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:28.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.773+0000 7f3d0084f640 1 --2- 172.21.15.7:0/2718014438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 0x55f75a76c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.773+0000 7f3d0084f640 1 -- 172.21.15.7:0/2718014438 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f75a757850 con 0x55f75a3851b0 2024-09-21T06:03:28.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.773+0000 7f3cf3fff640 1 --2- 172.21.15.7:0/2718014438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 0x55f75a76c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:28.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.773+0000 7f3d0084f640 1 --2- 172.21.15.7:0/2718014438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a3851b0 0x55f75a7627f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4021e70 tx=0x7f3cf4000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7952efaa029f09d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:28.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.773+0000 7f3cf1ffb640 1 -- 172.21.15.7:0/2718014438 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf401d990 con 0x55f75a3851b0 2024-09-21T06:03:28.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.773+0000 7f3cf1ffb640 1 -- 172.21.15.7:0/2718014438 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cf4019070 con 0x55f75a3851b0 2024-09-21T06:03:28.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.773+0000 7f3cf1ffb640 1 -- 172.21.15.7:0/2718014438 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4021a30 con 0x55f75a3851b0 2024-09-21T06:03:28.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.774+0000 7f3d08826740 1 -- 172.21.15.7:0/2718014438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a3851b0 msgr2=0x55f75a7627f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:28.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.774+0000 7f3d08826740 1 --2- 172.21.15.7:0/2718014438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a3851b0 0x55f75a7627f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4021e70 tx=0x7f3cf4000f40 comp rx=0 tx=0).stop 2024-09-21T06:03:28.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.774+0000 7f3d08826740 1 -- 172.21.15.7:0/2718014438 shutdown_connections 2024-09-21T06:03:28.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.774+0000 7f3d08826740 1 --2- 172.21.15.7:0/2718014438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 0x55f75a76c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.774+0000 7f3d08826740 1 --2- 172.21.15.7:0/2718014438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 0x55f75a752710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.774+0000 7f3d08826740 1 --2- 172.21.15.7:0/2718014438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a3851b0 0x55f75a7627f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.774+0000 7f3d08826740 1 -- 172.21.15.7:0/2718014438 >> 172.21.15.7:0/2718014438 conn(0x55f75a3a2460 msgr2=0x55f75a76bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.774+0000 7f3d08826740 1 -- 172.21.15.7:0/2718014438 shutdown_connections 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.774+0000 7f3d08826740 1 -- 172.21.15.7:0/2718014438 wait complete. 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3d08826740 1 -- start start 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3d08826740 1 Processor -- start 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3d08826740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a3851b0 0x55f75a7733f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3d08826740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 0x55f75a7739b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3d08826740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 0x55f75a7d5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3d08826740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc1add70 con 0x55f75a38d390 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3d08826740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc1af1e0 con 0x55f75a3ae070 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3d08826740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc1ae440 con 0x55f75a3851b0 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3d08826740 10 client.0 _ll_register_callbacks cb 0x7f3ce4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:28.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3cf3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 0x55f75a7739b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3cf3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 0x55f75a7739b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47728/0 (socket says 172.21.15.7:47728) 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3cf3fff640 1 -- 172.21.15.7:0/1287822197 learned_addr learned my addr 172.21.15.7:0/1287822197 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3d0084f640 1 --2- 172.21.15.7:0/1287822197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 0x55f75a7d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.775+0000 7f3d0084f640 1 --2- 172.21.15.7:0/1287822197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a3851b0 0x55f75a7733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.776+0000 7f3cf3fff640 1 -- 172.21.15.7:0/1287822197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a3851b0 msgr2=0x55f75a7733f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.776+0000 7f3cf3fff640 1 --2- 172.21.15.7:0/1287822197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a3851b0 0x55f75a7733f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.776+0000 7f3cf3fff640 1 -- 172.21.15.7:0/1287822197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 msgr2=0x55f75a7d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.776+0000 7f3cf3fff640 1 --2- 172.21.15.7:0/1287822197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 0x55f75a7d5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.776+0000 7f3cf3fff640 1 -- 172.21.15.7:0/1287822197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f75a7d58d0 con 0x55f75a38d390 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.776+0000 7f3cf3fff640 1 --2- 172.21.15.7:0/1287822197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 0x55f75a7739b0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f3ce402a930 tx=0x7f3ce4005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365083316668fbd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.776+0000 7f3cdb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.776+0000 7f3cdb7fe640 1 -- 172.21.15.7:0/1287822197 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4035040 con 0x55f75a38d390 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.776+0000 7f3cdb7fe640 1 -- 172.21.15.7:0/1287822197 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f3ce40046c0 con 0x55f75a38d390 2024-09-21T06:03:28.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.776+0000 7f3d08826740 1 -- 172.21.15.7:0/1287822197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cf4019070 con 0x55f75a38d390 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.776+0000 7f3cdb7fe640 1 -- 172.21.15.7:0/1287822197 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3ce40048c0 con 0x55f75a38d390 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.776+0000 7f3d08826740 10 client.18339 fetch_fsmap learned FSMap version 25 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.776+0000 7f3d08826740 1 -- 172.21.15.7:0/1287822197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f75a7dcbe0 con 0x55f75a38d390 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.777+0000 7f3cdb7fe640 1 -- 172.21.15.7:0/1287822197 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cf4019070 con 0x55f75a38d390 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.777+0000 7f3cdb7fe640 1 -- 172.21.15.7:0/1287822197 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3ce4003cf0 con 0x55f75a38d390 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.777+0000 7f3d08826740 10 client.18339 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.777+0000 7f3d08826740 10 client.18339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.777+0000 7f3d08826740 20 client.18339 populate_metadata read hostname 'smithi007' 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.777+0000 7f3d08826740 1 --2- 172.21.15.7:0/1287822197 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f75a341da0 0x55f75a7df330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.777+0000 7f3d08826740 4 client.18339 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.777+0000 7f3d08826740 1 -- 172.21.15.7:0/1287822197 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f75a6c9850 con 0x55f75a341da0 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.777+0000 7f3d0084f640 1 --2- 172.21.15.7:0/1287822197 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f75a341da0 0x55f75a7df330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3d0084f640 1 --2- 172.21.15.7:0/1287822197 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f75a341da0 0x55f75a7df330 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11b099a77bad74b7 server_cookie=f8e0efc00bb85eec in_seq=0 out_seq=0 2024-09-21T06:03:28.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3cdb7fe640 10 client.18339 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3cdb7fe640 1 -- 172.21.15.7:0/1287822197 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7954 (crc 0 0 0) 0x55f75a6c9850 con 0x55f75a341da0 2024-09-21T06:03:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3cdb7fe640 10 client.18339 handle_command_reply: tid=0 2024-09-21T06:03:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3d08826740 1 client.18339 shutdown 2024-09-21T06:03:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3d08826740 1 -- 172.21.15.7:0/1287822197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 msgr2=0x55f75a7739b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3d08826740 1 --2- 172.21.15.7:0/1287822197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 0x55f75a7739b0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f3ce402a930 tx=0x7f3ce4005130 comp rx=0 tx=0).stop 2024-09-21T06:03:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3d08826740 1 -- 172.21.15.7:0/1287822197 shutdown_connections 2024-09-21T06:03:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3d08826740 1 --2- 172.21.15.7:0/1287822197 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x55f75a341da0 0x55f75a7df330 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3d08826740 1 --2- 172.21.15.7:0/1287822197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f75a38d390 0x55f75a7739b0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3d08826740 1 --2- 172.21.15.7:0/1287822197 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f75a3ae070 0x55f75a7d5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3d08826740 1 --2- 172.21.15.7:0/1287822197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f75a3851b0 0x55f75a7733f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3d08826740 1 -- 172.21.15.7:0/1287822197 >> 172.21.15.7:0/1287822197 conn(0x55f75a3a2460 msgr2=0x55f75a756c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3cdb7fe640 0 client.18339 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:03:28.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3d08826740 1 -- 172.21.15.7:0/1287822197 shutdown_connections 2024-09-21T06:03:28.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.778+0000 7f3d08826740 1 -- 172.21.15.7:0/1287822197 wait complete. 2024-09-21T06:03:28.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.779+0000 7f3d08826740 20 client.18339 trim_cache size 0 max 16384 2024-09-21T06:03:28.785 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:03:28.785 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:03:28.785 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:03:28.785 INFO:teuthology.orchestra.run.smithi007.stdout: "45555fc5-f980-4215-8c2e-8c90fd64f21e": { 2024-09-21T06:03:28.785 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.785 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "45555fc5-f980-4215-8c2e-8c90fd64f21e", 2024-09-21T06:03:28.785 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:03:28.785 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:03:28.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.786 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:03:28.786 INFO:teuthology.orchestra.run.smithi007.stdout: "40df47a2-fbba-49bc-a842-15ce641cb6ee": { 2024-09-21T06:03:28.786 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:03:17.234445+0000", 2024-09-21T06:03:28.786 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.786 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.786 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.786 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.786 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.786 INFO:teuthology.orchestra.run.smithi007.stdout: "1d89aa12-56bd-49e8-bbd4-0309b4e70f2a": { 2024-09-21T06:03:28.786 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:02:56.375957+0000", 2024-09-21T06:03:28.786 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: "46ad69b3-ef90-42e0-a57b-ea33e3ef74ab": { 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:32.287019+0000", 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.787 INFO:teuthology.orchestra.run.smithi007.stdout: "d9b96838-732e-40a1-9fad-f54faef73b59": { 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:21.774276+0000", 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: "fd9e7ebd-b70a-487f-937b-80b64378d04b": { 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:11.755521+0000", 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "3bd778db-a0ed-42ad-8a79-14a200f0734e": { 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:51.556015+0000", 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.789 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: "f5c9a9cd-a1fc-4e1a-8442-f7c676fc4489": { 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:03:06.938698+0000", 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.790 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:03:28.791 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.792 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: "ecf3518d-a174-4cee-89a1-6aa26e1b3442": { 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:01.909762+0000", 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.794 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:03:28.794 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:03:28.794 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.794 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.794 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.794 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.794 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.794 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:03:28.794 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:03:28.794 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.794 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.794 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: "45555fc5-f980-4215-8c2e-8c90fd64f21e": { 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:03:27.371196+0000", 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:03:28.795 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:03:28.796 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.798 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:03:28.798 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:03:28.798 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.798 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:03:28.798 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:03:28.798 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.798 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: "a9901d9b-aa10-4587-83ff-d32730ff12ea": { 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:02:14.695980+0000", 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.799 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:03:28.800 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:03:28.801 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:03:28.801 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:03:28.801 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:03:28.801 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:03:28.801 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:03:28.801 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:03:28.801 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:03:28.801 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:03:28.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.779+0000 7f3d022b2640 1 -- 172.21.15.7:0/3019611008 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3ce80b66b0 msgr2=0x7f3ce80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:28.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.779+0000 7f3d022b2640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3ce80b66b0 0x7f3ce80b8bc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0e5070 tx=0x7f3cec000bc0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.779+0000 7f3d022b2640 1 -- 172.21.15.7:0/3019611008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cfc1020c0 msgr2=0x7f3cfc19a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:28.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.779+0000 7f3d022b2640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cfc1020c0 0x7f3cfc19a560 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00c920 tx=0x7f3cec00cde0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.779+0000 7f3d022b2640 1 -- 172.21.15.7:0/3019611008 shutdown_connections 2024-09-21T06:03:28.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.779+0000 7f3d022b2640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f3ce80b66b0 0x7f3ce80b8bc0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.779+0000 7f3d022b2640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cfc106c00 0x7f3cfc19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.779+0000 7f3d022b2640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cfc1062b0 0x7f3cfc19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.779+0000 7f3d022b2640 1 --2- 172.21.15.7:0/3019611008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cfc1020c0 0x7f3cfc19a560 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:28.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.779+0000 7f3d022b2640 1 -- 172.21.15.7:0/3019611008 >> 172.21.15.7:0/3019611008 conn(0x7f3cfc079e40 msgr2=0x7f3cfc107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:28.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.779+0000 7f3d022b2640 1 -- 172.21.15.7:0/3019611008 shutdown_connections 2024-09-21T06:03:28.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:28.779+0000 7f3d022b2640 1 -- 172.21.15.7:0/3019611008 wait complete. 2024-09-21T06:03:29.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:29 smithi027 ceph-mon[34364]: scrub queued for path: / 2024-09-21T06:03:29.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:29 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:29.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:29 smithi027 ceph-mon[34364]: scrub summary: active paths [/] 2024-09-21T06:03:29.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:29 smithi027 ceph-mon[34364]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:29.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:29 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:03:29.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:29 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:29.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:29 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:03:29.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:29 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:29.561 INFO:tasks.cephfs.filesystem:scrub status for tag:45555fc5-f980-4215-8c2e-8c90fd64f21e - {'path': '/', 'tag': '45555fc5-f980-4215-8c2e-8c90fd64f21e', 'options': 'recursive,force'} 2024-09-21T06:03:29.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:29 smithi119 ceph-mon[34833]: scrub queued for path: / 2024-09-21T06:03:29.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:29 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:29.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:29 smithi119 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T06:03:29.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:29 smithi119 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T06:03:30.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:30 smithi027 ceph-mon[34364]: pgmap v614: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8 op/s 2024-09-21T06:03:30.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:30 smithi007 ceph-mon[30983]: pgmap v614: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8 op/s 2024-09-21T06:03:30.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:30 smithi119 ceph-mon[34833]: pgmap v614: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8 op/s 2024-09-21T06:03:32.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:32 smithi027 ceph-mon[34364]: pgmap v615: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:03:32.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:32 smithi007 ceph-mon[30983]: pgmap v615: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:03:32.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:32 smithi119 ceph-mon[34833]: pgmap v615: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:03:33.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:33 smithi027 ceph-mon[34364]: scrub summary: idle 2024-09-21T06:03:33.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:33 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:03:33.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:33 smithi119 ceph-mon[34833]: scrub summary: idle 2024-09-21T06:03:34.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:34 smithi027 ceph-mon[34364]: pgmap v616: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:03:34.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:34 smithi007 ceph-mon[30983]: pgmap v616: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:03:34.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:34 smithi119 ceph-mon[34833]: pgmap v616: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:03:36.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:36 smithi027 ceph-mon[34364]: pgmap v617: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-09-21T06:03:36.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:36 smithi007 ceph-mon[30983]: pgmap v617: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-09-21T06:03:36.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:36 smithi119 ceph-mon[34833]: pgmap v617: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-09-21T06:03:38.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:38 smithi027 ceph-mon[34364]: pgmap v618: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:03:38.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:38 smithi007 ceph-mon[30983]: pgmap v618: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:03:38.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:38 smithi119 ceph-mon[34833]: pgmap v618: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:03:40.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:40 smithi027 ceph-mon[34364]: pgmap v619: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:03:40.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:40 smithi007 ceph-mon[30983]: pgmap v619: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:03:40.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:40 smithi119 ceph-mon[34833]: pgmap v619: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:03:42.477 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:42 smithi027 ceph-mon[34364]: pgmap v620: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T06:03:42.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:42 smithi007 ceph-mon[30983]: pgmap v620: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T06:03:42.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:42 smithi119 ceph-mon[34833]: pgmap v620: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T06:03:44.375 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T06:03:44.394 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:44 smithi119 ceph-mon[34833]: pgmap v621: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T06:03:44.403 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:44 smithi007 ceph-mon[30983]: pgmap v621: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T06:03:44.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:44 smithi027 ceph-mon[34364]: pgmap v621: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T06:03:44.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.502+0000 7fdf31750640 1 -- 172.21.15.7:0/672141651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c10dd90 msgr2=0x7fdf2c110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:44.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.502+0000 7fdf31750640 1 --2- 172.21.15.7:0/672141651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c10dd90 0x7fdf2c110270 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009900 tx=0x7fdf2402a410 comp rx=0 tx=0).stop 2024-09-21T06:03:44.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.502+0000 7fdf31750640 1 -- 172.21.15.7:0/672141651 shutdown_connections 2024-09-21T06:03:44.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.502+0000 7fdf31750640 1 --2- 172.21.15.7:0/672141651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c10dd90 0x7fdf2c110270 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.502+0000 7fdf31750640 1 --2- 172.21.15.7:0/672141651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf2c1052c0 0x7fdf2c10d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.502+0000 7fdf31750640 1 --2- 172.21.15.7:0/672141651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf2c104970 0x7fdf2c104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.502+0000 7fdf31750640 1 -- 172.21.15.7:0/672141651 >> 172.21.15.7:0/672141651 conn(0x7fdf2c0fe3c0 msgr2=0x7fdf2c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:44.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.502+0000 7fdf31750640 1 -- 172.21.15.7:0/672141651 shutdown_connections 2024-09-21T06:03:44.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.502+0000 7fdf31750640 1 -- 172.21.15.7:0/672141651 wait complete. 2024-09-21T06:03:44.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.503+0000 7fdf31750640 1 Processor -- start 2024-09-21T06:03:44.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.503+0000 7fdf31750640 1 -- start start 2024-09-21T06:03:44.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf31750640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf2c104970 0x7fdf2c19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:44.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf31750640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf2c1052c0 0x7fdf2c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf31750640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c10dd90 0x7fdf2c19fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf31750640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1139e0 con 0x7fdf2c10dd90 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf31750640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c113860 con 0x7fdf2c104970 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf31750640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c113b60 con 0x7fdf2c1052c0 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf2b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c10dd90 0x7fdf2c19fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf2b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c10dd90 0x7fdf2c19fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46194/0 (socket says 172.21.15.7:46194) 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf2b7fe640 1 -- 172.21.15.7:0/4217891269 learned_addr learned my addr 172.21.15.7:0/4217891269 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf2affd640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf2c104970 0x7fdf2c19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf2a7fc640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf2c1052c0 0x7fdf2c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf2b7fe640 1 -- 172.21.15.7:0/4217891269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf2c1052c0 msgr2=0x7fdf2c19a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf2b7fe640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf2c1052c0 0x7fdf2c19a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf2b7fe640 1 -- 172.21.15.7:0/4217891269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf2c104970 msgr2=0x7fdf2c19a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf2b7fe640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf2c104970 0x7fdf2c19a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf2b7fe640 1 -- 172.21.15.7:0/4217891269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2c1a02f0 con 0x7fdf2c10dd90 2024-09-21T06:03:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.504+0000 7fdf2b7fe640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c10dd90 0x7fdf2c19fbf0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fdf24004770 tx=0x7fdf24004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.505+0000 7fdf13fff640 1 -- 172.21.15.7:0/4217891269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2403f030 con 0x7fdf2c10dd90 2024-09-21T06:03:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.505+0000 7fdf31750640 1 -- 172.21.15.7:0/4217891269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2c1a0580 con 0x7fdf2c10dd90 2024-09-21T06:03:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.505+0000 7fdf13fff640 1 -- 172.21.15.7:0/4217891269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf24003aa0 con 0x7fdf2c10dd90 2024-09-21T06:03:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.505+0000 7fdf13fff640 1 -- 172.21.15.7:0/4217891269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf24035070 con 0x7fdf2c10dd90 2024-09-21T06:03:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.505+0000 7fdf31750640 1 -- 172.21.15.7:0/4217891269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf2c1a6d70 con 0x7fdf2c10dd90 2024-09-21T06:03:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.506+0000 7fdf31750640 1 -- 172.21.15.7:0/4217891269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2c104d80 con 0x7fdf2c10dd90 2024-09-21T06:03:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.508+0000 7fdf13fff640 1 -- 172.21.15.7:0/4217891269 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fdf24042030 con 0x7fdf2c10dd90 2024-09-21T06:03:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.509+0000 7fdf13fff640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdf140b6680 0x7fdf140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.509+0000 7fdf2affd640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdf140b6680 0x7fdf140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.509+0000 7fdf13fff640 1 -- 172.21.15.7:0/4217891269 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fdf24108220 con 0x7fdf2c10dd90 2024-09-21T06:03:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.510+0000 7fdf2affd640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdf140b6680 0x7fdf140b8b90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c005fd0 tx=0x7fdf1c009520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.513+0000 7fdf13fff640 1 -- 172.21.15.7:0/4217891269 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf240ce760 con 0x7fdf2c10dd90 2024-09-21T06:03:44.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.721+0000 7fdf31750640 1 -- 172.21.15.7:0/4217891269 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fdf2c108640 con 0x7fdf140b6680 2024-09-21T06:03:44.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.729+0000 7fdf13fff640 1 -- 172.21.15.7:0/4217891269 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fdf1c009b40 con 0x7fdf140b6680 2024-09-21T06:03:44.732 INFO:teuthology.orchestra.run.smithi007.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T05:53:42", "first": "2024-09-21T05:54:00", "last": "2024-09-21T06:03:00", "last_pruned": "2024-09-21T06:03:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-21T06:03:44.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.731+0000 7fdf31750640 1 -- 172.21.15.7:0/4217891269 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdf140b6680 msgr2=0x7fdf140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:44.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.731+0000 7fdf31750640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdf140b6680 0x7fdf140b8b90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c005fd0 tx=0x7fdf1c009520 comp rx=0 tx=0).stop 2024-09-21T06:03:44.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.731+0000 7fdf31750640 1 -- 172.21.15.7:0/4217891269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c10dd90 msgr2=0x7fdf2c19fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:44.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.731+0000 7fdf31750640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c10dd90 0x7fdf2c19fbf0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fdf24004770 tx=0x7fdf24004270 comp rx=0 tx=0).stop 2024-09-21T06:03:44.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.731+0000 7fdf31750640 1 -- 172.21.15.7:0/4217891269 shutdown_connections 2024-09-21T06:03:44.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.731+0000 7fdf31750640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fdf140b6680 0x7fdf140b8b90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.731+0000 7fdf31750640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c10dd90 0x7fdf2c19fbf0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.731+0000 7fdf31750640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf2c1052c0 0x7fdf2c19a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.731+0000 7fdf31750640 1 --2- 172.21.15.7:0/4217891269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf2c104970 0x7fdf2c19a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.731+0000 7fdf31750640 1 -- 172.21.15.7:0/4217891269 >> 172.21.15.7:0/4217891269 conn(0x7fdf2c0fe3c0 msgr2=0x7fdf2c1057a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:44.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.731+0000 7fdf31750640 1 -- 172.21.15.7:0/4217891269 shutdown_connections 2024-09-21T06:03:44.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.731+0000 7fdf31750640 1 -- 172.21.15.7:0/4217891269 wait complete. 2024-09-21T06:03:44.746 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T06:03:44.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.899+0000 7f00f9920640 1 -- 172.21.15.7:0/820878600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f41029d0 msgr2=0x7f00f4102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:44.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.899+0000 7f00f9920640 1 --2- 172.21.15.7:0/820878600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f41029d0 0x7f00f4102de0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009900 tx=0x7f00e402a410 comp rx=0 tx=0).stop 2024-09-21T06:03:44.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.899+0000 7f00f9920640 1 -- 172.21.15.7:0/820878600 shutdown_connections 2024-09-21T06:03:44.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.899+0000 7f00f9920640 1 --2- 172.21.15.7:0/820878600 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00f4108c50 0x7f00f410f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.899+0000 7f00f9920640 1 --2- 172.21.15.7:0/820878600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00f4108300 0x7f00f4108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.899+0000 7f00f9920640 1 --2- 172.21.15.7:0/820878600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f41029d0 0x7f00f4102de0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.899+0000 7f00f9920640 1 -- 172.21.15.7:0/820878600 >> 172.21.15.7:0/820878600 conn(0x7f00f407a710 msgr2=0x7f00f407ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:44.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.899+0000 7f00f9920640 1 -- 172.21.15.7:0/820878600 shutdown_connections 2024-09-21T06:03:44.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.899+0000 7f00f9920640 1 -- 172.21.15.7:0/820878600 wait complete. 2024-09-21T06:03:44.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.899+0000 7f00f9920640 1 Processor -- start 2024-09-21T06:03:44.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f9920640 1 -- start start 2024-09-21T06:03:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f9920640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f41029d0 0x7f00f41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f9920640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00f4108300 0x7f00f4199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f9920640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00f4108c50 0x7f00f419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f9920640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f00f4112910 con 0x7f00f41029d0 2024-09-21T06:03:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f9920640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f00f4112790 con 0x7f00f4108300 2024-09-21T06:03:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f9920640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f00f4112a90 con 0x7f00f4108c50 2024-09-21T06:03:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f41029d0 0x7f00f41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f41029d0 0x7f00f41992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46224/0 (socket says 172.21.15.7:46224) 2024-09-21T06:03:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f2ffd640 1 -- 172.21.15.7:0/3703011844 learned_addr learned my addr 172.21.15.7:0/3703011844 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f27fc640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00f4108300 0x7f00f4199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f2ffd640 1 -- 172.21.15.7:0/3703011844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00f4108c50 msgr2=0x7f00f419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f37fe640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00f4108c50 0x7f00f419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.900+0000 7f00f2ffd640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00f4108c50 0x7f00f419eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.901+0000 7f00f2ffd640 1 -- 172.21.15.7:0/3703011844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00f4108300 msgr2=0x7f00f4199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.901+0000 7f00f2ffd640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00f4108300 0x7f00f4199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.901+0000 7f00f2ffd640 1 -- 172.21.15.7:0/3703011844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f419f190 con 0x7f00f41029d0 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.901+0000 7f00f27fc640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00f4108300 0x7f00f4199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.901+0000 7f00f2ffd640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f41029d0 0x7f00f41992f0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f00e4005940 tx=0x7f00e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.901+0000 7f00f891e640 1 -- 172.21.15.7:0/3703011844 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e403f030 con 0x7f00f41029d0 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.901+0000 7f00f891e640 1 -- 172.21.15.7:0/3703011844 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00e4003cb0 con 0x7f00f41029d0 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.901+0000 7f00f9920640 1 -- 172.21.15.7:0/3703011844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f419f420 con 0x7f00f41029d0 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.901+0000 7f00f891e640 1 -- 172.21.15.7:0/3703011844 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4035070 con 0x7f00f41029d0 2024-09-21T06:03:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.901+0000 7f00f9920640 1 -- 172.21.15.7:0/3703011844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f419f960 con 0x7f00f41029d0 2024-09-21T06:03:44.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.902+0000 7f00f9920640 1 -- 172.21.15.7:0/3703011844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f4102de0 con 0x7f00f41029d0 2024-09-21T06:03:44.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.903+0000 7f00f891e640 1 -- 172.21.15.7:0/3703011844 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f00e4042030 con 0x7f00f41029d0 2024-09-21T06:03:44.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.905+0000 7f00f891e640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00dc0b6700 0x7f00dc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:44.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.905+0000 7f00f27fc640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00dc0b6700 0x7f00dc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:44.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.905+0000 7f00f891e640 1 -- 172.21.15.7:0/3703011844 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f00e4108260 con 0x7f00f41029d0 2024-09-21T06:03:44.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.905+0000 7f00f27fc640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00dc0b6700 0x7f00dc0b8c10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f00f407ad10 tx=0x7f00e8005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:44.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:44.908+0000 7f00f891e640 1 -- 172.21.15.7:0/3703011844 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00e40ce800 con 0x7f00f41029d0 2024-09-21T06:03:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.123+0000 7f00f9920640 1 -- 172.21.15.7:0/3703011844 --> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f00f4063800 con 0x7f00dc0b6700 2024-09-21T06:03:45.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.132+0000 7f00f891e640 1 -- 172.21.15.7:0/3703011844 <== mgr.14223 v2:172.21.15.7:6800/2451017072 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f00f4063800 con 0x7f00dc0b6700 2024-09-21T06:03:45.134 INFO:teuthology.orchestra.run.smithi007.stdout:/ 1m 6m3h 2024-09-21T06:03:45.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.134+0000 7f00f9920640 1 -- 172.21.15.7:0/3703011844 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00dc0b6700 msgr2=0x7f00dc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:45.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.134+0000 7f00f9920640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00dc0b6700 0x7f00dc0b8c10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f00f407ad10 tx=0x7f00e8005e50 comp rx=0 tx=0).stop 2024-09-21T06:03:45.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.134+0000 7f00f9920640 1 -- 172.21.15.7:0/3703011844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f41029d0 msgr2=0x7f00f41992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:45.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.134+0000 7f00f9920640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f41029d0 0x7f00f41992f0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f00e4005940 tx=0x7f00e40042f0 comp rx=0 tx=0).stop 2024-09-21T06:03:45.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.134+0000 7f00f9920640 1 -- 172.21.15.7:0/3703011844 shutdown_connections 2024-09-21T06:03:45.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.134+0000 7f00f9920640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f00dc0b6700 0x7f00dc0b8c10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:45.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.134+0000 7f00f9920640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00f4108c50 0x7f00f419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:45.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.134+0000 7f00f9920640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00f4108300 0x7f00f4199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:45.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.134+0000 7f00f9920640 1 --2- 172.21.15.7:0/3703011844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00f41029d0 0x7f00f41992f0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:45.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.134+0000 7f00f9920640 1 -- 172.21.15.7:0/3703011844 >> 172.21.15.7:0/3703011844 conn(0x7f00f407a710 msgr2=0x7f00f4101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:45.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.134+0000 7f00f9920640 1 -- 172.21.15.7:0/3703011844 shutdown_connections 2024-09-21T06:03:45.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:03:45.134+0000 7f00f9920640 1 -- 172.21.15.7:0/3703011844 wait complete. 2024-09-21T06:03:45.148 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T06:03:45.162 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T06:03:46.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:46 smithi027 ceph-mon[34364]: pgmap v622: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:03:46.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:46 smithi027 ceph-mon[34364]: from='client.18345 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:46.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:46 smithi027 ceph-mon[34364]: from='client.18351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:46.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:46 smithi007 ceph-mon[30983]: pgmap v622: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:03:46.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:46 smithi007 ceph-mon[30983]: from='client.18345 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:46.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:46 smithi007 ceph-mon[30983]: from='client.18351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:46.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:46 smithi119 ceph-mon[34833]: pgmap v622: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:03:46.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:46 smithi119 ceph-mon[34833]: from='client.18345 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:46.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:46 smithi119 ceph-mon[34833]: from='client.18351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:48.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:48 smithi027 ceph-mon[34364]: pgmap v623: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T06:03:48.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:48 smithi007 ceph-mon[30983]: pgmap v623: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T06:03:48.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:48 smithi119 ceph-mon[34833]: pgmap v623: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T06:03:50.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:50 smithi027 ceph-mon[34364]: pgmap v624: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:03:50.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:50 smithi007 ceph-mon[30983]: pgmap v624: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:03:50.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:50 smithi119 ceph-mon[34833]: pgmap v624: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:03:52.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:52 smithi027 ceph-mon[34364]: pgmap v625: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:03:52.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:52 smithi007 ceph-mon[30983]: pgmap v625: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:03:52.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:52 smithi119 ceph-mon[34833]: pgmap v625: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:03:54.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:54 smithi027 ceph-mon[34364]: pgmap v626: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:03:54.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:54 smithi007 ceph-mon[30983]: pgmap v626: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:03:54.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:54 smithi119 ceph-mon[34833]: pgmap v626: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:03:56.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:56 smithi027 ceph-mon[34364]: pgmap v627: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T06:03:56.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:56 smithi007 ceph-mon[30983]: pgmap v627: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T06:03:56.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:56 smithi119 ceph-mon[34833]: pgmap v627: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T06:03:58.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:03:58 smithi027 ceph-mon[34364]: pgmap v628: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:03:58.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:03:58 smithi007 ceph-mon[30983]: pgmap v628: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:03:58.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:03:58 smithi119 ceph-mon[34833]: pgmap v628: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:03:59.562 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:03:59.835 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:00.267 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:00 smithi007 ceph-mon[30983]: pgmap v629: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:04:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.278+0000 7f9605fc8640 1 -- 172.21.15.7:0/3787090023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9600103140 msgr2=0x7f9600103550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.278+0000 7f9605fc8640 1 --2- 172.21.15.7:0/3787090023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9600103140 0x7f9600103550 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009900 tx=0x7f95f002a410 comp rx=0 tx=0).stop 2024-09-21T06:04:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.278+0000 7f9605fc8640 1 -- 172.21.15.7:0/3787090023 shutdown_connections 2024-09-21T06:04:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.278+0000 7f9605fc8640 1 --2- 172.21.15.7:0/3787090023 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9600108d00 0x7f960010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.278+0000 7f9605fc8640 1 --2- 172.21.15.7:0/3787090023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96001083b0 0x7f96001087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.278+0000 7f9605fc8640 1 --2- 172.21.15.7:0/3787090023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9600103140 0x7f9600103550 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.278+0000 7f9605fc8640 1 -- 172.21.15.7:0/3787090023 >> 172.21.15.7:0/3787090023 conn(0x7f9600077c60 msgr2=0x7f96000780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.278+0000 7f9605fc8640 1 -- 172.21.15.7:0/3787090023 shutdown_connections 2024-09-21T06:04:00.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.278+0000 7f9605fc8640 1 -- 172.21.15.7:0/3787090023 wait complete. 2024-09-21T06:04:00.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.279+0000 7f9605fc8640 1 Processor -- start 2024-09-21T06:04:00.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.279+0000 7f9605fc8640 1 -- start start 2024-09-21T06:04:00.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.279+0000 7f9605fc8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9600103140 0x7f9600199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.279+0000 7f9605fc8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96001083b0 0x7f96001999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.279+0000 7f9605fc8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9600108d00 0x7f960019ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.279+0000 7f9605fc8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96001129c0 con 0x7f96001083b0 2024-09-21T06:04:00.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.279+0000 7f9605fc8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9600112840 con 0x7f9600103140 2024-09-21T06:04:00.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.279+0000 7f9605fc8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9600112b40 con 0x7f9600108d00 2024-09-21T06:04:00.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.280+0000 7f95ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96001083b0 0x7f96001999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.280+0000 7f95f77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9600103140 0x7f9600199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.280+0000 7f95ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96001083b0 0x7f96001999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42378/0 (socket says 172.21.15.7:42378) 2024-09-21T06:04:00.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.280+0000 7f95ff7fe640 1 -- 172.21.15.7:0/1597072493 learned_addr learned my addr 172.21.15.7:0/1597072493 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:00.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.280+0000 7f95fffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9600108d00 0x7f960019ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.280+0000 7f95fffff640 1 -- 172.21.15.7:0/1597072493 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9600103140 msgr2=0x7f9600199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.280+0000 7f95fffff640 1 --2- 172.21.15.7:0/1597072493 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9600103140 0x7f9600199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.280+0000 7f95fffff640 1 -- 172.21.15.7:0/1597072493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96001083b0 msgr2=0x7f96001999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.280+0000 7f95fffff640 1 --2- 172.21.15.7:0/1597072493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96001083b0 0x7f96001999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.280+0000 7f95fffff640 1 -- 172.21.15.7:0/1597072493 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960019f3a0 con 0x7f9600108d00 2024-09-21T06:04:00.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.280+0000 7f95fffff640 1 --2- 172.21.15.7:0/1597072493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9600108d00 0x7f960019ec70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009fd0 tx=0x7f95f800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.281+0000 7f95fd7fa640 1 -- 172.21.15.7:0/1597072493 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f800ce20 con 0x7f9600108d00 2024-09-21T06:04:00.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.281+0000 7f95fd7fa640 1 -- 172.21.15.7:0/1597072493 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95f8005020 con 0x7f9600108d00 2024-09-21T06:04:00.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.281+0000 7f95fd7fa640 1 -- 172.21.15.7:0/1597072493 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8010690 con 0x7f9600108d00 2024-09-21T06:04:00.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.281+0000 7f9605fc8640 1 -- 172.21.15.7:0/1597072493 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f960019f690 con 0x7f9600108d00 2024-09-21T06:04:00.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.281+0000 7f9605fc8640 1 -- 172.21.15.7:0/1597072493 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9600101da0 con 0x7f9600108d00 2024-09-21T06:04:00.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.284+0000 7f960c53c740 1 Processor -- start 2024-09-21T06:04:00.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.284+0000 7f95fd7fa640 1 -- 172.21.15.7:0/1597072493 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f95f80054d0 con 0x7f9600108d00 2024-09-21T06:04:00.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.284+0000 7f960c53c740 1 -- start start 2024-09-21T06:04:00.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.284+0000 7f960c53c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2293070 0x5623e263a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.284+0000 7f960c53c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e226a1b0 0x5623e263ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.284+0000 7f960c53c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e2272390 0x5623e263b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f960c53c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5623e25b0e50 con 0x5623e2293070 2024-09-21T06:04:00.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f960c53c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5623e25a0280 con 0x5623e2272390 2024-09-21T06:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f960c53c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5623e25a4090 con 0x5623e226a1b0 2024-09-21T06:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f95ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2293070 0x5623e263a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f95ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2293070 0x5623e263a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42384/0 (socket says 172.21.15.7:42384) 2024-09-21T06:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f95ff7fe640 1 -- 172.21.15.7:0/407210511 learned_addr learned my addr 172.21.15.7:0/407210511 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f95f77fe640 1 --2- 172.21.15.7:0/407210511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e226a1b0 0x5623e263ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f95ff7fe640 1 --2- 172.21.15.7:0/407210511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e2272390 0x5623e263b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f95fd7fa640 1 --2- 172.21.15.7:0/1597072493 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f95ec0b6700 0x7f95ec0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f95f77fe640 1 -- 172.21.15.7:0/407210511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e2272390 msgr2=0x5623e263b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f95f77fe640 1 --2- 172.21.15.7:0/407210511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e2272390 0x5623e263b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f95f77fe640 1 -- 172.21.15.7:0/407210511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2293070 msgr2=0x5623e263a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f95f77fe640 1 --2- 172.21.15.7:0/407210511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2293070 0x5623e263a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f95f77fe640 1 -- 172.21.15.7:0/407210511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e22fe650 con 0x5623e226a1b0 2024-09-21T06:04:00.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f95fffff640 1 --2- 172.21.15.7:0/1597072493 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f95ec0b6700 0x7f95ec0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.285+0000 7f95ff7fe640 1 --2- 172.21.15.7:0/407210511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2293070 0x5623e263a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:00.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.286+0000 7f95f77fe640 1 --2- 172.21.15.7:0/407210511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e226a1b0 0x5623e263ab90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009230 tx=0x7f95f0032b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82df9f35c31eb7c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.286+0000 7f95fd7fa640 1 -- 172.21.15.7:0/1597072493 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f95f80e7d70 con 0x7f9600108d00 2024-09-21T06:04:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.286+0000 7f95f5ffb640 1 -- 172.21.15.7:0/407210511 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0040070 con 0x5623e226a1b0 2024-09-21T06:04:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.286+0000 7f95f5ffb640 1 -- 172.21.15.7:0/407210511 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95f0004030 con 0x5623e226a1b0 2024-09-21T06:04:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.286+0000 7f95fffff640 1 --2- 172.21.15.7:0/1597072493 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f95ec0b6700 0x7f95ec0b8c10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f95f80aa370 tx=0x7f95f80aa300 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.286+0000 7f95f5ffb640 1 -- 172.21.15.7:0/407210511 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0035040 con 0x5623e226a1b0 2024-09-21T06:04:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.287+0000 7f960c53c740 1 -- 172.21.15.7:0/407210511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e226a1b0 msgr2=0x5623e263ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.287+0000 7f960c53c740 1 --2- 172.21.15.7:0/407210511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e226a1b0 0x5623e263ab90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009230 tx=0x7f95f0032b90 comp rx=0 tx=0).stop 2024-09-21T06:04:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.287+0000 7f960c53c740 1 -- 172.21.15.7:0/407210511 shutdown_connections 2024-09-21T06:04:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.287+0000 7f960c53c740 1 --2- 172.21.15.7:0/407210511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e2272390 0x5623e263b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.287+0000 7f960c53c740 1 --2- 172.21.15.7:0/407210511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e226a1b0 0x5623e263ab90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.287+0000 7f960c53c740 1 --2- 172.21.15.7:0/407210511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2293070 0x5623e263a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.287+0000 7f960c53c740 1 -- 172.21.15.7:0/407210511 >> 172.21.15.7:0/407210511 conn(0x5623e2287460 msgr2=0x5623e2638540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.287+0000 7f960c53c740 1 -- 172.21.15.7:0/407210511 shutdown_connections 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.287+0000 7f960c53c740 1 -- 172.21.15.7:0/407210511 wait complete. 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.288+0000 7f960c53c740 1 -- start start 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.288+0000 7f960c53c740 1 Processor -- start 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.288+0000 7f960c53c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e226a1b0 0x5623e2645d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.288+0000 7f960c53c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2272390 0x5623e2646280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.288+0000 7f960c53c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2293070 0x5623e26520c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f960c53c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5623e2401700 con 0x5623e2293070 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f960c53c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5623e253b110 con 0x5623e226a1b0 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f960c53c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5623e2648dd0 con 0x5623e2272390 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95ff7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e226a1b0 0x5623e2645d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95ff7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e226a1b0 0x5623e2645d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:55346/0 (socket says 172.21.15.7:55346) 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95ff7fe640 1 -- 172.21.15.7:0/1689821842 learned_addr learned my addr 172.21.15.7:0/1689821842 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95f77fe640 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2272390 0x5623e2646280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f960c53c740 10 client.0 _ll_register_callbacks cb 0x5623e2554990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95ff7fe640 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2293070 0x5623e26520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95f77fe640 1 -- 172.21.15.7:0/1689821842 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e226a1b0 msgr2=0x5623e2645d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95f77fe640 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e226a1b0 0x5623e2645d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95f77fe640 1 -- 172.21.15.7:0/1689821842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2293070 msgr2=0x5623e26520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95f77fe640 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2293070 0x5623e26520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95f77fe640 1 -- 172.21.15.7:0/1689821842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e2568c40 con 0x5623e2272390 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95ff7fe640 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2293070 0x5623e26520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95f77fe640 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2272390 0x5623e2646280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x5623e26392d0 tx=0x7f95f0004410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e34e68cc544e6a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95deffd640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.289+0000 7f95deffd640 1 -- 172.21.15.7:0/1689821842 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0035070 con 0x5623e2272390 2024-09-21T06:04:00.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.290+0000 7f95deffd640 1 -- 172.21.15.7:0/1689821842 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f95f00318b0 con 0x5623e2272390 2024-09-21T06:04:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.290+0000 7f960c53c740 1 -- 172.21.15.7:0/1689821842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95f0004030 con 0x5623e2272390 2024-09-21T06:04:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.290+0000 7f95deffd640 1 -- 172.21.15.7:0/1689821842 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95f0040040 con 0x5623e2272390 2024-09-21T06:04:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.290+0000 7f960c53c740 10 client.27535 fetch_fsmap learned FSMap version 25 2024-09-21T06:04:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.290+0000 7f960c53c740 1 -- 172.21.15.7:0/1689821842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5623e2654b10 con 0x5623e2272390 2024-09-21T06:04:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.290+0000 7f95deffd640 1 -- 172.21.15.7:0/1689821842 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95f0004030 con 0x5623e2272390 2024-09-21T06:04:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.290+0000 7f95deffd640 1 -- 172.21.15.7:0/1689821842 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95f0004cd0 con 0x5623e2272390 2024-09-21T06:04:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.290+0000 7f960c53c740 10 client.27535 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:04:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.290+0000 7f960c53c740 10 client.27535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:04:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.290+0000 7f960c53c740 20 client.27535 populate_metadata read hostname 'smithi007' 2024-09-21T06:04:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.290+0000 7f960c53c740 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5623e22519f0 0x5623e2657e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.290+0000 7f960c53c740 4 client.27535 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:04:00.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.290+0000 7f960c53c740 1 -- 172.21.15.7:0/1689821842 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623e25b2da0 con 0x5623e22519f0 2024-09-21T06:04:00.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.291+0000 7f95ff7fe640 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5623e22519f0 0x5623e2657e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.291+0000 7f95deffd640 10 client.27535 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:04:00.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.291+0000 7f95ff7fe640 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5623e22519f0 0x5623e2657e70 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d26b7ec554f51deb server_cookie=ca0045e387dafdf4 in_seq=0 out_seq=0 2024-09-21T06:04:00.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f95deffd640 1 -- 172.21.15.7:0/1689821842 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623e25b2da0 con 0x5623e22519f0 2024-09-21T06:04:00.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f95deffd640 10 client.27535 handle_command_reply: tid=0 2024-09-21T06:04:00.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f960c53c740 1 client.27535 shutdown 2024-09-21T06:04:00.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f960c53c740 1 -- 172.21.15.7:0/1689821842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2272390 msgr2=0x5623e2646280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f960c53c740 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2272390 0x5623e2646280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x5623e26392d0 tx=0x7f95f0004410 comp rx=0 tx=0).stop 2024-09-21T06:04:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f960c53c740 1 -- 172.21.15.7:0/1689821842 shutdown_connections 2024-09-21T06:04:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f960c53c740 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5623e22519f0 0x5623e2657e70 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f960c53c740 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2293070 0x5623e26520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f960c53c740 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2272390 0x5623e2646280 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f960c53c740 1 --2- 172.21.15.7:0/1689821842 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e226a1b0 0x5623e2645d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f960c53c740 1 -- 172.21.15.7:0/1689821842 >> 172.21.15.7:0/1689821842 conn(0x5623e2287460 msgr2=0x5623e263d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f95deffd640 0 client.27535 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:04:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f960c53c740 1 -- 172.21.15.7:0/1689821842 shutdown_connections 2024-09-21T06:04:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f960c53c740 1 -- 172.21.15.7:0/1689821842 wait complete. 2024-09-21T06:04:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.292+0000 7f960c53c740 20 client.27535 trim_cache size 0 max 16384 2024-09-21T06:04:00.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.312+0000 7f960c53c740 1 Processor -- start 2024-09-21T06:04:00.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f960c53c740 1 -- start start 2024-09-21T06:04:00.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f960c53c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e226a1b0 0x5623e2638570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f960c53c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2272390 0x5623e2652030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f960c53c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2293070 0x5623e263d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f960c53c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96001afc70 con 0x5623e2272390 2024-09-21T06:04:00.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f960c53c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f96001ad540 con 0x5623e226a1b0 2024-09-21T06:04:00.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f960c53c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96001ab3b0 con 0x5623e2293070 2024-09-21T06:04:00.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f95f77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2272390 0x5623e2652030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f95f77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2272390 0x5623e2652030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42398/0 (socket says 172.21.15.7:42398) 2024-09-21T06:04:00.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f95f77fe640 1 -- 172.21.15.7:0/2335124921 learned_addr learned my addr 172.21.15.7:0/2335124921 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:00.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f95ff7fe640 1 --2- 172.21.15.7:0/2335124921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e226a1b0 0x5623e2638570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f95ff7fe640 1 --2- 172.21.15.7:0/2335124921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2293070 0x5623e263d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f95f77fe640 1 -- 172.21.15.7:0/2335124921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2293070 msgr2=0x5623e263d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:00.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f95f77fe640 1 --2- 172.21.15.7:0/2335124921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2293070 0x5623e263d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f95f77fe640 1 -- 172.21.15.7:0/2335124921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e226a1b0 msgr2=0x5623e2638570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:00.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f95f77fe640 1 --2- 172.21.15.7:0/2335124921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e226a1b0 0x5623e2638570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f95f77fe640 1 -- 172.21.15.7:0/2335124921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e2647000 con 0x5623e2272390 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.313+0000 7f95ff7fe640 1 --2- 172.21.15.7:0/2335124921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2293070 0x5623e263d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.314+0000 7f95f77fe640 1 --2- 172.21.15.7:0/2335124921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2272390 0x5623e2652030 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f95f002a930 tx=0x7f95f0031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb329dc46360ebb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.314+0000 7f95f57fa640 1 -- 172.21.15.7:0/2335124921 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0035040 con 0x5623e2272390 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.314+0000 7f95f57fa640 1 -- 172.21.15.7:0/2335124921 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95f00318b0 con 0x5623e2272390 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.314+0000 7f95f57fa640 1 -- 172.21.15.7:0/2335124921 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0004900 con 0x5623e2272390 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.315+0000 7f960c53c740 1 -- 172.21.15.7:0/2335124921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2272390 msgr2=0x5623e2652030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.315+0000 7f960c53c740 1 --2- 172.21.15.7:0/2335124921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2272390 0x5623e2652030 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f95f002a930 tx=0x7f95f0031400 comp rx=0 tx=0).stop 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.315+0000 7f960c53c740 1 -- 172.21.15.7:0/2335124921 shutdown_connections 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.315+0000 7f960c53c740 1 --2- 172.21.15.7:0/2335124921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e2272390 0x5623e2652030 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.315+0000 7f960c53c740 1 --2- 172.21.15.7:0/2335124921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2293070 0x5623e263d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.315+0000 7f960c53c740 1 --2- 172.21.15.7:0/2335124921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e226a1b0 0x5623e2638570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.315+0000 7f960c53c740 1 -- 172.21.15.7:0/2335124921 >> 172.21.15.7:0/2335124921 conn(0x5623e2287460 msgr2=0x5623e2637e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.315+0000 7f960c53c740 1 -- 172.21.15.7:0/2335124921 shutdown_connections 2024-09-21T06:04:00.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.315+0000 7f960c53c740 1 -- 172.21.15.7:0/2335124921 wait complete. 2024-09-21T06:04:00.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f960c53c740 1 -- start start 2024-09-21T06:04:00.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f960c53c740 1 Processor -- start 2024-09-21T06:04:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f960c53c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e226a1b0 0x5623e265b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f960c53c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2272390 0x5623e2658cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f960c53c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e2293070 0x5623e2659350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f960c53c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96001aba00 con 0x5623e226a1b0 2024-09-21T06:04:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f960c53c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f96001ace70 con 0x5623e2293070 2024-09-21T06:04:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f960c53c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96001ac0d0 con 0x5623e2272390 2024-09-21T06:04:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f960c53c740 10 client.0 _ll_register_callbacks cb 0x7f95f0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f95ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e226a1b0 0x5623e265b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f95f77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2272390 0x5623e2658cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f95ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e226a1b0 0x5623e265b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42402/0 (socket says 172.21.15.7:42402) 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f95ff7fe640 1 -- 172.21.15.7:0/2214142724 learned_addr learned my addr 172.21.15.7:0/2214142724 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.316+0000 7f95ff7fe640 1 --2- 172.21.15.7:0/2214142724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e2293070 0x5623e2659350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f95ff7fe640 1 -- 172.21.15.7:0/2214142724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2272390 msgr2=0x5623e2658cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f95ff7fe640 1 --2- 172.21.15.7:0/2214142724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2272390 0x5623e2658cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f95ff7fe640 1 -- 172.21.15.7:0/2214142724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e2293070 msgr2=0x5623e2659350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f95ff7fe640 1 --2- 172.21.15.7:0/2214142724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e2293070 0x5623e2659350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f95ff7fe640 1 -- 172.21.15.7:0/2214142724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e2659ae0 con 0x5623e226a1b0 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f95f77fe640 1 --2- 172.21.15.7:0/2214142724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2272390 0x5623e2658cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f95ff7fe640 1 --2- 172.21.15.7:0/2214142724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e226a1b0 0x5623e265b7e0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x5623e25a41b0 tx=0x7f95e8015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9cabc21b2f4249 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f95deffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f95deffd640 1 -- 172.21.15.7:0/2214142724 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e8028040 con 0x5623e226a1b0 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f95deffd640 1 -- 172.21.15.7:0/2214142724 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f95e8012ba0 con 0x5623e226a1b0 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f960c53c740 1 -- 172.21.15.7:0/2214142724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95f00318b0 con 0x5623e226a1b0 2024-09-21T06:04:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f95deffd640 1 -- 172.21.15.7:0/2214142724 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95e801f8e0 con 0x5623e226a1b0 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f960c53c740 10 client.18369 fetch_fsmap learned FSMap version 25 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.317+0000 7f960c53c740 1 -- 172.21.15.7:0/2214142724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5623e26c26e0 con 0x5623e226a1b0 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.318+0000 7f95deffd640 1 -- 172.21.15.7:0/2214142724 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95f00318b0 con 0x5623e226a1b0 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.318+0000 7f95deffd640 1 -- 172.21.15.7:0/2214142724 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95e8033060 con 0x5623e226a1b0 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.318+0000 7f960c53c740 10 client.18369 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.318+0000 7f960c53c740 10 client.18369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.318+0000 7f960c53c740 20 client.18369 populate_metadata read hostname 'smithi007' 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.318+0000 7f960c53c740 1 --2- 172.21.15.7:0/2214142724 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5623e2226da0 0x5623e26c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.318+0000 7f960c53c740 4 client.18369 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.318+0000 7f960c53c740 1 -- 172.21.15.7:0/2214142724 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5623e26418f0 con 0x5623e2226da0 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.318+0000 7f95f77fe640 1 --2- 172.21.15.7:0/2214142724 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5623e2226da0 0x5623e26c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f95f77fe640 1 --2- 172.21.15.7:0/2214142724 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5623e2226da0 0x5623e26c4ed0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8521855722ee6440 server_cookie=6b0909ab9091441c in_seq=0 out_seq=0 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f95deffd640 10 client.18369 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f95deffd640 1 -- 172.21.15.7:0/2214142724 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7758 (crc 0 0 0) 0x5623e26418f0 con 0x5623e2226da0 2024-09-21T06:04:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f95deffd640 10 client.18369 handle_command_reply: tid=0 2024-09-21T06:04:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f960c53c740 1 client.18369 shutdown 2024-09-21T06:04:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f960c53c740 1 -- 172.21.15.7:0/2214142724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e226a1b0 msgr2=0x5623e265b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f960c53c740 1 --2- 172.21.15.7:0/2214142724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e226a1b0 0x5623e265b7e0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x5623e25a41b0 tx=0x7f95e8015040 comp rx=0 tx=0).stop 2024-09-21T06:04:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f960c53c740 1 -- 172.21.15.7:0/2214142724 shutdown_connections 2024-09-21T06:04:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f960c53c740 1 --2- 172.21.15.7:0/2214142724 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5623e2226da0 0x5623e26c4ed0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f960c53c740 1 --2- 172.21.15.7:0/2214142724 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5623e2293070 0x5623e2659350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f95deffd640 0 client.18369 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:04:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f960c53c740 1 --2- 172.21.15.7:0/2214142724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5623e2272390 0x5623e2658cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f960c53c740 1 --2- 172.21.15.7:0/2214142724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623e226a1b0 0x5623e265b7e0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f960c53c740 1 -- 172.21.15.7:0/2214142724 >> 172.21.15.7:0/2214142724 conn(0x5623e2287460 msgr2=0x5623e263d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f960c53c740 1 -- 172.21.15.7:0/2214142724 shutdown_connections 2024-09-21T06:04:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.319+0000 7f960c53c740 1 -- 172.21.15.7:0/2214142724 wait complete. 2024-09-21T06:04:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.320+0000 7f960c53c740 20 client.18369 trim_cache size 0 max 16384 2024-09-21T06:04:00.326 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:04:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:04:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:04:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:04:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "40df47a2-fbba-49bc-a842-15ce641cb6ee": { 2024-09-21T06:04:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:03:17.234445+0000", 2024-09-21T06:04:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "1d89aa12-56bd-49e8-bbd4-0309b4e70f2a": { 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:02:56.375957+0000", 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "46ad69b3-ef90-42e0-a57b-ea33e3ef74ab": { 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:32.287019+0000", 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "d9b96838-732e-40a1-9fad-f54faef73b59": { 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:21.774276+0000", 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "fd9e7ebd-b70a-487f-937b-80b64378d04b": { 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:11.755521+0000", 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "3bd778db-a0ed-42ad-8a79-14a200f0734e": { 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:51.556015+0000", 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "b9604e01-6d58-4b44-8781-0b517ac24064": { 2024-09-21T06:04:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:31.374508+0000", 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "9ca9a0b5-d25e-483b-95ac-20cce2a306c9": { 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:11.618991+0000", 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "f5c9a9cd-a1fc-4e1a-8442-f7c676fc4489": { 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:03:06.938698+0000", 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "f1184167-1a52-4b53-a7c1-bf937ae62179": { 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:53:43.198442+0000", 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "8b32a028-2f13-4c77-ae0f-9f6b2c5403ea": { 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:49.194007+0000", 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "9891a47c-baed-4663-96d7-95a281bed3f4": { 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:54:25.632416+0000", 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "438db71b-3351-4115-a5b5-9aa0035a3911": { 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:50.277366+0000", 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "ecf3518d-a174-4cee-89a1-6aa26e1b3442": { 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:01:01.909762+0000", 2024-09-21T06:04:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "3fee69f3-7fc1-4cbb-b29c-0adb2cc05e9a": { 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:55:08.018391+0000", 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "b3113b80-a15f-4fb0-9571-c99baad2936b": { 2024-09-21T06:04:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:56.381296+0000", 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "45555fc5-f980-4215-8c2e-8c90fd64f21e": { 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:03:27.371196+0000", 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "d0e9a5a2-105e-4374-8ece-18bc245b9a3e": { 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:21.326754+0000", 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "12e61c0d-1a70-41a3-866b-f7684d2cfdf0": { 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:30.991984+0000", 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "549be0a1-71cf-47fc-82a9-6f66cf789bca": { 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:56:32.420342+0000", 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "1c540995-232b-4bec-918f-a55f2761d274": { 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:58:07.347029+0000", 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "f7f81a98-cc78-407c-94cf-8aef91132db7": { 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:51.239489+0000", 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "fdd4afdc-f082-47dc-98c6-4396302d0e88": { 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:01.586236+0000", 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "a9901d9b-aa10-4587-83ff-d32730ff12ea": { 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:02:14.695980+0000", 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "960318d1-28a1-4ab7-bf0e-c215d0fb4f21": { 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:00:41.252267+0000", 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "64dcdb40-1029-4909-9044-77c05eff7591": { 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:57:14.335321+0000", 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "92761daf-6b32-43df-8c0e-72651e531a59": { 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T05:59:41.052738+0000", 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:04:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:04:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:00.341 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:04:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.320+0000 7f9605fc8640 1 -- 172.21.15.7:0/1597072493 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f95ec0b6700 msgr2=0x7f95ec0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.320+0000 7f9605fc8640 1 --2- 172.21.15.7:0/1597072493 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f95ec0b6700 0x7f95ec0b8c10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f95f80aa370 tx=0x7f95f80aa300 comp rx=0 tx=0).stop 2024-09-21T06:04:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.320+0000 7f9605fc8640 1 -- 172.21.15.7:0/1597072493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9600108d00 msgr2=0x7f960019ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.320+0000 7f9605fc8640 1 --2- 172.21.15.7:0/1597072493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9600108d00 0x7f960019ec70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009fd0 tx=0x7f95f800ef10 comp rx=0 tx=0).stop 2024-09-21T06:04:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.320+0000 7f9605fc8640 1 -- 172.21.15.7:0/1597072493 shutdown_connections 2024-09-21T06:04:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.320+0000 7f9605fc8640 1 --2- 172.21.15.7:0/1597072493 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f95ec0b6700 0x7f95ec0b8c10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.320+0000 7f9605fc8640 1 --2- 172.21.15.7:0/1597072493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96001083b0 0x7f96001999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.320+0000 7f9605fc8640 1 --2- 172.21.15.7:0/1597072493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9600108d00 0x7f960019ec70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.320+0000 7f9605fc8640 1 --2- 172.21.15.7:0/1597072493 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9600103140 0x7f9600199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.320+0000 7f9605fc8640 1 -- 172.21.15.7:0/1597072493 >> 172.21.15.7:0/1597072493 conn(0x7f9600077c60 msgr2=0x7f96001064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.320+0000 7f9605fc8640 1 -- 172.21.15.7:0/1597072493 shutdown_connections 2024-09-21T06:04:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:00.320+0000 7f9605fc8640 1 -- 172.21.15.7:0/1597072493 wait complete. 2024-09-21T06:04:00.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:00 smithi027 ceph-mon[34364]: pgmap v629: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:04:00.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:00 smithi119 ceph-mon[34833]: pgmap v629: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:04:01.219 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:04:01.219 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:04:01.485 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:01.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.943+0000 7f725c4a1640 1 -- 172.21.15.7:0/3278061682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72541094a0 msgr2=0x7f72541098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.943+0000 7f725c4a1640 1 --2- 172.21.15.7:0/3278061682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72541094a0 0x7f72541098b0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7248009900 tx=0x7f724802a410 comp rx=0 tx=0).stop 2024-09-21T06:04:01.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.943+0000 7f725c4a1640 1 -- 172.21.15.7:0/3278061682 shutdown_connections 2024-09-21T06:04:01.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.943+0000 7f725c4a1640 1 --2- 172.21.15.7:0/3278061682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72541094a0 0x7f72541098b0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.943+0000 7f725c4a1640 1 --2- 172.21.15.7:0/3278061682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7254109df0 0x7f7254110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.943+0000 7f725c4a1640 1 --2- 172.21.15.7:0/3278061682 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7254103b60 0x7f7254103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.943+0000 7f725c4a1640 1 -- 172.21.15.7:0/3278061682 >> 172.21.15.7:0/3278061682 conn(0x7f725407b850 msgr2=0x7f725407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.943+0000 7f725c4a1640 1 -- 172.21.15.7:0/3278061682 shutdown_connections 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.943+0000 7f725c4a1640 1 -- 172.21.15.7:0/3278061682 wait complete. 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.943+0000 7f725c4a1640 1 Processor -- start 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725c4a1640 1 -- start start 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725c4a1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7254103b60 0x7f7254075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725c4a1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72541094a0 0x7f7254075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725c4a1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7254109df0 0x7f7254076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725c4a1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7254113ab0 con 0x7f7254103b60 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725c4a1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7254113930 con 0x7f72541094a0 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725c4a1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7254113c30 con 0x7f7254109df0 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725a23d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7254103b60 0x7f7254075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725a23d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7254103b60 0x7f7254075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42414/0 (socket says 172.21.15.7:42414) 2024-09-21T06:04:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725a23d640 1 -- 172.21.15.7:0/2868047495 learned_addr learned my addr 172.21.15.7:0/2868047495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f7259a3c640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72541094a0 0x7f7254075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725aa3e640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7254109df0 0x7f7254076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725a23d640 1 -- 172.21.15.7:0/2868047495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7254109df0 msgr2=0x7f7254076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725a23d640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7254109df0 0x7f7254076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725a23d640 1 -- 172.21.15.7:0/2868047495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72541094a0 msgr2=0x7f7254075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725a23d640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72541094a0 0x7f7254075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725a23d640 1 -- 172.21.15.7:0/2868047495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72541a8740 con 0x7f7254103b60 2024-09-21T06:04:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.944+0000 7f725a23d640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7254103b60 0x7f7254075710 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f725000eab0 tx=0x7f725000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.945+0000 7f72477fe640 1 -- 172.21.15.7:0/2868047495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725000ce40 con 0x7f7254103b60 2024-09-21T06:04:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.945+0000 7f72477fe640 1 -- 172.21.15.7:0/2868047495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7250011920 con 0x7f7254103b60 2024-09-21T06:04:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.945+0000 7f725c4a1640 1 -- 172.21.15.7:0/2868047495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72541a8a30 con 0x7f7254103b60 2024-09-21T06:04:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.945+0000 7f72477fe640 1 -- 172.21.15.7:0/2868047495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250010a30 con 0x7f7254103b60 2024-09-21T06:04:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.945+0000 7f725c4a1640 1 -- 172.21.15.7:0/2868047495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72541a8f40 con 0x7f7254103b60 2024-09-21T06:04:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.946+0000 7f725c4a1640 1 -- 172.21.15.7:0/2868047495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7254103f70 con 0x7f7254103b60 2024-09-21T06:04:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.947+0000 7f72477fe640 1 -- 172.21.15.7:0/2868047495 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7250010bd0 con 0x7f7254103b60 2024-09-21T06:04:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.948+0000 7f72477fe640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f72400b6680 0x7f72400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.948+0000 7f7259a3c640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f72400b6680 0x7f72400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.948+0000 7f72477fe640 1 -- 172.21.15.7:0/2868047495 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f72500e7de0 con 0x7f7254103b60 2024-09-21T06:04:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.949+0000 7f7259a3c640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f72400b6680 0x7f72400b8b90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7248009230 tx=0x7f7248031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:01.953+0000 7f72477fe640 1 -- 172.21.15.7:0/2868047495 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7250016030 con 0x7f7254103b60 2024-09-21T06:04:02.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.183+0000 7f725c4a1640 1 -- 172.21.15.7:0/2868047495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f725402e640 con 0x7f7254103b60 2024-09-21T06:04:02.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.184+0000 7f72477fe640 1 -- 172.21.15.7:0/2868047495 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f72500ae380 con 0x7f7254103b60 2024-09-21T06:04:02.186 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:04:02.186 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:04:02.186 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:04:02.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.186+0000 7f725c4a1640 1 -- 172.21.15.7:0/2868047495 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f72400b6680 msgr2=0x7f72400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:02.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.186+0000 7f725c4a1640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f72400b6680 0x7f72400b8b90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7248009230 tx=0x7f7248031400 comp rx=0 tx=0).stop 2024-09-21T06:04:02.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.186+0000 7f725c4a1640 1 -- 172.21.15.7:0/2868047495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7254103b60 msgr2=0x7f7254075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:02.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.186+0000 7f725c4a1640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7254103b60 0x7f7254075710 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f725000eab0 tx=0x7f725000ef70 comp rx=0 tx=0).stop 2024-09-21T06:04:02.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.186+0000 7f725c4a1640 1 -- 172.21.15.7:0/2868047495 shutdown_connections 2024-09-21T06:04:02.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.186+0000 7f725c4a1640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f72400b6680 0x7f72400b8b90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.186+0000 7f725c4a1640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7254109df0 0x7f7254076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.186+0000 7f725c4a1640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72541094a0 0x7f7254075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.186+0000 7f725c4a1640 1 --2- 172.21.15.7:0/2868047495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7254103b60 0x7f7254075710 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.186+0000 7f725c4a1640 1 -- 172.21.15.7:0/2868047495 >> 172.21.15.7:0/2868047495 conn(0x7f725407b850 msgr2=0x7f7254107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:02.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.186+0000 7f725c4a1640 1 -- 172.21.15.7:0/2868047495 shutdown_connections 2024-09-21T06:04:02.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:02.186+0000 7f725c4a1640 1 -- 172.21.15.7:0/2868047495 wait complete. 2024-09-21T06:04:02.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:02 smithi027 ceph-mon[34364]: pgmap v630: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T06:04:02.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:02 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:02.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:02 smithi007 ceph-mon[30983]: pgmap v630: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T06:04:02.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:02.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:02 smithi119 ceph-mon[34833]: pgmap v630: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T06:04:02.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:02 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:02.864 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:04:03.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:03 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2868047495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:03.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:03 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2868047495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:03.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:03 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2868047495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:03.786 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.310+0000 7fba62d90640 1 -- 172.21.15.7:0/818509467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba5c1083b0 msgr2=0x7fba5c1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.310+0000 7fba62d90640 1 --2- 172.21.15.7:0/818509467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba5c1083b0 0x7fba5c1087c0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fba48009900 tx=0x7fba4802a410 comp rx=0 tx=0).stop 2024-09-21T06:04:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.310+0000 7fba62d90640 1 -- 172.21.15.7:0/818509467 shutdown_connections 2024-09-21T06:04:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.310+0000 7fba62d90640 1 --2- 172.21.15.7:0/818509467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba5c1083b0 0x7fba5c1087c0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.310+0000 7fba62d90640 1 --2- 172.21.15.7:0/818509467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba5c108d00 0x7fba5c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.310+0000 7fba62d90640 1 --2- 172.21.15.7:0/818509467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba5c102a70 0x7fba5c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.310+0000 7fba62d90640 1 -- 172.21.15.7:0/818509467 >> 172.21.15.7:0/818509467 conn(0x7fba5c079710 msgr2=0x7fba5c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.310+0000 7fba62d90640 1 -- 172.21.15.7:0/818509467 shutdown_connections 2024-09-21T06:04:04.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.310+0000 7fba62d90640 1 -- 172.21.15.7:0/818509467 wait complete. 2024-09-21T06:04:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.311+0000 7fba62d90640 1 Processor -- start 2024-09-21T06:04:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.311+0000 7fba62d90640 1 -- start start 2024-09-21T06:04:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.311+0000 7fba62d90640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba5c102a70 0x7fba5c19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.311+0000 7fba62d90640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba5c1083b0 0x7fba5c19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.311+0000 7fba62d90640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba5c108d00 0x7fba5c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.311+0000 7fba62d90640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1129c0 con 0x7fba5c102a70 2024-09-21T06:04:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.311+0000 7fba62d90640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c112840 con 0x7fba5c1083b0 2024-09-21T06:04:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.311+0000 7fba62d90640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c112b40 con 0x7fba5c108d00 2024-09-21T06:04:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.311+0000 7fba60b2c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba5c102a70 0x7fba5c19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.312+0000 7fba60b2c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba5c102a70 0x7fba5c19b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42436/0 (socket says 172.21.15.7:42436) 2024-09-21T06:04:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.312+0000 7fba60b2c640 1 -- 172.21.15.7:0/1667767143 learned_addr learned my addr 172.21.15.7:0/1667767143 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:04.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.312+0000 7fba5bfff640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba5c1083b0 0x7fba5c19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.312+0000 7fba6132d640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba5c108d00 0x7fba5c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.312+0000 7fba6132d640 1 -- 172.21.15.7:0/1667767143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba5c1083b0 msgr2=0x7fba5c19b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.312+0000 7fba6132d640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba5c1083b0 0x7fba5c19b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.312+0000 7fba6132d640 1 -- 172.21.15.7:0/1667767143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba5c102a70 msgr2=0x7fba5c19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.312+0000 7fba6132d640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba5c102a70 0x7fba5c19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.312+0000 7fba6132d640 1 -- 172.21.15.7:0/1667767143 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c1a6560 con 0x7fba5c108d00 2024-09-21T06:04:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.312+0000 7fba60b2c640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba5c102a70 0x7fba5c19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.312+0000 7fba6132d640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba5c108d00 0x7fba5c19bd50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fba54009fd0 tx=0x7fba5400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.313+0000 7fba59ffb640 1 -- 172.21.15.7:0/1667767143 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5400ce20 con 0x7fba5c108d00 2024-09-21T06:04:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.313+0000 7fba59ffb640 1 -- 172.21.15.7:0/1667767143 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba54005020 con 0x7fba5c108d00 2024-09-21T06:04:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.313+0000 7fba62d90640 1 -- 172.21.15.7:0/1667767143 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5c1a6850 con 0x7fba5c108d00 2024-09-21T06:04:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.313+0000 7fba59ffb640 1 -- 172.21.15.7:0/1667767143 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54010690 con 0x7fba5c108d00 2024-09-21T06:04:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.313+0000 7fba62d90640 1 -- 172.21.15.7:0/1667767143 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5c1a6d10 con 0x7fba5c108d00 2024-09-21T06:04:04.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.315+0000 7fba59ffb640 1 -- 172.21.15.7:0/1667767143 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fba540054d0 con 0x7fba5c108d00 2024-09-21T06:04:04.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.316+0000 7fba59ffb640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba4c0b66b0 0x7fba4c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.316+0000 7fba69304740 1 Processor -- start 2024-09-21T06:04:04.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba69304740 1 -- start start 2024-09-21T06:04:04.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba60b2c640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba4c0b66b0 0x7fba4c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba59ffb640 1 -- 172.21.15.7:0/1667767143 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fba540e7da0 con 0x7fba5c108d00 2024-09-21T06:04:04.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba69304740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561681b4070 0x55616855b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba69304740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55616818b1b0 0x55616855bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba69304740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x55616855c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba69304740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5561684d1ea0 con 0x556168193390 2024-09-21T06:04:04.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba69304740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5561684c12d0 con 0x5561681b4070 2024-09-21T06:04:04.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba69304740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5561684c50e0 con 0x55616818b1b0 2024-09-21T06:04:04.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba6132d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x55616855c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba60b2c640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba4c0b66b0 0x7fba4c0b8bc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fba5c06c6e0 tx=0x7fba50005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba6132d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x55616855c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42448/0 (socket says 172.21.15.7:42448) 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba6132d640 1 -- 172.21.15.7:0/3057640859 learned_addr learned my addr 172.21.15.7:0/3057640859 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba5bfff640 1 --2- 172.21.15.7:0/3057640859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55616818b1b0 0x55616855bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.317+0000 7fba60b2c640 1 --2- 172.21.15.7:0/3057640859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561681b4070 0x55616855b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.318+0000 7fba6132d640 1 -- 172.21.15.7:0/3057640859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55616818b1b0 msgr2=0x55616855bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.318+0000 7fba6132d640 1 --2- 172.21.15.7:0/3057640859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55616818b1b0 0x55616855bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.318+0000 7fba6132d640 1 -- 172.21.15.7:0/3057640859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561681b4070 msgr2=0x55616855b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.318+0000 7fba6132d640 1 --2- 172.21.15.7:0/3057640859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561681b4070 0x55616855b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.318+0000 7fba6132d640 1 -- 172.21.15.7:0/3057640859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55616821f650 con 0x556168193390 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.318+0000 7fba6132d640 1 --2- 172.21.15.7:0/3057640859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x55616855c120 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fba540adb70 tx=0x7fba540ad410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf29eee2b76007e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.318+0000 7fba46ffd640 1 -- 172.21.15.7:0/3057640859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba540b2020 con 0x556168193390 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.319+0000 7fba46ffd640 1 -- 172.21.15.7:0/3057640859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba540ae2e0 con 0x556168193390 2024-09-21T06:04:04.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.319+0000 7fba46ffd640 1 -- 172.21.15.7:0/3057640859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba540b7600 con 0x556168193390 2024-09-21T06:04:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.319+0000 7fba69304740 1 -- 172.21.15.7:0/3057640859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 msgr2=0x55616855c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.319+0000 7fba69304740 1 --2- 172.21.15.7:0/3057640859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x55616855c120 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fba540adb70 tx=0x7fba540ad410 comp rx=0 tx=0).stop 2024-09-21T06:04:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.320+0000 7fba69304740 1 -- 172.21.15.7:0/3057640859 shutdown_connections 2024-09-21T06:04:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.320+0000 7fba69304740 1 --2- 172.21.15.7:0/3057640859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x55616855c120 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.320+0000 7fba69304740 1 --2- 172.21.15.7:0/3057640859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55616818b1b0 0x55616855bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.320+0000 7fba69304740 1 --2- 172.21.15.7:0/3057640859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561681b4070 0x55616855b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.320+0000 7fba69304740 1 -- 172.21.15.7:0/3057640859 >> 172.21.15.7:0/3057640859 conn(0x5561681a8460 msgr2=0x556168559590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.320+0000 7fba69304740 1 -- 172.21.15.7:0/3057640859 shutdown_connections 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.320+0000 7fba69304740 1 -- 172.21.15.7:0/3057640859 wait complete. 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.320+0000 7fba69304740 1 -- start start 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.320+0000 7fba69304740 1 Processor -- start 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba69304740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55616818b1b0 0x55616856b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba69304740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x55616856b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba69304740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561681b4070 0x5561685774b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba69304740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556168322700 con 0x556168193390 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba69304740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x55616845c160 con 0x5561681b4070 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba69304740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55616856e180 con 0x55616818b1b0 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba69304740 10 client.0 _ll_register_callbacks cb 0x5561684759e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:04.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba5bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x55616856b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba5bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x55616856b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42450/0 (socket says 172.21.15.7:42450) 2024-09-21T06:04:04.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba5bfff640 1 -- 172.21.15.7:0/4102085728 learned_addr learned my addr 172.21.15.7:0/4102085728 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:04.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba60b2c640 1 --2- 172.21.15.7:0/4102085728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55616818b1b0 0x55616856b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba6132d640 1 --2- 172.21.15.7:0/4102085728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561681b4070 0x5561685774b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba5bfff640 1 -- 172.21.15.7:0/4102085728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55616818b1b0 msgr2=0x55616856b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:04.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba5bfff640 1 --2- 172.21.15.7:0/4102085728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55616818b1b0 0x55616856b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba5bfff640 1 -- 172.21.15.7:0/4102085728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561681b4070 msgr2=0x5561685774b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:04.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba5bfff640 1 --2- 172.21.15.7:0/4102085728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561681b4070 0x5561685774b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.321+0000 7fba5bfff640 1 -- 172.21.15.7:0/4102085728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556168489c90 con 0x556168193390 2024-09-21T06:04:04.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.322+0000 7fba5bfff640 1 --2- 172.21.15.7:0/4102085728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x55616856b700 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fba48009900 tx=0x7fba48032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cee235f392c793 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.322+0000 7fba3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:04:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.322+0000 7fba3bfff640 1 -- 172.21.15.7:0/4102085728 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48035040 con 0x556168193390 2024-09-21T06:04:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.322+0000 7fba3bfff640 1 -- 172.21.15.7:0/4102085728 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fba48031760 con 0x556168193390 2024-09-21T06:04:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.322+0000 7fba69304740 1 -- 172.21.15.7:0/4102085728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba540ae2e0 con 0x556168193390 2024-09-21T06:04:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.322+0000 7fba3bfff640 1 -- 172.21.15.7:0/4102085728 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba48004040 con 0x556168193390 2024-09-21T06:04:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.322+0000 7fba69304740 10 client.18387 fetch_fsmap learned FSMap version 25 2024-09-21T06:04:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.322+0000 7fba69304740 1 -- 172.21.15.7:0/4102085728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556168579e70 con 0x556168193390 2024-09-21T06:04:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.322+0000 7fba3bfff640 1 -- 172.21.15.7:0/4102085728 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba540ae2e0 con 0x556168193390 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.323+0000 7fba3bfff640 1 -- 172.21.15.7:0/4102085728 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba48004750 con 0x556168193390 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.323+0000 7fba69304740 10 client.18387 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.323+0000 7fba69304740 10 client.18387 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.323+0000 7fba69304740 20 client.18387 populate_metadata read hostname 'smithi007' 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.323+0000 7fba69304740 1 --2- 172.21.15.7:0/4102085728 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5561681729f0 0x55616857d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.323+0000 7fba69304740 4 client.18387 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.323+0000 7fba69304740 1 -- 172.21.15.7:0/4102085728 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561684d3df0 con 0x5561681729f0 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.323+0000 7fba60b2c640 1 --2- 172.21.15.7:0/4102085728 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5561681729f0 0x55616857d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.324+0000 7fba60b2c640 1 --2- 172.21.15.7:0/4102085728 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5561681729f0 0x55616857d310 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6a21f6ac8f0d4879 server_cookie=3becbb28763493f9 in_seq=0 out_seq=0 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.324+0000 7fba3bfff640 10 client.18387 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.324+0000 7fba3bfff640 1 -- 172.21.15.7:0/4102085728 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561684d3df0 con 0x5561681729f0 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.324+0000 7fba3bfff640 10 client.18387 handle_command_reply: tid=0 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.324+0000 7fba69304740 1 client.18387 shutdown 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.325+0000 7fba69304740 1 -- 172.21.15.7:0/4102085728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 msgr2=0x55616856b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.325+0000 7fba69304740 1 --2- 172.21.15.7:0/4102085728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x55616856b700 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fba48009900 tx=0x7fba48032e90 comp rx=0 tx=0).stop 2024-09-21T06:04:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.325+0000 7fba69304740 1 -- 172.21.15.7:0/4102085728 shutdown_connections 2024-09-21T06:04:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.325+0000 7fba69304740 1 --2- 172.21.15.7:0/4102085728 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5561681729f0 0x55616857d310 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.325+0000 7fba3bfff640 0 client.18387 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:04:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.325+0000 7fba69304740 1 --2- 172.21.15.7:0/4102085728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x55616856b700 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.325+0000 7fba69304740 1 --2- 172.21.15.7:0/4102085728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561681b4070 0x5561685774b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.325+0000 7fba69304740 1 --2- 172.21.15.7:0/4102085728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55616818b1b0 0x55616856b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.325+0000 7fba69304740 1 -- 172.21.15.7:0/4102085728 >> 172.21.15.7:0/4102085728 conn(0x5561681a8460 msgr2=0x556168557bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.325+0000 7fba69304740 1 -- 172.21.15.7:0/4102085728 shutdown_connections 2024-09-21T06:04:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.325+0000 7fba69304740 1 -- 172.21.15.7:0/4102085728 wait complete. 2024-09-21T06:04:04.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.325+0000 7fba69304740 20 client.18387 trim_cache size 0 max 16384 2024-09-21T06:04:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.342+0000 7fba69304740 1 Processor -- start 2024-09-21T06:04:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.342+0000 7fba69304740 1 -- start start 2024-09-21T06:04:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.342+0000 7fba69304740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561681729f0 0x55616855cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.342+0000 7fba69304740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55616818b1b0 0x5561685773b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.342+0000 7fba69304740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x5561685683b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.342+0000 7fba69304740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1afc10 con 0x556168193390 2024-09-21T06:04:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.342+0000 7fba69304740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1ad4e0 con 0x55616818b1b0 2024-09-21T06:04:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.342+0000 7fba69304740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1ab350 con 0x5561681729f0 2024-09-21T06:04:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.343+0000 7fba6132d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x5561685683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.343+0000 7fba60b2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561681729f0 0x55616855cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.343+0000 7fba60b2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561681729f0 0x55616855cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:35578/0 (socket says 172.21.15.7:35578) 2024-09-21T06:04:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.343+0000 7fba60b2c640 1 -- 172.21.15.7:0/283993668 learned_addr learned my addr 172.21.15.7:0/283993668 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.343+0000 7fba5bfff640 1 --2- 172.21.15.7:0/283993668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55616818b1b0 0x5561685773b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.343+0000 7fba60b2c640 1 -- 172.21.15.7:0/283993668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55616818b1b0 msgr2=0x5561685773b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.343+0000 7fba60b2c640 1 --2- 172.21.15.7:0/283993668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55616818b1b0 0x5561685773b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.343+0000 7fba60b2c640 1 -- 172.21.15.7:0/283993668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 msgr2=0x5561685683b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.343+0000 7fba60b2c640 1 --2- 172.21.15.7:0/283993668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x5561685683b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.343+0000 7fba60b2c640 1 -- 172.21.15.7:0/283993668 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561685696c0 con 0x5561681729f0 2024-09-21T06:04:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.343+0000 7fba60b2c640 1 --2- 172.21.15.7:0/283993668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561681729f0 0x55616855cde0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba50009fd0 tx=0x7fba50014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59f0dbaac0096349 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.343+0000 7fba467fc640 1 -- 172.21.15.7:0/283993668 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba50028470 con 0x5561681729f0 2024-09-21T06:04:04.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.344+0000 7fba467fc640 1 -- 172.21.15.7:0/283993668 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba50028ac0 con 0x5561681729f0 2024-09-21T06:04:04.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.344+0000 7fba467fc640 1 -- 172.21.15.7:0/283993668 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5000fa30 con 0x5561681729f0 2024-09-21T06:04:04.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.344+0000 7fba69304740 1 -- 172.21.15.7:0/283993668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561681729f0 msgr2=0x55616855cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.344+0000 7fba69304740 1 --2- 172.21.15.7:0/283993668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561681729f0 0x55616855cde0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba50009fd0 tx=0x7fba50014000 comp rx=0 tx=0).stop 2024-09-21T06:04:04.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.344+0000 7fba69304740 1 -- 172.21.15.7:0/283993668 shutdown_connections 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.344+0000 7fba69304740 1 --2- 172.21.15.7:0/283993668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556168193390 0x5561685683b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.344+0000 7fba69304740 1 --2- 172.21.15.7:0/283993668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55616818b1b0 0x5561685773b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.344+0000 7fba69304740 1 --2- 172.21.15.7:0/283993668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5561681729f0 0x55616855cde0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.344+0000 7fba69304740 1 -- 172.21.15.7:0/283993668 >> 172.21.15.7:0/283993668 conn(0x5561681a8460 msgr2=0x55616855c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.345+0000 7fba69304740 1 -- 172.21.15.7:0/283993668 shutdown_connections 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.345+0000 7fba69304740 1 -- 172.21.15.7:0/283993668 wait complete. 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.345+0000 7fba69304740 1 -- start start 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.345+0000 7fba69304740 1 Processor -- start 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba69304740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561681729f0 0x556168573ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba69304740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55616818b1b0 0x55616856ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba69304740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556168193390 0x5561685704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba69304740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1ab9a0 con 0x5561681729f0 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba69304740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1ace10 con 0x55616818b1b0 2024-09-21T06:04:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba69304740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1ac070 con 0x556168193390 2024-09-21T06:04:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba69304740 10 client.0 _ll_register_callbacks cb 0x7fba48032b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba60b2c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561681729f0 0x556168573ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba60b2c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561681729f0 0x556168573ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42470/0 (socket says 172.21.15.7:42470) 2024-09-21T06:04:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba60b2c640 1 -- 172.21.15.7:0/1884146955 learned_addr learned my addr 172.21.15.7:0/1884146955 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba5bfff640 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55616818b1b0 0x55616856ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba6132d640 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556168193390 0x5561685704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba5bfff640 1 -- 172.21.15.7:0/1884146955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556168193390 msgr2=0x5561685704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba5bfff640 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556168193390 0x5561685704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba5bfff640 1 -- 172.21.15.7:0/1884146955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561681729f0 msgr2=0x556168573ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba5bfff640 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561681729f0 0x556168573ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba5bfff640 1 -- 172.21.15.7:0/1884146955 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556168570b30 con 0x55616818b1b0 2024-09-21T06:04:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.346+0000 7fba60b2c640 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561681729f0 0x556168573ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.347+0000 7fba5bfff640 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55616818b1b0 0x55616856ff80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba4802a930 tx=0x7fba48004970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc2b6ce59d49fab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.347+0000 7fba3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-21T06:04:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.347+0000 7fba3bfff640 1 -- 172.21.15.7:0/1884146955 <== mon.2 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48035070 con 0x55616818b1b0 2024-09-21T06:04:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.347+0000 7fba3bfff640 1 -- 172.21.15.7:0/1884146955 <== mon.2 v2:172.21.15.27:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fba48003780 con 0x55616818b1b0 2024-09-21T06:04:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.347+0000 7fba69304740 1 -- 172.21.15.7:0/1884146955 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba50028ac0 con 0x55616818b1b0 2024-09-21T06:04:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.347+0000 7fba3bfff640 1 -- 172.21.15.7:0/1884146955 <== mon.2 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba48031970 con 0x55616818b1b0 2024-09-21T06:04:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.347+0000 7fba69304740 10 client.27626 fetch_fsmap learned FSMap version 25 2024-09-21T06:04:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.347+0000 7fba69304740 1 -- 172.21.15.7:0/1884146955 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5561685e8ac0 con 0x55616818b1b0 2024-09-21T06:04:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.347+0000 7fba3bfff640 1 -- 172.21.15.7:0/1884146955 <== mon.2 v2:172.21.15.27:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba50028ac0 con 0x55616818b1b0 2024-09-21T06:04:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.348+0000 7fba3bfff640 1 -- 172.21.15.7:0/1884146955 <== mon.2 v2:172.21.15.27:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba48004f40 con 0x55616818b1b0 2024-09-21T06:04:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.348+0000 7fba69304740 10 client.27626 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:04:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.348+0000 7fba69304740 10 client.27626 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:04:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.348+0000 7fba69304740 20 client.27626 populate_metadata read hostname 'smithi007' 2024-09-21T06:04:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.348+0000 7fba69304740 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5561681b4070 0x5561685eb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.348+0000 7fba69304740 4 client.27626 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.348+0000 7fba69304740 1 -- 172.21.15.7:0/1884146955 --> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5561684cf8a0 con 0x5561681b4070 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.348+0000 7fba60b2c640 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5561681b4070 0x5561685eb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba60b2c640 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5561681b4070 0x5561685eb240 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ac5f2dee882ab5a server_cookie=a15c91e7036e147b in_seq=0 out_seq=0 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba3bfff640 10 client.27626 ms_handle_connect on v2:172.21.15.119:6836/3266640886 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba3bfff640 1 -- 172.21.15.7:0/1884146955 <== mds.2 v2:172.21.15.119:6836/3266640886 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5561684cf8a0 con 0x5561681b4070 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba3bfff640 10 client.27626 handle_command_reply: tid=0 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba69304740 1 client.27626 shutdown 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba69304740 1 -- 172.21.15.7:0/1884146955 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55616818b1b0 msgr2=0x55616856ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba69304740 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55616818b1b0 0x55616856ff80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba4802a930 tx=0x7fba48004970 comp rx=0 tx=0).stop 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba69304740 1 -- 172.21.15.7:0/1884146955 shutdown_connections 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba69304740 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.119:6836/3266640886,v1:172.21.15.119:6837/3266640886] conn(0x5561681b4070 0x5561685eb240 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba69304740 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x556168193390 0x5561685704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba69304740 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55616818b1b0 0x55616856ff80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba69304740 1 --2- 172.21.15.7:0/1884146955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561681729f0 0x556168573ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba69304740 1 -- 172.21.15.7:0/1884146955 >> 172.21.15.7:0/1884146955 conn(0x5561681a8460 msgr2=0x556168560fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba3bfff640 0 client.27626 ms_handle_reset on v2:172.21.15.119:6836/3266640886 2024-09-21T06:04:04.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba69304740 1 -- 172.21.15.7:0/1884146955 shutdown_connections 2024-09-21T06:04:04.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba69304740 1 -- 172.21.15.7:0/1884146955 wait complete. 2024-09-21T06:04:04.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.349+0000 7fba69304740 20 client.27626 trim_cache size 0 max 16384 2024-09-21T06:04:04.355 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:04:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.350+0000 7fba62d90640 1 -- 172.21.15.7:0/1667767143 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba4c0b66b0 msgr2=0x7fba4c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.350+0000 7fba62d90640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba4c0b66b0 0x7fba4c0b8bc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fba5c06c6e0 tx=0x7fba50005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.350+0000 7fba62d90640 1 -- 172.21.15.7:0/1667767143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba5c108d00 msgr2=0x7fba5c19bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.350+0000 7fba62d90640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba5c108d00 0x7fba5c19bd50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fba54009fd0 tx=0x7fba5400ef10 comp rx=0 tx=0).stop 2024-09-21T06:04:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.350+0000 7fba62d90640 1 -- 172.21.15.7:0/1667767143 shutdown_connections 2024-09-21T06:04:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.350+0000 7fba62d90640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fba4c0b66b0 0x7fba4c0b8bc0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.350+0000 7fba62d90640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba5c108d00 0x7fba5c19bd50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.350+0000 7fba62d90640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba5c1083b0 0x7fba5c19b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.350+0000 7fba62d90640 1 --2- 172.21.15.7:0/1667767143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba5c102a70 0x7fba5c19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.350+0000 7fba62d90640 1 -- 172.21.15.7:0/1667767143 >> 172.21.15.7:0/1667767143 conn(0x7fba5c079710 msgr2=0x7fba5c1043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.350+0000 7fba62d90640 1 -- 172.21.15.7:0/1667767143 shutdown_connections 2024-09-21T06:04:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:04.350+0000 7fba62d90640 1 -- 172.21.15.7:0/1667767143 wait complete. 2024-09-21T06:04:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:04 smithi027 ceph-mon[34364]: pgmap v631: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:04:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:04.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:04 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:04.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:04 smithi007 ceph-mon[30983]: pgmap v631: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:04:04.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:04.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:04.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:04.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:04.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:04 smithi119 ceph-mon[34833]: pgmap v631: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:04:04.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:04.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:04 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:05.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:04:05.348 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:05.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.844+0000 7f0a281df640 1 -- 172.21.15.7:0/2613216686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a201083a0 msgr2=0x7f0a201087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.844+0000 7f0a281df640 1 --2- 172.21.15.7:0/2613216686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a201083a0 0x7f0a201087b0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009900 tx=0x7f0a1002a410 comp rx=0 tx=0).stop 2024-09-21T06:04:05.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.844+0000 7f0a281df640 1 -- 172.21.15.7:0/2613216686 shutdown_connections 2024-09-21T06:04:05.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.844+0000 7f0a281df640 1 --2- 172.21.15.7:0/2613216686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a201083a0 0x7f0a201087b0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.844+0000 7f0a281df640 1 --2- 172.21.15.7:0/2613216686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a20108cf0 0x7f0a2010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.844+0000 7f0a281df640 1 --2- 172.21.15.7:0/2613216686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a20102a60 0x7f0a20102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.844+0000 7f0a281df640 1 -- 172.21.15.7:0/2613216686 >> 172.21.15.7:0/2613216686 conn(0x7f0a20079730 msgr2=0x7f0a20079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.844+0000 7f0a281df640 1 -- 172.21.15.7:0/2613216686 shutdown_connections 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.844+0000 7f0a281df640 1 -- 172.21.15.7:0/2613216686 wait complete. 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a281df640 1 Processor -- start 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a281df640 1 -- start start 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a281df640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a20102a60 0x7f0a200ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a281df640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a201083a0 0x7f0a200ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a281df640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a20108cf0 0x7f0a201000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a281df640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20112960 con 0x7f0a20102a60 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a281df640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0a201127e0 con 0x7f0a201083a0 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a281df640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20112ae0 con 0x7f0a20108cf0 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a25f7b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a20102a60 0x7f0a200ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a25f7b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a20102a60 0x7f0a200ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42500/0 (socket says 172.21.15.7:42500) 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a25f7b640 1 -- 172.21.15.7:0/3080380095 learned_addr learned my addr 172.21.15.7:0/3080380095 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:05.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a2677c640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a20108cf0 0x7f0a201000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a2577a640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a201083a0 0x7f0a200ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a25f7b640 1 -- 172.21.15.7:0/3080380095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a20108cf0 msgr2=0x7f0a201000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a20108cf0 0x7f0a201000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a25f7b640 1 -- 172.21.15.7:0/3080380095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a201083a0 msgr2=0x7f0a200ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a201083a0 0x7f0a200ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.845+0000 7f0a25f7b640 1 -- 172.21.15.7:0/3080380095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a201a8720 con 0x7f0a20102a60 2024-09-21T06:04:05.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.846+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a20102a60 0x7f0a200ff670 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00d950 tx=0x7f0a1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:05.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.846+0000 7f0a16ffd640 1 -- 172.21.15.7:0/3080380095 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c017070 con 0x7f0a20102a60 2024-09-21T06:04:05.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.846+0000 7f0a281df640 1 -- 172.21.15.7:0/3080380095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a201a8a10 con 0x7f0a20102a60 2024-09-21T06:04:05.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.846+0000 7f0a16ffd640 1 -- 172.21.15.7:0/3080380095 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a1c009c30 con 0x7f0a20102a60 2024-09-21T06:04:05.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.846+0000 7f0a16ffd640 1 -- 172.21.15.7:0/3080380095 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c00f620 con 0x7f0a20102a60 2024-09-21T06:04:05.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.846+0000 7f0a281df640 1 -- 172.21.15.7:0/3080380095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a201a8f70 con 0x7f0a20102a60 2024-09-21T06:04:05.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.849+0000 7f0a2e753740 1 Processor -- start 2024-09-21T06:04:05.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.849+0000 7f0a2e753740 1 -- start start 2024-09-21T06:04:05.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.849+0000 7f0a16ffd640 1 -- 172.21.15.7:0/3080380095 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f0a1c010460 con 0x7f0a20102a60 2024-09-21T06:04:05.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.849+0000 7f0a2e753740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020da9070 0x5600211506a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.849+0000 7f0a2e753740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d801b0 0x560021150be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.849+0000 7f0a2e753740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d88390 0x560021151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.849+0000 7f0a2e753740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5600210c6ea0 con 0x560020d801b0 2024-09-21T06:04:05.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.849+0000 7f0a2e753740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5600210b62d0 con 0x560020da9070 2024-09-21T06:04:05.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.849+0000 7f0a2e753740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5600210ba0e0 con 0x560020d88390 2024-09-21T06:04:05.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.849+0000 7f0a25f7b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d801b0 0x560021150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.849+0000 7f0a25f7b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d801b0 0x560021150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42514/0 (socket says 172.21.15.7:42514) 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.849+0000 7f0a25f7b640 1 -- 172.21.15.7:0/3561777425 learned_addr learned my addr 172.21.15.7:0/3561777425 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.849+0000 7f0a2677c640 1 --2- 172.21.15.7:0/3561777425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020da9070 0x5600211506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.850+0000 7f0a2577a640 1 --2- 172.21.15.7:0/3561777425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d88390 0x560021151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.850+0000 7f0a25f7b640 1 -- 172.21.15.7:0/3561777425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d88390 msgr2=0x560021151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.850+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/3561777425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d88390 0x560021151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.850+0000 7f0a25f7b640 1 -- 172.21.15.7:0/3561777425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020da9070 msgr2=0x5600211506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.850+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/3561777425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020da9070 0x5600211506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.850+0000 7f0a25f7b640 1 -- 172.21.15.7:0/3561777425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560020e14650 con 0x560020d801b0 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.850+0000 7f0a2577a640 1 --2- 172.21.15.7:0/3561777425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d88390 0x560021151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.850+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/3561777425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d801b0 0x560021150be0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0e49a0 tx=0x7f0a1c0ef990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3caf69becdd20fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.850+0000 7f0a16ffd640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0a0c0b6700 0x7f0a0c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.850+0000 7f0a0bfff640 1 -- 172.21.15.7:0/3561777425 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c0fb070 con 0x560020d801b0 2024-09-21T06:04:05.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.850+0000 7f0a0bfff640 1 -- 172.21.15.7:0/3561777425 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a1c0acc40 con 0x560020d801b0 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.850+0000 7f0a0bfff640 1 -- 172.21.15.7:0/3561777425 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c072710 con 0x560020d801b0 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.850+0000 7f0a2677c640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0a0c0b6700 0x7f0a0c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.851+0000 7f0a16ffd640 1 -- 172.21.15.7:0/3080380095 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f0a1c0e7290 con 0x7f0a20102a60 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.851+0000 7f0a2e753740 1 -- 172.21.15.7:0/3561777425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d801b0 msgr2=0x560021150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.851+0000 7f0a2677c640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0a0c0b6700 0x7f0a0c0b8c10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0a18005fd0 tx=0x7f0a18009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.851+0000 7f0a2e753740 1 --2- 172.21.15.7:0/3561777425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d801b0 0x560021150be0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0e49a0 tx=0x7f0a1c0ef990 comp rx=0 tx=0).stop 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.851+0000 7f0a2e753740 1 -- 172.21.15.7:0/3561777425 shutdown_connections 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.851+0000 7f0a2e753740 1 --2- 172.21.15.7:0/3561777425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d801b0 0x560021150be0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.851+0000 7f0a2e753740 1 --2- 172.21.15.7:0/3561777425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d88390 0x560021151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.851+0000 7f0a2e753740 1 --2- 172.21.15.7:0/3561777425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020da9070 0x5600211506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.851+0000 7f0a2e753740 1 -- 172.21.15.7:0/3561777425 >> 172.21.15.7:0/3561777425 conn(0x560020d9d460 msgr2=0x56002114e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.852+0000 7f0a2e753740 1 -- 172.21.15.7:0/3561777425 shutdown_connections 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.852+0000 7f0a2e753740 1 -- 172.21.15.7:0/3561777425 wait complete. 2024-09-21T06:04:05.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.852+0000 7f0a2e753740 1 -- start start 2024-09-21T06:04:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.852+0000 7f0a2e753740 1 Processor -- start 2024-09-21T06:04:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.852+0000 7f0a2e753740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d801b0 0x56002115bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.852+0000 7f0a2e753740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d88390 0x56002115c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2e753740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020da9070 0x5600211681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2e753740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560020f17700 con 0x560020da9070 2024-09-21T06:04:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2e753740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x560021051160 con 0x560020d801b0 2024-09-21T06:04:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2e753740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56002115ee80 con 0x560020d88390 2024-09-21T06:04:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2e753740 10 client.0 _ll_register_callbacks cb 0x56002106a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2677c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020da9070 0x5600211681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2677c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020da9070 0x5600211681a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42520/0 (socket says 172.21.15.7:42520) 2024-09-21T06:04:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2677c640 1 -- 172.21.15.7:0/1572262654 learned_addr learned my addr 172.21.15.7:0/1572262654 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d801b0 0x56002115bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2577a640 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d88390 0x56002115c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2677c640 1 -- 172.21.15.7:0/1572262654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d88390 msgr2=0x56002115c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2677c640 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d88390 0x56002115c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2677c640 1 -- 172.21.15.7:0/1572262654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d801b0 msgr2=0x56002115bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2677c640 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d801b0 0x56002115bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2677c640 1 -- 172.21.15.7:0/1572262654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56002107ec90 con 0x560020da9070 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2577a640 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d88390 0x56002115c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a2677c640 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020da9070 0x5600211681a0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f0a18005c40 tx=0x7f0a18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb76974fbfd250b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a097fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a097fa640 1 -- 172.21.15.7:0/1572262654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18020620 con 0x560020da9070 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.853+0000 7f0a097fa640 1 -- 172.21.15.7:0/1572262654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f0a180207c0 con 0x560020da9070 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.854+0000 7f0a2e753740 1 -- 172.21.15.7:0/1572262654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a1c0acc40 con 0x560020da9070 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.854+0000 7f0a097fa640 1 -- 172.21.15.7:0/1572262654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0a18020a00 con 0x560020da9070 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.854+0000 7f0a2e753740 10 client.18405 fetch_fsmap learned FSMap version 25 2024-09-21T06:04:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.854+0000 7f0a2e753740 1 -- 172.21.15.7:0/1572262654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56002116abf0 con 0x560020da9070 2024-09-21T06:04:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.854+0000 7f0a097fa640 1 -- 172.21.15.7:0/1572262654 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a1c0acc40 con 0x560020da9070 2024-09-21T06:04:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.854+0000 7f0a097fa640 1 -- 172.21.15.7:0/1572262654 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0a1800f040 con 0x560020da9070 2024-09-21T06:04:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.854+0000 7f0a2e753740 10 client.18405 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:04:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.854+0000 7f0a2e753740 10 client.18405 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:04:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.854+0000 7f0a2e753740 20 client.18405 populate_metadata read hostname 'smithi007' 2024-09-21T06:04:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.854+0000 7f0a2e753740 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x560020d679f0 0x56002116e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.854+0000 7f0a2e753740 4 client.18405 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:04:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.854+0000 7f0a2e753740 1 -- 172.21.15.7:0/1572262654 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600210c8df0 con 0x560020d679f0 2024-09-21T06:04:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.855+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x560020d679f0 0x56002116e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.855+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x560020d679f0 0x56002116e1d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51d847c95542374c server_cookie=f5545646928ad1a9 in_seq=0 out_seq=0 2024-09-21T06:04:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.855+0000 7f0a097fa640 10 client.18405 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:04:05.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a097fa640 1 -- 172.21.15.7:0/1572262654 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5600210c8df0 con 0x560020d679f0 2024-09-21T06:04:05.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a097fa640 10 client.18405 handle_command_reply: tid=0 2024-09-21T06:04:05.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a2e753740 1 client.18405 shutdown 2024-09-21T06:04:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a2e753740 1 -- 172.21.15.7:0/1572262654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020da9070 msgr2=0x5600211681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a2e753740 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020da9070 0x5600211681a0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f0a18005c40 tx=0x7f0a18004a40 comp rx=0 tx=0).stop 2024-09-21T06:04:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a2e753740 1 -- 172.21.15.7:0/1572262654 shutdown_connections 2024-09-21T06:04:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a2e753740 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x560020d679f0 0x56002116e1d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a2e753740 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020da9070 0x5600211681a0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a2e753740 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d88390 0x56002115c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a097fa640 0 client.18405 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:04:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a2e753740 1 --2- 172.21.15.7:0/1572262654 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d801b0 0x56002115bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a2e753740 1 -- 172.21.15.7:0/1572262654 >> 172.21.15.7:0/1572262654 conn(0x560020d9d460 msgr2=0x560021153830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a2e753740 1 -- 172.21.15.7:0/1572262654 shutdown_connections 2024-09-21T06:04:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a2e753740 1 -- 172.21.15.7:0/1572262654 wait complete. 2024-09-21T06:04:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.856+0000 7f0a2e753740 20 client.18405 trim_cache size 0 max 16384 2024-09-21T06:04:05.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a2e753740 1 Processor -- start 2024-09-21T06:04:05.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a2e753740 1 -- start start 2024-09-21T06:04:05.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a2e753740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d679f0 0x56002115dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a2e753740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d801b0 0x5600211680a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a2e753740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d88390 0x56002115ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a2e753740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0a201b40a0 con 0x560020d679f0 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a2e753740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0a201b1970 con 0x560020d88390 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a2e753740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0a201af7e0 con 0x560020d801b0 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a25f7b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d679f0 0x56002115dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a25f7b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d679f0 0x56002115dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42536/0 (socket says 172.21.15.7:42536) 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a25f7b640 1 -- 172.21.15.7:0/1588445133 learned_addr learned my addr 172.21.15.7:0/1588445133 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a2677c640 1 --2- 172.21.15.7:0/1588445133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d88390 0x56002115ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a25f7b640 1 -- 172.21.15.7:0/1588445133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d801b0 msgr2=0x5600211680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/1588445133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d801b0 0x5600211680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a25f7b640 1 -- 172.21.15.7:0/1588445133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d88390 msgr2=0x56002115ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/1588445133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d88390 0x56002115ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a25f7b640 1 -- 172.21.15.7:0/1588445133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560021152990 con 0x560020d679f0 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.870+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/1588445133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d679f0 0x56002115dc70 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c005fd0 tx=0x7f0a1c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cc13b36914fcde server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.871+0000 7f0a0b7fe640 1 -- 172.21.15.7:0/1588445133 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c071730 con 0x560020d679f0 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.871+0000 7f0a0b7fe640 1 -- 172.21.15.7:0/1588445133 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a1c0e6040 con 0x560020d679f0 2024-09-21T06:04:05.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.871+0000 7f0a0b7fe640 1 -- 172.21.15.7:0/1588445133 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c071910 con 0x560020d679f0 2024-09-21T06:04:05.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.871+0000 7f0a2e753740 1 -- 172.21.15.7:0/1588445133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d679f0 msgr2=0x56002115dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.871+0000 7f0a2e753740 1 --2- 172.21.15.7:0/1588445133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d679f0 0x56002115dc70 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c005fd0 tx=0x7f0a1c005880 comp rx=0 tx=0).stop 2024-09-21T06:04:05.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.871+0000 7f0a2e753740 1 -- 172.21.15.7:0/1588445133 shutdown_connections 2024-09-21T06:04:05.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.871+0000 7f0a2e753740 1 --2- 172.21.15.7:0/1588445133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d88390 0x56002115ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.871+0000 7f0a2e753740 1 --2- 172.21.15.7:0/1588445133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d801b0 0x5600211680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.871+0000 7f0a2e753740 1 --2- 172.21.15.7:0/1588445133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d679f0 0x56002115dc70 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.871+0000 7f0a2e753740 1 -- 172.21.15.7:0/1588445133 >> 172.21.15.7:0/1588445133 conn(0x560020d9d460 msgr2=0x56002115a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.872+0000 7f0a2e753740 1 -- 172.21.15.7:0/1588445133 shutdown_connections 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.872+0000 7f0a2e753740 1 -- 172.21.15.7:0/1588445133 wait complete. 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.872+0000 7f0a2e753740 1 -- start start 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.872+0000 7f0a2e753740 1 Processor -- start 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.872+0000 7f0a2e753740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d679f0 0x5600211600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2e753740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d801b0 0x5600211605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2e753740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d88390 0x560021160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2e753740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0a201afe30 con 0x560020d88390 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2e753740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0a201b12a0 con 0x560020d679f0 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2e753740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0a201b0500 con 0x560020d801b0 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2e753740 10 client.0 _ll_register_callbacks cb 0x7f0a18009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2677c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d88390 0x560021160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a25f7b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d679f0 0x5600211600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2677c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d88390 0x560021160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42542/0 (socket says 172.21.15.7:42542) 2024-09-21T06:04:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2677c640 1 -- 172.21.15.7:0/4243353553 learned_addr learned my addr 172.21.15.7:0/4243353553 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a25f7b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d679f0 0x5600211600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.7:55494/0 (socket says 172.21.15.7:55494) 2024-09-21T06:04:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2577a640 1 --2- 172.21.15.7:0/4243353553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d801b0 0x5600211605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2677c640 1 -- 172.21.15.7:0/4243353553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d801b0 msgr2=0x5600211605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2677c640 1 --2- 172.21.15.7:0/4243353553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d801b0 0x5600211605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2677c640 1 -- 172.21.15.7:0/4243353553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d679f0 msgr2=0x5600211600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2677c640 1 --2- 172.21.15.7:0/4243353553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d679f0 0x5600211600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2677c640 1 -- 172.21.15.7:0/4243353553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600211d7b90 con 0x560020d88390 2024-09-21T06:04:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2577a640 1 --2- 172.21.15.7:0/4243353553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d801b0 0x5600211605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a2677c640 1 --2- 172.21.15.7:0/4243353553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d88390 0x560021160b20 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f0a18000f80 tx=0x7f0a18011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a61096bc817c4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a097fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a097fa640 1 -- 172.21.15.7:0/4243353553 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18020420 con 0x560020d88390 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.873+0000 7f0a097fa640 1 -- 172.21.15.7:0/4243353553 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f0a180205c0 con 0x560020d88390 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.874+0000 7f0a2e753740 1 -- 172.21.15.7:0/4243353553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a1c0e6040 con 0x560020d88390 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.874+0000 7f0a097fa640 1 -- 172.21.15.7:0/4243353553 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0a180207c0 con 0x560020d88390 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.874+0000 7f0a2e753740 10 client.18411 fetch_fsmap learned FSMap version 25 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.874+0000 7f0a2e753740 1 -- 172.21.15.7:0/4243353553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5600211d8de0 con 0x560020d88390 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.874+0000 7f0a097fa640 1 -- 172.21.15.7:0/4243353553 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a1c0e6040 con 0x560020d88390 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.874+0000 7f0a097fa640 1 -- 172.21.15.7:0/4243353553 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0a18038020 con 0x560020d88390 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.874+0000 7f0a2e753740 10 client.18411 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.874+0000 7f0a2e753740 10 client.18411 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.874+0000 7f0a2e753740 20 client.18411 populate_metadata read hostname 'smithi007' 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.874+0000 7f0a2e753740 1 --2- 172.21.15.7:0/4243353553 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x560020da9070 0x5600211db550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.874+0000 7f0a2e753740 4 client.18411 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.874+0000 7f0a2e753740 1 -- 172.21.15.7:0/4243353553 --> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56002115c680 con 0x560020da9070 2024-09-21T06:04:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/4243353553 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x560020da9070 0x5600211db550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a097fa640 10 client.18411 ms_handle_connect on v2:172.21.15.27:6838/556391029 2024-09-21T06:04:05.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a25f7b640 1 --2- 172.21.15.7:0/4243353553 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x560020da9070 0x5600211db550 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5b87daf8fa56ac0 server_cookie=482b81009f97dc45 in_seq=0 out_seq=0 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a097fa640 1 -- 172.21.15.7:0/4243353553 <== mds.1 v2:172.21.15.27:6838/556391029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56002115c680 con 0x560020da9070 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a097fa640 10 client.18411 handle_command_reply: tid=0 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a2e753740 1 client.18411 shutdown 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a2e753740 1 -- 172.21.15.7:0/4243353553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d88390 msgr2=0x560021160b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a2e753740 1 --2- 172.21.15.7:0/4243353553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d88390 0x560021160b20 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f0a18000f80 tx=0x7f0a18011aa0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a2e753740 1 -- 172.21.15.7:0/4243353553 shutdown_connections 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a2e753740 1 --2- 172.21.15.7:0/4243353553 >> [v2:172.21.15.27:6838/556391029,v1:172.21.15.27:6839/556391029] conn(0x560020da9070 0x5600211db550 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a2e753740 1 --2- 172.21.15.7:0/4243353553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560020d88390 0x560021160b20 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a2e753740 1 --2- 172.21.15.7:0/4243353553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x560020d801b0 0x5600211605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a2e753740 1 --2- 172.21.15.7:0/4243353553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x560020d679f0 0x5600211600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a097fa640 0 client.18411 ms_handle_reset on v2:172.21.15.27:6838/556391029 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.875+0000 7f0a2e753740 1 -- 172.21.15.7:0/4243353553 >> 172.21.15.7:0/4243353553 conn(0x560020d9d460 msgr2=0x56002115d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a2e753740 1 -- 172.21.15.7:0/4243353553 shutdown_connections 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a2e753740 1 -- 172.21.15.7:0/4243353553 wait complete. 2024-09-21T06:04:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a2e753740 20 client.18411 trim_cache size 0 max 16384 2024-09-21T06:04:05.882 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:04:05.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a281df640 1 -- 172.21.15.7:0/3080380095 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0a0c0b6700 msgr2=0x7f0a0c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a281df640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0a0c0b6700 0x7f0a0c0b8c10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0a18005fd0 tx=0x7f0a18009600 comp rx=0 tx=0).stop 2024-09-21T06:04:05.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a281df640 1 -- 172.21.15.7:0/3080380095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a20102a60 msgr2=0x7f0a200ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a281df640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a20102a60 0x7f0a200ff670 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00d950 tx=0x7f0a1c00de10 comp rx=0 tx=0).stop 2024-09-21T06:04:05.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a281df640 1 -- 172.21.15.7:0/3080380095 shutdown_connections 2024-09-21T06:04:05.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a281df640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f0a0c0b6700 0x7f0a0c0b8c10 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a281df640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a20108cf0 0x7f0a201000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a281df640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a201083a0 0x7f0a200ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a281df640 1 --2- 172.21.15.7:0/3080380095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a20102a60 0x7f0a200ff670 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a281df640 1 -- 172.21.15.7:0/3080380095 >> 172.21.15.7:0/3080380095 conn(0x7f0a20079730 msgr2=0x7f0a20101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:05.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a281df640 1 -- 172.21.15.7:0/3080380095 shutdown_connections 2024-09-21T06:04:05.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:05.876+0000 7f0a281df640 1 -- 172.21.15.7:0/3080380095 wait complete. 2024-09-21T06:04:06.462 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:06 smithi007 ceph-mon[30983]: pgmap v632: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:04:06.462 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:06.462 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:06.463 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:06.463 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:06.463 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:06.490 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:04:06.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:06 smithi119 ceph-mon[34833]: pgmap v632: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:04:06.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:06 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:06.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:06 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:06.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:06 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:06.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:06 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:06.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:06 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:06.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:06 smithi027 ceph-mon[34364]: pgmap v632: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:04:06.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:06 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:06.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:06 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:06.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:06 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:06.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:06 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:06.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:06 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' 2024-09-21T06:04:06.748 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.216+0000 7f8b73e8b640 1 -- 172.21.15.7:0/2437714343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b6c102a60 msgr2=0x7f8b6c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.216+0000 7f8b73e8b640 1 --2- 172.21.15.7:0/2437714343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b6c102a60 0x7f8b6c102e70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009900 tx=0x7f8b6402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.216+0000 7f8b73e8b640 1 -- 172.21.15.7:0/2437714343 shutdown_connections 2024-09-21T06:04:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.216+0000 7f8b73e8b640 1 --2- 172.21.15.7:0/2437714343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b6c108cf0 0x7f8b6c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.216+0000 7f8b73e8b640 1 --2- 172.21.15.7:0/2437714343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b6c1083a0 0x7f8b6c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.216+0000 7f8b73e8b640 1 --2- 172.21.15.7:0/2437714343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b6c102a60 0x7f8b6c102e70 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.216+0000 7f8b73e8b640 1 -- 172.21.15.7:0/2437714343 >> 172.21.15.7:0/2437714343 conn(0x7f8b6c079730 msgr2=0x7f8b6c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.216+0000 7f8b73e8b640 1 -- 172.21.15.7:0/2437714343 shutdown_connections 2024-09-21T06:04:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.216+0000 7f8b73e8b640 1 -- 172.21.15.7:0/2437714343 wait complete. 2024-09-21T06:04:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.217+0000 7f8b73e8b640 1 Processor -- start 2024-09-21T06:04:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.217+0000 7f8b73e8b640 1 -- start start 2024-09-21T06:04:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.217+0000 7f8b73e8b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b6c102a60 0x7f8b6c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.217+0000 7f8b73e8b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b6c1083a0 0x7f8b6c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.217+0000 7f8b73e8b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b6c108cf0 0x7f8b6c19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.217+0000 7f8b73e8b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c113ac0 con 0x7f8b6c102a60 2024-09-21T06:04:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.217+0000 7f8b73e8b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c113940 con 0x7f8b6c108cf0 2024-09-21T06:04:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.217+0000 7f8b73e8b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c113c40 con 0x7f8b6c1083a0 2024-09-21T06:04:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.217+0000 7f8b71c27640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b6c102a60 0x7f8b6c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.217+0000 7f8b71c27640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b6c102a60 0x7f8b6c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42558/0 (socket says 172.21.15.7:42558) 2024-09-21T06:04:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.217+0000 7f8b71c27640 1 -- 172.21.15.7:0/537537062 learned_addr learned my addr 172.21.15.7:0/537537062 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.217+0000 7f8b71426640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b6c1083a0 0x7f8b6c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.217+0000 7f8b72428640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b6c108cf0 0x7f8b6c19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.218+0000 7f8b71c27640 1 -- 172.21.15.7:0/537537062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b6c1083a0 msgr2=0x7f8b6c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.218+0000 7f8b71c27640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b6c1083a0 0x7f8b6c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.218+0000 7f8b71c27640 1 -- 172.21.15.7:0/537537062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b6c108cf0 msgr2=0x7f8b6c19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.218+0000 7f8b71c27640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b6c108cf0 0x7f8b6c19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.218+0000 7f8b71c27640 1 -- 172.21.15.7:0/537537062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6c1a0360 con 0x7f8b6c102a60 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.218+0000 7f8b72428640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b6c108cf0 0x7f8b6c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.218+0000 7f8b71c27640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b6c102a60 0x7f8b6c19a4b0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f8b64006010 tx=0x7f8b640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.218+0000 7f8b6affd640 1 -- 172.21.15.7:0/537537062 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6403f030 con 0x7f8b6c102a60 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.218+0000 7f8b6affd640 1 -- 172.21.15.7:0/537537062 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b64003800 con 0x7f8b6c102a60 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.218+0000 7f8b6affd640 1 -- 172.21.15.7:0/537537062 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64035070 con 0x7f8b6c102a60 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.218+0000 7f8b73e8b640 1 -- 172.21.15.7:0/537537062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6c1a05f0 con 0x7f8b6c102a60 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.218+0000 7f8b73e8b640 1 -- 172.21.15.7:0/537537062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6c1a0b00 con 0x7f8b6c102a60 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.221+0000 7f8b7a3ff740 1 Processor -- start 2024-09-21T06:04:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.221+0000 7f8b7a3ff740 1 -- start start 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.221+0000 7f8b6affd640 1 -- 172.21.15.7:0/537537062 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f8b64003cb0 con 0x7f8b6c102a60 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.221+0000 7f8b7a3ff740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab2a070 0x5651eaed16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b7a3ff740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab011b0 0x5651eaed1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b7a3ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaed2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b7a3ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5651eae47ea0 con 0x5651eab09390 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b7a3ff740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5651eae372d0 con 0x5651eab011b0 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b7a3ff740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5651eae3b0e0 con 0x5651eab2a070 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b71426640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaed2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b71426640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaed2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42570/0 (socket says 172.21.15.7:42570) 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b71426640 1 -- 172.21.15.7:0/2395408166 learned_addr learned my addr 172.21.15.7:0/2395408166 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b71c27640 1 --2- 172.21.15.7:0/2395408166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab011b0 0x5651eaed1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b72428640 1 --2- 172.21.15.7:0/2395408166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab2a070 0x5651eaed16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b71426640 1 -- 172.21.15.7:0/2395408166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab2a070 msgr2=0x5651eaed16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b71426640 1 --2- 172.21.15.7:0/2395408166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab2a070 0x5651eaed16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b71426640 1 -- 172.21.15.7:0/2395408166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab011b0 msgr2=0x5651eaed1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b71426640 1 --2- 172.21.15.7:0/2395408166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab011b0 0x5651eaed1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b71426640 1 -- 172.21.15.7:0/2395408166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651eab95650 con 0x5651eab09390 2024-09-21T06:04:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b71c27640 1 --2- 172.21.15.7:0/2395408166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab011b0 0x5651eaed1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b71426640 1 --2- 172.21.15.7:0/2395408166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaed2120 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000cc00 tx=0x7f8b6000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f256142e1d2fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.222+0000 7f8b6affd640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b540b66b0 0x7f8b540b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.223+0000 7f8b53fff640 1 -- 172.21.15.7:0/2395408166 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60005220 con 0x5651eab09390 2024-09-21T06:04:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.223+0000 7f8b72428640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b540b66b0 0x7f8b540b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.223+0000 7f8b53fff640 1 -- 172.21.15.7:0/2395408166 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b60004c50 con 0x5651eab09390 2024-09-21T06:04:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.223+0000 7f8b53fff640 1 -- 172.21.15.7:0/2395408166 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60010790 con 0x5651eab09390 2024-09-21T06:04:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.223+0000 7f8b6affd640 1 -- 172.21.15.7:0/537537062 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f8b64108080 con 0x7f8b6c102a60 2024-09-21T06:04:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.224+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/2395408166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 msgr2=0x5651eaed2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.224+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/2395408166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaed2120 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000cc00 tx=0x7f8b6000e720 comp rx=0 tx=0).stop 2024-09-21T06:04:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.224+0000 7f8b72428640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b540b66b0 0x7f8b540b8bc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00f4c0 tx=0x7f8b5c007740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.224+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/2395408166 shutdown_connections 2024-09-21T06:04:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.224+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/2395408166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaed2120 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.224+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/2395408166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab011b0 0x5651eaed1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.224+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/2395408166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab2a070 0x5651eaed16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.224+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/2395408166 >> 172.21.15.7:0/2395408166 conn(0x5651eab1e460 msgr2=0x5651eaecf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.224+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/2395408166 shutdown_connections 2024-09-21T06:04:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.224+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/2395408166 wait complete. 2024-09-21T06:04:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.224+0000 7f8b7a3ff740 1 -- start start 2024-09-21T06:04:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.224+0000 7f8b7a3ff740 1 Processor -- start 2024-09-21T06:04:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.225+0000 7f8b7a3ff740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab011b0 0x5651eaedcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.225+0000 7f8b7a3ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaedd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.225+0000 7f8b7a3ff740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab2a070 0x5651eaedd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.225+0000 7f8b7a3ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5651eac98700 con 0x5651eab09390 2024-09-21T06:04:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.225+0000 7f8b7a3ff740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x5651eadd2160 con 0x5651eab2a070 2024-09-21T06:04:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.225+0000 7f8b7a3ff740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5651eaedfe80 con 0x5651eab011b0 2024-09-21T06:04:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.225+0000 7f8b7a3ff740 10 client.0 _ll_register_callbacks cb 0x5651eadeb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.225+0000 7f8b71426640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaedd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.225+0000 7f8b71426640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaedd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42572/0 (socket says 172.21.15.7:42572) 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.225+0000 7f8b71426640 1 -- 172.21.15.7:0/3848779618 learned_addr learned my addr 172.21.15.7:0/3848779618 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.225+0000 7f8b71c27640 1 --2- 172.21.15.7:0/3848779618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab011b0 0x5651eaedcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.225+0000 7f8b72428640 1 --2- 172.21.15.7:0/3848779618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab2a070 0x5651eaedd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.225+0000 7f8b71426640 1 -- 172.21.15.7:0/3848779618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab011b0 msgr2=0x5651eaedcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.226+0000 7f8b71426640 1 --2- 172.21.15.7:0/3848779618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab011b0 0x5651eaedcca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.226+0000 7f8b71426640 1 -- 172.21.15.7:0/3848779618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab2a070 msgr2=0x5651eaedd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.226+0000 7f8b71426640 1 --2- 172.21.15.7:0/3848779618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab2a070 0x5651eaedd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.226+0000 7f8b71426640 1 -- 172.21.15.7:0/3848779618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651eadffc90 con 0x5651eab09390 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.226+0000 7f8b71426640 1 --2- 172.21.15.7:0/3848779618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaedd1e0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f8b60005770 tx=0x7f8b6000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258bb24d569f9b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.226+0000 7f8b517fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.226+0000 7f8b517fa640 1 -- 172.21.15.7:0/3848779618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6002a060 con 0x5651eab09390 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.226+0000 7f8b517fa640 1 -- 172.21.15.7:0/3848779618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f8b600050d0 con 0x5651eab09390 2024-09-21T06:04:07.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.226+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3848779618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b60004c50 con 0x5651eab09390 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.226+0000 7f8b517fa640 1 -- 172.21.15.7:0/3848779618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8b600052d0 con 0x5651eab09390 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.226+0000 7f8b7a3ff740 10 client.18423 fetch_fsmap learned FSMap version 25 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.226+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3848779618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5651eaeebae0 con 0x5651eab09390 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.226+0000 7f8b517fa640 1 -- 172.21.15.7:0/3848779618 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b60004c50 con 0x5651eab09390 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.227+0000 7f8b517fa640 1 -- 172.21.15.7:0/3848779618 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8b6002f460 con 0x5651eab09390 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.227+0000 7f8b7a3ff740 10 client.18423 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.227+0000 7f8b7a3ff740 10 client.18423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.227+0000 7f8b7a3ff740 20 client.18423 populate_metadata read hostname 'smithi007' 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.227+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/3848779618 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5651eaae89f0 0x5651eaeeeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.227+0000 7f8b7a3ff740 4 client.18423 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.227+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3848779618 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651eae49df0 con 0x5651eaae89f0 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.227+0000 7f8b71c27640 1 --2- 172.21.15.7:0/3848779618 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5651eaae89f0 0x5651eaeeeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.228+0000 7f8b71c27640 1 --2- 172.21.15.7:0/3848779618 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5651eaae89f0 0x5651eaeeeef0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4f08a8fe4738b02 server_cookie=496c7b343c688af1 in_seq=0 out_seq=0 2024-09-21T06:04:07.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.228+0000 7f8b517fa640 10 client.18423 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:04:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.228+0000 7f8b517fa640 1 -- 172.21.15.7:0/3848779618 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5651eae49df0 con 0x5651eaae89f0 2024-09-21T06:04:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.228+0000 7f8b517fa640 10 client.18423 handle_command_reply: tid=0 2024-09-21T06:04:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.228+0000 7f8b7a3ff740 1 client.18423 shutdown 2024-09-21T06:04:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.228+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3848779618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 msgr2=0x5651eaedd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.228+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/3848779618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaedd1e0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f8b60005770 tx=0x7f8b6000c940 comp rx=0 tx=0).stop 2024-09-21T06:04:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.229+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3848779618 shutdown_connections 2024-09-21T06:04:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.229+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/3848779618 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5651eaae89f0 0x5651eaeeeef0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.229+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/3848779618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaedd1e0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.229+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/3848779618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab2a070 0x5651eaedd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.229+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/3848779618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab011b0 0x5651eaedcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.229+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3848779618 >> 172.21.15.7:0/3848779618 conn(0x5651eab1e460 msgr2=0x5651eaed4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.229+0000 7f8b517fa640 0 client.18423 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:04:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.229+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3848779618 shutdown_connections 2024-09-21T06:04:07.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.229+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3848779618 wait complete. 2024-09-21T06:04:07.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.229+0000 7f8b7a3ff740 20 client.18423 trim_cache size 0 max 16384 2024-09-21T06:04:07.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.242+0000 7f8b7a3ff740 1 Processor -- start 2024-09-21T06:04:07.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.242+0000 7f8b7a3ff740 1 -- start start 2024-09-21T06:04:07.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b7a3ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab011b0 0x5651eaed3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b7a3ff740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab09390 0x5651eaede8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b7a3ff740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab2a070 0x5651eaed9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b7a3ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c1b1ef0 con 0x5651eab011b0 2024-09-21T06:04:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b7a3ff740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c1af7c0 con 0x5651eab2a070 2024-09-21T06:04:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b7a3ff740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c1ad630 con 0x5651eab09390 2024-09-21T06:04:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b71c27640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab011b0 0x5651eaed3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b71426640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab09390 0x5651eaede8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b71c27640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab011b0 0x5651eaed3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42576/0 (socket says 172.21.15.7:42576) 2024-09-21T06:04:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b71c27640 1 -- 172.21.15.7:0/631672915 learned_addr learned my addr 172.21.15.7:0/631672915 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b72428640 1 --2- 172.21.15.7:0/631672915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab2a070 0x5651eaed9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b71c27640 1 -- 172.21.15.7:0/631672915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab09390 msgr2=0x5651eaede8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:07.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b71c27640 1 --2- 172.21.15.7:0/631672915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab09390 0x5651eaede8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b71c27640 1 -- 172.21.15.7:0/631672915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab2a070 msgr2=0x5651eaed9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:07.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b71c27640 1 --2- 172.21.15.7:0/631672915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab2a070 0x5651eaed9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b71c27640 1 -- 172.21.15.7:0/631672915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651eaedf3e0 con 0x5651eab011b0 2024-09-21T06:04:07.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.243+0000 7f8b71c27640 1 --2- 172.21.15.7:0/631672915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab011b0 0x5651eaed3090 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f8b640cdf50 tx=0x7f8b640f1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41125009ae414897 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:07.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.244+0000 7f8b537fe640 1 -- 172.21.15.7:0/631672915 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64049030 con 0x5651eab011b0 2024-09-21T06:04:07.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.244+0000 7f8b537fe640 1 -- 172.21.15.7:0/631672915 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b640ce6c0 con 0x5651eab011b0 2024-09-21T06:04:07.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.244+0000 7f8b537fe640 1 -- 172.21.15.7:0/631672915 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6410a0e0 con 0x5651eab011b0 2024-09-21T06:04:07.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.244+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/631672915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab011b0 msgr2=0x5651eaed3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.244+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/631672915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab011b0 0x5651eaed3090 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f8b640cdf50 tx=0x7f8b640f1040 comp rx=0 tx=0).stop 2024-09-21T06:04:07.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.244+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/631672915 shutdown_connections 2024-09-21T06:04:07.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.244+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/631672915 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab2a070 0x5651eaed9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.244+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/631672915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab09390 0x5651eaede8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.244+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/631672915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab011b0 0x5651eaed3090 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.244+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/631672915 >> 172.21.15.7:0/631672915 conn(0x5651eab1e460 msgr2=0x5651eaede1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.245+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/631672915 shutdown_connections 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.245+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/631672915 wait complete. 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.245+0000 7f8b7a3ff740 1 -- start start 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.245+0000 7f8b7a3ff740 1 Processor -- start 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b7a3ff740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab011b0 0x5651eaef25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b7a3ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaeefb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b7a3ff740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab2a070 0x5651eaef0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b7a3ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c1adc80 con 0x5651eab09390 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b7a3ff740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c1af0f0 con 0x5651eab011b0 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b7a3ff740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c1ae350 con 0x5651eab2a070 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b7a3ff740 10 client.0 _ll_register_callbacks cb 0x7f8b60014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b71426640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaeefb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b71426640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaeefb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42584/0 (socket says 172.21.15.7:42584) 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b71426640 1 -- 172.21.15.7:0/3516679822 learned_addr learned my addr 172.21.15.7:0/3516679822 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b72428640 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab2a070 0x5651eaef0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b71c27640 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab011b0 0x5651eaef25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b71426640 1 -- 172.21.15.7:0/3516679822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab2a070 msgr2=0x5651eaef0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b71426640 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab2a070 0x5651eaef0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b71426640 1 -- 172.21.15.7:0/3516679822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab011b0 msgr2=0x5651eaef25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b71426640 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab011b0 0x5651eaef25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b71426640 1 -- 172.21.15.7:0/3516679822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651eaef06a0 con 0x5651eab09390 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b71c27640 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab011b0 0x5651eaef25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b71426640 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaeefb20 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f8b6002f800 tx=0x7f8b6000c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bea49545540c465 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.246+0000 7f8b517fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b517fa640 1 -- 172.21.15.7:0/3516679822 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6002a040 con 0x5651eab09390 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b517fa640 1 -- 172.21.15.7:0/3516679822 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f8b600050d0 con 0x5651eab09390 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3516679822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b640ce6c0 con 0x5651eab09390 2024-09-21T06:04:07.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b517fa640 1 -- 172.21.15.7:0/3516679822 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8b60004c50 con 0x5651eab09390 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b7a3ff740 10 client.18429 fetch_fsmap learned FSMap version 25 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3516679822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5651eaf59460 con 0x5651eab09390 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b517fa640 1 -- 172.21.15.7:0/3516679822 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b640ce6c0 con 0x5651eab09390 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b517fa640 1 -- 172.21.15.7:0/3516679822 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8b60003710 con 0x5651eab09390 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b7a3ff740 10 client.18429 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b7a3ff740 10 client.18429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b7a3ff740 20 client.18429 populate_metadata read hostname 'smithi007' 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5651eaabdda0 0x5651eaf5bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b7a3ff740 4 client.18429 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.247+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3516679822 --> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5651eae458a0 con 0x5651eaabdda0 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.248+0000 7f8b71c27640 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5651eaabdda0 0x5651eaf5bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.248+0000 7f8b517fa640 10 client.18429 ms_handle_connect on v2:172.21.15.119:6838/1840148228 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.248+0000 7f8b71c27640 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5651eaabdda0 0x5651eaf5bae0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fb12fd274b24529 server_cookie=aad171680d95bc78 in_seq=0 out_seq=0 2024-09-21T06:04:07.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.248+0000 7f8b517fa640 1 -- 172.21.15.7:0/3516679822 <== mds.0 v2:172.21.15.119:6838/1840148228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5651eae458a0 con 0x5651eaabdda0 2024-09-21T06:04:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.248+0000 7f8b517fa640 10 client.18429 handle_command_reply: tid=0 2024-09-21T06:04:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.248+0000 7f8b7a3ff740 1 client.18429 shutdown 2024-09-21T06:04:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.248+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3516679822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 msgr2=0x5651eaeefb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.248+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaeefb20 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f8b6002f800 tx=0x7f8b6000c4f0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3516679822 shutdown_connections 2024-09-21T06:04:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.119:6838/1840148228,v1:172.21.15.119:6839/1840148228] conn(0x5651eaabdda0 0x5651eaf5bae0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5651eab09390 0x5651eaeefb20 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5651eab2a070 0x5651eaef0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b7a3ff740 1 --2- 172.21.15.7:0/3516679822 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5651eab011b0 0x5651eaef25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b517fa640 0 client.18429 ms_handle_reset on v2:172.21.15.119:6838/1840148228 2024-09-21T06:04:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3516679822 >> 172.21.15.7:0/3516679822 conn(0x5651eab1e460 msgr2=0x5651eaee8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3516679822 shutdown_connections 2024-09-21T06:04:07.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b7a3ff740 1 -- 172.21.15.7:0/3516679822 wait complete. 2024-09-21T06:04:07.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b7a3ff740 20 client.18429 trim_cache size 0 max 16384 2024-09-21T06:04:07.256 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:04:07.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b73e8b640 1 -- 172.21.15.7:0/537537062 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b540b66b0 msgr2=0x7f8b540b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b73e8b640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b540b66b0 0x7f8b540b8bc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00f4c0 tx=0x7f8b5c007740 comp rx=0 tx=0).stop 2024-09-21T06:04:07.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b73e8b640 1 -- 172.21.15.7:0/537537062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b6c102a60 msgr2=0x7f8b6c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b73e8b640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b6c102a60 0x7f8b6c19a4b0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f8b64006010 tx=0x7f8b640042f0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b73e8b640 1 -- 172.21.15.7:0/537537062 shutdown_connections 2024-09-21T06:04:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b73e8b640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f8b540b66b0 0x7f8b540b8bc0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b73e8b640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8b6c108cf0 0x7f8b6c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b73e8b640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b6c1083a0 0x7f8b6c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b73e8b640 1 --2- 172.21.15.7:0/537537062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b6c102a60 0x7f8b6c19a4b0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.249+0000 7f8b73e8b640 1 -- 172.21.15.7:0/537537062 >> 172.21.15.7:0/537537062 conn(0x7f8b6c079730 msgr2=0x7f8b6c101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.250+0000 7f8b73e8b640 1 -- 172.21.15.7:0/537537062 shutdown_connections 2024-09-21T06:04:07.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:07.250+0000 7f8b73e8b640 1 -- 172.21.15.7:0/537537062 wait complete. 2024-09-21T06:04:07.937 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T06:04:07.938 INFO:tasks.fwd_scrub:done joining 2024-09-21T06:04:07.938 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T06:04:07.949 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:04:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.067+0000 7ffacc227640 1 -- 172.21.15.7:0/3887349430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffac41029d0 msgr2=0x7ffac4102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.067+0000 7ffacc227640 1 --2- 172.21.15.7:0/3887349430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffac41029d0 0x7ffac4102de0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009900 tx=0x7ffac002a410 comp rx=0 tx=0).stop 2024-09-21T06:04:08.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.067+0000 7ffacc227640 1 -- 172.21.15.7:0/3887349430 shutdown_connections 2024-09-21T06:04:08.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.067+0000 7ffacc227640 1 --2- 172.21.15.7:0/3887349430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffac4108c50 0x7ffac410f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.067+0000 7ffacc227640 1 --2- 172.21.15.7:0/3887349430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffac4108300 0x7ffac4108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.067+0000 7ffacc227640 1 --2- 172.21.15.7:0/3887349430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffac41029d0 0x7ffac4102de0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.067+0000 7ffacc227640 1 -- 172.21.15.7:0/3887349430 >> 172.21.15.7:0/3887349430 conn(0x7ffac407a660 msgr2=0x7ffac407aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.068+0000 7ffacc227640 1 -- 172.21.15.7:0/3887349430 shutdown_connections 2024-09-21T06:04:08.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.068+0000 7ffacc227640 1 -- 172.21.15.7:0/3887349430 wait complete. 2024-09-21T06:04:08.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.068+0000 7ffacc227640 1 Processor -- start 2024-09-21T06:04:08.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.068+0000 7ffacc227640 1 -- start start 2024-09-21T06:04:08.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffacc227640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffac41029d0 0x7ffac4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffacc227640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffac4108300 0x7ffac41998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffacc227640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffac4108c50 0x7ffac419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffacc227640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffac4112910 con 0x7ffac41029d0 2024-09-21T06:04:08.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffacc227640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ffac4112790 con 0x7ffac4108c50 2024-09-21T06:04:08.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffacc227640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffac4112a90 con 0x7ffac4108300 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffac9fc3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffac41029d0 0x7ffac4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffac9fc3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffac41029d0 0x7ffac4199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42598/0 (socket says 172.21.15.7:42598) 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffac9fc3640 1 -- 172.21.15.7:0/2316209258 learned_addr learned my addr 172.21.15.7:0/2316209258 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffac97c2640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffac4108300 0x7ffac41998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffaca7c4640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffac4108c50 0x7ffac419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffac9fc3640 1 -- 172.21.15.7:0/2316209258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffac4108300 msgr2=0x7ffac41998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffac9fc3640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffac4108300 0x7ffac41998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffac9fc3640 1 -- 172.21.15.7:0/2316209258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffac4108c50 msgr2=0x7ffac419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffac9fc3640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffac4108c50 0x7ffac419eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffac9fc3640 1 -- 172.21.15.7:0/2316209258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac419f280 con 0x7ffac41029d0 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffac9fc3640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffac41029d0 0x7ffac4199350 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7ffac0005940 tx=0x7ffac00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.069+0000 7ffabaffd640 1 -- 172.21.15.7:0/2316209258 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac003f030 con 0x7ffac41029d0 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.070+0000 7ffabaffd640 1 -- 172.21.15.7:0/2316209258 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffac0003cb0 con 0x7ffac41029d0 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.070+0000 7ffacc227640 1 -- 172.21.15.7:0/2316209258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac419f510 con 0x7ffac41029d0 2024-09-21T06:04:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.070+0000 7ffabaffd640 1 -- 172.21.15.7:0/2316209258 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0035070 con 0x7ffac41029d0 2024-09-21T06:04:08.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.070+0000 7ffacc227640 1 -- 172.21.15.7:0/2316209258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac41a5d00 con 0x7ffac41029d0 2024-09-21T06:04:08.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.071+0000 7ffacc227640 1 -- 172.21.15.7:0/2316209258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac4103c40 con 0x7ffac41029d0 2024-09-21T06:04:08.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.072+0000 7ffabaffd640 1 -- 172.21.15.7:0/2316209258 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7ffac0042030 con 0x7ffac41029d0 2024-09-21T06:04:08.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.073+0000 7ffabaffd640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ffab00b6680 0x7ffab00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.073+0000 7ffac97c2640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ffab00b6680 0x7ffab00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.073+0000 7ffabaffd640 1 -- 172.21.15.7:0/2316209258 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7ffac0108230 con 0x7ffac41029d0 2024-09-21T06:04:08.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.074+0000 7ffac97c2640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ffab00b6680 0x7ffab00b8b90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ffac4107e80 tx=0x7ffab400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.076+0000 7ffabaffd640 1 -- 172.21.15.7:0/2316209258 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffac00ce7d0 con 0x7ffac41029d0 2024-09-21T06:04:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.269+0000 7ffacc227640 1 -- 172.21.15.7:0/2316209258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffac4102de0 con 0x7ffac41029d0 2024-09-21T06:04:08.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.271+0000 7ffabaffd640 1 -- 172.21.15.7:0/2316209258 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22983 (secure 0 0 0) 0x7ffac4102de0 con 0x7ffac41029d0 2024-09-21T06:04:08.273 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:04:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":84,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:43:32.863896+0000","modified":"2024-09-21T06:04:08.239550+0000","last_up_change":"2024-09-21T05:51:02.074799+0000","last_in_change":"2024-09-21T05:50:39.016405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:47:20.844179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:51:46.238763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:51:48.832249+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":84,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d7a68ba-a599-44a9-a0de-a1d6df51f437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6803","nonce":536257283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6805","nonce":536257283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6809","nonce":536257283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6807","nonce":536257283}]},"public_addr":"172.21.15.7:6803/536257283","cluster_addr":"172.21.15.7:6805/536257283","heartbeat_back_addr":"172.21.15.7:6809/536257283","heartbeat_front_addr":"172.21.15.7:6807/536257283","state":["exists","up"]},{"osd":1,"uuid":"d4600805-1cb5-432a-8ae0-a40107a6c6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6801","nonce":2299402871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6803","nonce":2299402871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6807","nonce":2299402871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6805","nonce":2299402871}]},"public_addr":"172.21.15.27:6801/2299402871","cluster_addr":"172.21.15.27:6803/2299402871","heartbeat_back_addr":"172.21.15.27:6807/2299402871","heartbeat_front_addr":"172.21.15.27:6805/2299402871","state":["exists","up"]},{"osd":2,"uuid":"aa435f82-5819-4497-9053-1d891e712b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6801","nonce":1043408043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6803","nonce":1043408043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6807","nonce":1043408043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6805","nonce":1043408043}]},"public_addr":"172.21.15.119:6801/1043408043","cluster_addr":"172.21.15.119:6803/1043408043","heartbeat_back_addr":"172.21.15.119:6807/1043408043","heartbeat_front_addr":"172.21.15.119:6805/1043408043","state":["exists","up"]},{"osd":3,"uuid":"55803f97-02e1-43c0-b8da-9b8af32fd1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6811","nonce":1261229771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6813","nonce":1261229771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6817","nonce":1261229771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6815","nonce":1261229771}]},"public_addr":"172.21.15.7:6811/1261229771","cluster_addr":"172.21.15.7:6813/1261229771","heartbeat_back_addr":"172.21.15.7:6817/1261229771","heartbeat_front_addr":"172.21.15.7:6815/1261229771","state":["exists","up"]},{"osd":4,"uuid":"987ce230-5bfc-45a7-a33e-6291545afded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6809","nonce":631467792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6811","nonce":631467792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6815","nonce":631467792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6813","nonce":631467792}]},"public_addr":"172.21.15.27:6809/631467792","cluster_addr":"172.21.15.27:6811/631467792","heartbeat_back_addr":"172.21.15.27:6815/631467792","heartbeat_front_addr":"172.21.15.27:6813/631467792","state":["exists","up"]},{"osd":5,"uuid":"e768fbfa-8983-4ff6-8dca-b7df2304cf91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6809","nonce":2530968619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6811","nonce":2530968619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6815","nonce":2530968619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6813","nonce":2530968619}]},"public_addr":"172.21.15.119:6809/2530968619","cluster_addr":"172.21.15.119:6811/2530968619","heartbeat_back_addr":"172.21.15.119:6815/2530968619","heartbeat_front_addr":"172.21.15.119:6813/2530968619","state":["exists","up"]},{"osd":6,"uuid":"22496f13-64be-479b-89ea-bf51544199c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6819","nonce":856032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6821","nonce":856032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6825","nonce":856032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6823","nonce":856032021}]},"public_addr":"172.21.15.7:6819/856032021","cluster_addr":"172.21.15.7:6821/856032021","heartbeat_back_addr":"172.21.15.7:6825/856032021","heartbeat_front_addr":"172.21.15.7:6823/856032021","state":["exists","up"]},{"osd":7,"uuid":"53fc5616-b06a-498e-a60e-d7d7d6ba2a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6817","nonce":2862843529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6819","nonce":2862843529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6823","nonce":2862843529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6821","nonce":2862843529}]},"public_addr":"172.21.15.27:6817/2862843529","cluster_addr":"172.21.15.27:6819/2862843529","heartbeat_back_addr":"172.21.15.27:6823/2862843529","heartbeat_front_addr":"172.21.15.27:6821/2862843529","state":["exists","up"]},{"osd":8,"uuid":"53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6817","nonce":3663835202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6819","nonce":3663835202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6823","nonce":3663835202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6821","nonce":3663835202}]},"public_addr":"172.21.15.119:6817/3663835202","cluster_addr":"172.21.15.119:6819/3663835202","heartbeat_back_addr":"172.21.15.119:6823/3663835202","heartbeat_front_addr":"172.21.15.119:6821/3663835202","state":["exists","up"]},{"osd":9,"uuid":"a69a747d-1e6c-4940-9d96-4315ab384588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6827","nonce":2348805959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6829","nonce":2348805959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6833","nonce":2348805959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6831","nonce":2348805959}]},"public_addr":"172.21.15.7:6827/2348805959","cluster_addr":"172.21.15.7:6829/2348805959","heartbeat_back_addr":"172.21.15.7:6833/2348805959","heartbeat_front_addr":"172.21.15.7:6831/2348805959","state":["exists","up"]},{"osd":10,"uuid":"a8f67271-99bb-4fb7-b0f5-a24730cd96cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6825","nonce":2363600090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6827","nonce":2363600090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6831","nonce":2363600090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6829","nonce":2363600090}]},"public_addr":"172.21.15.27:6825/2363600090","cluster_addr":"172.21.15.27:6827/2363600090","heartbeat_back_addr":"172.21.15.27:6831/2363600090","heartbeat_front_addr":"172.21.15.27:6829/2363600090","state":["exists","up"]},{"osd":11,"uuid":"88456735-00b1-479c-b201-588a9ee0c881","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6825","nonce":3937692826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6827","nonce":3937692826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6831","nonce":3937692826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6829","nonce":3937692826}]},"public_addr":"172.21.15.119:6825/3937692826","cluster_addr":"172.21.15.119:6827/3937692826","heartbeat_back_addr":"172.21.15.119:6831/3937692826","heartbeat_front_addr":"172.21.15.119:6829/3937692826","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:26.217550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:51.830871+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:17.201362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:41.990894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:07.357782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.114180+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:56.808155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:22.565234+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:46.981522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:10.600602+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:35.973766+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:51:00.216062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/4143746508":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/1505943829":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/1622456881":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/833696585":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/2055984288":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6801/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3995317885":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2229583478":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/468393974":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/1009303060":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2125734440":"2024-09-22T05:45:22.373420+0000","172.21.15.7:6800/3995317885":"2024-09-22T05:45:22.373420+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:04:08.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.273+0000 7ffacc227640 1 -- 172.21.15.7:0/2316209258 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ffab00b6680 msgr2=0x7ffab00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.273+0000 7ffacc227640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ffab00b6680 0x7ffab00b8b90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ffac4107e80 tx=0x7ffab400b390 comp rx=0 tx=0).stop 2024-09-21T06:04:08.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.273+0000 7ffacc227640 1 -- 172.21.15.7:0/2316209258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffac41029d0 msgr2=0x7ffac4199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.273+0000 7ffacc227640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffac41029d0 0x7ffac4199350 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7ffac0005940 tx=0x7ffac00042f0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.273+0000 7ffacc227640 1 -- 172.21.15.7:0/2316209258 shutdown_connections 2024-09-21T06:04:08.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.273+0000 7ffacc227640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7ffab00b6680 0x7ffab00b8b90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.273+0000 7ffacc227640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffac4108c50 0x7ffac419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.273+0000 7ffacc227640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffac4108300 0x7ffac41998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.273+0000 7ffacc227640 1 --2- 172.21.15.7:0/2316209258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffac41029d0 0x7ffac4199350 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.273+0000 7ffacc227640 1 -- 172.21.15.7:0/2316209258 >> 172.21.15.7:0/2316209258 conn(0x7ffac407a660 msgr2=0x7ffac4106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.273+0000 7ffacc227640 1 -- 172.21.15.7:0/2316209258 shutdown_connections 2024-09-21T06:04:08.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.273+0000 7ffacc227640 1 -- 172.21.15.7:0/2316209258 wait complete. 2024-09-21T06:04:08.287 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T05:47:20.844179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T05:51:46.238763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T05:51:48.832249+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 84, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:04:08.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:04:08.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.402+0000 7f22b2b4a640 1 -- 172.21.15.7:0/795994505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22ac1082d0 msgr2=0x7f22ac1086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.402+0000 7f22b2b4a640 1 --2- 172.21.15.7:0/795994505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22ac1082d0 0x7f22ac1086e0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f2294009900 tx=0x7f229402a410 comp rx=0 tx=0).stop 2024-09-21T06:04:08.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.402+0000 7f22b2b4a640 1 -- 172.21.15.7:0/795994505 shutdown_connections 2024-09-21T06:04:08.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.402+0000 7f22b2b4a640 1 --2- 172.21.15.7:0/795994505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22ac1082d0 0x7f22ac1086e0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.402+0000 7f22b2b4a640 1 --2- 172.21.15.7:0/795994505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22ac108c20 0x7f22ac10f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.402+0000 7f22b2b4a640 1 --2- 172.21.15.7:0/795994505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22ac1029a0 0x7f22ac102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.402+0000 7f22b2b4a640 1 -- 172.21.15.7:0/795994505 >> 172.21.15.7:0/795994505 conn(0x7f22ac0fe3e0 msgr2=0x7f22ac100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.402+0000 7f22b2b4a640 1 -- 172.21.15.7:0/795994505 shutdown_connections 2024-09-21T06:04:08.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.402+0000 7f22b2b4a640 1 -- 172.21.15.7:0/795994505 wait complete. 2024-09-21T06:04:08.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.403+0000 7f22b2b4a640 1 Processor -- start 2024-09-21T06:04:08.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.403+0000 7f22b2b4a640 1 -- start start 2024-09-21T06:04:08.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.403+0000 7f22b2b4a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22ac1029a0 0x7f22ac1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.403+0000 7f22b2b4a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22ac1082d0 0x7f22ac199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.403+0000 7f22b2b4a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22ac108c20 0x7f22ac19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.403+0000 7f22b2b4a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac1128e0 con 0x7f22ac1029a0 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.403+0000 7f22b2b4a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac112760 con 0x7f22ac1082d0 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.403+0000 7f22b2b4a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac112a60 con 0x7f22ac108c20 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.403+0000 7f22b08e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22ac1029a0 0x7f22ac1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.403+0000 7f22b08e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22ac1029a0 0x7f22ac1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42614/0 (socket says 172.21.15.7:42614) 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.403+0000 7f22b08e6640 1 -- 172.21.15.7:0/1798574418 learned_addr learned my addr 172.21.15.7:0/1798574418 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.403+0000 7f22b10e7640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22ac108c20 0x7f22ac19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.403+0000 7f22abfff640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22ac1082d0 0x7f22ac199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.404+0000 7f22b08e6640 1 -- 172.21.15.7:0/1798574418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22ac108c20 msgr2=0x7f22ac19eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.404+0000 7f22b08e6640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22ac108c20 0x7f22ac19eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.404+0000 7f22b08e6640 1 -- 172.21.15.7:0/1798574418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22ac1082d0 msgr2=0x7f22ac199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.404+0000 7f22b08e6640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22ac1082d0 0x7f22ac199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.404+0000 7f22b08e6640 1 -- 172.21.15.7:0/1798574418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ac19f180 con 0x7f22ac1029a0 2024-09-21T06:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.404+0000 7f22abfff640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22ac1082d0 0x7f22ac199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:08.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.404+0000 7f22b08e6640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22ac1029a0 0x7f22ac1992e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f229c007b50 tx=0x7f229c00e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:08.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.404+0000 7f22a9ffb640 1 -- 172.21.15.7:0/1798574418 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c007c40 con 0x7f22ac1029a0 2024-09-21T06:04:08.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.404+0000 7f22b2b4a640 1 -- 172.21.15.7:0/1798574418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ac19f470 con 0x7f22ac1029a0 2024-09-21T06:04:08.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.404+0000 7f22a9ffb640 1 -- 172.21.15.7:0/1798574418 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f229c007de0 con 0x7f22ac1029a0 2024-09-21T06:04:08.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.404+0000 7f22a9ffb640 1 -- 172.21.15.7:0/1798574418 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c00ace0 con 0x7f22ac1029a0 2024-09-21T06:04:08.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.404+0000 7f22b2b4a640 1 -- 172.21.15.7:0/1798574418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ac06a890 con 0x7f22ac1029a0 2024-09-21T06:04:08.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.405+0000 7f22b2b4a640 1 -- 172.21.15.7:0/1798574418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ac103c10 con 0x7f22ac1029a0 2024-09-21T06:04:08.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.407+0000 7f22a9ffb640 1 -- 172.21.15.7:0/1798574418 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f229c00eb30 con 0x7f22ac1029a0 2024-09-21T06:04:08.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.408+0000 7f22a9ffb640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22980b6680 0x7f22980b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.408+0000 7f22abfff640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22980b6680 0x7f22980b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.408+0000 7f22a9ffb640 1 -- 172.21.15.7:0/1798574418 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f229c0e8f70 con 0x7f22ac1029a0 2024-09-21T06:04:08.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.408+0000 7f22abfff640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22980b6680 0x7f22980b8b90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2294009230 tx=0x7f2294000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:08.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.411+0000 7f22a9ffb640 1 -- 172.21.15.7:0/1798574418 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f229c023060 con 0x7f22ac1029a0 2024-09-21T06:04:08.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:08 smithi007 ceph-mon[30983]: pgmap v633: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:04:08.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:08 smithi119 ceph-mon[34833]: pgmap v633: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:04:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.608+0000 7f22b2b4a640 1 -- 172.21.15.7:0/1798574418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f22ac102db0 con 0x7f22ac1029a0 2024-09-21T06:04:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.609+0000 7f22a9ffb640 1 -- 172.21.15.7:0/1798574418 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f22ac102db0 con 0x7f22ac1029a0 2024-09-21T06:04:08.610 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-21T06:04:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.611+0000 7f22b2b4a640 1 -- 172.21.15.7:0/1798574418 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22980b6680 msgr2=0x7f22980b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.611+0000 7f22b2b4a640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22980b6680 0x7f22980b8b90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2294009230 tx=0x7f2294000bc0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.611+0000 7f22b2b4a640 1 -- 172.21.15.7:0/1798574418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22ac1029a0 msgr2=0x7f22ac1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.611+0000 7f22b2b4a640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22ac1029a0 0x7f22ac1992e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f229c007b50 tx=0x7f229c00e420 comp rx=0 tx=0).stop 2024-09-21T06:04:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.611+0000 7f22b2b4a640 1 -- 172.21.15.7:0/1798574418 shutdown_connections 2024-09-21T06:04:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.611+0000 7f22b2b4a640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f22980b6680 0x7f22980b8b90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.611+0000 7f22b2b4a640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22ac108c20 0x7f22ac19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.611+0000 7f22b2b4a640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22ac1082d0 0x7f22ac199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.611+0000 7f22b2b4a640 1 --2- 172.21.15.7:0/1798574418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22ac1029a0 0x7f22ac1992e0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.611+0000 7f22b2b4a640 1 -- 172.21.15.7:0/1798574418 >> 172.21.15.7:0/1798574418 conn(0x7f22ac0fe3e0 msgr2=0x7f22ac100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.611+0000 7f22b2b4a640 1 -- 172.21.15.7:0/1798574418 shutdown_connections 2024-09-21T06:04:08.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.611+0000 7f22b2b4a640 1 -- 172.21.15.7:0/1798574418 wait complete. 2024-09-21T06:04:08.624 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T06:04:08.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:08 smithi027 ceph-mon[34364]: pgmap v633: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.739+0000 7f7e39abd640 1 -- 172.21.15.7:0/3920557551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e34108c30 msgr2=0x7f7e3410f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.739+0000 7f7e39abd640 1 --2- 172.21.15.7:0/3920557551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e34108c30 0x7f7e3410f460 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c009ca0 tx=0x7f7e2c02a8e0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.739+0000 7f7e39abd640 1 -- 172.21.15.7:0/3920557551 shutdown_connections 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.739+0000 7f7e39abd640 1 --2- 172.21.15.7:0/3920557551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e34108c30 0x7f7e3410f460 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.739+0000 7f7e39abd640 1 --2- 172.21.15.7:0/3920557551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e341082e0 0x7f7e341086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.739+0000 7f7e39abd640 1 --2- 172.21.15.7:0/3920557551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e341029b0 0x7f7e34102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.739+0000 7f7e39abd640 1 -- 172.21.15.7:0/3920557551 >> 172.21.15.7:0/3920557551 conn(0x7f7e340fe390 msgr2=0x7f7e341007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.739+0000 7f7e39abd640 1 -- 172.21.15.7:0/3920557551 shutdown_connections 2024-09-21T06:04:08.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.739+0000 7f7e39abd640 1 -- 172.21.15.7:0/3920557551 wait complete. 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.740+0000 7f7e39abd640 1 Processor -- start 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.740+0000 7f7e39abd640 1 -- start start 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.740+0000 7f7e39abd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e341029b0 0x7f7e3419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.740+0000 7f7e39abd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e341082e0 0x7f7e3419b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.740+0000 7f7e39abd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e34108c30 0x7f7e3419bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.740+0000 7f7e39abd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7e34112930 con 0x7f7e341029b0 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.740+0000 7f7e39abd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7e341127b0 con 0x7f7e34108c30 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.740+0000 7f7e39abd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7e34112ab0 con 0x7f7e341082e0 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.740+0000 7f7e337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e341029b0 0x7f7e3419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.740+0000 7f7e337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e341029b0 0x7f7e3419b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38776/0 (socket says 172.21.15.7:38776) 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.740+0000 7f7e337fe640 1 -- 172.21.15.7:0/468770253 learned_addr learned my addr 172.21.15.7:0/468770253 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.740+0000 7f7e33fff640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e34108c30 0x7f7e3419bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.741+0000 7f7e2affd640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e341082e0 0x7f7e3419b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.741+0000 7f7e337fe640 1 -- 172.21.15.7:0/468770253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e341082e0 msgr2=0x7f7e3419b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.741+0000 7f7e337fe640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e341082e0 0x7f7e3419b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.741+0000 7f7e337fe640 1 -- 172.21.15.7:0/468770253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e34108c30 msgr2=0x7f7e3419bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.741+0000 7f7e337fe640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e34108c30 0x7f7e3419bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.741+0000 7f7e337fe640 1 -- 172.21.15.7:0/468770253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e341a64a0 con 0x7f7e341029b0 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.741+0000 7f7e337fe640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e341029b0 0x7f7e3419b1e0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400d950 tx=0x7f7e2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.741+0000 7f7e317fa640 1 -- 172.21.15.7:0/468770253 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24017070 con 0x7f7e341029b0 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.741+0000 7f7e317fa640 1 -- 172.21.15.7:0/468770253 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e24009c30 con 0x7f7e341029b0 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.741+0000 7f7e39abd640 1 -- 172.21.15.7:0/468770253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e341a6790 con 0x7f7e341029b0 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.741+0000 7f7e317fa640 1 -- 172.21.15.7:0/468770253 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400f620 con 0x7f7e341029b0 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.741+0000 7f7e39abd640 1 -- 172.21.15.7:0/468770253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e341a6d60 con 0x7f7e341029b0 2024-09-21T06:04:08.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.742+0000 7f7e39abd640 1 -- 172.21.15.7:0/468770253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e34102dc0 con 0x7f7e341029b0 2024-09-21T06:04:08.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.744+0000 7f7e317fa640 1 -- 172.21.15.7:0/468770253 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f7e24010460 con 0x7f7e341029b0 2024-09-21T06:04:08.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.745+0000 7f7e317fa640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e200b6680 0x7f7e200b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.745+0000 7f7e2affd640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e200b6680 0x7f7e200b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.745+0000 7f7e317fa640 1 -- 172.21.15.7:0/468770253 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f7e240e73c0 con 0x7f7e341029b0 2024-09-21T06:04:08.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.746+0000 7f7e2affd640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e200b6680 0x7f7e200b8b90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7e34100c00 tx=0x7f7e1c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:08.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.748+0000 7f7e317fa640 1 -- 172.21.15.7:0/468770253 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7e240ad8d0 con 0x7f7e341029b0 2024-09-21T06:04:08.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.938+0000 7f7e39abd640 1 -- 172.21.15.7:0/468770253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7e3402e640 con 0x7f7e341029b0 2024-09-21T06:04:08.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.939+0000 7f7e317fa640 1 -- 172.21.15.7:0/468770253 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f7e24009de0 con 0x7f7e341029b0 2024-09-21T06:04:08.940 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-21T06:04:08.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.941+0000 7f7e39abd640 1 -- 172.21.15.7:0/468770253 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e200b6680 msgr2=0x7f7e200b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.941+0000 7f7e39abd640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e200b6680 0x7f7e200b8b90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7e34100c00 tx=0x7f7e1c008040 comp rx=0 tx=0).stop 2024-09-21T06:04:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.941+0000 7f7e39abd640 1 -- 172.21.15.7:0/468770253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e341029b0 msgr2=0x7f7e3419b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.941+0000 7f7e39abd640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e341029b0 0x7f7e3419b1e0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400d950 tx=0x7f7e2400de10 comp rx=0 tx=0).stop 2024-09-21T06:04:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.941+0000 7f7e39abd640 1 -- 172.21.15.7:0/468770253 shutdown_connections 2024-09-21T06:04:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.941+0000 7f7e39abd640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f7e200b6680 0x7f7e200b8b90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.941+0000 7f7e39abd640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e34108c30 0x7f7e3419bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.941+0000 7f7e39abd640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e341082e0 0x7f7e3419b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.941+0000 7f7e39abd640 1 --2- 172.21.15.7:0/468770253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e341029b0 0x7f7e3419b1e0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.941+0000 7f7e39abd640 1 -- 172.21.15.7:0/468770253 >> 172.21.15.7:0/468770253 conn(0x7f7e340fe390 msgr2=0x7f7e3406aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.941+0000 7f7e39abd640 1 -- 172.21.15.7:0/468770253 shutdown_connections 2024-09-21T06:04:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:08.941+0000 7f7e39abd640 1 -- 172.21.15.7:0/468770253 wait complete. 2024-09-21T06:04:08.954 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T06:04:09.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.069+0000 7f27a33c6640 1 -- 172.21.15.7:0/1480359456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c10dda0 msgr2=0x7f279c110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.069+0000 7f27a33c6640 1 --2- 172.21.15.7:0/1480359456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c10dda0 0x7f279c110290 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f2794009ca0 tx=0x7f279402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.069+0000 7f27a33c6640 1 -- 172.21.15.7:0/1480359456 shutdown_connections 2024-09-21T06:04:09.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.069+0000 7f27a33c6640 1 --2- 172.21.15.7:0/1480359456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c10dda0 0x7f279c110290 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.069+0000 7f27a33c6640 1 --2- 172.21.15.7:0/1480359456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f279c105220 0x7f279c10d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.069+0000 7f27a33c6640 1 --2- 172.21.15.7:0/1480359456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f279c1047f0 0x7f279c104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.069+0000 7f27a33c6640 1 -- 172.21.15.7:0/1480359456 >> 172.21.15.7:0/1480359456 conn(0x7f279c0fe3c0 msgr2=0x7f279c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.069+0000 7f27a33c6640 1 -- 172.21.15.7:0/1480359456 shutdown_connections 2024-09-21T06:04:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.069+0000 7f27a33c6640 1 -- 172.21.15.7:0/1480359456 wait complete. 2024-09-21T06:04:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.070+0000 7f27a33c6640 1 Processor -- start 2024-09-21T06:04:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.070+0000 7f27a33c6640 1 -- start start 2024-09-21T06:04:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.070+0000 7f27a33c6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f279c1047f0 0x7f279c19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.070+0000 7f27a33c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c105220 0x7f279c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.070+0000 7f27a33c6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f279c10dda0 0x7f279c19fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.070+0000 7f27a33c6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f279c113a00 con 0x7f279c105220 2024-09-21T06:04:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.070+0000 7f27a33c6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f279c113880 con 0x7f279c10dda0 2024-09-21T06:04:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.070+0000 7f27a33c6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f279c113b80 con 0x7f279c1047f0 2024-09-21T06:04:09.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.070+0000 7f27a0961640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c105220 0x7f279c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.070+0000 7f27a0961640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c105220 0x7f279c19a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38804/0 (socket says 172.21.15.7:38804) 2024-09-21T06:04:09.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f27a0961640 1 -- 172.21.15.7:0/2966242459 learned_addr learned my addr 172.21.15.7:0/2966242459 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:09.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f27a1963640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f279c10dda0 0x7f279c19fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f27a1162640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f279c1047f0 0x7f279c19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f27a0961640 1 -- 172.21.15.7:0/2966242459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f279c1047f0 msgr2=0x7f279c19a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f27a0961640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f279c1047f0 0x7f279c19a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f27a0961640 1 -- 172.21.15.7:0/2966242459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f279c10dda0 msgr2=0x7f279c19fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f27a0961640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f279c10dda0 0x7f279c19fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f27a0961640 1 -- 172.21.15.7:0/2966242459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c1a02f0 con 0x7f279c105220 2024-09-21T06:04:09.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f27a0961640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c105220 0x7f279c19a960 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f2798005d00 tx=0x7f279800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:09.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f278e7fc640 1 -- 172.21.15.7:0/2966242459 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798017070 con 0x7f279c105220 2024-09-21T06:04:09.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f278e7fc640 1 -- 172.21.15.7:0/2966242459 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2798009c30 con 0x7f279c105220 2024-09-21T06:04:09.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f27a33c6640 1 -- 172.21.15.7:0/2966242459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279c1a05e0 con 0x7f279c105220 2024-09-21T06:04:09.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f278e7fc640 1 -- 172.21.15.7:0/2966242459 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279800f620 con 0x7f279c105220 2024-09-21T06:04:09.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.071+0000 7f27a33c6640 1 -- 172.21.15.7:0/2966242459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f279c1a6d70 con 0x7f279c105220 2024-09-21T06:04:09.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.072+0000 7f27a33c6640 1 -- 172.21.15.7:0/2966242459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f279c104c00 con 0x7f279c105220 2024-09-21T06:04:09.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.074+0000 7f278e7fc640 1 -- 172.21.15.7:0/2966242459 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f279801a070 con 0x7f279c105220 2024-09-21T06:04:09.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.075+0000 7f278e7fc640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27880b6680 0x7f27880b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.075+0000 7f27a1162640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27880b6680 0x7f27880b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.075+0000 7f278e7fc640 1 -- 172.21.15.7:0/2966242459 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f27980e7100 con 0x7f279c105220 2024-09-21T06:04:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.075+0000 7f27a1162640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27880b6680 0x7f27880b8b90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2790009b60 tx=0x7f2790005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:09.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.078+0000 7f278e7fc640 1 -- 172.21.15.7:0/2966242459 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2798009de0 con 0x7f279c105220 2024-09-21T06:04:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.266+0000 7f27a33c6640 1 -- 172.21.15.7:0/2966242459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f279c1a6fa0 con 0x7f279c105220 2024-09-21T06:04:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.267+0000 7f278e7fc640 1 -- 172.21.15.7:0/2966242459 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f27980ad610 con 0x7f279c105220 2024-09-21T06:04:09.269 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-21T06:04:09.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.269+0000 7f27a33c6640 1 -- 172.21.15.7:0/2966242459 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27880b6680 msgr2=0x7f27880b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.269+0000 7f27a33c6640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27880b6680 0x7f27880b8b90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2790009b60 tx=0x7f2790005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:09.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.269+0000 7f27a33c6640 1 -- 172.21.15.7:0/2966242459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c105220 msgr2=0x7f279c19a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.269+0000 7f27a33c6640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c105220 0x7f279c19a960 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f2798005d00 tx=0x7f279800dde0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.269+0000 7f27a33c6640 1 -- 172.21.15.7:0/2966242459 shutdown_connections 2024-09-21T06:04:09.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.269+0000 7f27a33c6640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f27880b6680 0x7f27880b8b90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.269+0000 7f27a33c6640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f279c105220 0x7f279c19a960 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.269+0000 7f27a33c6640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f279c10dda0 0x7f279c19fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.269+0000 7f27a33c6640 1 --2- 172.21.15.7:0/2966242459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f279c1047f0 0x7f279c19a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.269+0000 7f27a33c6640 1 -- 172.21.15.7:0/2966242459 >> 172.21.15.7:0/2966242459 conn(0x7f279c0fe3c0 msgr2=0x7f279c0ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:09.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.269+0000 7f27a33c6640 1 -- 172.21.15.7:0/2966242459 shutdown_connections 2024-09-21T06:04:09.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.269+0000 7f27a33c6640 1 -- 172.21.15.7:0/2966242459 wait complete. 2024-09-21T06:04:09.282 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T06:04:09.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.393+0000 7f79284d5640 1 -- 172.21.15.7:0/430009213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7920102040 msgr2=0x7f7920102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.393+0000 7f79284d5640 1 --2- 172.21.15.7:0/430009213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7920102040 0x7f7920102450 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f791c009900 tx=0x7f791c02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.393+0000 7f79284d5640 1 -- 172.21.15.7:0/430009213 shutdown_connections 2024-09-21T06:04:09.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.393+0000 7f79284d5640 1 --2- 172.21.15.7:0/430009213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7920109d60 0x7f7920110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.393+0000 7f79284d5640 1 --2- 172.21.15.7:0/430009213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7920109410 0x7f7920109820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.393+0000 7f79284d5640 1 --2- 172.21.15.7:0/430009213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7920102040 0x7f7920102450 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.393+0000 7f79284d5640 1 -- 172.21.15.7:0/430009213 >> 172.21.15.7:0/430009213 conn(0x7f7920079e70 msgr2=0x7f792007a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:09.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.393+0000 7f79284d5640 1 -- 172.21.15.7:0/430009213 shutdown_connections 2024-09-21T06:04:09.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.393+0000 7f79284d5640 1 -- 172.21.15.7:0/430009213 wait complete. 2024-09-21T06:04:09.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.393+0000 7f79284d5640 1 Processor -- start 2024-09-21T06:04:09.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f79284d5640 1 -- start start 2024-09-21T06:04:09.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f79284d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7920102040 0x7f792019c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f79284d5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7920109410 0x7f792019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f79284d5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7920109d60 0x7f79201a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f79284d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7920113a20 con 0x7f7920102040 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f79284d5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f79201138a0 con 0x7f7920109410 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f79284d5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7920113ba0 con 0x7f7920109d60 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f7926271640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7920102040 0x7f792019c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f7926271640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7920102040 0x7f792019c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38832/0 (socket says 172.21.15.7:38832) 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f7926271640 1 -- 172.21.15.7:0/2534229024 learned_addr learned my addr 172.21.15.7:0/2534229024 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f7926271640 1 -- 172.21.15.7:0/2534229024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7920109d60 msgr2=0x7f79201a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f7926271640 1 --2- 172.21.15.7:0/2534229024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7920109d60 0x7f79201a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f7926271640 1 -- 172.21.15.7:0/2534229024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7920109410 msgr2=0x7f792019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f7926271640 1 --2- 172.21.15.7:0/2534229024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7920109410 0x7f792019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f7926271640 1 -- 172.21.15.7:0/2534229024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79201a24e0 con 0x7f7920102040 2024-09-21T06:04:09.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.394+0000 7f7926271640 1 --2- 172.21.15.7:0/2534229024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7920102040 0x7f792019c640 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f791c005940 tx=0x7f791c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:09.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.395+0000 7f79177fe640 1 -- 172.21.15.7:0/2534229024 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c03f030 con 0x7f7920102040 2024-09-21T06:04:09.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.395+0000 7f79177fe640 1 -- 172.21.15.7:0/2534229024 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f791c003cb0 con 0x7f7920102040 2024-09-21T06:04:09.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.395+0000 7f79284d5640 1 -- 172.21.15.7:0/2534229024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79201a2770 con 0x7f7920102040 2024-09-21T06:04:09.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.395+0000 7f79177fe640 1 -- 172.21.15.7:0/2534229024 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c035070 con 0x7f7920102040 2024-09-21T06:04:09.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.395+0000 7f79284d5640 1 -- 172.21.15.7:0/2534229024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79201a2c60 con 0x7f7920102040 2024-09-21T06:04:09.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.396+0000 7f79284d5640 1 -- 172.21.15.7:0/2534229024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7920102450 con 0x7f7920102040 2024-09-21T06:04:09.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.397+0000 7f79177fe640 1 -- 172.21.15.7:0/2534229024 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f791c042030 con 0x7f7920102040 2024-09-21T06:04:09.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.398+0000 7f79177fe640 1 --2- 172.21.15.7:0/2534229024 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f790c0b6680 0x7f790c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.398+0000 7f7925a70640 1 --2- 172.21.15.7:0/2534229024 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f790c0b6680 0x7f790c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.398+0000 7f79177fe640 1 -- 172.21.15.7:0/2534229024 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f791c108370 con 0x7f7920102040 2024-09-21T06:04:09.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.399+0000 7f7925a70640 1 --2- 172.21.15.7:0/2534229024 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f790c0b6680 0x7f790c0b8b90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7920108d10 tx=0x7f7910005ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.401+0000 7f79177fe640 1 -- 172.21.15.7:0/2534229024 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f791c0ce880 con 0x7f7920102040 2024-09-21T06:04:09.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:09 smithi007 ceph-mon[30983]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:04:09.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:09 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2316209258' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:04:09.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:09 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1798574418' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:04:09.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:09 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/468770253' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:04:09.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:09 smithi119 ceph-mon[34833]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:04:09.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:09 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2316209258' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:04:09.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:09 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1798574418' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:04:09.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:09 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/468770253' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:04:09.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.642+0000 7f79284d5640 1 -- 172.21.15.7:0/2534229024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f79201a9230 con 0x7f7920102040 2024-09-21T06:04:09.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.651+0000 7f79177fe640 1 -- 172.21.15.7:0/2534229024 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) ==== 81+0+834041 (secure 0 0 0) 0x7f791c0d2c60 con 0x7f7920102040 2024-09-21T06:04:09.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:04:09.663 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:04:09.663 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 24, 2024-09-21T06:04:09.663 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.663 INFO:teuthology.orchestra.run.smithi007.stdout: "active_gid": 14223, 2024-09-21T06:04:09.663 INFO:teuthology.orchestra.run.smithi007.stdout: "active_name": "x", 2024-09-21T06:04:09.663 INFO:teuthology.orchestra.run.smithi007.stdout: "active_addrs": { 2024-09-21T06:04:09.663 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:04:09.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.663 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:04:09.663 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6800", 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2451017072 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6801", 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2451017072 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: "active_addr": "172.21.15.7:6801/2451017072", 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: "active_change": "2024-09-21T05:45:22.373551+0000", 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: "available": true, 2024-09-21T06:04:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: "standbys": [ 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: "gid": 24154, 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "z", 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.665 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.666 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.667 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.668 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.669 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.669 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.669 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.669 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.669 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.669 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.669 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.669 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.669 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.669 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.669 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.669 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.670 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.671 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.673 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.674 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-21T06:04:09.675 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.676 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.677 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.678 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.679 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.680 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-21T06:04:09.681 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-21T06:04:09.682 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-21T06:04:09.683 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-21T06:04:09.684 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.685 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.686 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.687 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.688 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.691 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.692 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.693 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.694 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-21T06:04:09.695 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:09.696 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.697 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-21T06:04:09.698 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:09.699 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.706 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.708 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.709 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:04:09.710 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:09.711 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.712 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-21T06:04:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:04:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:04:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-21T06:04:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:09.714 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.715 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.716 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.719 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nginx": { 2024-09-21T06:04:09.720 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nginx", 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nginx container image", 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-21T06:04:09.721 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-21T06:04:09.722 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.723 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.725 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:04:09.725 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.725 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.725 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.725 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:09.725 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.725 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.725 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.725 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-21T06:04:09.725 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-21T06:04:09.725 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.725 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.726 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.726 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:04:09.726 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.726 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.726 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.726 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-21T06:04:09.726 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.726 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.726 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.726 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-09-21T06:04:09.726 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-09-21T06:04:09.726 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba_metrics": { 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:04:09.727 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:04:09.728 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.729 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.729 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.729 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:04:09.729 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.729 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.729 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.729 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:04:09.729 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.729 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.729 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-21T06:04:09.729 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:04:09.730 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:04:09.731 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.732 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.733 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.734 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.735 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.736 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:04:09.737 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.737 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.737 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.737 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:04:09.737 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.737 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.737 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.737 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-21T06:04:09.737 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-21T06:04:09.737 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.737 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.737 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.738 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:09.738 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.738 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.738 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.738 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:04:09.738 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.738 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.738 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.738 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-21T06:04:09.738 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-21T06:04:09.738 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.738 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.739 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.740 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.741 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.742 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.743 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.744 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.745 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.746 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.747 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.749 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.750 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-21T06:04:09.751 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.752 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.753 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.754 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.755 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.756 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.757 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.758 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:04:09.759 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.760 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.761 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.762 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_keepalive_interval": { 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-21T06:04:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-21T06:04:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:04:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.768 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.769 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.770 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.771 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.772 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.773 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.774 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.774 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.774 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.774 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-21T06:04:09.774 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-21T06:04:09.774 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.774 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.774 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.774 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-21T06:04:09.774 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.774 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.774 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.775 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.776 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.776 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.776 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.776 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.776 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-21T06:04:09.776 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-21T06:04:09.776 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.776 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.776 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.776 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-21T06:04:09.776 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.776 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.777 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.778 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.779 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:04:09.780 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:04:09.781 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.782 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.783 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.784 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.785 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.786 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.787 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.788 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.790 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.791 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.792 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.794 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.795 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.796 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.797 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.798 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "[]", 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "{}", 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.800 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.801 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.802 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:04:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:04:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.803 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.804 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.807 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:04:09.812 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:04:09.812 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.812 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.812 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.812 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:09.812 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.812 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.812 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.812 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.812 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.812 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.812 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.815 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:04:09.815 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:04:09.815 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.815 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.815 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.815 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.815 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.815 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.815 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.815 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.815 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.815 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.815 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.816 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.819 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-21T06:04:09.822 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-21T06:04:09.823 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.824 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.825 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.825 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.825 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.825 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.825 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.825 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:04:09.825 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.825 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.825 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.825 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-21T06:04:09.825 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-21T06:04:09.825 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.826 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.827 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.828 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.829 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.831 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.832 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.833 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-21T06:04:09.834 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.835 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.836 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.837 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.838 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: "sso_oauth2": { 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sso_oauth2", 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.839 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.840 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-21T06:04:09.841 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.842 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.843 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.844 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.845 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.846 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.847 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.847 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.847 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.847 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.847 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.847 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.847 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.847 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.847 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.847 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.847 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.847 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-21T06:04:09.849 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.850 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.851 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.853 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:09.854 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.855 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-21T06:04:09.856 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.857 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.858 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.858 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.858 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.858 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.858 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.858 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.858 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.858 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.858 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.858 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.858 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.858 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.858 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.859 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.860 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.861 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-21T06:04:09.862 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-21T06:04:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-21T06:04:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.868 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.869 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.871 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.872 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.873 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.874 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.875 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.876 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.877 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.878 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.878 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.878 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.878 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.878 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.878 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.878 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.878 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.878 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.878 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.878 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.878 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.879 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.880 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.881 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.882 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.883 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.888 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.890 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.891 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.891 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.891 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.891 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.891 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.891 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.891 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.891 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.891 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.891 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.891 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.891 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.892 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.893 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.894 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-21T06:04:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.896 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:04:09.910 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.911 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.912 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.913 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.916 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.917 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.917 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.917 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.917 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.917 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.917 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.917 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.917 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.917 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.917 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.917 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.917 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.919 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.920 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.921 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.923 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.924 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.925 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.926 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.927 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-21T06:04:09.928 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.929 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.929 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.929 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.929 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.929 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.929 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.929 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.929 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.929 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.929 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.929 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.929 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.929 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.931 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.931 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.931 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.931 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.931 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.931 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.931 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.931 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.931 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.931 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.931 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.931 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.932 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.933 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.933 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.933 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.933 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.933 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.933 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.933 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.933 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.933 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.933 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.933 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.933 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.934 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-21T06:04:09.935 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.936 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.938 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.940 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.941 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.942 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.943 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.944 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.945 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.946 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.947 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.948 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.949 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.950 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.951 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.952 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.953 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.954 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.955 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.956 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.957 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.958 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.959 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.959 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.959 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.959 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.959 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.959 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.959 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.959 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.959 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.959 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.959 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.962 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.963 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.965 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.966 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.967 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.968 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.970 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.970 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.970 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.970 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.970 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.970 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.970 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.970 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.970 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.970 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.970 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.970 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.970 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.971 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-21T06:04:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-21T06:04:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-21T06:04:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.974 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-21T06:04:09.975 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.976 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.977 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.979 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.980 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.981 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.982 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.983 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.985 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:04:09.986 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.987 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.988 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.989 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.990 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.991 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.992 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.993 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:09.994 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.995 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.996 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:09.997 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:09.998 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.998 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.998 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.998 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.998 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.998 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.998 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.998 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:09.998 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:09.998 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:09.998 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:09.998 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:09.999 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.000 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.000 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.000 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.000 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.000 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.000 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.000 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.000 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.000 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.000 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.000 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.001 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.002 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.003 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.004 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.005 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.006 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.008 INFO:teuthology.orchestra.run.smithi007.stdout: "max_requests": { 2024-09-21T06:04:10.008 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_requests", 2024-09-21T06:04:10.008 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.008 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.008 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.008 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:04:10.008 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.008 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.008 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.008 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:04:10.008 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.008 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.008 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.011 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.012 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.013 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.014 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.015 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.016 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.017 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.018 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.019 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.020 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.021 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.022 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.022 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.022 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.022 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.022 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.022 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.022 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.022 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.022 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.022 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.022 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.022 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.023 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.024 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.025 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.026 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.027 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.027 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.027 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.027 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.027 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.027 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.027 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.027 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.027 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.027 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.027 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.027 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.027 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.028 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.029 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.030 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.030 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.030 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.030 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.030 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.030 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.030 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.030 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.030 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.030 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.030 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.030 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.030 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.031 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.032 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.033 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.034 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.034 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-21T06:04:10.034 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-21T06:04:10.034 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.034 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.034 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.034 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.034 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.034 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.034 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.034 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.034 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.036 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.037 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.038 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.039 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.040 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.042 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.043 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.044 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smb", 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: "internal_store_backend": { 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "internal_store_backend", 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.045 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.046 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.049 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.050 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.051 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.052 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.052 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.052 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.052 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.052 INFO:teuthology.orchestra.run.smithi007.stdout: "update_orchestration": { 2024-09-21T06:04:10.052 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "update_orchestration", 2024-09-21T06:04:10.052 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.052 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.052 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.052 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.052 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.052 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.053 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.053 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:04:10.053 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.053 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.053 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.053 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.053 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.053 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-21T06:04:10.053 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.053 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.053 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.054 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.055 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.057 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.059 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.060 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.061 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-21T06:04:10.062 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.062 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.062 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.062 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.062 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.062 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.062 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.062 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.062 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.062 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.062 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.062 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.062 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.063 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.064 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.066 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.066 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.066 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.066 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.066 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.066 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.066 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.066 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.066 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.066 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.066 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.066 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.066 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.067 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.068 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.071 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.072 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.073 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-21T06:04:10.074 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:10.075 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.076 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.077 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.078 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.079 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.080 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.081 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.082 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.083 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.085 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-21T06:04:10.086 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-21T06:04:10.087 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.088 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.089 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.090 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.091 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.092 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.093 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.094 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.095 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.096 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.097 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.098 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.102 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.103 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.105 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.106 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.107 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.108 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.111 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.112 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.115 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.117 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.118 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.118 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.118 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:04:10.118 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.118 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.118 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.118 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:04:10.118 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:04:10.118 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.118 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.118 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.118 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.119 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.120 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.124 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.125 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.126 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.127 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.128 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.129 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.130 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.131 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.132 INFO:teuthology.orchestra.run.smithi007.stdout: "gid": 24155, 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "y", 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.133 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.134 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.136 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.137 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.138 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.139 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-21T06:04:10.140 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.141 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.142 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-21T06:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-21T06:04:10.145 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.145 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.145 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.145 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.145 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.145 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.145 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.145 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:04:10.145 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.145 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.145 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.145 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.146 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.148 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.149 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.150 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:04:10.151 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:04:10.152 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.153 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.156 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.157 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.158 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.159 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.160 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.161 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.163 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.164 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-21T06:04:10.165 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:04:10.166 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:10.167 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.167 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.167 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.167 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.167 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.167 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.167 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:04:10.167 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.167 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.167 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.167 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.167 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.168 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.169 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.170 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:04:10.171 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.172 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.173 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-09-21T06:04:10.174 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.175 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:04:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-21T06:04:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-21T06:04:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:04:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:10.178 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:04:10.179 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.180 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.181 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.182 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.183 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.184 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.186 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.187 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nginx": { 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nginx", 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nginx container image", 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-21T06:04:10.188 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-21T06:04:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:04:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.193 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba_metrics": { 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.194 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.195 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.196 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.197 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.198 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.199 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.200 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.201 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:04:10.202 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.203 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.205 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.206 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.207 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.208 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.209 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.210 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.211 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:04:10.212 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:04:10.213 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-21T06:04:10.214 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.216 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.216 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.216 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.216 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.216 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.216 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:04:10.216 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.216 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.216 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.216 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-21T06:04:10.216 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-21T06:04:10.216 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-21T06:04:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.219 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-21T06:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-21T06:04:10.221 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-21T06:04:10.222 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.223 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.224 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.225 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.226 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.227 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.228 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.228 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.228 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:04:10.228 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.228 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.228 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.228 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:04:10.228 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:04:10.228 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.228 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.228 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.228 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_keepalive_interval": { 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-21T06:04:10.229 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.230 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.231 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.233 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.234 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.235 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.236 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.237 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.238 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.238 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.238 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.238 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.238 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.238 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.238 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.238 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.238 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.238 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.238 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.238 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.239 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.240 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.241 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.242 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.243 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.244 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:04:10.245 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:04:10.246 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:04:10.247 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.248 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.249 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.250 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.251 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.252 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.253 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.253 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.253 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.253 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.253 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.253 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.253 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.253 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:04:10.253 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:04:10.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.253 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.253 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.254 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.255 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.256 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.257 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.257 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.257 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.257 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.257 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.257 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.257 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:04:10.257 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:04:10.257 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.257 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.257 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.257 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.258 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.259 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.260 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.261 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.262 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.264 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "[]", 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.265 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "{}", 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.267 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.272 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:04:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:04:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.274 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:04:10.274 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:04:10.274 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.274 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.274 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.274 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.274 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.274 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.274 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.274 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.274 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.274 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.274 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.276 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.277 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:04:10.278 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:04:10.278 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.278 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.278 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.278 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.278 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.278 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.278 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.278 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.278 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.278 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.278 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.281 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.282 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.283 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.284 INFO:teuthology.orchestra.run.smithi007.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.285 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:04:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-21T06:04:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-21T06:04:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: "sso_oauth2": { 2024-09-21T06:04:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sso_oauth2", 2024-09-21T06:04:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-21T06:04:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-21T06:04:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-21T06:04:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-21T06:04:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-21T06:04:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-21T06:04:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-21T06:04:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:04:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:04:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-21T06:04:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-21T06:04:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-21T06:04:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:04:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:04:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.424 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.424 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.424 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.424 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.424 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-21T06:04:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-21T06:04:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:04:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:04:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-21T06:04:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:04:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-21T06:04:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:04:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:04:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "max_requests": { 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_requests", 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-21T06:04:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-21T06:04:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-21T06:04:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-21T06:04:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-21T06:04:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-21T06:04:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smb", 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "internal_store_backend": { 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "internal_store_backend", 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:04:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "update_orchestration": { 2024-09-21T06:04:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "update_orchestration", 2024-09-21T06:04:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:04:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:04:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-21T06:04:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.539 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-21T06:04:10.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:10.542 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.543 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.544 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.546 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.547 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.548 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-21T06:04:10.549 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-21T06:04:10.550 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.550 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.550 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.550 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.550 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.550 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.550 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.550 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:04:10.550 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.550 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.550 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.550 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-21T06:04:10.551 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-21T06:04:10.552 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.552 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.552 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.552 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.552 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.552 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.552 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.552 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:04:10.552 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.552 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.552 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.552 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-21T06:04:10.553 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-21T06:04:10.554 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-21T06:04:10.555 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-21T06:04:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-21T06:04:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:10.558 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.559 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.560 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.561 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.562 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.564 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.565 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.567 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.568 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.569 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.570 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.570 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.570 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.570 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.570 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.570 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-21T06:04:10.570 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-21T06:04:10.570 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.570 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.570 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.570 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:04:10.570 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.573 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.575 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.576 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.577 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.578 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.579 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.580 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.581 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-21T06:04:10.582 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-09-21T06:04:10.583 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.584 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.585 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.586 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.587 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.588 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.589 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.590 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.591 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.592 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.593 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.594 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.595 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-21T06:04:10.596 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-21T06:04:10.597 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.598 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:04:10.599 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: "modules": [ 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: "dashboard", 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: "iostat", 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: "nfs", 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: "restful", 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_schedule" 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.600 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.601 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.602 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.603 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.604 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.605 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.605 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.605 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.605 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.605 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.605 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.605 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.605 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.605 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.605 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.605 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.605 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.605 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.609 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.610 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-21T06:04:10.611 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.612 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.613 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.615 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.616 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.616 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-21T06:04:10.616 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-21T06:04:10.616 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.616 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.616 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.616 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.616 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.616 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.616 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.616 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:04:10.616 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.616 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.617 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.618 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.619 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.621 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.622 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.624 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-21T06:04:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:10.631 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.632 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-21T06:04:10.633 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:04:10.634 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.636 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.638 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.639 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.640 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-09-21T06:04:10.641 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.642 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.644 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-21T06:04:10.645 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-21T06:04:10.646 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.647 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.648 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.649 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.650 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.651 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.652 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:04:10.653 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.654 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nginx": { 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nginx", 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.655 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nginx container image", 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.656 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-21T06:04:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.658 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.658 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.658 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:04:10.658 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:04:10.658 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.658 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.658 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.658 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:04:10.658 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.658 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.659 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.660 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:04:10.661 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba_metrics": { 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:04:10.662 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.663 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.666 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-21T06:04:10.667 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-21T06:04:10.668 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-21T06:04:10.669 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:04:10.670 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.671 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.672 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.673 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.674 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.676 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.677 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.678 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.679 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.680 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.682 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-21T06:04:10.684 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.685 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.686 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.687 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-21T06:04:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-21T06:04:10.689 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-21T06:04:10.690 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:04:10.691 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.692 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.694 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.695 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_keepalive_interval": { 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-21T06:04:10.696 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.697 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.698 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.699 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.700 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.701 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.702 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.703 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.704 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.705 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.706 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.707 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.708 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.709 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:04:10.710 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.711 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.712 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.714 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.715 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.716 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.717 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.719 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.720 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:04:10.721 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.722 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.722 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.722 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.722 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.722 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.722 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.722 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.722 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.722 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.722 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.722 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:04:10.722 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:04:10.723 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.724 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.725 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.726 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.727 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.728 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.730 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "[]", 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.731 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "{}", 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.733 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.734 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.735 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.736 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.737 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.738 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.739 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:04:10.741 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:04:10.742 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.743 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.744 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-21T06:04:10.745 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.746 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.747 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.748 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.749 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.750 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.755 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-21T06:04:10.756 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.757 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.758 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.759 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.760 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.761 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.762 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.764 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.765 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.766 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.767 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.769 INFO:teuthology.orchestra.run.smithi007.stdout: "sso_oauth2": { 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sso_oauth2", 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.770 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.771 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.773 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.774 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.775 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.777 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.778 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.779 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.780 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.781 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.782 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-21T06:04:10.783 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.784 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.785 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.786 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.787 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.788 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.789 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.790 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.795 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.796 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.797 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.798 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-21T06:04:10.798 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.798 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.798 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.798 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:04:10.798 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.798 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.798 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.798 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-21T06:04:10.798 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-21T06:04:10.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.798 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.799 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.800 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.801 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.803 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.805 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.806 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.807 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:04:10.808 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.809 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.810 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.811 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.812 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.813 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.814 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.816 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.817 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.818 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.818 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.818 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.818 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.818 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.818 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-21T06:04:10.818 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.818 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.818 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.818 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.818 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.819 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.820 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.821 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.822 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.823 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-21T06:04:10.824 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-21T06:04:10.825 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.826 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.827 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.828 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.829 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.830 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.831 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.831 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.831 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.831 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.831 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.831 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.831 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.831 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.831 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.831 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.831 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.831 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.832 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.832 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.832 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.832 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.833 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.833 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.833 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.833 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.833 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.834 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-21T06:04:10.834 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.834 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.834 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.834 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-21T06:04:10.834 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-21T06:04:10.834 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.834 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.834 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.834 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.835 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.837 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.838 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.839 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.840 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:04:10.841 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:04:10.842 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:04:10.843 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.844 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:04:10.845 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.846 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.847 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.848 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.849 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.850 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.851 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.852 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.853 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.854 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.856 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.858 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.859 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.860 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.861 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.862 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.862 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.862 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.862 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.862 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.862 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.862 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.862 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.862 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.862 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.862 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.862 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.862 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.864 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.865 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.866 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.867 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.868 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.869 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.870 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.872 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.873 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-21T06:04:10.874 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.874 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.874 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.874 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.874 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.874 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.874 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.874 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.874 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.874 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.874 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.874 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.874 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.876 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.877 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.878 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.879 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.880 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.882 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.882 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.882 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.882 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.882 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.882 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.882 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.882 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.882 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.882 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.882 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.882 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.883 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.884 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.885 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.886 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.887 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.889 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.890 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.891 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.892 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.893 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.894 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.895 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.896 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.897 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.898 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.898 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.898 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.898 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.898 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.898 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.898 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.898 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.898 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.898 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.898 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.898 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.900 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.901 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.902 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.903 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.904 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.905 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.906 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.908 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.910 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.911 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.914 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:04:10.914 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:04:10.914 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.914 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.914 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.914 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-21T06:04:10.914 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.914 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.914 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.914 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:04:10.914 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.914 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.914 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-21T06:04:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-21T06:04:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.920 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.921 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.922 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.923 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:04:10.924 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:04:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:04:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.926 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-21T06:04:10.927 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.928 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.931 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.932 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.933 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.935 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.935 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.935 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.935 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.935 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.935 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.935 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.935 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.935 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.935 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.935 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.935 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "max_requests": { 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_requests", 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.936 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.940 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.941 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.943 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.945 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.947 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.948 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.949 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.950 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.951 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-21T06:04:10.952 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.953 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.954 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.955 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.956 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.958 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-21T06:04:10.959 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-21T06:04:10.960 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-21T06:04:10.961 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-21T06:04:10.962 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-21T06:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-21T06:04:10.964 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.965 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.966 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.967 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.968 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.970 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smb", 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.971 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: "internal_store_backend": { 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "internal_store_backend", 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.973 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.974 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.975 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.976 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.977 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "update_orchestration": { 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "update_orchestration", 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.978 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-21T06:04:10.979 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.980 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.982 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.983 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.984 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.986 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.988 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.989 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.990 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.991 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.992 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:10.994 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.995 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.996 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:10.997 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:10.999 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-21T06:04:11.000 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:11.001 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.002 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.003 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.004 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:11.005 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.006 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.007 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:11.008 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.013 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.014 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-21T06:04:11.015 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-21T06:04:11.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:11.017 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.019 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.020 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.021 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:11.022 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:11.022 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:11.022 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:11.022 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:11.022 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:11.022 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:11.022 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.022 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.022 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.022 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.022 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:11.024 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.025 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.027 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.028 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.029 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.030 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.031 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.032 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:11.033 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.034 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:11.035 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:11.036 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:11.037 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.038 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:11.039 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.040 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-21T06:04:11.041 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-09-21T06:04:11.042 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:11.043 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.044 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:11.045 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:04:11.046 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.047 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:04:11.048 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:04:11.049 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.050 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.051 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:04:11.052 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:04:11.053 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.054 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.055 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.056 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:04:11.057 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: "services": { 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: "dashboard": "https://172.21.15.7:8443/" 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: "always_on_modules": { 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: "octopus": [ 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-21T06:04:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "pacific": [ 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-21T06:04:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "quincy": [ 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "reef": [ 2024-09-21T06:04:11.060 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "squid": [ 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-21T06:04:11.061 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: "last_failure_osd_epoch": 5, 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: "active_clients": [ 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 4081314363 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "libcephsqlite", 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1024329610 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1286981104 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 82825244 2024-09-21T06:04:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 990371067 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-21T06:04:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:04:11.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:04:11.066 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:04:11.066 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-21T06:04:11.066 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2761747325 2024-09-21T06:04:11.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.066 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:04:11.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.066 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:04:11.066 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:04:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.657+0000 7f79284d5640 1 -- 172.21.15.7:0/2534229024 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f790c0b6680 msgr2=0x7f790c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.657+0000 7f79284d5640 1 --2- 172.21.15.7:0/2534229024 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f790c0b6680 0x7f790c0b8b90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7920108d10 tx=0x7f7910005ed0 comp rx=0 tx=0).stop 2024-09-21T06:04:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.657+0000 7f79284d5640 1 -- 172.21.15.7:0/2534229024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7920102040 msgr2=0x7f792019c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:11.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.657+0000 7f79284d5640 1 --2- 172.21.15.7:0/2534229024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7920102040 0x7f792019c640 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f791c005940 tx=0x7f791c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:04:11.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.658+0000 7f79284d5640 1 -- 172.21.15.7:0/2534229024 shutdown_connections 2024-09-21T06:04:11.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.658+0000 7f79284d5640 1 --2- 172.21.15.7:0/2534229024 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f790c0b6680 0x7f790c0b8b90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:11.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.658+0000 7f79284d5640 1 --2- 172.21.15.7:0/2534229024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7920109d60 0x7f79201a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:11.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.658+0000 7f79284d5640 1 --2- 172.21.15.7:0/2534229024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7920109410 0x7f792019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:11.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.658+0000 7f79284d5640 1 --2- 172.21.15.7:0/2534229024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7920102040 0x7f792019c640 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:11.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.658+0000 7f79284d5640 1 -- 172.21.15.7:0/2534229024 >> 172.21.15.7:0/2534229024 conn(0x7f7920079e70 msgr2=0x7f7920107220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:11.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.658+0000 7f79284d5640 1 -- 172.21.15.7:0/2534229024 shutdown_connections 2024-09-21T06:04:11.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:09.658+0000 7f79284d5640 1 -- 172.21.15.7:0/2534229024 wait complete. 2024-09-21T06:04:11.107 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T06:04:11.108 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T06:04:11.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:10 smithi007 ceph-mon[30983]: pgmap v635: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:04:11.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:10 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2966242459' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:04:11.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:10 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2534229024' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:04:11.109 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:10 smithi119 ceph-mon[34833]: pgmap v635: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:04:11.109 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:10 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2966242459' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:04:11.109 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:10 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2534229024' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:04:11.110 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:09 smithi027 ceph-mon[34364]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:04:11.110 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:09 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2316209258' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:04:11.110 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:09 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1798574418' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:04:11.110 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:09 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/468770253' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:04:11.110 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:10 smithi027 ceph-mon[34364]: pgmap v635: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:04:11.110 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:10 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2966242459' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:04:11.110 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:10 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2534229024' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:04:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:11.899 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:04:11.899 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:11.899 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 212, 2024-09-21T06:04:11.899 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 205, 2024-09-21T06:04:11.899 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 837216, 2024-09-21T06:04:11.899 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 125152, 2024-09-21T06:04:11.899 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.039860544, 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.018968916, 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.025611445, 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 205, 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.014733412, 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000071870 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 837216, 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 125152 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1, 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 154, 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 107344, 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.015534288, 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.011993025, 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.001969007, 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 152, 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.007704172, 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000050685 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 107344 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 0, 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 2, 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 0, 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.000448301, 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.000357528, 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 149998, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 30, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-21T06:04:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 968, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 209, 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 804850, 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 209, 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-21T06:04:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 209, 2024-09-21T06:04:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 804850, 2024-09-21T06:04:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-21T06:04:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:11.910 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:04:12.512 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:12 smithi007 ceph-mon[30983]: pgmap v636: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:04:12.528 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:12 smithi027 ceph-mon[34364]: pgmap v636: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:04:12.545 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-21T06:04:12.545 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-21T06:04:12.545 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-21T06:04:12.545 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-21T06:04:12.545 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-21T06:04:12.546 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-21T06:04:12.546 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-21T06:04:12.546 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T06:04:12.546 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T06:04:12.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:12 smithi119 ceph-mon[34833]: pgmap v636: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:04:12.808 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:13.255 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:04:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 0, 2024-09-21T06:04:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 2, 2024-09-21T06:04:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:04:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 0, 2024-09-21T06:04:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-21T06:04:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.001524467, 2024-09-21T06:04:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.000372203, 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:04:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 218, 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 211, 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 838912, 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 128512, 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.041158000, 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.018909433, 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.030032527, 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 211, 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.016061329, 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000076120 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 838912, 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 128512 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1, 2024-09-21T06:04:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 158, 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 108048, 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.016169294, 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.013019245, 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.001349240, 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 156, 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.008458716, 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000054222 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 108048 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-21T06:04:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 148984, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 30, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-21T06:04:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 968, 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-21T06:04:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 215, 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 805694, 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 215, 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 215, 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 805694, 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:13.265 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:04:13.979 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T06:04:13.980 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T06:04:13.980 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-21T06:04:13.980 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-21T06:04:13.980 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-21T06:04:13.980 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-21T06:04:13.980 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-21T06:04:13.980 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T06:04:13.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T06:04:14.242 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:14.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:14 smithi007 ceph-mon[30983]: pgmap v637: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:04:14.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:14 smithi119 ceph-mon[34833]: pgmap v637: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:04:14.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:14 smithi027 ceph-mon[34364]: pgmap v637: 97 pgs: 97 active+clean; 2.4 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 0, 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 2, 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 0, 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.001349766, 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.000184489, 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:14.729 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 210, 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 205, 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 834832, 2024-09-21T06:04:14.730 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 125504, 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.038661371, 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.018834745, 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.027692955, 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 204, 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.011540950, 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000056573 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:14.731 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 834832, 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 125504 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 5, 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 157, 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 3152, 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 107968, 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.017551171, 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.012396653, 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.003571519, 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:14.732 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 156, 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.011976672, 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000076773 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 107968 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:14.733 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:14.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:14.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 149007, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 30, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-21T06:04:14.736 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 968, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 211, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 805174, 2024-09-21T06:04:14.737 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:14.738 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 211, 2024-09-21T06:04:14.738 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-21T06:04:14.738 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-21T06:04:14.738 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 211, 2024-09-21T06:04:14.738 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 805174, 2024-09-21T06:04:14.738 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-21T06:04:14.738 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:14.738 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:14.738 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:14.738 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:14.738 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:14.738 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:04:15.436 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-21T06:04:15.436 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-21T06:04:15.436 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-21T06:04:15.436 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-21T06:04:15.436 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-21T06:04:15.436 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-21T06:04:15.436 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-21T06:04:15.437 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T06:04:15.437 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T06:04:15.699 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:16.254 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:04:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 215, 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 210, 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 836192, 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 128688, 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.039415635, 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.018739602, 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.026836747, 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 209, 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.011939552, 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000057127 2024-09-21T06:04:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 836192, 2024-09-21T06:04:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 128688 2024-09-21T06:04:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 5, 2024-09-21T06:04:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 161, 2024-09-21T06:04:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 3152, 2024-09-21T06:04:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 108672, 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.018041965, 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.013057750, 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.003380574, 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 160, 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.011872444, 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000074202 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T06:04:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 108672 2024-09-21T06:04:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 0, 2024-09-21T06:04:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 2, 2024-09-21T06:04:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:04:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 0, 2024-09-21T06:04:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-21T06:04:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.000392014, 2024-09-21T06:04:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.000305474, 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:04:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 150038, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 31, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-21T06:04:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 968, 2024-09-21T06:04:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-21T06:04:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-21T06:04:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-21T06:04:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:04:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 216, 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 805824, 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 216, 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 216, 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 805824, 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:04:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:04:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:04:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:04:16.266 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:04:16.559 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:16 smithi007 ceph-mon[30983]: pgmap v638: 97 pgs: 97 active+clean; 2.4 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-21T06:04:16.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:16 smithi119 ceph-mon[34833]: pgmap v638: 97 pgs: 97 active+clean; 2.4 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-21T06:04:16.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:16 smithi027 ceph-mon[34364]: pgmap v638: 97 pgs: 97 active+clean; 2.4 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-21T06:04:16.936 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T06:04:16.936 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T06:04:16.936 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-21T06:04:16.936 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-21T06:04:16.936 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-21T06:04:16.936 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-21T06:04:16.936 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-21T06:04:16.936 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T06:04:16.937 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T06:04:17.210 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:04:17.727 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-21T06:04:17.727 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:17.727 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 37, 2024-09-21T06:04:17.727 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 73, 2024-09-21T06:04:17.727 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 8581, 2024-09-21T06:04:17.727 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 71850, 2024-09-21T06:04:17.727 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 15, 2024-09-21T06:04:17.727 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 5, 2024-09-21T06:04:17.727 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.023568126, 2024-09-21T06:04:17.727 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.004745646, 2024-09-21T06:04:17.727 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.011198179, 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000850152, 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 69, 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.020024315, 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000290207 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 53, 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000011947, 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000225 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 2208, 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 10576 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.728 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 841, 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 904, 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 1048140, 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 456968, 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 7, 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 5, 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.129343654, 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.061040463, 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.075664767, 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.005330734, 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 906, 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.063254680, 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000069817 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.729 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:17.730 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 1208, 2024-09-21T06:04:17.730 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000376269, 2024-09-21T06:04:17.730 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000311 2024-09-21T06:04:17.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.730 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 882928, 2024-09-21T06:04:17.730 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 144592 2024-09-21T06:04:17.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.730 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:17.730 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 114, 2024-09-21T06:04:17.730 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 268, 2024-09-21T06:04:17.730 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 28889, 2024-09-21T06:04:17.730 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 1054191, 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 61, 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 7, 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.043312416, 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.014184007, 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.026094484, 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000543233, 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 266, 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.016862302, 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000063392 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 155, 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000032197, 2024-09-21T06:04:17.731 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000207 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 361072 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: "cct": { 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: "total_workers": 1, 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: "unhealthy_workers": 0 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: "finisher-MDSRank": { 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: "queue_len": 0, 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: "complete_latency": { 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 31, 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.002084640, 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000067246 2024-09-21T06:04:17.732 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: "finisher-PurgeQueue": { 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: "queue_len": 0, 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: "complete_latency": { 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 2, 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000024676, 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000012338 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: "request": 7, 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: "reply": 5, 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: "reply_latency": { 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 5, 2024-09-21T06:04:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000986394, 2024-09-21T06:04:17.734 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000197278 2024-09-21T06:04:17.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.734 INFO:teuthology.orchestra.run.smithi027.stdout: "slow_reply": 0, 2024-09-21T06:04:17.734 INFO:teuthology.orchestra.run.smithi027.stdout: "forward": 2, 2024-09-21T06:04:17.734 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_fetch_complete": 0, 2024-09-21T06:04:17.734 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_fetch_keys": 0, 2024-09-21T06:04:17.734 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_commit": 11, 2024-09-21T06:04:17.734 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_split": 0, 2024-09-21T06:04:17.734 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_merge": 0, 2024-09-21T06:04:17.734 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes": 16, 2024-09-21T06:04:17.734 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_top": 0, 2024-09-21T06:04:17.735 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_bottom": 16, 2024-09-21T06:04:17.735 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_pin_tail": 0, 2024-09-21T06:04:17.735 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_pinned": 13, 2024-09-21T06:04:17.735 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_expired": 4, 2024-09-21T06:04:17.735 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_with_caps": 2, 2024-09-21T06:04:17.735 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": 3, 2024-09-21T06:04:17.735 INFO:teuthology.orchestra.run.smithi027.stdout: "subtrees": 3, 2024-09-21T06:04:17.735 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse": 14, 2024-09-21T06:04:17.735 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_hit": 10, 2024-09-21T06:04:17.735 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_forward": 0, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_discover": 3, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_remote_ino": 0, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_lock": 0, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "load_cent": 1000, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "q": 1, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "exported": 0, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "exported_inodes": 0, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "imported": 0, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "imported_inodes": 0, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "openino_dir_fetch": 0, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "openino_peer_discover": 0, 2024-09-21T06:04:17.736 INFO:teuthology.orchestra.run.smithi027.stdout: "root_rfiles": 4, 2024-09-21T06:04:17.737 INFO:teuthology.orchestra.run.smithi027.stdout: "root_rbytes": 234, 2024-09-21T06:04:17.737 INFO:teuthology.orchestra.run.smithi027.stdout: "root_rsnaps": 6, 2024-09-21T06:04:17.737 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:04:17.737 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_set_tag": 0, 2024-09-21T06:04:17.737 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:04:17.737 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:04:17.737 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:04:17.737 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:04:17.737 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:04:17.737 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_file_inodes": 0, 2024-09-21T06:04:17.737 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:04:17.738 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:04:17.738 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:04:17.738 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:04:17.738 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:04:17.738 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:04:17.738 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_caps": 0, 2024-09-21T06:04:17.738 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:04:17.738 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_cap_release": 0, 2024-09-21T06:04:17.738 INFO:teuthology.orchestra.run.smithi027.stdout: "process_request_cap_release": 0 2024-09-21T06:04:17.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.738 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_cache": { 2024-09-21T06:04:17.738 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_update": 0, 2024-09-21T06:04:17.739 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_update_receipt": 11, 2024-09-21T06:04:17.739 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_try_discover": 7, 2024-09-21T06:04:17.739 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_send_discover": 8, 2024-09-21T06:04:17.739 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_handle_discover": 0, 2024-09-21T06:04:17.739 INFO:teuthology.orchestra.run.smithi027.stdout: "num_strays": 0, 2024-09-21T06:04:17.739 INFO:teuthology.orchestra.run.smithi027.stdout: "num_strays_delayed": 0, 2024-09-21T06:04:17.739 INFO:teuthology.orchestra.run.smithi027.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:04:17.739 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_created": 0, 2024-09-21T06:04:17.739 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_enqueued": 0, 2024-09-21T06:04:17.739 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_reintegrated": 0, 2024-09-21T06:04:17.740 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_migrated": 0, 2024-09-21T06:04:17.740 INFO:teuthology.orchestra.run.smithi027.stdout: "num_recovering_processing": 0, 2024-09-21T06:04:17.740 INFO:teuthology.orchestra.run.smithi027.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:04:17.740 INFO:teuthology.orchestra.run.smithi027.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:04:17.740 INFO:teuthology.orchestra.run.smithi027.stdout: "recovery_started": 0, 2024-09-21T06:04:17.740 INFO:teuthology.orchestra.run.smithi027.stdout: "recovery_completed": 0, 2024-09-21T06:04:17.740 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:04:17.740 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:04:17.740 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:04:17.740 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_exportdir": 0, 2024-09-21T06:04:17.740 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_flush": 0, 2024-09-21T06:04:17.740 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:04:17.740 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_fragstats": 0, 2024-09-21T06:04:17.741 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_inodestats": 0, 2024-09-21T06:04:17.741 INFO:teuthology.orchestra.run.smithi027.stdout: "uninline_started": 0, 2024-09-21T06:04:17.741 INFO:teuthology.orchestra.run.smithi027.stdout: "uninline_succeeded": 0, 2024-09-21T06:04:17.741 INFO:teuthology.orchestra.run.smithi027.stdout: "uninline_write_failed": 0 2024-09-21T06:04:17.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.741 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_log": { 2024-09-21T06:04:17.741 INFO:teuthology.orchestra.run.smithi027.stdout: "evlrg": 0, 2024-09-21T06:04:17.741 INFO:teuthology.orchestra.run.smithi027.stdout: "evadd": 4, 2024-09-21T06:04:17.741 INFO:teuthology.orchestra.run.smithi027.stdout: "evex": 0, 2024-09-21T06:04:17.741 INFO:teuthology.orchestra.run.smithi027.stdout: "evtrm": 0, 2024-09-21T06:04:17.741 INFO:teuthology.orchestra.run.smithi027.stdout: "ev": 4, 2024-09-21T06:04:17.742 INFO:teuthology.orchestra.run.smithi027.stdout: "evexg": 0, 2024-09-21T06:04:17.742 INFO:teuthology.orchestra.run.smithi027.stdout: "evexd": 0, 2024-09-21T06:04:17.742 INFO:teuthology.orchestra.run.smithi027.stdout: "segadd": 2, 2024-09-21T06:04:17.742 INFO:teuthology.orchestra.run.smithi027.stdout: "segex": 0, 2024-09-21T06:04:17.742 INFO:teuthology.orchestra.run.smithi027.stdout: "segtrm": 0, 2024-09-21T06:04:17.742 INFO:teuthology.orchestra.run.smithi027.stdout: "seg": 2, 2024-09-21T06:04:17.742 INFO:teuthology.orchestra.run.smithi027.stdout: "segmjr": 2, 2024-09-21T06:04:17.742 INFO:teuthology.orchestra.run.smithi027.stdout: "segexg": 0, 2024-09-21T06:04:17.742 INFO:teuthology.orchestra.run.smithi027.stdout: "segexd": 0, 2024-09-21T06:04:17.742 INFO:teuthology.orchestra.run.smithi027.stdout: "expos": 4194304, 2024-09-21T06:04:17.742 INFO:teuthology.orchestra.run.smithi027.stdout: "wrpos": 4195591, 2024-09-21T06:04:17.742 INFO:teuthology.orchestra.run.smithi027.stdout: "rdpos": 0, 2024-09-21T06:04:17.742 INFO:teuthology.orchestra.run.smithi027.stdout: "jlat": { 2024-09-21T06:04:17.743 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 3, 2024-09-21T06:04:17.743 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.005406749, 2024-09-21T06:04:17.743 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.001802249 2024-09-21T06:04:17.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.743 INFO:teuthology.orchestra.run.smithi027.stdout: "replayed": 0 2024-09-21T06:04:17.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.743 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_mem": { 2024-09-21T06:04:17.743 INFO:teuthology.orchestra.run.smithi027.stdout: "ino": 20, 2024-09-21T06:04:17.743 INFO:teuthology.orchestra.run.smithi027.stdout: "ino+": 22, 2024-09-21T06:04:17.743 INFO:teuthology.orchestra.run.smithi027.stdout: "ino-": 2, 2024-09-21T06:04:17.744 INFO:teuthology.orchestra.run.smithi027.stdout: "dir": 19, 2024-09-21T06:04:17.744 INFO:teuthology.orchestra.run.smithi027.stdout: "dir+": 23, 2024-09-21T06:04:17.744 INFO:teuthology.orchestra.run.smithi027.stdout: "dir-": 4, 2024-09-21T06:04:17.744 INFO:teuthology.orchestra.run.smithi027.stdout: "dn": 16, 2024-09-21T06:04:17.744 INFO:teuthology.orchestra.run.smithi027.stdout: "dn+": 20, 2024-09-21T06:04:17.744 INFO:teuthology.orchestra.run.smithi027.stdout: "dn-": 4, 2024-09-21T06:04:17.744 INFO:teuthology.orchestra.run.smithi027.stdout: "cap": 3, 2024-09-21T06:04:17.744 INFO:teuthology.orchestra.run.smithi027.stdout: "cap+": 3, 2024-09-21T06:04:17.744 INFO:teuthology.orchestra.run.smithi027.stdout: "cap-": 0, 2024-09-21T06:04:17.744 INFO:teuthology.orchestra.run.smithi027.stdout: "rss": 118708, 2024-09-21T06:04:17.744 INFO:teuthology.orchestra.run.smithi027.stdout: "heap": 324812800 2024-09-21T06:04:17.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.745 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_server": { 2024-09-21T06:04:17.745 INFO:teuthology.orchestra.run.smithi027.stdout: "dispatch_client_request": 7, 2024-09-21T06:04:17.745 INFO:teuthology.orchestra.run.smithi027.stdout: "dispatch_server_request": 0, 2024-09-21T06:04:17.745 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_request": 7, 2024-09-21T06:04:17.745 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_session": 18, 2024-09-21T06:04:17.745 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_peer_request": 0, 2024-09-21T06:04:17.745 INFO:teuthology.orchestra.run.smithi027.stdout: "req_create_latency": { 2024-09-21T06:04:17.745 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.745 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.746 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.747 INFO:teuthology.orchestra.run.smithi027.stdout: "req_getattr_latency": { 2024-09-21T06:04:17.747 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 3, 2024-09-21T06:04:17.747 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000740810, 2024-09-21T06:04:17.747 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000246936 2024-09-21T06:04:17.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.747 INFO:teuthology.orchestra.run.smithi027.stdout: "req_getfilelock_latency": { 2024-09-21T06:04:17.747 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.747 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.747 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.747 INFO:teuthology.orchestra.run.smithi027.stdout: "req_link_latency": { 2024-09-21T06:04:17.747 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookup_latency": { 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookuphash_latency": { 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupino_latency": { 2024-09-21T06:04:17.748 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 2, 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000245584, 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000122792 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupname_latency": { 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupparent_latency": { 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupsnap_latency": { 2024-09-21T06:04:17.749 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.750 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.750 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.750 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lssnap_latency": { 2024-09-21T06:04:17.750 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.750 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.751 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.751 INFO:teuthology.orchestra.run.smithi027.stdout: "req_mkdir_latency": { 2024-09-21T06:04:17.751 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.751 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.751 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.751 INFO:teuthology.orchestra.run.smithi027.stdout: "req_mknod_latency": { 2024-09-21T06:04:17.751 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.751 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.751 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.751 INFO:teuthology.orchestra.run.smithi027.stdout: "req_mksnap_latency": { 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: "req_open_latency": { 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: "req_readdir_latency": { 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.752 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rename_latency": { 2024-09-21T06:04:17.753 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.753 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.753 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.753 INFO:teuthology.orchestra.run.smithi027.stdout: "req_renamesnap_latency": { 2024-09-21T06:04:17.753 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.753 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.753 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.753 INFO:teuthology.orchestra.run.smithi027.stdout: "req_snapdiff_latency": { 2024-09-21T06:04:17.753 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rmdir_latency": { 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rmsnap_latency": { 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.754 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rmxattr_latency": { 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setattr_latency": { 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setdirlayout_latency": { 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setfilelock_latency": { 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setlayout_latency": { 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setxattr_latency": { 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.756 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: "req_symlink_latency": { 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: "req_unlink_latency": { 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:04:17.757 INFO:teuthology.orchestra.run.smithi027.stdout: "req_getvxattr_latency": { 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_sessions": { 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: "session_count": 2, 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: "session_add": 2, 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: "session_remove": 0, 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: "sessions_open": 2, 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: "sessions_stale": 0, 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: "total_load": 4, 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: "average_load": 2, 2024-09-21T06:04:17.758 INFO:teuthology.orchestra.run.smithi027.stdout: "avg_session_uptime": 622, 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: "mdthresh_evicted": 0 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: "mempool": { 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:17.759 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:17.760 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_items": 0, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_bytes": 279911, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_items": 102, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_bytes": 88, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_items": 1, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_bytes": 0, 2024-09-21T06:04:17.761 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_items": 0, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_bytes": 8088, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_items": 179, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_items": 0, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_bytes": 85345, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_items": 420, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_items": 0, 2024-09-21T06:04:17.762 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_items": 0 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "objecter": { 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "op_active": 0, 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "op_laggy": 0, 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "op_send": 40, 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "op_send_bytes": 11800, 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "op_resend": 27, 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "op_reply": 40, 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "op_latency": { 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 40, 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.247993574, 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.006199839 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "op_inflight": 0, 2024-09-21T06:04:17.763 INFO:teuthology.orchestra.run.smithi027.stdout: "oplen_avg": { 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 40, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 63 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "op": 40, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "op_r": 0, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "op_w": 40, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "op_rmw": 0, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "op_pg": 0, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_stat": 0, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_create": 10, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_read": 0, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_write": 3, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_writefull": 7, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_writesame": 0, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_append": 0, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_zero": 0, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_truncate": 0, 2024-09-21T06:04:17.764 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_delete": 6, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_mapext": 0, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_sparse_read": 0, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_clonerange": 0, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_getxattr": 0, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_setxattr": 20, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_rmxattr": 0, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_call": 0, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_watch": 0, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_notify": 0, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_pgls": 0, 2024-09-21T06:04:17.765 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_other": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_active": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_send": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_resend": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_ping": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "poolop_active": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "poolop_send": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "poolop_resend": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "poolstat_active": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "poolstat_send": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "poolstat_resend": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "statfs_active": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "statfs_send": 0, 2024-09-21T06:04:17.766 INFO:teuthology.orchestra.run.smithi027.stdout: "statfs_resend": 0, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "command_active": 0, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "command_send": 0, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "command_resend": 0, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "map_epoch": 84, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "map_full": 0, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "map_inc": 11, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_sessions": 10, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_session_open": 10, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_session_close": 0, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_laggy": 0, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_wr": 16, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_rd": 0, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_del": 1 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.767 INFO:teuthology.orchestra.run.smithi027.stdout: "oft": { 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_objs": 1, 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_updates": 0, 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_removes": 0 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "purge_queue": { 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing_ops": 0, 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing": 0, 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing_high_water": 0, 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executed_ops": 0, 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executed": 0, 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_item_in_journal": 0 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:17.768 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 988, 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 979686, 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 988, 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 988, 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 979686, 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:17.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-objecter_bytes": { 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 0, 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 0, 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 40, 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 11800, 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 40, 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 11800, 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.770 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-objecter_ops": { 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 1024, 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 0, 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 0, 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 40, 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 40, 2024-09-21T06:04:17.771 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 40, 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 40, 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 3758096384, 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 0, 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 0, 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:17.772 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 0, 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 0, 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-write_buf_throttle-0x560f149a5450": { 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 3758096384, 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 4, 2024-09-21T06:04:17.773 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 1287, 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 4, 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 3, 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 1287, 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: "trackedop": { 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: "slow_ops_count": 0 2024-09-21T06:04:17.774 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:17.775 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-21T06:04:18.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:18 smithi007 ceph-mon[30983]: pgmap v639: 97 pgs: 97 active+clean; 2.4 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:04:18.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:18 smithi007 ceph-mon[30983]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:04:18.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:18 smithi119 ceph-mon[34833]: pgmap v639: 97 pgs: 97 active+clean; 2.4 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:04:18.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:18 smithi119 ceph-mon[34833]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:04:18.642 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:18 smithi027 ceph-mon[34364]: pgmap v639: 97 pgs: 97 active+clean; 2.4 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:04:18.642 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:18 smithi027 ceph-mon[34364]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:04:18.669 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-21T06:04:18.669 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-21T06:04:18.669 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=0 2024-09-21T06:04:18.669 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=11 2024-09-21T06:04:18.669 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-21T06:04:18.669 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:04:18.669 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:04:18.670 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T06:04:18.670 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T06:04:18.926 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:04:19.386 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-21T06:04:19.387 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:19.387 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 215, 2024-09-21T06:04:19.387 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 210, 2024-09-21T06:04:19.387 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 836192, 2024-09-21T06:04:19.387 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 128704, 2024-09-21T06:04:19.387 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:19.387 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 0, 2024-09-21T06:04:19.387 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.041851329, 2024-09-21T06:04:19.387 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.018696088, 2024-09-21T06:04:19.387 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.029795361, 2024-09-21T06:04:19.387 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:19.387 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:19.388 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 209, 2024-09-21T06:04:19.388 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.013474601, 2024-09-21T06:04:19.388 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000064471 2024-09-21T06:04:19.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:19.388 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:19.388 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:19.388 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:19.388 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:19.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:19.388 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 836192, 2024-09-21T06:04:19.388 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 128704 2024-09-21T06:04:19.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:19.389 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:19.389 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 1, 2024-09-21T06:04:19.389 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 159, 2024-09-21T06:04:19.389 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:04:19.389 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 108224, 2024-09-21T06:04:19.389 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:19.389 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:19.389 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.014789083, 2024-09-21T06:04:19.389 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.011487749, 2024-09-21T06:04:19.389 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.001270622, 2024-09-21T06:04:19.389 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:19.389 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:19.390 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 157, 2024-09-21T06:04:19.390 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.010059572, 2024-09-21T06:04:19.390 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000064073 2024-09-21T06:04:19.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:19.390 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:19.390 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:19.390 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:19.390 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:19.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:19.390 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:19.390 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 108224 2024-09-21T06:04:19.390 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:19.391 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:19.391 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 4, 2024-09-21T06:04:19.391 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 4, 2024-09-21T06:04:19.391 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 2992, 2024-09-21T06:04:19.391 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 448, 2024-09-21T06:04:19.391 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 2, 2024-09-21T06:04:19.391 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:19.391 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.002342776, 2024-09-21T06:04:19.391 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.000050096, 2024-09-21T06:04:19.391 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.002293397, 2024-09-21T06:04:19.391 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:19.391 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 3, 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.003954964, 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.001318321 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: "cct": { 2024-09-21T06:04:19.392 INFO:teuthology.orchestra.run.smithi027.stdout: "total_workers": 0, 2024-09-21T06:04:19.393 INFO:teuthology.orchestra.run.smithi027.stdout: "unhealthy_workers": 0 2024-09-21T06:04:19.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:19.393 INFO:teuthology.orchestra.run.smithi027.stdout: "mempool": { 2024-09-21T06:04:19.393 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:19.393 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:19.393 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:19.393 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:19.393 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:19.393 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:19.393 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:19.393 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:19.393 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:19.393 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:19.394 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:19.395 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:19.395 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:19.395 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:19.395 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:19.395 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:19.395 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:19.395 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:19.395 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_items": 0, 2024-09-21T06:04:19.395 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:19.395 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:19.395 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:19.395 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:19.395 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_items": 29, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_bytes": 0, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_items": 0, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_bytes": 0, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_items": 0, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:19.396 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:19.397 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_items": 0, 2024-09-21T06:04:19.397 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_bytes": 968, 2024-09-21T06:04:19.397 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_items": 2, 2024-09-21T06:04:19.397 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:19.397 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_items": 0, 2024-09-21T06:04:19.397 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:19.397 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_items": 0 2024-09-21T06:04:19.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:19.397 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:19.397 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-21T06:04:19.397 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-21T06:04:19.397 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-21T06:04:19.398 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 216, 2024-09-21T06:04:19.398 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 805824, 2024-09-21T06:04:19.398 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:19.398 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 216, 2024-09-21T06:04:19.398 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-21T06:04:19.398 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-21T06:04:19.398 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 216, 2024-09-21T06:04:19.398 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 805824, 2024-09-21T06:04:19.398 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-21T06:04:19.399 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:19.399 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:19.399 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:19.399 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:19.399 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:19.399 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-21T06:04:20.061 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-09-21T06:04:20.061 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-09-21T06:04:20.061 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.e 2024-09-21T06:04:20.061 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.e 2024-09-21T06:04:20.061 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-21T06:04:20.061 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-21T06:04:20.061 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-21T06:04:20.061 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T06:04:20.062 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T06:04:20.362 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:04:20.476 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:20 smithi027 ceph-mon[34364]: pgmap v641: 97 pgs: 97 active+clean; 2.4 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:04:20.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:20 smithi007 ceph-mon[30983]: pgmap v641: 97 pgs: 97 active+clean; 2.4 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:04:20.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:20 smithi119 ceph-mon[34833]: pgmap v641: 97 pgs: 97 active+clean; 2.4 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:04:20.851 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-21T06:04:20.851 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:20.851 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 2121, 2024-09-21T06:04:20.851 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 2123, 2024-09-21T06:04:20.851 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 602116, 2024-09-21T06:04:20.851 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 674485, 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 6, 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.218649091, 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.096345567, 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.045354976, 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.061930000, 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 2121, 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.083750610, 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000039486 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.852 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 238, 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 229, 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 868796, 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 131514, 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.045537081, 2024-09-21T06:04:20.853 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.020199600, 2024-09-21T06:04:20.854 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.034848119, 2024-09-21T06:04:20.854 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000059276, 2024-09-21T06:04:20.854 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:20.854 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 229, 2024-09-21T06:04:20.854 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.019048431, 2024-09-21T06:04:20.854 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000083180 2024-09-21T06:04:20.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.854 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:20.854 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.854 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.854 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.854 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 868240, 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 130816 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 2, 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 159, 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 428, 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 361918, 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 3, 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.012220805, 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.009013577, 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.001544950, 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000022751, 2024-09-21T06:04:20.855 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:20.856 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 157, 2024-09-21T06:04:20.856 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.009176387, 2024-09-21T06:04:20.856 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000058448 2024-09-21T06:04:20.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.856 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:20.856 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.856 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.856 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.856 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:20.856 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 361600 2024-09-21T06:04:20.856 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.856 INFO:teuthology.orchestra.run.smithi027.stdout: "cct": { 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: "total_workers": 1, 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: "unhealthy_workers": 0 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: "finisher-MDSRank": { 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: "queue_len": 0, 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: "complete_latency": { 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 3605, 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.102075379, 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000028314 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: "finisher-PurgeQueue": { 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: "queue_len": 0, 2024-09-21T06:04:20.857 INFO:teuthology.orchestra.run.smithi027.stdout: "complete_latency": { 2024-09-21T06:04:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-21T06:04:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: "request": 0, 2024-09-21T06:04:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: "reply": 0, 2024-09-21T06:04:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: "reply_latency": { 2024-09-21T06:04:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "slow_reply": 0, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "forward": 0, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_fetch_complete": 0, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_fetch_keys": 0, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_commit": 0, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_split": 0, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_merge": 0, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes": 0, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_top": 0, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_bottom": 0, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_pin_tail": 0, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_pinned": 0, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_expired": 0, 2024-09-21T06:04:20.859 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_with_caps": 0, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": 0, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "subtrees": 1, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse": 0, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_hit": 0, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_forward": 0, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_discover": 0, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_remote_ino": 0, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_lock": 0, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "load_cent": 0, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "q": 0, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "exported": 0, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "exported_inodes": 0, 2024-09-21T06:04:20.860 INFO:teuthology.orchestra.run.smithi027.stdout: "imported": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "imported_inodes": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "openino_dir_fetch": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "openino_peer_discover": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "root_rfiles": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "root_rbytes": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "root_rsnaps": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_set_tag": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:04:20.861 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_file_inodes": 0, 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_caps": 0, 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_cap_release": 0, 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "process_request_cap_release": 0 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_cache": { 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_update": 0, 2024-09-21T06:04:20.862 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_update_receipt": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_try_discover": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_send_discover": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_handle_discover": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "num_strays": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "num_strays_delayed": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_created": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_enqueued": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_reintegrated": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_migrated": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "num_recovering_processing": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "recovery_started": 0, 2024-09-21T06:04:20.863 INFO:teuthology.orchestra.run.smithi027.stdout: "recovery_completed": 0, 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_exportdir": 0, 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_flush": 0, 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_fragstats": 0, 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_inodestats": 0, 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "uninline_started": 0, 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "uninline_succeeded": 0, 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "uninline_write_failed": 0 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_log": { 2024-09-21T06:04:20.864 INFO:teuthology.orchestra.run.smithi027.stdout: "evlrg": 0, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "evadd": 0, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "evex": 0, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "evtrm": 0, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "ev": 4, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "evexg": 0, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "evexd": 0, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "segadd": 0, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "segex": 0, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "segtrm": 0, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "seg": 2, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "segmjr": 2, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "segexg": 0, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "segexd": 0, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "expos": 4194304, 2024-09-21T06:04:20.865 INFO:teuthology.orchestra.run.smithi027.stdout: "wrpos": 4195591, 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "rdpos": 4195200, 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "jlat": { 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "replayed": 4 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_mem": { 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "ino": 3, 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "ino+": 3, 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "ino-": 0, 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "dir": 1, 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "dir+": 1, 2024-09-21T06:04:20.866 INFO:teuthology.orchestra.run.smithi027.stdout: "dir-": 0, 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "dn": 0, 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "dn+": 0, 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "dn-": 0, 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "cap": 0, 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "cap+": 0, 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "cap-": 0, 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "rss": 116392, 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "heap": 316420096 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_server": { 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "dispatch_client_request": 0, 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "dispatch_server_request": 0, 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_request": 0, 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_session": 0, 2024-09-21T06:04:20.867 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_peer_request": 0, 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "req_create_latency": { 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "req_getattr_latency": { 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "req_getfilelock_latency": { 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "req_link_latency": { 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookup_latency": { 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookuphash_latency": { 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.869 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupino_latency": { 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupname_latency": { 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupparent_latency": { 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.870 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupsnap_latency": { 2024-09-21T06:04:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lssnap_latency": { 2024-09-21T06:04:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.871 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: "req_mkdir_latency": { 2024-09-21T06:04:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.872 INFO:teuthology.orchestra.run.smithi027.stdout: "req_mknod_latency": { 2024-09-21T06:04:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "req_mksnap_latency": { 2024-09-21T06:04:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "req_open_latency": { 2024-09-21T06:04:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.873 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "req_readdir_latency": { 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rename_latency": { 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "req_renamesnap_latency": { 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.874 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "req_snapdiff_latency": { 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rmdir_latency": { 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rmsnap_latency": { 2024-09-21T06:04:20.875 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rmxattr_latency": { 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setattr_latency": { 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.876 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setdirlayout_latency": { 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setfilelock_latency": { 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setlayout_latency": { 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.877 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setxattr_latency": { 2024-09-21T06:04:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "req_symlink_latency": { 2024-09-21T06:04:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "req_unlink_latency": { 2024-09-21T06:04:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.878 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "req_getvxattr_latency": { 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_sessions": { 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "session_count": 2, 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "session_add": 2, 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "session_remove": 0, 2024-09-21T06:04:20.879 INFO:teuthology.orchestra.run.smithi027.stdout: "sessions_open": 2, 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "sessions_stale": 0, 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "total_load": 0, 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "average_load": 0, 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "avg_session_uptime": 1940, 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "mdthresh_evicted": 0 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "mempool": { 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:20.880 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_items": 0, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_bytes": 181343, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_items": 47, 2024-09-21T06:04:20.882 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_bytes": 0, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_items": 0, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_bytes": 7968, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_items": 176, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_items": 0, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_bytes": 8672, 2024-09-21T06:04:20.883 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_items": 13, 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_items": 0, 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_items": 0 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "objecter": { 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "op_active": 0, 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "op_laggy": 0, 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "op_send": 2124, 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "op_send_bytes": 21, 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "op_resend": 3, 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "op_reply": 2124, 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "op_latency": { 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 2124, 2024-09-21T06:04:20.884 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 1.260966956, 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000593675 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "op_inflight": 0, 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "oplen_avg": { 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 2124, 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 2125 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "op": 2124, 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "op_r": 2124, 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "op_w": 0, 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "op_rmw": 0, 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "op_pg": 0, 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_stat": 1376, 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_create": 0, 2024-09-21T06:04:20.885 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_read": 746, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_write": 0, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_writefull": 0, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_writesame": 0, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_append": 0, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_zero": 0, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_truncate": 0, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_delete": 0, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_mapext": 0, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_sparse_read": 0, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_clonerange": 0, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_getxattr": 1, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_setxattr": 0, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:04:20.886 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_rmxattr": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_call": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_watch": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_notify": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_pgls": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_other": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_active": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_send": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_resend": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_ping": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "poolop_active": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "poolop_send": 0, 2024-09-21T06:04:20.887 INFO:teuthology.orchestra.run.smithi027.stdout: "poolop_resend": 0, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "poolstat_active": 0, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "poolstat_send": 0, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "poolstat_resend": 0, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "statfs_active": 0, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "statfs_send": 0, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "statfs_resend": 0, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "command_active": 0, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "command_send": 0, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "command_resend": 0, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "map_epoch": 85, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "map_full": 0, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "map_inc": 12, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_sessions": 4, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_session_open": 4, 2024-09-21T06:04:20.888 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_session_close": 0, 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_laggy": 0, 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_wr": 0, 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_rd": 2, 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_del": 0 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "oft": { 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_objs": 0, 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_updates": 0, 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_removes": 0 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "purge_queue": { 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing_ops": 0, 2024-09-21T06:04:20.889 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing": 0, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing_high_water": 0, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executed_ops": 0, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executed": 0, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_item_in_journal": 0 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 2357, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 1244331, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 2357, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 2357, 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 1244331, 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-objecter_bytes": { 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 0, 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 0, 2024-09-21T06:04:20.891 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 2124, 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 1292, 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 2124, 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 1292, 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-objecter_ops": { 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-21T06:04:20.892 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 1024, 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 0, 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 0, 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 2124, 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 2124, 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 2124, 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 2124, 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:20.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 3758096384, 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 0, 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 0, 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 0, 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 0, 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.894 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-write_buf_throttle-0x55eadbe81380": { 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 3758096384, 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 0, 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 0, 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 0, 2024-09-21T06:04:20.895 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 0, 2024-09-21T06:04:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-21T06:04:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "trackedop": { 2024-09-21T06:04:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: "slow_ops_count": 0 2024-09-21T06:04:20.896 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:20.896 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-21T06:04:21.622 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T06:04:21.622 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T06:04:21.622 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-21T06:04:21.622 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-21T06:04:21.622 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-09-21T06:04:21.622 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:04:21.623 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:04:21.623 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T06:04:21.623 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T06:04:21.879 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:04:22.327 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-21T06:04:22.327 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:22.327 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 0, 2024-09-21T06:04:22.327 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 2, 2024-09-21T06:04:22.327 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:04:22.327 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 0, 2024-09-21T06:04:22.327 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 0, 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.001351654, 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.000386690, 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:22.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 222, 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 215, 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 840000, 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 131072, 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 2, 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.044997587, 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.019640344, 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.033532271, 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:22.329 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 215, 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.017715131, 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000082395 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 840000, 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 131072 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 1, 2024-09-21T06:04:22.330 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 161, 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 108576, 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.014725701, 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.011172165, 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.001486192, 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 159, 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.010952504, 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000068883 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:22.331 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 108576 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: "cct": { 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: "total_workers": 0, 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: "unhealthy_workers": 0 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: "mempool": { 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:22.332 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:22.333 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_items": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_bytes": 148984, 2024-09-21T06:04:22.334 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_items": 30, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_bytes": 0, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_items": 0, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_bytes": 0, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_items": 0, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:22.335 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_items": 0, 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_bytes": 968, 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_items": 2, 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_items": 0, 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_items": 0 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 219, 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 806214, 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:22.336 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 219, 2024-09-21T06:04:22.337 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-21T06:04:22.337 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-21T06:04:22.337 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 219, 2024-09-21T06:04:22.337 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 806214, 2024-09-21T06:04:22.337 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-21T06:04:22.337 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-21T06:04:22.337 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-21T06:04:22.337 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-21T06:04:22.337 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:22.337 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-21T06:04:22.337 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-21T06:04:22.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:22 smithi007 ceph-mon[30983]: pgmap v642: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:04:22.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:22 smithi119 ceph-mon[34833]: pgmap v642: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:04:22.622 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:22 smithi027 ceph-mon[34364]: pgmap v642: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:04:22.977 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-21T06:04:22.977 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-21T06:04:22.977 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-21T06:04:22.977 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-21T06:04:22.977 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-21T06:04:22.977 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-21T06:04:22.977 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-21T06:04:22.978 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T06:04:22.978 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T06:04:23.241 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:04:23.766 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T06:04:23.766 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:23.766 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 846, 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 875, 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 1046238, 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 259910, 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 7, 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.132204752, 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.064826489, 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.070505744, 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.003818539, 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 877, 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.054409612, 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000062040 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.767 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1155, 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000266140, 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000230 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 878784, 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 136896 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 69, 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 225, 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 23223, 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 419487, 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 9, 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 4, 2024-09-21T06:04:23.768 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.020799690, 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.012773437, 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.006224491, 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000493335, 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 225, 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.027591689, 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000122629 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 96, 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000020391, 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000212 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 363424 2024-09-21T06:04:23.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 73, 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 79, 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 12715, 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 697262, 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 64, 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 8, 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.027619759, 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.002873900, 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.022852718, 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000349941, 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 73, 2024-09-21T06:04:23.770 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.013556149, 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000185700 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 67, 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000007877, 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000117 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 1440 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.771 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 39, 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.001851644, 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000047478 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2, 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000018610, 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000009305 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:23.772 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 2, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 1, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000195360, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000195360 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 1, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 11, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 16, 2024-09-21T06:04:23.773 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 0, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 16, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 0, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 13, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 4, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 0, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 0, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 3, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 10, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 5, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 4, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2024-09-21T06:04:23.774 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 4, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 234, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 6, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:04:23.775 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 1 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.776 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 9, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 6, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 8, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:04:23.777 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0, 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_started": 0, 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_succeeded": 0, 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_write_failed": 0 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2024-09-21T06:04:23.778 INFO:teuthology.orchestra.run.smithi119.stdout: "evlrg": 0, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 4, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 4, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 2, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 2, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "segmjr": 2, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 4194304, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 4195424, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 0, 2024-09-21T06:04:23.779 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3, 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.006930553, 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.002310184 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 0 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 20, 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 22, 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 2, 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 19, 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 22, 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 3, 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 16, 2024-09-21T06:04:23.780 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 20, 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 4, 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 0, 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 1, 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 1, 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 118384, 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 325857280 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 3, 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 2, 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 4, 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.781 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1, 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000195360, 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000195360 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.782 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.783 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.784 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.785 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2024-09-21T06:04:23.785 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.785 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.785 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.785 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2024-09-21T06:04:23.785 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2024-09-21T06:04:23.786 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2024-09-21T06:04:23.787 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.788 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.790 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.791 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 0, 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 1, 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 1, 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 0, 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 1, 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 1, 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 78, 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: "mdthresh_evicted": 0 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.792 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:23.793 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:23.794 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 230695, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 76, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 7968, 2024-09-21T06:04:23.795 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 176, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 84409, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 417, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 38, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 11332, 2024-09-21T06:04:23.796 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 33, 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 38, 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 38, 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.212994888, 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.005605128 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 38, 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 60 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 38, 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 0, 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 38, 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2024-09-21T06:04:23.797 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 0, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 10, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 0, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 3, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 6, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 6, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 0, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 20, 2024-09-21T06:04:23.798 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2024-09-21T06:04:23.799 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 85, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 12, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 8, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 8, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2024-09-21T06:04:23.800 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 14, 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 0, 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 1 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 1, 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2024-09-21T06:04:23.801 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed_ops": 0, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 984, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 976896, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 984, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 984, 2024-09-21T06:04:23.802 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 976896, 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 38, 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 11332, 2024-09-21T06:04:23.803 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 38, 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 11332, 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:23.804 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 38, 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 38, 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 38, 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 38, 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x55bb7b1bb380": { 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:23.806 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 4, 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 1120, 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 4, 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 3, 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1120, 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: "trackedop": { 2024-09-21T06:04:23.807 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2024-09-21T06:04:23.808 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:23.808 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T06:04:24.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:24 smithi007 ceph-mon[30983]: pgmap v643: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:04:24.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:24 smithi119 ceph-mon[34833]: pgmap v643: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:04:24.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:24 smithi027 ceph-mon[34364]: pgmap v643: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:04:24.727 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T06:04:24.727 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-21T06:04:24.727 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-21T06:04:24.728 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=9 2024-09-21T06:04:24.728 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-21T06:04:24.728 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:04:24.728 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:04:24.728 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T06:04:24.728 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T06:04:24.975 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:04:25.482 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T06:04:25.483 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:25.483 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 1841, 2024-09-21T06:04:25.483 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 1834, 2024-09-21T06:04:25.483 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 2485835, 2024-09-21T06:04:25.483 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 642842, 2024-09-21T06:04:25.483 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 5, 2024-09-21T06:04:25.483 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:25.483 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.246854329, 2024-09-21T06:04:25.483 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.109804363, 2024-09-21T06:04:25.483 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.077352366, 2024-09-21T06:04:25.483 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.053323532, 2024-09-21T06:04:25.483 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1833, 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.081703405, 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000044573 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 866224, 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 132448 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 5, 2024-09-21T06:04:25.484 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 163, 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 1816, 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 364746, 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 5, 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 4, 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.012560765, 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.008923069, 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.001932944, 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000116781, 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 161, 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.013471176, 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000083671 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.485 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 363408 2024-09-21T06:04:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 744, 2024-09-21T06:04:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 744, 2024-09-21T06:04:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 185138, 2024-09-21T06:04:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 235775, 2024-09-21T06:04:25.486 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 3, 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.095168780, 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.043993976, 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.018695265, 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.025234406, 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 743, 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.038109754, 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000051291 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.487 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3861, 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.124689638, 2024-09-21T06:04:25.488 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000032294 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 0, 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 0, 2024-09-21T06:04:25.489 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 0, 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 31, 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 8, 2024-09-21T06:04:25.490 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 23, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 0, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 20, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 0, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 0, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 0, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 2, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 0, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 0, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2024-09-21T06:04:25.491 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 4, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 234, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 6, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:04:25.492 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:04:25.493 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:04:25.493 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:04:25.493 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:04:25.493 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2024-09-21T06:04:25.493 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:04:25.493 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:04:25.493 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:04:25.493 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:04:25.493 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:04:25.493 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:04:25.493 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 0, 2024-09-21T06:04:25.493 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:04:25.493 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 0 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2024-09-21T06:04:25.494 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0, 2024-09-21T06:04:25.495 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_started": 0, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_succeeded": 0, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_write_failed": 0 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "evlrg": 0, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 0, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 256, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 0, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 2, 2024-09-21T06:04:25.496 INFO:teuthology.orchestra.run.smithi119.stdout: "segmjr": 11, 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 5142120, 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 5339635, 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 5339523, 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 256 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2024-09-21T06:04:25.497 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 20, 2024-09-21T06:04:25.498 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 24, 2024-09-21T06:04:25.498 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 4, 2024-09-21T06:04:25.498 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 11, 2024-09-21T06:04:25.498 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 11, 2024-09-21T06:04:25.498 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 0, 2024-09-21T06:04:25.498 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 31, 2024-09-21T06:04:25.498 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 31, 2024-09-21T06:04:25.498 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 0, 2024-09-21T06:04:25.498 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 0, 2024-09-21T06:04:25.498 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 0, 2024-09-21T06:04:25.498 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 0, 2024-09-21T06:04:25.498 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 116892, 2024-09-21T06:04:25.498 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 316420096 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 0, 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 0, 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 0, 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2024-09-21T06:04:25.499 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.500 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2024-09-21T06:04:25.501 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2024-09-21T06:04:25.502 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.503 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.503 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.503 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.503 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2024-09-21T06:04:25.503 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.503 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.503 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.504 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2024-09-21T06:04:25.504 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.504 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.504 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.504 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2024-09-21T06:04:25.504 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.504 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.504 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.504 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2024-09-21T06:04:25.504 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.505 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.505 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.505 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.505 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2024-09-21T06:04:25.505 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.505 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.505 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.505 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.505 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2024-09-21T06:04:25.505 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.505 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.505 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.505 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.506 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2024-09-21T06:04:25.506 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.506 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.506 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.506 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2024-09-21T06:04:25.506 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.506 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.506 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.506 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2024-09-21T06:04:25.506 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.506 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.507 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.508 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.509 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.509 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2024-09-21T06:04:25.509 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.509 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.509 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.509 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2024-09-21T06:04:25.509 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.509 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.509 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.509 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2024-09-21T06:04:25.510 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.510 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.510 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.510 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.510 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:04:25.510 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:04:25.510 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2024-09-21T06:04:25.510 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.510 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.510 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.510 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:25.510 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.510 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 2, 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 3, 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 1, 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 2, 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 0, 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 0, 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 2010, 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: "mdthresh_evicted": 0 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:25.511 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:25.512 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:25.513 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 189733, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 60, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:25.514 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 7968, 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 176, 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 95053, 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 873, 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2024-09-21T06:04:25.515 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 2349, 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 26, 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 4, 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 2349, 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2349, 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1.172971435, 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000499349 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2349, 2024-09-21T06:04:25.516 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 2350 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 2349, 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 2349, 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 0, 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 1481, 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 0, 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 865, 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 0, 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 0, 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2024-09-21T06:04:25.517 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 0, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 2, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 0, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2024-09-21T06:04:25.518 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2024-09-21T06:04:25.519 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 85, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 12, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 5, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 5, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 0, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 2, 2024-09-21T06:04:25.520 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 0 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 0, 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed_ops": 0, 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.521 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 2586, 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 2424968, 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 2586, 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 2586, 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 2424968, 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.522 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2024-09-21T06:04:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T06:04:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T06:04:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T06:04:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 2349, 2024-09-21T06:04:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 1145341, 2024-09-21T06:04:25.523 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 2349, 2024-09-21T06:04:25.524 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1145341, 2024-09-21T06:04:25.524 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:25.524 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.524 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.524 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.524 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:25.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.524 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2024-09-21T06:04:25.524 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:25.524 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2024-09-21T06:04:25.524 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:25.524 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T06:04:25.524 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 2349, 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 2349, 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 2349, 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 2349, 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:25.525 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.526 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x560734813380": { 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:25.527 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:25.528 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:25.528 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:25.528 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:25.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:25.528 INFO:teuthology.orchestra.run.smithi119.stdout: "trackedop": { 2024-09-21T06:04:25.528 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2024-09-21T06:04:25.528 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:25.528 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T06:04:26.160 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T06:04:26.160 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T06:04:26.160 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-21T06:04:26.161 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-21T06:04:26.161 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-21T06:04:26.161 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:04:26.161 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:04:26.161 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T06:04:26.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T06:04:26.405 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:04:26.525 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:26 smithi119 ceph-mon[34833]: pgmap v644: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:04:26.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:26 smithi007 ceph-mon[30983]: pgmap v644: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:04:26.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:26 smithi027 ceph-mon[34364]: pgmap v644: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:04:26.898 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T06:04:26.898 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:26.898 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 2071, 2024-09-21T06:04:26.898 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 1434, 2024-09-21T06:04:26.898 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 697196, 2024-09-21T06:04:26.898 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 1748370, 2024-09-21T06:04:26.898 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 17, 2024-09-21T06:04:26.898 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 5, 2024-09-21T06:04:26.898 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.253270689, 2024-09-21T06:04:26.898 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.094674939, 2024-09-21T06:04:26.898 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.095287498, 2024-09-21T06:04:26.898 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.052451882, 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1432, 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.384882967, 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000268773 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2053, 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000418011, 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000203 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 330496, 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 97296 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.899 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 1718, 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 1065, 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 1409214, 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 3002548, 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 207, 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 7, 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.292957825, 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.079625540, 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.166212987, 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.051183532, 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1065, 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.372800712, 2024-09-21T06:04:26.900 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000350047 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1352, 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000298984, 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000221 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 1303232, 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 283408 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 960, 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 1068, 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 408378, 2024-09-21T06:04:26.901 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 716530, 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 10, 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 6, 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.110344419, 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.053817083, 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.056221827, 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.008923044, 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1066, 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.221303654, 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000207601 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1140, 2024-09-21T06:04:26.902 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000280134, 2024-09-21T06:04:26.903 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000245 2024-09-21T06:04:26.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.903 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:26.903 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 369488 2024-09-21T06:04:26.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.903 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-21T06:04:26.903 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2024-09-21T06:04:26.903 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-21T06:04:26.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.903 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2024-09-21T06:04:26.903 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-21T06:04:26.903 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-21T06:04:26.903 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 765, 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.244407320, 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000319486 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 88, 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.003035909, 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000034498 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 172, 2024-09-21T06:04:26.904 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 172, 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 172, 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.243614925, 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001416365 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 65, 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 37, 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 8, 2024-09-21T06:04:26.905 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 29, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 0, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 25, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 0, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 2, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 2, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 2, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 349, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 340, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2024-09-21T06:04:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 305, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 4, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 234, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 6, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 305, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:04:26.907 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 193, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 27, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 166, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 112, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 27, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 37, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 115, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 87, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 2, 2024-09-21T06:04:26.908 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 25 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 7, 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 16, 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 2, 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 6, 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 4, 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2024-09-21T06:04:26.909 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 27, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_started": 0, 2024-09-21T06:04:26.910 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_succeeded": 0, 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_write_failed": 0 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "evlrg": 0, 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 256, 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 166, 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 166, 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 90, 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 22, 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 11, 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 10, 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 10, 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 1, 2024-09-21T06:04:26.911 INFO:teuthology.orchestra.run.smithi119.stdout: "segmjr": 1, 2024-09-21T06:04:26.912 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2024-09-21T06:04:26.912 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 1, 2024-09-21T06:04:26.912 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 5142120, 2024-09-21T06:04:26.912 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 5339635, 2024-09-21T06:04:26.912 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 0, 2024-09-21T06:04:26.912 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2024-09-21T06:04:26.912 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 211, 2024-09-21T06:04:26.912 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1.497798594, 2024-09-21T06:04:26.912 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.007098571 2024-09-21T06:04:26.912 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.912 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 0 2024-09-21T06:04:26.912 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.912 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2024-09-21T06:04:26.913 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 29, 2024-09-21T06:04:26.913 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 60, 2024-09-21T06:04:26.913 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 31, 2024-09-21T06:04:26.913 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 20, 2024-09-21T06:04:26.913 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 20, 2024-09-21T06:04:26.913 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 0, 2024-09-21T06:04:26.913 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 37, 2024-09-21T06:04:26.913 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 41, 2024-09-21T06:04:26.913 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 4, 2024-09-21T06:04:26.913 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 2, 2024-09-21T06:04:26.913 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 19, 2024-09-21T06:04:26.913 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 17, 2024-09-21T06:04:26.913 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 122212, 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 337391616 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 229, 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 172, 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 25, 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 8, 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.006838360, 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000854795 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.914 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 108, 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.018960112, 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000175556 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.918 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2024-09-21T06:04:26.918 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 11, 2024-09-21T06:04:26.918 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.001535299, 2024-09-21T06:04:26.918 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000139572 2024-09-21T06:04:26.918 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.918 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 8, 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.014563030, 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001820378 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 11, 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.132368023, 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.012033456 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1, 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000177064, 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000177064 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2, 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.004763798, 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.002381899 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2, 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.002115324, 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001057662 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2024-09-21T06:04:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2, 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.011884530, 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.005942265 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 5, 2024-09-21T06:04:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.022356750, 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.004471350 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1, 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000870176, 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000870176 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.922 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2024-09-21T06:04:26.923 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 9, 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.021383513, 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.002375945 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 4, 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.005798946, 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001449736 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:04:26.924 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 2, 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 3, 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 1, 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 2, 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 27, 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 13, 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 635, 2024-09-21T06:04:26.925 INFO:teuthology.orchestra.run.smithi119.stdout: "mdthresh_evicted": 0 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:26.927 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 350877, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 146, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 704, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 8, 2024-09-21T06:04:26.928 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 7968, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 176, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 136485, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 1368, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:26.929 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 1329, 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 1266840, 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 37, 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 1329, 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1329, 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 27.836326079, 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.020945316 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.930 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1329, 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1509 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 1329, 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 361, 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 968, 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 45, 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 28, 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 29, 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 213, 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 45, 2024-09-21T06:04:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 579, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 332, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 56, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2024-09-21T06:04:26.932 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2024-09-21T06:04:26.933 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 85, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 12, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 12, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 12, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 168, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 0, 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 14 2024-09-21T06:04:26.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 1, 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 64, 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 3, 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed_ops": 67, 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 4, 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2024-09-21T06:04:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 4745, 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 1991606, 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 4745, 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 4745, 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1991606, 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.936 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 1329, 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 1267276, 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 1329, 2024-09-21T06:04:26.937 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1267276, 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:26.938 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 1329, 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 1329, 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 1329, 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1329, 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 4, 2024-09-21T06:04:26.939 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 436, 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 4, 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 2, 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 436, 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x55be59c011e0": { 2024-09-21T06:04:26.940 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 256, 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 1145331, 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 256, 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 211, 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1145331, 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:26.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:26.942 INFO:teuthology.orchestra.run.smithi119.stdout: "trackedop": { 2024-09-21T06:04:26.942 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2024-09-21T06:04:26.942 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:26.942 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T06:04:27.627 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-21T06:04:27.627 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-21T06:04:27.627 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=7 2024-09-21T06:04:27.627 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=0 2024-09-21T06:04:27.627 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-21T06:04:27.627 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=11 2024-09-21T06:04:27.628 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=5 2024-09-21T06:04:27.628 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T06:04:27.628 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T06:04:27.871 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:04:28.384 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T06:04:28.384 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:28.384 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 753, 2024-09-21T06:04:28.384 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 755, 2024-09-21T06:04:28.384 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 198997, 2024-09-21T06:04:28.384 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 239518, 2024-09-21T06:04:28.384 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 6, 2024-09-21T06:04:28.384 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:28.384 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.092368910, 2024-09-21T06:04:28.384 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.040404601, 2024-09-21T06:04:28.384 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.020422597, 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.022797091, 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 753, 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.035075051, 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000046580 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.385 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 909, 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 900, 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 1034002, 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 347089, 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 3, 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.130568409, 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.053918992, 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.053948995, 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.026278131, 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 900, 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.042681210, 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000047423 2024-09-21T06:04:28.386 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.387 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:28.387 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.387 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.387 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.387 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 870144, 2024-09-21T06:04:28.387 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 135296 2024-09-21T06:04:28.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.387 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:28.387 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 748, 2024-09-21T06:04:28.387 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 910, 2024-09-21T06:04:28.387 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 251152, 2024-09-21T06:04:28.387 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 603306, 2024-09-21T06:04:28.388 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:28.388 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 3, 2024-09-21T06:04:28.388 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.131826780, 2024-09-21T06:04:28.388 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.060207250, 2024-09-21T06:04:28.388 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.027730425, 2024-09-21T06:04:28.388 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.032765578, 2024-09-21T06:04:28.388 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:28.388 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 908, 2024-09-21T06:04:28.388 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.054979763, 2024-09-21T06:04:28.388 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000060550 2024-09-21T06:04:28.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.388 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:28.388 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 365760 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3616, 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.123335344, 2024-09-21T06:04:28.389 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000034108 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 0, 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 0, 2024-09-21T06:04:28.390 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 0, 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 0, 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 0, 2024-09-21T06:04:28.391 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 0, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 0, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 0, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 0, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 0, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 0, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 1, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 0, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 0, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2024-09-21T06:04:28.392 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:04:28.393 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 0, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 0, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 0 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2024-09-21T06:04:28.394 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:04:28.395 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_started": 0, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_succeeded": 0, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_write_failed": 0 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "evlrg": 0, 2024-09-21T06:04:28.396 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 0, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 4, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 0, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 2, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "segmjr": 2, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 4194304, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 4195424, 2024-09-21T06:04:28.397 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 4195283, 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 4 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 3, 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 3, 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 0, 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 1, 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 1, 2024-09-21T06:04:28.398 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 0, 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 0, 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 0, 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 0, 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 0, 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 0, 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 0, 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 117348, 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 316420096 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 0, 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 0, 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 0, 2024-09-21T06:04:28.399 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.401 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.402 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.403 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2024-09-21T06:04:28.403 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.403 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.403 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.403 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2024-09-21T06:04:28.403 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.403 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.404 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.404 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2024-09-21T06:04:28.404 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.404 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.404 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.404 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2024-09-21T06:04:28.404 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.404 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.404 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.404 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.407 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.408 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.409 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:28.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 0, 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 1, 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 1, 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 1, 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 0, 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 0, 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 1346, 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "mdthresh_evicted": 0 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:28.411 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:28.412 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:28.412 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:28.412 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:28.412 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:28.413 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:28.413 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:28.413 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:28.413 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:28.413 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:28.413 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:28.414 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 189378, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 51, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-21T06:04:28.415 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 7968, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 176, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 8672, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 13, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-21T06:04:28.416 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 2166, 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 21, 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 3, 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 2166, 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2166, 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1.665959455, 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000769141 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.417 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2166, 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 2167 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 2166, 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 2166, 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 0, 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 1411, 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 0, 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 753, 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 0, 2024-09-21T06:04:28.418 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 1, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2024-09-21T06:04:28.419 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2024-09-21T06:04:28.420 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 85, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 12, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 5, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 5, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 0, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 2, 2024-09-21T06:04:28.421 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 0 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 0, 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 0, 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed_ops": 0, 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 0, 2024-09-21T06:04:28.422 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 2406, 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 1252368, 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 2406, 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 2406, 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1252368, 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:28.423 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 2166, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 1125, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 2166, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 1125, 2024-09-21T06:04:28.424 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:28.425 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 2166, 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 2166, 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 2166, 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 2166, 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x560631703380": { 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T06:04:28.427 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 0, 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 0, 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T06:04:28.428 INFO:teuthology.orchestra.run.smithi119.stdout: "trackedop": { 2024-09-21T06:04:28.429 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 0 2024-09-21T06:04:28.429 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T06:04:28.429 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T06:04:28.429 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:28 smithi119 ceph-mon[34833]: pgmap v645: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:04:28.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:28 smithi007 ceph-mon[30983]: pgmap v645: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:04:28.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:28 smithi027 ceph-mon[34364]: pgmap v645: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:04:29.160 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-21T06:04:29.160 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-21T06:04:29.160 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-21T06:04:29.160 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-21T06:04:29.160 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-21T06:04:29.161 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:04:29.161 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:04:29.161 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T06:04:29.172 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T06:04:29.172 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:04:29.172 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:29.194 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:04:29.194 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:29.254 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T06:04:29.563 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:30.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.038+0000 7f94cce69640 1 -- 172.21.15.7:0/564688466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94c8105300 msgr2=0x7f94c810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.038+0000 7f94cce69640 1 --2- 172.21.15.7:0/564688466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94c8105300 0x7f94c810d850 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009900 tx=0x7f94bc02a410 comp rx=0 tx=0).stop 2024-09-21T06:04:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.038+0000 7f94cce69640 1 -- 172.21.15.7:0/564688466 shutdown_connections 2024-09-21T06:04:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.038+0000 7f94cce69640 1 --2- 172.21.15.7:0/564688466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94c8105300 0x7f94c810d850 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.038+0000 7f94cce69640 1 --2- 172.21.15.7:0/564688466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c810de10 0x7f94c8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.038+0000 7f94cce69640 1 --2- 172.21.15.7:0/564688466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94c81049b0 0x7f94c8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.038+0000 7f94cce69640 1 -- 172.21.15.7:0/564688466 >> 172.21.15.7:0/564688466 conn(0x7f94c8079730 msgr2=0x7f94c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.038+0000 7f94cce69640 1 -- 172.21.15.7:0/564688466 shutdown_connections 2024-09-21T06:04:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.038+0000 7f94cce69640 1 -- 172.21.15.7:0/564688466 wait complete. 2024-09-21T06:04:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.039+0000 7f94cce69640 1 Processor -- start 2024-09-21T06:04:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.039+0000 7f94cce69640 1 -- start start 2024-09-21T06:04:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.039+0000 7f94cce69640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c81049b0 0x7f94c819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.039+0000 7f94cce69640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94c8105300 0x7f94c819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.039+0000 7f94cce69640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94c810de10 0x7f94c819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94cce69640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f94c8113af0 con 0x7f94c8105300 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94cce69640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f94c8113970 con 0x7f94c810de10 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94cce69640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f94c8113c70 con 0x7f94c81049b0 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94c5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94c8105300 0x7f94c819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94c5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94c8105300 0x7f94c819ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45988/0 (socket says 172.21.15.7:45988) 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94c5d9b640 1 -- 172.21.15.7:0/3250694233 learned_addr learned my addr 172.21.15.7:0/3250694233 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94c6d9d640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94c810de10 0x7f94c819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94c659c640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c81049b0 0x7f94c819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94c5d9b640 1 -- 172.21.15.7:0/3250694233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c81049b0 msgr2=0x7f94c819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94c5d9b640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c81049b0 0x7f94c819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94c5d9b640 1 -- 172.21.15.7:0/3250694233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94c810de10 msgr2=0x7f94c819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94c5d9b640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94c810de10 0x7f94c819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94c5d9b640 1 -- 172.21.15.7:0/3250694233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c81a04d0 con 0x7f94c8105300 2024-09-21T06:04:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94c5d9b640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94c8105300 0x7f94c819ab00 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f94bc02a930 tx=0x7f94bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94b77fe640 1 -- 172.21.15.7:0/3250694233 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc03f030 con 0x7f94c8105300 2024-09-21T06:04:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94b77fe640 1 -- 172.21.15.7:0/3250694233 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94bc003aa0 con 0x7f94c8105300 2024-09-21T06:04:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94cce69640 1 -- 172.21.15.7:0/3250694233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c81a0760 con 0x7f94c8105300 2024-09-21T06:04:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.040+0000 7f94b77fe640 1 -- 172.21.15.7:0/3250694233 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc035070 con 0x7f94c8105300 2024-09-21T06:04:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.041+0000 7f94cce69640 1 -- 172.21.15.7:0/3250694233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c81a6f20 con 0x7f94c8105300 2024-09-21T06:04:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.041+0000 7f94cce69640 1 -- 172.21.15.7:0/3250694233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94c806b560 con 0x7f94c8105300 2024-09-21T06:04:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.043+0000 7f94b77fe640 1 -- 172.21.15.7:0/3250694233 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f94bc042030 con 0x7f94c8105300 2024-09-21T06:04:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.044+0000 7f94b77fe640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f94b00b6680 0x7f94b00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.044+0000 7f94c659c640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f94b00b6680 0x7f94b00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.044+0000 7f94b77fe640 1 -- 172.21.15.7:0/3250694233 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f94bc108110 con 0x7f94c8105300 2024-09-21T06:04:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.044+0000 7f94c659c640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f94b00b6680 0x7f94b00b8b90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f94c806bc60 tx=0x7f94b800d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.047+0000 7f94b77fe640 1 -- 172.21.15.7:0/3250694233 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f94bc0d2a30 con 0x7f94c8105300 2024-09-21T06:04:30.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.246+0000 7f94cce69640 1 -- 172.21.15.7:0/3250694233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f94c8108f10 con 0x7f94c8105300 2024-09-21T06:04:30.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.247+0000 7f94b77fe640 1 -- 172.21.15.7:0/3250694233 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v85) ==== 81+0+871 (secure 0 0 0) 0x7f94bc0d7970 con 0x7f94c8105300 2024-09-21T06:04:30.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/4143746508 2024-09-22T05:45:22.373420+0000 2024-09-21T06:04:30.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1505943829 2024-09-22T05:43:54.947457+0000 2024-09-21T06:04:30.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1622456881 2024-09-22T05:44:20.678295+0000 2024-09-21T06:04:30.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/833696585 2024-09-22T05:43:54.947457+0000 2024-09-21T06:04:30.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2055984288 2024-09-22T05:43:54.947457+0000 2024-09-21T06:04:30.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3203783640 2024-09-22T05:43:54.947457+0000 2024-09-21T06:04:30.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/2964502604 2024-09-22T05:44:20.678295+0000 2024-09-21T06:04:30.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3203783640 2024-09-22T05:43:54.947457+0000 2024-09-21T06:04:30.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/2964502604 2024-09-22T05:44:20.678295+0000 2024-09-21T06:04:30.249 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3995317885 2024-09-22T05:45:22.373420+0000 2024-09-21T06:04:30.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2229583478 2024-09-22T05:44:20.678295+0000 2024-09-21T06:04:30.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/468393974 2024-09-22T05:44:20.678295+0000 2024-09-21T06:04:30.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1009303060 2024-09-22T05:45:22.373420+0000 2024-09-21T06:04:30.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2125734440 2024-09-22T05:45:22.373420+0000 2024-09-21T06:04:30.250 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3995317885 2024-09-22T05:45:22.373420+0000 2024-09-21T06:04:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:listed 15 entries 2024-09-21T06:04:30.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.249+0000 7f94cce69640 1 -- 172.21.15.7:0/3250694233 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f94b00b6680 msgr2=0x7f94b00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.249+0000 7f94cce69640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f94b00b6680 0x7f94b00b8b90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f94c806bc60 tx=0x7f94b800d040 comp rx=0 tx=0).stop 2024-09-21T06:04:30.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.249+0000 7f94cce69640 1 -- 172.21.15.7:0/3250694233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94c8105300 msgr2=0x7f94c819ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.249+0000 7f94cce69640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94c8105300 0x7f94c819ab00 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f94bc02a930 tx=0x7f94bc004270 comp rx=0 tx=0).stop 2024-09-21T06:04:30.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.249+0000 7f94cce69640 1 -- 172.21.15.7:0/3250694233 shutdown_connections 2024-09-21T06:04:30.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.249+0000 7f94cce69640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f94b00b6680 0x7f94b00b8b90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.249+0000 7f94cce69640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94c8105300 0x7f94c819ab00 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.249+0000 7f94cce69640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94c810de10 0x7f94c819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.249+0000 7f94cce69640 1 --2- 172.21.15.7:0/3250694233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c81049b0 0x7f94c819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.249+0000 7f94cce69640 1 -- 172.21.15.7:0/3250694233 >> 172.21.15.7:0/3250694233 conn(0x7f94c8079730 msgr2=0x7f94c8100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:30.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.250+0000 7f94cce69640 1 -- 172.21.15.7:0/3250694233 shutdown_connections 2024-09-21T06:04:30.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:30.250+0000 7f94cce69640 1 -- 172.21.15.7:0/3250694233 wait complete. 2024-09-21T06:04:30.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:30 smithi007 ceph-mon[30983]: pgmap v646: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:04:30.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:30 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3250694233' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:04:30.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:30 smithi119 ceph-mon[34833]: pgmap v646: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:04:30.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:30 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3250694233' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:04:30.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:30 smithi027 ceph-mon[34364]: pgmap v646: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:04:30.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:30 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3250694233' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:04:30.988 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:04:30.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:30.989 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:04:31.041 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T06:04:31.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:31.041 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:04:31.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:31.084 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-21T06:04:31.142 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:04:31.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:31.142 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:04:31.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:31.211 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-09-21T06:04:31.320 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T06:04:31.331 INFO:tasks.cephadm:Teardown begin 2024-09-21T06:04:31.332 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:04:31.332 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:04:31.595 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:32.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.022+0000 7f81686aa640 1 -- 172.21.15.7:0/1383552633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f816010de10 msgr2=0x7f8160110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.022+0000 7f81686aa640 1 --2- 172.21.15.7:0/1383552633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f816010de10 0x7f8160110300 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f8158009900 tx=0x7f815802a410 comp rx=0 tx=0).stop 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.022+0000 7f81686aa640 1 -- 172.21.15.7:0/1383552633 shutdown_connections 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.022+0000 7f81686aa640 1 --2- 172.21.15.7:0/1383552633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f816010de10 0x7f8160110300 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.022+0000 7f81686aa640 1 --2- 172.21.15.7:0/1383552633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8160105300 0x7f816010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.022+0000 7f81686aa640 1 --2- 172.21.15.7:0/1383552633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81601049b0 0x7f8160104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.022+0000 7f81686aa640 1 -- 172.21.15.7:0/1383552633 >> 172.21.15.7:0/1383552633 conn(0x7f8160079730 msgr2=0x7f8160079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.022+0000 7f81686aa640 1 -- 172.21.15.7:0/1383552633 shutdown_connections 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.022+0000 7f81686aa640 1 -- 172.21.15.7:0/1383552633 wait complete. 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.023+0000 7f81686aa640 1 Processor -- start 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.023+0000 7f81686aa640 1 -- start start 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.023+0000 7f81686aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81601049b0 0x7f816019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.023+0000 7f81686aa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8160105300 0x7f816019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.023+0000 7f81686aa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f816010de10 0x7f816019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.023+0000 7f81686aa640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8160113a70 con 0x7f81601049b0 2024-09-21T06:04:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.023+0000 7f81686aa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f81601138f0 con 0x7f816010de10 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.023+0000 7f81686aa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8160113bf0 con 0x7f8160105300 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f8166446640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81601049b0 0x7f816019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f8165c45640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8160105300 0x7f816019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f8166446640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81601049b0 0x7f816019a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46016/0 (socket says 172.21.15.7:46016) 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f8166446640 1 -- 172.21.15.7:0/2740503189 learned_addr learned my addr 172.21.15.7:0/2740503189 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f8165c45640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8160105300 0x7f816019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.7:57882/0 (socket says 172.21.15.7:57882) 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f8166c47640 1 --2- 172.21.15.7:0/2740503189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f816010de10 0x7f816019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f8166446640 1 -- 172.21.15.7:0/2740503189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8160105300 msgr2=0x7f816019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f8166446640 1 --2- 172.21.15.7:0/2740503189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8160105300 0x7f816019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f8166446640 1 -- 172.21.15.7:0/2740503189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f816010de10 msgr2=0x7f816019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f8166446640 1 --2- 172.21.15.7:0/2740503189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f816010de10 0x7f816019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f8166446640 1 -- 172.21.15.7:0/2740503189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81601a02f0 con 0x7f81601049b0 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f8166446640 1 --2- 172.21.15.7:0/2740503189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81601049b0 0x7f816019a440 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f815c00ea80 tx=0x7f815c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f81577fe640 1 -- 172.21.15.7:0/2740503189 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c00cd80 con 0x7f81601049b0 2024-09-21T06:04:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f81686aa640 1 -- 172.21.15.7:0/2740503189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81601a05e0 con 0x7f81601049b0 2024-09-21T06:04:32.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f81577fe640 1 -- 172.21.15.7:0/2740503189 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f815c011920 con 0x7f81601049b0 2024-09-21T06:04:32.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f81577fe640 1 -- 172.21.15.7:0/2740503189 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c01a980 con 0x7f81601049b0 2024-09-21T06:04:32.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.024+0000 7f81686aa640 1 -- 172.21.15.7:0/2740503189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81601a6e00 con 0x7f81601049b0 2024-09-21T06:04:32.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.025+0000 7f81686aa640 1 -- 172.21.15.7:0/2740503189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8160104dc0 con 0x7f81601049b0 2024-09-21T06:04:32.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.027+0000 7f81577fe640 1 -- 172.21.15.7:0/2740503189 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f815c011470 con 0x7f81601049b0 2024-09-21T06:04:32.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.028+0000 7f81577fe640 1 --2- 172.21.15.7:0/2740503189 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f814c0b66b0 0x7f814c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:32.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.028+0000 7f8165c45640 1 --2- 172.21.15.7:0/2740503189 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f814c0b66b0 0x7f814c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:32.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.028+0000 7f81577fe640 1 -- 172.21.15.7:0/2740503189 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f815c0e7d60 con 0x7f81601049b0 2024-09-21T06:04:32.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.028+0000 7f8165c45640 1 --2- 172.21.15.7:0/2740503189 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f814c0b66b0 0x7f814c0b8bc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f816010fa50 tx=0x7f815000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:32.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.031+0000 7f81577fe640 1 -- 172.21.15.7:0/2740503189 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f815c058710 con 0x7f81601049b0 2024-09-21T06:04:32.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.258+0000 7f81686aa640 1 -- 172.21.15.7:0/2740503189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f816019b570 con 0x7f81601049b0 2024-09-21T06:04:32.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.259+0000 7f81577fe640 1 -- 172.21.15.7:0/2740503189 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f815c016030 con 0x7f81601049b0 2024-09-21T06:04:32.261 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:04:32.261 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:04:32.261 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:04:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.261+0000 7f81686aa640 1 -- 172.21.15.7:0/2740503189 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f814c0b66b0 msgr2=0x7f814c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.261+0000 7f81686aa640 1 --2- 172.21.15.7:0/2740503189 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f814c0b66b0 0x7f814c0b8bc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f816010fa50 tx=0x7f815000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.261+0000 7f81686aa640 1 -- 172.21.15.7:0/2740503189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81601049b0 msgr2=0x7f816019a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.261+0000 7f81686aa640 1 --2- 172.21.15.7:0/2740503189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81601049b0 0x7f816019a440 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f815c00ea80 tx=0x7f815c00ee80 comp rx=0 tx=0).stop 2024-09-21T06:04:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.261+0000 7f81686aa640 1 -- 172.21.15.7:0/2740503189 shutdown_connections 2024-09-21T06:04:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.261+0000 7f81686aa640 1 --2- 172.21.15.7:0/2740503189 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f814c0b66b0 0x7f814c0b8bc0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.261+0000 7f81686aa640 1 --2- 172.21.15.7:0/2740503189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f816010de10 0x7f816019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.261+0000 7f81686aa640 1 --2- 172.21.15.7:0/2740503189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8160105300 0x7f816019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.261+0000 7f81686aa640 1 --2- 172.21.15.7:0/2740503189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81601049b0 0x7f816019a440 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.261+0000 7f81686aa640 1 -- 172.21.15.7:0/2740503189 >> 172.21.15.7:0/2740503189 conn(0x7f8160079730 msgr2=0x7f81600ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:32.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.261+0000 7f81686aa640 1 -- 172.21.15.7:0/2740503189 shutdown_connections 2024-09-21T06:04:32.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:32.261+0000 7f81686aa640 1 -- 172.21.15.7:0/2740503189 wait complete. 2024-09-21T06:04:32.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:32 smithi007 ceph-mon[30983]: pgmap v647: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:04:32.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:32 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2740503189' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:32.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:32 smithi119 ceph-mon[34833]: pgmap v647: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:04:32.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:32 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/2740503189' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:32.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:32 smithi027 ceph-mon[34364]: pgmap v647: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:04:32.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:32 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/2740503189' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:33.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:04:33.316 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:33.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.780+0000 7f2924fad640 1 -- 172.21.15.7:0/454141686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2920102a60 msgr2=0x7f2920102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.780+0000 7f2924fad640 1 --2- 172.21.15.7:0/454141686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2920102a60 0x7f2920102e70 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f2910009900 tx=0x7f291002a410 comp rx=0 tx=0).stop 2024-09-21T06:04:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.780+0000 7f2924fad640 1 -- 172.21.15.7:0/454141686 shutdown_connections 2024-09-21T06:04:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.780+0000 7f2924fad640 1 --2- 172.21.15.7:0/454141686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2920108cf0 0x7f292010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.780+0000 7f2924fad640 1 --2- 172.21.15.7:0/454141686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29201083a0 0x7f29201087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.780+0000 7f2924fad640 1 --2- 172.21.15.7:0/454141686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2920102a60 0x7f2920102e70 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.780+0000 7f2924fad640 1 -- 172.21.15.7:0/454141686 >> 172.21.15.7:0/454141686 conn(0x7f2920079730 msgr2=0x7f2920079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.781+0000 7f2924fad640 1 -- 172.21.15.7:0/454141686 shutdown_connections 2024-09-21T06:04:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.781+0000 7f2924fad640 1 -- 172.21.15.7:0/454141686 wait complete. 2024-09-21T06:04:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.781+0000 7f2924fad640 1 Processor -- start 2024-09-21T06:04:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.781+0000 7f2924fad640 1 -- start start 2024-09-21T06:04:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f2924fad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2920102a60 0x7f2920104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f2924fad640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29201083a0 0x7f2920104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f2924fad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2920108cf0 0x7f2920104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f2924fad640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2920112960 con 0x7f2920108cf0 2024-09-21T06:04:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f2924fad640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f29201127e0 con 0x7f29201083a0 2024-09-21T06:04:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f2924fad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2920112ae0 con 0x7f2920102a60 2024-09-21T06:04:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f291ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2920108cf0 0x7f2920104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f291ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2920108cf0 0x7f2920104cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46036/0 (socket says 172.21.15.7:46036) 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f291ed9d640 1 -- 172.21.15.7:0/368889830 learned_addr learned my addr 172.21.15.7:0/368889830 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f291e59c640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2920102a60 0x7f2920104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f291dd9b640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29201083a0 0x7f2920104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f291ed9d640 1 -- 172.21.15.7:0/368889830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2920102a60 msgr2=0x7f2920104250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f291ed9d640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2920102a60 0x7f2920104250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f291ed9d640 1 -- 172.21.15.7:0/368889830 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29201083a0 msgr2=0x7f2920104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f291ed9d640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29201083a0 0x7f2920104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.782+0000 7f291ed9d640 1 -- 172.21.15.7:0/368889830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29201a8720 con 0x7f2920108cf0 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.783+0000 7f291ed9d640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2920108cf0 0x7f2920104cd0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f291800eaa0 tx=0x7f291800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.783+0000 7f290f7fe640 1 -- 172.21.15.7:0/368889830 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291800cdb0 con 0x7f2920108cf0 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.783+0000 7f2924fad640 1 -- 172.21.15.7:0/368889830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29201a8a10 con 0x7f2920108cf0 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.783+0000 7f290f7fe640 1 -- 172.21.15.7:0/368889830 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2918005020 con 0x7f2920108cf0 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.783+0000 7f290f7fe640 1 -- 172.21.15.7:0/368889830 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29180116d0 con 0x7f2920108cf0 2024-09-21T06:04:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.783+0000 7f2924fad640 1 -- 172.21.15.7:0/368889830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29201a8f00 con 0x7f2920108cf0 2024-09-21T06:04:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.784+0000 7f2924fad640 1 -- 172.21.15.7:0/368889830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2920102e70 con 0x7f2920108cf0 2024-09-21T06:04:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.787+0000 7f290f7fe640 1 -- 172.21.15.7:0/368889830 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f29180051d0 con 0x7f2920108cf0 2024-09-21T06:04:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.787+0000 7f290f7fe640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f29080b6680 0x7f29080b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.787+0000 7f291e59c640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f29080b6680 0x7f29080b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.788+0000 7f290f7fe640 1 -- 172.21.15.7:0/368889830 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f29180e7d40 con 0x7f2920108cf0 2024-09-21T06:04:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.788+0000 7f291e59c640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f29080b6680 0x7f29080b8b90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2910000c00 tx=0x7f2910031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:33.791+0000 7f290f7fe640 1 -- 172.21.15.7:0/368889830 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2918016030 con 0x7f2920108cf0 2024-09-21T06:04:34.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.018+0000 7f2924fad640 1 -- 172.21.15.7:0/368889830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2920105550 con 0x7f2920108cf0 2024-09-21T06:04:34.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.019+0000 7f290f7fe640 1 -- 172.21.15.7:0/368889830 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f2920105550 con 0x7f2920108cf0 2024-09-21T06:04:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:04:34.021 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T05:53:34:627211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/806638499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":806638499},{"type":"v1","addr":"172.21.15.7:6835","nonce":806638499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3313125359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3313125359},{"type":"v1","addr":"172.21.15.7:6837","nonce":3313125359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14850,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1135458977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1135458977},{"type":"v1","addr":"172.21.15.7:6839","nonce":1135458977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14856,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1570509958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1570509958},{"type":"v1","addr":"172.21.15.7:6841","nonce":1570509958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24605,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/3377430896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":3377430896},{"type":"v1","addr":"172.21.15.27:6833","nonce":3377430896}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/1038330056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":1038330056},{"type":"v1","addr":"172.21.15.27:6835","nonce":1038330056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:51:50.882920+0000","modified":"2024-09-21T05:53:33.767152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24691,"mds_1":24686,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6833/1234076482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1234076482},{"type":"v1","addr":"172.21.15.119:6833","nonce":1234076482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6837/1469000794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1469000794},{"type":"v1","addr":"172.21.15.27:6837","nonce":1469000794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.119:6835/4262162696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4262162696},{"type":"v1","addr":"172.21.15.119:6835","nonce":4262162696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.119:6837/3266640886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3266640886},{"type":"v1","addr":"172.21.15.119:6837","nonce":3266640886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.27:6839/556391029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":556391029},{"type":"v1","addr":"172.21.15.27:6839","nonce":556391029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6839/1840148228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1840148228},{"type":"v1","addr":"172.21.15.119:6839","nonce":1840148228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24691,"qdb_cluster":[24691,24686,24679]},"id":1}]} 2024-09-21T06:04:34.021 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:04:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.021+0000 7f2924fad640 1 -- 172.21.15.7:0/368889830 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f29080b6680 msgr2=0x7f29080b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.021+0000 7f2924fad640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f29080b6680 0x7f29080b8b90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2910000c00 tx=0x7f2910031400 comp rx=0 tx=0).stop 2024-09-21T06:04:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.021+0000 7f2924fad640 1 -- 172.21.15.7:0/368889830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2920108cf0 msgr2=0x7f2920104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.021+0000 7f2924fad640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2920108cf0 0x7f2920104cd0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f291800eaa0 tx=0x7f291800ef60 comp rx=0 tx=0).stop 2024-09-21T06:04:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.021+0000 7f2924fad640 1 -- 172.21.15.7:0/368889830 shutdown_connections 2024-09-21T06:04:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.021+0000 7f2924fad640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f29080b6680 0x7f29080b8b90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.021+0000 7f2924fad640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2920108cf0 0x7f2920104cd0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.021+0000 7f2924fad640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29201083a0 0x7f2920104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.021+0000 7f2924fad640 1 --2- 172.21.15.7:0/368889830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2920102a60 0x7f2920104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:34.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.021+0000 7f2924fad640 1 -- 172.21.15.7:0/368889830 >> 172.21.15.7:0/368889830 conn(0x7f2920079730 msgr2=0x7f29201019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:34.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.021+0000 7f2924fad640 1 -- 172.21.15.7:0/368889830 shutdown_connections 2024-09-21T06:04:34.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:34.021+0000 7f2924fad640 1 -- 172.21.15.7:0/368889830 wait complete. 2024-09-21T06:04:34.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:34 smithi007 ceph-mon[30983]: pgmap v648: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:04:34.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:34 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/368889830' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:34.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:34 smithi119 ceph-mon[34833]: pgmap v648: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:04:34.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:34 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/368889830' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:34.720 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:04:34.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:34 smithi027 ceph-mon[34364]: pgmap v648: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:04:34.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:34 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/368889830' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:34.984 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:35.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.505+0000 7fb6ce164640 1 -- 172.21.15.7:0/686216507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c8109eb0 msgr2=0x7fb6c81106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:35.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.505+0000 7fb6ce164640 1 --2- 172.21.15.7:0/686216507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c8109eb0 0x7fb6c81106e0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009ca0 tx=0x7fb6c002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.505+0000 7fb6ce164640 1 -- 172.21.15.7:0/686216507 shutdown_connections 2024-09-21T06:04:35.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.505+0000 7fb6ce164640 1 --2- 172.21.15.7:0/686216507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c8109eb0 0x7fb6c81106e0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.505+0000 7fb6ce164640 1 --2- 172.21.15.7:0/686216507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c8109560 0x7fb6c8109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.505+0000 7fb6ce164640 1 --2- 172.21.15.7:0/686216507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6c8102080 0x7fb6c8102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.505+0000 7fb6ce164640 1 -- 172.21.15.7:0/686216507 >> 172.21.15.7:0/686216507 conn(0x7fb6c8079ec0 msgr2=0x7fb6c807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.505+0000 7fb6ce164640 1 -- 172.21.15.7:0/686216507 shutdown_connections 2024-09-21T06:04:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.505+0000 7fb6ce164640 1 -- 172.21.15.7:0/686216507 wait complete. 2024-09-21T06:04:35.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.506+0000 7fb6ce164640 1 Processor -- start 2024-09-21T06:04:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.506+0000 7fb6ce164640 1 -- start start 2024-09-21T06:04:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.506+0000 7fb6ce164640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6c8102080 0x7fb6c819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:35.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.506+0000 7fb6ce164640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c8109560 0x7fb6c819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.506+0000 7fb6ce164640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c8109eb0 0x7fb6c819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.506+0000 7fb6ce164640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c8113b70 con 0x7fb6c8109eb0 2024-09-21T06:04:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.506+0000 7fb6ce164640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81139f0 con 0x7fb6c8109560 2024-09-21T06:04:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.506+0000 7fb6ce164640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c8113cf0 con 0x7fb6c8102080 2024-09-21T06:04:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.506+0000 7fb6c7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c8109eb0 0x7fb6c819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.506+0000 7fb6c7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c8109eb0 0x7fb6c819fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46062/0 (socket says 172.21.15.7:46062) 2024-09-21T06:04:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.506+0000 7fb6c7fff640 1 -- 172.21.15.7:0/252911299 learned_addr learned my addr 172.21.15.7:0/252911299 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.506+0000 7fb6c6ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c8109560 0x7fb6c819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.507+0000 7fb6c77fe640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6c8102080 0x7fb6c819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.507+0000 7fb6c7fff640 1 -- 172.21.15.7:0/252911299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6c8102080 msgr2=0x7fb6c819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.507+0000 7fb6c7fff640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6c8102080 0x7fb6c819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.507+0000 7fb6c7fff640 1 -- 172.21.15.7:0/252911299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c8109560 msgr2=0x7fb6c819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:35.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.507+0000 7fb6c7fff640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c8109560 0x7fb6c819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.507+0000 7fb6c7fff640 1 -- 172.21.15.7:0/252911299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c81a0470 con 0x7fb6c8109eb0 2024-09-21T06:04:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.507+0000 7fb6c77fe640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6c8102080 0x7fb6c819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.507+0000 7fb6c7fff640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c8109eb0 0x7fb6c819fd40 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0005cc0 tx=0x7fb6c002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.507+0000 7fb6c4ff9640 1 -- 172.21.15.7:0/252911299 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0003bf0 con 0x7fb6c8109eb0 2024-09-21T06:04:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.507+0000 7fb6c4ff9640 1 -- 172.21.15.7:0/252911299 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6c0003d90 con 0x7fb6c8109eb0 2024-09-21T06:04:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.507+0000 7fb6c4ff9640 1 -- 172.21.15.7:0/252911299 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c002fbc0 con 0x7fb6c8109eb0 2024-09-21T06:04:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.507+0000 7fb6ce164640 1 -- 172.21.15.7:0/252911299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c81a0700 con 0x7fb6c8109eb0 2024-09-21T06:04:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.507+0000 7fb6ce164640 1 -- 172.21.15.7:0/252911299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c81a6ec0 con 0x7fb6c8109eb0 2024-09-21T06:04:35.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.508+0000 7fb6ce164640 1 -- 172.21.15.7:0/252911299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c8102490 con 0x7fb6c8109eb0 2024-09-21T06:04:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.510+0000 7fb6c4ff9640 1 -- 172.21.15.7:0/252911299 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7fb6c002fd60 con 0x7fb6c8109eb0 2024-09-21T06:04:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.511+0000 7fb6c4ff9640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb6b00b6700 0x7fb6b00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.511+0000 7fb6c77fe640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb6b00b6700 0x7fb6b00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.511+0000 7fb6c4ff9640 1 -- 172.21.15.7:0/252911299 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fb6c0108cc0 con 0x7fb6c8109eb0 2024-09-21T06:04:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.511+0000 7fb6c77fe640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb6b00b6700 0x7fb6b00b8c10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8005fd0 tx=0x7fb6b8005ea0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:35.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.514+0000 7fb6c4ff9640 1 -- 172.21.15.7:0/252911299 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6c00cf260 con 0x7fb6c8109eb0 2024-09-21T06:04:35.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.703+0000 7fb6ce164640 1 -- 172.21.15.7:0/252911299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6c819b630 con 0x7fb6c8109eb0 2024-09-21T06:04:35.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.704+0000 7fb6c4ff9640 1 -- 172.21.15.7:0/252911299 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22916 (secure 0 0 0) 0x7fb6c00d3640 con 0x7fb6c8109eb0 2024-09-21T06:04:35.706 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:04:35.707 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":85,"fsid":"397810bc-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:43:32.863896+0000","modified":"2024-09-21T06:04:17.796083+0000","last_up_change":"2024-09-21T05:51:02.074799+0000","last_in_change":"2024-09-21T05:50:39.016405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:47:20.844179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:51:46.238763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:51:48.832249+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":84,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d7a68ba-a599-44a9-a0de-a1d6df51f437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6803","nonce":536257283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6805","nonce":536257283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6809","nonce":536257283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":536257283},{"type":"v1","addr":"172.21.15.7:6807","nonce":536257283}]},"public_addr":"172.21.15.7:6803/536257283","cluster_addr":"172.21.15.7:6805/536257283","heartbeat_back_addr":"172.21.15.7:6809/536257283","heartbeat_front_addr":"172.21.15.7:6807/536257283","state":["exists","up"]},{"osd":1,"uuid":"d4600805-1cb5-432a-8ae0-a40107a6c6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6801","nonce":2299402871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6803","nonce":2299402871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6807","nonce":2299402871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2299402871},{"type":"v1","addr":"172.21.15.27:6805","nonce":2299402871}]},"public_addr":"172.21.15.27:6801/2299402871","cluster_addr":"172.21.15.27:6803/2299402871","heartbeat_back_addr":"172.21.15.27:6807/2299402871","heartbeat_front_addr":"172.21.15.27:6805/2299402871","state":["exists","up"]},{"osd":2,"uuid":"aa435f82-5819-4497-9053-1d891e712b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6801","nonce":1043408043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6803","nonce":1043408043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6807","nonce":1043408043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1043408043},{"type":"v1","addr":"172.21.15.119:6805","nonce":1043408043}]},"public_addr":"172.21.15.119:6801/1043408043","cluster_addr":"172.21.15.119:6803/1043408043","heartbeat_back_addr":"172.21.15.119:6807/1043408043","heartbeat_front_addr":"172.21.15.119:6805/1043408043","state":["exists","up"]},{"osd":3,"uuid":"55803f97-02e1-43c0-b8da-9b8af32fd1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6811","nonce":1261229771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6813","nonce":1261229771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6817","nonce":1261229771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1261229771},{"type":"v1","addr":"172.21.15.7:6815","nonce":1261229771}]},"public_addr":"172.21.15.7:6811/1261229771","cluster_addr":"172.21.15.7:6813/1261229771","heartbeat_back_addr":"172.21.15.7:6817/1261229771","heartbeat_front_addr":"172.21.15.7:6815/1261229771","state":["exists","up"]},{"osd":4,"uuid":"987ce230-5bfc-45a7-a33e-6291545afded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6809","nonce":631467792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6811","nonce":631467792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6815","nonce":631467792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":631467792},{"type":"v1","addr":"172.21.15.27:6813","nonce":631467792}]},"public_addr":"172.21.15.27:6809/631467792","cluster_addr":"172.21.15.27:6811/631467792","heartbeat_back_addr":"172.21.15.27:6815/631467792","heartbeat_front_addr":"172.21.15.27:6813/631467792","state":["exists","up"]},{"osd":5,"uuid":"e768fbfa-8983-4ff6-8dca-b7df2304cf91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6809","nonce":2530968619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6811","nonce":2530968619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6815","nonce":2530968619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2530968619},{"type":"v1","addr":"172.21.15.119:6813","nonce":2530968619}]},"public_addr":"172.21.15.119:6809/2530968619","cluster_addr":"172.21.15.119:6811/2530968619","heartbeat_back_addr":"172.21.15.119:6815/2530968619","heartbeat_front_addr":"172.21.15.119:6813/2530968619","state":["exists","up"]},{"osd":6,"uuid":"22496f13-64be-479b-89ea-bf51544199c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6819","nonce":856032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6821","nonce":856032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6825","nonce":856032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":856032021},{"type":"v1","addr":"172.21.15.7:6823","nonce":856032021}]},"public_addr":"172.21.15.7:6819/856032021","cluster_addr":"172.21.15.7:6821/856032021","heartbeat_back_addr":"172.21.15.7:6825/856032021","heartbeat_front_addr":"172.21.15.7:6823/856032021","state":["exists","up"]},{"osd":7,"uuid":"53fc5616-b06a-498e-a60e-d7d7d6ba2a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6817","nonce":2862843529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6819","nonce":2862843529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6823","nonce":2862843529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":2862843529},{"type":"v1","addr":"172.21.15.27:6821","nonce":2862843529}]},"public_addr":"172.21.15.27:6817/2862843529","cluster_addr":"172.21.15.27:6819/2862843529","heartbeat_back_addr":"172.21.15.27:6823/2862843529","heartbeat_front_addr":"172.21.15.27:6821/2862843529","state":["exists","up"]},{"osd":8,"uuid":"53c96fe8-14fa-4d6d-94bf-dcdb49bc59b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6817","nonce":3663835202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6819","nonce":3663835202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6823","nonce":3663835202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3663835202},{"type":"v1","addr":"172.21.15.119:6821","nonce":3663835202}]},"public_addr":"172.21.15.119:6817/3663835202","cluster_addr":"172.21.15.119:6819/3663835202","heartbeat_back_addr":"172.21.15.119:6823/3663835202","heartbeat_front_addr":"172.21.15.119:6821/3663835202","state":["exists","up"]},{"osd":9,"uuid":"a69a747d-1e6c-4940-9d96-4315ab384588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6827","nonce":2348805959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6829","nonce":2348805959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6833","nonce":2348805959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2348805959},{"type":"v1","addr":"172.21.15.7:6831","nonce":2348805959}]},"public_addr":"172.21.15.7:6827/2348805959","cluster_addr":"172.21.15.7:6829/2348805959","heartbeat_back_addr":"172.21.15.7:6833/2348805959","heartbeat_front_addr":"172.21.15.7:6831/2348805959","state":["exists","up"]},{"osd":10,"uuid":"a8f67271-99bb-4fb7-b0f5-a24730cd96cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6825","nonce":2363600090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6827","nonce":2363600090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6831","nonce":2363600090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":2363600090},{"type":"v1","addr":"172.21.15.27:6829","nonce":2363600090}]},"public_addr":"172.21.15.27:6825/2363600090","cluster_addr":"172.21.15.27:6827/2363600090","heartbeat_back_addr":"172.21.15.27:6831/2363600090","heartbeat_front_addr":"172.21.15.27:6829/2363600090","state":["exists","up"]},{"osd":11,"uuid":"88456735-00b1-479c-b201-588a9ee0c881","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6825","nonce":3937692826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6827","nonce":3937692826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6831","nonce":3937692826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3937692826},{"type":"v1","addr":"172.21.15.119:6829","nonce":3937692826}]},"public_addr":"172.21.15.119:6825/3937692826","cluster_addr":"172.21.15.119:6827/3937692826","heartbeat_back_addr":"172.21.15.119:6831/3937692826","heartbeat_front_addr":"172.21.15.119:6829/3937692826","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:26.217550+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:51.830871+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:17.201362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:41.990894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:07.357782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.114180+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:56.808155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:22.565234+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:46.981522+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:10.600602+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:50:35.973766+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:51:00.216062+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/4143746508":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/1505943829":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/1622456881":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/833696585":"2024-09-22T05:43:54.947457+0000","172.21.15.7:0/2055984288":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6801/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3203783640":"2024-09-22T05:43:54.947457+0000","172.21.15.7:6800/2964502604":"2024-09-22T05:44:20.678295+0000","172.21.15.7:6801/3995317885":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2229583478":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/468393974":"2024-09-22T05:44:20.678295+0000","172.21.15.7:0/1009303060":"2024-09-22T05:45:22.373420+0000","172.21.15.7:0/2125734440":"2024-09-22T05:45:22.373420+0000","172.21.15.7:6800/3995317885":"2024-09-22T05:45:22.373420+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.707+0000 7fb6ce164640 1 -- 172.21.15.7:0/252911299 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb6b00b6700 msgr2=0x7fb6b00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.707+0000 7fb6ce164640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb6b00b6700 0x7fb6b00b8c10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8005fd0 tx=0x7fb6b8005ea0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.707+0000 7fb6ce164640 1 -- 172.21.15.7:0/252911299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c8109eb0 msgr2=0x7fb6c819fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.707+0000 7fb6ce164640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c8109eb0 0x7fb6c819fd40 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0005cc0 tx=0x7fb6c002f380 comp rx=0 tx=0).stop 2024-09-21T06:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.707+0000 7fb6ce164640 1 -- 172.21.15.7:0/252911299 shutdown_connections 2024-09-21T06:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.707+0000 7fb6ce164640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7fb6b00b6700 0x7fb6b00b8c10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.707+0000 7fb6ce164640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6c8109eb0 0x7fb6c819fd40 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.707+0000 7fb6ce164640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c8109560 0x7fb6c819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.707+0000 7fb6ce164640 1 --2- 172.21.15.7:0/252911299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6c8102080 0x7fb6c819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.707+0000 7fb6ce164640 1 -- 172.21.15.7:0/252911299 >> 172.21.15.7:0/252911299 conn(0x7fb6c8079ec0 msgr2=0x7fb6c81054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.708+0000 7fb6ce164640 1 -- 172.21.15.7:0/252911299 shutdown_connections 2024-09-21T06:04:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:35.708+0000 7fb6ce164640 1 -- 172.21.15.7:0/252911299 wait complete. 2024-09-21T06:04:36.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:36 smithi007 ceph-mon[30983]: pgmap v649: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T06:04:36.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:36 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/252911299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:04:36.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T06:04:36.591 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:36 smithi119 ceph-mon[34833]: pgmap v649: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T06:04:36.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:36 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/252911299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:04:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:36.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:36 smithi027 ceph-mon[34364]: pgmap v649: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T06:04:36.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:36 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/252911299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:04:37.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.122+0000 7f41b53d5640 1 -- 172.21.15.7:0/2580330258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b01083a0 msgr2=0x7f41b01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.122+0000 7f41b53d5640 1 --2- 172.21.15.7:0/2580330258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b01083a0 0x7f41b01087b0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009900 tx=0x7f41a402a410 comp rx=0 tx=0).stop 2024-09-21T06:04:37.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.122+0000 7f41b53d5640 1 -- 172.21.15.7:0/2580330258 shutdown_connections 2024-09-21T06:04:37.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.122+0000 7f41b53d5640 1 --2- 172.21.15.7:0/2580330258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b01083a0 0x7f41b01087b0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.122+0000 7f41b53d5640 1 --2- 172.21.15.7:0/2580330258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41b0108cf0 0x7f41b010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.122+0000 7f41b53d5640 1 --2- 172.21.15.7:0/2580330258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b0102a60 0x7f41b0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.122+0000 7f41b53d5640 1 -- 172.21.15.7:0/2580330258 >> 172.21.15.7:0/2580330258 conn(0x7f41b0079730 msgr2=0x7f41b0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:37.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.122+0000 7f41b53d5640 1 -- 172.21.15.7:0/2580330258 shutdown_connections 2024-09-21T06:04:37.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.122+0000 7f41b53d5640 1 -- 172.21.15.7:0/2580330258 wait complete. 2024-09-21T06:04:37.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.123+0000 7f41b53d5640 1 Processor -- start 2024-09-21T06:04:37.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.123+0000 7f41b53d5640 1 -- start start 2024-09-21T06:04:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.123+0000 7f41b53d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b0102a60 0x7f41b019b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.123+0000 7f41b53d5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b01083a0 0x7f41b019b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.123+0000 7f41b53d5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41b0108cf0 0x7f41b019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.123+0000 7f41b53d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f41b0112960 con 0x7f41b0102a60 2024-09-21T06:04:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.123+0000 7f41b53d5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f41b01127e0 con 0x7f41b0108cf0 2024-09-21T06:04:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.123+0000 7f41b53d5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f41b0112ae0 con 0x7f41b01083a0 2024-09-21T06:04:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.123+0000 7f41aeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b0102a60 0x7f41b019b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f41ae7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b01083a0 0x7f41b019b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f41aeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b0102a60 0x7f41b019b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46084/0 (socket says 172.21.15.7:46084) 2024-09-21T06:04:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f41aeffd640 1 -- 172.21.15.7:0/1452656644 learned_addr learned my addr 172.21.15.7:0/1452656644 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f41af7fe640 1 --2- 172.21.15.7:0/1452656644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41b0108cf0 0x7f41b019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f41aeffd640 1 -- 172.21.15.7:0/1452656644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b01083a0 msgr2=0x7f41b019b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f41aeffd640 1 --2- 172.21.15.7:0/1452656644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b01083a0 0x7f41b019b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f41aeffd640 1 -- 172.21.15.7:0/1452656644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41b0108cf0 msgr2=0x7f41b019bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f41aeffd640 1 --2- 172.21.15.7:0/1452656644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41b0108cf0 0x7f41b019bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f41aeffd640 1 -- 172.21.15.7:0/1452656644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b01a6540 con 0x7f41b0102a60 2024-09-21T06:04:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f41aeffd640 1 --2- 172.21.15.7:0/1452656644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b0102a60 0x7f41b019b2b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f41a000d770 tx=0x7f41a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f4197fff640 1 -- 172.21.15.7:0/1452656644 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0017070 con 0x7f41b0102a60 2024-09-21T06:04:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f41b53d5640 1 -- 172.21.15.7:0/1452656644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b01a6830 con 0x7f41b0102a60 2024-09-21T06:04:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f4197fff640 1 -- 172.21.15.7:0/1452656644 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41a00054d0 con 0x7f41b0102a60 2024-09-21T06:04:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f4197fff640 1 -- 172.21.15.7:0/1452656644 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0004c30 con 0x7f41b0102a60 2024-09-21T06:04:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.124+0000 7f41b53d5640 1 -- 172.21.15.7:0/1452656644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b01a6cf0 con 0x7f41b0102a60 2024-09-21T06:04:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.125+0000 7f41b53d5640 1 -- 172.21.15.7:0/1452656644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b0102e70 con 0x7f41b0102a60 2024-09-21T06:04:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.127+0000 7f4197fff640 1 -- 172.21.15.7:0/1452656644 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f41a0004dd0 con 0x7f41b0102a60 2024-09-21T06:04:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.128+0000 7f4197fff640 1 --2- 172.21.15.7:0/1452656644 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f41980b66b0 0x7f41980b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:37.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.128+0000 7f4197fff640 1 -- 172.21.15.7:0/1452656644 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f41a00e74a0 con 0x7f41b0102a60 2024-09-21T06:04:37.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.128+0000 7f41ae7fc640 1 --2- 172.21.15.7:0/1452656644 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f41980b66b0 0x7f41980b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:37.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.128+0000 7f41ae7fc640 1 --2- 172.21.15.7:0/1452656644 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f41980b66b0 0x7f41980b8bc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f41a4000c00 tx=0x7f41a4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.131+0000 7f4197fff640 1 -- 172.21.15.7:0/1452656644 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41a00b1e20 con 0x7f41b0102a60 2024-09-21T06:04:37.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.361+0000 7f41b53d5640 1 -- 172.21.15.7:0/1452656644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f41b002e640 con 0x7f41b0102a60 2024-09-21T06:04:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.363+0000 7f4197fff640 1 -- 172.21.15.7:0/1452656644 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f41a00b6d60 con 0x7f41b0102a60 2024-09-21T06:04:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:04:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.366+0000 7f41b53d5640 1 -- 172.21.15.7:0/1452656644 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f41980b66b0 msgr2=0x7f41980b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.366+0000 7f41b53d5640 1 --2- 172.21.15.7:0/1452656644 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f41980b66b0 0x7f41980b8bc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f41a4000c00 tx=0x7f41a4031400 comp rx=0 tx=0).stop 2024-09-21T06:04:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.366+0000 7f41b53d5640 1 -- 172.21.15.7:0/1452656644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b0102a60 msgr2=0x7f41b019b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.366+0000 7f41b53d5640 1 --2- 172.21.15.7:0/1452656644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b0102a60 0x7f41b019b2b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f41a000d770 tx=0x7f41a000dc30 comp rx=0 tx=0).stop 2024-09-21T06:04:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.366+0000 7f41b53d5640 1 -- 172.21.15.7:0/1452656644 shutdown_connections 2024-09-21T06:04:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.366+0000 7f41b53d5640 1 --2- 172.21.15.7:0/1452656644 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f41980b66b0 0x7f41980b8bc0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.366+0000 7f41b53d5640 1 --2- 172.21.15.7:0/1452656644 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41b0108cf0 0x7f41b019bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.366+0000 7f41b53d5640 1 --2- 172.21.15.7:0/1452656644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41b01083a0 0x7f41b019b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.366+0000 7f41b53d5640 1 --2- 172.21.15.7:0/1452656644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41b0102a60 0x7f41b019b2b0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.366+0000 7f41b53d5640 1 -- 172.21.15.7:0/1452656644 >> 172.21.15.7:0/1452656644 conn(0x7f41b0079730 msgr2=0x7f41b0104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.367+0000 7f41b53d5640 1 -- 172.21.15.7:0/1452656644 shutdown_connections 2024-09-21T06:04:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:37.367+0000 7f41b53d5640 1 -- 172.21.15.7:0/1452656644 wait complete. 2024-09-21T06:04:37.692 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:37 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a[30979]: 2024-09-21T06:04:37.362+0000 7f1ca47e6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:04:37.726 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 06:04:37 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-h[62473]: ignoring --setuser ceph since I am not root 2024-09-21T06:04:37.726 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 06:04:37 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-h[62473]: ignoring --setgroup ceph since I am not root 2024-09-21T06:04:37.726 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 06:04:37 smithi027 ceph-mds[62477]: -- 172.21.15.27:0/185093140 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5591b5687860 con 0x5591b982f180 2024-09-21T06:04:37.726 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 06:04:37 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-h[62473]: starting mds.h at 2024-09-21T06:04:37.726 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 06:04:37 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-b[62758]: ignoring --setuser ceph since I am not root 2024-09-21T06:04:37.727 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 06:04:37 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-b[62758]: ignoring --setgroup ceph since I am not root 2024-09-21T06:04:37.727 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 06:04:37 smithi027 ceph-mds[62762]: -- 172.21.15.27:0/940679077 <== mon.2 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563216993860 con 0x56321ab3b180 2024-09-21T06:04:37.727 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 06:04:37 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-b[62758]: starting mds.b at 2024-09-21T06:04:37.841 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-c[64413]: ignoring --setuser ceph since I am not root 2024-09-21T06:04:37.842 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-c[64413]: ignoring --setgroup ceph since I am not root 2024-09-21T06:04:37.842 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-mds[64417]: -- 172.21.15.119:0/3143074698 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b91d4a7c20 con 0x55b92164f600 2024-09-21T06:04:37.842 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-c[64413]: starting mds.c at 2024-09-21T06:04:37.842 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-f[64144]: ignoring --setuser ceph since I am not root 2024-09-21T06:04:37.842 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-f[64144]: ignoring --setgroup ceph since I am not root 2024-09-21T06:04:37.842 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-mds[64148]: -- 172.21.15.119:0/220508682 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559448fd7860 con 0x55944d17f180 2024-09-21T06:04:37.842 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-f[64144]: starting mds.f at 2024-09-21T06:04:37.843 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-l[63875]: ignoring --setuser ceph since I am not root 2024-09-21T06:04:37.843 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-l[63875]: ignoring --setgroup ceph since I am not root 2024-09-21T06:04:37.843 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-mds[63879]: -- 172.21.15.119:0/3431331307 <== mon.2 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5561fd0c3860 con 0x55620126ba80 2024-09-21T06:04:37.843 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-l[63875]: starting mds.l at 2024-09-21T06:04:37.843 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-i[64682]: ignoring --setuser ceph since I am not root 2024-09-21T06:04:37.843 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-i[64682]: ignoring --setgroup ceph since I am not root 2024-09-21T06:04:37.843 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-mds[64686]: -- 172.21.15.119:0/796876111 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d4f6481860 con 0x55d4fa629600 2024-09-21T06:04:37.843 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 21 06:04:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-i[64682]: starting mds.i at 2024-09-21T06:04:38.090 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:04:38.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:38 smithi007 ceph-mon[30983]: pgmap v650: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:04:38.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:38 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1452656644' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:04:38.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:38 smithi007 ceph-mon[30983]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:04:38.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:38 smithi007 ceph-mon[30983]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:04:38.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:38 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1452656644' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:04:38.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:38 smithi007 ceph-mon[30983]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:04:38.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:38 smithi007 ceph-mon[30983]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:04:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:38.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:38 smithi119 ceph-mon[34833]: pgmap v650: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:04:38.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:38 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1452656644' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:04:38.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:38 smithi119 ceph-mon[34833]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:04:38.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:38 smithi119 ceph-mon[34833]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:04:38.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:38 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1452656644' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:04:38.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:38 smithi119 ceph-mon[34833]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:04:38.592 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:38 smithi119 ceph-mon[34833]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:04:38.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:38 smithi027 ceph-mon[34364]: pgmap v650: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:04:38.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:38 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1452656644' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:04:38.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:38 smithi027 ceph-mon[34364]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:04:38.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:38 smithi027 ceph-mon[34364]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:04:38.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:38 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1452656644' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:04:38.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:38 smithi027 ceph-mon[34364]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:04:38.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:38 smithi027 ceph-mon[34364]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:04:38.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.806+0000 7f2386fe5640 1 -- 172.21.15.7:0/2415294180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2380102a70 msgr2=0x7f2380102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.806+0000 7f2386fe5640 1 --2- 172.21.15.7:0/2415294180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2380102a70 0x7f2380102e80 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f2378009ca0 tx=0x7f237802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.806+0000 7f2386fe5640 1 -- 172.21.15.7:0/2415294180 shutdown_connections 2024-09-21T06:04:38.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.806+0000 7f2386fe5640 1 --2- 172.21.15.7:0/2415294180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2380108d00 0x7f238010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.806+0000 7f2386fe5640 1 --2- 172.21.15.7:0/2415294180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23801083b0 0x7f23801087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.806+0000 7f2386fe5640 1 --2- 172.21.15.7:0/2415294180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2380102a70 0x7f2380102e80 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.806+0000 7f2386fe5640 1 -- 172.21.15.7:0/2415294180 >> 172.21.15.7:0/2415294180 conn(0x7f2380079730 msgr2=0x7f2380079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:38.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.806+0000 7f2386fe5640 1 -- 172.21.15.7:0/2415294180 shutdown_connections 2024-09-21T06:04:38.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.806+0000 7f2386fe5640 1 -- 172.21.15.7:0/2415294180 wait complete. 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.807+0000 7f2386fe5640 1 Processor -- start 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.807+0000 7f2386fe5640 1 -- start start 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2386fe5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2380102a70 0x7f238019b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2386fe5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23801083b0 0x7f238019b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2386fe5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2380108d00 0x7f238019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2386fe5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2380112970 con 0x7f2380108d00 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2386fe5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f23801127f0 con 0x7f23801083b0 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2386fe5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2380112af0 con 0x7f2380102a70 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2385582640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2380108d00 0x7f238019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2385582640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2380108d00 0x7f238019bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41364/0 (socket says 172.21.15.7:41364) 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2385582640 1 -- 172.21.15.7:0/3478251691 learned_addr learned my addr 172.21.15.7:0/3478251691 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2384d81640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2380102a70 0x7f238019b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f237ffff640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23801083b0 0x7f238019b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2385582640 1 -- 172.21.15.7:0/3478251691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2380102a70 msgr2=0x7f238019b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2385582640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2380102a70 0x7f238019b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2385582640 1 -- 172.21.15.7:0/3478251691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23801083b0 msgr2=0x7f238019b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2385582640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23801083b0 0x7f238019b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2385582640 1 -- 172.21.15.7:0/3478251691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23801a6560 con 0x7f2380108d00 2024-09-21T06:04:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.808+0000 7f2385582640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2380108d00 0x7f238019bd20 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f237000d750 tx=0x7f237000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.809+0000 7f237dffb640 1 -- 172.21.15.7:0/3478251691 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370017070 con 0x7f2380108d00 2024-09-21T06:04:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.809+0000 7f237dffb640 1 -- 172.21.15.7:0/3478251691 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23700054d0 con 0x7f2380108d00 2024-09-21T06:04:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.809+0000 7f2386fe5640 1 -- 172.21.15.7:0/3478251691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23801a6850 con 0x7f2380108d00 2024-09-21T06:04:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.809+0000 7f237dffb640 1 -- 172.21.15.7:0/3478251691 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370004c60 con 0x7f2380108d00 2024-09-21T06:04:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.809+0000 7f2386fe5640 1 -- 172.21.15.7:0/3478251691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23801a6d40 con 0x7f2380108d00 2024-09-21T06:04:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.810+0000 7f2386fe5640 1 -- 172.21.15.7:0/3478251691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2380103cf0 con 0x7f2380108d00 2024-09-21T06:04:38.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.811+0000 7f237dffb640 1 -- 172.21.15.7:0/3478251691 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f2370009bd0 con 0x7f2380108d00 2024-09-21T06:04:38.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.812+0000 7f237dffb640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23680b6680 0x7f23680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:38.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.812+0000 7f2384d81640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23680b6680 0x7f23680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:38.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.812+0000 7f237dffb640 1 -- 172.21.15.7:0/3478251691 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8655+0+0 (secure 0 0 0) 0x7f23700e74e0 con 0x7f2380108d00 2024-09-21T06:04:38.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.813+0000 7f2384d81640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23680b6680 0x7f23680b8b90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2378005e30 tx=0x7f2378009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:38.815+0000 7f237dffb640 1 -- 172.21.15.7:0/3478251691 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23700b1d90 con 0x7f2380108d00 2024-09-21T06:04:39.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.043+0000 7f2386fe5640 1 -- 172.21.15.7:0/3478251691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f238006bfb0 con 0x7f2380108d00 2024-09-21T06:04:39.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.371+0000 7f237dffb640 1 -- 172.21.15.7:0/3478251691 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7f238006bfb0 con 0x7f2380108d00 2024-09-21T06:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.374+0000 7f2386fe5640 1 -- 172.21.15.7:0/3478251691 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23680b6680 msgr2=0x7f23680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.374+0000 7f2386fe5640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23680b6680 0x7f23680b8b90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2378005e30 tx=0x7f2378009360 comp rx=0 tx=0).stop 2024-09-21T06:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.374+0000 7f2386fe5640 1 -- 172.21.15.7:0/3478251691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2380108d00 msgr2=0x7f238019bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.374+0000 7f2386fe5640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2380108d00 0x7f238019bd20 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f237000d750 tx=0x7f237000dc10 comp rx=0 tx=0).stop 2024-09-21T06:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.374+0000 7f2386fe5640 1 -- 172.21.15.7:0/3478251691 shutdown_connections 2024-09-21T06:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.374+0000 7f2386fe5640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f23680b6680 0x7f23680b8b90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.374+0000 7f2386fe5640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2380108d00 0x7f238019bd20 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.374+0000 7f2386fe5640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f23801083b0 0x7f238019b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.374+0000 7f2386fe5640 1 --2- 172.21.15.7:0/3478251691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2380102a70 0x7f238019b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.374+0000 7f2386fe5640 1 -- 172.21.15.7:0/3478251691 >> 172.21.15.7:0/3478251691 conn(0x7f2380079730 msgr2=0x7f23801014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.374+0000 7f2386fe5640 1 -- 172.21.15.7:0/3478251691 shutdown_connections 2024-09-21T06:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:39.374+0000 7f2386fe5640 1 -- 172.21.15.7:0/3478251691 wait complete. 2024-09-21T06:04:39.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.119:6832/2029820795,v1:172.21.15.119:6834/2029820795] up:boot 2024-09-21T06:04:39.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.119:6833/3432818748,v1:172.21.15.119:6835/3432818748] up:boot 2024-09-21T06:04:39.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.27:6836/1031301019,v1:172.21.15.27:6838/1031301019] up:boot 2024-09-21T06:04:39.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.27:6837/2522390803,v1:172.21.15.27:6839/2522390803] up:boot 2024-09-21T06:04:39.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.119:6836/3587805966,v1:172.21.15.119:6838/3587805966] up:boot 2024-09-21T06:04:39.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.119:6837/3185093919,v1:172.21.15.119:6839/3185093919] up:boot 2024-09-21T06:04:39.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:04:39.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:04:39.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:04:39.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:04:39.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:04:39.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:04:39.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:04:39.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:39 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3478251691' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:04:39.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.119:6832/2029820795,v1:172.21.15.119:6834/2029820795] up:boot 2024-09-21T06:04:39.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.119:6833/3432818748,v1:172.21.15.119:6835/3432818748] up:boot 2024-09-21T06:04:39.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.27:6836/1031301019,v1:172.21.15.27:6838/1031301019] up:boot 2024-09-21T06:04:39.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.27:6837/2522390803,v1:172.21.15.27:6839/2522390803] up:boot 2024-09-21T06:04:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.119:6836/3587805966,v1:172.21.15.119:6838/3587805966] up:boot 2024-09-21T06:04:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: mds.? [v2:172.21.15.119:6837/3185093919,v1:172.21.15.119:6839/3185093919] up:boot 2024-09-21T06:04:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:04:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:04:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:04:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:04:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:04:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:04:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:04:39.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:39 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3478251691' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:04:39.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.119:6832/2029820795,v1:172.21.15.119:6834/2029820795] up:boot 2024-09-21T06:04:39.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.119:6833/3432818748,v1:172.21.15.119:6835/3432818748] up:boot 2024-09-21T06:04:39.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.27:6836/1031301019,v1:172.21.15.27:6838/1031301019] up:boot 2024-09-21T06:04:39.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.27:6837/2522390803,v1:172.21.15.27:6839/2522390803] up:boot 2024-09-21T06:04:39.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.119:6836/3587805966,v1:172.21.15.119:6838/3587805966] up:boot 2024-09-21T06:04:39.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: mds.? [v2:172.21.15.119:6837/3185093919,v1:172.21.15.119:6839/3185093919] up:boot 2024-09-21T06:04:39.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:04:39.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:04:39.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:04:39.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:04:39.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:04:39.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:04:39.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: from='mgr.14223 172.21.15.7:0/326231577' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:04:39.843 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:39 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3478251691' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:04:40.071 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:04:40.336 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:40.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:40 smithi007 ceph-mon[30983]: pgmap v652: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:04:40.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:40 smithi007 ceph-mon[30983]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:04:40.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:40 smithi007 ceph-mon[30983]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:04:40.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:40 smithi007 ceph-mon[30983]: Cluster is now healthy 2024-09-21T06:04:40.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:40 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3478251691' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:04:40.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:40 smithi007 ceph-mon[30983]: fsmap 12 up:standby 2024-09-21T06:04:40.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:40 smithi027 ceph-mon[34364]: pgmap v652: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:04:40.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:40 smithi027 ceph-mon[34364]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:04:40.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:40 smithi027 ceph-mon[34364]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:04:40.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:40 smithi027 ceph-mon[34364]: Cluster is now healthy 2024-09-21T06:04:40.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:40 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3478251691' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:04:40.727 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:40 smithi027 ceph-mon[34364]: fsmap 12 up:standby 2024-09-21T06:04:40.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.791+0000 7f142b4e2640 1 -- 172.21.15.7:0/3974801641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1424105330 msgr2=0x7f142410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.791+0000 7f142b4e2640 1 --2- 172.21.15.7:0/3974801641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1424105330 0x7f142410d880 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f1414009900 tx=0x7f141402a410 comp rx=0 tx=0).stop 2024-09-21T06:04:40.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.791+0000 7f142b4e2640 1 -- 172.21.15.7:0/3974801641 shutdown_connections 2024-09-21T06:04:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.791+0000 7f142b4e2640 1 --2- 172.21.15.7:0/3974801641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1424105330 0x7f142410d880 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.791+0000 7f142b4e2640 1 --2- 172.21.15.7:0/3974801641 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f142410de40 0x7f1424110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.791+0000 7f142b4e2640 1 --2- 172.21.15.7:0/3974801641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14241049e0 0x7f1424104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.791+0000 7f142b4e2640 1 -- 172.21.15.7:0/3974801641 >> 172.21.15.7:0/3974801641 conn(0x7f1424079730 msgr2=0x7f1424079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.791+0000 7f142b4e2640 1 -- 172.21.15.7:0/3974801641 shutdown_connections 2024-09-21T06:04:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.791+0000 7f142b4e2640 1 -- 172.21.15.7:0/3974801641 wait complete. 2024-09-21T06:04:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.792+0000 7f142b4e2640 1 Processor -- start 2024-09-21T06:04:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.792+0000 7f142b4e2640 1 -- start start 2024-09-21T06:04:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.792+0000 7f142b4e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14241049e0 0x7f142419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.792+0000 7f142b4e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1424105330 0x7f142419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.792+0000 7f142b4e2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f142410de40 0x7f142419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.792+0000 7f142b4e2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1424113a60 con 0x7f14241049e0 2024-09-21T06:04:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.792+0000 7f142b4e2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f14241138e0 con 0x7f142410de40 2024-09-21T06:04:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.792+0000 7f142b4e2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1424113be0 con 0x7f1424105330 2024-09-21T06:04:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.792+0000 7f142927e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14241049e0 0x7f142419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f142927e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14241049e0 0x7f142419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41378/0 (socket says 172.21.15.7:41378) 2024-09-21T06:04:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f142927e640 1 -- 172.21.15.7:0/3407477815 learned_addr learned my addr 172.21.15.7:0/3407477815 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f1428a7d640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1424105330 0x7f142419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f1429a7f640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f142410de40 0x7f142419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f142927e640 1 -- 172.21.15.7:0/3407477815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1424105330 msgr2=0x7f142419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f142927e640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1424105330 0x7f142419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f142927e640 1 -- 172.21.15.7:0/3407477815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f142410de40 msgr2=0x7f142419fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f142927e640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f142410de40 0x7f142419fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f142927e640 1 -- 172.21.15.7:0/3407477815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14241a03e0 con 0x7f14241049e0 2024-09-21T06:04:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f1429a7f640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f142410de40 0x7f142419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f142927e640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14241049e0 0x7f142419a470 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f142000d950 tx=0x7f142000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f141a7fc640 1 -- 172.21.15.7:0/3407477815 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1420017070 con 0x7f14241049e0 2024-09-21T06:04:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f141a7fc640 1 -- 172.21.15.7:0/3407477815 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1420009c30 con 0x7f14241049e0 2024-09-21T06:04:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f141a7fc640 1 -- 172.21.15.7:0/3407477815 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142000f620 con 0x7f14241049e0 2024-09-21T06:04:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f142b4e2640 1 -- 172.21.15.7:0/3407477815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14241a06d0 con 0x7f14241049e0 2024-09-21T06:04:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.793+0000 7f142b4e2640 1 -- 172.21.15.7:0/3407477815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14241a6e30 con 0x7f14241049e0 2024-09-21T06:04:40.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.795+0000 7f142b4e2640 1 -- 172.21.15.7:0/3407477815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f142406c280 con 0x7f14241049e0 2024-09-21T06:04:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.796+0000 7f141a7fc640 1 -- 172.21.15.7:0/3407477815 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7f1420010460 con 0x7f14241049e0 2024-09-21T06:04:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.797+0000 7f141a7fc640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f14100b6680 0x7f14100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.798+0000 7f1428a7d640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f14100b6680 0x7f14100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.798+0000 7f141a7fc640 1 -- 172.21.15.7:0/3407477815 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8655+0+0 (secure 0 0 0) 0x7f14200e7470 con 0x7f14241049e0 2024-09-21T06:04:40.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.798+0000 7f1428a7d640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f14100b6680 0x7f14100b8b90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1414009230 tx=0x7f1414031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:40.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.802+0000 7f141a7fc640 1 -- 172.21.15.7:0/3407477815 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f14200ad8e0 con 0x7f14241049e0 2024-09-21T06:04:40.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:40 smithi119 ceph-mon[34833]: pgmap v652: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:04:40.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:40 smithi119 ceph-mon[34833]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:04:40.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:40 smithi119 ceph-mon[34833]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:04:40.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:40 smithi119 ceph-mon[34833]: Cluster is now healthy 2024-09-21T06:04:40.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:40 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3478251691' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:04:40.842 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:40 smithi119 ceph-mon[34833]: fsmap 12 up:standby 2024-09-21T06:04:40.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:40.989+0000 7f142b4e2640 1 -- 172.21.15.7:0/3407477815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1424104df0 con 0x7f14241049e0 2024-09-21T06:04:41.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:41.378+0000 7f141a7fc640 1 -- 172.21.15.7:0/3407477815 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) ==== 181+0+0 (secure 0 0 0) 0x7f1420009de0 con 0x7f14241049e0 2024-09-21T06:04:41.380 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:04:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:41.382+0000 7f142b4e2640 1 -- 172.21.15.7:0/3407477815 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f14100b6680 msgr2=0x7f14100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:41.382+0000 7f142b4e2640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f14100b6680 0x7f14100b8b90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1414009230 tx=0x7f1414031400 comp rx=0 tx=0).stop 2024-09-21T06:04:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:41.382+0000 7f142b4e2640 1 -- 172.21.15.7:0/3407477815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14241049e0 msgr2=0x7f142419a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:41.382+0000 7f142b4e2640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14241049e0 0x7f142419a470 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f142000d950 tx=0x7f142000de10 comp rx=0 tx=0).stop 2024-09-21T06:04:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:41.382+0000 7f142b4e2640 1 -- 172.21.15.7:0/3407477815 shutdown_connections 2024-09-21T06:04:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:41.382+0000 7f142b4e2640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7f14100b6680 0x7f14100b8b90 secure :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1414009230 tx=0x7f1414031400 comp rx=0 tx=0).stop 2024-09-21T06:04:41.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:41.382+0000 7f142b4e2640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f142410de40 0x7f142419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:41.382+0000 7f142b4e2640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1424105330 0x7f142419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:41.382+0000 7f142b4e2640 1 --2- 172.21.15.7:0/3407477815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14241049e0 0x7f142419a470 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:41.382+0000 7f142b4e2640 1 -- 172.21.15.7:0/3407477815 >> 172.21.15.7:0/3407477815 conn(0x7f1424079730 msgr2=0x7f14241007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:41.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:41.383+0000 7f142b4e2640 1 -- 172.21.15.7:0/3407477815 shutdown_connections 2024-09-21T06:04:41.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:41.383+0000 7f142b4e2640 1 -- 172.21.15.7:0/3407477815 wait complete. 2024-09-21T06:04:41.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:41 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3407477815' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:04:41.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:41 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3407477815' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:04:41.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:41 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3407477815' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:04:42.112 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 397810bc-77dc-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:04:42.376 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:42.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:42 smithi007 ceph-mon[30983]: pgmap v653: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:04:42.644 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:42 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3407477815' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:04:42.644 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:42 smithi007 ceph-mon[30983]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:04:42.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:42 smithi027 ceph-mon[34364]: pgmap v653: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:04:42.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:42 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/3407477815' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:04:42.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:42 smithi027 ceph-mon[34364]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:04:42.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:42 smithi119 ceph-mon[34833]: pgmap v653: 97 pgs: 97 active+clean; 2.4 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:04:42.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:42 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/3407477815' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:04:42.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:42 smithi119 ceph-mon[34833]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:04:42.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.869+0000 7efdf90fa640 1 -- 172.21.15.7:0/2578859444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf4104a30 msgr2=0x7efdf4104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.869+0000 7efdf90fa640 1 --2- 172.21.15.7:0/2578859444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf4104a30 0x7efdf4104e40 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7efde4009900 tx=0x7efde402a410 comp rx=0 tx=0).stop 2024-09-21T06:04:42.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.869+0000 7efdf90fa640 1 -- 172.21.15.7:0/2578859444 shutdown_connections 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.869+0000 7efdf90fa640 1 --2- 172.21.15.7:0/2578859444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdf410de60 0x7efdf4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.869+0000 7efdf90fa640 1 --2- 172.21.15.7:0/2578859444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efdf4105380 0x7efdf410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.869+0000 7efdf90fa640 1 --2- 172.21.15.7:0/2578859444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf4104a30 0x7efdf4104e40 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.869+0000 7efdf90fa640 1 -- 172.21.15.7:0/2578859444 >> 172.21.15.7:0/2578859444 conn(0x7efdf4079760 msgr2=0x7efdf4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.869+0000 7efdf90fa640 1 -- 172.21.15.7:0/2578859444 shutdown_connections 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.869+0000 7efdf90fa640 1 -- 172.21.15.7:0/2578859444 wait complete. 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.870+0000 7efdf90fa640 1 Processor -- start 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.870+0000 7efdf90fa640 1 -- start start 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.870+0000 7efdf90fa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efdf4104a30 0x7efdf419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.870+0000 7efdf90fa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf4105380 0x7efdf419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.870+0000 7efdf90fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdf410de60 0x7efdf419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.870+0000 7efdf90fa640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efdf4113aa0 con 0x7efdf4105380 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.870+0000 7efdf90fa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7efdf4113920 con 0x7efdf4104a30 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.870+0000 7efdf90fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efdf4113c20 con 0x7efdf410de60 2024-09-21T06:04:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.870+0000 7efdf259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf4105380 0x7efdf419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.870+0000 7efdf259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf4105380 0x7efdf419aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41388/0 (socket says 172.21.15.7:41388) 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.870+0000 7efdf259c640 1 -- 172.21.15.7:0/1600400196 learned_addr learned my addr 172.21.15.7:0/1600400196 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.871+0000 7efdf359e640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdf410de60 0x7efdf419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.871+0000 7efdf2d9d640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efdf4104a30 0x7efdf419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.871+0000 7efdf259c640 1 -- 172.21.15.7:0/1600400196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdf410de60 msgr2=0x7efdf419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.871+0000 7efdf259c640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdf410de60 0x7efdf419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.871+0000 7efdf259c640 1 -- 172.21.15.7:0/1600400196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efdf4104a30 msgr2=0x7efdf419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.871+0000 7efdf259c640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efdf4104a30 0x7efdf419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.871+0000 7efdf259c640 1 -- 172.21.15.7:0/1600400196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf41a0460 con 0x7efdf4105380 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.871+0000 7efdf259c640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf4105380 0x7efdf419aa90 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7efde800e9f0 tx=0x7efde800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.871+0000 7efddbfff640 1 -- 172.21.15.7:0/1600400196 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde800ccc0 con 0x7efdf4105380 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.871+0000 7efdf90fa640 1 -- 172.21.15.7:0/1600400196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf41a0750 con 0x7efdf4105380 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.871+0000 7efddbfff640 1 -- 172.21.15.7:0/1600400196 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efde80108e0 con 0x7efdf4105380 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.871+0000 7efddbfff640 1 -- 172.21.15.7:0/1600400196 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8018860 con 0x7efdf4105380 2024-09-21T06:04:42.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.871+0000 7efdf90fa640 1 -- 172.21.15.7:0/1600400196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf41a6eb0 con 0x7efdf4105380 2024-09-21T06:04:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.872+0000 7efdf90fa640 1 -- 172.21.15.7:0/1600400196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf406c1f0 con 0x7efdf4105380 2024-09-21T06:04:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.874+0000 7efddbfff640 1 -- 172.21.15.7:0/1600400196 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154642+0+0 (secure 0 0 0) 0x7efde8010430 con 0x7efdf4105380 2024-09-21T06:04:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.875+0000 7efddbfff640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efddc0b6680 0x7efddc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.875+0000 7efdf2d9d640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efddc0b6680 0x7efddc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.875+0000 7efddbfff640 1 -- 172.21.15.7:0/1600400196 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8130+0+0 (secure 0 0 0) 0x7efde80e7c90 con 0x7efdf4105380 2024-09-21T06:04:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.876+0000 7efdf2d9d640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efddc0b6680 0x7efddc0b8b90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efde4000c00 tx=0x7efde4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:42.879+0000 7efddbfff640 1 -- 172.21.15.7:0/1600400196 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efde80b2770 con 0x7efdf4105380 2024-09-21T06:04:43.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.071+0000 7efdf90fa640 1 -- 172.21.15.7:0/1600400196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7efdf4104e40 con 0x7efdf4105380 2024-09-21T06:04:43.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.388+0000 7efddbfff640 1 -- 172.21.15.7:0/1600400196 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) ==== 169+0+0 (secure 0 0 0) 0x7efdf4104e40 con 0x7efdf4105380 2024-09-21T06:04:43.390 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-09-21T06:04:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.392+0000 7efdf90fa640 1 -- 172.21.15.7:0/1600400196 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efddc0b6680 msgr2=0x7efddc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.392+0000 7efdf90fa640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efddc0b6680 0x7efddc0b8b90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efde4000c00 tx=0x7efde4031400 comp rx=0 tx=0).stop 2024-09-21T06:04:43.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.392+0000 7efdf90fa640 1 -- 172.21.15.7:0/1600400196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf4105380 msgr2=0x7efdf419aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:43.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.392+0000 7efdf90fa640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf4105380 0x7efdf419aa90 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7efde800e9f0 tx=0x7efde800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.393+0000 7efdf90fa640 1 -- 172.21.15.7:0/1600400196 shutdown_connections 2024-09-21T06:04:43.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.393+0000 7efdf90fa640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.7:6800/2451017072,v1:172.21.15.7:6801/2451017072] conn(0x7efddc0b6680 0x7efddc0b8b90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.393+0000 7efdf90fa640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf4105380 0x7efdf419aa90 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.393+0000 7efdf90fa640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdf410de60 0x7efdf419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.393+0000 7efdf90fa640 1 --2- 172.21.15.7:0/1600400196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efdf4104a30 0x7efdf419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.393+0000 7efdf90fa640 1 -- 172.21.15.7:0/1600400196 >> 172.21.15.7:0/1600400196 conn(0x7efdf4079760 msgr2=0x7efdf4100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.393+0000 7efdf90fa640 1 -- 172.21.15.7:0/1600400196 shutdown_connections 2024-09-21T06:04:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:04:43.393+0000 7efdf90fa640 1 -- 172.21.15.7:0/1600400196 wait complete. 2024-09-21T06:04:43.643 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:43 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1600400196' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:04:43.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:43 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1600400196' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:04:43.841 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:43 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1600400196' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:04:44.270 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:04:44.300 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:04:44.328 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:04:44.362 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T06:04:44.362 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:04:44.380 DEBUG:teuthology.orchestra.run.smithi027:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:04:44.396 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:04:44.419 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T06:04:44.419 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T06:04:44.419 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:04:44.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:44 smithi007 ceph-mon[30983]: pgmap v655: 65 pgs: 65 active+clean; 577 KiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:04:44.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:44 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1600400196' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:04:44.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:44 smithi007 ceph-mon[30983]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:04:44.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:44 smithi007 systemd[1]: Stopping Ceph mon.a for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:04:44.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:44 smithi027 ceph-mon[34364]: pgmap v655: 65 pgs: 65 active+clean; 577 KiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:04:44.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:44 smithi027 ceph-mon[34364]: from='client.? 172.21.15.7:0/1600400196' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:04:44.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:44 smithi027 ceph-mon[34364]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:04:44.743 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:44 smithi119 ceph-mon[34833]: pgmap v655: 65 pgs: 65 active+clean; 577 KiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:04:44.743 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:44 smithi119 ceph-mon[34833]: from='client.? 172.21.15.7:0/1600400196' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:04:44.743 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:44 smithi119 ceph-mon[34833]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:04:45.148 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:44 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a[30979]: 2024-09-21T06:04:44.837+0000 7f1ca9ff1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:04:45.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:44 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a[30979]: 2024-09-21T06:04:44.837+0000 7f1ca9ff1640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T06:04:45.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:44 smithi007 podman[111916]: 2024-09-21 06:04:44.890122151 +0000 UTC m=+0.275086982 container died 2b401bd9ca816d595047690b49e6a65eb872986e414b15585342151f13b4d7d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T06:04:45.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:45 smithi007 podman[111916]: 2024-09-21 06:04:45.346690486 +0000 UTC m=+0.731655317 container cleanup 2b401bd9ca816d595047690b49e6a65eb872986e414b15585342151f13b4d7d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T06:04:45.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:04:45 smithi007 bash[111916]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:04:45.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T06:04:45.941 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:04:45.942 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T06:04:45.942 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T06:04:45.942 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.b 2024-09-21T06:04:46.226 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:45 smithi027 systemd[1]: Stopping Ceph mon.b for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:04:46.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:46 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-b[34360]: 2024-09-21T06:04:46.258+0000 7f9b888b1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:04:46.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:46 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-b[34360]: 2024-09-21T06:04:46.258+0000 7f9b888b1640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:04:46.726 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:46 smithi027 podman[66052]: 2024-09-21 06:04:46.495110026 +0000 UTC m=+0.344962780 container died c32ce2120a6c2a995d3ffadafb9610072bc50f6e259b25e89f3cfe612dbbd6c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:04:47.153 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:46 smithi027 podman[66052]: 2024-09-21 06:04:46.867721203 +0000 UTC m=+0.717573943 container cleanup c32ce2120a6c2a995d3ffadafb9610072bc50f6e259b25e89f3cfe612dbbd6c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:04:47.154 INFO:journalctl@ceph.mon.b.smithi027.stdout:Sep 21 06:04:46 smithi027 bash[66052]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-b 2024-09-21T06:04:47.315 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T06:04:47.363 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:04:47.364 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T06:04:47.364 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T06:04:47.364 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.c 2024-09-21T06:04:47.745 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:47 smithi119 systemd[1]: Stopping Ceph mon.c for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:04:48.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:47 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-c[34827]: 2024-09-21T06:04:47.743+0000 7fa8e0a82640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:04:48.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:47 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-c[34827]: 2024-09-21T06:04:47.743+0000 7fa8e0a82640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:04:48.092 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:47 smithi119 podman[68161]: 2024-09-21 06:04:47.825388454 +0000 UTC m=+0.275918041 container died 8660d449d50ea55c51ccff0068880e66830c726ba1010edc047d4df197aa00a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-c, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T06:04:48.446 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:48 smithi119 podman[68161]: 2024-09-21 06:04:48.268611743 +0000 UTC m=+0.719141332 container cleanup 8660d449d50ea55c51ccff0068880e66830c726ba1010edc047d4df197aa00a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T06:04:48.446 INFO:journalctl@ceph.mon.c.smithi119.stdout:Sep 21 06:04:48 smithi119 bash[68161]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mon-c 2024-09-21T06:04:48.671 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T06:04:48.718 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:04:48.718 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T06:04:48.719 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T06:04:48.719 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:04:49.019 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:04:48 smithi007 systemd[1]: Stopping Ceph mgr.x for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:04:49.311 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:04:49 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T06:04:49.016+0000 7f378224e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:04:49.311 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:04:49 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x[31207]: 2024-09-21T06:04:49.016+0000 7f378224e640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T06:04:49.311 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:04:49 smithi007 podman[112038]: 2024-09-21 06:04:49.05871614 +0000 UTC m=+0.138963468 container died ef771cd10fa869c913a8cdd85a606f53e335ad70cce5a06a0a2c902ef803ea66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T06:04:49.569 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:04:49 smithi007 podman[112038]: 2024-09-21 06:04:49.476574395 +0000 UTC m=+0.556821757 container cleanup ef771cd10fa869c913a8cdd85a606f53e335ad70cce5a06a0a2c902ef803ea66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T06:04:49.569 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:04:49 smithi007 bash[112038]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-x 2024-09-21T06:04:49.863 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T06:04:49.900 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:04:49.901 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T06:04:49.901 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T06:04:49.901 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mgr.y 2024-09-21T06:04:50.226 INFO:journalctl@ceph.mgr.y.smithi027.stdout:Sep 21 06:04:49 smithi027 systemd[1]: Stopping Ceph mgr.y for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:04:50.541 INFO:journalctl@ceph.mgr.y.smithi027.stdout:Sep 21 06:04:50 smithi027 podman[66174]: 2024-09-21 06:04:50.268977553 +0000 UTC m=+0.166701239 container died 03fe0b91433b02aaa163f450b1df1bb834fa852b218ea1521518cf6fddab1927 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-y, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T06:04:50.957 INFO:journalctl@ceph.mgr.y.smithi027.stdout:Sep 21 06:04:50 smithi027 podman[66174]: 2024-09-21 06:04:50.622253602 +0000 UTC m=+0.519977288 container cleanup 03fe0b91433b02aaa163f450b1df1bb834fa852b218ea1521518cf6fddab1927 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-y, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:04:50.958 INFO:journalctl@ceph.mgr.y.smithi027.stdout:Sep 21 06:04:50 smithi027 bash[66174]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-y 2024-09-21T06:04:51.109 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T06:04:51.145 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:04:51.145 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T06:04:51.145 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T06:04:51.145 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mgr.z 2024-09-21T06:04:51.461 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 21 06:04:51 smithi119 systemd[1]: Stopping Ceph mgr.z for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:04:51.842 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 21 06:04:51 smithi119 podman[68282]: 2024-09-21 06:04:51.460755632 +0000 UTC m=+0.119322683 container died 6a6bf2f07240ee47d92478bb5502fe0f146300533a21cbf01037aa17046aef51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-z, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:04:52.226 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 21 06:04:52 smithi119 podman[68282]: 2024-09-21 06:04:52.017413693 +0000 UTC m=+0.675980744 container cleanup 6a6bf2f07240ee47d92478bb5502fe0f146300533a21cbf01037aa17046aef51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T06:04:52.226 INFO:journalctl@ceph.mgr.z.smithi119.stdout:Sep 21 06:04:52 smithi119 bash[68282]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mgr-z 2024-09-21T06:04:52.446 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T06:04:52.480 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:04:52.480 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T06:04:52.480 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T06:04:52.481 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.0 2024-09-21T06:04:52.782 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:52 smithi007 systemd[1]: Stopping Ceph osd.0 for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:04:53.068 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:52 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0[47922]: 2024-09-21T06:04:52.779+0000 7f34f987c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:04:53.068 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:52 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0[47922]: 2024-09-21T06:04:52.779+0000 7f34f987c640 -1 osd.0 88 *** Got signal Terminated *** 2024-09-21T06:04:53.068 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:52 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0[47922]: 2024-09-21T06:04:52.779+0000 7f34f987c640 -1 osd.0 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:04:58.559 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:58 smithi007 podman[112160]: 2024-09-21 06:04:58.287940863 +0000 UTC m=+5.613101482 container died 7d17161e76cdfbc6e1af2dd541ccb601aceee9ebba9a25b9d7f2a5178d227bcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:04:58.818 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:58 smithi007 podman[112160]: 2024-09-21 06:04:58.713886093 +0000 UTC m=+6.039046741 container cleanup 7d17161e76cdfbc6e1af2dd541ccb601aceee9ebba9a25b9d7f2a5178d227bcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T06:04:58.818 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:58 smithi007 bash[112160]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0 2024-09-21T06:04:59.318 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:58 smithi007 podman[112175]: 2024-09-21 06:04:58.906910372 +0000 UTC m=+0.616174299 container remove 7d17161e76cdfbc6e1af2dd541ccb601aceee9ebba9a25b9d7f2a5178d227bcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T06:04:59.636 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:59 smithi007 podman[112264]: 2024-09-21 06:04:59.349382768 +0000 UTC m=+0.113636758 container create d0e696ceaf4972487d9d6503d2c30315485ebf27c017fb96a909ff07f589eb0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-21T06:04:59.636 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:59 smithi007 podman[112264]: 2024-09-21 06:04:59.252308683 +0000 UTC m=+0.016562651 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:04:59.636 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:59 smithi007 podman[112264]: 2024-09-21 06:04:59.552090974 +0000 UTC m=+0.316344939 container init d0e696ceaf4972487d9d6503d2c30315485ebf27c017fb96a909ff07f589eb0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:04:59.637 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:59 smithi007 podman[112264]: 2024-09-21 06:04:59.555627054 +0000 UTC m=+0.319881008 container start d0e696ceaf4972487d9d6503d2c30315485ebf27c017fb96a909ff07f589eb0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T06:04:59.637 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:59 smithi007 podman[112264]: 2024-09-21 06:04:59.63530181 +0000 UTC m=+0.399555773 container attach d0e696ceaf4972487d9d6503d2c30315485ebf27c017fb96a909ff07f589eb0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T06:05:00.068 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:04:59 smithi007 podman[112264]: 2024-09-21 06:04:59.749222416 +0000 UTC m=+0.513476380 container died d0e696ceaf4972487d9d6503d2c30315485ebf27c017fb96a909ff07f589eb0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:05:00.350 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:05:00 smithi007 podman[112287]: 2024-09-21 06:05:00.330463876 +0000 UTC m=+0.574886833 container remove d0e696ceaf4972487d9d6503d2c30315485ebf27c017fb96a909ff07f589eb0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T06:05:00.355 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T06:05:00.398 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:00.398 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T06:05:00.399 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T06:05:00.399 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.1 2024-09-21T06:05:00.720 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:00 smithi027 systemd[1]: Stopping Ceph osd.1 for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:00.976 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:00 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1[38887]: 2024-09-21T06:05:00.718+0000 7fdd2db08640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:00.976 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:00 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1[38887]: 2024-09-21T06:05:00.718+0000 7fdd2db08640 -1 osd.1 88 *** Got signal Terminated *** 2024-09-21T06:05:00.976 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:00 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1[38887]: 2024-09-21T06:05:00.718+0000 7fdd2db08640 -1 osd.1 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:05:06.476 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:06 smithi027 podman[66301]: 2024-09-21 06:05:06.218090962 +0000 UTC m=+5.620909830 container died a5e8c44ae01d531c559cbf8d31f39d1bbf88fa80c6d770f5ed73b58fc021c209 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T06:05:06.821 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:06 smithi027 podman[66301]: 2024-09-21 06:05:06.626913157 +0000 UTC m=+6.029732013 container cleanup a5e8c44ae01d531c559cbf8d31f39d1bbf88fa80c6d770f5ed73b58fc021c209 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T06:05:06.821 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:06 smithi027 bash[66301]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1 2024-09-21T06:05:07.226 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:06 smithi027 podman[66317]: 2024-09-21 06:05:06.819674389 +0000 UTC m=+0.603584619 container remove a5e8c44ae01d531c559cbf8d31f39d1bbf88fa80c6d770f5ed73b58fc021c209 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T06:05:07.524 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:07 smithi027 podman[66409]: 2024-09-21 06:05:07.154173306 +0000 UTC m=+0.016300210 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:05:07.524 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:07 smithi027 podman[66409]: 2024-09-21 06:05:07.295626981 +0000 UTC m=+0.157753887 container create accd60a022d0de098a7c62be1b328c6470f0d47dbdf1286383e3baa840af352f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:05:07.977 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:07 smithi027 podman[66409]: 2024-09-21 06:05:07.52321224 +0000 UTC m=+0.385339144 container init accd60a022d0de098a7c62be1b328c6470f0d47dbdf1286383e3baa840af352f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T06:05:07.977 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:07 smithi027 podman[66409]: 2024-09-21 06:05:07.526819574 +0000 UTC m=+0.388946477 container start accd60a022d0de098a7c62be1b328c6470f0d47dbdf1286383e3baa840af352f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T06:05:07.977 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:07 smithi027 podman[66409]: 2024-09-21 06:05:07.614661205 +0000 UTC m=+0.476788122 container attach accd60a022d0de098a7c62be1b328c6470f0d47dbdf1286383e3baa840af352f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T06:05:07.977 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 21 06:05:07 smithi027 podman[66409]: 2024-09-21 06:05:07.720768564 +0000 UTC m=+0.582895478 container died accd60a022d0de098a7c62be1b328c6470f0d47dbdf1286383e3baa840af352f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T06:05:08.320 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T06:05:08.363 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:08.363 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T06:05:08.363 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T06:05:08.363 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.2 2024-09-21T06:05:08.687 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:08 smithi119 systemd[1]: Stopping Ceph osd.2 for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:09.091 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:08 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2[40036]: 2024-09-21T06:05:08.684+0000 7fb8813d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:09.092 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:08 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2[40036]: 2024-09-21T06:05:08.684+0000 7fb8813d1640 -1 osd.2 88 *** Got signal Terminated *** 2024-09-21T06:05:09.092 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:08 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2[40036]: 2024-09-21T06:05:08.684+0000 7fb8813d1640 -1 osd.2 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:05:14.320 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:14 smithi119 podman[68409]: 2024-09-21 06:05:14.057663871 +0000 UTC m=+5.499893559 container died aae2ce0fe6a922664da9eab666eda695a0910cf92826d1d15c1da1e18fb613fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T06:05:14.591 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:14 smithi119 podman[68409]: 2024-09-21 06:05:14.40958753 +0000 UTC m=+5.851817206 container cleanup aae2ce0fe6a922664da9eab666eda695a0910cf92826d1d15c1da1e18fb613fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T06:05:14.592 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:14 smithi119 bash[68409]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2 2024-09-21T06:05:15.013 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:14 smithi119 podman[68424]: 2024-09-21 06:05:14.703426735 +0000 UTC m=+0.639355098 container remove aae2ce0fe6a922664da9eab666eda695a0910cf92826d1d15c1da1e18fb613fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T06:05:15.274 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:15 smithi119 podman[68513]: 2024-09-21 06:05:14.915076625 +0000 UTC m=+0.015796217 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:05:15.274 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:15 smithi119 podman[68513]: 2024-09-21 06:05:15.037711085 +0000 UTC m=+0.138430678 container create e9e4fba64d26e6f93099a3da6997d0c1cc32fdb3188fe99e17b38ed90fb0b96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T06:05:15.592 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:15 smithi119 podman[68513]: 2024-09-21 06:05:15.273170502 +0000 UTC m=+0.373890094 container init e9e4fba64d26e6f93099a3da6997d0c1cc32fdb3188fe99e17b38ed90fb0b96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T06:05:15.592 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:15 smithi119 podman[68513]: 2024-09-21 06:05:15.276628407 +0000 UTC m=+0.377348005 container start e9e4fba64d26e6f93099a3da6997d0c1cc32fdb3188fe99e17b38ed90fb0b96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T06:05:15.592 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:15 smithi119 podman[68513]: 2024-09-21 06:05:15.373284789 +0000 UTC m=+0.474004381 container attach e9e4fba64d26e6f93099a3da6997d0c1cc32fdb3188fe99e17b38ed90fb0b96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:05:15.592 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 21 06:05:15 smithi119 podman[68513]: 2024-09-21 06:05:15.463192871 +0000 UTC m=+0.563912468 container died e9e4fba64d26e6f93099a3da6997d0c1cc32fdb3188fe99e17b38ed90fb0b96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:05:16.094 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T06:05:16.134 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:16.134 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T06:05:16.134 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T06:05:16.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.3 2024-09-21T06:05:16.442 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:16 smithi007 systemd[1]: Stopping Ceph osd.3 for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:16.818 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:16 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3[54478]: 2024-09-21T06:05:16.440+0000 7f8855e81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:16.819 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:16 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3[54478]: 2024-09-21T06:05:16.440+0000 7f8855e81640 -1 osd.3 88 *** Got signal Terminated *** 2024-09-21T06:05:16.819 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:16 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3[54478]: 2024-09-21T06:05:16.440+0000 7f8855e81640 -1 osd.3 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:05:20.092 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:19 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:19.591+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:20.191 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:19 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3[54478]: 2024-09-21T06:05:19.828+0000 7f885246c640 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:56.841617+0000 front 2024-09-21T06:04:56.841644+0000 (oldest deadline 2024-09-21T06:05:19.141740+0000) 2024-09-21T06:05:20.481 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:20 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:20.154+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:20.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:20 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:20.189+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:20.999 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:20 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:20.631+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:21.218 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:20 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3[54478]: 2024-09-21T06:05:20.848+0000 7f885246c640 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:56.841617+0000 front 2024-09-21T06:04:56.841644+0000 (oldest deadline 2024-09-21T06:05:19.141740+0000) 2024-09-21T06:05:21.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:20 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:20.997+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:21.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:21 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:21.194+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:21.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:21 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:21.215+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:22.045 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:21 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:21.664+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:22.275 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:22 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:22.174+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:22.275 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:21 smithi007 podman[112366]: 2024-09-21 06:05:21.992561309 +0000 UTC m=+5.646864686 container died 57ce2904553c1ab4afa9c5ffae4e610b047a1a5397e99e508923b25e762afb08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T06:05:22.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:22 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:22.044+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:22.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:22 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:22.220+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:22.568 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:22 smithi007 podman[112366]: 2024-09-21 06:05:22.45695161 +0000 UTC m=+6.111254976 container cleanup 57ce2904553c1ab4afa9c5ffae4e610b047a1a5397e99e508923b25e762afb08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:05:22.568 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:22 smithi007 bash[112366]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3 2024-09-21T06:05:23.035 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:22 smithi007 podman[112382]: 2024-09-21 06:05:22.708214192 +0000 UTC m=+0.712177480 container remove 57ce2904553c1ab4afa9c5ffae4e610b047a1a5397e99e508923b25e762afb08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T06:05:23.043 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:22 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:22.626+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:23.318 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:23 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:23.141+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:23.319 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:23 smithi007 podman[112471]: 2024-09-21 06:05:22.93699938 +0000 UTC m=+0.016092577 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:05:23.319 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:23 smithi007 podman[112471]: 2024-09-21 06:05:23.042400064 +0000 UTC m=+0.121493288 container create ea1c08ee9aee40d54db95849fe029156e08d1e69fcbb43d5a51bbb5fa193d3b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T06:05:23.319 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:23 smithi007 podman[112471]: 2024-09-21 06:05:23.253214207 +0000 UTC m=+0.332307404 container init ea1c08ee9aee40d54db95849fe029156e08d1e69fcbb43d5a51bbb5fa193d3b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T06:05:23.319 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:23 smithi007 podman[112471]: 2024-09-21 06:05:23.25653075 +0000 UTC m=+0.335623933 container start ea1c08ee9aee40d54db95849fe029156e08d1e69fcbb43d5a51bbb5fa193d3b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T06:05:23.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:23 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:23.042+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:23.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:23 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:23.246+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:23.748 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:23 smithi007 podman[112471]: 2024-09-21 06:05:23.327942397 +0000 UTC m=+0.407035596 container attach ea1c08ee9aee40d54db95849fe029156e08d1e69fcbb43d5a51bbb5fa193d3b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:05:23.748 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:05:23 smithi007 podman[112471]: 2024-09-21 06:05:23.45008484 +0000 UTC m=+0.529178040 container died ea1c08ee9aee40d54db95849fe029156e08d1e69fcbb43d5a51bbb5fa193d3b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T06:05:23.841 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:23 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:23.582+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:24.016 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:23 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:23.757+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:24.038 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T06:05:24.078 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:24.078 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T06:05:24.078 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T06:05:24.078 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.4 2024-09-21T06:05:24.318 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:24 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:24.130+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:24.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:24 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:24.000+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:24.381 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:24 smithi027 systemd[1]: Stopping Ceph osd.4 for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:24.381 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:24 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:24.281+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:24.726 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:24 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4[45016]: 2024-09-21T06:05:24.378+0000 7fc438a65640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:24.726 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:24 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4[45016]: 2024-09-21T06:05:24.378+0000 7fc438a65640 -1 osd.4 88 *** Got signal Terminated *** 2024-09-21T06:05:24.726 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:24 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4[45016]: 2024-09-21T06:05:24.378+0000 7fc438a65640 -1 osd.4 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:05:25.051 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:24 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:24.595+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:25.068 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:24 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:24.758+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:25.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:25 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:25.049+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:25.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:25 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:25.115+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:25.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:25 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:25.312+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:26.068 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:25 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:25.772+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:26.091 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:25 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:25.636+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:26.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:26.120+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:26.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:26 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:26.095+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:26.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:26 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:26.272+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:27.068 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:26.815+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:27.091 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:26 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:26.615+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:27.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:27 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:27.108+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:27.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:27 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:27.109+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:27.574 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:27 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:27.117+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:27.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:27 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:27.229+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:27.841 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:27 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:27.640+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:27.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:27 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:27.572+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:28.068 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:27 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:27.786+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:28.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:28 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:28.087+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:28.476 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:28 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:28.193+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:28.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:28 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:28.269+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:28.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:28 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:28.123+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:28.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:28 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:28.123+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:28.841 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:28 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:28.638+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:28.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:28 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:28.587+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:29.068 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:28 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:28.746+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:29.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:29 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:29.076+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:29.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:29 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:29.076+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:29.476 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:29 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:29.211+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:29.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:29 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:29.235+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:29.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:29 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:29.133+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:29.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:29 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:29.133+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:29.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:29 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:29.541+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:29.842 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:29 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:29.657+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:29.842 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:29 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:29.657+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.585094+0000 front 2024-09-21T06:05:04.585197+0000 (oldest deadline 2024-09-21T06:05:28.685078+0000) 2024-09-21T06:05:29.976 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:29 smithi027 podman[66528]: 2024-09-21 06:05:29.725129543 +0000 UTC m=+5.435769423 container died 5a126e8c96c74e9bdd2e4881e09b92d9ef503cc12939f206beccbea39ebbe824 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T06:05:30.068 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:29 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:29.750+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:30.260 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:30 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:30.187+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:30.260 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:30 smithi027 podman[66528]: 2024-09-21 06:05:30.079564934 +0000 UTC m=+5.790204850 container cleanup 5a126e8c96c74e9bdd2e4881e09b92d9ef503cc12939f206beccbea39ebbe824 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:05:30.260 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:30 smithi027 bash[66528]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4 2024-09-21T06:05:30.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:30 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:30.028+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:30.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:30 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:30.028+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:30.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:30 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:30.112+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:30.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:30 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:30.112+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:30.709 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:30 smithi027 podman[66546]: 2024-09-21 06:05:30.363920372 +0000 UTC m=+0.636088719 container remove 5a126e8c96c74e9bdd2e4881e09b92d9ef503cc12939f206beccbea39ebbe824 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T06:05:30.710 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:30 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:30.257+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:30.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:30 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:30.526+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:30.842 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:30 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:30.692+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:30.842 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:30 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:30.692+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.585094+0000 front 2024-09-21T06:05:04.585197+0000 (oldest deadline 2024-09-21T06:05:28.685078+0000) 2024-09-21T06:05:30.976 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:30 smithi027 podman[66638]: 2024-09-21 06:05:30.611482959 +0000 UTC m=+0.016351923 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:05:30.976 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:30 smithi027 podman[66638]: 2024-09-21 06:05:30.714705599 +0000 UTC m=+0.119574550 container create 1e62db3de9971c2da4ff980695a6fe52096e14bea75b70c826587f62cda35b4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T06:05:31.068 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:30 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:30.746+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:31.275 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:31 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:31.208+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:31.275 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:31 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:31.208+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:31.275 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:30 smithi027 podman[66638]: 2024-09-21 06:05:30.975446838 +0000 UTC m=+0.380315802 container init 1e62db3de9971c2da4ff980695a6fe52096e14bea75b70c826587f62cda35b4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:05:31.276 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:30 smithi027 podman[66638]: 2024-09-21 06:05:30.979009986 +0000 UTC m=+0.383878936 container start 1e62db3de9971c2da4ff980695a6fe52096e14bea75b70c826587f62cda35b4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T06:05:31.276 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:31 smithi027 podman[66638]: 2024-09-21 06:05:31.100422137 +0000 UTC m=+0.505291099 container attach 1e62db3de9971c2da4ff980695a6fe52096e14bea75b70c826587f62cda35b4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-21T06:05:31.276 INFO:journalctl@ceph.osd.4.smithi027.stdout:Sep 21 06:05:31 smithi027 podman[66638]: 2024-09-21 06:05:31.176828849 +0000 UTC m=+0.581697801 container died 1e62db3de9971c2da4ff980695a6fe52096e14bea75b70c826587f62cda35b4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T06:05:31.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:31 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:31.008+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:31.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:31 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:31.008+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:31.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:31 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:31.117+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:31.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:31 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:31.117+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:31.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:31 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:31.273+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:31.834 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T06:05:31.841 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:31 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:31.724+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:31.842 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:31 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:31.724+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.585094+0000 front 2024-09-21T06:05:04.585197+0000 (oldest deadline 2024-09-21T06:05:28.685078+0000) 2024-09-21T06:05:31.842 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:31 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:31.511+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:31.876 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:31.876 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T06:05:31.877 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T06:05:31.877 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.5 2024-09-21T06:05:32.068 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:31 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:31.783+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:32.068 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:31 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:31.783+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:32.181 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:31 smithi119 systemd[1]: Stopping Ceph osd.5 for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:32.181 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:32 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:32.055+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:32.181 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:32 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:32.055+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:32.476 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:32 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:32.298+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:32.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:32 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:32.161+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:32.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:32 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:32.161+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:32.513 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:32 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:32.179+0000 7fcd02c32640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:32.513 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:32 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:32.179+0000 7fcd02c32640 -1 osd.5 88 *** Got signal Terminated *** 2024-09-21T06:05:32.513 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:32 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:32.179+0000 7fcd02c32640 -1 osd.5 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:05:32.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:32 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:32.133+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:32.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:32 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:32.133+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:32.841 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:32 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:32.682+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:32.841 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:32 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:32.682+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.585094+0000 front 2024-09-21T06:05:04.585197+0000 (oldest deadline 2024-09-21T06:05:28.685078+0000) 2024-09-21T06:05:32.842 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:32 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:32.512+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:33.068 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:32 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:32.806+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:33.068 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:32 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:32.806+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:33.476 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:33 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:33.314+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:33.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:33 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:33.204+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:33.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:33 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:33.204+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:33.495 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:33 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:33.104+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:33.495 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:33 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:33.104+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:33.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:33 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:33.127+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:33.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:33 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:33.127+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:33.842 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:33 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:33.494+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:33.842 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:33 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:33.657+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:33.842 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:33 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:33.657+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.585094+0000 front 2024-09-21T06:05:04.585197+0000 (oldest deadline 2024-09-21T06:05:28.685078+0000) 2024-09-21T06:05:34.318 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:34 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:34.083+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:34.318 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:34 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:34.083+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:34.319 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:33 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:33.855+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:34.319 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:33 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:33.855+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:34.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:34 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:34.065+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:34.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:34 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:34.065+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:34.476 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:34 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:34.330+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:34.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:34 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:34.196+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:34.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:34 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:34.196+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:34.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:34 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:34.502+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:34.842 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:34 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:34.704+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:34.842 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:34 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:34.704+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.585094+0000 front 2024-09-21T06:05:04.585197+0000 (oldest deadline 2024-09-21T06:05:28.685078+0000) 2024-09-21T06:05:34.842 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:34 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:34.704+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:08.685423+0000 front 2024-09-21T06:05:08.685587+0000 (oldest deadline 2024-09-21T06:05:34.585567+0000) 2024-09-21T06:05:35.132 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:34 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:34.873+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:35.133 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:34 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:34.873+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:35.133 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:34 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:34.873+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:11.712035+0000 front 2024-09-21T06:05:11.712110+0000 (oldest deadline 2024-09-21T06:05:34.612177+0000) 2024-09-21T06:05:35.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:35 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:35.043+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:35.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:35 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:35.043+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:35.476 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:35 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:35.287+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:35.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:35 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:35.167+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:35.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:35 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:35.167+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:35.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:35 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:35.129+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:35.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:35 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:35.129+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:35.749 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:35 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:35.491+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:35.749 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:35 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:35.491+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:36.012 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:35 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:35.747+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:36.012 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:35 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:35.747+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.585094+0000 front 2024-09-21T06:05:04.585197+0000 (oldest deadline 2024-09-21T06:05:28.685078+0000) 2024-09-21T06:05:36.012 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:35 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:35.747+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:08.685423+0000 front 2024-09-21T06:05:08.685587+0000 (oldest deadline 2024-09-21T06:05:34.585567+0000) 2024-09-21T06:05:36.318 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:36 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:36.119+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:36.318 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:36 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:36.119+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:36.319 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:36 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:36.119+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:36.319 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:35 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:35.892+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:36.319 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:35 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:35.892+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:36.319 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:35 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:35.892+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:11.712035+0000 front 2024-09-21T06:05:11.712110+0000 (oldest deadline 2024-09-21T06:05:34.612177+0000) 2024-09-21T06:05:36.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:36 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:36.011+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:36.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:36 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:36.011+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:36.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:36 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:36.011+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:36.476 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:36 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:36.327+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:36.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:36 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:36.120+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:36.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:36 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:36.120+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:36.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:36 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:36.120+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:36.782 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:36 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:36.476+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:36.782 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:36 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:36.476+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:37.092 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:36 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:36.780+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.883252+0000 front 2024-09-21T06:04:55.883115+0000 (oldest deadline 2024-09-21T06:05:18.783251+0000) 2024-09-21T06:05:37.092 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:36 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:36.780+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.585094+0000 front 2024-09-21T06:05:04.585197+0000 (oldest deadline 2024-09-21T06:05:28.685078+0000) 2024-09-21T06:05:37.092 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:36 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5[46486]: 2024-09-21T06:05:36.780+0000 7fccfb215640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:08.685423+0000 front 2024-09-21T06:05:08.685587+0000 (oldest deadline 2024-09-21T06:05:34.585567+0000) 2024-09-21T06:05:37.092 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:36 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:36.964+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:37.092 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:36 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:36.964+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:37.092 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:36 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:36.964+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:37.318 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:36 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:36.916+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:37.318 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:36 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:36.916+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:37.318 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:36 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:36.916+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:11.712035+0000 front 2024-09-21T06:05:11.712110+0000 (oldest deadline 2024-09-21T06:05:34.612177+0000) 2024-09-21T06:05:37.319 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:37 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:37.158+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:37.319 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:37 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:37.158+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:37.319 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:37 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:37.158+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:37.476 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:37 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:37.314+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:37.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:37 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:37.150+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:37.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:37 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:37.150+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:37.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:37 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:37.150+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:37.815 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:37 smithi119 podman[68627]: 2024-09-21 06:05:37.538428882 +0000 UTC m=+5.460843910 container died 17888a9e88091c327d0bddf42a15d84c496766e330b0379050b038b0000eb3c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T06:05:37.815 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:37.480+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:37.816 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:37 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:37.480+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:38.091 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:37 smithi119 podman[68627]: 2024-09-21 06:05:37.91231976 +0000 UTC m=+5.834734832 container cleanup 17888a9e88091c327d0bddf42a15d84c496766e330b0379050b038b0000eb3c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T06:05:38.092 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:37 smithi119 bash[68627]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5 2024-09-21T06:05:38.092 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:38 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:38.001+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:38.092 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:38 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:38.001+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:38.092 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:38 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:38.001+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:38.190 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:37 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:37.936+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:38.190 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:37 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:37.936+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:38.190 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:37 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:37.936+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:11.712035+0000 front 2024-09-21T06:05:11.712110+0000 (oldest deadline 2024-09-21T06:05:34.612177+0000) 2024-09-21T06:05:38.476 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:38 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:38.308+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:38.476 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:38 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:38.308+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:38.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:38 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:38.195+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:38.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:38 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:38.195+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:38.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:38 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:38.195+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:38.498 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:38 smithi119 podman[68643]: 2024-09-21 06:05:38.188605418 +0000 UTC m=+0.646994399 container remove 17888a9e88091c327d0bddf42a15d84c496766e330b0379050b038b0000eb3c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T06:05:38.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:38 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:38.188+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:38.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:38 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:38.188+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:38.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:38 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:38.188+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:38.751 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:38 smithi119 podman[68729]: 2024-09-21 06:05:38.427981558 +0000 UTC m=+0.015753493 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:05:38.751 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:38 smithi119 podman[68729]: 2024-09-21 06:05:38.531047174 +0000 UTC m=+0.118819101 container create 544747b4cad8f619b546ffcf193e996e87563f82dc1772bcdb87d9579ea1822d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T06:05:38.752 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:38 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:38.496+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:38.752 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:38 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:38.496+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:39.020 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:38 smithi119 podman[68729]: 2024-09-21 06:05:38.750149234 +0000 UTC m=+0.337921160 container init 544747b4cad8f619b546ffcf193e996e87563f82dc1772bcdb87d9579ea1822d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T06:05:39.021 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:38 smithi119 podman[68729]: 2024-09-21 06:05:38.753540305 +0000 UTC m=+0.341312249 container start 544747b4cad8f619b546ffcf193e996e87563f82dc1772bcdb87d9579ea1822d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T06:05:39.021 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:38 smithi119 podman[68729]: 2024-09-21 06:05:38.833484916 +0000 UTC m=+0.421256842 container attach 544747b4cad8f619b546ffcf193e996e87563f82dc1772bcdb87d9579ea1822d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T06:05:39.021 INFO:journalctl@ceph.osd.5.smithi119.stdout:Sep 21 06:05:38 smithi119 podman[68729]: 2024-09-21 06:05:38.93869327 +0000 UTC m=+0.526465197 container died 544747b4cad8f619b546ffcf193e996e87563f82dc1772bcdb87d9579ea1822d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:05:39.318 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:38 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:38.914+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:39.319 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:38 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:38.914+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:39.319 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:38 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:38.914+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:11.712035+0000 front 2024-09-21T06:05:11.712110+0000 (oldest deadline 2024-09-21T06:05:34.612177+0000) 2024-09-21T06:05:39.319 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:39 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:39.141+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:39.319 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:39 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:39.141+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:39.319 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:39 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:39.141+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:39.320 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:39 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:39.017+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:39.320 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:39 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:39.017+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:39.321 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:39 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:39.017+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:39.476 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:39 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:39.332+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:39.476 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:39 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:39.332+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:39.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:39 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:39.192+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:39.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:39 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:39.192+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:39.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:39 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:39.192+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:39.571 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:39 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:39.470+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:39.571 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:39 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:39.470+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:39.590 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T06:05:39.630 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:39.630 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T06:05:39.630 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T06:05:39.631 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.6 2024-09-21T06:05:39.935 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:39 smithi007 systemd[1]: Stopping Ceph osd.6 for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:39.935 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:39 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:39.898+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:39.935 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:39 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:39.898+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:39.935 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:39 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:39.898+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:11.712035+0000 front 2024-09-21T06:05:11.712110+0000 (oldest deadline 2024-09-21T06:05:34.612177+0000) 2024-09-21T06:05:39.936 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:39 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:39.933+0000 7f5646001640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:39.936 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:39 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:39.933+0000 7f5646001640 -1 osd.6 88 *** Got signal Terminated *** 2024-09-21T06:05:39.936 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:39 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:39.933+0000 7f5646001640 -1 osd.6 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:05:40.318 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:40 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:40.172+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:40.318 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:40 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:40.172+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:40.318 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:40 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:40.172+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:40.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:39 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:39.969+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:40.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:39 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:39.969+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:40.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:39 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:39.969+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:40.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:40 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:40.309+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:40.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:40 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:40.309+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:40.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:40 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:40.238+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:40.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:40 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:40.238+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:40.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:40 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:40.238+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:40.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:40 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:40.492+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:40.842 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:40 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:40.492+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:41.195 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:40 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:40.876+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:41.195 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:40 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:40.876+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:41.195 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:40 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:40.876+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:11.712035+0000 front 2024-09-21T06:05:11.712110+0000 (oldest deadline 2024-09-21T06:05:34.612177+0000) 2024-09-21T06:05:41.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:40 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:40.982+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:41.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:40 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:40.982+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:41.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:40 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:40.982+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:41.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:41 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:41.193+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:41.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:41 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:41.193+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:41.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:41 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:41.193+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:41.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:41 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:41.314+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:41.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:41 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:41.314+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:41.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:41 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:41.276+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:41.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:41 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:41.276+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:41.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:41 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:41.276+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:41.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:41 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:41.500+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:41.842 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:41 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:41.500+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:42.236 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:41 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:41.911+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:42.236 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:41 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:41.911+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:42.236 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:41 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:41.911+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:11.712035+0000 front 2024-09-21T06:05:11.712110+0000 (oldest deadline 2024-09-21T06:05:34.612177+0000) 2024-09-21T06:05:42.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:42 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:42.014+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:42.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:42 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:42.014+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:42.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:42 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:42.014+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:42.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:42 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:42.235+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:42.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:42 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:42.235+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:42.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:42 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:42.235+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:42.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:42 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:42.334+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:42.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:42 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:42.334+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:42.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:42 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:42.321+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:42.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:42 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:42.321+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:42.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:42 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:42.321+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:42.842 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:42 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:42.519+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:42.842 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:42 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:42.519+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:42.842 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:42 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:42.519+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:43.256 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:42 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:42.905+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:43.257 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:42 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:42.905+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:43.257 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:42 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:42.905+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:11.712035+0000 front 2024-09-21T06:05:11.712110+0000 (oldest deadline 2024-09-21T06:05:34.612177+0000) 2024-09-21T06:05:43.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:43 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:43.024+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:43.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:43 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:43.024+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:43.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:43 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:43.024+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:43.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:43 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:43.255+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:43.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:43 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:43.255+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:43.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:43 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:43.255+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:43.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:43 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:43.255+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:43.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:43 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:43.293+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:43.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:43 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:43.293+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:43.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:43 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:43.336+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:43.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:43 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:43.336+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:43.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:43 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:43.336+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:43.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:43 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:43.336+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:43.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:43 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:43.548+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:43.842 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:43 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:43.548+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:43.842 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:43 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:43.548+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:44.256 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:43 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:43.867+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:44.256 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:43 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:43.867+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:44.256 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:43 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:43.867+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:11.712035+0000 front 2024-09-21T06:05:11.712110+0000 (oldest deadline 2024-09-21T06:05:34.612177+0000) 2024-09-21T06:05:44.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:44 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:44.011+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:44.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:44 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:44.011+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:44.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:44 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:44.011+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:44.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:44 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:44.254+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:44.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:44 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:44.254+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:44.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:44 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:44.254+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:44.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:44 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:44.254+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:44.614 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:44 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:44.560+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:44.614 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:44 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:44.560+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:44.614 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:44 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:44.560+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:44.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:44 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:44.281+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:44.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:44 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:44.281+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:44.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:44 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:44.291+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:44.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:44 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:44.291+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:44.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:44 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:44.291+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:44.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:44 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:44.291+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:45.300 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:44 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:44.831+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:54.308702+0000 front 2024-09-21T06:04:54.308732+0000 (oldest deadline 2024-09-21T06:05:23.109371+0000) 2024-09-21T06:05:45.300 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:44 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:44.831+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.310906+0000 front 2024-09-21T06:05:05.311216+0000 (oldest deadline 2024-09-21T06:05:31.711403+0000) 2024-09-21T06:05:45.301 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:44 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6[60618]: 2024-09-21T06:05:44.831+0000 7f56425ec640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:11.712035+0000 front 2024-09-21T06:05:11.712110+0000 (oldest deadline 2024-09-21T06:05:34.612177+0000) 2024-09-21T06:05:45.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:45 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:45.055+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:45.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:45 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:45.055+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:45.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:45 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:45.055+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:45.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:45 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:45.055+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:45.569 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:45 smithi007 podman[112576]: 2024-09-21 06:05:45.423369104 +0000 UTC m=+5.592655704 container died c4bd63cdf689e76e916d6f4475c375a30f42fd714c48133d45228b14797c885e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:05:45.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:45 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:45.299+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:45.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:45 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:45.299+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:45.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:45 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:45.299+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:45.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:45 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:45.299+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:45.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:45 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:45.238+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:45.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:45 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:45.239+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:45.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:45 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:45.254+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:45.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:45 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:45.254+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:45.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:45 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:45.254+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:45.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:45 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:45.254+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:45.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:45 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:45.546+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:45.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:45 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:45.546+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:45.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:45 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:45.546+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:46.027 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:45 smithi007 podman[112576]: 2024-09-21 06:05:45.832859865 +0000 UTC m=+6.002146503 container cleanup c4bd63cdf689e76e916d6f4475c375a30f42fd714c48133d45228b14797c885e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T06:05:46.027 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:45 smithi007 bash[112576]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6 2024-09-21T06:05:46.318 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:46 smithi007 podman[112592]: 2024-09-21 06:05:46.025849894 +0000 UTC m=+0.600214957 container remove c4bd63cdf689e76e916d6f4475c375a30f42fd714c48133d45228b14797c885e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T06:05:46.318 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:46 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:46.266+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:46.318 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:46 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:46.266+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:46.319 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:46 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:46.266+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:46.319 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:46 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:46.266+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:46.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:46 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:46.019+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:46.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:46 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:46.019+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:46.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:46 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:46.019+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:46.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:46 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:46.019+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:46.722 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:46 smithi007 podman[112681]: 2024-09-21 06:05:46.366461367 +0000 UTC m=+0.016423854 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:05:46.722 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:46 smithi007 podman[112681]: 2024-09-21 06:05:46.476706634 +0000 UTC m=+0.126669110 container create 12914ee0b193067e3a99372fc05d75f1112dc53fe3b626783e3a3608d146b7f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:05:46.722 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:46 smithi007 podman[112681]: 2024-09-21 06:05:46.720748141 +0000 UTC m=+0.370710626 container init 12914ee0b193067e3a99372fc05d75f1112dc53fe3b626783e3a3608d146b7f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T06:05:46.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:46 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:46.242+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:46.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:46 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:46.242+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:46.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:46 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:46.246+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:46.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:46 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:46.246+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:46.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:46 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:46.246+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:46.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:46 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:46.246+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:46.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:46 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:46.560+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:46.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:46 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:46.560+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:46.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:46 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:46.560+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:47.068 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:46 smithi007 podman[112681]: 2024-09-21 06:05:46.724279731 +0000 UTC m=+0.374242209 container start 12914ee0b193067e3a99372fc05d75f1112dc53fe3b626783e3a3608d146b7f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T06:05:47.069 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:46 smithi007 podman[112681]: 2024-09-21 06:05:46.937722131 +0000 UTC m=+0.587684618 container attach 12914ee0b193067e3a99372fc05d75f1112dc53fe3b626783e3a3608d146b7f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T06:05:47.069 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:05:46 smithi007 podman[112681]: 2024-09-21 06:05:46.938269196 +0000 UTC m=+0.588231680 container died 12914ee0b193067e3a99372fc05d75f1112dc53fe3b626783e3a3608d146b7f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:05:47.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:46 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:46.996+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:47.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:46 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:46.996+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:47.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:46 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:46.996+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:47.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:46 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:46.996+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:47.442 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:47 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:47.255+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:47.442 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:47 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:47.255+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:47.442 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:47 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:47.255+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:47.442 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:47 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:47.255+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:47.469 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T06:05:47.511 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:47.511 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T06:05:47.512 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T06:05:47.512 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.7 2024-09-21T06:05:47.540 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:47 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:47.285+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:47.540 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:47 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:47.285+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:47.540 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:47 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:47.285+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:47.540 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:47 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:47.285+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:47.540 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:47 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:47.226+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:47.541 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:47 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:47.226+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:47.541 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:47 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:47.226+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.397167+0000 front 2024-09-21T06:05:20.397209+0000 (oldest deadline 2024-09-21T06:05:46.297026+0000) 2024-09-21T06:05:47.816 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:47 smithi027 systemd[1]: Stopping Ceph osd.7 for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:47.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:47 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:47.563+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:47.841 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:47 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:47.563+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:47.842 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:47 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:47.563+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:48.226 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:47 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:47.815+0000 7f5b7e8f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:48.226 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:47 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:47.815+0000 7f5b7e8f2640 -1 osd.7 88 *** Got signal Terminated *** 2024-09-21T06:05:48.226 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:47 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:47.815+0000 7f5b7e8f2640 -1 osd.7 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:05:48.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:48 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:48.026+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:48.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:48 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:48.026+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:48.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:48 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:48.026+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:48.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:48 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:48.026+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:48.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:48 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:48.229+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:48.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:48 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:48.229+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:48.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:48 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:48.229+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:48.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:48 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:48.229+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:48.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:48 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:48.236+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:48.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:48 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:48.236+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:48.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:48 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:48.236+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.397167+0000 front 2024-09-21T06:05:20.397209+0000 (oldest deadline 2024-09-21T06:05:46.297026+0000) 2024-09-21T06:05:48.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:48 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:48.259+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:48.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:48 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:48.259+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:48.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:48 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:48.259+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:48.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:48 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:48.259+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:49.038 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:48 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:48.604+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:49.038 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:48 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:48.604+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:49.038 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:48 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:48.604+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:49.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:49 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:49.036+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:49.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:49 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:49.036+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:49.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:49 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:49.036+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:49.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:49 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:49.036+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:49.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:49 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:49.271+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:49.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:49 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:49.271+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:49.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:49 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:49.271+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:49.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:49 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:49.271+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:49.628 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:49 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:49.246+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:49.628 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:49 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:49.246+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:49.628 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:49 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:49.246+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.397167+0000 front 2024-09-21T06:05:20.397209+0000 (oldest deadline 2024-09-21T06:05:46.297026+0000) 2024-09-21T06:05:49.629 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:49 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:49.231+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:49.629 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:49 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:49.231+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:49.629 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:49 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:49.231+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:49.629 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:49 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:49.231+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:50.074 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:49 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:49.648+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:50.074 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:49 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:49.648+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:50.075 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:49 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:49.648+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:50.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:50 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:50.072+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:50.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:50 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:50.072+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:50.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:50 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:50.072+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:50.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:50 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:50.072+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:50.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:50 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:50.213+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:50.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:50 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:50.213+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:50.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:50 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:50.213+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:50.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:50 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:50.213+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:50.477 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:50 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:50.249+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:50.477 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:50 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:50.249+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:50.477 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:50 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:50.249+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.397167+0000 front 2024-09-21T06:05:20.397209+0000 (oldest deadline 2024-09-21T06:05:46.297026+0000) 2024-09-21T06:05:50.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:50 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:50.242+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:50.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:50 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:50.242+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:50.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:50 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:50.242+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:50.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:50 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:50.242+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:51.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:50 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:50.668+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:51.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:50 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:50.668+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:51.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:50 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:50.668+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:51.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:50 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:50.668+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:26.425689+0000 front 2024-09-21T06:05:26.425528+0000 (oldest deadline 2024-09-21T06:05:50.525629+0000) 2024-09-21T06:05:51.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:51 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:51.087+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:51.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:51 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:51.087+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:51.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:51 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:51.087+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:51.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:51 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:51.087+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:51.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:51 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:51.087+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:05:51.477 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:51 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:51.213+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:51.477 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:51 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:51.213+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:51.477 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:51 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:51.213+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.397167+0000 front 2024-09-21T06:05:20.397209+0000 (oldest deadline 2024-09-21T06:05:46.297026+0000) 2024-09-21T06:05:51.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:51 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:51.206+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:51.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:51 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:51.206+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:51.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:51 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:51.206+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:51.478 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:51 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:51.206+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:51.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:51 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:51.230+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:51.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:51 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:51.230+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:51.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:51 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:51.230+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:51.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:51 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:51.230+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:52.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:51 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:51.694+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:52.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:51 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:51.694+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:52.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:51 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:51.694+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:52.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:51 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:51.694+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:26.425689+0000 front 2024-09-21T06:05:26.425528+0000 (oldest deadline 2024-09-21T06:05:50.525629+0000) 2024-09-21T06:05:52.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:52 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:52.174+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:52.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:52 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:52.174+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:52.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:52 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:52.175+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:52.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:52 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:52.175+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:52.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:52 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:52.175+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:05:52.477 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:52 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:52.242+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.794747+0000 front 2024-09-21T06:05:02.794680+0000 (oldest deadline 2024-09-21T06:05:28.094852+0000) 2024-09-21T06:05:52.477 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:52 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:52.242+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.196027+0000 front 2024-09-21T06:05:12.195866+0000 (oldest deadline 2024-09-21T06:05:38.095975+0000) 2024-09-21T06:05:52.477 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:52 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:52.242+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.397167+0000 front 2024-09-21T06:05:20.397209+0000 (oldest deadline 2024-09-21T06:05:46.297026+0000) 2024-09-21T06:05:52.477 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:52 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7[51657]: 2024-09-21T06:05:52.242+0000 7f5b7aedd640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:26.797847+0000 front 2024-09-21T06:05:26.797823+0000 (oldest deadline 2024-09-21T06:05:51.497838+0000) 2024-09-21T06:05:52.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:52 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:52.208+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:52.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:52 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:52.208+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:52.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:52 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:52.208+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:52.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:52 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:52.208+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:52.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:52 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:52.114+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:52.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:52 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:52.114+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:52.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:52 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:52.114+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:52.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:52 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:52.114+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:52.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:52 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:52.114+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:05:53.091 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:52 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:52.740+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:53.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:52 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:52.740+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:53.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:52 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:52.740+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:53.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:52 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:52.740+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:26.425689+0000 front 2024-09-21T06:05:26.425528+0000 (oldest deadline 2024-09-21T06:05:50.525629+0000) 2024-09-21T06:05:53.476 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:53 smithi027 podman[66739]: 2024-09-21 06:05:53.141830309 +0000 UTC m=+5.426354603 container died d76dfdb91ab8186a2917a6737d18088a25c516d24a316b10a1db93fee19fc1ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T06:05:53.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:53 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:53.173+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:53.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:53 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:53.173+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:53.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:53 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:53.173+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:53.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:53 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:53.173+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:53.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:53 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:53.173+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:05:53.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:53 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:53.189+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:53.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:53 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:53.189+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:53.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:53 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:53.189+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:53.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:53 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:53.189+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:53.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:53 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:53.137+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:53.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:53 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:53.137+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:53.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:53 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:53.137+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:53.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:53 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:53.137+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:53.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:53 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:53.137+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:05:53.892 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:53 smithi027 podman[66739]: 2024-09-21 06:05:53.631343023 +0000 UTC m=+5.915867320 container cleanup d76dfdb91ab8186a2917a6737d18088a25c516d24a316b10a1db93fee19fc1ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:05:53.892 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:53 smithi027 bash[66739]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7 2024-09-21T06:05:54.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:53 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:53.768+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:54.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:53 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:53.768+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:54.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:53 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:53.768+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:54.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:53 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:53.768+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:26.425689+0000 front 2024-09-21T06:05:26.425528+0000 (oldest deadline 2024-09-21T06:05:50.525629+0000) 2024-09-21T06:05:54.182 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:53 smithi027 podman[66766]: 2024-09-21 06:05:53.890820561 +0000 UTC m=+0.745775522 container remove d76dfdb91ab8186a2917a6737d18088a25c516d24a316b10a1db93fee19fc1ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T06:05:54.453 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:54 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:54.181+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:54.453 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:54 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:54.181+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:54.453 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:54 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:54.181+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:54.454 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:54 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:54.181+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:54.454 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:54 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:54.181+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:05:54.454 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:54 smithi027 podman[66859]: 2024-09-21 06:05:54.112832584 +0000 UTC m=+0.016684174 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:05:54.454 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:54 smithi027 podman[66859]: 2024-09-21 06:05:54.216748174 +0000 UTC m=+0.120599749 container create 82749b0d967ebe48c47d58fb05e58bd1f9fc95586cc59ce7f8b33203c20120a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T06:05:54.454 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:54 smithi027 podman[66859]: 2024-09-21 06:05:54.393987593 +0000 UTC m=+0.297839179 container init 82749b0d967ebe48c47d58fb05e58bd1f9fc95586cc59ce7f8b33203c20120a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:05:54.454 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:54 smithi027 podman[66859]: 2024-09-21 06:05:54.397450474 +0000 UTC m=+0.301302047 container start 82749b0d967ebe48c47d58fb05e58bd1f9fc95586cc59ce7f8b33203c20120a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:05:54.454 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:54 smithi027 podman[66859]: 2024-09-21 06:05:54.45222013 +0000 UTC m=+0.356071706 container attach 82749b0d967ebe48c47d58fb05e58bd1f9fc95586cc59ce7f8b33203c20120a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:05:54.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:54 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:54.224+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:54.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:54 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:54.224+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:54.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:54 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:54.224+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:54.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:54 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:54.224+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:54.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:54 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:54.115+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:54.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:54 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:54.115+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:54.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:54 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:54.115+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:54.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:54 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:54.115+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:54.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:54 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:54.115+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:05:54.726 INFO:journalctl@ceph.osd.7.smithi027.stdout:Sep 21 06:05:54 smithi027 podman[66859]: 2024-09-21 06:05:54.587564052 +0000 UTC m=+0.491415626 container died 82749b0d967ebe48c47d58fb05e58bd1f9fc95586cc59ce7f8b33203c20120a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T06:05:55.082 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:54 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:54.769+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:55.082 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:54 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:54.769+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:55.082 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:54 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:54.769+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:55.082 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:54 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:54.769+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:26.425689+0000 front 2024-09-21T06:05:26.425528+0000 (oldest deadline 2024-09-21T06:05:50.525629+0000) 2024-09-21T06:05:55.282 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:55 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:55.176+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:55.282 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:55 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:55.176+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:55.282 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:55 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:55.176+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:55.282 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:55 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:55.176+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:55.283 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:55 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:55.176+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:05:55.310 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T06:05:55.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:55 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:55.144+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:55.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:55 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:55.144+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:55.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:55 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:55.144+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:55.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:55 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:55.144+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:55.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:55 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:55.144+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:05:55.398 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:55.398 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T06:05:55.398 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T06:05:55.398 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.8 2024-09-21T06:05:55.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:55 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:55.257+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:55.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:55 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:55.257+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:55.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:55 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:55.257+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:55.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:55 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:55.257+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:55.801 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:55 smithi119 systemd[1]: Stopping Ceph osd.8 for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:55.801 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:55 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:55.672+0000 7f7a22968640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:55.801 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:55 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:55.672+0000 7f7a22968640 -1 osd.8 88 *** Got signal Terminated *** 2024-09-21T06:05:55.801 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:55 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:55.672+0000 7f7a22968640 -1 osd.8 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:05:56.091 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:55 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:55.799+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:56.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:55 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:55.799+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:56.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:55 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:55.799+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:56.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:55 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:55.799+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:26.425689+0000 front 2024-09-21T06:05:26.425528+0000 (oldest deadline 2024-09-21T06:05:50.525629+0000) 2024-09-21T06:05:56.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:56 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:56.130+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:56.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:56 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:56.130+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:56.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:56 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:56.130+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:56.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:56 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:56.130+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:56.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:56 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:56.130+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:05:56.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:56 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:56.217+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:56.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:56 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:56.217+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:56.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:56 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:56.217+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:56.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:56 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:56.217+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:56.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:56 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:56.189+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:56.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:56 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:56.189+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:56.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:56 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:56.189+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:56.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:56 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:56.189+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:56.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:56 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:56.189+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:05:57.091 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:56 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:56.758+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:57.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:56 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:56.758+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:57.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:56 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:56.758+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:57.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:56 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:56.758+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:26.425689+0000 front 2024-09-21T06:05:26.425528+0000 (oldest deadline 2024-09-21T06:05:50.525629+0000) 2024-09-21T06:05:57.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:57 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:57.111+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:57.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:57 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:57.111+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:57.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:57 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:57.111+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:57.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:57 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:57.111+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:57.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:57 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:57.111+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:05:57.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:57.190+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:57.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:57.190+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:57.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:57.190+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:57.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:57 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:57.190+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:57.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:57 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:57.234+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:57.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:57 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:57.234+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:57.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:57 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:57.234+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:57.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:57 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:57.234+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:57.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:57 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:57.234+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:05:58.091 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:57 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:57.749+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:58.091 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:57 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:57.749+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:58.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:57 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:57.749+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:58.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:57 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:57.749+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:26.425689+0000 front 2024-09-21T06:05:26.425528+0000 (oldest deadline 2024-09-21T06:05:50.525629+0000) 2024-09-21T06:05:58.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:58 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:58.139+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:58.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:58 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:58.139+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:58.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:58 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:58.139+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:58.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:58 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:58.139+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:58.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:58 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:58.139+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:05:58.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:58 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:58.163+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:58.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:58 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:58.163+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:58.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:58 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:58.163+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:58.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:58 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:58.163+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:58.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:58 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:58.163+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.525213+0000 front 2024-09-21T06:05:35.525071+0000 (oldest deadline 2024-09-21T06:05:57.825189+0000) 2024-09-21T06:05:58.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:58 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:58.193+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:58.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:58 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:58.193+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:58.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:58 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:58.193+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:58.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:58 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:58.193+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:58.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:58 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:58.193+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:05:58.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:58 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:58.193+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:05:59.091 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:58 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:58.718+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:05:59.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:58 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:58.718+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:05:59.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:58 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:58.718+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:05:59.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:58 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:58.718+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:26.425689+0000 front 2024-09-21T06:05:26.425528+0000 (oldest deadline 2024-09-21T06:05:50.525629+0000) 2024-09-21T06:05:59.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:58 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:58.718+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.627751+0000 front 2024-09-21T06:05:35.627720+0000 (oldest deadline 2024-09-21T06:05:58.428331+0000) 2024-09-21T06:05:59.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:59 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:59.127+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:05:59.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:59 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:59.127+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:05:59.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:59 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:59.127+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:05:59.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:59 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:59.127+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:05:59.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:05:59 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:05:59.127+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:05:59.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:59 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:59.203+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:05:59.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:59 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:59.203+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:05:59.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:59 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:59.203+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:05:59.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:59 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:59.203+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:05:59.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:05:59 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:05:59.203+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.525213+0000 front 2024-09-21T06:05:35.525071+0000 (oldest deadline 2024-09-21T06:05:57.825189+0000) 2024-09-21T06:05:59.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:59 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:59.200+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:05:59.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:59 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:59.200+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:05:59.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:59 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:59.200+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:05:59.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:59 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:59.200+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:05:59.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:59 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:59.200+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:05:59.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:05:59 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:05:59.200+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:00.091 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:59 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:59.680+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:03.019345+0000 front 2024-09-21T06:05:03.019456+0000 (oldest deadline 2024-09-21T06:05:27.019814+0000) 2024-09-21T06:06:00.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:59 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:59.680+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.222509+0000 front 2024-09-21T06:05:13.222562+0000 (oldest deadline 2024-09-21T06:05:34.922532+0000) 2024-09-21T06:06:00.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:59 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:59.680+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:17.724134+0000 front 2024-09-21T06:05:17.724113+0000 (oldest deadline 2024-09-21T06:05:42.424066+0000) 2024-09-21T06:06:00.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:59 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:59.680+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:26.425689+0000 front 2024-09-21T06:05:26.425528+0000 (oldest deadline 2024-09-21T06:05:50.525629+0000) 2024-09-21T06:06:00.092 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:05:59 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8[53136]: 2024-09-21T06:05:59.680+0000 7f7a1af4b640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.627751+0000 front 2024-09-21T06:05:35.627720+0000 (oldest deadline 2024-09-21T06:05:58.428331+0000) 2024-09-21T06:06:00.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:00 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:00.104+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:00.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:00 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:00.104+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:00.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:00 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:00.104+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:00.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:00 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:00.104+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:00.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:00 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:00.104+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:00.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:00 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:00.162+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:06:00.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:00 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:00.162+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:06:00.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:00 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:00.162+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:06:00.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:00 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:00.162+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:06:00.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:00 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:00.162+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.525213+0000 front 2024-09-21T06:05:35.525071+0000 (oldest deadline 2024-09-21T06:05:57.825189+0000) 2024-09-21T06:06:00.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:00 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:00.156+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:00.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:00 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:00.156+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:00.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:00 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:00.156+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:00.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:00 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:00.156+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:00.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:00 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:00.156+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:00.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:00 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:00.156+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:01.425 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:01 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:01.169+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:01.425 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:01 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:01.169+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:01.425 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:01 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:01.169+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:01.425 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:01 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:01.169+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:01.425 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:01 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:01.169+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:01.426 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:01 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:01.169+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:01.426 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:06:01 smithi119 podman[68843]: 2024-09-21 06:06:01.139448549 +0000 UTC m=+5.549480798 container died 9b4128b506da4158124508f7c6dbaf7cf1190327d761378df9eda092db7c9fe5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T06:06:01.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:01 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:01.139+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:01.511 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:01 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:01.139+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:01.511 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:01 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:01.139+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:01.511 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:01 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:01.139+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:01.511 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:01 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:01.139+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:01.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:01.145+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:06:01.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:01.145+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:06:01.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:01.145+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:06:01.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:01.145+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:06:01.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:01 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:01.145+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.525213+0000 front 2024-09-21T06:05:35.525071+0000 (oldest deadline 2024-09-21T06:05:57.825189+0000) 2024-09-21T06:06:01.758 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:06:01 smithi119 podman[68843]: 2024-09-21 06:06:01.514099358 +0000 UTC m=+5.924131606 container cleanup 9b4128b506da4158124508f7c6dbaf7cf1190327d761378df9eda092db7c9fe5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T06:06:01.758 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:06:01 smithi119 bash[68843]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8 2024-09-21T06:06:02.073 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:06:01 smithi119 podman[68860]: 2024-09-21 06:06:01.756812086 +0000 UTC m=+0.610708233 container remove 9b4128b506da4158124508f7c6dbaf7cf1190327d761378df9eda092db7c9fe5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:06:02.342 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:06:02 smithi119 podman[68950]: 2024-09-21 06:06:01.974687155 +0000 UTC m=+0.015370195 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:06:02.342 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:06:02 smithi119 podman[68950]: 2024-09-21 06:06:02.08262459 +0000 UTC m=+0.123307632 container create 8d411e7034055491645c4237b501cb75bfb9aa61ca8d07e8331b38a0e8017f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T06:06:02.342 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:06:02 smithi119 podman[68950]: 2024-09-21 06:06:02.293351708 +0000 UTC m=+0.334034750 container init 8d411e7034055491645c4237b501cb75bfb9aa61ca8d07e8331b38a0e8017f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T06:06:02.342 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:06:02 smithi119 podman[68950]: 2024-09-21 06:06:02.296530088 +0000 UTC m=+0.337213128 container start 8d411e7034055491645c4237b501cb75bfb9aa61ca8d07e8331b38a0e8017f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:06:02.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:02 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:02.170+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:02.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:02 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:02.170+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:02.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:02 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:02.170+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:02.342 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:02 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:02.170+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:02.343 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:02 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:02.170+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:02.343 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:02 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:02.170+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:02.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:02 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:02.170+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:02.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:02 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:02.170+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:02.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:02 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:02.170+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:02.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:02 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:02.170+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:02.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:02 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:02.170+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:02.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:02 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:02.170+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:02.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:02 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:02.108+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:06:02.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:02 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:02.108+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:06:02.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:02 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:02.108+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:06:02.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:02 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:02.108+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:06:02.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:02 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:02.108+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.525213+0000 front 2024-09-21T06:05:35.525071+0000 (oldest deadline 2024-09-21T06:05:57.825189+0000) 2024-09-21T06:06:02.780 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:06:02 smithi119 podman[68950]: 2024-09-21 06:06:02.393638233 +0000 UTC m=+0.434321279 container attach 8d411e7034055491645c4237b501cb75bfb9aa61ca8d07e8331b38a0e8017f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T06:06:02.780 INFO:journalctl@ceph.osd.8.smithi119.stdout:Sep 21 06:06:02 smithi119 podman[68950]: 2024-09-21 06:06:02.491020074 +0000 UTC m=+0.531703113 container died 8d411e7034055491645c4237b501cb75bfb9aa61ca8d07e8331b38a0e8017f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T06:06:03.094 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T06:06:03.132 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:03.133 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T06:06:03.133 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T06:06:03.133 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.9 2024-09-21T06:06:03.338 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:03 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:03.200+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:03.338 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:03 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:03.200+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:03.338 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:03 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:03.200+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:03.338 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:03 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:03.200+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:03.338 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:03 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:03.200+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:03.338 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:03 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:03.200+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:03.428 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:03 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:03.090+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:06:03.428 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:03 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:03.090+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:06:03.428 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:03 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:03.090+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:06:03.429 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:03 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:03.090+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:06:03.429 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:03 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:03.090+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.525213+0000 front 2024-09-21T06:05:35.525071+0000 (oldest deadline 2024-09-21T06:05:57.825189+0000) 2024-09-21T06:06:03.429 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:03 smithi007 systemd[1]: Stopping Ceph osd.9 for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:03.429 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:03 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:03.425+0000 7f73a9077640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:03.429 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:03 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:03.425+0000 7f73a9077640 -1 osd.9 88 *** Got signal Terminated *** 2024-09-21T06:06:03.429 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:03 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:03.425+0000 7f73a9077640 -1 osd.9 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:06:03.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:03 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:03.215+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:03.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:03 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:03.215+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:03.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:03 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:03.215+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:03.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:03 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:03.215+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:03.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:03 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:03.215+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:03.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:03 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:03.215+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:04.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:04 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:04.223+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:04.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:04 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:04.223+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:04.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:04 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:04.223+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:04.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:04 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:04.223+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:04.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:04 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:04.223+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:04.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:04 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:04.223+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:04.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:04 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:04.093+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:06:04.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:04 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:04.093+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:06:04.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:04 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:04.093+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:06:04.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:04 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:04.093+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:06:04.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:04 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:04.093+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.525213+0000 front 2024-09-21T06:05:35.525071+0000 (oldest deadline 2024-09-21T06:05:57.825189+0000) 2024-09-21T06:06:04.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:04 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:04.171+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:04.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:04 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:04.171+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:04.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:04 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:04.171+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:04.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:04 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:04.171+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:04.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:04 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:04.171+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:04.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:04 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:04.171+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:05.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:05 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:05.175+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:05.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:05 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:05.175+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:05.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:05 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:05.175+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:05.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:05 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:05.175+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:05.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:05 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:05.175+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:05.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:05 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:05.175+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:05.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:05 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:05.116+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:06:05.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:05 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:05.116+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:06:05.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:05 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:05.116+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:06:05.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:05 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:05.116+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:06:05.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:05 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:05.116+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.525213+0000 front 2024-09-21T06:05:35.525071+0000 (oldest deadline 2024-09-21T06:05:57.825189+0000) 2024-09-21T06:06:05.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:05 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:05.217+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:05.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:05 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:05.217+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:05.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:05 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:05.217+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:05.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:05 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:05.217+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:05.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:05 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:05.217+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:05.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:05 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:05.217+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:06.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:06 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:06.202+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:06.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:06 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:06.202+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:06.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:06 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:06.202+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:06.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:06 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:06.202+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:06.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:06 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:06.202+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:06.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:06 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:06.202+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:06.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:06 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:06.202+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:05:43.620043+0000 front 2024-09-21T06:05:43.619985+0000 (oldest deadline 2024-09-21T06:06:05.919800+0000) 2024-09-21T06:06:06.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:06 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:06.099+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:06:06.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:06 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:06.099+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:06:06.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:06 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:06.099+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:06:06.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:06 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:06.099+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:06:06.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:06 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:06.099+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.525213+0000 front 2024-09-21T06:05:35.525071+0000 (oldest deadline 2024-09-21T06:05:57.825189+0000) 2024-09-21T06:06:06.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:06 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:06.253+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:06.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:06 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:06.253+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:06.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:06 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:06.253+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:06.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:06 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:06.253+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:06.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:06 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:06.253+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:06.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:06 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:06.253+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:07.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:07 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:07.131+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:06:07.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:07 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:07.131+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:06:07.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:07 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:07.131+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:06:07.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:07 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:07.131+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:06:07.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:07 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:07.131+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.525213+0000 front 2024-09-21T06:05:35.525071+0000 (oldest deadline 2024-09-21T06:05:57.825189+0000) 2024-09-21T06:06:07.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:07 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:07.131+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:05:42.526134+0000 front 2024-09-21T06:05:42.526217+0000 (oldest deadline 2024-09-21T06:06:06.626178+0000) 2024-09-21T06:06:07.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:07 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:07.222+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:07.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:07 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:07.222+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:07.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:07 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:07.222+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:07.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:07 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:07.222+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:07.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:07 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:07.222+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:07.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:07 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:07.222+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:07.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:07 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:07.250+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:07.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:07 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:07.250+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:07.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:07 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:07.250+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:07.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:07 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:07.250+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:07.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:07 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:07.250+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:07.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:07 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:07.250+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:07.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:07 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:07.250+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:05:43.620043+0000 front 2024-09-21T06:05:43.619985+0000 (oldest deadline 2024-09-21T06:06:05.919800+0000) 2024-09-21T06:06:08.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:08 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:08.161+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.016930+0000 front 2024-09-21T06:04:55.016869+0000 (oldest deadline 2024-09-21T06:05:19.717035+0000) 2024-09-21T06:06:08.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:08 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:08.161+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:02.618310+0000 front 2024-09-21T06:05:02.618349+0000 (oldest deadline 2024-09-21T06:05:26.618882+0000) 2024-09-21T06:06:08.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:08 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:08.161+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.420408+0000 front 2024-09-21T06:05:12.420598+0000 (oldest deadline 2024-09-21T06:05:35.920453+0000) 2024-09-21T06:06:08.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:08 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:08.161+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.121966+0000 front 2024-09-21T06:05:21.122072+0000 (oldest deadline 2024-09-21T06:05:42.821888+0000) 2024-09-21T06:06:08.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:08 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:08.161+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.525213+0000 front 2024-09-21T06:05:35.525071+0000 (oldest deadline 2024-09-21T06:05:57.825189+0000) 2024-09-21T06:06:08.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:08 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9[66976]: 2024-09-21T06:06:08.161+0000 7f73a5662640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:05:42.526134+0000 front 2024-09-21T06:05:42.526217+0000 (oldest deadline 2024-09-21T06:06:06.626178+0000) 2024-09-21T06:06:08.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:08 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:08.261+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:08.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:08 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:08.261+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:08.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:08 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:08.261+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:08.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:08 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:08.261+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:08.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:08 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:08.261+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:08.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:08 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:08.261+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:08.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:08 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:08.235+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:08.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:08 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:08.235+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:08.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:08 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:08.235+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:08.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:08 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:08.235+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:08.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:08 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:08.235+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:08.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:08 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:08.235+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:08.727 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:08 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:08.235+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:05:43.620043+0000 front 2024-09-21T06:05:43.619985+0000 (oldest deadline 2024-09-21T06:06:05.919800+0000) 2024-09-21T06:06:09.162 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:08 smithi007 podman[112783]: 2024-09-21 06:06:08.882878461 +0000 UTC m=+5.552786049 container died 50b1f198c680f4f55532f34525764719b9886ea7b872b4bd7a9156ebc5062172 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T06:06:09.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:09 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:09.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:09.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:09 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:09.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:09.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:09 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:09.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:09.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:09 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:09.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:09.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:09 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:09.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:09.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:09 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:09.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:09.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:09 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:09.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:05:43.620043+0000 front 2024-09-21T06:05:43.619985+0000 (oldest deadline 2024-09-21T06:06:05.919800+0000) 2024-09-21T06:06:09.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:09 smithi007 podman[112783]: 2024-09-21 06:06:09.334102703 +0000 UTC m=+6.004010281 container cleanup 50b1f198c680f4f55532f34525764719b9886ea7b872b4bd7a9156ebc5062172 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T06:06:09.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:09 smithi007 bash[112783]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9 2024-09-21T06:06:09.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:09 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:09.301+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:09.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:09 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:09.301+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:09.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:09 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:09.301+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:09.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:09 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:09.301+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:09.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:09 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:09.301+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:09.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:09 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:09.301+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:09.921 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:09 smithi007 podman[112798]: 2024-09-21 06:06:09.593735673 +0000 UTC m=+0.707554454 container remove 50b1f198c680f4f55532f34525764719b9886ea7b872b4bd7a9156ebc5062172 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:06:10.172 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:09 smithi007 podman[112887]: 2024-09-21 06:06:09.823303347 +0000 UTC m=+0.016343646 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:06:10.173 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:09 smithi007 podman[112887]: 2024-09-21 06:06:09.969535056 +0000 UTC m=+0.162575345 container create 291b55cdb5a02d17750a605d76d5188f27f35829c97e17850cc89e512d0c96c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T06:06:10.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:10 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:10.177+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:10.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:10 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:10.177+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:10.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:10 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:10.177+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:10.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:10 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:10.177+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:10.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:10 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:10.177+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:10.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:10 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:10.177+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:10.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:10 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:10.177+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:05:43.620043+0000 front 2024-09-21T06:05:43.619985+0000 (oldest deadline 2024-09-21T06:06:05.919800+0000) 2024-09-21T06:06:10.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:10 smithi007 podman[112887]: 2024-09-21 06:06:10.171950807 +0000 UTC m=+0.364991106 container init 291b55cdb5a02d17750a605d76d5188f27f35829c97e17850cc89e512d0c96c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:06:10.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:10 smithi007 podman[112887]: 2024-09-21 06:06:10.175363469 +0000 UTC m=+0.368403757 container start 291b55cdb5a02d17750a605d76d5188f27f35829c97e17850cc89e512d0c96c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T06:06:10.568 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:10 smithi007 podman[112887]: 2024-09-21 06:06:10.255113587 +0000 UTC m=+0.448153888 container attach 291b55cdb5a02d17750a605d76d5188f27f35829c97e17850cc89e512d0c96c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T06:06:10.569 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:10 smithi007 podman[112887]: 2024-09-21 06:06:10.363531518 +0000 UTC m=+0.556571806 container died 291b55cdb5a02d17750a605d76d5188f27f35829c97e17850cc89e512d0c96c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:06:10.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:10 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:10.297+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:10.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:10 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:10.297+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:10.591 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:10 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:10.297+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:10.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:10 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:10.297+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:10.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:10 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:10.297+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:10.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:10 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:10.297+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:10.909 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:06:10 smithi007 podman[112910]: 2024-09-21 06:06:10.891949472 +0000 UTC m=+0.522358680 container remove 291b55cdb5a02d17750a605d76d5188f27f35829c97e17850cc89e512d0c96c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T06:06:10.914 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T06:06:10.953 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:10.953 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T06:06:10.953 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T06:06:10.953 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.10 2024-09-21T06:06:11.235 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:11 smithi027 systemd[1]: Stopping Ceph osd.10 for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:11.235 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:11 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:11.218+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:11.235 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:11 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:11.218+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:11.235 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:11 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:11.218+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:11.235 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:11 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:11.218+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:11.235 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:11 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:11.218+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:11.235 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:11 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:11.218+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:11.235 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:11 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:11.218+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:05:43.620043+0000 front 2024-09-21T06:05:43.619985+0000 (oldest deadline 2024-09-21T06:06:05.919800+0000) 2024-09-21T06:06:11.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:11 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:11.289+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:11.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:11 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:11.289+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:11.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:11 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:11.289+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:11.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:11 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:11.289+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:11.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:11 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:11.289+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:11.593 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:11 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:11.289+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:11.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:11 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:11.232+0000 7feae7e5b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:11.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:11 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:11.232+0000 7feae7e5b640 -1 osd.10 88 *** Got signal Terminated *** 2024-09-21T06:06:11.726 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:11 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:11.232+0000 7feae7e5b640 -1 osd.10 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:06:12.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:12 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:12.186+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:12.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:12 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:12.186+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:12.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:12 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:12.186+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:12.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:12 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:12.186+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:12.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:12 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:12.186+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:12.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:12 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:12.186+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:12.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:12 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:12.186+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:05:43.620043+0000 front 2024-09-21T06:05:43.619985+0000 (oldest deadline 2024-09-21T06:06:05.919800+0000) 2024-09-21T06:06:12.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:12 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:12.331+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:12.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:12 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:12.331+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:12.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:12 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:12.331+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:12.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:12 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:12.331+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:12.592 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:12 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:12.331+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:12.593 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:12 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:12.331+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:13.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:13 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:13.194+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:13.478 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:13 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:13.194+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:13.478 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:13 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:13.194+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:13.478 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:13 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:13.194+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:13.478 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:13 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:13.194+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:13.478 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:13 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:13.194+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:13.479 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:13 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:13.194+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:05:43.620043+0000 front 2024-09-21T06:05:43.619985+0000 (oldest deadline 2024-09-21T06:06:05.919800+0000) 2024-09-21T06:06:13.803 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:13 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:13.350+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:13.804 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:13 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:13.350+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:13.804 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:13 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:13.350+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:13.804 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:13 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:13.350+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:13.804 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:13 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:13.350+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:13.804 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:13 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:13.350+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:14.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:14 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:14.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:14.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:14 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:14.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:14.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:14 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:14.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:14.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:14 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:14.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:14.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:14 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:14.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:14.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:14 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:14.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:14.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:14 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:14.221+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:05:43.620043+0000 front 2024-09-21T06:05:43.619985+0000 (oldest deadline 2024-09-21T06:06:05.919800+0000) 2024-09-21T06:06:14.841 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:14 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:14.346+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:14.841 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:14 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:14.346+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:14.841 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:14 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:14.346+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:14.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:14 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:14.346+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:14.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:14 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:14.346+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:14.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:14 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:14.346+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:15.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:15 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:15.187+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:57.310272+0000 front 2024-09-21T06:04:57.310470+0000 (oldest deadline 2024-09-21T06:05:19.610378+0000) 2024-09-21T06:06:15.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:15 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:15.187+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:05.511520+0000 front 2024-09-21T06:05:05.511552+0000 (oldest deadline 2024-09-21T06:05:30.211730+0000) 2024-09-21T06:06:15.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:15 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:15.187+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:12.512890+0000 front 2024-09-21T06:05:12.512996+0000 (oldest deadline 2024-09-21T06:05:36.012908+0000) 2024-09-21T06:06:15.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:15 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:15.187+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:21.115072+0000 front 2024-09-21T06:05:21.115311+0000 (oldest deadline 2024-09-21T06:05:42.715726+0000) 2024-09-21T06:06:15.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:15 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:15.187+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.416621+0000 front 2024-09-21T06:05:27.416733+0000 (oldest deadline 2024-09-21T06:05:51.516842+0000) 2024-09-21T06:06:15.476 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:15 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:15.187+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.419361+0000 front 2024-09-21T06:05:35.419207+0000 (oldest deadline 2024-09-21T06:06:01.318923+0000) 2024-09-21T06:06:15.477 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:15 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10[57869]: 2024-09-21T06:06:15.187+0000 7feae043e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:05:43.620043+0000 front 2024-09-21T06:05:43.619985+0000 (oldest deadline 2024-09-21T06:06:05.919800+0000) 2024-09-21T06:06:15.841 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:15 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:15.389+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:15.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:15 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:15.389+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:15.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:15 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:15.389+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:15.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:15 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:15.389+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:15.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:15 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:15.389+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:15.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:15 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:15.389+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:16.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:16 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:16.407+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:16.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:16 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:16.407+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:16.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:16 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:16.407+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:16.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:16 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:16.407+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:16.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:16 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:16.407+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:16.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:16 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:16.407+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:16.962 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:16 smithi027 podman[66962]: 2024-09-21 06:06:16.610285401 +0000 UTC m=+5.456949032 container died c4955ca2c4dce3d7afee81318fcbe988d2f33539b5e9ab8bc0e93c91528dd67d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T06:06:17.226 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:17 smithi027 podman[66962]: 2024-09-21 06:06:17.058246465 +0000 UTC m=+5.904910095 container cleanup c4955ca2c4dce3d7afee81318fcbe988d2f33539b5e9ab8bc0e93c91528dd67d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T06:06:17.226 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:17 smithi027 bash[66962]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10 2024-09-21T06:06:17.681 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:17 smithi027 podman[66977]: 2024-09-21 06:06:17.242604186 +0000 UTC m=+0.627540218 container remove c4955ca2c4dce3d7afee81318fcbe988d2f33539b5e9ab8bc0e93c91528dd67d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:06:17.841 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:17 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:17.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:17.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:17 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:17.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:17.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:17 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:17.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:17.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:17 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:17.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:17.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:17 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:17.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:17.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:17 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:17.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:17.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:17 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:17.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6820 osd.7 since back 2024-09-21T06:05:51.387663+0000 front 2024-09-21T06:05:51.387723+0000 (oldest deadline 2024-09-21T06:06:17.287582+0000) 2024-09-21T06:06:17.976 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:17 smithi027 podman[67067]: 2024-09-21 06:06:17.583175168 +0000 UTC m=+0.016878189 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:06:17.976 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:17 smithi027 podman[67067]: 2024-09-21 06:06:17.684860995 +0000 UTC m=+0.118564004 container create 4cad5a9cdc8f5705f1c2d6c648ca6eba38b0a3c96a40e5448e5b487e0f8e0a9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:06:17.976 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:17 smithi027 podman[67067]: 2024-09-21 06:06:17.920248168 +0000 UTC m=+0.353951178 container init 4cad5a9cdc8f5705f1c2d6c648ca6eba38b0a3c96a40e5448e5b487e0f8e0a9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:06:17.976 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:17 smithi027 podman[67067]: 2024-09-21 06:06:17.923738971 +0000 UTC m=+0.357441990 container start 4cad5a9cdc8f5705f1c2d6c648ca6eba38b0a3c96a40e5448e5b487e0f8e0a9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T06:06:18.416 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:18 smithi027 podman[67067]: 2024-09-21 06:06:18.007152598 +0000 UTC m=+0.440855616 container attach 4cad5a9cdc8f5705f1c2d6c648ca6eba38b0a3c96a40e5448e5b487e0f8e0a9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T06:06:18.416 INFO:journalctl@ceph.osd.10.smithi027.stdout:Sep 21 06:06:18 smithi027 podman[67067]: 2024-09-21 06:06:18.131118015 +0000 UTC m=+0.564821033 container died 4cad5a9cdc8f5705f1c2d6c648ca6eba38b0a3c96a40e5448e5b487e0f8e0a9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T06:06:18.732 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T06:06:18.773 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:18.773 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T06:06:18.773 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T06:06:18.773 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.11 2024-09-21T06:06:18.802 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:18 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:18.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:18.802 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:18 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:18.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:18.802 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:18 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:18.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:18.803 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:18 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:18.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:18.803 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:18 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:18.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:18.803 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:18 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:18.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:18.803 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:18 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:18.454+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6820 osd.7 since back 2024-09-21T06:05:51.387663+0000 front 2024-09-21T06:05:51.387723+0000 (oldest deadline 2024-09-21T06:06:17.287582+0000) 2024-09-21T06:06:19.091 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:18 smithi119 systemd[1]: Stopping Ceph osd.11 for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:19.440 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:19 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:19.089+0000 7faa2a470640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:19.440 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:19 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:19.089+0000 7faa2a470640 -1 osd.11 88 *** Got signal Terminated *** 2024-09-21T06:06:19.440 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:19 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:19.089+0000 7faa2a470640 -1 osd.11 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:06:19.440 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:19 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:19.437+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:19.440 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:19 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:19.437+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:19.440 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:19 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:19.437+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:19.841 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:19 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:19.437+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:19.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:19 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:19.437+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:19.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:19 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:19.437+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:19.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:19 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:19.437+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6820 osd.7 since back 2024-09-21T06:05:51.387663+0000 front 2024-09-21T06:05:51.387723+0000 (oldest deadline 2024-09-21T06:06:17.287582+0000) 2024-09-21T06:06:20.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:20 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:20.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:20.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:20 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:20.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:20.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:20 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:20.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:20.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:20 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:20.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:20.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:20 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:20.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:20.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:20 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:20.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:20.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:20 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:20.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6820 osd.7 since back 2024-09-21T06:05:51.387663+0000 front 2024-09-21T06:05:51.387723+0000 (oldest deadline 2024-09-21T06:06:17.287582+0000) 2024-09-21T06:06:21.841 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:21 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:21.411+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:21.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:21 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:21.411+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:21.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:21 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:21.411+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:21.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:21 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:21.411+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:21.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:21 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:21.411+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:21.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:21 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:21.411+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:21.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:21 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:21.411+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6820 osd.7 since back 2024-09-21T06:05:51.387663+0000 front 2024-09-21T06:05:51.387723+0000 (oldest deadline 2024-09-21T06:06:17.287582+0000) 2024-09-21T06:06:22.841 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:22 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:22.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:22.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:22 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:22.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:22.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:22 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:22.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:22.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:22 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:22.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:22.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:22 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:22.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:22.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:22 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:22.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:22.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:22 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:22.416+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6820 osd.7 since back 2024-09-21T06:05:51.387663+0000 front 2024-09-21T06:05:51.387723+0000 (oldest deadline 2024-09-21T06:06:17.287582+0000) 2024-09-21T06:06:23.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:23 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:23.377+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:04:55.877043+0000 front 2024-09-21T06:04:55.876964+0000 (oldest deadline 2024-09-21T06:05:20.576733+0000) 2024-09-21T06:06:23.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:23 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:23.377+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6804 osd.1 since back 2024-09-21T06:05:04.077822+0000 front 2024-09-21T06:05:04.077931+0000 (oldest deadline 2024-09-21T06:05:28.177947+0000) 2024-09-21T06:06:23.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:23 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:23.377+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6804 osd.2 since back 2024-09-21T06:05:13.379635+0000 front 2024-09-21T06:05:13.379865+0000 (oldest deadline 2024-09-21T06:05:35.679828+0000) 2024-09-21T06:06:23.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:23 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:23.377+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:05:20.981074+0000 front 2024-09-21T06:05:20.981201+0000 (oldest deadline 2024-09-21T06:05:44.381342+0000) 2024-09-21T06:06:23.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:23 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:23.377+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6812 osd.4 since back 2024-09-21T06:05:27.182956+0000 front 2024-09-21T06:05:27.182894+0000 (oldest deadline 2024-09-21T06:05:50.683075+0000) 2024-09-21T06:06:23.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:23 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:23.377+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.119:6812 osd.5 since back 2024-09-21T06:05:35.284467+0000 front 2024-09-21T06:05:35.284526+0000 (oldest deadline 2024-09-21T06:05:57.584738+0000) 2024-09-21T06:06:23.842 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:23 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11[59374]: 2024-09-21T06:06:23.377+0000 7faa26a5b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.27:6820 osd.7 since back 2024-09-21T06:05:51.387663+0000 front 2024-09-21T06:05:51.387723+0000 (oldest deadline 2024-09-21T06:06:17.287582+0000) 2024-09-21T06:06:24.718 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:24 smithi119 podman[69069]: 2024-09-21 06:06:24.511006689 +0000 UTC m=+5.544553753 container died 0c1423556edf5b835ad9aff633aeab7f00ec4e428c1bd5bfa17dc89e6503f7f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:06:25.034 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:24 smithi119 podman[69069]: 2024-09-21 06:06:24.81531041 +0000 UTC m=+5.848857483 container cleanup 0c1423556edf5b835ad9aff633aeab7f00ec4e428c1bd5bfa17dc89e6503f7f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T06:06:25.034 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:24 smithi119 bash[69069]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11 2024-09-21T06:06:25.341 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:25 smithi119 podman[69084]: 2024-09-21 06:06:25.033290531 +0000 UTC m=+0.522545325 container remove 0c1423556edf5b835ad9aff633aeab7f00ec4e428c1bd5bfa17dc89e6503f7f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T06:06:25.646 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:25 smithi119 podman[69175]: 2024-09-21 06:06:25.342452605 +0000 UTC m=+0.103445504 container create 5c200617254ebedb95ac89f66bc1fef5ac45d8dfafe2620218bda89b38a14845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T06:06:25.646 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:25 smithi119 podman[69175]: 2024-09-21 06:06:25.254730011 +0000 UTC m=+0.015722914 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:06:25.646 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:25 smithi119 podman[69175]: 2024-09-21 06:06:25.561440408 +0000 UTC m=+0.322433314 container init 5c200617254ebedb95ac89f66bc1fef5ac45d8dfafe2620218bda89b38a14845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T06:06:25.646 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:25 smithi119 podman[69175]: 2024-09-21 06:06:25.564808537 +0000 UTC m=+0.325801442 container start 5c200617254ebedb95ac89f66bc1fef5ac45d8dfafe2620218bda89b38a14845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T06:06:25.646 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:25 smithi119 podman[69175]: 2024-09-21 06:06:25.644759453 +0000 UTC m=+0.405752377 container attach 5c200617254ebedb95ac89f66bc1fef5ac45d8dfafe2620218bda89b38a14845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T06:06:26.032 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:25 smithi119 podman[69175]: 2024-09-21 06:06:25.747235542 +0000 UTC m=+0.508228445 container died 5c200617254ebedb95ac89f66bc1fef5ac45d8dfafe2620218bda89b38a14845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T06:06:26.243 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T06:06:26.306 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:26 smithi119 podman[69198]: 2024-09-21 06:06:26.22309645 +0000 UTC m=+0.470009146 container remove 5c200617254ebedb95ac89f66bc1fef5ac45d8dfafe2620218bda89b38a14845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-osd-11-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T06:06:26.306 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:26 smithi119 systemd[1]: ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.11.service: Deactivated successfully. 2024-09-21T06:06:26.306 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:26 smithi119 systemd[1]: Stopped Ceph osd.11 for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T06:06:26.307 INFO:journalctl@ceph.osd.11.smithi119.stdout:Sep 21 06:06:26 smithi119 systemd[1]: ceph-397810bc-77dc-11ef-baf5-efdc52797490@osd.11.service: Consumed 15.308s CPU time. 2024-09-21T06:06:26.321 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:26.321 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T06:06:26.322 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T06:06:26.322 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.a 2024-09-21T06:06:26.619 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:06:26 smithi007 systemd[1]: Stopping Ceph mds.a for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:26.886 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:06:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-a[73374]: 2024-09-21T06:06:26.617+0000 7fe0207cf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:26.886 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:06:26 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-a[73374]: 2024-09-21T06:06:26.617+0000 7fe0207cf640 -1 mds.a *** got signal Terminated *** 2024-09-21T06:06:30.019 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:06:29 smithi007 podman[112988]: 2024-09-21 06:06:29.764955462 +0000 UTC m=+3.248435881 container died c90d9e0c0da3929170a06614ad30fcbaf5dc66a53ed29edd501f31ee47b452fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-a, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T06:06:30.318 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:06:30 smithi007 podman[112988]: 2024-09-21 06:06:30.192237327 +0000 UTC m=+3.675717777 container cleanup c90d9e0c0da3929170a06614ad30fcbaf5dc66a53ed29edd501f31ee47b452fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T06:06:30.318 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:06:30 smithi007 bash[112988]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-a 2024-09-21T06:06:30.641 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T06:06:30.664 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:06:30 smithi007 podman[113015]: 2024-09-21 06:06:30.393645338 +0000 UTC m=+0.626506831 container remove c90d9e0c0da3929170a06614ad30fcbaf5dc66a53ed29edd501f31ee47b452fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-a, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T06:06:30.664 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:06:30 smithi007 systemd[1]: ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.a.service: Deactivated successfully. 2024-09-21T06:06:30.664 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:06:30 smithi007 systemd[1]: Stopped Ceph mds.a for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T06:06:30.664 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:06:30 smithi007 systemd[1]: ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.a.service: Consumed 1.102s CPU time. 2024-09-21T06:06:30.679 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:30.679 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T06:06:30.679 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T06:06:30.679 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.d 2024-09-21T06:06:30.999 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:06:30 smithi007 systemd[1]: Stopping Ceph mds.d for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:31.318 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:06:30 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-d[72359]: 2024-09-21T06:06:30.996+0000 7f8d33df0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:31.318 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:06:30 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-d[72359]: 2024-09-21T06:06:30.996+0000 7f8d33df0640 -1 mds.d *** got signal Terminated *** 2024-09-21T06:06:32.249 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:06:31 smithi007 podman[113120]: 2024-09-21 06:06:31.992476022 +0000 UTC m=+1.088440371 container died 4195a80c7f363ee48600f0e981e08e7c3eadbcf7b1622148ccec6b9c38ed5c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-d, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T06:06:32.568 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:06:32 smithi007 podman[113120]: 2024-09-21 06:06:32.405117294 +0000 UTC m=+1.501081684 container cleanup 4195a80c7f363ee48600f0e981e08e7c3eadbcf7b1622148ccec6b9c38ed5c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-d, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T06:06:32.660 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:06:32 smithi007 bash[113120]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-d 2024-09-21T06:06:32.843 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T06:06:32.866 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:06:32 smithi007 podman[113132]: 2024-09-21 06:06:32.614949531 +0000 UTC m=+0.621375430 container remove 4195a80c7f363ee48600f0e981e08e7c3eadbcf7b1622148ccec6b9c38ed5c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-d, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T06:06:32.866 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:06:32 smithi007 systemd[1]: ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.d.service: Deactivated successfully. 2024-09-21T06:06:32.867 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:06:32 smithi007 systemd[1]: Stopped Ceph mds.d for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T06:06:32.867 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:06:32 smithi007 systemd[1]: ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.d.service: Consumed 1.099s CPU time. 2024-09-21T06:06:32.876 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:32.876 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T06:06:32.877 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T06:06:32.877 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.g 2024-09-21T06:06:33.194 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:06:32 smithi007 systemd[1]: Stopping Ceph mds.g for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:33.568 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:06:33 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-g[73100]: 2024-09-21T06:06:33.192+0000 7fc411279640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:33.568 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:06:33 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-g[73100]: 2024-09-21T06:06:33.192+0000 7fc411279640 -1 mds.g *** got signal Terminated *** 2024-09-21T06:06:35.445 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:06:35 smithi007 podman[113240]: 2024-09-21 06:06:35.182425985 +0000 UTC m=+2.085468073 container died c668caa707e3abc88d456ceab9a7d40d4f54545087f76cf4cb3ad16bf23000ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-g, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T06:06:35.794 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:06:35 smithi007 podman[113240]: 2024-09-21 06:06:35.567346292 +0000 UTC m=+2.470388425 container cleanup c668caa707e3abc88d456ceab9a7d40d4f54545087f76cf4cb3ad16bf23000ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T06:06:35.795 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:06:35 smithi007 bash[113240]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-g 2024-09-21T06:06:35.946 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T06:06:35.979 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:35.979 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T06:06:35.979 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T06:06:35.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.j 2024-09-21T06:06:36.318 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:06:36 smithi007 systemd[1]: Stopping Ceph mds.j for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:36.318 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:06:36 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-j[71979]: 2024-09-21T06:06:36.304+0000 7fbc4d707640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:36.318 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:06:36 smithi007 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-j[71979]: 2024-09-21T06:06:36.304+0000 7fbc4d707640 -1 mds.j *** got signal Terminated *** 2024-09-21T06:06:40.568 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:06:40 smithi007 podman[113359]: 2024-09-21 06:06:40.313373243 +0000 UTC m=+4.106565333 container died d7598d5edaafc33afa17e6bba6504f97fdc88b1e05e9f0bad4dc533ffdc73877 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-j, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T06:06:41.068 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:06:40 smithi007 podman[113359]: 2024-09-21 06:06:40.67967077 +0000 UTC m=+4.472862860 container cleanup d7598d5edaafc33afa17e6bba6504f97fdc88b1e05e9f0bad4dc533ffdc73877 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-j, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T06:06:41.068 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:06:40 smithi007 bash[113359]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-j 2024-09-21T06:06:41.266 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T06:06:41.299 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:41.300 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T06:06:41.300 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T06:06:41.300 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.b 2024-09-21T06:06:41.586 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 06:06:41 smithi027 systemd[1]: Stopping Ceph mds.b for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:41.976 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 06:06:41 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-b[62758]: 2024-09-21T06:06:41.582+0000 7f93ea176640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:41.976 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 06:06:41 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-b[62758]: 2024-09-21T06:06:41.582+0000 7f93ea176640 -1 mds.b *** got signal Terminated *** 2024-09-21T06:06:45.726 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 06:06:45 smithi027 podman[67169]: 2024-09-21 06:06:45.461687327 +0000 UTC m=+3.962556525 container died efeb32a1386f42c38389a0ecd6922f006184348cd9a9fa6117db2755a5bcb697 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-b, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T06:06:46.102 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 06:06:45 smithi027 podman[67169]: 2024-09-21 06:06:45.841605404 +0000 UTC m=+4.342474634 container cleanup efeb32a1386f42c38389a0ecd6922f006184348cd9a9fa6117db2755a5bcb697 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T06:06:46.102 INFO:journalctl@ceph.mds.b.smithi027.stdout:Sep 21 06:06:45 smithi027 bash[67169]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-b 2024-09-21T06:06:46.278 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T06:06:46.316 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:46.316 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T06:06:46.316 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T06:06:46.316 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.e 2024-09-21T06:06:46.726 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 06:06:46 smithi027 systemd[1]: Stopping Ceph mds.e for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:47.226 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 06:06:46 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-e[62203]: 2024-09-21T06:06:46.777+0000 7fa4940e9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:47.226 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 06:06:46 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-e[62203]: 2024-09-21T06:06:46.778+0000 7fa4940e9640 -1 mds.e *** got signal Terminated *** 2024-09-21T06:06:50.905 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 06:06:50 smithi027 podman[67302]: 2024-09-21 06:06:50.523404782 +0000 UTC m=+3.983009630 container died 083fb9d6ae63481d03dba2f0383963f40a7a745df0af26e500fb162bf15bc567 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-21T06:06:51.164 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 06:06:50 smithi027 podman[67302]: 2024-09-21 06:06:50.962008733 +0000 UTC m=+4.421613584 container cleanup 083fb9d6ae63481d03dba2f0383963f40a7a745df0af26e500fb162bf15bc567 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:06:51.164 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 06:06:50 smithi027 bash[67302]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-e 2024-09-21T06:06:51.411 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T06:06:51.433 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 06:06:51 smithi027 podman[67314]: 2024-09-21 06:06:51.162914086 +0000 UTC m=+0.639640686 container remove 083fb9d6ae63481d03dba2f0383963f40a7a745df0af26e500fb162bf15bc567 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T06:06:51.433 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 06:06:51 smithi027 systemd[1]: ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.e.service: Deactivated successfully. 2024-09-21T06:06:51.433 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 06:06:51 smithi027 systemd[1]: Stopped Ceph mds.e for 397810bc-77dc-11ef-baf5-efdc52797490. 2024-09-21T06:06:51.434 INFO:journalctl@ceph.mds.e.smithi027.stdout:Sep 21 06:06:51 smithi027 systemd[1]: ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.e.service: Consumed 1.122s CPU time. 2024-09-21T06:06:51.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:51.445 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T06:06:51.445 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T06:06:51.445 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.h 2024-09-21T06:06:51.726 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 06:06:51 smithi027 systemd[1]: Stopping Ceph mds.h for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:52.226 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 06:06:51 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-h[62473]: 2024-09-21T06:06:51.824+0000 7ff007dff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:52.226 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 06:06:51 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-h[62473]: 2024-09-21T06:06:51.824+0000 7ff007dff640 -1 mds.h *** got signal Terminated *** 2024-09-21T06:06:53.726 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 06:06:53 smithi027 podman[67424]: 2024-09-21 06:06:53.463768546 +0000 UTC m=+1.799638523 container died c33e1a46a8c1ed5d6bfb28099cb88d1edbb1b6db6b2cc7a730054f20689a503a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-h, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T06:06:54.085 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 06:06:53 smithi027 podman[67424]: 2024-09-21 06:06:53.832416567 +0000 UTC m=+2.168286540 container cleanup c33e1a46a8c1ed5d6bfb28099cb88d1edbb1b6db6b2cc7a730054f20689a503a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-h, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:06:54.085 INFO:journalctl@ceph.mds.h.smithi027.stdout:Sep 21 06:06:53 smithi027 bash[67424]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-h 2024-09-21T06:06:54.236 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T06:06:54.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:54.270 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T06:06:54.271 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T06:06:54.271 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.k 2024-09-21T06:06:54.726 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 06:06:54 smithi027 systemd[1]: Stopping Ceph mds.k for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:54.726 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 06:06:54 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-k[61916]: 2024-09-21T06:06:54.585+0000 7fcd6d76d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:54.726 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 06:06:54 smithi027 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-k[61916]: 2024-09-21T06:06:54.585+0000 7fcd6d76d640 -1 mds.k *** got signal Terminated *** 2024-09-21T06:06:57.976 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 06:06:57 smithi027 podman[67544]: 2024-09-21 06:06:57.702269363 +0000 UTC m=+3.213555298 container died 7821dfe3d882303147fb99f73db412d1cc4053d23a01081de6f5dafad61cb3db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:06:58.288 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 06:06:58 smithi027 podman[67544]: 2024-09-21 06:06:58.085884136 +0000 UTC m=+3.597170059 container cleanup 7821dfe3d882303147fb99f73db412d1cc4053d23a01081de6f5dafad61cb3db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-k, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T06:06:58.290 INFO:journalctl@ceph.mds.k.smithi027.stdout:Sep 21 06:06:58 smithi027 bash[67544]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-k 2024-09-21T06:06:58.415 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T06:06:58.448 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:58.448 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T06:06:58.449 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T06:06:58.449 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.c 2024-09-21T06:06:58.832 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 06:06:58 smithi119 systemd[1]: Stopping Ceph mds.c for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:59.087 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 06:06:58 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-c[64413]: 2024-09-21T06:06:58.830+0000 7f70a045c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:59.087 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 06:06:58 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-c[64413]: 2024-09-21T06:06:58.830+0000 7f70a045c640 -1 mds.c *** got signal Terminated *** 2024-09-21T06:07:01.749 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 06:07:01 smithi119 podman[69278]: 2024-09-21 06:07:01.458813942 +0000 UTC m=+2.819508860 container died 0c730a46804ac24c7d8bc1c54bf66eda917a6fce4d338660e67393692a1e45b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-c, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T06:07:02.082 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 06:07:01 smithi119 podman[69278]: 2024-09-21 06:07:01.838653803 +0000 UTC m=+3.199348719 container cleanup 0c730a46804ac24c7d8bc1c54bf66eda917a6fce4d338660e67393692a1e45b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:07:02.083 INFO:journalctl@ceph.mds.c.smithi119.stdout:Sep 21 06:07:01 smithi119 bash[69278]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-c 2024-09-21T06:07:02.213 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T06:07:02.249 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:02.249 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T06:07:02.249 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T06:07:02.249 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.f 2024-09-21T06:07:02.591 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 06:07:02 smithi119 systemd[1]: Stopping Ceph mds.f for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:02.591 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 06:07:02 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-f[64144]: 2024-09-21T06:07:02.574+0000 7f7db677f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:02.591 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 06:07:02 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-f[64144]: 2024-09-21T06:07:02.574+0000 7f7db677f640 -1 mds.f *** got signal Terminated *** 2024-09-21T06:07:05.736 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 06:07:05 smithi119 podman[69412]: 2024-09-21 06:07:05.464444184 +0000 UTC m=+2.990949925 container died 7fde12298b052c2a1778aed97d2c2436f323a4b92157a2fbd331b4cdfd4e1b21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-f, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:07:06.091 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 06:07:05 smithi119 podman[69412]: 2024-09-21 06:07:05.833702614 +0000 UTC m=+3.360208355 container cleanup 7fde12298b052c2a1778aed97d2c2436f323a4b92157a2fbd331b4cdfd4e1b21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:07:06.091 INFO:journalctl@ceph.mds.f.smithi119.stdout:Sep 21 06:07:05 smithi119 bash[69412]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-f 2024-09-21T06:07:06.238 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T06:07:06.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:06.270 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T06:07:06.270 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T06:07:06.270 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.i 2024-09-21T06:07:06.572 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 21 06:07:06 smithi119 systemd[1]: Stopping Ceph mds.i for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:06.841 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 21 06:07:06 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-i[64682]: 2024-09-21T06:07:06.569+0000 7f97b5f93640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:06.841 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 21 06:07:06 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-i[64682]: 2024-09-21T06:07:06.569+0000 7f97b5f93640 -1 mds.i *** got signal Terminated *** 2024-09-21T06:07:09.756 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 21 06:07:09 smithi119 podman[69534]: 2024-09-21 06:07:09.469142444 +0000 UTC m=+2.987478653 container died b4ccc69700e7df5116383547304a66a671373d4761481283f58aefeaeadcad84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-i, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T06:07:10.091 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 21 06:07:09 smithi119 podman[69534]: 2024-09-21 06:07:09.853970647 +0000 UTC m=+3.372306844 container cleanup b4ccc69700e7df5116383547304a66a671373d4761481283f58aefeaeadcad84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-i, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:07:10.091 INFO:journalctl@ceph.mds.i.smithi119.stdout:Sep 21 06:07:09 smithi119 bash[69534]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-i 2024-09-21T06:07:10.269 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T06:07:10.301 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:10.302 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T06:07:10.302 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T06:07:10.302 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.l 2024-09-21T06:07:10.625 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 06:07:10 smithi119 systemd[1]: Stopping Ceph mds.l for 397810bc-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:11.091 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 06:07:10 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-l[63875]: 2024-09-21T06:07:10.623+0000 7f243fd12640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:11.091 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 06:07:10 smithi119 ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-l[63875]: 2024-09-21T06:07:10.623+0000 7f243fd12640 -1 mds.l *** got signal Terminated *** 2024-09-21T06:07:13.742 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 06:07:13 smithi119 podman[69658]: 2024-09-21 06:07:13.462737025 +0000 UTC m=+2.945427114 container died 1509638beea9980ae404427b12f25a8c94f22cbe1b8e2640e847b552f3d79d57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-l, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:07:14.042 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 06:07:13 smithi119 podman[69658]: 2024-09-21 06:07:13.840660559 +0000 UTC m=+3.323350637 container cleanup 1509638beea9980ae404427b12f25a8c94f22cbe1b8e2640e847b552f3d79d57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T06:07:14.043 INFO:journalctl@ceph.mds.l.smithi119.stdout:Sep 21 06:07:13 smithi119 bash[69658]: ceph-397810bc-77dc-11ef-baf5-efdc52797490-mds-l 2024-09-21T06:07:14.187 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-397810bc-77dc-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T06:07:14.218 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:14.219 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T06:07:14.219 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 397810bc-77dc-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:07:14.435 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T06:07:17.011 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 397810bc-77dc-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:07:17.231 INFO:teuthology.orchestra.run.smithi027.stdout:Deleting cluster with fsid: 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T06:07:19.767 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 397810bc-77dc-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:07:19.967 INFO:teuthology.orchestra.run.smithi119.stdout:Deleting cluster with fsid: 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T06:07:22.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:07:22.357 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:07:22.391 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:07:22.419 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T06:07:22.421 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913503/remote/smithi007/crash 2024-09-21T06:07:22.421 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:07:22.459 INFO:teuthology.orchestra.run.smithi007.stderr:tar: /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:07:22.459 INFO:teuthology.orchestra.run.smithi007.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:07:22.461 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913503/remote/smithi027/crash 2024-09-21T06:07:22.461 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:07:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:tar: /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:07:22.500 INFO:teuthology.orchestra.run.smithi027.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:07:22.501 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913503/remote/smithi119/crash 2024-09-21T06:07:22.502 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:07:22.536 INFO:teuthology.orchestra.run.smithi119.stderr:tar: /var/lib/ceph/397810bc-77dc-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:07:22.536 INFO:teuthology.orchestra.run.smithi119.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:07:22.537 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T06:07:22.537 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T06:07:22.577 INFO:tasks.cephadm:Compressing logs... 2024-09-21T06:07:22.577 DEBUG:teuthology.orchestra.run.smithi007:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:07:22.620 DEBUG:teuthology.orchestra.run.smithi027:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:07:22.622 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:07:22.644 INFO:teuthology.orchestra.run.smithi007.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T06:07:22.645 INFO:teuthology.orchestra.run.smithi007.stderr:: No such file or directory 2024-09-21T06:07:22.645 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T06:07:22.646 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.0.log: -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:07:22.646 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:07:22.646 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T06:07:22.646 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:07:22.649 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.audit.log: /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T06:07:22.649 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T06:07:22.649 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T06:07:22.649 INFO:teuthology.orchestra.run.smithi007.stderr: 83.8% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:07:22.649 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:07:22.652 INFO:teuthology.orchestra.run.smithi119.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:07:22.652 INFO:teuthology.orchestra.run.smithi119.stderr:: No such file or directory 2024-09-21T06:07:22.652 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:07:22.652 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T06:07:22.652 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T06:07:22.652 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:07:22.652 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T06:07:22.652 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T06:07:22.652 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log: /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose 80.7% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:07:22.652 INFO:teuthology.orchestra.run.smithi119.stderr: -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T06:07:22.652 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:07:22.652 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 90.2% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:07:22.653 INFO:teuthology.orchestra.run.smithi119.stderr: --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T06:07:22.653 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T06:07:22.655 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.l.log: /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.log: 87.5% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:07:22.655 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T06:07:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.6.log: 90.1% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:07:22.658 INFO:teuthology.orchestra.run.smithi007.stderr: 95.0% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T06:07:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T06:07:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T06:07:22.658 INFO:teuthology.orchestra.run.smithi007.stderr: 95.0%/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.d.log: -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T06:07:22.658 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:07:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T06:07:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:: No such file or directory 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.audit.log: 90.2% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log: 80.7% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:07:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:07:22.661 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mgr.y.log: 94.9% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T06:07:22.661 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:07:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.j.log: 90.9% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:07:22.662 INFO:teuthology.orchestra.run.smithi007.stderr: 95.0% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T06:07:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:07:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 95.1% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T06:07:22.665 INFO:teuthology.orchestra.run.smithi027.stderr: 91.0% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:07:22.665 INFO:teuthology.orchestra.run.smithi027.stderr: 92.4% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T06:07:22.666 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T06:07:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T06:07:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T06:07:22.668 INFO:teuthology.orchestra.run.smithi007.stderr: 94.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:07:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mon.b.log: 87.5% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:07:22.670 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T06:07:22.677 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:07:22.678 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mgr.z.log: 92.5% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T06:07:22.684 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T06:07:22.684 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.e.log: 94.9% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T06:07:22.692 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:07:22.696 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:07:22.708 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:07:22.735 INFO:teuthology.orchestra.run.smithi119.stderr: 94.3% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T06:07:22.740 INFO:teuthology.orchestra.run.smithi027.stderr: 92.5% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T06:07:22.754 INFO:teuthology.orchestra.run.smithi027.stderr: 94.4% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T06:07:22.764 INFO:teuthology.orchestra.run.smithi119.stderr: 92.8% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T06:07:22.824 INFO:teuthology.orchestra.run.smithi119.stderr: 93.8% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T06:07:22.996 INFO:teuthology.orchestra.run.smithi119.stderr: 91.7% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T06:07:23.018 INFO:teuthology.orchestra.run.smithi007.stderr: 90.4% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T06:07:23.143 INFO:teuthology.orchestra.run.smithi027.stderr: 91.8% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T06:07:23.176 INFO:teuthology.orchestra.run.smithi119.stderr: 92.6% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T06:07:23.529 INFO:teuthology.orchestra.run.smithi007.stderr: 90.3% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T06:07:23.545 INFO:teuthology.orchestra.run.smithi007.stderr: 93.4% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T06:07:23.556 INFO:teuthology.orchestra.run.smithi119.stderr: 93.2% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T06:07:23.570 INFO:teuthology.orchestra.run.smithi007.stderr: 93.1% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T06:07:23.659 INFO:teuthology.orchestra.run.smithi027.stderr: 93.7% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T06:07:23.664 INFO:teuthology.orchestra.run.smithi027.stderr: 93.3% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T06:07:23.706 INFO:teuthology.orchestra.run.smithi119.stderr: 93.3% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T06:07:23.822 INFO:teuthology.orchestra.run.smithi027.stderr: 93.3% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T06:07:23.844 INFO:teuthology.orchestra.run.smithi119.stderr: 93.9% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T06:07:23.896 INFO:teuthology.orchestra.run.smithi027.stderr: 93.3% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T06:07:23.898 INFO:teuthology.orchestra.run.smithi027.stderr: 2024-09-21T06:07:23.898 INFO:teuthology.orchestra.run.smithi027.stderr:real 0m1.261s 2024-09-21T06:07:23.898 INFO:teuthology.orchestra.run.smithi027.stderr:user 0m4.961s 2024-09-21T06:07:23.899 INFO:teuthology.orchestra.run.smithi027.stderr:sys 0m0.202s 2024-09-21T06:07:23.932 INFO:teuthology.orchestra.run.smithi007.stderr: 93.1% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T06:07:24.108 INFO:teuthology.orchestra.run.smithi119.stderr: 93.3% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T06:07:24.108 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-21T06:07:24.108 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m1.472s 2024-09-21T06:07:24.108 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m5.593s 2024-09-21T06:07:24.108 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m0.195s 2024-09-21T06:07:24.400 INFO:teuthology.orchestra.run.smithi007.stderr: 93.7% -- replaced with /var/log/ceph/397810bc-77dc-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T06:07:24.401 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T06:07:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:real 0m1.768s 2024-09-21T06:07:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:user 0m5.948s 2024-09-21T06:07:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:sys 0m0.214s 2024-09-21T06:07:24.402 INFO:tasks.cephadm:Archiving logs... 2024-09-21T06:07:24.402 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913503/remote/smithi007/log 2024-09-21T06:07:24.404 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:07:25.479 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913503/remote/smithi027/log 2024-09-21T06:07:25.480 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:07:26.183 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913503/remote/smithi119/log 2024-09-21T06:07:26.183 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:07:26.945 INFO:tasks.cephadm:Removing cluster... 2024-09-21T06:07:26.945 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 397810bc-77dc-11ef-baf5-efdc52797490 --force 2024-09-21T06:07:27.159 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T06:07:27.429 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 397810bc-77dc-11ef-baf5-efdc52797490 --force 2024-09-21T06:07:27.643 INFO:teuthology.orchestra.run.smithi027.stdout:Deleting cluster with fsid: 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T06:07:27.917 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 397810bc-77dc-11ef-baf5-efdc52797490 --force 2024-09-21T06:07:28.118 INFO:teuthology.orchestra.run.smithi119.stdout:Deleting cluster with fsid: 397810bc-77dc-11ef-baf5-efdc52797490 2024-09-21T06:07:28.404 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T06:07:28.404 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:07:28.424 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:07:28.441 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:07:28.457 INFO:tasks.cephadm:Teardown complete 2024-09-21T06:07:28.457 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T06:07:28.473 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T06:07:28.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:07:28.477 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:07:28.483 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:07:28.594 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T06:07:28.605 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T06:07:28.605 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:07:28.608 DEBUG:teuthology.orchestra.run.smithi027:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:07:28.611 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:07:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:07:28.624 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:07:28.625 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:07:28.628 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:07:28.628 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2024-09-21T06:07:28.628 INFO:teuthology.orchestra.run.smithi027.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 -215us[ -213us] +/- 48ms 2024-09-21T06:07:28.628 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 +471us[ +472us] +/- 55ms 2024-09-21T06:07:28.628 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 -293us[ -293us] +/- 59ms 2024-09-21T06:07:28.628 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:07:28.630 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:07:28.630 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-21T06:07:28.630 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 -209us[ -211us] +/- 48ms 2024-09-21T06:07:28.630 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 +468us[ +468us] +/- 55ms 2024-09-21T06:07:28.630 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 -278us[ -279us] +/- 59ms 2024-09-21T06:07:28.630 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:07:28.630 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:07:28.630 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-09-21T06:07:28.630 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 -217us[ -212us] +/- 48ms 2024-09-21T06:07:28.630 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 +466us[ +466us] +/- 55ms 2024-09-21T06:07:28.631 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -288us[ -288us] +/- 59ms 2024-09-21T06:07:28.631 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:07:28.631 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T06:07:28.643 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T06:07:28.643 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T06:07:28.655 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:07:28.764 DEBUG:teuthology.orchestra.run.smithi027:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:07:28.834 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:07:28.901 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:07:28.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:07:28.933 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:07:28.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:07:28.964 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:07:28.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:07:28.992 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T06:07:29.003 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T06:07:29.019 INFO:teuthology.task.internal:Duration was 1881.879729 seconds 2024-09-21T06:07:29.020 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T06:07:29.032 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T06:07:29.033 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:07:29.035 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:07:29.038 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:07:29.078 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:07:29.078 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:07:29.078 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:07:29.516 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T06:07:29.516 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T06:07:29.517 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:07:29.541 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi027.front.sepia.ceph.com 2024-09-21T06:07:29.541 DEBUG:teuthology.orchestra.run.smithi027:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:07:29.579 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-09-21T06:07:29.580 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:07:29.605 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T06:07:29.605 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:07:29.607 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:07:29.623 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:07:29.672 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T06:07:29.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:07:29.678 DEBUG:teuthology.orchestra.run.smithi027:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:07:29.691 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:07:31.056 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T06:07:31.069 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T06:07:31.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:07:31.094 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:07:31.126 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:07:31.156 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T06:07:31.168 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:07:31.170 DEBUG:teuthology.orchestra.run.smithi027:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:07:31.173 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:07:31.191 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-09-21T06:07:31.198 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = core 2024-09-21T06:07:31.223 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-09-21T06:07:31.281 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:07:31.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:07:31.297 DEBUG:teuthology.orchestra.run.smithi027:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:07:31.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:07:31.313 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:07:31.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:07:31.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T06:07:31.355 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T06:07:31.356 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913503/remote/smithi007 2024-09-21T06:07:31.356 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:07:31.420 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913503/remote/smithi027 2024-09-21T06:07:31.420 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:07:31.459 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913503/remote/smithi119 2024-09-21T06:07:31.459 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:07:31.497 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T06:07:31.497 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:07:31.500 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:07:31.502 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:07:31.547 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T06:07:31.566 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T06:07:31.566 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T06:07:31.589 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T06:07:31.589 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:07:31.591 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:07:31.594 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:07:31.605 INFO:teuthology.orchestra.run.smithi007.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:07 /home/ubuntu/cephtest 2024-09-21T06:07:31.608 INFO:teuthology.orchestra.run.smithi027.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:07 /home/ubuntu/cephtest 2024-09-21T06:07:31.609 INFO:teuthology.orchestra.run.smithi119.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:07 /home/ubuntu/cephtest 2024-09-21T06:07:31.610 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T06:07:31.622 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T06:07:31.651 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/fsync-tester}} duration: 1881.879728794098 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T06:07:31.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:07:31.765 INFO:teuthology.run:pass